It happens... As your follow count gets high, the probability of getting one who's impatient gets high too. It's better to have those who will stick around cause they like your content vs those who are there just to be entertained.