If you're basing your success on the number of friends you've gotten to follow you - you've failed.
Friends are going to follow you - they're your friends.
Friends, ironically are the first to also abandon you when they feel they've fulfilled the "friendly" duty.
Don't get mad at them. They probably never cared to begin with. They were just being good friends.
To truly gauge your influence - you need folks with no allegiance to you personally.
Friends are great but you really should count them as followers.