I don't know. He sounds really needy. The fact that he ignores your feelings regarding spending time with him doesn't sound good to me.
Could you get your parents involved? Maybe if you tell them his attention is getting intrusive, they'd intervene for you.
And, you could always change your phone and tell your friends not give him the new #.
