Why does this guy hate me so much?

I am in 8th grade and was riding my bus, listening to music and minding my own business. Then all of an sudden I see this guy in 7th grade, short and African American. (I don't know why I included that but I suppose it adds more detail to the story) I have seen him on the bus before, he boasts about his dream of being an rapper and such. He seems to get negative responses of people saying that he is stupid or that his dream won't happen. I feel very bad that he has to deal with everyone doubting him, no matter what his pion is. Sorry, I am getting off track. He sits an couple seats up from me and I see him mouthing words to me and has his eyes on me. I pause my music because it would be rude not to listen to him. Well, I caught an bit of rudeness once I paused. He called me an nerd and said "Look at that nerd, always going to school carrying an lunch box and watching Naruto." (I watch Anime sometimes while on my way to school) I then heard some people laughing at me. It made me feel very bad and down and it ruined my day before it even started. I felt terrible especially since I believe I am only kind to him and never judge yet he loves the people that hate him. How can I fix this? Am I being rash? Why does he feel that he has to be mean to me? I am so confused.