AITA for refusing to sit next to a man who sits on the floor?

So I 23m was on a train ride going home from a night out at a friends. Now I'm the kind of person who needs to sit where I can see everyone else. I don't know why it just makes me feel comfortable and safe. I sat next to a group of college students who were talking pretty loudly. They minded their own business and I minded mine. We even had a chat from time to time. Then a man came and tried to sit on the seat directly across from mine but it was taken by one of the college students. He tried to argue and talk to the conductor but he got angry and sat on the floor. I'm not sure why but he kept glaring at me and spacing me out. He kept trying to talk to me and the college students told him to leave me alone and I told him I wasn't interested in talking to him and he should head to another car and find a seat. He said I wasn't actin like a lady and I should do my job as a woman and help him. He then got up and came closer to me. I stood up and told him to back off. He got mad and told me I was acting like a BITCH and the college students got up and escorted me to a different car. I was really thankful but also felt bad for leaving him. AITA?