Is it a bad thing that I (F20) am moved by the lovely words of a man (M22) with a small penis?

So I hooked up with this guy and he had a small penis, it was my first time seeing a penis irl but I could just tell that it was small. I wanted to make sure he knew I didn’t care about that kind of thing but he started telling me about how he was self conscious because of it and how he’s gotten made fun of and rejected before. He was getting really upset and I just wanted to make him feel better so I told him that my attraction and love for him wasn’t based on his penis size and I genuinely meant it. He was so touched by that and he told me that I’m the kindest and lovely girl he’s ever met. Then we had sex and he gave me my first ever orgasm and I love him for that. But I can’t help but feel bad that his penis size moved me so much.