I’m feeling hurt about my relationship and I’m not sure whether I should be feeling this way?

Silent heathen here. I(25f) have been with my boyfriend (24m) for four years and we’ve been living together for six months. I always knew that his mum dated a lot of people after his dad died. She had a few long-term relationships, and she had even more one night stands. I assumed this was her way of grieving. But my boyfriend is the product of a one night stand, and at some point in high school, he found out that his mum had a lot of one night stands. He told me that he doesn’t find it right for a mother to have one night stands, and said that they were disrespectful and that he’ll never be able to look them in the eye. I didn’t think much of it at first, but then I remembered that my parents were both the products of one night stands. Both of my parents were told by their parents that they were the products of a one night stand, and they always felt like they were disrespected and that their parents never wanted them. I know I’m being paranoid, but I genuinely feel hurt by his words. It’s like he’s saying that I’m disrespectful. I’ve wanted to go away for the holidays, but he’s been telling me that he won’t leave his family for the holidays when they need him the most. I feel like that’s not fair. I’m hurt but my logical side knows that he’s going through a tough time.