AITA for telling my boyfriend that I couldn't go fishing with him?

So, me (26F) and my boyfriend (27M) have been dating for two years, and we recently moved in together. I work in a library, and he works in a shop. He works on Tuesdays, but then has every Wednesday and Thursday off, while I get every Thursdays, Fridays and Saturdays off. My boyfriend loves to go fishing and I'm not super keen on it, but can tolerate it.<br><br>On Saturday, he said that the weather would be great on week days, and that I would like going fishing if I actually went, so I should come with him on Wednesday and Thursday. He said it would be fun, and that I should try new things. I said that I work on Wednesdays, but he said that I could easily call in sick for this one day, and we could make a trip out of it. I laughed and said no, but he was serious. I told him that my job is a priority, and that it's not always fun. I also said that I'm not really into fishing, and he was upset by that. I told him that I'd love to go fishing with him this weekend, and he said no, because we wouldn't be able to catch anything. I asked if we could go on Thursday, since I have that day off, and he just said that I never want to do things that he likes. I told him that that's not true, and that I'd love to spend some quality time with him together, and that I just don't like fishing very much.<br><br>He went to bed angry, and I don't know if I should apologise to him. AITA for telling him I couldn't go fishing with him every week?