My husband (M47) won't let me (F35) have a pet because of his "grandfather clause". How can we agree on this?

You all come here for the dramatic stories, but sometimes us folks just need a little help with everyday issues. My fiancé and I (F30 & M36) have been together for over 7 years, married for 2, and are expecting our first baby in a few months. We are excited to finally start our family, but also aware of the adjustments that come with it. We've been reading up on things and watching videos to prepare ourselves. One of the videos was about preparing the home for a baby, and the tip was to make sure there are no hazardous or dangerous items within the baby's reach. This got me thinking about the cat. Of course, we know that cats can generally be aloof and less affectionate with young children, but it's still important to consider the possibility of them hissing/swatting/scratchin etc. even if it's out of fear or defense. My husband is very much against getting rid of our cat, who he loves very much. We agreed that when we have our baby, the cat will need to live in the guest bedroom when there's visitors in the home. But, we're unsure what to do when there's no visitors over. My thought is that the cat will need to avoid the area of the home where the baby is most active (not a room to room cat). His thought is that the cat should be free to go as it pleases. How do we compromise? Does the cat really need to be locked away in the guest bedroom at all times, or is my husband being paranoid? TIA!