Question: Does taking notes stop you from memorizing?

Hi everyone, I have a question: Does writing down notes make you less likely to memorize the material? I take notes, not summary notes, but everything the lecturer says. I do not plan on using them, except I want to make sure I remember everything the lecturer says, so I can ask questions in class, and so on. However, I feel like I am not retaining anything and I want to be able to remember the material. Should I just listen instead of taking notes?