I lied to a man and he gave me his number

I was at this coffee shop with my mom and there was a guy sitting at a table by the window. He was staring at me and I didn’t think much of it but I noticed when he got up and walked over to the table I was sitting at. I asked him if he wanted to sit with us. He said no. Then I asked him why he sat at our table if he wasn’t gonna sit with us. He said he just did. Then I said he could sit at our table but he had to order coffee or something so he did. We ordered coffee and then he sat back down at his table by the window and we left after finishing our coffee. That was when he asked if I wanted his number and said we should meet up again. I told him I wasn’t interested. And he said okay. I think I was just being kind but he could have been trying to pick me up.