Is there basically no difference between a regular person and a psychopath?

I mean we all kind of seek our own pleasure, we just function well in society and understand that we need to get along with others and we want to because of things like empathy. But if you think about it, the only difference between us and psychopaths is that that have no empathy. I don’t know, maybe that’s not even true, but basically all of us are just seeking pleasure, but psychopaths have no problem with hurting others because they are incapable of feeling empathy. But I don’t think it’s something that I would be able to control, like if I just had no problem with hurting others, then I guess I would just always do that. Maybe it seems like I’m making no sense here, but I’m just wondering what you guys think.