Sockets?

I am trying to programme a simple chat application, but I am unsure about how sockets work. I want to know if I just have to start the server program, and the clients can join. Do you have to start the client program to start the server? So basically, how do sockets work. I believe the ones I am using are TCP.