If you're puzzled by this, you're not ready to stand on your own two feet. Just this one pointer: Lincoln Stein's excellent book Network Programming with Perl. It deals with this and related problems in several manners, see all of part 3.

Oh, and the technical answer is: fork, or multiplex. The server needs to be able to accept new connections while a converstation is going on.