Looking at the code, it seems that the only way this could happend is if you set the option RemotePort. It looks for options in a couple of places. First it looks for a file called (on windows) "perldb.ini" in the current directory, your home directory (if $ENV{HOME} is defined), or $ENV{LOGDIR} (if defined).
It then looks for an environment variable called PERLDB_OPTS.
Hope that helps.