They are not operators but variables. The $, is the string that gets printed between fields automatically, nothing by default. The $\ is what gets printed after allf fields, again nothing by default. If you set it to "\n", every print command will print a newline.

All these nice variables can be found in the perlvar documentation.