Using a regexp to split the datastream between character sets makes perfect sense.

For the conversion between character sets you could opt to reuse the existing (core) module Encode and add a new encoding for each new character set that you would like to support.
See Encode::Encoding for instructions.

Using the Encode module is straight forward, some nice examples are given in the Unicode Tutorial on Perlmonks.