Encode is "core" since perl 5.7.3 and handles pretty much any encoding you can think of. You should use it.

To write a file with a specific encoding, it's enough to do things like this: 

open (my $file_handle, '>:encoding(UTF-8)', $filename) or die $!;
print $file_handle $text_string;
close $file_handle;

[download]

(Update: I didn't see you already used that, sorry for the noise.)

Guessing character encodings can be done with Encode::Guess, but it can never be done reliably.

I know of no module that combines encoding guessing with file slurping, so it might be worth the effort. But don't roll any encoding handling code by hand, it's all been done before and properly tested.

See perluniintro, perlunitut and perlunicode for details, I also wrote a short article on the subject.

(Update: Fixed article link, thanks for reporting Rudif.

In reply to Re: Module to read - modify - write text files in any unicode encoding by moritz
in thread Module to read - modify - write text files in any unicode encoding by Rudif

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.