I have been trying for several months to build a screen scraping application using LWP. Everything works just fine except a crucial module, using the LWP POST request to get back information from a form with POST action. Even that works fine with single character unicode, like languages with Western European alphabets. However it fails miserably with multibyte characters, sending back zeroes wherever there are multibyte characters. It thinks it has succeeded, and a count of the zero characters and the intervening spaces, commas, etc. shows that it knows the spacing of the characters, but nothing I have tried nor been advised on the Web to try works. It may be a bug in CPAN's version of LWP::UserAgent, but it might also be some hidden secret of which I...and apparently everyone else on the Web...is unaware of. HELP!

In reply to LWP: POST request by cw010000

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.