in reply to HTML::Strip and UTF8 -- is there some way I can just skip all the "UTF8 only" entities?
Problem I'm having is html that has exotic characters like:A possible source of such exoticism is MS and their use of x80-x9F for such characters (a range not used by either Latin1 or utf8). After a round trip through something like HTML::Entities they come back as a utf8 equivalent (e.g. 0x201C).
’
I've had several runs round the block with this myself.
See Fixing suspect characters in HTML for a possible approach.
Hope that helps.
|
|---|