in reply to HTML::Strip and UTF8 -- is there some way I can just skip all the "UTF8 only" entities?

Problem I'm having is html that has exotic characters like:
’
A possible source of such exoticism is MS and their use of x80-x9F for such characters (a range not used by either Latin1 or utf8). After a round trip through something like HTML::Entities they come back as a utf8 equivalent (e.g. 0x201C).

I've had several runs round the block with this myself.
See Fixing suspect characters in HTML for a possible approach.

Hope that helps.

  • Comment on Re: HTML::Strip and UTF8 -- is there some way I can just skip all the "UTF8 only" entities?
  • Download Code