The main problem is that, AFAICT, less doesn't support random access of the file when using a LESSOPEN filter.
The log files I want to colorize are very large, and it is impractical to colorize the entire file. Also, I want search to be performed on the raw contents, not the colorized version.