This is a kind of problem that lends itself to clever hacks, but finding the right hack would require some more info on the nature of the strings. It's not human readable words is it?

The simplest thing that could possible work would be to create a hash tied to a file and read it all into that. That is so simple that you can very quickly assess whether that solution is fast enough or not.