The mysql query optimizer appears stupider than even what I expected. But I think I've convinced it to use an appropriate index so I'm hopeful that this problem is now mostly history. But we'll see.