Add another tier of directories for years YYYY or additionally also month MM and reorganize your files accordingly.

First globbing for relevant folders before parsing the files in pre-filtered places will keep your overhead relatively constant.

Of course nothing will beat an in memory search or SQL database after synchronizing all file names.