Sounds very much like synchronous disk accesses causing lock contention.

Changing to a proper database system would likely fix the issue. Beyond that thought, perhaps share some info such as number of hits, disk activity information, file permissions etc.