Do you mean that, the best way to solve this problem, is to have all the most frequently used data kept in the memory?

Maybe having concurrent queries won't save the total time of query, but at least I could avoid that my server could not do anything when waiting for query result. For example, the server might process some request that do not need DB queries while other connections are waiting for DB response.