May I answer this with your own words ;-) :

Ask yourself if your code is actually too slow for your purpose. Only if the answer is "yes", continue.

Perhaps I should mention that I interpreted his 'efficiency' more in terms of efficient coding than speed (which could be the wrong interpretation)