Any improvement of a few percent you may get out of the code by changes of that type are absolutely insignificant compared with improving your algorithm. But before you do anything else, figure out where to focus your energy - profile your code to see where it spends its time, then focus your efforts there.