The reason That I am having two use inside the sub is that I am trying to utilize minimum possible RAN memory, since the moment that you call a module it is loaded in the memory (correct?).

Because use takes effect at compile time, it doesn't respect the ordinary flow control of the code being compiled. In particular, putting a use inside the false branch of a conditional doesn't prevent it from being processed.