Quite frankly, I have begun to appreciate the phrase that, “at 100 billion ops a second, no one can hear you scream.”   I think that you should simply focus on writing clear, easily-maintainable code, done in some well-documented fashion which avoids the proliferation of “thousands of statements scattered all over the code, every one of which must be changed in exactly the same way at exactly the same time.”   You should give a passing thought to the one-and-only-one thing which might actually slow this program down, namely:   page faults.   But also carefully consider human effort required to maintain it going forward, weighed properly against the risk associated with inadequate testing or some maintenance oversight.