My intuition is that the impact is non-trivial. But very few users are affected, as the feature is only present in the nodelets of cabal members (iirc). Personally, I'm willing to pay the price in performance for the benefit of the feature. Maybe we should make it optional, via something in user settings?