i use htop. I did not see what you describe. All cores were active. Still we are talking about very small time intervals. In any event you now have some tools to debug this and confirm any suspicions you may have. For example taskset will report on the current cpu (relocations are common though).

bw, bliako