With as many machines as I have about, both at home and at work, fan noise is definatly NOISE!
I have invested fairly heavily into good, quiet as possible but still do the job fans and I can still hear them. Oh, and try replacing all the fans on your switches one day....not fun :)