I wrote a pair of spectrogram programs about a year ago, sound-to-image and vice versa. I did it in Fortran, which was actually very well-suited to the task.

Are you rolling the FFT code yourself?