I started with the Commodore 64, and doing something like fractals was just painfully slow.

It depended on precisely what you were doing with the fractals. Rescue on Fractalus! was released on the C64 (among many other platforms) and played fairly well AFAIR.