I think most legal bots, such as Googlebot and others, respect the robot rules convention. You can find more information on it here

For more information on how to remove the stuff already indexed by Google, try here

at the risk of sounding pedantic though, caching and indexing by crawlers are not exactly the same thing. To stop someone from caching pages, this would be a good site to start with....
HTH