No, robots.txt only specifies pages on a server, and even theough it's a standard, some broken peices of cruft programming don't care for it. Wget cares, though. ;)

--
$Stalag99{"URL"}="http://stalag99.keenspace.com";