Ofcourse you can configure your ruleset, so SSH connections are only allowed from a certain (local) IP, which kinda minimizes the chances once again :)

As a personal touch: my firewall box is in my basement, I don't like spending time there alot :)

Greetz
Beatnik
... Quidquid perl dictum sit, altum viditur.