There is a simple test: is it too slow? If it is, pre-publish. Otherwise, don't.

By the way, if you're using a flexible web server like Apache you can make dynamic pages have any URL you like, including /my/static/page.html. Look at mod_rewrite or mod_perl for this.