But seriously, wouldn't it be more involved since we need to consider saving the program "state" and resume it somehow?

Not always. In fact, quite often, if you do the exec when you aren't in the middle of something, that is all the code you need. Servers usually process transactions and it is usually a bad idea to have your stuff break because critical data is stored nowhere other than the memory of some service.