Having objects move at abitrary rates also brings up problems with collision detection etc. What type of terrain is this? What type of objects? How are they shaped?
I think making an arbitrary world model in Perl could be slow. It depends on what the criteria is though. How many frames per second do you need?