You don't need to give world access to your files, why do you think so? If your virtual server space use SuExec, then every file uploaded to your space will be owned by you (your user on that server). Can you explain better your setup and what you think is a problem?