You have not told us which OS / Web server you are using.
Take a look at Apache::MP3, if you had each user uploading to a unique directory you could use the Per-directory configuration variables to allow or deny downloading / streaming of the mp3 files.
zentra has done some great work with Perl regards creating flash with audio that you could look at also.