“Red5 is a server that not only streams content to the Flash plugin, but
it can push calls and information to the Flash client! It can also
receive video/audio/data from a flash client and either save or
rebroadcast that content.”

This is something that is really worth a look. It should be able to stream mp3 on-demand as we require but of course the client will still be relying on the flash plugin.