I think platforms like openshift and cloudfoundry could take this market away from heroku. They're opensource platforms as a service. At some point (when it's stable enough), then I hope enough providers will sell access to theese services. It's also perfect for hosting lots of diffrent programming languages and databases on your own server. But I think there is missing an opensource application store for deploying already made opensource applications to theese platforms.