Our favorite hosting platform of choice^tm at one point could specifically provide access to gcc, so you may want to just make a support request for that to your hosting company (and any other 'build' requirements). Beyond that, yes it's super cheap(er) and easier to go with your own VPS.