@digitalocean is pretty good. They have a WordPress image to get started with. The 4GB droplet is $40/mo.