Reliable vps provider depends on what you need. If you want linux vps or windows. I like cheap vps service located in country if i make sites for one country. If i make sites for world wide i just find a reliable vps that has no set up or upgrade fees and no vat taxes.
I also like buy cheap vps that has 30 day money back guarantee