I don't think it's the end of the world, but Google definitely known when a server is hosted in the US for a .co.uk domain, I'm not sure what it does with this information but I wouldn't be surprised if it made the site drop a little in search engines.