I think this is the inherent flaw with SEO. It caters to robots, all kinds of robots, with all kinds of names. So the question you should be asking yourself is whether your site is for robots or for human beings. Myself, I work on the basis of publishing content for human visitors because as far as I can remember, it's the human visitors who buy things and helps you to make money with your site.