Grey Hat SEO is the practice of using technically legal methods to improve your site rankings, but which are ethically dubious, and could one day become black hat. Think of it like legal highs.
In the words of SEO Consultant John Andrews, Gray Hat SEO is not something between Black Hat and White Hat, but rather "the practice of tactics/techniques which remain ill-defined by published material coming out of Google