Former Yorkshire and England cricketer Matthew Hoggard has claimed his life was “ruined” by the Azeem Rafiq racism scandal.