Jeremy Clarkson has responded to backlash over a post on X in which he confirmed he has banned all Labour MPs from his pub.