If he corrected himself and said he wanted to say "mental midget" would that still be offensive to the National Organization of Little People?
Personally, being called a "little person" sounds more derogatory to me than midget or dwarf, but that's just me. Glad I have so many organizations and such telling me how to speak and not offend anyone. God forbid.