Detract

v. i.
  1. To take away a part or something, especially from one's credit; to lessen reputation; to derogate; to defame; -- often with from.