hold it/that against
idiomDefinition of hold it/that against
: to dislike (for a particular reason)
We disagree about many things, but I don't hold it/that against you.