Make a lingering bad impression on one, as in The argument left a bad taste in my mouth, so after that I avoided talking politics. This expression transfers the bad taste left by consuming bitter or otherwise unpleasant food to a distasteful experience. [Mid-1800s]