eat (away) at (someone's) conscience

To increasingly cause or inspire troubled feelings of guilt, especially for an extended period of time. Stealing that money from my parents has been eating away at my conscience for the past month. Don't let it eat at your conscience, anyone would have done the same thing in that situation.