behind (one's) back

In one's absence. The phrase typically suggests wrongdoing or deceit. I can't believe you were gossiping about me behind my back! Tom will be upset that we already made the decision behind his back.