when one's back is turned

When one is away or not looking, as in You can count on the children to misbehave when the teacher's back is turned, or I don't dare go on vacation; he'll take my job when my back is turned. Also see when the cat's away, the mice will play.