have the devil to pay

and have hell to pay

Inf. to have a great deal of trouble. (Use hell with caution.) If you cheat on your income taxes, you'll have the devil to pay. I came home after three in the morning and had hell to pay.