thorn in the flesh

A constant or persistent cause of annoyance, frustration, or trouble. My little brother is such a thorn in the flesh—he always wants to do stuff with me, especially when I'm trying to hang out with my friends.