be the end of one
Be one's downfall, as in His heavy drinking may well be the end of him, or That math assignment will be the end of me. This phrase originally alluded to something that would cause someone's death. Today, while it may be used seriously (as in the first example), it more often is used more lightly (as in the second).