go out on a high note
To finish, complete, or leave (something) at a successful, impressive, or climactic point. I know we've had quite a few losses this season, but let's win this last game and go out on a high note! After winning the Oscar, he decided to go out on a high note.