finish (something) on a high note
To finish, complete, or leave (something) at a successful, impressive, or climactic point. I know we've had quite a few losses this season, but let's win this last game and finish on a high note! After winning the Oscar, she decided to finish her career on a high note.