Get off my ass!

and Get off my tail! and Get off my back!

exclam. Leave me alone!; Stop following me!; Stop dogging me! (Usually objectionable.) Stop pestering me! Get off my ass! Get off my back! Go bug somebody else.