sit idly by

and stand idly by

to remain close, doing nothing to help. I do not intend to stand idly by while my children need my help. The wealthy man sat idly by while the poor people starved.