if something withers on the vine, it is destroyed very gradually, usually because no one does anything to help or support it
Usage notes: Grapes (= small fruits used to make wine) which are still joined to the vine (= the plant on which grapes grow) die slowly.
Plans to create cheap housing for the poor seem doomed to wither on the vine.