be left holding the baby

(British) also be left holding the bag (American)

to suddenly have to deal with a difficult problem or responsibility because someone else has decided they do not want to deal with it He abandoned the project after a year because he felt that it was going to fail and I was left holding the baby.