go away empty-handed

Fig. to depart with nothing. I hate for you to go away empty-handed, but I cannot afford to contribute any money. They came hoping for some food, but they had to go away empty-handed.