To go without dinner. The phrase refers to the story of a man who, while visiting the tomb of Duke Humphrey of Gloucester, was locked in the abbey—and thus missed dinner. A: "Why are you so hungry? Didn't you eat dinner?" B: "No, I got stuck in a meeting, so I dined with Duke Humphrey!"