It's time we should be going.
a statement made by one member of a pair (or group) of guests to the other mem-ber(s), indicating a desire to leave. (Typically, a way for one person in a couple to signal the other, indicating a desire to leave.) Mr. Franklin looked at his wife and said softly, "It's time we should be going." Tom: Well, I suppose it's time we should be going. Mary: Yes, we really should. Alice: So early?