have a rough patch
To experience or be in the midst of a period of trouble, difficulty, or hardship. Her business has had a bit of a rough patch lately. If things don't pick up soon, she might have to close shop. We had a rough patch in our marriage after Frank lost his job, but now, we love each other more than ever.