At first, you can let the situation go. But before too long, it’s out of control. Too much time has passed for you to just ask straight out. You could just take a stab, but there’s an almost 100% chance that you’ll be wrong.
Then, something happens and you know you can't let it go any longer.