Usually this is related to something like lighting, a ceiling room light on, you create a big shadow, and without the extra fish to show it's safe, it's easier to hide and then come out when the shadow is gone. This can happen from having summertime windows and such open or a TV etc.