[Himeko finds herself groaning in annoyance because she knows it's true, but still—]

Yes, that may be true, but doing it in such a way where other people can potentially find us and get caught is also a problem. If we want to go in places we're not supposed to, the point of doing so isn't to be brazen about it, or even obvious.