...Usually I'd say that it's because some like the quiet, but there's something 'off' about that library.

[ Speaking in that area didn't feel like it should be a thing, or rather it was a feeling he had everytime he considered it. So he wasn't fond of the place either. ]

I'm afraid in this case we'd be of the same opinion. Though at the least there are some books that are worth reading...if there's to be a bright side to that place at all.