Thank you all for your comments!
@zsharpfire thanks for the bug report! anyway, you can take it like a valid way to have fun by going through a backdoor, so congradulations!
@the-neon-shark good idea about reshuffling, but the core thing I wanted to achive is that players remember boxes they visited. "Aha I know what is it and where is it!" after taking a quest, that was my main design goal:) To explore and make unknown places familiar and cozy
@sezdev trying to take things without reading is also a valid way to beat the game, not so fun for sure. But if a player struggles with a riddle or do not want to read anything, why not?