You are free to exit the Wizards' Hollow at any time in order to collect your accumulated rewards. The further you dare to progress, the better the rewards.