Hahaha, don't worry! Whatever works for you! Usually the 3 slowed down days should be enough to finish the temple with all fairies and with enough time to return them before the final night, if not... Having the temple's item allows you to skip several steps in case you need to return. Don't worry about the time and have fun :D