Would you rather be doing Stone Tower Temple? Also, try using the Bunny Hood, and as Ken said earlier, use the Inverted Song of Time. And make sure you only stay in the barn area and shoot the closest ghosts.