Hop to the left of the entrance of the deku castle/lair/thingy that I don't remember the name (where they are torturing the monkey and they only let you in if you're a deku scrub), you'll find a place with soil and a deku baba, and some grass at the back. There's a hole there, drop there and the guy will be in the hole.