I might be wrong, but I think it's trespassing, not adding, that gets you villagers. Friends are for sent moves and abilink. You can get more villagers by going to the save menus and pressing net invite every day to gain 3-5 villagers.