If I remember correctly I think that the green units that the enemy leader recruits won't move until you killed everyone who started as red, so you don't really have to pay them any mind until you killed everyone who started as red. But I might be wrong.