No it doesn't. Its kind of clever when you think about it. It causes the opponent to lower their guard due to them not taking you seriously for using those characters, which can then allow you to pull unexpected moves. Using character like those requires skill in order to pull those moves, as others would just be discouraged by how weak they might seem at first.