If you go to the menu and select 'active members', you can swap your character with other current party members just by selecting them and swapping with your character, then confirm. I think this can be done at any time. :-)