Rarely, yeah. Most tribes are pretty relaxed about who can join, and if someone tries to switch tribes and can't find one that will take them they can almost always go back to their original tribe, but rarely someone will do something to upset their tribe enough that the tribe wants them gone but not enough that they're quite willing to kick them out to die, and if someone in that situation can't find a new tribe at the next meetup...