i feel like leftovers is more the people who don’t fit in with other people at all. I’ve heard the term undesirables apply here though