The word “them” is perfectly fine. Using it in a pejorative manner might make people uncomfortable, though. Try to avoid that. It’s really easy.