Add or remove travelers assigned to a Travel Manager