Brown alleged in a new interview he was "often" made "to feel like an outsider" on the Netflix reality show.