You speak up you get branded a bigot and are either ostracized, alienated or straight up exiled from the community.
Unless you White or got JK Rowling money...then you can just tell people to EAD because you know there's nothing they can do about it because you're too powerful to destroy.
Chappelle is an example of this actually.
He stood on business and will undoubtedly sell out whatever show he has because there's nothing anyone can do about it.