Selection bias, the people who don’t discriminate aren’t causing harm so you don’t notice them but since they don’t speak up they aren’t helping either, so the jerks are still setting the tone. The solution is to not just do the right thing but actively call people out the jerks.