An article described reviewing research articles for bias as a way to think about eliminating bias in assessments.
Main point: "More strategic use of AI systems — through what I call “blind taste tests” — can give us a fresh chance to identify and remove decision biases from the underlying algorithms even if we can’t remove them completely from our own habits of mind."
Basically, it controlling for variables that aren't significant. For example, would an article be more likely to be published just because the reviewers knew who the author was?
The article also gave the example of blind taste tests, describing how people preferred the taste of one drink if they knew the brand name but preferred the other drink if the brand names were hidden.
The article argued for "the value of creating blind taste tests for AI systems, to reduce or remove bias and promote fairer decisions and outcomes across contexts."
