Confederate effect
Human error of identifying a human as machine
The confederate effect is the phenomenon of people falsely classifying human intelligence as machine (or artificial) intelligence during Turing tests. For example, in the Loebner Prize during which a tester conducts a text exchange with one human and one artificial-intelligence chatbot and is tasked to identify which is which, the confederate effect describes the tester inaccurately identifying the human as the machine.
The confederate effect is the reverse of the ELIZA effect, which Sherry Turkle states is humans' "more general tendency to treat responsive computer programs as more intelligent than they really are": that is, anthropomorphizing.
The phenomenon was seen in the University of Surrey 2003 Loebner Prize for Artificial Intelligence, when both confederate (tested) humans, one male and one female, were each ranked as machine by at least one judge. More precisely, Judge 7 and Judge 9 ranked the female 'Confederate 2' as "1.00=definitely a machine"; the male 'Confederate 1' was ranked "1.00=definitely a machine" by Judge 4 and Judge 9. Also, the gender of these two hidden-humans were incorrectly identified (male considered female; woman considered man) in independent transcript analysis ('gender-blurring' phenomenon, see Shah & Henry, 2005).
Sources and credits
This article is adapted from the Wikipedia article “Confederate effect”, written by its contributors and licensed under CC BY-SA 4.0. Fathomly has changed the layout, removed citation markers, navigation and maintenance notices, and adjusted punctuation. This adapted version is shared under the same license. For references, see the original article.
Fathomly is not affiliated with or endorsed by the Wikimedia Foundation. Spotted a problem? Tell us.