Automation Bias
Origin: Cognitive psychology (automation bias)
Definition
Automation bias refers to the tendency to trust automated systems at the expense of one’s own judgment. The individual delegates not only the execution of a task, but progressively the very direction of their thinking, by adopting the machine’s choices as if they were their own.
This bias is not a one-off, correctable error. It establishes itself insidiously, through repeated use, without the user perceiving the shift. It is a slow and nearly imperceptible reconfiguration of cognitive and creative faculties.
In my writings
Applied to creation, automation bias produces a specific perverse effect: the user who regularly relies on a generative model begins to validate formulations they would not have chosen, to adopt structures they would not have conceived, to build according to logics they would not have constructed. Progressively, they internalize the machine’s statistical preferences as their own.
This is a form of proletarianization that does not declare itself and is all the more difficult to perceive because it is accompanied by a feeling of comfort and efficiency. The user does not feel dispossessed: they feel assisted. That is where the pharmacological trap lies.
This bias is closely linked to the imperceptive: the adoption dynamic creates the conditions in which the bias takes hold undetected. And it ultimately produces a form of operative dispossession applied no longer just to professional reasoning but to thought itself.
The distinction between legitimate trust and automation bias is difficult to draw in practice — this is what makes it a pharmacological phenomenon: useful delegation and insidious dispossession follow the same paths.
Link to the devaluation of human judgment
This bias is part of a broader movement that I have analyzed through Mathieu Corteel’s formula: “we fundamentally no longer trust human judgment.” AI is placed on a pedestal while human intelligence is devalued on the pretext that it is less performant than the machine. Automation bias then ceases to be an individual cognitive accident: it becomes a cultural disposition, sustained by a dominant discourse that presents delegation to the machine as the exercise of superior lucidity.
Articles where this term is used
- From semantic ablation to attentional ablation
- Knowing without doing. Doing without knowing.
- Grammatize and observe.