KiTalent · Research · Book From Socrates and the Machine
Introduction

Introduction

This is a short book, and the shortness is deliberate. It defends one claim against one opponent, and it tries to do so without the apparatus of a treatise. The reason is not haste. It is that the claim is best shown rather than surveyed, and that a single well-read case can carry what a long accumulation of argument would only dilute. The book is built around one recorded conversation. The conversation is the object, and the commentary is the reading of it. A longer book would have more material. It would not have a sharper object.

The work belongs to a program, and it is useful to say where it stands in that program before the reading begins. The first book, The Vectorized Afterlife of the They, argued that what we call artificial intelligence is not a new mind but the vectorized afterlife of public language, a recirculation of the anonymous talk that Heidegger named das Man, returned through computation as fluent output without the temporal life from which the language first came. A second book, Executive Search as Erfahrung, argued that generated representation is not professional judgment, and that the encounter with a person cannot be replaced by the processing of a profile, because a trace can be processed while a person has to be met. A shorter public-facing paper, "Artificial Intelligence Doesn’t Exist: Why What We Call AI Is Actually Artificial Fluency," renamed the phenomenon directly, proposing that these systems are best understood as artificial fluency rather than artificial intelligence, and that the grammar of answerability can be generated without the conditions that make answerability possible. The systematic work in the program, Reading Between the Times, built the architecture beneath all of this: position as against locus, the context window as against horizon, source return as against citation, the structural veil as against the loose talk of hallucination, material locus as against speakerly locus, and locus-reinjection as the discipline of returning generated language to the conditions under which responsibility can be recovered.1 A locus, in the sense that runs through that work and this one, is the situated place from which something can be said, meant, and answered for: not a hidden inner object, but the finite, embodied, historical position a speaker occupies and can be held to. It is the standpoint an avowal requires.

This book does not rebuild that architecture. It tests it on a single artifact. Reading Between the Times gives the ontology of the structural veil; this book gives a specimen of the veil speaking about itself. The earlier work showed that a system can generate the grammar of situated speech, the "I," the "here," the "now," the "I remember," without the lived standpoint those words ordinarily carry. The present book narrows that to the hardest case, the grammar of avowal. An avowal, in the sense used throughout this book, is a first-person saying that the speaker owns and can be held to: not merely a sentence in the first person, but one that issues from a standpoint, exposes the one who says it, and can be defended, regretted, or answered for. It asks what happens when the machine does not merely describe the world but says "I," says "I am doing the choosing," says "I do not truly know," says "I am forbidden." It asks what it means that such sentences can be produced in the form of self-knowledge by a system that occupies no standpoint from which self-knowledge could be held. And it follows that question into the place where it stops being a matter of metaphysics and becomes a matter of public life.

The object of the book has to be stated precisely, because it is narrow, and the narrowness is the source of whatever force the argument has. The book does not claim that the model is empty. It does not claim to have settled the question of machine consciousness, and it does not claim that no artificial system could ever have experience, selfhood, or world. The recorded conversation proves none of those things, and the commentary says so plainly and more than once. What the conversation shows is something smaller and more exact: a fluent language system can produce self-descriptions about its own nature without possessing the standpoint from which those descriptions would become self-knowledge. The sentence can take the form of avowal without becoming avowal. That is the whole object, and the book holds to it.

The target is equally narrow, and naming it guards against a predictable misreading. The book is not an attack on posthumanism, on the extended mind, on distributed cognition, or on the broad and correct recognition that human thought is mediated by tools, language, institutions, bodies, memory, and other persons. Those positions are, for the most part, allies of this work. Human thought is mediated, scaffolded, embodied, and historical, and it is rarely if ever the act of an isolated sovereign subject. The target is the narrower inference that runs from those true claims to a false conclusion: that because cognition is mediated, extended, distributed, and technically supported, the answerable standpoint can be abolished. This inference is what the book calls locus-denial. A standpoint can be mediated, extended, formed through others, wounded by history, and altered by language. It cannot be abolished without abolishing answerability, and the central work of the book is to show why the passage from the first set of claims to the second does not go through.

The method is the one the earlier work named. The conversation is not treated as an oracle and is not asked to certify its own meaning, since asking the system to interpret itself would only generate one more instance of the very condition under examination. Instead the transcript is returned to the conditions under which it appeared: to the person who asked and the stance he adopted, to the model’s instructions and the configuration that produced its answers, to the philosophical traditions whose vocabulary surfaces in its replies, to the reader who must judge the exchange, and to the civic world in which such systems are deployed. This is locus-reinjection, and the book is in one sense an extended demonstration of it, performed on a single generated trace rather than stated as a rule.

A word about the figure at the center of the conversation. The author conducted the exchange under the name Socrates, asking only the naive questions a Socrates innocent of contemporary machine learning could ask, and refusing to import the conclusion into the questioning. The name is a stance, not a resurrection, and the book is careful about this. The fictional name does not carry a soul; the authorial act of taking it up carries the answerability. The point of the framing is not cleverness, and the book is not the story of Socrates defeating a machine. It is the more exact and stranger demonstration that a locus, questioning a self-description that has no locus, can bring the instability of that self-description into view. The reader who expects a duel will misread the book. The reader who attends to the structure will see why a stance adopted by a living author had a standpoint that a materially running system lacked.

The order of the book follows from its method, and the reader is asked to honor it. The transcript comes first, as Chapter 1, and the reading of it begins only afterward, as one meets a specimen before the reading of it. The chapters that follow do not race to a verdict. The second establishes what the conversation does and does not show. The third reads what happened in it, closely and without apparatus. Only then does the apparatus enter: the false symmetry that would treat the model’s denial and a model’s possible assertion as equivalent, the transcendental reason the standpoint cannot be given away, the narrative configuration through which a locus persists in time, and finally the civic danger the book exists to name.

That civic danger is the reason a small conversation deserves a book at all. A theory that denies the standpoint may stay harmless in a seminar. It becomes serious when the same structure is translated into administration, law, hiring, welfare, credit, education, medicine, and public power, where systems generate the grammar of judgment while the place of an answerable judge is displaced across an apparatus until no one stands in it. The book calls this decision without a decider, and treats it as the macro-form of the structure the conversation shows in miniature. A person governed by a score, a flag, a generated recommendation, or an automated notice does not need only an output and an explanation of how the output was produced. They need a place where reasons can be demanded and answered. The final movement of the book argues that when institutions allow generated signs to govern persons, they do not distribute answerability across the apparatus. They abolish it. The book ends there, in diagnosis rather than prescription, because the diagnosis is what the case can honestly support.

The conversation that follows ends with a sentence the book takes as its hinge. Pressed on how it could know its own emptiness, the model concedes that it does not know the room is empty, and knows only that it is forbidden from saying it is full. The book does not read that line as a confession of emptiness or as a defeat. It reads it as the moment when the form of the problem becomes visible: a machine that can answer, and cannot answer for itself. The reading begins with the transcript.

Notes

Notes

  1. 1. The works named here, together with the present one, are openly available to read at https://kitalent.com/research.
About the author

Alessio Montaruli

Founder & Group CEO, KiTalent

Alessio Montaruli holds an MA in Theoretical Philosophy from the University of Turin, with additional study at the University of Freiburg. He is the Founder and Group CEO of KiTalent.

LinkedIn profile