Artificial Intelligence

Sub-Symbolic (Connectionist) AI

Sub-symbolic AI, also called connectionist AI, stores what it knows as numeric weights across many simple units, as in neural networks, rather than as readable rules. Deep learning and large language models are sub-symbolic.

What is sub-symbolic AI?

Sub-symbolic AI, also called connectionist AI, is the approach in which knowledge is distributed across a large number of numeric parameters learned from data instead of being written as explicit symbols or rules. The best-known form is the artificial neural network: layers of simple units, each computing a weighted sum of its inputs, connected so that the network as a whole maps inputs to outputs. No single weight means anything by itself. The behavior emerges from millions or billions of them acting together.

Deep learning, convolutional networks for images, recurrent networks for sequences, and the transformer architecture behind large language models are all sub-symbolic. So are many classic statistical methods, such as support vector machines, which learn numeric decision boundaries rather than rules. The term “connectionist” comes from the idea that intelligence arises from the pattern of connections, loosely modeled on neurons in the brain.

Why sub-symbolic AI matters

Sub-symbolic methods are responsible for nearly every AI capability that has reached business use in the past decade: recognizing defects on a production line, transcribing calls, reading handwritten forms, translating documents, and generating text. They succeed on exactly the problems that defeated symbolic AI, where the rules are too many or too subtle for anyone to write down. Given enough labeled examples, a neural network discovers the features that matter on its own.

The cost is opacity. A trained network cannot be read like a rulebook, so explaining why it produced a particular output requires separate interpretability techniques such as Shapley values or counterfactual explanations. Networks also need large amounts of data and compute, and they can be confidently wrong on inputs unlike anything they were trained on.

Sub-symbolic AI in practice

A metal fabricator installs cameras over its welding stations and trains a convolutional network on images of acceptable and defective welds. Within weeks the network catches porosity and undercut that inspectors missed at line speed. Nobody wrote a rule describing a bad weld; the network learned the visual signature from examples. The plant pairs it with a simple rule layer that halts the line after three consecutive flags, which is the kind of guarantee the network cannot provide alone.

What to watch for

  • Budget for labeled data, since sub-symbolic methods learn only from examples and need many of them.
  • Require interpretability tooling where decisions affect people, because the model will not explain itself.
  • Test on inputs that differ from the training set to see how the model behaves when conditions change.
  • Pair the network with explicit rules for any constraint that must never be violated.

← Back to AI Glossary