What is an air-gapped AI deployment?
An air-gapped AI deployment is an AI system running on a network that is physically or logically isolated from the internet and from the organization’s other networks. Model weights, software, and updates enter through a controlled transfer process, typically removable media scanned at a transfer station or a one-way data diode. Nothing on the isolated network can call an outside service, download a model, or send telemetry.
Air gaps are standard practice in defense, critical infrastructure, and some manufacturing and government settings. Applying one to AI is possible only because open-weight models can be downloaded once, carried inside, and run entirely offline. A hosted model reached over an API cannot be air-gapped by definition.
How an air-gapped AI deployment works
The build starts outside the gap. Engineers assemble a complete bundle: model files, the inference server, container images, the retrieval stack, every software dependency, and a checksum manifest. The bundle is scanned, approved, and carried across. Inside, the system installs from the bundle with no package manager reaching out to the internet. Users reach the model through applications on the isolated network, and logs are reviewed in place or exported through the same controlled channel.
Updates follow the same route. A new model version is tested outside on representative but non-sensitive data, packaged, verified by hash on both sides of the transfer, and installed in a maintenance window. The model registry inside the gap records exactly which version is live.
Air-gapped AI deployment in practice
A contract manufacturer handles export-controlled technical drawings for aerospace customers, and its engineering network is already isolated to meet those obligations. The company wants engineers to ask questions across thousands of specifications and past change orders. It installs an open-weight model and a document retrieval stack on a GPU server inside the isolated network, with the bundle delivered by the IT security team on verified media. Engineers get answers grounded in their own documents, and the compliance officer can state that no controlled data has ever had a path to the internet.
Kirk Tech Solutions typically plans an air-gapped deployment as a software bundle with a documented transfer procedure, so the first installation and every later upgrade follow the same auditable steps.
What to watch for
- Every dependency must be in the bundle, including tokenizer files and driver packages that installers normally fetch silently.
- Confirm the model license permits offline use within the organization, since some require acceptance through an online account.
- Plan how monitoring and audit logs will be reviewed, because the usual cloud dashboards are unavailable inside the gap.
- Budget staff time for testing and transfer, or the deployment will fall behind on upgrades and stay there.