Resources

AI Glossary

Explore key terms, concepts, and technologies across artificial intelligence, machine learning, generative AI, and AI agents — defined in plain language for business and technical teams.

  • 560 terms
  • 12 categories

Showing 20 of 90 terms

Agent Observability

AI Agents

Definition
Agent observability is the practice of recording and inspecting what an AI agent did during a task, including each model call, tool call, intermediate result, cost, and failure, so teams can debug…
AI Infrastructure

Agent Runtime

AI Agents

Definition
An agent runtime is the software environment that executes an AI agent: it runs the reasoning loop, calls the model, dispatches tool calls, manages state and memory, and enforces limits and permissions.
AI Infrastructure

AI Accelerator (NPU, VPU)

AI Infrastructure

Definition
An AI accelerator is a specialized chip or chip section built to run neural network inference efficiently, such as the neural processing units (NPUs) in laptops and phones and the vision processing…

AI Agent Framework

AI Agents

Definition
An AI agent framework is a software library or platform that supplies the building blocks for agents, including the reasoning loop, tool definitions, memory, and connections to models, so teams do not…
AI Infrastructure

AI Gateway

Large Language Models

Definition
An AI gateway is a proxy that sits between applications and model endpoints to enforce authentication, routing, rate limits, logging, and data policies for every request to an AI model.
AI InfrastructureAI Security

AI Ownership

AI Infrastructure

Definition
AI ownership means running AI on model weights, infrastructure, and data paths a company controls, instead of renting a provider's model per token. It suits companies with sensitive data or steady volume.
Enterprise AI

AI Security

AI Security

Definition
AI security is the practice of protecting AI systems, including models, data, prompts, and agents, from attack and misuse, and of preventing a manipulated AI system from harming the business that runs…
AI GovernanceAI Infrastructure

Air-Gapped AI Deployment

AI Infrastructure

Definition
An air-gapped AI deployment runs models on a network with no connection to the internet or to other networks, so data cannot leave and updates arrive only through controlled physical transfer.
AI Security

Application Programming Interface (API)

Data Management

Definition
An application programming interface (API) is a defined set of requests and responses that lets one program use another's functions or data without access to its internal code.
AI Infrastructure

Batch Inference

Machine Learning

Definition
Batch inference is the practice of running a model over a large set of records at once on a schedule, such as scoring every account overnight, instead of answering requests one at…
AI Infrastructure

Canary Deployment

AI Infrastructure

Definition
A canary deployment releases a new model or software version to a small share of real traffic first, compares its behavior with the current version, and widens the rollout only when the…

Central Processing Unit (CPU)

AI Infrastructure

Definition
A central processing unit (CPU) is the general-purpose processor in every computer, built to run a few tasks very quickly in sequence, and it handles most of the work around an AI…

Citizen Developer

Enterprise AI

Definition
A citizen developer is an employee outside the IT department who builds applications, automations, or AI agents for their own team using no-code or low-code tools that IT has approved.
AI Infrastructure

Cloud Computing

AI Infrastructure

Definition
Cloud computing is the delivery of servers, storage, networking, and software over the internet from a provider's data centers, rented on demand and billed by use instead of bought outright.

Cloud GPU

AI Infrastructure

Definition
A cloud GPU is a graphics processing unit rented by the hour or by reservation from a cloud provider, giving an organization AI hardware without buying or housing it.

Compute

AI Infrastructure

Definition
Compute is the processing capacity, measured in processor time and operations per second, that an AI system consumes to train a model or to produce answers from a trained one.

Computer Vision Platform

Computer Vision

Definition
A computer vision platform is software that covers the full life cycle of vision models: collecting and labeling images, training, deploying to cameras or servers, and monitoring results in production.
AI Infrastructure

Confidential Computing

AI Security

Definition
Confidential computing protects data while it is being processed by running workloads in hardware-isolated, encrypted memory that the host operating system, the cloud operator, and other tenants cannot read.
AI Infrastructure

Container

AI Infrastructure

Definition
A container is a packaged unit of software that bundles an application with its libraries and settings so it runs the same way on any machine. In AI work, containers carry models,…

Continuous Batching

Large Language Models

Definition
Continuous batching is an inference server technique that adds new requests to the running batch and removes finished ones at every generation step, keeping the GPU busy and raising throughput.
AI Infrastructure