AI security means hardening everything around the model, not just the model itself.

AI workloads have moved out of the research sandbox and into production, which means they now carry the same operational weight as any other critical service. If you want to understand what is AI security in practical terms, start here. It’s not a 

separate discipline bolted onto your existing stack. It’s an extension of it. The systems around a model matter as much as the model itself, and for teams running Linux and open-source infrastructure, that means applying familiar discipline to some new risks.

AI Security Is Becoming Part of the Linux Infrastructure

Treat AI workloads like production infrastructure, not side projects. A model doesn’t run in isolation. It depends on an operating system, a container runtime, storage, APIs, identity systems, and a pile of dependencies. If any of those layers are weak, prompt filtering or output moderation won’t be enough.

Security teams that only look at the model may miss much of the actual attack surface. The work starts with the same questions you’d ask about any service. What’s exposed? Who can reach it? What happens if it’s compromised? 

The AI Attack Surface Extends Beyond the Model 

Model-serving APIs, embeddings, retrieval systems, vector databases, plugins, and CI/CD pipelines all now sit inside the perimeter. A vector database that holds proprietary documents is a data store like any other and needs the same access controls. An inference endpoint that accepts arbitrary text input is a public-facing service, and it needs rate limits and authentication like any other. Plugins and tool integrations expand what a model can touch, which also expands what an attacker can touch. It’s the same threat modeling you’d apply to a web application.