Open-Weight AI Models: The Enterprise AI Playbook
Cross-platform defense in depth for acquiring, isolating, operating, testing, and governing open-weight artificial intelligence.
Start here
Executive decision
Approve a controlled path for open-weight AI
Open-weight models can deliver useful local and private capabilities, but only when the system around them is controlled. That means a named owner, a reviewed artifact, a bounded runtime, and mediated tools. It also means classified data paths, evidence held outside the workload, and recovery that has been tested rather than assumed.
Decision requested: Approve a tiered operating model and one bounded thirty-day pilot. Do not approve unreviewed artifacts, ambient credentials, direct tool execution, uncontrolled data paths, or untested recovery.
Why now
Local model experiments are already becoming shared services, retrieval systems, and tool-connected workflows. The operating boundary needs to catch up with the capability.
Cost of inaction
Teams keep experimenting without a consistent approval record, isolation standard, owner, or recovery test. Risk grows quietly as access and data expand.
What approval enables
Useful workloads can move forward under a common standard instead of being handled as one-off exceptions.
The approval has six decisions
Leadership is approving one operating model, not six unrelated controls. The model is acceptable only when each decision below has an owner and evidence:
Leadership choice
Choose the operating posture
There are three realistic choices. The first preserves speed but leaves every team to invent its own boundary. The second creates a useful internal service with controls that can be tested and improved. The third reserves the strongest boundary for workloads whose data, authority, or consequences justify it.
Who should read what
Recommended target state
Build a boundary that can be defended
The target state is not a promise that compromise is impossible. It is a system in which each important decision has an owner, each authority path is bounded, and each control produces evidence that can be reviewed later.
Before the runtime
Quarantine the artifact. Verify the publisher, legal terms, immutable revision, hashes, signatures, formats, tokenizer, template, custom code, and loading dependencies.
Around the runtime
Use a dedicated identity, read-only model store, bounded scratch space, explicit listeners, deny-by-default egress, and no ambient production credentials.
Beyond the runtime
Put gateways, brokers, retrieval filters, telemetry, alerting, evidence, rollback, and recovery outside the process that performs inference.
What leadership should expect to see
Approval should be based on evidence, not on a benchmark, a model name, or a statement that the workload runs locally.
| Question | Evidence | Owner |
|---|---|---|
| Can we identify exactly what will run? | Immutable revision, manifest, hashes, license record, and loading-stack inventory. | Platform and procurement |
| Can the process reach more than it needs? | Identity review, listener inventory, egress test, metadata denial, and IPC review. | Security engineering |
| Can model output exercise authority? | Broker policy, scoped tool identities, approval thresholds, and action traces. | Platform and application owners |
| Can sensitive data persist or cross tenants? | Classification, retrieval filters, retention rules, redaction, and canary tests. | Privacy and data platform |
| Can the organization recover? | Kill switch, credential rotation, artifact quarantine, rollback, rebuild, and restoration rehearsal. | Security operations |