Tools & Products

Cohere Launches North 2: Autonomous Enterprise Agent Harness and Bring-Your-Own-Model Architecture

Cohere rolled out North 2, a major architectural overhaul of its enterprise AI suite. The release introduces an agent orchestration engine, deterministic tool verification, and a Bring-Your-Own-Model (BYOM) gateway that connects Command R+ with external open and proprietary models.

By Julian Thorne · 2026-10-06 · 11 min read

Cohere launched North 2 on October 6, 2026, marking the platform's most comprehensive architectural update since its founding. Rather than focusing strictly on standalone language model checkpoints, North 2 reorganizes Cohere's enterprise offerings into an autonomous agent orchestration environment.

Central to the release is a new Agent Harness designed to solve the principal barrier to corporate agent adoption: non-deterministic tool failures and untracked database mutations.


The North 2 Agent Harness: Verifiable Execution Loops

When autonomous agents interact with internal enterprise tools—such as SAP ERPs, Salesforce instances, or SQL data warehouses—hallucinated tool parameters can corrupt production tables.

The North 2 Harness introduces a three-phase state machine between the model and external execution environments:

┌────────────────────────────────────────────────────────────────────────┐
│                      Cohere North 2 Agent Harness                      │
├────────────────────────────────────────────────────────────────────────┤
│ 1. Intent Decomposition: Command R+ breaks user goal into tool steps  │
│                                                                        │
│ 2. Deterministic Verification Gate:                                    │
│    • JSON Schema strict validation                                     │
│    • Dry-run query plan execution on shadow replica                    │
│    • Access permission boundary check (IAM / RBAC)                     │
│                                                                        │
│ 3. State Commitment & Cross-Citation:                                  │
│    • Target database transaction committed                             │
│    • Mathematical citation vectors appended to response log           │
└────────────────────────────────────────────────────────────────────────┘

If a tool parameter fails schema checks or requests unauthorized permissions, the harness halts the loop and triggers an in-line correction prompt without polluting the main conversation history.


Bring-Your-Own-Model (BYOM) Gateway

Recognizing that large enterprises run heterogeneous model fleets, North 2 decouples its orchestration layer from Cohere's proprietary weights.

Through the BYOM Gateway, developers can plug in external models while retaining Cohere's tool-calling logic and safety filters:

Orchestrated Model Routing Role Latency (P95) Typical Enterprise Use Case
Cohere Command R+ Primary Reasoning & RAG 280 ms Complex document synthesis & tool calls
Llama 3.3 70B (Self-hosted) Specialized Internal Logic 310 ms On-premises confidential document analysis
Cohere Embed v3 / Rerank Vector Search & Indexing 45 ms Cross-lingual enterprise retrieval
External Frontier Models Deep Reasoning & Audit 650 ms Financial risk analysis & contract review

Enterprise Deployment and Sovereignty

North 2 deploys as containerized Helm charts across Amazon Web Services, Microsoft Azure, Google Cloud Platform, and air-gapped on-premises Kubernetes clusters.

By standardizing agent governance, tool validation, and cross-model routing under a single control plane, Cohere aims to become the operational operating system for corporate AI workloads.