Research

System 1 AI Models & Non-Autoregressive Parallel Inference

Non-autoregressive token generation, finite state machine schema masks, and sub-15ms structured execution.

Pillar Architectural Overview

### The Division of Cognitive Labor in AI Systems Standard generative language models are autoregressive: they generate text token-by-token in sequential order. While effective for open-ended prose and multi-step reasoning, this design incurs $O(N)$ sequential latency and introduces syntax drift on deterministic operations. 1. **System 1 (Instinctive & Structured)**: - Executes immediate classification, JSON extraction, intent routing, and parameter validation. - Operates in 10 to 20 milliseconds via non-autoregressive parallel sampling with logit-level finite state constraints. - Exists to handle deterministic operational plumbing without wasting GPU memory on slow recursive search. 2. **System 2 (Deliberative & Recursive)**: - Executes multi-step mathematical proofs, full codebase architecture, and deep analytical research. - Operates over 10 to 60 seconds with chain-of-thought verification (e.g. OpenAI o3, Claude 3.7 Sonnet).

Cluster Dispatches & Deep Dives (2)

Laya vs. Jev: How System 1 Decision Models Broke Free from the Cloud and Run in Your Browser

After TypeSafe AI’s Jev introduced fast non-autoregressive decisions, ConvAI Innovations open-sourced Laya on ModernBERT-large, and researcher Vishal Mysore got it running entirely inside web browsers via ONNX Runtime Web. An architectural breakdown of typed decision models, local WebGPU execution, JevBench benchmarks, and the end of text-generation overhead for software routing.

Read Technical Article →

TypeSafe AI Launches Jev: Technical Breakdown of the Non-Autoregressive System 1 Model Built by a ChatGPT Inventor

Created by former OpenAI researcher Diogo Almeida at TypeSafe AI, Jev introduces non-autoregressive parallel sampling for deterministic structured outputs. The model achieves sub-15ms response times, produces 100% schema-valid JSON without regex patching, and eliminates sequential token bottlenecks across agent workflows.

Read Technical Article →