Nonu Model | 100

The "100 nonu" (or OK100-nonu) refers to a specialized genetic "high-order mutant" used primarily in plant biology research to study how plants respond to environmental stress and hormones. The Biological "Model"

The first public release, Nonu-100-v1, dropped in March 2024. It had 7 billion total parameters but only used ~700,000 per inference step. The result? It ran on a Raspberry Pi 5 at 40 tokens per second. 100 nonu model

3.1 The Nonu-Gate Mechanism

Instead of a softmax over all possible neurons, the model uses a hard-threshold gating function: The "100 nonu" (or OK100-nonu ) refers to

Part 4: Performance Benchmarks – Is 100 Nonu Better?

Independent tests from the MLCommons Tiny Taskforce compared the 100 Nonu Model (7B total) against GPT-3.5 (175B) and Llama 2 (13B) on three edge-relevant tasks: The result