Zyphra's ZAYA1-8B reasoning model was trained on AMD MI300X GPUs

ZAYA1-8B is an Apache 2.0 MoE model with 8.4B total and 760M active parameters. On tests reported by Zyphra, it scored 89.1 on AIME 2026, 71.0 on GPQA Diamond, and 65.8 on LiveCodeBench v6, ahead of similarly sized models including Qwen3-4B and Gemma 4 E4B. Its Markovian RSA method allows test-time reasoning to scale while keeping memory usage fixed.

Visit original source