Institute of Foundation Models releases six K2 Horizon models under Apache 2.0

K2 Horizon includes 375B-A23B, 36B-A4B, 32B, 7B, 3.7B, and 0.9B models, with weights, code, training data, and methodologies published. The institute says the 0.9B, 3.7B, and 7B models achieve state-of-the-art results in their size classes and that the 36B-A4B model uses MoVA.

Visit original source