Tag: Mixture of Experts

AMD’s open 16B MoE model tops fully open rivals on benchmarks

AMD's fully open mixture-of-experts model leads open rivals while activating just 2.8B parameters.

AMD opens Instella MoE model trained on its Instinct GPUs

AMD ships Instella-MoE-16B-A3B, an open mixture-of-experts model trained on Instinct GPUs with 2.8B active parameters.

Inkling Small matches flagship skills at a quarter of the size

Thinking Machines shipped a quarter-size Inkling model that nears the flagship's benchmark scores.

Mira Murati’s Thinking Machines Lab debuts first open model

Inkling, a 975-billion-parameter open-weight model, lets organizations customize AI without relying on big labs.