Databricks Unveils DBRX: A Groundbreaking 132B-Parameter AI Surpassing GPT-3.5
March 28, 2024
Databricks unveils DBRX, a semi-open source large language model with 132 billion parameters utilizing a mixture-of-experts approach.
DBRX surpasses other models including GPT-3.5 and Grok-1 in language, programming, and math tasks by employing only 36 billion parameters at a time for increased efficiency.
The model is up to twice as compute-efficient compared to other existing large language models.
DBRX is governed by the Databricks Open Model License, which permits reproduction and distribution but limits enhancement of other large language models and imposes a user cap for licensing.
Databricks, valued at $43 billion after raising over $4 billion, aims at enterprise users and anticipates releasing DBRX under a fully open source license.
Summary based on 0 sources