Databricks Unveils DBRX: A Groundbreaking 132B-Parameter AI Surpassing GPT-3.5

March 28, 2024
Databricks Unveils DBRX: A Groundbreaking 132B-Parameter AI Surpassing GPT-3.5
  • Databricks unveils DBRX, a semi-open source large language model with 132 billion parameters utilizing a mixture-of-experts approach.

  • DBRX surpasses other models including GPT-3.5 and Grok-1 in language, programming, and math tasks by employing only 36 billion parameters at a time for increased efficiency.

  • The model is up to twice as compute-efficient compared to other existing large language models.

  • DBRX is governed by the Databricks Open Model License, which permits reproduction and distribution but limits enhancement of other large language models and imposes a user cap for licensing.

  • Databricks, valued at $43 billion after raising over $4 billion, aims at enterprise users and anticipates releasing DBRX under a fully open source license.

Summary based on 16 sources


Get a daily email with more Tech stories

More Stories