Databricks Unveils DBRX: AI Powerhouse with 132 Billion Parameters
March 27, 2024
Databricks has introduced a new AI model, DBRX, employing a 'mixture of experts' architecture with 132 billion parameters.
DBRX surpasses its rivals in efficiency, cost-effectiveness, and performance in language, programming, and mathematical tasks.
The model was developed with a $10 million investment, trained over two months on public data, and operates on about 3,000 Nvidia H100 GPUs.
At a given time, DBRX utilizes approximately 36 billion of its total parameters, with the full model openly accessible to the public for further development.
Databricks has taken measures to remove copyrighted content from the training data of DBRX, which is anticipated to be accessible via the NVIDIA API Catalog.
The launch of DBRX signifies Databricks' commitment to leading in AI research and development, focusing on innovation and practical market applications.
Summary based on 19 sources
Get a daily email with more Startups stories
Sources

Forbes • Mar 27, 2024
Databricks Unveils An AI Model That Helps Businesses Build Their Own Models
TechCrunch • Mar 27, 2024
Databricks spent $10M on new DBRX generative AI model, but it can't beat GPT-4 | TechCrunch
MacDailyNews • Mar 27, 2024
DBRX: Inside the creation of the world’s most powerful open source AI model
MarkTechPost • Mar 27, 2024
DBRX: Databricks' Latest AI Innovation! Game Changer or Just Another Player in Open LLMs?