Databricks Unveils DBRX: AI Powerhouse with 132 Billion Parameters
March 27, 2024
Databricks has introduced a new AI model, DBRX, employing a 'mixture of experts' architecture with 132 billion parameters.
DBRX surpasses its rivals in efficiency, cost-effectiveness, and performance in language, programming, and mathematical tasks.
The model was developed with a $10 million investment, trained over two months on public data, and operates on about 3,000 Nvidia H100 GPUs.
At a given time, DBRX utilizes approximately 36 billion of its total parameters, with the full model openly accessible to the public for further development.
Databricks has taken measures to remove copyrighted content from the training data of DBRX, which is anticipated to be accessible via the NVIDIA API Catalog.
The launch of DBRX signifies Databricks' commitment to leading in AI research and development, focusing on innovation and practical market applications.
Summary based on 0 sources