Databricks Unveils DBRX: AI Powerhouse with 132 Billion Parameters

March 27, 2024
Databricks Unveils DBRX: AI Powerhouse with 132 Billion Parameters
  • Databricks has introduced a new AI model, DBRX, employing a 'mixture of experts' architecture with 132 billion parameters.

  • DBRX surpasses its rivals in efficiency, cost-effectiveness, and performance in language, programming, and mathematical tasks.

  • The model was developed with a $10 million investment, trained over two months on public data, and operates on about 3,000 Nvidia H100 GPUs.

  • At a given time, DBRX utilizes approximately 36 billion of its total parameters, with the full model openly accessible to the public for further development.

  • Databricks has taken measures to remove copyrighted content from the training data of DBRX, which is anticipated to be accessible via the NVIDIA API Catalog.

  • The launch of DBRX signifies Databricks' commitment to leading in AI research and development, focusing on innovation and practical market applications.

Summary based on 19 sources


Get a daily email with more Startups stories

More Stories