iGenius Unveils Colosseum 355B: AI Model Revolutionizing Data Security in Regulated Industries

January 16, 2025
iGenius Unveils Colosseum 355B: AI Model Revolutionizing Data Security in Regulated Industries
  • On January 16, 2025, Italian startup iGenius announced the release of Colosseum 355B, a large language model specifically designed for highly regulated industries.

  • The model employs FP8 precision for pre-training, significantly reducing memory usage and cutting inference costs by 50% without compromising accuracy.

  • Colosseum 355B utilizes the latest Nvidia technology to meet stringent data protection needs, ensuring that sensitive information remains secure.

  • Due to its size, Colosseum 355B can be run on-premises within an organization's firewall, allowing for proprietary hosting and full control over data.

  • iGenius differentiates itself from competitors like OpenAI by focusing on developing open-source AI models that companies can operate on their own infrastructure, ensuring data privacy.

  • CEO Uljan Sharka presented Colosseum 355B to the European Commission in Brussels, highlighting its capabilities for businesses in regulated sectors.

  • Sharka revealed that iGenius is currently in discussions with potential clients in financial services, heavy industries, and government sectors.

  • The model aims to provide businesses with confidence in data security, guaranteeing that data remains uncompromised.

  • Tight legislation and compliance requirements present significant barriers to the adoption of AI technology in these regulated sectors.

  • Development of Colosseum 355B was completed in just two months, resulting in a 355 billion-parameter model that supports over 50 languages.

  • Colosseum 355B was developed in collaboration with Nvidia Corp., utilizing the Nvidia AI Enterprise software platform and orchestrating over 3,000 Nvidia H100 GPUs.

  • The model is offered as an Nvidia NIM microservice and can be accessed via the Nvidia API catalog, ensuring secure deployment across various platforms.

Summary based on 4 sources


Get a daily email with more AI stories

More Stories