Elon Musk's xAI Releases Grok, Shakes Up AI Landscape
March 17, 2024
Elon Musk's xAI Corp. has released its large language model, Grok, as open source, directly competing with models like Meta's Llama 2 and Mistral 8x7B.
The Grok-1 model can be accessed via GitHub at 'xai-org/grok-1' with example code provided for using the model with JAX.
Grok-1 is under the permissive Apache 2.0 license, but requires substantial GPU memory for efficient operation.
The model includes an inefficient MoE layer implemented for the purpose of validating the model's correctness.
Musk's decision to open-source Grok-1 is seen as a strategic move amidst his lawsuit and criticisms against OpenAI, and it raises the stakes for other language model providers to prove their value.
Summary based on 4 sources
Get a daily email with more Startups stories
Sources

VentureBeat • Mar 17, 2024
Musk’s Grok AI goes open source
SiliconANGLE • Mar 17, 2024
Elon Musk's xAI releases Grok-1 architecture, while Apple advances multimodal AI research - SiliconANGLE
