Elon Musk’s AI company xAI has released the weights and architecture of its large language model Grok-1.
xAI published a blog post that announced that GrokAI is now open-sourced. The blog post said that the xAI team is “releasing the base model weights and network architecture of Grok-1, a large language model.
“We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI. This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue. We are releasing the weights and the architecture under the Apache 2.0 license. To get started with using the model, follow the instructions at github.com/xai-org/grok,” noted xAI, the company behind GrokAI.
Earlier last week, Musk had promised that his AI chatbot, GrokAI, would be open-sourced soon. Fulfilling his promise, the X chief has now made the AI tool open-sourced and an open release is available on GitHub.
Open-sourcing an AI model means offering its source code to the public for modification and redistribution.
Meanwhile, Musk took another jibe at OpenAI asking them to talk more about the “open” in their name. “Tell us more about the “Open” part of OpenAI,” he said in a post on X.