xAI Recently Open-Sources Base Model of Grok

xAI has released the architecture and weights of its new AI model, Grok. In their Blog post, the company said that-” Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.”

Last week, Elon Musk announced that in the coming week, they will open source Grok. The company has already released Grok for the Premium+ users of X social network. As per the company’s claims, Grok can access real-time data from the X (formerly known as Twitter), so that the Grok users can be updated with real-time information which sets it apart from the other AI chatbots.

Also Read: Indian IT Ministry Removes the Approval of Tech Forms to Launch their AI Products

Grok-1 Model Details:

The company states in its blog post that Grok is a Base model that is trained on a large amount of text data. The model was trained using a custom training stack on top of JAX and Rust in October 2023. The model is still not fine-tuned for any particular application or task.

The weights and architecture model of Grok are now available on GitHub, along with all the instructions for the users. The users can now access a magnet link for a torrent file, to download the model.

Some users are already talking about Grok. Aravind Srinivas, CEO of Perplexity AI said-” Yep, thanks to Elon Musk and the xAI team for open-sourcing the base model for Grok. We will fine-tune it for conversational search optimize the inference, and bring it up for all Pro users!”

xAI has announced the news of Grok, after when it faced an allegation against openAI. Eongmusk was interested in generative AI earlier also but he left OpenAI back in 2018 saying that he wanted to focus on the projects of Tesla.

Also Read: AI Assistant Smackdown: Copilot Pro vs. ChatGPT Plus

Now he has released Grok, which is said to be a competition of OpenAI chatbot ChatGPT.