xAI open-sources base model of Grok, but without any training code

Elon Musk’s xAI has open sourced the base code of Grok AI model, but without any training code. The company described it as the 314 billion parameter Mixture-of-Expert model on GitHub.

In a blog post, xAI said that the model wasn’t tuned for any particular application such as using it for conversations. The company noted that Grok-1 was trained on a “custom” stack without specifying details. The model is licensed under Apache License 2.0, which permits commercial use cases.

Last week, Musk noted on X that xAI intended to open source the Grok model this week. The company released Grok in a chatbot form last year, accessible to Premium+ users of X social network. Notably, the chatbot could access some of the X data, but the open source model doesn’t include connections to the social network.

Many notable companies have open sourced some of their AI models including Meta’s LLaMa, Mistral, Falcon, and AI2. In February, Google also released two new open models called Gemma2B and Gemma7B.

Some AI-powered tool makers are already talking about using Grok in their solutions. Perplexity CEO Aravind Srinivas posted on X that the company will fine-tune Grok for conversational search and make it available to Pro users.

Musk has been in a legal battle with OpenAI and sued the company earlier this month over the “betrayal” of the nonprofit AI goal. Since then, he has called out OpenAI and Sam Altman on X multiple times.


source

Rinsu Ann Easo
Rinsu Ann Easo
Diligent Technical Lead with 9 years of experience in software development. Successfully lead project management teams to build technological products. Exposed to software development life cycle including requirement analysis, program design, development and unit testing and application maintenance. Has worked on Java, PHP, PL/SQL, Oracle forms and Reports, Oracle, Bootstrap, structs, jQuery, Ajax, java script, CSS, Microsoft Excel, Microsoft Word, C++, and Microsoft Office.

You May Also Like

NatWest Group Strengthens Free Investment Guidance Programme

New initiative aims to educate more customers on investing.Highlights: NatWest Group expands free investment guidance programme.Initiative targets educating...

Tether Launches New Stablecoin Wallet to Enhance User Experience

This innovative platform aims to improve accessibility for crypto users.Highlights: Tether has introduced a new stablecoin wallet.The wallet...

FCA Strengthens Money Laundering Combat with Synthetic Dataset

New collaboration aims to enhance detection capabilities against financial crime.Highlights: FCA partners with Turing Institute to combat money...

Spektr Strengthens Compliance Efforts with $20M Funding

Fintech startup Spektr secures $20 million for AI-driven compliance solutions.Highlights: Spektr raises $20 million to enhance its AI...