xAI open-sources base model of Grok, but without any training code

Elon Musk’s xAI has open sourced the base code of Grok AI model, but without any training code. The company described it as the 314 billion parameter Mixture-of-Expert model on GitHub.

In a blog post, xAI said that the model wasn’t tuned for any particular application such as using it for conversations. The company noted that Grok-1 was trained on a “custom” stack without specifying details. The model is licensed under Apache License 2.0, which permits commercial use cases.

Last week, Musk noted on X that xAI intended to open source the Grok model this week. The company released Grok in a chatbot form last year, accessible to Premium+ users of X social network. Notably, the chatbot could access some of the X data, but the open source model doesn’t include connections to the social network.

Many notable companies have open sourced some of their AI models including Meta’s LLaMa, Mistral, Falcon, and AI2. In February, Google also released two new open models called Gemma2B and Gemma7B.

Some AI-powered tool makers are already talking about using Grok in their solutions. Perplexity CEO Aravind Srinivas posted on X that the company will fine-tune Grok for conversational search and make it available to Pro users.

Musk has been in a legal battle with OpenAI and sued the company earlier this month over the “betrayal” of the nonprofit AI goal. Since then, he has called out OpenAI and Sam Altman on X multiple times.


source

Rinsu Ann Easo
Rinsu Ann Easo
Diligent Technical Lead with 9 years of experience in software development. Successfully lead project management teams to build technological products. Exposed to software development life cycle including requirement analysis, program design, development and unit testing and application maintenance. Has worked on Java, PHP, PL/SQL, Oracle forms and Reports, Oracle, Bootstrap, structs, jQuery, Ajax, java script, CSS, Microsoft Excel, Microsoft Word, C++, and Microsoft Office.

You May Also Like

SWIFT to Build Shared Ledger for Tokenised Asset Transactions

New initiative aims to streamline digital asset transactions globally.Highlights: SWIFT is launching a shared ledger for tokenised assets.The...

Keye Launches AI Co-Pilot for Private Equity Due Diligence

Innovative tool aims to streamline investment analysis and decision-making.Highlights: Keye introduces an AI co-pilot for private equity due...

Cosegic Strengthens Financial Crime Expertise with Fintrail Acquisition

The acquisition enhances Cosegic's capabilities in combating financial crime.Highlights: Cosegic acquires Fintrail to enhance financial crime capabilities.The acquisition...

Keye Launches AI Co-Pilot for Private Equity Due Diligence

A game-changing tool to enhance efficiency in investment evaluations.Highlights: Keye introduces an AI-powered co-pilot for due diligence.Streamlines the...