10.9 C
Monday, April 15, 2024
HomeAIX’s Grok chatbot will soon get an upgraded model, Grok-1.5

X’s Grok chatbot will soon get an upgraded model, Grok-1.5


Elon Musk’s AI startup, X.ai, has revealed its latest generative AI model, Grok-1.5. Set to power social network X’s Grok chatbot in the not-so-distant future (“in the coming days,” per a blog post), Grok-1.5 appears to be a measurable upgrade over its predecessor, Grok-1 — at least judging by the published benchmark results and specs.

Grok-1.5 benefits from “improved reasoning,” according to X.ai, particularly where it concerns coding and math-related tasks. The model more than doubled Grok-1’s score on a popular mathematics benchmark, MATH, and scored over 10 percentage points higher on the HumanEval test of programming language generation and problem-solving abilities.

It’s difficult to predict how those results will translate in actual usage. As we recently wrote, commonly-used AI benchmarks, which measure things as esoteric as performance on graduate-level chemistry exam questions, do a poor job of capturing how the average person interacts with models today.

One improvement that should lead to observable gains is the amount of context Grok-1.5 can understand compared to Grok-1.

Grok-1.5 can process contexts of up to 128,000 tokens. Here, “tokens” refers to bits of raw text (e.g., the word “fantastic” split into “fan,” “tas” and “tic”). Context, or context window, refers to input data (in this case, text) that a model considers before generating output (more text). Models with small context windows tend to forget the contents of even very recent conversations, while models with larger contexts avoid this pitfall — and, as an added benefit, better grasp the flow of data they take in.

“[Grok-1.5 can] utilize information from substantially longer documents,” X.ai writes in the blog post. “Furthermore, the model can handle longer and more complex prompts while still maintaining its instruction-following capability as its context window expands.”

What’s historically set X.ai’s Grok models apart from other generative AI models is that they respond to questions about topics that are typically off-limits to other models, like conspiracies and more controversial political ideas. The models also answer questions with “a rebellious streak,” as Musk has described it, and outright rude language if requested to do so.

It’s unclear what changes, if any, Grok-1.5 brings in these areas. X.ai doesn’t allude to this in the blog post.

Grok-1.5 will soon be available to early testers on X, accompanied by “several new features.” Musk has previously hinted at summarizing threads and replies, and suggesting content for posts; we’ll see if those arrive soon enough.

The announcement comes after X.ai open sourced Grok-1, albeit without the code necessary to fine-tune or further train it. More recently, Musk said that more users on X — specifically those paying for X’s $8-per-month Premium plan — would gain access to the Grok chatbot, which was previously only available to X Premium+ customers (who pay $16 per month).


Related stories

UK’s antitrust enforcer sounds the alarm over Big Tech’s grip on GenAI

The U.K.’s competition watchdog, Competition and Markets Authority (CMA),...

ICYMI fintech funding round-up: Mimo, TransferGo, Smartpay, Adro and more

Mimo:Raised £15.5 million led by Northzone. Plans...

Amazon, eyeing up AI, adds Andrew Ng to its board — ex-MTV exec McGrath to step down

If the decisions made by corporate boards of directors...

Meta unveils its newest custom AI chip as it races to catch up

Meta, hell-bent on catching up to rivals in the...
Rinsu Ann Easo
Rinsu Ann Easo
Diligent Technical Lead with 9 years of experience in software development. Successfully lead project management teams to build technological products. Exposed to software development life cycle including requirement analysis, program design, development and unit testing and application maintenance. Has worked on Java, PHP, PL/SQL, Oracle forms and Reports, Oracle, Bootstrap, structs, jQuery, Ajax, java script, CSS, Microsoft Excel, Microsoft Word, C++, and Microsoft Office.


- Never miss a story with notifications

- Gain full access to our premium content

- Browse free from up to 5 devices at once

Latest stories