Groq reportedly seeks $650M to grow its AI inference cloud business

In short: AI chip company Groq is reportedly trying to raise $650 million from its existing investors to expand a cloud service focused on AI inference.

What happened

Groq is looking to raise $650 million in new funding from investors it already has, according to Axios, as cited by TechCrunch. The money would support Groq’s “inference cloud” business, which is a service that helps companies run AI features on Groq’s own computer chips.

“Inference” is the work an AI system does after you type a prompt, when it figures out and produces the response (like the moment a cashier totals up your order, instead of stocking the store). This is different from “training,” which is the long process of teaching an AI model in the first place.

The report comes after a major deal Groq made with Nvidia in December. That agreement was described as a “not-an-acquisition,” meaning Nvidia did not buy Groq outright, but it did license Groq’s hardware technology and hired away some senior Groq employees. Axios said the deal was valued at about $20 billion and it paid Groq’s investors in cash.

Groq’s current push is being led by interim CEO Adam Winter and CFO Matt Eng, TechCrunch reported. Axios also reported that two backers, Disruptive and Infinitium, have agreed to cover the full round if other investors do not put in their share.

Why it matters

Many everyday apps now add AI features, and they need reliable, affordable computing to answer user requests quickly. If Groq succeeds, it could give businesses another option besides the biggest cloud and chip providers for running AI responses at scale.

Source: TechCrunch AI