GrokThe Mountain View, California-based startup that captured the AI community's attention with its proprietary microchips designed specifically to run large language models (LLMs) quickly and efficiently is making more waves this week.
Today it’s announced the acquisition of one other startup, Definite intelligenceand a brand new product that builds on their previous and ongoing collaboration: GroqCloud, which the 2 combined firms now describe as a “developer playground with fully integrated documentation, code samples, and self-service access.”
The big seller: LPU access to run AI inference
But GroqCloud's big seller might be the access it gives AI developers: the Groq Language Processing Unit (LPU) inference engine.
Groq's LPUs have recently attracted viral attention from AI developers because they deliver near-instant results, which has put Groq within the highlight whilst rival Nvidia's profits hit latest heights as a consequence of strong demand for its graphics processing units (GPUs). achieved.
But GPUs, because the name suggests, were designed to display computer graphics – originally for games and multimedia software, but in recent many years also for AI applications. But until recently that they had not devoted themselves to this task. As VentureBeat previously reported, Groq CEO and founder Jonathan Ross – previously the developer of Google's Tensor Processing Unit (TPU) – believes Groq's purpose-built LPUs will soon lead the market.
“We'll probably be the infrastructure that the majority startups use by the tip of the 12 months,” he told my colleague Sharon Goldman just last week, citing the numerous cost benefits and superior performance of their LPUs over Nvidia's GPUs.
Soft start with strong initial acceptance
GroqCloud Soft launched on February nineteenth and has already been utilized by 1000’s of developers to leverage LPUs for his or her machine learning (ML) applications and inference (running AI models for users somewhat than training), but now it's for accessible to the general public.
“At Groq, we’re committed to creating an AI economy that’s accessible and inexpensive to anyone with a superb idea,” Ross noted in a single Press release.
Expanding Groq's capabilities to tackle Nvidia
Sunny Madra, co-founder and CEO of Definitive Intelligence, was enthusiastic about working with Groq.
“At Groq, we give developers the speed, low latency and efficiency they should deliver on the promise of generative AI,” Madra said in the identical press release, underscoring the transformative capabilities of Groq’s technology.
The acquisition also facilitated the creation of a Groq Systems business unit focused on innovation and addressing the needs of the general public sector and customers requiring advanced AI computing solutions. This strategic division goals to speed up Groq's innovation and strengthen its commitment to leading the AI chip industry.
Groq is targeted on improving developer access to cutting-edge AI capabilities and difficult the establishment. Groq shouldn’t be just joining the AI chip race, but shaping a future where AI technology is more accessible, efficient and transformative.
