Breaking AI & Tech News Analyzed

Baseten Nears $1.5 B Funding Close, Valuation Jumps to $13 BAI inference company Baseten is reportedly finalising a $1.5 billion financing round that would place the firm at a $13 billion post‑money valuation, according to the Wall Street Journal.Split‑Priced Funding Structure Fuels Valuation SurgeThe round is being executed as a split‑priced deal: some investors are buying in at a $13 billion valuation while others are priced at $11 billion. Co‑lead investors include Spark Capital, Sands Capital, Altimeter Capital and Wellington Management.Valuation Metrics: 160% Rise in Six MonthsFive months ago: $300 million Series E at a $5 billion valuation.Nine months ago: $150 million Series D.Current round: $1.5 billion at $13 billion valuation – a 160% increase in under half a year.Implications for the Inference‑Layer Gold RushBaseten, founded in 2019, rides the “inference gold rush” where venture capital is flowing into companies that optimise the model‑execution layer. By routing requests to the most cost‑effective model—including open‑source alternatives—Baseten promises faster, cheaper inference, a value proposition that is attracting deep‑pocket investors.What the Next Funding Wave Could Mean for AI StartupsIf the split‑price model proves successful, other AI startups may adopt it to showcase higher headline valuations while accommodating differing investor risk appetites. This could intensify competition for capital in the inference space and push more firms to differentiate on cost‑efficiency and latency.

General Compute, a new inference neocloud, raised a $15 million seed round at a $60 million post‑money valuation and booked a $300 million order for SambaNova’s upcoming SN50 chips. The company promises 600‑700 tokens per second per chip and a deployment model that fits into existing, air‑cooled data‑center infrastructure. General Compute’s Funding and Strategic Partnerships Seed round led by FUSE VC with participation from Carya Venture Partners and Village Global Ventures. Co‑founders Finn Puklowski (CEO) and Jason Goodison (CTO) partnered with SambaNova, an Intel‑backed chipmaker focused on inference. General Compute will be the first neocloud to deploy SambaNova’s SN50 chips, ordering $300 million worth of hardware. Colocation strategy includes traditional data‑center providers and repurposed crypto‑miner facilities. Financial Snapshot: $15 Million Seed and $300 Million Chip Order Seed funding: $15 million raised, valuing the company at $60 million post‑money. Chip commitment: $300 million of SN50 chips on order, enough to power a large inference fleet. Comparable market moves: Nvidia’s $20 billion acquisition of Groq (Dec 2025) and Cerebras’ $57 billion IPO (May 2026) illustrate the scale of inference‑focused investments. Implications for the AI Inference Landscape The shift from GPU‑centric training to specialized inference hardware is accelerating. SambaNova’s memory‑rich, flexible architecture claims to outperform GPUs, Groq, and Cerebras on token‑throughput, delivering 600‑700 tokens/sec versus ~250 tokens/sec for GPUs. Air‑cooled, low‑power chips lower the barrier to entry for colocation, enabling rapid deployment in existing facilities and even in repurposed crypto‑mining sites. This could democratize high‑speed inference, pressure pricing, and spur a wave of niche cloud providers focused on agent‑to‑agent workloads. What the Next Year May Hold for Inference‑First Cloud Providers When SambaNova releases its next‑gen chips later in 2026, General Compute’s early access positions it to capture a sizable share of the fast‑inference market. Expect: Increased competition among inference‑only clouds (e.g., CoreWeave, OpenRouter) to offer multi‑model routing and token‑cost optimization. More venture capital flowing into inference‑focused startups, mirroring the recent $113 million Series B for OpenRouter. Potential consolidation as larger players (Nvidia, Intel) seek partnerships or acquisitions to secure the most efficient inference stacks. Speed and cost efficiency will become the primary differentiators, shaping the architecture choices that dominate the AI future.

Google and Intel announced an expanded multiyear agreement that will keep Google Cloud on Intel’s Xeon CPUs while accelerating joint development of custom infrastructure processing units (IPUs) designed for AI inference and data‑center workloads. Expanded Multiyear AI Infrastructure Deal Announcement date: 2026-04-09 Partnership originally launched in 2021 Focus on co‑development of ASIC‑based IPUs and continued use of Intel’s Xeon line Technical Scope and Processor Commitments The agreement specifies that Google Cloud will run Intel’s latest Xeon 6 chips for AI, cloud, and inference tasks, extending a decades‑long reliance on Xeon CPUs. Xeon 6 chips are positioned as the flagship CPU for AI workloads, complementing GPU accelerators. Custom IPUs will offload AI‑specific processing from general‑purpose CPUs, improving efficiency. Pricing details were not disclosed by Intel. Strategic Impact on the AI Compute Landscape Industry analysts note a pivot toward CPU‑centric architectures as the global AI boom strains GPU supply chains. By bolstering CPU and IPU capabilities, the partnership aims to deliver balanced systems that can scale AI workloads without relying solely on GPUs. Lip‑Bu Tan, Intel CEO, emphasized that “balanced systems” are essential for modern AI workloads. Recent CPU shortages have prompted rivals like Arm Holdings to launch their own AI‑focused CPUs (Arm AGI). The move may pressure other cloud providers to diversify beyond Nvidia‑centric stacks. Future Outlook for CPU‑Centric AI Architecture With the partnership deepening, both companies are likely to iterate on next‑generation Xeon processors and IPU designs, targeting higher throughput and lower power consumption. Expect further announcements on custom silicon roadmaps and potential joint reference designs for enterprise AI deployments. Short‑term: Expanded Xeon deployment across Google Cloud’s AI services. Mid‑term: Introduction of first‑generation custom IPUs in production workloads. Long‑term: A more heterogeneous compute stack where CPUs, IPUs, and GPUs coexist to meet diverse AI demands.

The Arm AGI CPU: A New Era of In-House SiliconFor the first time in its 35-year history, Arm Holdings is stepping out from behind the licensing model to manufacture its own silicon. The company revealed the Arm AGI CPU at an event in San Francisco, a production-ready processor designed specifically for AI inference in data centers. Unlike its traditional business model of licensing designs to giants like Nvidia and Apple, Arm has developed this chip using its own Arm Neoverse family of CPU IP cores.This strategic pivot is backed by a robust ecosystem of launch partners, including Meta, which is the chip's first customer. Other key partners include OpenAI, Cerebras, and Cloudflare. The chip is already ready for order, signaling that Arm is moving aggressively to capture value in the booming AI infrastructure market.The Critical Role of CPUs in AI InfrastructureWhile GPUs have dominated headlines for training large language models, Arm is highlighting the often-overlooked importance of the central processing unit (CPU) in modern AI racks. Arm argues that the CPU is the pacing element of modern infrastructure, responsible for managing thousands of distributed tasks, including memory allocation, storage scheduling, and data movement across systems.Infrastructure Management: CPUs ensure that distributed AI systems operate efficiently at scale.Market Constraints: The demand for high-performance computing is exacerbating global supply chain issues, with Intel and AMD recently informing Chinese customers of extended wait times due to CPU shortages.Cost Implications: These supply constraints are contributing to rising prices for computer hardware.Breaking the Licensing Model: A Strategic Bet on CompetitionThe release of the Arm AGI CPU represents a historic deviation from the company's founding principles. For decades, Arm has operated as a pure-play design licensor, allowing partners to manufacture chips based on its architecture. However, the company is now poised to compete directly with many of its biggest customers.Majority-owned by the Japanese conglomerate SoftBank Group, Arm's move suggests a desire to capture more of the value chain. By building its own silicon, Arm can offer a more integrated solution for AI workloads, potentially undercutting or complementing the offerings of its licensees. This shift challenges the traditional semiconductor ecosystem and sets a precedent for other IP licensor to consider building their own hardware.The Future of Chip Architecture in the AI RaceArm's entry into manufacturing signals a new phase in the AI chip wars. As the industry moves toward specialized silicon for inference, the line between design houses and manufacturers is blurring. We can expect to see more IP licensor developing their own chips to ensure they have control over the performance and efficiency of the hardware powering the next generation of AI models.