Akamai has launched an inferencing service and expanded its GPU fleet.

The Nasdaq-listed company announced Akamai Inference this week, a new cloud-based AI inference service.

akamai image
– Akamai

The new offering gives enterprises managed access to open-weight and custom models through OpenAI-compatible APIs. Customers can choose serverless, pay-per-use inference, or dedicated deployments.

At launch, the offering includes 12 open-weight models ranging from eight billion to 2.8 trillion parameters, including Nvidia Nemotron 3 Ultra, OpenAI gpt-oss-120b, and Google Gemma 4, along with embedding models for retrieval-augmented generation.

Akamai Inference is available in beta and includes serverless deployment options.

The company also announced Akamai Agent Sandbox, a new service that gives AI agents and the code they generate a restricted place to run.

“We have been implementing an AI infrastructure strategy based on the notion that AI inference will represent the majority of enterprise focus and investment. Our customers proved that thesis and pulled us further,” said Adam Karon, chief operating officer and GM of Akamai Cloud.

“They want to build, run, and protect AI on the same platform. Akamai Inference and Akamai Agent Sandbox add the inference and execution layers that turn our AI infrastructure into a full AI stack, and our security portfolio protects every layer of it. Akamai is uniquely positioned to bring our scale and distribution to address scaling real-time inference and agentic workloads.”

Akamai said it has also expanded its dedicated GPU fleet to include Nvidia Blackwell Ultra GPU clusters and is preparing its data centers to support the Nvidia Vera Rubin platform next year. The company’s GPU fleet now features Nvidia RTX Pro 6000 Blackwell Server Edition GPUs for low-latency inference and Blackwell Ultra GPU clusters for enterprises that want to self-host models on infrastructure they control.

The company said its Akamai Cloud now can offer GPU and CPU clusters in core regions to more than 4,350 Edge locations.

“Enterprises should not have to choose between speed and control when they put AI into production,” said Jon Alexander, SVP of cloud technology at Akamai.

“Some teams want to ship an AI feature this quarter on a managed platform. Others need dedicated GPUs to run frontier-class open models on their own terms. Every team running agents needs a boundary around the code those agents write. Akamai Cloud now supports all of them on one platform, with security and resilience built in.”