Cloudflare's AI Platform: Unified Inference Layer for AI Agents

What Cloudflare's AI Platform Offers

Cloudflare has expanded its AI capabilities into a unified inference layer designed specifically for AI agents. The platform addresses the challenge of AI models changing rapidly and the need to use multiple models for different tasks within agentic workflows.

Key Features and Implementation

The core offering is one API to access any AI model from any provider. For Workers users, you can call third-party models using the same AI.run() binding already used for Workers AI. Switching between providers requires only a one-line code change.

const response = await env.AI.run('@cf/moonshotai/kimi-k2.5', {
    prompt: 'What is AI Gateway?'
}, {
    metadata: {
        "teamId": "AI",
        "userId": 12345
    }
});

The platform provides access to 70+ models across 12+ providers including Alibaba Cloud, AssemblyAI, Bytedance, Google, InWorld, MiniMax, OpenAI, Pixverse, Recraft, Runway, and Vidu. Model offerings now include image, video, and speech models for building multimodal applications.

Cost Management and BYOM Support

All AI spend can be managed in one place through AI Gateway. By including custom metadata with requests, you can get cost breakdowns by attributes like free vs. paid users, individual customers, or specific workflows.

For custom model needs, Cloudflare is working on letting users bring their own models to Workers AI using Replicate's Cog technology. This involves containerizing machine learning models with a cog.yaml file and Python inference code, abstracting away CUDA dependencies, Python versions, and weight loading.

Recent Updates and Availability

Recent additions include zero-setup default gateways, automatic retries on upstream failures, and more granular logging controls. REST API support for non-Workers users is coming in the coming weeks.