Crusoe Managed Inference

Inference
that scales

Serve models with ultra-low latency and high throughput. Now with flexible deployment options that fit your workload.

Crusoe's inference engine is powered by MemoryAlloy™ technology, a unique cluster-native memory fabric that persists across nodes and enables intelligent routing to eliminate redundant prefill computation.

Abstract illustration composed of layered curved lines forming an organic shape

Flexible deployment options

Serverless Inference

Get started fast with usage-based consumption of top open-source models via a fully managed inference API in Crusoe Intelligence Foundry.

Best for

• Early-stage workloads

• Low volume traffic

• Rapid experimentation

Self-Serve Deployments

Run top models in Crusoe Intelligence Foundry with inference optimized for throughput or responsiveness. Deploy models customized with Serverless Fine-Tuning in one click.

Best for

• Production-scale workloads

• Low-latency applications

• Predictable costs

Tailored Deployments

Work with our team for the highest level of optimization and a dedicated, benchmarked endpoint. You bring the model and define the requirements, we handle the rest.

Best for

• Proprietary models

• Bespoke inference optimization

• SLA-backed performance

Request benchmarking

Model hub

Explore a curated selection of pre-configured top open models from leading AI labs, ranging from lightweight and ultra-fast to large with frontier reasoning power.

Explore a curated selection of pre-configured top open models from leading AI labs, ranging from lightweight and ultra-fast to large with frontier reasoning power.

Model

Provider

Parameters

Context

AVAILABLE FOR

DeepSeek V3 0324

DeepSeek

DeepSeek

Parameters

684.5B

Context

163,840

AVAILABLE FOR

Serverless Inference

DeepSeek V4 Flash

DeepSeek

DeepSeek

Parameters

158.1B

Context

1,048,576

AVAILABLE FOR

Serverless Inference
Self-Serve Deployments

DeepSeek V4 Pro

DeepSeek

DeepSeek

Parameters

861.6B

Context

1,048,576

AVAILABLE FOR

Serverless Inference

Gemma 4 31B it

Google

Google

Parameters

32.7B

Context

262,144

AVAILABLE FOR

Serverless Inference
Self-Serve Deployments

GLM 5.1

Z.ai

Z.ai

Parameters

753.9B

Context

202,752

AVAILABLE FOR

Serverless Inference

GLM 5.2

Z.ai

Z.ai

Parameters

379.2B

Context

262,144

AVAILABLE FOR

Serverless Inference

GPT-OSS 120B

OpenAI

OpenAI

Parameters

120.4B

Context

131,072

AVAILABLE FOR

Serverless Inference
Self-Serve Deployments

GPT-OSS 20B

OpenAI

OpenAI

Parameters

21B

Context

128,000

AVAILABLE FOR

Self-Serve Deployments

Kimi K2.6

Kimi

Kimi

Parameters

1.1T

Context

262,144

AVAILABLE FOR

Serverless Inference

Llama 3.3 70B Instruct

Meta

Meta

Parameters

70.6B

Context

131,072

AVAILABLE FOR

Serverless Inference
Self-Serve Deployments

Llama 3.1 8B Instruct

Meta

Meta

Parameters

8B

Context

128,000

AVAILABLE FOR

Self-Serve Deployments

Nemotron 3 Nano 30B A3B FP8

NVIDIA

NVIDIA

Parameters

31.6B

Context

261,144

AVAILABLE FOR

Serverless Inference

Nemotron 3 Nano Omni 30B A3B Reasoning

NVIDIA

NVIDIA

Parameters

33B

Context

256,000

AVAILABLE FOR

Serverless Inference

Nemotron 3 Super 120B A12B FP8

NVIDIA

NVIDIA

Parameters

123.6B

Context

261,144

AVAILABLE FOR

Serverless Inference

Nemotron 3 VoiceChat

NVIDIA

NVIDIA

Parameters

12B

Context

131,072

AVAILABLE FOR

Serverless Inference

Qwen3 235B A22B Instruct 2507

Alibaba

Alibaba

Parameters

235.1B

Context

262,144

AVAILABLE FOR

Serverless Inference
Self-Serve Deployments

Qwen3 8B

Alibaba

Alibaba

Parameters

8.2B

Context

32,000

AVAILABLE FOR

Self-Serve Deployments

Qwen3.5 9B

Alibaba

Alibaba

Parameters

9B

Context

256,000

AVAILABLE FOR

Self-Serve Deployments

Qwen3.5 2B

Alibaba

Alibaba

Parameters

2B

Context

256,000

AVAILABLE FOR

Self-Serve Deployments

Qwen3.6 35B A3B

Alibaba

Alibaba

Parameters

35B

Context

256,000

AVAILABLE FOR

Self-Serve Deployments

Qwen3.6 27B

Alibaba

Alibaba

Parameters

27B

Context

256,000

AVAILABLE FOR

Self-Serve Deployments

Yutori n1.5

Yutori

Yutori

Parameters

33.4B

Context

128,000

AVAILABLE FOR

Serverless Inference

Unmatched performance, flexibility, and scalability

1

Breakthrough speed

Powered by MemoryAlloy technology with a cluster-wide KV cache, Crusoe's inference engine delivers up to 9.9x faster time-to-first-token* and 5x higher throughput using speculative decoding and dynamic batching.

2

Ultimate flexibility

Choose the right inference deployment option for your workload. Pay as you go with Serverless Inference APIs, use Self-Serve Deployments to further optimize for throughput or responsiveness, or work with us via Tailored Deployments to customize for your unique needs.

3

Seamless scaling

Go from experiment to production without the operational burden. We handle the infrastructure to deliver reliable performance even under peak load. Meet changing user demands with elastic scaling that flexes from single-user testing to sustained, high-volume production deployments.

*

Benchmarked against vLLM for Llama-3.3-70B model. Read our blog to learn more details.

We need to process complex records instantly. Crusoe Managed Inference helps us meet that challenge. It provides a reliable path to production at a pace we haven't seen on other platforms.

Grant Jensen

Co-Founder & CEO

We are firmly entering the agentic era where swarms of digital minds proactively assist humans. This requires fundamentally rethinking the entire stack — models, harnesses, and infra. Crusoe is a recognized leader in the AI inference space, helping Yutori push out the Pareto frontier of capabilities, latency, and cost.

Dhruv Batra

Co-founder & Chief Scientist

Crusoe Intelligence Foundry, designed for AI developers

Discover new models, accelerate fine-tuning, and quickly deploy with flexible inference options.

API keys for fastest path to production

Experiment with top open-source models rapidly. Generate API keys, monitor performance metrics and enable provisioned throughput for production-scale deployments.

Managed endpoints for rapid deployment

Leverage fully managed endpoints powered by our inference engine tuned specifically to each model for optimized performance.

Unified interface for cross-team collaboration

Users working across teams can easily switch between the Crusoe Intelligence Foundry for inference tasks and the Crusoe Cloud Console for infrastructure-as-a-service (IaaS) resources within a single, integrated environment.

Crusoe inference engine vs vLLM

0

2

4

6

8

10

TTFT

Throughput

9.9x

5.0x

x Improvement vs. vLLM

Llama-3.3-70B model, 4-node deployment

$Screenshot of a coding interface showing a prompt requesting a Python 3.11+ fractal viewer app, followed by a partial Python script with imports and comments.$

Frequently
asked questions

Are you ready to build something amazing?