Skip to main content
Model Inference supports multiple models with different capabilities. This guide helps you choose the right model for your use case.

Quick selection guide

Model comparison

Anthropic Claude models

Models labeled forced-tool-use enforce structured output through client-side schema validation and do not accept temperature or top_p — the platform drops those sampling parameters silently. See Structured Output.

OpenAI models

When to use smaller models

Use Claude Haiku or o4-mini when:
  • Task is straightforward: Binary classification, simple extraction
  • High volume: Processing many items where speed matters
  • Cost sensitivity: Budget constraints require efficiency
  • Latency matters: User-facing features needing fast response

When to use medium models

Use Claude Sonnet 4.5 when:
  • Task requires understanding: Content analysis, summarization
  • Balanced needs: Good quality without excessive cost
  • Most production use cases: Default choice for typical workflows

When to use larger models

Use Claude Opus 4.5 or GPT-4.1 when:
  • Complex reasoning required: Multi-step analysis, nuanced judgment
  • High stakes: Decisions with significant impact
  • Ambiguous inputs: Tasks requiring interpretation
  • Quality over speed: Accuracy is paramount

Task-based recommendations

Classification tasks

Extraction tasks

Generation tasks

Transformation tasks

Testing different models

Try multiple models on sample data to compare quality:

Best practices

Supported Models

Complete model reference

Running Inference

Submit inference requests

Model Inference Overview

How inference works

Structured Output

Define response schemas