Skip to main content
Model Inference supports multiple models with different capabilities. This guide helps you choose the right model for your use case.

Quick selection guide

Model comparison

Anthropic Claude models

Models labeled forced-tool-use enforce structured output through client-side schema validation and do not accept temperature or top_p — the platform drops those sampling parameters silently. Sonnet 5.5 and Opus 5.5 use the prompted-tool-use path — the reserved answer tool is offered with an auto tool choice and the platform asks for the answer in the prompt. They also drop temperature and top_p, and always think. See Structured Output.

OpenAI models

When to use smaller models

Use Claude Haiku or o4-mini when:
  • Task is straightforward: Binary classification, simple extraction
  • High volume: Processing many items where speed matters
  • Cost sensitivity: Budget constraints require efficiency
  • Latency matters: User-facing features needing fast response

When to use medium models

Use Claude Sonnet 4.5 when:
  • Task requires understanding: Content analysis, summarization
  • Balanced needs: Good quality without excessive cost
  • Most production use cases: Default choice for typical workflows

When to use larger models

Use Claude Opus 4.5 or GPT-4.1 when:
  • Complex reasoning required: Multi-step analysis, nuanced judgment
  • High stakes: Decisions with significant impact
  • Ambiguous inputs: Tasks requiring interpretation
  • Quality over speed: Accuracy is paramount

Task-based recommendations

Classification tasks

Extraction tasks

Generation tasks

Transformation tasks

Testing different models

Try multiple models on sample data to compare quality:

Best practices

Supported Models

Complete model reference

Running Inference

Submit inference requests

Model Inference Overview

How inference works

Structured Output

Define response schemas