Models

To use a model in Gage/Inspect, you need:

  • Python package support
  • API keys

Below is a list of popular models along with what’s needed to use them.

This is a quick reference to popular providers and models. Refer to Inspect Model Providers for additional details on using models.

OpenAI

Requirements

Python package API environment variable
openai OPENAI_API_KEY

Models

Name
openai/gpt-5.1
openai/gpt-5.1-pro
openai/gpt-5
openai/gpt-5-pro
openai/gpt-5-mini
openai/gpt-5-nano
openai/gpt-4.1
openai/gpt-4.1-mini
openai/gpt-4.1-nano

For a complete list, see Open AI Models.

Anthropic

Requirements

Python package API environment variable
anthropic ANTHROPIC_API_KEY

Models

Name
anthropic/claude-opus-4-5
anthropic/claude-sonnet-4-5
anthropic/claude-haiku-4-5
anthropic/claude-opus-4-1
anthropic/claude-sonnet-4-1
anthropic/claude-haiku-4-1
anthropic/claude-opus-4-0
anthropic/claude-sonnet-4-0
anthropic/claude-haiku-4-0
anthropic/claude-opus-3-5
anthropic/claude-sonnet-3-5
anthropic/claude-haiku-3-5

For a complete list, see Claude Models overview.

Google

Requirements

Python package API environment variable
google-genai GOOGLE_API_KEY

Models

Name
google/gemini-3-pro-preview
google/gemini-2.5-pro
google/gemini-2.5-flash
google/gemini-2.5-flash-lite
google/gemini-2.0-pro
google/gemini-2.0-flash
google/gemini-2.0-flash-lite

For a complete list, see Gemini models.

AWS Bedrock

Requirements

Python package API environment variables
aioboto3 AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY

Models

To search the extensive list of models available on AWS, see Supported foundation models in Amazon Bedrock.

Azure AI

Requirements

Python packages API environment variables
azure-ai-inference
azure-identity
AZUREAI_API_KEY
AZUREAI_BASE_URL

For a complete list, see Microsoft Foundry Catalog.

Ollama

Requirements

Python package API environment variable
openai OLLAMA_BASE_URL

Models

To search an Ollama model, see Ollama model search.

Mistral

Requirements

Python package API environment variable
mistral MISTRAL_API_KEY

Models

Name
mistral/mistral-large-latest
mistral/mistral-large-3
mistral/mistral-medium-3.1
mistral/mistral-small-3.2

For a complete list, see Mistal Models.

DeepSeek

Requirements

Python package API environment variable
openai DEEPSEEK_API_KEY

Models

Name
deepseek/deepseek-chat
deepseek/deepseek-reasoner

For a complete list, see DeepSeek Models and Pricing.

Grok

Requirements

Python package API environment variable
openai XAI_API_KEY

Models

Name
grok/grok-4-1-fast-reasoning
grok/grok-4-1-fast-non-reasoning
grok/grok-code-fast-1
grok/grok-4-fast-reasoning
grok/grok-4-fast-non-reasoning
grok/grok-4-0709
grok/grok-3-mini
grok/grok-3

For a complete list, see xAI Models and Pricing.

Hugging Face

Requirements

Python packages API environment variable
torch
transformers
HF_TOKEN

Models

Refer to Huggin Face models using the hf/ prefix and the model name.

For example:

Name
hf/meta-llama/Llama-2-7b-chat-hf

To search the extensive list of models available on Hugging Face, see Huggin Face Models.

Copyright 2025 Gage ML, Inc.