New: every message picks a fast or a slow model

Vercel AI Gateway

Access Vercel AI Gateway's model discovery, inference, generation, and usage APIs through a unified AI model gateway.

What agents can do

Actions22

  • Compact response

    Compact a long OpenAI Responses conversation into replayable context through Vercel AI Gateway.

  • Count message tokens

    Estimate input tokens for Anthropic-format messages, system content, and tools before sending a model request through Vercel AI Gateway.

  • Create anthropic message

    Create one non-streaming Anthropic Messages-compatible result through Vercel AI Gateway, with multimodal content, tools, extended thinking, and routing controls.

  • Create chat completion

    Create one non-streaming OpenAI Chat Completions-compatible result through Vercel AI Gateway, with multimodal messages, tools, structured output, fallback models, and routing controls.

  • Create embeddings

    Generate OpenAI-compatible vector embeddings through Vercel AI Gateway for text or token inputs, with optional dimensions and routing controls.

  • Edit images

    Create edited images from up to 16 HTTPS or base64 data-URL source images and a text instruction.

  • Evaluate state

    Evaluate one shared state against one or more typed choice, score, or boolean questions using an AI Gateway evaluation model.

  • Generate images

    Generate one or more images from a text prompt through an image-only Vercel AI Gateway model.

14 more
  • Generate response

    Generate one non-streaming OpenAI Responses-compatible result through AI Gateway, with optional instructions, tools, structured output, reasoning, and routing controls.

  • Generate speech

    Generate spoken audio from text through a Vercel AI Gateway speech model.

  • Get credit balance

    Return the connected team's remaining AI Gateway credit balance and lifetime credit usage in USD.

  • Get generation

    Look up cost, token usage, provider routing, latency, and finish details for one completed Vercel AI Gateway generation.

  • Get model

    Return detailed capabilities, modalities, limits, tags, and pricing for one exact Gateway model ID.

  • Get model endpoints

    Compare provider endpoints serving one Vercel AI Gateway model, including limits, pricing, caching, availability, throughput, and latency.

  • Get spend report

    Query aggregated Vercel AI Gateway spend and token usage.

  • List model catalog

    List AI Gateway model-to-provider routes and capability tags, with bounded local filtering by model text, provider, or tag.

  • List typesafe models

    List evaluation models available through AI Gateway's TypeSafe-compatible API, including each accepted model name, description, and release date.

  • Rerank object documents

    Rank structured object documents by relevance through the Cohere v1 route, using selected rank fields and optionally returning each source document.

  • Rerank text documents

    Rerank string documents through the current Cohere v2 compatibility endpoint.

  • Search models

    Search the AI Gateway model catalog by text, model type, and tags, returning capability and pricing metadata for matching models.

  • Transcribe audio

    Transcribe base64-encoded recorded audio through a Vercel AI Gateway transcription model.

  • Typesafe evaluate

    Evaluate one shared state through AI Gateway's TypeSafe-compatible System One API.

How it connects

You paste an API key from Vercel AI Gateway on a page Composio hosts, so the key never passes through Definable.

Keep the connection to yourself or share it with your workspace. Any action that writes or sends can wait for your approval.