Keep a small call small.
Use an integrated model tag when the application owns the whole request and nothing needs to be shared yet.
Find an AI modelApplications keep one OpenAI-compatible request. Behind it, the model, knowledge, tools and policy can change as one shared system.
Two operating modes
How a request works
Your application sends a message to a model or an AI Gateway. A gateway adds the shared behavior you configured, so the application does not have to rebuild it with every call.
Illustrative clients. Configuration is shared; messages and responses remain separate.
A simple example
An application reports a checkout timeout and asks for a severity, a summary and a next action. The response identifies a high-severity incident and suggests inspecting slow queries and database pool wait time.
Replace <gateway-slug> with your gateway identifier. Gateway slugs require a private API key; public keys must use the gateway full ID. The response and token counts below are illustrative, not a live run.
curl https://inference.aivax.net/v1/chat/completions \
-H "Authorization: Bearer $AIVAX_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "<gateway-slug>",
"messages": [
{
"role": "user",
"content": "Checkout timed out after the database pool reached capacity. Return severity, summary and next_action."
}
],
"response_schema": {
"type": "object",
"properties": {
"severity": { "type": "string" },
"summary": { "type": "string" },
"next_action": { "type": "string" }
},
"required": ["severity", "summary", "next_action"]
}
}'
{
"severity": "high",
"summary": "Checkout timeouts followed database pool saturation.",
"next_action": "Inspect slow queries and database pool wait time."
}
Illustrative usage: 318 prompt tokens + 64 completion tokens = 382 total tokens.
After the answer
When conversation logging is enabled, the request and its operational context stay together. Use that record to investigate an unexpected answer, a cost increase or a failed call.
Open the ConsoleSee where the request originated and which model actually handled it.
Follow the gateway, tools and linked collections that shaped the response.
Compare prompt and completion tokens, then inspect messages and errors when something goes wrong.
Origin and request ID connect the call to its record. The record includes the model name, gateway and API key context, linked resources, prompt/completion/total usage and token count, error message, messages, tools and metadata. Use idempotency_key and metadata to correlate records with your own workflow.
Connect another client
Publish one configured gateway as a callable tool without exposing the prompt, retrieval or provider setup behind it.
https://inference.aivax.net/v1/mcp/inference
Gateway capabilities
Route one familiar call across integrated and external models.
Cover eligible model usage through plan-based reserve windows.
Extract, validate and retry malformed JSON against your schema.
Use provider-native or AIVAX-managed JSON Schema output.
Load specialized system instructions only when a request needs them.
Translate images, audio, video and files into text before inference.
Trim context and tool messages to fit the selected model.
Screen input text with reusable gateway policy. Generated output is not moderated; moderation adds cost and latency.
Load shared instructions from controlled remote sources.
Build conversational agents that listen, reason and respond in voice.
Turn generated text into natural audio through compatible models.
Transcribe spoken audio into text ready for models and workflows.
Create images through the same managed inference layer.
Tools + providers / 08 capabilities
Apply policy, enrichment and audit logic outside the prompt through authenticated HTTP hooks.
Attach server-side tools to the same request path.
Let models without native tool calling invoke functions.
Run shell tools inside isolated sandboxed environments.
Connect an external OpenAI-compatible provider through the gateway.
Give agents current web results through a managed search tool.
Extract machine-readable text from images and scanned documents.
Retrieve and normalize page content for agents and pipelines.