Skip to main content

Endpoint

Returns the result immediately — no polling needed.
Which endpoint to use for LLM? Check capabilities.endpoint from GET /v1/models:
  • Standard chat models (GPT-, Gemini-, etc.) have "endpoint": "/v1/chat/completions" — use POST /v1/chat/completions with messages[] (OpenAI-compatible format).
  • Some LLM models and all non-LLM models (STT, OCR, caption) have "endpoint": "/v1/generate" — use this endpoint with a prompt field.
For image generation use POST /v1/images/generations.

Request

string
required
Bearer <your-token>
string
required
application/json

Body

string
required
Model ID from GET /v1/models. Accepted types: llm, speech-to-text, image-to-text, video-to-text.
string
Text prompt or question. Required for LLM and most models.
string
System prompt for LLM models.
number
Maximum tokens for LLM response. Range: 1–32768.
number
default:"1"
Sampling temperature (0–2). Lower = more deterministic.
boolean
Include reasoning trace in LLM response.
string
Audio file URL for speech-to-text models.
string
Language hint for STT (e.g. vi, en). Pass auto for automatic detection.
string
Image URL for image-to-text, OCR, or vision models.
array
Array of image URLs for vision LLM models.
string
Video URL for video-to-text / captioning models.
string
Output format for OCR models. Values: json, markdown.

Examples

LLM — text generation (dùng id từ GET /v1/models với capabilities.endpoint: "/v1/generate"):
Speech to text:
OCR:
Video captioning:

Response 200

Text / transcription:
For image generation use POST /v1/images/generations — it has its own response format.