Generate conversational AI responses using the OpenAI-compatible chat completions API
Documentation Index
Fetch the complete documentation index at: https://docs.megallm.io/llms.txt
Use this file to discover all available pages before exploring further.
Bearer token authentication (OpenAI-compatible)
Model ID (e.g., gpt-4, claude-3.5-sonnet)
"gpt-4"
Array of message objects
Sampling temperature (0.0 - 2.0)
0 <= x <= 2Maximum tokens to generate
Enable streaming responses
Available functions/tools
Controls tool calling behavior
auto, required, none Nucleus sampling parameter
0 <= x <= 1Penalize frequent tokens
-2 <= x <= 2Penalize repeated tokens
-2 <= x <= 2Number of completions to generate
Stop sequences
Unique user identifier