Skip to main content
Base URL: https://ai.megallm.io/v1 for all OpenAI-compatible endpoints

​
Available Endpoints

Chat Completions

Generate conversational responses with GPT models

Streaming

Real-time streaming responses with Server-Sent Events

Function Calling

Execute functions and tools with parallel support

Models

Browse available models and capabilities

​
Quick Example

from openai import OpenAI

# Initialize client
client = OpenAI(
    base_url="https://ai.megallm.io/v1",
    api_key="your-api-key"
)

# Simple chat completion
response = client.chat.completions.create(
    model="gpt-4",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Explain quantum computing in simple terms."}
    ],
    temperature=0.7,
    max_tokens=150
)

print(response.choices[0].message.content)

​
Supported Models

ModelContext WindowUse Case
gpt-48,192 tokensComplex reasoning, analysis
gpt-4-32k32,768 tokensLong documents, extensive context
gpt-4-turbo128,000 tokensLarge-scale processing
gpt-3.5-turbo16,385 tokensFast, cost-effective responses

​
Features

​
Full Compatibility

Drop-in replacement for OpenAI API - use your existing code without changes.

​
High Performance

Fast response times with optimized infrastructure.

​
Usage Tracking

Monitor your API usage and costs.

​
SDK Support

MegaLLM works with all OpenAI-compatible SDKs:
  • Python: openai official SDK
  • Node.js: openai official SDK
  • Go: go-openai
  • Rust: async-openai
  • Java: openai-java
  • C#: OpenAI-DotNet

​
Rate Limits

TierRequests/minTokens/min
Basic6090,000
Pro300450,000
EnterpriseCustomCustom

​
Migration Guide

Migrating from OpenAI to MegaLLM is simple: 
# Before (OpenAI)
client = OpenAI(api_key="sk-...")

# After (MegaLLM)
client = OpenAI(
    base_url="https://ai.megallm.io/v1",
    api_key="your-api-key"
)
That’s it! All your existing code continues to work.

​
Error Handling

MegaLLM returns OpenAI-compatible error responses: 
{
  "error": {
    "message": "Invalid request parameter",
    "type": "invalid_request_error",
    "param": "temperature",
    "code": null
  }
}
Pro Tip: Enable debug mode with X-Debug: true header to get detailed error information during development.

​
Next Steps