Jump to Content

Guides Discussions

v1.0

Guides

v1.0Guides Discussions

Introduction

Get started

Configuration

Gateway setup

Features

Request logging
- Request caching
  - OpenAI caching
  - Anthropic caching
- Custom metadata
Model analytics
- AI SQL editor
  - Static IPs
  - Connection string
- Use cases
Evaluations

Platform

Data retention
Plan limits
Custom deployments
Pricing
Help & Feedback

Use cases

Query LLM logs to analyze usage

Use the AI SQL editor to query your LLM logs. See examples below.

Batch API observability
Analyze caching
Datasets for finetuning

Updated 2 months ago