olore-tensorzero-latest

name: olore-tensorzero-latest description: Local TensorZero documentation reference (latest). TensorZero documentation. Use for LLM gateway configuration, inference API, model provider integrations, optimization (fine-tuning, DICL), experimentation, evaluations, deployment, and observability.

TensorZero Documentation

TensorZero is an open-source stack for industrial-grade LLM applications that unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

Documentation Structure

contents/
├── gateway/               # LLM gateway API, configuration, and guides (18 files)
├── integrations/
│   └── model-providers/   # Provider integrations: OpenAI, Anthropic, AWS, GCP, etc. (20 files)
├── deployment/            # Deploying gateway, UI, ClickHouse, Postgres, Redis (8 files)
├── operations/            # Auth, rate limits, credentials, metrics, cost tracking (9 files)
├── optimization/          # Fine-tuning (SFT), DICL, GEPA prompt optimization (4 files)
├── evaluations/           # Inference and workflow evaluations (6 files)
├── experimentation/       # A/B tests and experiment namespaces (3 files)
├── observability/         # Querying historical inferences (1 file)
├── index.mdx              # Product overview
├── quickstart.mdx         # Getting started
└── faq.mdx                # FAQ

Topic Guide

When to use

Use this skill when the user asks about:

• Configuring the TensorZero LLM gateway (functions, variants, models, providers, prompt templates)
• Calling LLMs via the TensorZero inference API or OpenAI-compatible API
• Integrating with model providers (OpenAI, Anthropic, AWS, GCP, Azure, Groq, Mistral, vLLM, etc.)
• Collecting feedback and metrics from LLM inferences
• Deploying TensorZero (gateway, UI, ClickHouse, Postgres, Redis)
• Managing authentication, credentials, and rate limits
• Running A/B experiments and adaptive tests
• Optimizing LLM applications with fine-tuning (SFT), DICL, or GEPA
• Running evaluations on inference or workflow outputs
• Tracking usage, cost, and exporting telemetry

How to find information

1. Use Topic Guide above to identify relevant files
2. Read TOC.md for complete file listing by directory
3. Read specific files from contents/{path}