Connect Opik Playground

Opik’s AI Providers settings supply models to Playground and online evaluations. This guide assumes you already have an Opik workspace and permission to manage those settings. The saved connection can be used by permitted workspace users, and its prompts and outputs pass through Opik. Review workspace access and data retention before using private data. Tracing an application’s requests is a separate integration.

1. Create a custom provider

Open Workspace Settings → AI Providers → Add configuration. In Provider Configuration, choose vLLM / Custom provider, which supports arbitrary OpenAI-compatible endpoints.

Setting	Value
Provider Name	A unique label, such as my-api
URL	The service Base URL above, including /v1
Authentication	Static API key, with your service key
Models	Exact text model IDs from the authenticated models endpoint
Custom Headers	Leave empty for this setup

Enter the key privately in Opik’s credential field, without Bearer. Do not put it in a custom header or a setup chat. Use the API base rather than a full /chat/completions URL. Save the configuration, preserving other providers.

2. Run a small Playground check

Open Playground and select the new custom provider and one of its listed models. Run a short text prompt and confirm the request in your service dashboard. Running prompts or connection tests that invoke a model can spend balance.

The saved provider stays available to the workspace. Reopen the selector after changes. For missing models, inspect the manually configured Models list; for 404, inspect the Base URL. Check the service key and model access for authentication failures.

3. Use evaluations deliberately

Select the provider explicitly when configuring a model-based evaluation. Test a small sample before enabling an online rule, since evaluation traffic can generate additional paid requests. Judge prompts, structured outputs and tool calls must fit the selected model’s capabilities.

This connection uses OpenAI-compatible Chat Completions. It does not automatically instrument applications, configure media models or replace the service dashboard’s usage records.

See Opik’s official AI Providers guide for the custom provider form and evaluation usage.