Prerequisites

• Search the current open issues

What are you trying to do that currently feels hard or impossible?

GenAI Toolbox currently exposes telemetry only via OpenTelemetry (--telemetry-otlp).
There is no native /metrics endpoint, which prevents Prometheus-based environments from scraping metrics without running an OpenTelemetry Collector.

This issue proposes adding first-class Prometheus metrics support as a lightweight, optional alternative to OpenTelemetry.

Problem Statement

Many Kubernetes platforms rely on Prometheus as the default observability stack and avoid introducing OpenTelemetry collectors due to:

Additional operational complexity

Extra components to deploy and maintain

Overhead for single-service deployments

Currently:

/metrics endpoint returns 404

Kubernetes annotation-based scraping does not work

Metrics can only be exported via OTEL pipelines

This limits adoption in Prometheus-first environments.

Proposed Solution

Introduce native Prometheus metrics exposure in Toolbox:

Add an HTTP /metrics endpoint using prometheus/client_golang

Metrics exposed independently of OpenTelemetry

Compatible with Kubernetes annotation-based scraping

Can coexist with existing OTEL support

This does not remove or replace OpenTelemetry.

Suggested Solution(s)

No response

Alternatives Considered

No response

Additional Details

No response