Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[Feat]: Auto-Evaluation Metrics Based for every LLM RequestΒ #470

@amanagarwal042

Description

@amanagarwal042

πŸš€ What's the Problem?

Right now OpenLIT can show the LLM events but their is no automated way to see if a event performed good or bad. This can be done using Eval metrics that generally run against a dataset

πŸ’‘ Your Dream Solution

Auto Evalutaion scoring for all LLM requests traced and stored in OpenLIT

πŸ€” Seen anything similar?

NA

πŸ–ΌοΈ Pictures or Drawings

NA

πŸ‘ Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!

Metadata

Metadata

Labels

πŸš€ FeatureNew feature or requestclientIssue related to OpenLIT Client

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions