Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Releases: zazencodes/arbiter-mcp-evals

v0.1.0

21 Sep 15:35

Choose a tag to compare

Added

  • Initial release of Arbiter CLI
    • Commands:
      • execute: Run an evaluation suite from a configuration file
      • genesis: Create an example configuration file
      • forge: Interactively generate a custom evaluation config
      • council: Launch a local dashboard to review an eval results JSON
    • LLM-as-judge with rule checks and summary metrics
    • Cost estimation via LiteLLM pricing metadata