EvalCI

Run automated LLM evaluations on every pull request with the SynapseKit EvalCI GitHub Action.

📄️ EvalCI — LLM Evaluation in CI/CD | SynapseKit

Run LLM quality gates on every pull request with EvalCI. Block merges when quality drops. GitHub Actions integration, no infrastructure required.

Get EvalCI running on your repo in under 5 minutes.

Eval cases are ordinary Python functions decorated with @eval_case. EvalCI discovers and runs them automatically.

Complete reference for all EvalCI inputs, outputs, and configuration options.

Real-world EvalCI workflow configurations and eval case patterns.

Common EvalCI errors and how to fix them.