EvalCI

Run automated LLM evaluations on every pull request with the SynapseKit EvalCI GitHub Action.

📄️ EvalCI — LLM Quality Gates

EvalCI is a GitHub Action that runs your @evalcase suites on every pull request and blocks merge if quality drops below threshold.

📄️ Quickstart

Get EvalCI running on your repo in under 5 minutes.

📄️ Writing Eval Cases

Eval cases are ordinary Python functions decorated with @eval_case. EvalCI discovers and runs them automatically.

📄️ Action Reference

Complete reference for all EvalCI inputs, outputs, and configuration options.

📄️ Examples

Real-world EvalCI workflow configurations and eval case patterns.

📄️ Troubleshooting

Common EvalCI errors and how to fix them.