Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Rust is one of the newest programming languages, and it can change how you see code.
It contains a production grade implementation including DEPLOYMENT code with CDK and a CI/CD pipeline, testing, observability and more (see Features section). Choose the architecture that you see fit, ...