Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
After Hurricane Helene struck western North Carolina in September 2024, Kevin Miller fired up his old chainsaw and spent hours sawing through trunks and limbs of downed trees. The toll was enormous: ...