Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
While we’ve only just met our celebrities and intruders, unfortunately, one will have to ditch the jungle FOR GOOD each week! Here’s who’s been eliminated from I’m A Celebrity… Get Me Out Of Here!