Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Department of Chemistry and Biochemistry, University of South Carolina, Columbia, United States ...
Jonathan Kwan is an Assistant Professor of Philosophy at New York University Abu Dhabi and was previously the Markkula Center’s Inclusive Excellence Postdoctoral Fellow in Immigration Ethics. Views ...