Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Rep. Randy Fine, R-Fla., prompted calls for his resignation from Democrats and a major Islamic civil rights group after suggesting in a social media post that he'd choose dogs over Muslims. "If they ...