Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...

Abstract: Deep learning-based mobile imaging applications are often limited by the lack of training data. To this end, researchers have resorted to using synthetic training data. However, pure ...