Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

The getpass.getpass() function in the Python Standard Library won't display "mask" characters as you type; it only displays nothing as you type. If you want mask characters to appear, you can use the ...