Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Testing isn't optional. Every AI platform interprets your data differently. What works perfectly in ChatGPT might fail completely in Perplexity. Test ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results