Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
This performance testing framework evaluates the maximum throughput of a Kafka cluster, and compares the put latency of different broker, producer, and consumer configurations. To run a test, you need ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results