A streamlined and customizable framework for efficient large model evaluation and performance benchmarking - eval-scope/README_zh.md at main · everloom/eval-scope ...
DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9. - modelscope/dash-infer ...