npm

llmfit

Detect and benchmark LLM models compatible with your hardware

brewmacoslinux
Try with needOr install directly
Source

About

Find what models run on your hardware

Commands

llmfit

Examples

Scan your system to find compatible LLM models$ llmfit scan
Benchmark a specific model to test performance on your hardware$ llmfit benchmark --model mistral-7b
Show detailed hardware information and recommendations$ llmfit info