npm

mteb

Benchmark and evaluate text embedding models at scale.

pipmacoslinuxwindows
Try with needOr install directly
Source

About

Massive Text Embedding Benchmark

Commands

mteb

Examples

evaluate how good an embedding model is on standard tasks$ mteb run -m sentence-transformers/all-MiniLM-L6-v2
test embedding model performance on semantic similarity$ mteb run -m sentence-transformers/all-MiniLM-L6-v2 -t STS
benchmark multiple embedding models at once$ mteb run -m sentence-transformers/all-MiniLM-L6-v2 sentence-transformers/all-mpnet-base-v2
compare embedding model results and view scores$ mteb eval -m sentence-transformers/all-MiniLM-L6-v2 --output_folder ./results
list all available embedding benchmark datasets$ mteb list_datasets