cortexso

Local AI alternative to OpenAI API stack with compatible endpoints

brewmacoslinux
Try with needOr install directly
Source

About

Drop-in, local AI alternative to the OpenAI stack

Commands

cortexso

Examples

Start the Cortex server to run local AI models$ cortexso start
Query a local model via OpenAI-compatible API$ curl http://localhost:8000/v1/chat/completions -X POST -H 'Content-Type: application/json' -d '{"model":"default","messages":[{"role":"user","content":"Hello"}]}'
List available models in Cortex$ cortexso models list