djl-serving

Universal model serving framework for deep learning models

brewmacoslinux
Try with needOr install directly
Source

About

This module contains an universal model serving implementation

Commands

djl-serving

Examples

Start DJL Serving with default configuration$ djl-serving
Start DJL Serving on a specific port$ djl-serving -Dserver.port=8080
Load a model from a model store directory$ djl-serving -Dmodel.store=/path/to/models