Skip to content

DJL Serving

This module has been moved to deepjavalibrary/djl-serving repository.

DJL serving is a high performance universal model serving solution. You can use djl-serving serve the following models out of the box:

  • PyTorch TorchScript model
  • TensorFlow SavedModel bundle
  • Apache MXNet model

You can install extra extensions to enable the following models:

  • ONNX model
  • PaddlePaddle model
  • TFLite model
  • XGBoost model
  • LightGBM model
  • Sentencepiece model
  • fastText/BlazingText model