DJL Serving plugin management¶
Available Plugins¶
- KServe plugin - KServe V2 Protocol support
- Management console plugin - DJL Management console UI
- Cache plugin - Provides additional options for caches
- Static File plugin - Allows DJL Serving to also serve static files
- Plugin Management plugin - Adds plugin management to the management API
Installing plug-ins¶
The model server looks for plug-ins during startup in the plugin folder and register this plug-ins.
The default plug-in folder is
{work-dir}/plugins
The plug-in folder can be configured with the 'plugin-folder' parameter in the server-config file.
example: running model server with gradle using a specific config-file:
djl-serving -f ~/modelserver-config.properties
example config.properties file for djl-server
inference_address=http://127.0.0.1:8081
management_address=http://127.0.0.1:8081
plugin_folder=serving_plugins