DJLServing KServe V2 Protocol¶
APIs¶
Health:¶
GET v2/health/live
GET v2/health/ready
GET v2/models/${MODEL_NAME}[/versions/${MODEL_VERSION}]/ready
Model Metadata:¶
GET v2/models/${MODEL_NAME}[/versions/${MODEL_VERSION}]
Inference:¶
POST v2/models/${MODEL_NAME}[/versions/${MODEL_VERSION}]/infer
Reference from Kserve¶
Instructions¶
Instructions for using plugins can be found on the main plugins page.