Created a small REST api service that uses Scala, Akka-Http and DJL.ai (deep java library) together to perform inference.
https://github.com/skirdey/djl-akka-http
sbt run &&
curl --location --request POST 'http://127.0.0.1:8080/inferences' \
--header 'Content-Type: application/json' \
--data-raw '{"text": "whatever"}'