triton-inference-server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.