DataHour: Optimizing Real-Time ML Inference with Nvidia Triton Inference Server
DataHour: Optimizing Real-Time ML Inference with Nvidia Triton Inference Server
26 Feb 202309:02am - 26 Feb 202310:02am
DataHour: Optimizing Real-Time ML Inference with Nvidia Triton Inference Server
About the Event
Hosting ML Models as an API service is one of the ML model serving patterns when a model is trained offline but hosted for on-demand predictions.
Challenges of Real-time inferencing include but are not limited to strict latency constraints, high throughput and high availability assurances, and expectations of auto-scaling to accommodate changes in the volume of incoming requests.
There are multiple solutions in the market for ML model serving - TF Serving, TorchServe, and Seldon core.
In this DataHour, Sharmili will introduce you to one such Inference server from Nvidia - Triton Inference Server. She will also walk you through the distinguishing features of Triton that makes it powerful.
Prerequisites: Basic understanding of Docker containers fundamentals (101) and python programming and enthusiasm of learning Data Science and Deep Learning.
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
Who is this DataHour for?
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
About the Speaker
Participate in discussion
Registration Details
Registered
Become a Speaker
Share your vision, inspire change, and leave a mark on the industry. We're calling for innovators and thought leaders to speak at our event
- Professional Exposure
- Networking Opportunities
- Thought Leadership
- Knowledge Exchange
- Leading-Edge Insights
- Community Contribution
