DataHour: Production Stack for LLMs

DataHour: Production Stack for LLMs

07 Nov 202313:11pm - 07 Nov 202314:11pm

DataHour: Production Stack for LLMs

About the Event

Conducting a Proof of Concept (POC) with a Large Language Model (LLM) is impressively swift, allowing you to have a functional prototype ready within a weekend. The experience is almost enchanting due to the sheer potency of the underlying technology.

However, transitioning from this experimental phase to full-scale production is a challenging endeavor. Numerous considerations must be meticulously addressed before deploying it confidently to serve millions of users. In this session, we will delve into the hurdles that emerge when operating at a large scale and explore the ideal architecture of an LLM stack for such endeavors.

  1. Best articles get published on Analytics Vidhya’s Blog Space
  2. Best articles get published on Analytics Vidhya’s Blog Space
  3. Best articles get published on Analytics Vidhya’s Blog Space
  4. Best articles get published on Analytics Vidhya’s Blog Space
  5. Best articles get published on Analytics Vidhya’s Blog Space

Who is this DataHour for?

  1. Best articles get published on Analytics Vidhya’s Blog Space
  2. Best articles get published on Analytics Vidhya’s Blog Space
  3. Best articles get published on Analytics Vidhya’s Blog Space

About the Speaker

Ayush Garg

Ayush Garg

Co-Founder at Portkey

Over the past 2.5 years, Ayush has been dedicated to harnessing the power of LLMs, and the results are nothing short of astounding. Ayush's creation, PepperType, not only came into existence but also reached the hands of millions of users worldwide, showcasing his ability to scale innovations on a global scale.Ayush has a knack for working with early-stage startups and has left his architectural imprint on products that have soared to an impressive 25 million Daily Active Users (DAU). His track record demonstrates an exceptional talent for transforming ideas into impactful, user-driven realities.Currently, Ayush is deeply immersed in the development of Portkey, a comprehensive LLM Ops platform. Portkey serves as the catalyst, empowering organizations to expedite the deployment of their cutting-edge Gen AI Apps to production with remarkable efficiency. 

Participate in discussion

Registration Details

8185

Registered

Become a Speaker

Share your vision, inspire change, and leave a mark on the industry. We're calling for innovators and thought leaders to speak at our event

  • Professional Exposure
  • Networking Opportunities
  • Thought Leadership
  • Knowledge Exchange
  • Leading-Edge Insights
  • Community Contribution