A ChatBot and Multi-Model RAG on your Laptop

A ChatBot and Multi-Model RAG on your Laptop

21 May 202413:05pm - 21 May 202414:05pm

A ChatBot and Multi-Model RAG on your Laptop

About the Event

What if we could run state-of-the-art open-source LLMs and RAG on a typical personal computer? Did you think it was a lost cause? Well, it's not!


In this session, thanks to Hugging Face Optimum, OpenVino and Intel Labs, We will demonstrate how to apply different optimization techniques such as 4-bit quantization, speculative decoding to the 2.7B MFST Phi-2 and LLaVA Phi-2 model , and chat with your MM docs on mid-range laptop powered by an Intel Corporation Meteor Lake CPU.


In this DataHour, Moshe will cover the following points in detail:

  • Why local LLM inference is desirable and now possible
  • Intel Meteor Lake
  • The Microsoft Phi-2 model
  • Quantization with Intel OpenVINO and Optimum Intel
  • ChatBot on your Laptop – Demo
  • Introduction to fastRAG
  • Chat with your MM docs on your Laptop – Demo
  1. Best articles get published on Analytics Vidhya’s Blog Space
  2. Best articles get published on Analytics Vidhya’s Blog Space
  3. Best articles get published on Analytics Vidhya’s Blog Space
  4. Best articles get published on Analytics Vidhya’s Blog Space
  5. Best articles get published on Analytics Vidhya’s Blog Space

Who is this DataHour for?

  1. Best articles get published on Analytics Vidhya’s Blog Space
  2. Best articles get published on Analytics Vidhya’s Blog Space
  3. Best articles get published on Analytics Vidhya’s Blog Space

About the Speaker

Moshe Wasserblat

Moshe Wasserblat

Research Lead at Intel Labs

Moshe Wasserblat is the NLP DL Research Lead for Intel Lab Emergent AI group. Previously, he was with NICE Systems for more than 17 years, where he founded and led the speech and text analytics research team. He has filed more than 60 patents in the field of language technology and has several publications in international conferences and journals.

Participate in discussion

Registration Details

5349

Registered

Become a Speaker

Share your vision, inspire change, and leave a mark on the industry. We're calling for innovators and thought leaders to speak at our event

  • Professional Exposure
  • Networking Opportunities
  • Thought Leadership
  • Knowledge Exchange
  • Leading-Edge Insights
  • Community Contribution