DataHour: Evaluation of GenAI Models and Search Use Case
DataHour: Evaluation of GenAI Models and Search Use Case
24 Aug 202313:08pm - 24 Aug 202314:08pm
DataHour: Evaluation of GenAI Models and Search Use Case
About the Event
Similar to other AI/ML models, the evaluation of GenAI models is a crucial step. However, this process presents distinctive challenges due to the absence of manual curation in the training data, which makes it difficult to ensure the inclusion of relevant benchmarks. In simpler terms, it's highly probable that the model has already been trained on benchmark data, leading to the creation of newer benchmarks.
This raises pertinent questions about the resulting implications. What do these benchmarks signify, and how can we effectively assess the quality of a model? In the forthcoming presentation, the speaker will explore one specific use case - Search - to delve into the intricacies of benchmark concerns. He will provide insights into why GenAI might not be suitable for high-level search tasks, touching upon concepts like BM25 for a better understanding of the subject.
Prerequisites: It is beneficial to have a basic familiarity with Machine Learning and GenerativeAI Models for this webinar.
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
Who is this DataHour for?
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
- Best articles get published on Analytics Vidhya’s Blog Space
About the Speaker
Participate in discussion
Registration Details
Registered
Become a Speaker
Share your vision, inspire change, and leave a mark on the industry. We're calling for innovators and thought leaders to speak at our event
- Professional Exposure
- Networking Opportunities
- Thought Leadership
- Knowledge Exchange
- Leading-Edge Insights
- Community Contribution
