{"id":2206,"date":"2023-07-05T14:21:03","date_gmt":"2023-07-05T08:51:03","guid":{"rendered":"https:\/\/www.analyticsvidhya.com\/datahack-summit-2023\/?page_id=2206"},"modified":"2023-07-19T19:09:43","modified_gmt":"2023-07-19T13:39:43","slug":"using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models","status":"publish","type":"page","link":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/","title":{"rendered":"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models"},"content":{"rendered":"<p><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.<\/span><\/p>\n<p><strong>Key Takeaways:<\/strong><\/p>\n<ol>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Introduction to NLP<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Overview of Transformers<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Evolution of Transformers to LLMs<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Mitigation options for hallucination and knowledge cutoffs<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Introducing Retrieval Augmented Generation<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">RAG at scale with Amazon Kendra<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock<br \/>\n<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram will then discuss some of the Pros and Cons with LLMs specifically focusing on challenges with hallucinations and knowledge cut-offs. Vikram will discuss some options to mitigate these challenges and introduce Retrieval Augmented Generation, tokenization and the power of Vector DBs for semantic matching. For customers\/organizations to quickly leverage the power of LLMs, Vikram will introduce Amazon Kendra, an ML powered search service and talk about why Amazon Kendra is mission-critical for organizations looking to adopt Generative AI within their enterprises securely, reliably, quickly, and realize business benefits at scale when integrating with these LLMs. Vikram will walk through key industry use cases for LLMs that a RAG approach can provide immediate benefits and discuss how customers\/community can get started today to implement Kendra with LLMs on AWS.\\n\\nKey Takeaways:\\n\\n Introduction to NLP\\n Overview of Transformers\\n Evolution of Transformers to LLMs\\n Mitigation options for hallucination and knowledge cutoffs\\n Introducing Retrieval Augmented Generation\\n RAG at scale with Amazon Kendra\\n Industry use cases leveraging benefits of Amazon Kendra with LLMs on Amazon Bedrock\\n Getting started with Amazon Kendra and Amazon Bedrock today&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:1021,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0}\">Getting started with Amazon Kendra and Amazon Bedrock today<\/span><\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":2207,"parent":1126,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"session-details.php","meta":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models - DataHack Summit 2023<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models - DataHack Summit 2023\" \/>\n<meta property=\"og:description\" content=\"In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/\" \/>\n<meta property=\"og:site_name\" content=\"DataHack Summit 2023\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-19T13:39:43+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-content\/uploads\/2023\/07\/s-knowledge_cutoff.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"500\" \/>\n\t<meta property=\"og:image:height\" content=\"250\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/\",\"url\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/\",\"name\":\"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models - DataHack Summit 2023\",\"isPartOf\":{\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website\"},\"datePublished\":\"2023-07-05T08:51:03+00:00\",\"dateModified\":\"2023-07-19T13:39:43+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Session\",\"item\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website\",\"url\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/\",\"name\":\"DataHack Summit 2023\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models - DataHack Summit 2023","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/","og_locale":"en_US","og_type":"article","og_title":"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models - DataHack Summit 2023","og_description":"In this session, Vikram will cover the history and evolution of LLMs starting with Transformers architecture and its applicability in a variety of Natural Language Processing tasks. He will then pivot to the introduction of LLMs, the different types of encoder-decoder paradigms and how LLMs have changed the ML game with recent mass adoption. Vikram [&hellip;]","og_url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/","og_site_name":"DataHack Summit 2023","article_modified_time":"2023-07-19T13:39:43+00:00","og_image":[{"url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-content\/uploads\/2023\/07\/s-knowledge_cutoff.jpg","width":500,"height":250,"type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/","url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/","name":"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models - DataHack Summit 2023","isPartOf":{"@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website"},"datePublished":"2023-07-05T08:51:03+00:00","dateModified":"2023-07-19T13:39:43+00:00","breadcrumb":{"@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/using-retrieval-augmented-generation-to-prevent-hallucination-and-knowledge-cut-offs-in-large-language-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/"},{"@type":"ListItem","position":2,"name":"Session","item":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/"},{"@type":"ListItem","position":3,"name":"Using Retrieval Augmented Generation to prevent hallucination and knowledge cut-offs in Large Language Models"}]},{"@type":"WebSite","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website","url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/","name":"DataHack Summit 2023","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/2206"}],"collection":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/comments?post=2206"}],"version-history":[{"count":5,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/2206\/revisions"}],"predecessor-version":[{"id":2927,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/2206\/revisions\/2927"}],"up":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1126"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/media\/2207"}],"wp:attachment":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/media?parent=2206"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}