{"id":1369,"date":"2023-05-17T20:10:43","date_gmt":"2023-05-17T20:10:43","guid":{"rendered":"https:\/\/www.analyticsvidhya.com\/datahack-summit-2023\/?page_id=1369"},"modified":"2023-07-19T19:08:13","modified_gmt":"2023-07-19T13:38:13","slug":"the-art-of-exploration-in-automated-decision-making-systems","status":"publish","type":"page","link":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/","title":{"rendered":"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem"},"content":{"rendered":"<p><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system's exploration of the problem, a process involving a broad sweep of the state space and experimental engagement with a range of actions or decisions. The focus of this power talk will revolve around diverse exploration strategies and their impact on training quality.\\n\\nFor a nuanced understanding of this subject, this talk will also consider the exploration-exploitation dilemma from a generative AI perspective. It will draw parallels between generative models and exploration.\\n\\nKey Takeaways:\\n\\n Understand the exploration-exploitation dilemma in automated decision-making systems\\n Gain insights into how generative AI can inform exploration strategies\\n Explore different exploration strategies and their effects on the quality of training\\n&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:17405,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0,&quot;17&quot;:1}\">In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system&#8217;s exploration of the problem, a process involving a broad sweep of the state space and experimental engagement with a range of actions or decisions. The focus of this power talk will revolve around diverse exploration strategies and their impact on training quality.<\/span><\/p>\n<p>For a nuanced understanding of this subject, this talk will also consider the exploration-exploitation dilemma from a generative AI perspective. It will draw parallels between generative models and exploration.<\/p>\n<p><strong>Key Takeaways:<br \/>\n<\/strong><\/p>\n<ul>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system's exploration of the problem, a process involving a broad sweep of the state space and experimental engagement with a range of actions or decisions. The focus of this power talk will revolve around diverse exploration strategies and their impact on training quality.\\n\\nFor a nuanced understanding of this subject, this talk will also consider the exploration-exploitation dilemma from a generative AI perspective. It will draw parallels between generative models and exploration.\\n\\nKey Takeaways:\\n\\n Understand the exploration-exploitation dilemma in automated decision-making systems\\n Gain insights into how generative AI can inform exploration strategies\\n Explore different exploration strategies and their effects on the quality of training\\n&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:17405,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0,&quot;17&quot;:1}\">Understand the exploration-exploitation dilemma in automated decision-making systems<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system's exploration of the problem, a process involving a broad sweep of the state space and experimental engagement with a range of actions or decisions. The focus of this power talk will revolve around diverse exploration strategies and their impact on training quality.\\n\\nFor a nuanced understanding of this subject, this talk will also consider the exploration-exploitation dilemma from a generative AI perspective. It will draw parallels between generative models and exploration.\\n\\nKey Takeaways:\\n\\n Understand the exploration-exploitation dilemma in automated decision-making systems\\n Gain insights into how generative AI can inform exploration strategies\\n Explore different exploration strategies and their effects on the quality of training\\n&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:17405,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0,&quot;17&quot;:1}\">Gain insights into how generative AI can inform exploration strategies<\/span><\/li>\n<li><span data-sheets-value=\"{&quot;1&quot;:2,&quot;2&quot;:&quot;In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system's exploration of the problem, a process involving a broad sweep of the state space and experimental engagement with a range of actions or decisions. The focus of this power talk will revolve around diverse exploration strategies and their impact on training quality.\\n\\nFor a nuanced understanding of this subject, this talk will also consider the exploration-exploitation dilemma from a generative AI perspective. It will draw parallels between generative models and exploration.\\n\\nKey Takeaways:\\n\\n Understand the exploration-exploitation dilemma in automated decision-making systems\\n Gain insights into how generative AI can inform exploration strategies\\n Explore different exploration strategies and their effects on the quality of training\\n&quot;}\" data-sheets-userformat=\"{&quot;2&quot;:17405,&quot;3&quot;:{&quot;1&quot;:0},&quot;5&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;6&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;7&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;8&quot;:{&quot;1&quot;:[{&quot;1&quot;:2,&quot;2&quot;:0,&quot;5&quot;:{&quot;1&quot;:2,&quot;2&quot;:0}},{&quot;1&quot;:0,&quot;2&quot;:0,&quot;3&quot;:3},{&quot;1&quot;:1,&quot;2&quot;:0,&quot;4&quot;:1}]},&quot;9&quot;:1,&quot;10&quot;:1,&quot;11&quot;:3,&quot;12&quot;:0,&quot;17&quot;:1}\">Explore different exploration strategies and their effects on the quality of training<br \/>\n<\/span><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system&#8217;s exploration of the problem, a process involving a broad sweep [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1371,"parent":1126,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"session-details.php","meta":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem - DataHack Summit 2023<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem - DataHack Summit 2023\" \/>\n<meta property=\"og:description\" content=\"In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system&#8217;s exploration of the problem, a process involving a broad sweep [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/\" \/>\n<meta property=\"og:site_name\" content=\"DataHack Summit 2023\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-19T13:38:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-content\/uploads\/2023\/05\/art-of-exploration.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"500\" \/>\n\t<meta property=\"og:image:height\" content=\"250\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/\",\"url\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/\",\"name\":\"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem - DataHack Summit 2023\",\"isPartOf\":{\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website\"},\"datePublished\":\"2023-05-17T20:10:43+00:00\",\"dateModified\":\"2023-07-19T13:38:13+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Session\",\"item\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website\",\"url\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/\",\"name\":\"DataHack Summit 2023\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem - DataHack Summit 2023","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/","og_locale":"en_US","og_type":"article","og_title":"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem - DataHack Summit 2023","og_description":"In the realm of automated decision-making systems, the objective is to develop a policy that not only observes the present state of the system but also computes the optimal action or decision to be implemented. The quality of learning is deeply entrenched in the system&#8217;s exploration of the problem, a process involving a broad sweep [&hellip;]","og_url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/","og_site_name":"DataHack Summit 2023","article_modified_time":"2023-07-19T13:38:13+00:00","og_image":[{"width":500,"height":250,"url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-content\/uploads\/2023\/05\/art-of-exploration.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/","url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/","name":"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem - DataHack Summit 2023","isPartOf":{"@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website"},"datePublished":"2023-05-17T20:10:43+00:00","dateModified":"2023-07-19T13:38:13+00:00","breadcrumb":{"@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/the-art-of-exploration-in-automated-decision-making-systems\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/"},{"@type":"ListItem","position":2,"name":"Session","item":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/"},{"@type":"ListItem","position":3,"name":"Reimagining the Exploration-Exploitation Dilemma as a Generative AI Problem"}]},{"@type":"WebSite","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website","url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/","name":"DataHack Summit 2023","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1369"}],"collection":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/comments?post=1369"}],"version-history":[{"count":7,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1369\/revisions"}],"predecessor-version":[{"id":2394,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1369\/revisions\/2394"}],"up":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1126"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/media\/1371"}],"wp:attachment":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/media?parent=1369"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}