{"id":1659,"date":"2023-06-07T11:52:57","date_gmt":"2023-06-07T06:22:57","guid":{"rendered":"https:\/\/www.analyticsvidhya.com\/datahack-summit-2023\/?page_id=1659"},"modified":"2023-07-19T19:03:08","modified_gmt":"2023-07-19T13:33:08","slug":"bespoke-llms-building-and-scaling-customized-large-language-models","status":"publish","type":"page","link":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/","title":{"rendered":"Bespoke LLMs : Building and Scaling customized large language models"},"content":{"rendered":"<p>&#8220;As Generative AI continues to evolve, enterprises are increasingly turning to Large language models to improve their business processes and customer experiences. They are becoming a key component of many NLP applications, such as chatbots, code generations etc.<\/p>\n<p>However, many off-the-shelf large language models APIs have limitations and may not be suitable for enterprise needs due to domain specificity of certain use-cases or data sharing restrictions or for strategic reasons. Custom Language Models (LLMs) can be built to meet specific requirements and can be trained to perform specific tasks.<\/p>\n<p>This talk will cover the benefits of building custom LLMs for enterprises, including the process of building custom LLMs, including data collection, preprocessing, training, and evaluation. We will discuss the different ways to adapt the open source LLMs for the enterprise needs.<\/p>\n<p>Attendees will gain an understanding of how LLMs can be tailored to specific enterprise needs, and the benefits and challenges of building custom LLMs. We will also discuss how these custom LLMs can be scaled.<\/p>\n<p><strong>Key takeaways:<\/strong><\/p>\n<ol>\n<li>Pros and Cons of building custom LLMs and what is realistically possible.<\/li>\n<li>Step-by-step demo of building custom LLMs for an example use case.<\/li>\n<li>Considerations for LLM size and latency trade-off.<\/li>\n<li>Best practices in efficiently scaling the custom LLMs.&#8221;<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;As Generative AI continues to evolve, enterprises are increasingly turning to Large language models to improve their business processes and customer experiences. They are becoming a key component of many NLP applications, such as chatbots, code generations etc. However, many off-the-shelf large language models APIs have limitations and may not be suitable for enterprise needs [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1660,"parent":1126,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"session-details.php","meta":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Bespoke LLMs : Building and Scaling customized large language models - DataHack Summit 2023<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Bespoke LLMs : Building and Scaling customized large language models - DataHack Summit 2023\" \/>\n<meta property=\"og:description\" content=\"&#8220;As Generative AI continues to evolve, enterprises are increasingly turning to Large language models to improve their business processes and customer experiences. They are becoming a key component of many NLP applications, such as chatbots, code generations etc. However, many off-the-shelf large language models APIs have limitations and may not be suitable for enterprise needs [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/\" \/>\n<meta property=\"og:site_name\" content=\"DataHack Summit 2023\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-19T13:33:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-content\/uploads\/2023\/06\/large-language-models.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"500\" \/>\n\t<meta property=\"og:image:height\" content=\"250\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/\",\"url\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/\",\"name\":\"Bespoke LLMs : Building and Scaling customized large language models - DataHack Summit 2023\",\"isPartOf\":{\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website\"},\"datePublished\":\"2023-06-07T06:22:57+00:00\",\"dateModified\":\"2023-07-19T13:33:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Session\",\"item\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Bespoke LLMs : Building and Scaling customized large language models\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website\",\"url\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/\",\"name\":\"DataHack Summit 2023\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.analyticsvidhya.com\/dhs-2023\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Bespoke LLMs : Building and Scaling customized large language models - DataHack Summit 2023","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/","og_locale":"en_US","og_type":"article","og_title":"Bespoke LLMs : Building and Scaling customized large language models - DataHack Summit 2023","og_description":"&#8220;As Generative AI continues to evolve, enterprises are increasingly turning to Large language models to improve their business processes and customer experiences. They are becoming a key component of many NLP applications, such as chatbots, code generations etc. However, many off-the-shelf large language models APIs have limitations and may not be suitable for enterprise needs [&hellip;]","og_url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/","og_site_name":"DataHack Summit 2023","article_modified_time":"2023-07-19T13:33:08+00:00","og_image":[{"width":500,"height":250,"url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-content\/uploads\/2023\/06\/large-language-models.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/","url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/","name":"Bespoke LLMs : Building and Scaling customized large language models - DataHack Summit 2023","isPartOf":{"@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website"},"datePublished":"2023-06-07T06:22:57+00:00","dateModified":"2023-07-19T13:33:08+00:00","breadcrumb":{"@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/bespoke-llms-building-and-scaling-customized-large-language-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/"},{"@type":"ListItem","position":2,"name":"Session","item":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/session\/"},{"@type":"ListItem","position":3,"name":"Bespoke LLMs : Building and Scaling customized large language models"}]},{"@type":"WebSite","@id":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/#website","url":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/","name":"DataHack Summit 2023","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1659"}],"collection":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/comments?post=1659"}],"version-history":[{"count":4,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1659\/revisions"}],"predecessor-version":[{"id":2353,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1659\/revisions\/2353"}],"up":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/pages\/1126"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/media\/1660"}],"wp:attachment":[{"href":"https:\/\/www.analyticsvidhya.com\/dhs-2023\/wp-json\/wp\/v2\/media?parent=1659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}