{"id":8033,"date":"2023-10-13T23:16:40","date_gmt":"2023-10-13T22:16:40","guid":{"rendered":"https:\/\/irsg.bcs.org\/informer\/?p=8033"},"modified":"2023-10-13T23:16:40","modified_gmt":"2023-10-13T22:16:40","slug":"search-solutions-2023-tutorials-london-21-november-2023","status":"publish","type":"post","link":"https:\/\/archive-irsg.bcs.org\/informer\/?p=8033","title":{"rendered":"Search Solutions 2023 &#8211; Tutorials London 21 November 2023"},"content":{"rendered":"<p><strong>Innovations in Search &amp; Information Retrieval.<\/strong><\/p>\n<p>Search Solutions is the <a href=\"https:\/\/www.bcs.org\/membership-and-registrations\/member-communities\/information-retrieval-specialist-group\/\">BCS Information Retrieval Specialist Group\u2019s<\/a> annual event focused on practitioner issues in the arena of search and information retrieval. It is a unique opportunity to bring together academic research and practitioner experience.<\/p>\n<p>The Search Solutions event consists of a Tutorial day and a Conference day, each of which has a separate registration. Information on the Conference day can be found <a href=\"https:\/\/irsg.bcs.org\/informer\/2023\/10\/search-solutions-2023-conference-london-22-november-2023\/\">here<\/a>.<\/p>\n<p><strong>Search Solutions 2023 Tutorials 21 November <\/strong><\/p>\n<p>This year there are two tutorials, a half-day tutorial on how Large Language Models can Improve Your Search Project and a full day tutorial on Uncertainty Quantification for Text Classification<\/p>\n<p><strong>Registration form<\/strong> on <a href=\"https:\/\/SearchSolutions2023Tutorials.eventbrite.co.uk.\">Eventbrite<\/a><\/p>\n<p><!--more--><\/p>\n<p>Details of the tutorials are given below.<\/p>\n<p>Tutorial fee (for the day)<\/p>\n<p>BCS Members \u00a380<\/p>\n<p>Non-Members \u00a395<\/p>\n<p>Students \u00a0 \u00a0 \u00a0 \u00a0 \u00a365<\/p>\n<p><strong>Location <\/strong><\/p>\n<p>Both the Tutorials and the Conference take place at the BCS London Headquarters, Ground Floor, 25 Copthall Avenue EC2R 7BP. This is a 10 minute walk from Liverpool Street Station (Elizabeth Line and London Underground) and a 20 minute walk from London Bridge Station.<\/p>\n<p><strong>Tutorial 1 How Large Language Models Can Improve Your Search Project (Half-day)<\/strong><\/p>\n<p><strong>Tutor<\/strong><\/p>\n<p>Alessandro Benedetti, <a href=\"https:\/\/sease.io\/\">Sease Ltd.<\/a> \u00a0Apache Lucene\/Solr committer and PMC member and Director and R&amp;D Software Engineer<\/p>\n<p><strong>Tutorial Schedule (10AM &#8211; 2PM)<\/strong><\/p>\n<p><strong>Tutorial scope<\/strong><\/p>\n<p>Large Language Models (LLMs) are becoming ubiquitous: everyone is talking about them, everyone wants to use them and everyone claims is getting benefits out of them&#8230;<\/p>\n<p>But&#8230; is it that simple?<\/p>\n<p>This tutorial aims to demystify the Open-Source landscape of large language models, exploring what it means to use them to improve your search engine ecosystem and what are the most common pitfalls.<\/p>\n<p>The talk starts by introducing the reasons to add LLMs to your search application and the complexities it adds (choosing the right model, measuring success, and rabbit holes).<\/p>\n<p>Building upon the introduction we&#8217;ll present how search changes with the advent of this innovative technology, what is &#8216;fine-tuning&#8217; and what are the Open-Source solutions available in terms of models, components to interact with the models, and search engines that integrate with such technologies.<\/p>\n<p>During the session, we&#8217;ll have multiple demos showing effective ways of using LLMs in your search project, using open-source software and publicly available datasets.<\/p>\n<p>Join us as we explore this new exciting Open-Source landscape and learn how you can leverage it to improve your search experience!<\/p>\n<ul>\n<li>Target audience<strong>:<\/strong>Software engineers, data scientists, researchers, \u00a0information retrieval practitioners,<\/li>\n<li>Learning outcome<strong>s:<\/strong><\/li>\n<\/ul>\n<p>&#8211; The basics of Large Language Models<br \/>\n&#8211; How to navigate the Open-Source Sea of LLMs<\/p>\n<p>&#8211; What Open-Source frameworks and projects to adopt if you want to use\/interact with LLMs<\/p>\n<p>&#8211; How to integrate LLMs with popular Open-Source search engines.<\/p>\n<p><strong>Tutorial logistics\/materials:<\/strong>\u00a0slides and code snippets will be provided. Bring your own laptop.<\/p>\n<p><strong>Tutorial 2 Uncertainty Quantification for Text Classification (Full Day)<\/strong><\/p>\n<p><strong>Schedule\u00a0 10.00 \u2013 16.30<\/strong><\/p>\n<p><strong>Tutors<\/strong><\/p>\n<p>Dell Zhang, Thomson Reuters Labs, London, UK.<\/p>\n<p>Murat Sensoy, Amazon Alexa AI, London, UK.<\/p>\n<p>Lin Gui, King&#8217;s College London, London UK<\/p>\n<p>Yulan He, King&#8217;s College London &amp; Alan Turing Institute, London, UK.<\/p>\n<p><strong>Tutorial scope<\/strong><\/p>\n<p>This full-day tutorial introduces modern techniques for practical uncertainty quantification specifically in the context of multi-class and multi-label text classification. First, we explain the usefulness of estimating aleatoric uncertainty and epistemic uncertainty for text classification models. Then, we describe several state-of-the-art approaches to uncertainty quantification and analyze their scalability to big text data: Next, we talk about the latest advances in uncertainty quantification for pre-trained language models (including asking language models to express their uncertainty, interpreting uncertainties of text classifiers built on large-scale language models, uncertainty estimation in text generation, calibration of language models, and calibration for in-context learning).<\/p>\n<p>After that, we discuss typical application scenarios of uncertainty quantification in text classification (including in-domain calibration, cross-domain robustness, and novel class detection). Finally, we list popular performance metrics for the evaluation of uncertainty quantification effectiveness in text classification. Practical hands-on examples\/exercises are provided to the attendees for them to experiment with different uncertainty quantification methods on a few real-world text classification datasets such as CLINC150.<\/p>\n<p><strong>Tutorial Logistics\/Materials<\/strong>: Bring your own laptop.<\/p>\n<p style=\"font-weight: 400;\">\n","protected":false},"excerpt":{"rendered":"<p>Innovations in Search &amp; Information Retrieval. Search Solutions is the BCS Information Retrieval Specialist Group\u2019s annual event focused on practitioner issues in the arena of search and information retrieval. It is a unique opportunity to bring together academic research and practitioner experience. The Search Solutions event consists of a Tutorial day and a Conference day,&hellip; <a class=\"more-link\" href=\"https:\/\/archive-irsg.bcs.org\/informer\/?p=8033\">Continue reading <span class=\"screen-reader-text\">Search Solutions 2023 &#8211; Tutorials London 21 November 2023<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[192,200],"tags":[],"class_list":["post-8033","post","type-post","status-publish","format-standard","hentry","category-autumn-2023","category-events","entry"],"_links":{"self":[{"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=\/wp\/v2\/posts\/8033","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8033"}],"version-history":[{"count":0,"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=\/wp\/v2\/posts\/8033\/revisions"}],"wp:attachment":[{"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8033"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8033"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/archive-irsg.bcs.org\/informer\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8033"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}