Icon Course

Seminar Natural Language Models (5012005)

This seminar is triggered by recent and groundbreaking advancements in the performance of language-processing neural networks, so-called neural language models (LMs). State-of-the-art systems such as OpenAI’s GPT-2, GPT-3, Google’s T5 or Microsoft's DeBERTa are capable of reliably answering (even complex) open questions about a given text, and of generating longer (stylistically matching) text themselves on a given subject. The results have astonished both experts and laypersons. What’s more, LMs achieve state-of-the art results nearly across all natural language processing benchmarks (such as question answering, text summarization, translation, reading comprehension, or natural language inference). Therefore, neural LMs are sometimes considered to be the most promising technological path towards general AI. Yet, even if this were true, there would still be a long way to go: The NLP community is producing a continuous stream of studies that reveal LMs' limitations (and in the same push their boundaries ever further). These developments are not just revolutionizing the field of NLP and AI, but will have major repercussions for how we read, write and study texts in the humanities and social sciences. Vice versa, insights from disciplines such as communication science, computational sociology, formal epistemology, and philosophy of language might help us to better assess, understand and improve LMs. Accordingly, this seminar is jointly held by scholars from computer science, the social sciences, and the humanities; it can be attended by students from the faculty of informatics as well as from the faculty of social sciences and humanities.
Status: Offline

General Information

Important Information
ANMELDUNG
Anmelden können sich Studierende der Informatik und Wirtschaftsinformatik sowie aus dem Bereich GeistSoz (siehe https://campus.studium.kit.edu/ev/7x3w625KSdSMsLfm1GJ_aQ/de ). Es gibt insgesamt 16 Plätze, vorzugsweise gleichmäßig aufgeteilt auf Informatik/WI und GeistSoz.

BITTE GEBEN SIE BEIM BEITRITT IHREN STUDIENGANG AN!

Am 01. April 2021 um 14 Uhr wird die Anmeldung im ILIAS freigeschaltet. Die Anmeldung ist bis 26. April um 13:00 Uhr möglich. Sie können sich anmelden, indem Sie sich beim ILIAS-Kurs bewerben. Wir werden nach dem first-come-first-serve-Prinzip die Anmeldungen annehmen, wobei wir gleichzeitig versuchen, eine gleichmäßige Verteilung zwischen Studierenden der Informatik/Wirtschaftsinformatik und aus dem Bereich GeistSoz. zu gewährleisten. Bevor sie angenommen werden UND wenn bereits alle Plätze belegt sind, landen sie vorerst auf der Warteliste. Sollten Sie zum Zeitpunkt des ersten Infotreffens noch auf der Warteliste sein,können Sie trotzdem zum ersten Infotreffen erscheinen. Oftmals treten Personen ihren Platz nicht an, wodurch auch Personen auf der Warteliste das Seminar belegen können.

Veranstaltungsdaten

Abschluß
Master
Veranstaltungsart
Oberseminar
Zyklus
Block

Description

This seminar is triggered by recent and groundbreaking advancements in the performance of language-processing neural networks, so-called neural language models (LMs). State-of-the-art systems such as OpenAI’s GPT-2, GPT-3, Google’s T5 or Microsoft's DeBERTa are capable of reliably answering (even complex) open questions about a given text, and of generating longer (stylistically matching) text themselves on a given subject. The results have astonished both experts and laypersons. What’s more, LMs achieve state-of-the art results nearly across all natural language processing benchmarks (such as question answering, text summarization, translation, reading comprehension, or natural language inference). Therefore, neural LMs are sometimes considered to be the most promising technological path towards general AI. Yet, even if this were true, there would still be a long way to go: The NLP community is producing a continuous stream of studies that reveal LMs' limitations (and in the same push their boundaries ever further).
These developments are not just revolutionizing the field of NLP and AI, but will have major repercussions for how we read, write and study texts in the humanities and social sciences. Vice versa, insights from disciplines such as communication science, computational sociology, formal epistemology, and philosophy of language might help us to better assess, understand and improve LMs. Accordingly, this seminar is jointly held by scholars from computer science, the social sciences, and the humanities; it can be attended by students from the faculty of informatics as well as from the faculty of social sciences and humanities.

General

Language
German

Contact

Name
Prof. Dr. Chr. Seidel, Prof. Dr. G. Betz, Jan Keim
Responsibility
Jan Keim

Availability

Access
24. Mar 2021, 19:45 - 24. Dec 2021, 05:40
Admittance
You have to request for membership to access this course. Please describe your interest for becoming member in the message form. You will be notified as soon as an administrator has accepted or declined your request.
Registration Period
Until 26. Apr 2021, 13:00
Free Places
Limit 'Unsubscribe from Course'
29. Apr 2021
Period of Event
12. Apr 2021 - 30. Sep 2021

Visible Personal Data for Course Administrators

Data Types of the Personal Profile
Username
First Name
Last Name
E-Mail
Matriculation number
Course-Specific User Fields
Studiengang

Additional Information

Object-Id
1871986
Permanent Link
Created on
17. Dec 2020, 14:19