• Krajiny
• Spolky
• Aktivity
• Mapa
• Kalendár
• Dotácie
• Výzvy
• eShop

Prednáška: Robust Language Models and Where to Find Them

Popis udalosti/akcie/projektu:

Názov podujatia: Výskumný seminár na zdieľanie znalostí z oblasti Robust Language Models

Forma podujatia: fyzická

Termín konania: 27. jún 2025, 13:45

Miesto konania: The Spot, Sky Park Offices, Bottova 7939/2A, 811 09 Bratislava – Staré Mesto

Hosť: Michal Štefánik, NLP Researcher, University of Helsinki

Program:

1. Privítanie a úvod

2. Prednáška Michala Štefánika: Robust Language Models and Where to Find Them

3. Diskusia a záver

Abstrakt:

Language models (LMs) have emerged into a technology adopted in a wide variety of use-cases, today largely exceeding traditional NLP tasks. Despite that, over the last years, we have made little progress in LMs' applicability in tasks with limited data and tasks requiring reliable decision making, bearing huge potential for automation. Both these limitations can be attributed to models' limited robustness in out-of-distribution settings.

In this talk, I will share our experience with making language models more robust across languages, domains and tasks, and underline some general rules for improving robustness. Finally, I will outline our vision for achieving progress beyond the inherent limitations of the Transformer architecture, motivating further research in several key directions.

Aktuálne prebiehajúce krajanské aktivity a projekty v krajine Slovenská republika z oblasti Veda a vzdelávanie