Parallel session 10: LM under Scrutiny: Explanation, Evaluation, Fine-tuning Ideas and Applications

Session Chair: Isuri Anuradha, Odessos hall

10.30-10.50 The Dark Side of the Language: Pre-trained Transformers in the DarkNet (Leonardo Ranaldi, Aria Nourbakhsh, Elena Sofia Ruzzetti, Arianna Patrizi, Dario Onorati, Michele Mastromattei, Francesca Fallucchi and Fabio Massimo Zanzotto)

10.50-11.10 PreCog: Exploring the Relation between Memorization and Performance in Pre-trained Language Models (Leonardo Ranaldi, Elena Sofia Ruzzetti and Fabio Massimo Zanzotto)

11.10-11.30 Evaluating Generative Models for Graph-to-Text Generation (Shuzhou Yuan and Michael Faerber)

11.30-11.50 Can Model Fusing Help Transformers in Long Document Classification? An Empirical Study (Damith Premasiri, Tharindu Ranasinghe and Ruslan Mitkov)

11.50-12.10 Microsyntactic Unit Detection using Word Embedding Models: Experiments on Slavic Languages (Iuliia Zaitova, Irina Stenger and Tania Avgustinova)

12.10-12.30 BERTabaporu: assessing a genre-specific language model for Portuguese  NLP (Pablo Botton Costa, Matheus Camasmie Pavan, Wesley Ramos Santos, Samuel Caetano Silva and Ivandré Paraboni)

12.30-12.50 Mind the User! Measures to More Accurately Evaluate the Practical Value of Active Learning Strategies (Julia Romberg)

12.50-1.10pm Publish or Hold? Automatic Comment Moderation in Luxembourgish News Articles (Tharindu Ranasinghe, Alistair Plum, Christoph Purschke and Marcos Zampieri)

1.10-1.30pm Poetry Generation Combining Poetry Theme Labels Representations (Yingyu Yan, Dongzhen Wen, Liang Yang, Dongyu Zhang and Hongfei LIN)