Overview of the CLPsych 2024 Shared Task: Leveraging Large Language Models to Identify Evidence of Suicidality Risk in Online Posts

Jenny Chim, Adam Tsakalidis, Dimitris Gkoumas, Dana Atzil-Slonim, Yaakov Ophir, Ayah Zirikly, Philip Resnik, Maria Liakata

نتاج البحث: فصل من :كتاب / تقرير / مؤتمرمنشور من مؤتمرمراجعة النظراء

17 اقتباسات (Scopus)

ملخص

We present the overview of the CLPsych 2024 Shared Task, focusing on leveraging open source Large Language Models (LLMs) for identifying textual evidence that supports the suicidal risk level of individuals on Reddit. In particular, given a Reddit user, their predetermined suicide risk level (‘Low’, ‘Moderate’ or ‘High’) and all of their posts in the r/SuicideWatch subreddit, we frame the task of identifying relevant pieces of text in their posts supporting their suicidal classification in two ways: (a) on the basis of evidence highlighting (extracting sub-phrases of the posts) and (b) on the basis of generating a summary of such evidence. We annotate a sample of 125 users and introduce evaluation metrics based on (a) BERTScore and (b) natural language inference for the two sub-tasks, respectively. Finally, we provide an overview of the system submissions and summarise the key findings.

اللغة الأصليةالإنجليزيّة
عنوان منشور المضيفCLPsych 2024 - 9th Workshop on Computational Linguistics and Clinical Psychology, Proceedings of the Workshop
المحررونAndrew Yates, Bart Desmet, Emily Prud�hommeaux, Ayah Zirikly, Steven Bedrick, Sean MacAvaney, Kfir Bar, Molly Ireland, Yaakov Ophir, Yaakov Ophir
ناشرAssociation for Computational Linguistics (ACL)
الصفحات177-190
عدد الصفحات14
رقم المعيار الدولي للكتب (الإلكتروني)9798891760806
حالة النشرنُشِر - 2024
الحدث9th Workshop on Computational Linguistics and Clinical Psychology, CLPsych 2024 - St. Julian's, مالطا
المدة: ٢١ مارس ٢٠٢٤ → …

سلسلة المنشورات

الاسمCLPsych 2024 - 9th Workshop on Computational Linguistics and Clinical Psychology, Proceedings of the Workshop

!!Conference

!!Conference9th Workshop on Computational Linguistics and Clinical Psychology, CLPsych 2024
الدولة/الإقليممالطا
المدينةSt. Julian's
المدة٢١/٠٣/٢٤ → …

بصمة

أدرس بدقة موضوعات البحث “Overview of the CLPsych 2024 Shared Task: Leveraging Large Language Models to Identify Evidence of Suicidality Risk in Online Posts'. فهما يشكلان معًا بصمة فريدة.

قم بذكر هذا