|
Record |
Links |
|
Author |
Congcong Wang; Paul Nulty; David Lillis |
|
|
Title |
Crisis Domain Adaptation Using Sequence-to-Sequence Transformers |
Type |
Conference Article |
|
Year |
2021 |
Publication |
ISCRAM 2021 Conference Proceedings – 18th International Conference on Information Systems for Crisis Response and Management |
Abbreviated Journal |
Iscram 2021 |
|
|
Volume |
|
Issue |
|
Pages |
655-666 |
|
|
Keywords |
Domain Adaptation, Emergency Response, Social media, Transformers |
|
|
Abstract |
User-generated content (UGC) on social media can act as a key source of information for emergency responders incrisis situations. However, due to the volume concerned, computational techniques are needed to effectively filter and prioritise this content as it arises during emerging events. In the literature, these techniques are trained using annotated content from previous crises. In this paper, we investigate how this prior knowledge can be best leveraged for new crises by examining the extent to which crisis events of a similar type are more suitable for adaptation tonew events (cross-domain adaptation). Given the recent successes of transformers in various language processing tasks, we propose CAST: an approach for Crisis domain Adaptation leveraging Sequence-to-sequence Transformers. We evaluate CAST using two major crisis-related message classification datasets. Our experiments show that ourCAST-based best run without using any target data achieves the state of the art performance in both in-domain and cross-domain contexts. Moreover, CAST is particularly effective in one-to-one cross-domain adaptation when trained with a larger language model. In many-to-one adaptation where multiple crises are jointly used as the source domain, CAST further improves its performance. In addition, we find that more similar events are more likely to bring better adaptation performance whereas fine-tuning using dissimilar events does not help for adaptation. To aid reproducibility, we open source our code to the community. |
|
|
Address |
University College Dublin; University College Dublin; University College Dublin |
|
|
Corporate Author |
|
Thesis |
|
|
|
Publisher |
Virginia Tech |
Place of Publication |
Blacksburg, VA (USA) |
Editor |
Anouck Adrot; Rob Grace; Kathleen Moore; Christopher W. Zobel |
|
|
Language |
English |
Summary Language |
English |
Original Title |
|
|
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
|
Series Volume |
|
Series Issue |
|
Edition |
|
|
|
ISSN |
978-1-949373-61-5 |
ISBN |
|
Medium |
|
|
|
Track |
Social Media for Disaster Response and Resilience |
Expedition |
|
Conference |
18th International Conference on Information Systems for Crisis Response and Management |
|
|
Notes |
wangcongcongcc@gmail.com |
Approved |
no |
|
|
Call Number |
ISCRAM @ idladmin @ |
Serial |
2362 |
|
Share this record to Facebook |