| Record |
Author  |
Ferda Ofli; Firoj Alam; Muhammad Imran |
| Title |
Analysis of Social Media Data using Multimodal Deep Learning for Disaster Response |
Type |
Conference Article |
| Year |
2020 |
Publication |
ISCRAM 2020 Conference Proceedings – 17th International Conference on Information Systems for Crisis Response and Management |
Abbreviated Journal |
Iscram 2020 |
| Volume |
|
Issue |
|
Pages |
802-811 |
| Keywords |
Multimodal Deep Learning, Multimedia Content, Natural Disasters, Crisis Computing, Social Media. |
| Abstract |
Multimedia content in social media platforms provides significant information during disaster events. The types of information shared include reports of injured or deceased people, infrastructure damage, and missing or found people, among others. Although many studies have shown the usefulness of both text and image content for disaster response purposes, the research has been mostly focused on analyzing only the text modality in the past. In this paper, we propose to use both text and image modalities of social media data to learn a joint representation using state-of-the-art deep learning techniques. Specifically, we utilize convolutional neural networks to define a multimodal deep learning architecture with a modality-agnostic shared representation. Extensive experiments on real-world disaster datasets show that the proposed multimodal architecture yields better performance than models trained using a single modality (e.g., either text or image). |
| Address |
Qatar Computing Research Institute Hamad Bin Khalifa University Doha, Qatar; Qatar Computing Research Institute Hamad Bin Khalifa University Doha, Qatar; Qatar Computing Research Institute Hamad Bin Khalifa University Doha, Qatar |
| Corporate Author |
|
Thesis |
|
| Publisher |
Virginia Tech |
Place of Publication |
Blacksburg, VA (USA) |
Editor |
Amanda Hughes; Fiona McNeill; Christopher W. Zobel |
| Language |
English |
Summary Language |
English |
Original Title |
|
| Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
| Series Volume |
|
Series Issue |
|
Edition |
|
| ISSN |
978-1-949373-27-71 |
ISBN |
2411-3457 |
Medium |
|
| Track |
Social Media for Disaster Response and Resilie |
Expedition |
|
Conference |
17th International Conference on Information Systems for Crisis Response and Management |
| Notes |
fofli@hbku.edu.qa |
Approved |
no |
| Call Number |
|
Serial |
2272 |
| Share this record to Facebook |
