1.1
1
xml
info:srw/schema/1/dc-v1.1
Coordinating human and machine intelligence to classify microblog communications in crises
Muhammad Imran
Carlos Castillo
Jesse Lucas
Patrick Meier
Jakob Rogstadius
S.R. Hiltz, M.S.P., L. Plotnick, and P.C. Shih.
An emerging paradigm for the processing of data streams involves human and machine computation working together, allowing human intelligence to process large-scale data. We apply this approach to the classification of crisis-related messages in microblog streams. We begin by describing the platform AIDR (Artificial Intelligence for Disaster Response), which collects human annotations over time to create and maintain automatic supervised classifiers for social media messages. Next, we study two significant challenges in its design: (1) identifying which elements must be labeled by humans, and (2) determining when to ask for such annotations to be done. The first challenge is selecting the items to be labeled by crowd sourcing workers to maximize the productivity of their work. The second challenge is to schedule the work in order to reliably maintain high classification accuracy over time. We provide and validate answers to these challenges by extensive experimentation on real world datasets.
urn:ISBN:9780692211946
openurl:?ctx_ver=Z39.88-2004&rfr_id=info%3Asid%2Fidl.iscram.org%2F&genre=proceeding&title=Coordinating%20human%20and%20machine%20intelligence%20to%20classify%20microblog%20communications%20in%20crises&stitle=ISCRAM%202014&issn=2411-3387&isbn=9780692211946&date=2014&spage=712&epage=721&aulast=Muhammad%20Imran&au=Carlos%20Castillo&au=Jesse%20Lucas&au=Patrick%20Meier&au=Jakob%20Rogstadius&pub=The%20Pennsylvania%20State%20University&place=University%20Park%2C%20PA&sid=refbase%3AISCRAM
url:http://idl.iscram.org/show.php?record=612
citekey:MuhammadImran_etal2014
citation:Muhammad Imran, Carlos Castillo, Jesse Lucas, Patrick Meier, & Jakob Rogstadius. (2014). Coordinating human and machine intelligence to classify microblog communications in crises. In and P.C. Shih. L. Plotnick M. S. P. S.R. Hiltz (Ed.), ISCRAM 2014 Conference Proceedings – 11th International Conference on Information Systems for Crisis Response and Management (pp. 712-721). University Park, PA: The Pennsylvania State University.
2014
ConferencePaper
text
Information systems
Classification accuracy
Disaster response
Human intelligence
Large-scale datum
Machine computations
Machine intelligence
Real-world datasets
Supervised classifiers
Artificial intelligence
file:http://idl.iscram.org/files/imran/2014/612_Imran_etal2014.pdf
The Pennsylvania State University
English
2411-3387
ISCRAM 2014 Conference Proceedings – 11th International Conference on Information Systems for Crisis Response and Management
2014
712
721
1