Next Article in Journal
Adoption of Organic Farming as an Opportunity for Syrian Farmers of Fresh Fruit and Vegetables: An Application of the Theory of Planned Behaviour and Structural Equation Modelling
Next Article in Special Issue
Big Social Network Data and Sustainable Economic Development
Previous Article in Journal
Transformation Strategies for the Operation and Management of Local Cultural Museums in Nantou County
Previous Article in Special Issue
Impacts of Leadership on Project-Based Organizational Innovation Performance: The Mediator of Knowledge Sharing and Moderator of Social Capital
Open AccessArticle

Crowdsourcing Analysis of Twitter Data on Climate Change: Paid Workers vs. Volunteers

The Department of Tourism, Recreation and Sport Management, University of Florida, P.O. Box 118208, Gainesville, FL 32611-8208, USA
The Department of Computer Science, University of North Dakota, Streibel Hall, 3950 Campus Road Stop 9015, Grand Forks, ND 58202-9015, USA
The Department of Business Administration and Tourism and Hospitality Management, Mount Saint Vincent University, 166 Bedford Highway, Halifax, NS B3M 2J6, Canada
Author to whom correspondence should be addressed.
Sustainability 2017, 9(11), 2019;
Received: 25 September 2017 / Revised: 27 October 2017 / Accepted: 30 October 2017 / Published: 3 November 2017
Web based crowdsourcing has become an important method of environmental data processing. Two alternatives are widely used today by researchers in various fields: paid data processing mediated by for-profit businesses such as Amazon’s Mechanical Turk, and volunteer data processing conducted by amateur citizen-scientists. While the first option delivers results much faster, it is not quite clear how it compares with volunteer processing in terms of quality. This study compares volunteer and paid processing of social media data originating from climate change discussions on Twitter. The same sample of Twitter messages discussing climate change was offered for processing to the volunteer workers through the Climate Tweet project, and to the paid workers through the Amazon MTurk platform. We found that paid crowdsourcing required the employment of a high redundancy data processing design to obtain quality that was comparable with volunteered processing. Among the methods applied to improve data processing accuracy, limiting the geographical locations of the paid workers appeared the most productive. Conversely, we did not find significant geographical differences in the accuracy of data processed by volunteer workers. We suggest that the main driver of the found pattern is the differences in familiarity of the paid workers with the research topic. View Full-Text
Keywords: citizen-scientist; climate change; crowdsourcing; MTurk; social networks; Twitter citizen-scientist; climate change; crowdsourcing; MTurk; social networks; Twitter
Show Figures

Figure 1

MDPI and ACS Style

Kirilenko, A.P.; Desell, T.; Kim, H.; Stepchenkova, S. Crowdsourcing Analysis of Twitter Data on Climate Change: Paid Workers vs. Volunteers. Sustainability 2017, 9, 2019.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop