Next Article in Journal
Development of Ecotourism in Svalbard as Part of Norway’s Arctic Policy
Next Article in Special Issue
A Self-Assessment of European Citizen Science Projects on Their Contribution to the UN Sustainable Development Goals (SDGs)
Previous Article in Journal
The Potential of Geographical Indications (GI) to Enhance Sustainable Development Goals (SDGs) in Japan: Overview and Insights from Japan GI Mishima Potato
Previous Article in Special Issue
Knowledge Translation and Its Interrelation with Usability and Accessibility. Biocultural Diversity Translated by Means of Technology and Language—The Case of Citizen Science Contributing to the Sustainable Development Goals
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:

A Buzz for Sustainability and Conservation: The Growing Potential of Citizen Science Studies on Bees

Instituto de Estudos Avançados, University of São Paulo, R. Praça do Relógio 109, São Paulo 05508-970, SP, Brazil
Escola de Artes, Ciências e Humanidades, University of São Paulo, R. Arlindo Bettio 1000, São Paulo 03828-000, SP, Brazil
Centro de Ciências Naturais e Humanas, Federal University of ABC, R. Arcturus 3, São Bernardo Do Campo 09606-070, SP, Brazil
Escola Politécnica, University of São Paulo, Avenida Professor Luciano Gualberto 158, Tv. 3, São Paulo 05508-010, SP, Brazil
Author to whom correspondence should be addressed.
Shared co-first authorship.
Sustainability 2021, 13(2), 959;
Received: 31 October 2020 / Revised: 12 January 2021 / Accepted: 14 January 2021 / Published: 19 January 2021
(This article belongs to the Special Issue Citizen Science and the Role in Sustainable Development)


Expanding involvement of the public in citizen science projects can benefit both volunteers and professional scientists alike. Recently, citizen science has come into focus as an important data source for reporting and monitoring United Nations Sustainable Development Goals (SDGs). Since bees play an essential role in the pollination ecosystem service, citizen science projects involving them have a high potential for attaining SDGs. By performing a systematic review of citizen science studies on bees, we assessed how these studies could contribute towards SDG reporting and monitoring, and also verified compliance with citizen science principles. Eighty eight studies published from 1992 to 2020 were collected. SDG 15 (Life on Land) and SDG 17 (Partnerships) were the most outstanding, potentially contributing to targets related to biodiversity protection, restoration and sustainable use, capacity building and establishing multi stakeholder partnerships. SDG 2 (Zero Hunger), SDG 4 (Quality Education), and SDG 11 (Sustainable Cities and Communities) were also addressed. Studies were found to produce new knowledge, apply methods to improve data quality, and invest in open access publishing. Notably, volunteer participation was mainly restricted to data collection. Further challenges include extending these initiatives to developing countries, where only a few citizen science projects are underway.

Graphical Abstract

1. Introduction

Citizen science (CS), which can be defined as the involvement of (usually unpaid) volunteers in the scientific process (e.g., data collection, analysis, and interpretation) [1,2], has been used for different purposes, including biodiversity and environmental monitoring of both terrestrial and aquatic ecosystems. Data produced through citizen science initiatives is speeding up, in an unprecedented way, understanding of patterns and functions in biodiversity [3,4,5], thereby contributing towards natural resource management, environmental protection and policymaking, as well as fostering public input and engagement [6,7,8]. Increasingly, knowledge that is deeply integrated across disciplines and co-produced with non-academic stakeholders [9] is needed to achieve the 17 United Nations Sustainable Development Goals (SDGs), which aim for a better and more sustainable future for all by 2030, seeking the end of poverty, the improvement of health and education, the reduction of inequalities, the stimulus to economic growth, while tackling climate change and working to conserve our oceans and forests [10]. More recently, citizen science has been recognized as a source of data for SDG reporting and monitoring, thus potentially contributing to 76 of the 244 SDG indicators [11]. Certain features of CS data are of extreme relevance, such as: spatial reference, resolution and extent; duration and temporal resolution; thematic subject areas, definitions and resolution; data purposes, use, collection, processing and management (if data is findable, accessible, interoperable and reusable); and levels of participant involvement [12]. If used in accordance with ethical and scientific principles [13,14], CS has enormous potential to expand knowledge about global biodiversity, reducing taxonomic and spatial biases in global biodiversity data sets, moving beyond data on the occurrence of single species and providing further understanding of ecological interactions among species or habitats [15].
Since they are generally small-sized and can easily fit into photographs, insects pose significant opportunities for citizen science approaches, more so than with most other biological groups. Nonetheless, apart from the possibility of sampling in many different situations, there still remain several pertinent, and as yet, unanswered scientific queries [16]. Bees are excellent subjects for mutually integrating citizen science projects and SDGs, since they comprise the most dominant pollinating taxon [17] and their ecological importance is widely recognized by the public [18]. Although bees are not the most diverse group of pollinators (as butterflies and moths, beetles, and flies show higher species richness, [17] and other pollinating insects contribute significantly to flower visitation and fruit set in crops globally [19]), bees are still the major pollinating group of wild and crop plants [20]. The global economic value of pollination has been estimated as between US$ 235 and 577 billion [20]. However, the diversity of wild and managed bees has crucial ecological, economic and social importance beyond crop pollination [21]. Indeed, bees were recognized as contributing to 15 of the 17 SDGs and at least 30 relevant SDG targets. They can easily be linked to SDGs, such as SDG 15 (Life on land), SDG 11 (Sustainable cities and communities), and SDG 12 (Responsible consumption and production) [11]. They can also be successfully used in educational programs, especially those dealing with the environment, ecology and conservation [22], directly linked to SDG 4 (Quality Education).
Here we performed a systematic review of studies combining citizen science and bees. In each case, assessment focused on addressing each study to the appropriate SDG, besides evaluating system traits, citizen participation, methods employed and research questions. Our aim was to understand the potential contribution of these particular citizen science studies to SDG reporting and monitoring, and how they conformed to ECSA principles, in order to place in evidence opportunities for enhancing practices in this field.

2. Material and Methods

The review carried out in this study followed the guidelines proposed by PRISMA [23], which defines a systematic review as a study employing appropriate and explicit methods to identify, select and critically evaluate relevant research through data collection and analysis.

2.1. Search Process

The survey of the literature was carried out in two steps: a naive search with pre-selected author terms, followed by a second step with less biased terms after using the litsearchR package [24]. All analyses were performed using the R version 4.0.0 (R Core Team 2020). litsearchR, besides automating several steps of systematic review, employs the Rapid Automatic Keyword Extraction (RAKE) algorithm to identify potential keywords initially omitted by researchers, thus improving reproducibility and reducing bias.
The searches in the literature were performed in Web of Science and Scopus databases, which returned 102 and 114 articles, respectively, during ‘naive search’. The initial selection of the search terms was according to the PECO (Population, Exposure, Comparator, Outcome) framework [25]. Population was represented by “bees”, Exposure by “citizen science”, and Outcome by research aims and questions which were our interest in this study. Citizen science terms included those described by  Eitzel et al. [26], which provide a historical overview of terminology in CS. No Comparator terms were used. Sequentially, the litsearchR algorithm package was applied to this initial list of articles, according to the protocol and parameters suggested by the package authors [27]. After identifying new synonyms and related words for bees and citizen science, research was resumed on December 7 to include novel recently published articles. The final results were 122 articles in Web of Science and 134 in Scopus (total n = 256). The queries searched the terms in the title, abstract and keywords and considered all records available in the databases (the terms in italics were suggested by the litsearchR package):
(( “bee” OR “bees” OR “Apoidea” OR “Antophila” ORhoney beeORhoneybeeOR
apis melliferaORbeekeep *” ORbee colon *” ORcolossOR
queen problem *” ORyoung queensORbumble bee *” ORbumblebee
brood cell*ORbrood combORnative stinglessORaustralian stinglessOR
frieseomelitta ningraORgeotrigona acapulconisORlestrimelitta chamelensisOR
“melipona fasciata” ORscaptotrigona hellwegeriORpot-honeyOR
african carder”)
(‘citizen science” OR “participatory science” OR
“crowd * science” OR “volunteer * monitoring” OR “networked science” OR
“collaborative research” OR “collaborative monitoring” OR
“collaborative science” ORparticipatory action researchORcommunity action research
ORcrowdsourcingORcommunity-based participatory researchORlocal knowledgeOR
volunteered geographic informationORpublic participation in scientific researchOR
community scienceORcitizen scientist”))
Of these, 101 were removed through duplicate analysis, six were introductions of conference proceedings (and were also removed), and 149 remained as potentially relevant study items. In addition, 13 others were selected through citation in the revised studies or author personal knowledge, resulting in a total of 162 studies. Our search strategy was as inclusive as possible, in an effort to include studies that fulfilled the established requirements, even when the term “citizen science” was not present. This is especially important, since an assessment of ornithological studies showed that many studies employing CS data did not explicitly mention volunteer participation in data collection [28], which may also have interfered in our search results.

2.2. Collected Data

Titles and abstracts were read to identify studies that did not conform to the requirements for analysis, e.g., could not be characterized as CS, did not include bees (only other pollinators), or which only mentioned or recommended CS, but did not include citizen scientists in any step of procedures. Following Eitzel et al. [26] recommendations, we only considered as citizen science those studies in which volunteers were actively involved in some aspect of the project and were informed how their data was going to be used. Thus, data gathered at online databases (without the owners’ knowledge or consent) and, thus not related to CS programs, were not considered. In addition, studies regarding local knowledge assessments were only included if participants were knowledge-producers (not study subjects, e.g., Smith et al. [29]). After screening, 74 articles were removed and 88 remained for review (Supplementary Material 1). A subset of 40 articles were read, each by two researchers, to validate and standardize the terms and categories used for each indicator up for analysis (Table 1). The remainder were distributed equally between them. All articles were analyzed, and the most prominent UN SDG related to each one was defined. SDG 2 (Zero Hunger) was related to studies of the influence of bees on agricultural production, SDG 4 (Quality Education) to those in which bees were used to promote scientific education (this process was the main focus of the study), SDG 11 (Sustainable Cities and Communities) to studies of the biology of bees on urban landscapes, SDG 15 (Life on Land) to those aimed at investigating biological or ecological aspects of bees in general, such as species identification, occurrence and distribution, and their interaction with plants, among others, and SDG 17 (Partnerships) to studies in which establishing a partnership, such as recruitment, engagement, retention strategies or co-creation of platforms, or validating a citizen science project, the case of pilot-testing of protocols, and data quality analysis, were central to research. SDGs are related to distinct targets, each measured by distinct indicators. Hence, we also indicated which targets could be addressed and their indicator tier classification [30]. Indicators are classified into three tiers, tiers I and II having established methods and standards. However, for tier II indicators data collection is not regular countrywide. Currently, the global indicator framework does not include any tier III indicators, which are those with no methods and standards available yet.
Additionally, the compliance with ECSA principles [13] was analysed for each article, as follows: 1. CS projects actively involve citizens in scientific endeavour that generates new knowledge and understanding; 2. CS projects should have a genuine scientific outcome. 3. Both professional scientists and citizen scientists benefit from taking part; 4. Citizen scientists may, if they so wish, participate in multiple stages of the scientific process; 5. Citizen scientists receive feedback from the project; 6. CS is considered a research approach like any other, with limitations and biases that should be considered and controlled; 7. CS project data and metadata are made publicly available and where possible, results are published in an open access format; 8. Citizen scientists are acknowledged in project results and publications; 9. CS programs are evaluated for their scientific output, data validity, participant experience, and wider societal and policy impact; and finally, 10. The leaders of CS projects should take into consideration the legal and ethical issues surrounding copyright, intellectual property, data sharing agreements, confidentiality and attribution, as well as the environmental impact of any activity (see Table 1 for the correspondence of each variable and ECSA principle and Table S2 for detailed criteria used for each principle). Even though distinct aspects are considered in each individual principle, compliance with the principle was treated as a binary variable, which means that when more than one indicator was proposed, we considered the principle as fulfilled if at least one of them was contemplated in the study. Not all aspects covered by the ECSA Principles could be assessed in our analysis because they were not explicitly mentioned in the published results. We highlight here the difficulty to evaluate all aspects of the 9th ECSA principle, because of the intrinsic complexity for the measure of project outputs and impact [14]. The 10th principle was not evaluated because a deep analysis of each project would be necessary since the information presented in the manuscripts does not always include the legal and ethical aspects of the CS initiatives in detail. Despite these limitations, we believe our analyses provide an interesting framework for systematically assessing CS research, which may be further expanded in future studies.

3. Results

Of all the 88 scientific studies that were collected, 81 were peer-reviewed articles and seven conference papers. From 1992 to the present, there has been a constant increase in the number of studies published per year, reaching a maximum of 19 in 2019 (Figure S1). Most studies were undertaken on a local scale (Figure 1) and comprised data from long-term citizen science projects (73%, n = 60), including 47 ongoing projects.

3.1. Sustainable Development Goals

The studies were mainly addressed to SDG 15 (Life on Land, 52.3%), followed by SDG 17 (Partnerships, 29.5%), with the remainder to SDGs 2, 4, and 11 (Zero Hunger, Quality Education, and Sustainable Cities and Communities, respectively—Figure 2a). Even though the reviewed studies were not explicitly related to any SDG, data and findings produced could be used to monitor and implement 12 tier I and 9 tier II indicators (Table S3). Main research subjects were beekeeping, distributional ecology (with 6 studies focusing on invasive species), data quality, natural history, plant-pollinator interactions, volunteer assessment, and landscape ecology (Figure 2b). Few studies focused on population ecology, agricultural practices, toxicology, or were descriptions of new projects. Project purposes were biological recording (63.9%), biological monitoring (30.7%), providing technology platforms (2.3%), and crowd-sourcing (1.1%).
Bees were the only study system in 76% of the studies, whereas 24% included other animals, such as insects, invertebrates, or birds (complete dataset available in Supplementary Material 1). Among those, 65.9% focused on social bees, 21.6% on both social and solitary species, and 12.5% only on solitary species. Most studies gathered data for Bombus spp. (35.2% with focus on the genus level or the specific species), and honey bees (Apis mellifera, 26.1%. Stingless bees were only investigated in three studies. While honey bee studies were frequently related to beekeeping (83%), bumble bee studies showed a more diverse pattern of research subjects. Solitary bee studies, on the other hand, were usually related to distributional ecology. Several studies (18%) were based on data provided by long-term citizen science projects on these bee groups, such as Bee Watch, Bumble Bee Watch, and COLOSS (COLOSS survey of honey bee colony losses).
Funding was mainly provided by governments (68.2%), followed by non-governmental organizations (NGOs, 28.4%), universities (22.7%), and the private sector (13.6%). While two studies declared no funding to report or personal funding, ten made no mention (Figure S2a). University members were authors in 93.2% of the studies, while governments and NGOs were represented in 39.8% and 38.6%, respectively. Three studies also had authors from the private sector and one from a school (Figure S2b). The number of participants in each project varied from 2 to 28,629 (Figure S3); however 32% of the studies do not mention how many participants were involved. Although in several cases (36.4%) there was no mention of how participants were recruited, the most frequent manner was through digital media (38.6%), or related organizations (43.2%), such as beekeeper or gardener associations. Participant communication and training was either online (51.8%), through presencial meetings and workshops (22.9%), or through manuals (24.1%).

3.2. ECSA Principles

The reviewed papers scored points on a scale from 2 to 9 (Figure 3). All the reviewed papers scored points for the principles 1 and 2. We considered these principles classificatory to be included in the analysis. The average score of the 88 reviewed papers is 6.7, the minimum 3 (1.1%) and the maximum 9 (7.9%). A total of 38 papers scored 7 points (43.2%). Excluding the principles 1 and 2, the most frequent principles were Principle 4 (97.7%) and Principle 6 (94.3%), while the less frequent ones were Principle 9 (35.2%) and Principle 5 (23.9%).
When considering the first and second ECSA principles, notably hypotheses or scientific questions were explicitly stated in 50% of the studies. Although several (48.8%) relied on volunteers from the general public, without targeting any specific group, beekeepers, bee enthusiasts, and students were target groups in some. Considering volunteer participation (fourth ECSA principle), data collection was the main task performed by citizen scientists, and 93.2% of the studies were classified as contributory. Two studies were collaborative, three co-created, and one relied on crowd-sourcing. From all selected studies, 37.5% contained information on feedback to participants (fifth ECSA principle) and 53.4% were published as open access (seventh ECSA principle). Volunteers were acknowledged in 79.5% of the studies (eighth ECSA principle), and two article included participants as authors [29,36].
Few studies (22%) included some kind of volunteer assessment (ninth ECSA principle) and those that did, focused on interest, motivation, behavior, knowledge and perception. Assessment, applied through questionnaires, was generally applied after volunteer participation (Table S1). As to data quality evaluation (ninth ECSA principle), different strategies were employed, with a maximum of five per study (Figure 4). Digital vouchers (photographs submitted by citizen scientists), expert review of data, use of structured protocols, and training of participants were the most frequent strategies to improve data quality. Volunteer personal knowledge, usually related to beekeepers’ experience in analyzing hive conditions, was also exploited to improve data quality.

4. Discussion

Our results revealed that five of the 17 SDGs could be addressed by citizen science studies of bees. In general, the aims were to expand basic bee knowledge, investigate applied aspects of beekeeping and conservation, and explore the potential of CS as a research and educational process. The recent increase noted in the number of published works follows a more general trend in scientific publications in this field, and indicates the acceptance of citizen science by the research community towards mainstreaming this research avenue [37]. Publishing results from citizen science projects in peer-reviewed journals and conferences also fulfills the first and second citizen science principles, as citizen participation is generating new knowledge and understanding, while at the same time producing genuine scientific outcomes [13]. In addition, the growing number of studies is contributing to the generation of large scale data that can be employed as a non-traditional data source for SDG monitoring and implementation [12]. In a previous analysis, bees were related to 30 targets across SDGs 1 and 15, demonstrating a great potential to contribute to SDGs achievement [21]. However, SDGs 16 and 17 were not taken into consideration by Patel et al. [21], as these goals focus on governance and policy, which nevertheless can be targeted through CS. Another positive factor is the increasing recognition by the public that bees are important providers of pollination services [38], a possible motivation for recruiting volunteers for participation in citizen science projects. In fact, the main motivational factors declared in a survey with citizen scientists from a bee monitoring program were contributing to scientific data collection and aiding in bee conservation [39].
Since bees are the most dominant pollinators of flowering plants [17] and bee diversity contributes to increasing crop production [40], studies combining agriculture and bees were related to SDG 2 (Zero Hunger). Specifically, CS projects may contribute to ensuring sustainable agriculture and increasing productivity (target 2.4). In this context, as bee monitoring in crop fields is a potential tool for sustainable agriculture, this could be implemented in collaboration with agriculture stakeholders [41]. For instance, the citizen science studies reviewed here focused on assessing data quality of bee monitoring protocols in crop fields [42], as well as management strategies for assuring adequate pollination services for food production [43].
SDG 4 (Quality Education) is related to articles regarding CS projects for schools. Studies thus addressed would contribute to relevant and effective learning outcomes, education for sustainable development, and teacher qualification (targets 4.1, 4.7, and 4.c, respectively). Even though SDG targets and indicators focus on literacy and numeracy in primary and secondary education, we highlight the importance of scientific literacy for sustainability comprehension and implementation, which can be positively impacted by participation in citizen science projects [44,45]. Regarding vocational and technical skills, Patel et al. [21] also suggest that training for beekeeping may provide equitable opportunities for men, women, and indigenous people possessing traditional knowledge, which can be considered as an innovative opportunity for citizen science projects in SDG 4.
SDG 11 (Sustainable Cities and Communities) was explored when investigating bee response to urbanization, a key conservation factor when considering the growing urban sprawl. Reviewed studies regarding this SDG mainly focused on landscape ecology, hence related to protecting and safeguarding the world’s natural heritage and providing access to green and public spaces (targets 11.4 and 11.7). For instance, CS data revealed foraging resource availability was related to solitary bee nesting [46], and how the proportion of impervious surface affected bee communities [47]. Thus, there is a positive relationship between bee presence and gardens, urban green spaces and the remaining natural ecosystems within cities, which in turn, benefit from bee pollination. None of the studies focused on employing bees for air quality monitoring in cities, another potential application for citizen science and SDG 11 [21].
Expanding knowledge of basic bee biology and ecology contributes to SDG 15 (Life on Land), potentially promoting conservation and the sustainable use of terrestrial ecosystems. CS projects provide large-scale spatial and temporal data, allowing estimating species distribution and assessing extinction risk [48,49,50]. These results may ultimately be useful for identifying potential areas for biodiversity protection and informing national conservation policies, hence attaining targets 15.1, 15.4, 15.5, and 15.9. Regarding alien species (target 15.8), the high sampling effort in citizen science projects could facilitate recording and monitoring invasive processes [51,52]. Furthermore, as bees are important pollinators [17], data obtained by citizen scientists on flower visitation and pollination outcome [53,54], could ultimately contribute to conservation and restoration programs that rely on effective pollination (targets 15.1–15.5). Despite the increasing number of CS studies on bees, there is a bias for social species, especially honey bees and bumblebees. Solitary bees, which comprise the majority in bee diversity [55], are largely unknown by the public [38], contrary to what occurs with managed bees. Thus, gaps in bee diversity are still found in CS research, with few projects focusing on native solitary and stingless bees, which exhibit high species richness resulting in difficulties in species identification by non-experts. This is especially important in tropical countries, where species diversity is high. All told, partnerships with beekeepers [56] could provide an opportunity for the sustainable use of biodiversity, as well as fair and equitable sharing of benefits from the use of genetic resources (targets 15.1 and 15.6).
Establishing partnerships (SDG 17) is essential for successful CS projects. Inducing capacity building and multi stakeholder partnerships, and involving the various social sectors that are central elements in citizen science projects, are in line with targets 17.9, 17.16, and 17.17. In this respect, our results corroborate the findings of Cunha et al. [31], showing that governments and NGOs play major roles in building and funding partnerships, whereas in the private sector this is less so. Private sector participation (17.17) could lead to inducing companies to support science and sustainability, hence rewarded with innovations in technology and production (SDG 9 Industry Innovation and Infrastructure). On the other hand, as study proponents are mainly researchers, this could affect the intended role of each stakeholder. Indeed, the level of participation in most of the studies reviewed was contributory, thereby indicating that citizen scientist participation is restricted to collecting or processing data [33]. According to the fourth principle of citizen science, citizen scientists may, if they so wish, participate in several stages of the research process [13]. Similar to previous assessments, contributory approaches were more frequent [2]. Even though requiring more effort and engagement from both researchers and citizen scientists, involving higher levels of citizen participation in collaborative and co-created projects is also relevant as they promote greater ownership and may bring contributions driven by the needs of the community that may be related to key SDG targets [12]. The scarcity of co-created projects may be explained once one of the main disadvantages in CS approaches is related to the amount of effort and difficulty to execute a protocol or participate in the project. The co-created and collaborative projects usually need more effort from the professional scientists to maintain the volunteers committed and manage the research, because the data acquisition is not under the professional team direct control [57].
According to Martens [58], spatial scale is an essential factor in sustainable development. Most of the reviewed studies concentrated on a local scale, which contributes to monitoring volunteers, their activities and expectations [57]. In addition, citizen science projects contributing to monitoring at the local scale have greater potential to implement SDGs in specific contexts, and if successful, feasible for scaling up when attempting to reach a global level [12]. Scaling CS initiatives to the global level may contribute to bee monitoring programs, which can provide essential information on how pollinators face global change [59]. Indeed, participatory research has been increasingly indicated as a powerful strategy for long-term pollinator monitoring, suggesting an avenue for mainstreaming CS in bee and pollination research and advocating for funding those initiatives [60,61,62]. Since the Global Biodiversity Information Facility (GBIF) already accepts CS data, including these data on research will become more common and highlights the importance of data sharing practices. Currently and according to previous studies, most projects were carried out in developed countries, mostly in Europe and North America [5,63]. The United Kingdom stands out as a leader in citizen science projects involving bees, which was to be expected, due to the UK’s centenary tradition in biodiversity monitoring projects [64]. On the contrary, in developing countries, where access to research funding is more restricted and levels of formal education lower, there are less citizen science projects and added difficulties in volunteer engagement [63,65]. Investing in citizen science projects on developing countries as a strategy to achieve SDGs is highly relevant because these countries concentrate the greatest and most important biodiversity hotspots, are responsible for the maintenance of numerous ecosystem services, and show high levels of poverty and inequality [66]. Citizen science thus emerges as a promising way to engage local communities in conservation projects, besides being a potentially cheaper way to monitor biodiversity, especially important in developing countries. Furthermore, citizen science initiatives focused on beekeeping should be supported in developing countries, because this activity can be a promoter of sustainability in its social, economic, cultural and ecological domains [22], being valuable to reduce social and gender inequalities [21].
Regarding best practices and the use of correct terminology, during our search several studies using the term “citizen science” were found. However, they were not considered as CS in our study, according to current definitions and so were excluded from our analyses [26]. Even though the term “citizen science” was found in keywords of some studies, authors only mentioned or suggested CS. Two allegedly CS studies used data collected from people stored in social media platforms, not involving citizen scientists on the science making process, and being in conflict with the ECSA principles. The distinction between this kind of data mining and the crowdsourced level of participation in citizen science must be highlighted, because consent is an ethical principle of this research field. The term citizen science should be carefully used in scientific publications, once this field is a valid scientific approach like any other with their own strengths and limitations and the appropriate use of terminology contributes to its recognition as a field of study [26].
Volunteer assessment was rarely explored in the studies, thereby hampering an evaluation of outcomes from the volunteer’s point of view (third principle, [13]). Knowledge of the volunteer’s motivations is crucial for keeping them engaged, especially in the case of long-term citizen science projects [57]. However, we highlight that the analyzed citizen science projects may present volunteer assessment protocols, even though this feature was not exploited in the publications. Results from citizen scientist outcomes are highly valuable when designing new or improving long-term projects [67]. Recruitment and communication strategies employed in citizen science projects also exert great influence when engaging citizen scientists [57]. Recruiting a particular profile volunteer with a close relationship with the research subject, may be a simple manner of improving data quality, since the volunteer can rely on personal knowledge to run the protocols [32]. This strategy was used in several of the studies surveyed here, where beekeepers were recruited in large numbers through already existing social organizations [54,56]. Volunteer participation was also assessed as to the quality of data, always a major concern in citizen science studies [12,32]. In most of the cases, the focus was on reliability in species identification, still a challenge in citizen science projects on biodiversity. Strategies to overcome taxonomic uncertainty may involve data validation by experts, identification restricted to higher-level groups or non-natural groups, and focusing on easily identifiable species [68,69].
Feedback to volunteers on the research is of utmost importance for maintaining citizen scientist motivation and collaboration throughout the project [70]. More so, communicating project outcomes represents an ethical principle for professional researchers (fifth and tenth principles [13]). Furthermore, high quality science communication is essential not only for spreading specific knowledge, but also building up trust between the population and scientific community [71]. Although there was mention of the various communication strategies, several did not mention feedback to participants, possibly since this feature was unrelated to the research aim. Nonetheless, numerous studies were published as open access, and most acknowledged volunteers, thus in accordance to the seventh and eighth principles of citizen science [13]. Even though open access publishing in citizen science is still hampered by elevated costs [72], citizen science articles on bees were more frequently published in this format (56%), in comparison with statistics for general publication (20.4% [73]). Notwithstanding, volunteer acknowledgement should be strongly recommended, seeing that in 22% of the studies there was none.

5. Conclusions

Since sustainability can only be achieved through an intergenerational approach [58,74], establishing firm partnerships is an essential step, whereby citizen science can act as a powerful strategy for providing data and implementing SDGs [12]. Our findings revealed that existing citizen science projects are already contributing to scientific research, and even though none were directly aligned to SDGs, studies implicitly related to and data derived from these projects are linked to 21 indicators from 18 SDG targets. Among these, nine are tier II indicators without regular data production, and thus can be positively impacted by citizen science projects contributing with data [12].
Nevertheless, citizen science research on bees still presents major gaps, such as the lack of volunteer assessment, which would significantly contribute to building efficient volunteer engagement strategies, improving learning outcomes, and promoting meaningful experiences. To include citizen science in the SDG workflow and implementation in local contexts, these issues should be dealt with. The inclusion of citizen scientists in all the steps of the scientific process is still uncommon, and should be fostered in further studies. Major challenges are citizen science in developing countries, where investments on research are constrained and budget cuts frequent [75,76]. Few citizen science papers have been produced in developing countries, especially in the southern hemisphere. Thus, these represent priority areas for formulating participatory and co-created projects aiming at achieving several SDGs related to bees, beekeeping, and biodiversity.

Supplementary Materials

The following are available online at, Supplementary Material 1: Complete dataset on citizen science studies assessed in this systematic review; Supplementary Material 2: Figure S1: Publication of citizen science studies on bees from 1992 to 2020, Figure S2: Funding source and proponent affiliation of the citizen science studies on bees, Figure S3: Number of participants engaged in the citizen science studies on bees, Table S1: Variables assessed in the systematic review and summarized results, Table S2: Compliance criteria for the ECSA Principles, Table S3: SDG targets and indicators related to the citizen science studies on bees.

Author Contributions

Conceptualization, S.K. and C.B. methodology, S.K., C.B., N.P.G.-L., J.N.L., B.A. and T.M.F.; validation, S.K., C.B., N.P.G.-L., J.N.L., B.A. and T.M.F.; formal analysis, S.K. and C.B.; investigation, S.K. and C.B.; data curation, S.K. and C.B.; writing—original draft preparation, S.K., C.B., N.P.G.-L., J.N.L. and T.M.F.; writing—review and editing, S.K., C.B., N.P.G.-L., J.N.L., T.M.F. and B.A.; visualization, S.K., C.B., J.N.L. and B.A.; supervision, N.P.G.-L., B.A., T.M.F. and A.M.S.; project administration, A.M.S., T.M.F., N.P.G.-L. and B.A.; funding acquisition, A.M.S. All authors have read and agreed to the published version of the manuscript.


This research was funded by Fundação de Amparo e Apoio à Pesquisa do Estado de São Paulo (FAPESP, grant numbers 2018/14994-1 and 2019/26760-8). This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior—Brazil (CAPES)—Finance Code 001; C.B. grant number 88882.377160/2019-01; J.L grant number 88882.333367/2019-01, and by Conselho Nacional de Desenvolvimento Científico e Tecnológico—Brazil (CNPq), A.S. grant number 312605/2018-8.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Complete datasets are provided as Supplementary Material.


We thank all citizen scientists and researchers from the studies reviewed here for their contribution to bee conservation and sustainability. We also would like to acknowledge researchers from the SURPASS2 project (Safeguarding pollination services in a changing world) for their support to our study. The SURPASS2 project is funded under the Newton Fund Latin America Biodiversity Programme: Biodiversity—Ecosystem services for sustainable development, awarded by the UKRI Natural Environment Research Council (NERC: NE/S011870/2), in partnership with the Argentina National Scientific and Technical Research Council (CONICET 1984/19), Brazil/São Paulo Research Foundation (FAPESP 2018/14994-1), and Chile National Agency for Research and Development (ANID NE/S011870/1).

Conflicts of Interest

The authors declare no conflict of interest.


The following abbreviations are used in this manuscript:
SDGSustainable Development Goals
CSCitizen Science
ECSAEuropean Citizen Science Association
PRISMAPreferred Reporting Items for Systematic Reviews and Meta-Analyses
RAKERapid Automatic Keyword Extraction
PECOPopulation, Exposure, Comparator, Outcome
NGONon-Governmental Organizations
GBIFGlobal Biodiversity Information Facility


  1. Bonney, R.; Cooper, C.B.; Dickinson, J.; Kelling, S.; Phillips, T.; Rosenberg, K.V.; Shirk, J. Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy. BioScience 2009, 59, 977–984. [Google Scholar] [CrossRef]
  2. Pocock, M.J.O.; Tweddle, J.C.; Savage, J.; Robinson, L.D.; Roy, H.E. The diversity and evolution of ecological and environmental citizen science. PLoS ONE 2017, 12, e172579. [Google Scholar] [CrossRef]
  3. Schmeller, D.S.; Henry, P.Y.; Julliard, R.; Gruber, B.; Clobert, J.; Dziock, F.; Lengyel, S.; Nowicki, P.; Deri, E.; Budrys, E.; et al. Advantages of volunteer-based biodiversity monitoring in Europe. Conserv. Biol. 2009, 23, 307–316. [Google Scholar] [CrossRef]
  4. Theobald, E.; Ettinger, A.; Burgess, H.; DeBey, L.; Schmidt, N.; Froehlich, H.; Wagner, C.; HilleRisLambers, J.; Tewksbury, J.; Harsch, M.; et al. Global change and local solutions: Tapping the unrealized potential of citizen science for biodiversity research. Biol. Conserv. 2015, 181, 236–244. [Google Scholar] [CrossRef][Green Version]
  5. Chandler, M.; See, L.; Copas, K.; Bonde, A.M.; López, B.C.; Danielsen, F.; Legind, J.K.; Masinde, S.; Miller-Rushing, A.J.; Newman, G.; et al. Contribution of citizen science towards international biodiversity monitoring. Biol. Conserv. 2017, 213, 280–294. [Google Scholar] [CrossRef][Green Version]
  6. Couvet, D.; Jiguet, F.; Julliard, R.; Levrel, H.; Teyssedre, A. Enhancing citizen contributions to biodiversity science and public policy. Interdiscip. Sci. Rev. 2008, 33, 95–103. [Google Scholar] [CrossRef]
  7. Ballard, H.L.; Robinson, L.D.; Young, A.N.; Pauly, G.B.; Higgins, L.M.; Johnson, R.F.; Tweddle, J.C. Contributions to conservation outcomes by natural history museum-led citizen science: Examining evidence and next steps. Biol. Conserv. 2017, 208, 87–97. [Google Scholar] [CrossRef][Green Version]
  8. McKinley, D.C.; Miller-Rushing, A.J.; Ballard, H.L.; Bonney, R.; Brown, H.; Cook-Patton, S.C.; Evans, D.M.; French, R.A.; Parrish, J.K.; Phillips, T.B.; et al. Citizen science can improve conservation science, natural resource management, and environmental protection. Biol. Conserv. 2017, 208, 15–28. [Google Scholar] [CrossRef][Green Version]
  9. Irwin, E.G.; Culligan, P.J.; Fischer-Kowalski, M.; Law, K.L.; Murtugudde, R.; Pfirman, S. Bridging barriers to advance global sustainability. Nat. Sustain. 2018, 1, 324–326. [Google Scholar] [CrossRef]
  10. Nations, U. The 17 Goals|Sustainable Development. Available online: (accessed on 17 December 2020).
  11. Fraisl, D.; Campbell, J.; See, L.; Wehn, U.; Wardlaw, J.; Gold, M.; Moorthy, I.; Arias, R.; Piera, J.; Oliver, J.L.; et al. Mapping citizen science contributions to the UN sustainable development goals. Sustain. Sci. 2020. [Google Scholar] [CrossRef]
  12. Fritz, S.; See, L.; Carlson, T.; Haklay, M.M.; Oliver, J.L.; Fraisl, D.; Mondardini, R.; Brocklehurst, M.; Shanley, L.A.; Schade, S.; et al. Citizen science and the United Nations Sustainable Development Goals. Nat. Sustain. 2019, 2, 922–930. [Google Scholar] [CrossRef]
  13. ECSA. Ten Principles of Citizen Science. 2015. Available online: (accessed on 30 October 2020).
  14. Robinson, L.D.; Cawthray, J.L.; West, S.E.; Bonn, A.; Ansine, J. Ten principles of citizen science. In Citizen Science: Innovation in Open Science, Society and Policy; UCL Press: London, UK, 2018; pp. 27–40. [Google Scholar]
  15. Callaghan, C.T.; Poore, A.G.B.; Mesaglio, T.; Moles, A.T.; Nakagawa, S.; Roberts, C.; Rowley, J.J.L.; VergÉs, A.; Wilshire, J.H.; Cornwell, W.K. Three Frontiers for the Future of Biodiversity Research Using Citizen Science Data. BioScience 2020, biaa133. [Google Scholar] [CrossRef]
  16. Dunn, R.R.; Beasley, D.E. Democratizing evolutionary biology, lessons from insects. Curr. Opin. Insect Sci. 2016, 18, 89–92. [Google Scholar] [CrossRef] [PubMed][Green Version]
  17. Ollerton, J. Pollinator Diversity: Distribution, Ecological Function, and Conservation. Annu. Rev. Ecol. Evol. Syst. 2017, 48, 353–376. [Google Scholar] [CrossRef][Green Version]
  18. Wilson, J.S.; Forister, M.L.; Carril, O.M. Interest exceeds understanding in public support of bee conservation. Front. Ecol. Environ. 2017, 15, 460–466. [Google Scholar] [CrossRef][Green Version]
  19. Rader, R.; Bartomeus, I.; Garibaldi, L.A.; Garratt, M.P.D.; Howlett, B.G.; Winfree, R.; Cunningham, S.A.; Mayfield, M.M.; Arthur, A.D.; Andersson, G.K.S.; et al. Non-bee insects are important contributors to global crop pollination. Proc. Natl. Acad. Sci. USA 2016, 113, 146–151. [Google Scholar] [CrossRef][Green Version]
  20. Intergovernmental Science-Policy Platform on Biodiversity and Ecosystem Services (IPBES). Assessment Report on Pollinators, Pollination and Food Production; IPBES: Bonn, Germany, 2016. [CrossRef]
  21. Patel, V.; Pauli, N.; Biggs, E.; Barbour, L.; Boruff, B. Why bees are critical for achieving sustainable development. Ambio 2020. [Google Scholar] [CrossRef][Green Version]
  22. Barbiéri, C.; Francoy, T.M. Theoretical model for interdisciplinary analysis of human activities: Meliponiculture as an activity that promotes sustainability. Ambiente Soc. 2020, 23. [Google Scholar] [CrossRef]
  23. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Group, T.P. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef][Green Version]
  24. Grames, E.M.; Stillman, A.N.; Tingley, M.W.; Elphick, C.S. An automated approach to identifying search terms for systematic reviews using keyword co-occurrence networks. Methods Ecol. Evol. 2019, 10, 1645–1654. [Google Scholar] [CrossRef]
  25. Haddaway, N.R.; Bernes, C.; Jonsson, B.G.; Hedlund, K. The benefits of systematic mapping to evidence-based environmental management. Ambio 2016, 45, 613–620. [Google Scholar] [CrossRef][Green Version]
  26. Eitzel, M.V.; Cappadonna, J.L.; Santos-Lang, C.; Duerr, R.E.; Virapongse, A.; West, S.E.; Kyba, C.; Bowser, A.; Cooper, C.B.; Sforzi, A.; et al. Citizen science terminology matters: Exploring key terms. Citiz. Sci. Theory Pract. 2017. [Google Scholar] [CrossRef][Green Version]
  27. Grames, E.M.; Hennessy, E.A. Search Term Selection with Litsearchr for an Example Systematic Review of the Effects of Forest Fragmentation on Bird-Insect Interactions. Available online: (accessed on 23 September 2020).
  28. Cooper, C.B.; Shirk, J.; Zuckerberg, B. The invisible prevalence of citizen science in global research: Migratory birds and climate change. PLoS ONE 2014, 9, e106508. [Google Scholar] [CrossRef] [PubMed][Green Version]
  29. Smith, B.M.; Chakrabarti, P.; Chatterjee, A.; Chatterjee, S.; Dey, U.K.; Dicks, L.V.; Giri, B.; Laha, S.; Majhi, R.K.; Basu, P. Collating and validating indigenous and local knowledge to apply multiple knowledge systems to an environmental challenge: A case-study of pollinators in India. Biol. Conserv. 2017, 211, 20–28. [Google Scholar] [CrossRef][Green Version]
  30. United Nations Statistics Division (UNSD). Tier Classification for Global SDG Indicators. Available online: (accessed on 20 October 2020).
  31. Cunha, D.G.; Marques, J.F.; Resende, J.C.; Falco, P.B.; Souza, C.M.; Loiselle, S.A. Citizen science participation in research in the environmental sciences: Key factors related to projects’ success and longevity. An. Acad. Bras. Ciências 2017, 89, 2229–2245. [Google Scholar] [CrossRef][Green Version]
  32. Wiggins, A.; Newman, G.; Stevenson, R.D.; Crowston, K. Mechanisms for Data Quality and Validation in Citizen Science. In Proceedings of the 2011 IEEE Seventh International Conference on e-Science Workshops, Stockholm, Sweden, 5–8 December 2011; pp. 14–19. [Google Scholar] [CrossRef]
  33. Bonney, R.; Ballard, H.; Jordan, R.; McCallie, E.; Phillips, T.; Shirk, J.; Wilderman, C.C. Public Participation in Scientific Research: Defining the Field and Assessing Its Potential for Informal Science Education. A CAISE Inquiry Group Report, Online Submission. 2009.
  34. Kelemen-Finan, J.; Scheuch, M.; Winter, S. Contributions from citizen science to science education: An examination of a biodiversity citizen science project with schools in Central Europe. Int. J. Sci. Educ. 2018, 40, 2078–2098. [Google Scholar] [CrossRef]
  35. South, A. Package ‘Rworldmap’. Available online: (accessed on 14 October 2020).
  36. Blackawton, P.; Airzee, S.; Allen, A.; Baker, S.; Berrow, A.; Blair, C.; Churchill, M.; Coles, J.; Cumming, R.J.; Fraquelli, L.; et al. Blackawton bees. Biol. Lett. 2011, 7, 168–172. [Google Scholar] [CrossRef]
  37. Follett, R.; Strezov, V. An Analysis of Citizen Science Based Research: Usage and Publication Patterns. PLoS ONE 2015, 10, e143687. [Google Scholar] [CrossRef][Green Version]
  38. van Vierssen Trip, N.; MacPhail, V.J.; Colla, S.R.; Olivastri, B. Examining the public’s awareness of bee (Hymenoptera: Apoidae: Anthophila) conservation in Canada. Conserv. Sci. Pract. 2020, e293. [Google Scholar] [CrossRef]
  39. MacPhail, V.J.; Gibson, S.D.; Colla, S.R. Community science participants gain environmental awareness and contribute high quality data but improvements are needed: Insights from Bumble Bee Watch. PeerJ 2020, 8, e9141. [Google Scholar] [CrossRef]
  40. Kremen, C.; Williams, N.M.; Thorp, R.W. Crop pollination from native bees at risk from agricultural intensification. Proc. Natl. Acad. Sci. USA 2002, 99, 16812–16816. [Google Scholar] [CrossRef] [PubMed][Green Version]
  41. Billaud, O.; Vermeersch, R.L.; Porcher, E. Citizen science involving farmers as a means to document temporal trends in farmland biodiversity and relate them to agricultural practices. J. Appl. Ecol. 2020. [Google Scholar] [CrossRef]
  42. Garratt, M.; Potts, S.; Banks, G.; Hawes, C.; Breeze, T.; O’Connor, R.; Carvell, C. Capacity and willingness of farmers and citizen scientists to monitor crop pollinators and pollination services. Glob. Ecol. Conserv. 2019, 20, e00781. [Google Scholar] [CrossRef]
  43. Appenfeller, L.R.; Lloyd, S.; Szendrei, Z. Citizen science improves our understanding of the impact of soil management on wild pollinator abundance in agroecosystems. PLoS ONE 2020, 15, e230007. [Google Scholar] [CrossRef] [PubMed][Green Version]
  44. Cronje, R.; Rohlinger, S.; Crall, A.; Newman, G. Does Participation in Citizen Science Improve Scientific Literacy? A Study to Compare Assessment Methods. Appl. Environ. Educ. Commun. 2011, 10, 135–145. [Google Scholar] [CrossRef]
  45. Queiruga-Dios, M.Á.; López-Iñesta, E.; Diez-Ojeda, M.; Sáiz-Manzanares, M.C.; Vázquez Dorrío, J.B. Citizen Science for Scientific Literacy and the Attainment of Sustainable Development Goals in Formal Education. Sustainability 2020, 12, 4283. [Google Scholar] [CrossRef]
  46. Everaars, J.; Strohbach, M.W.; Gruber, B.; Dormann, C.F. Microsite conditions dominate habitat selection of the red mason bee (Osmia bicornis, Hymenoptera: Megachilidae) in an urban environment: A case study from Leipzig, Germany. Landsc. Urban Plan. 2011, 103, 15–23. [Google Scholar] [CrossRef]
  47. Desaegher, J.; Nadot, S.; Fontaine, C.; Colas, B. Floral morphology as the main driver of flower-feeding insect occurrences in the Paris region. Urban Ecosyst. 2018, 21, 585–598. [Google Scholar] [CrossRef]
  48. Beckham, J.L.; Atkinson, S. An updated understanding of Texas bumble bee (Hymenoptera: Apidae) species presence and potential distributions in Texas, USA. PeerJ 2017, 5, e3612. [Google Scholar] [CrossRef][Green Version]
  49. Suzuki-Ohno, Y.; Yokoyama, J.; Nakashizuka, T.; Kawata, M. Utilization of photographs taken by citizens for estimating bumblebee distributions. Sci. Rep. 2017, 7, 11215. [Google Scholar] [CrossRef]
  50. MacPhail, V.J.; Richardson, L.L.; Colla, S.R. Incorporating citizen science, museum specimens, and field work into the assessment of extinction risk of the American Bumble bee (Bombus pensylvanicus De Geer 1773) in Canada. J. Insect Conserv. 2019, 23, 597–611. [Google Scholar] [CrossRef][Green Version]
  51. Looney, C.; Strange, J.P.; Freeman, M.; Jennings, D. The expanding Pacific Northwest range of Bombus impatiens Cresson and its establishment in Washington State. Biol. Invasions 2019, 21, 1879–1885. [Google Scholar] [CrossRef]
  52. Prendergast, K.S. First records of the introduced African carder bee, Pseudoanthidium (Immanthidium) repetitum (Hymenoptera: Megachilidae), in Western Australia. Pac. Conserv. Biol. 2020. [Google Scholar] [CrossRef]
  53. Birkin, L.; Goulson, D. Using citizen science to monitor pollination services. Ecol. Entomol. 2015, 40, 3–11. [Google Scholar] [CrossRef][Green Version]
  54. Brodschneider, R.; Gratzer, K.; Kalcher-Sommersguter, E.; Heigl, H.; Auer, W.; Moosbeckhofer, R.; Crailsheim, K. A citizen science supported study on seasonal diversity and monoflorality of pollen collected by honey bees in Austria. Sci. Rep. 2019, 9, 1–12. [Google Scholar] [CrossRef]
  55. Michener, C.D. The Bees of the World; JHU Press: Baltimore, MD, USA, 2000; Volume 1. [Google Scholar]
  56. Gray, A.; Adjlane, N.; Arab, A.; Ballis, A.; Brusbardis, V.; Charrière, J.D.; Chlebo, R.; Coffey, M.F.; Cornelissen, B.; Amaro da Costa, C.; et al. Honey bee colony winter loss rates for 35 countries participating in the COLOSS survey for winter 2018–2019, and the effects of a new queen on the risk of colony winter loss. J. Apic. Res. 2020, 59, 744–751. [Google Scholar] [CrossRef]
  57. Pocock, M.J.; Chapman, D.S.; Sheppard, L.J.; Roy, H.E. Choosing and Using Citizen Science: A Guide to When and How to Use Citizen Science to Monitor Biodiversity and the Environment; NERC/Centre for Ecology & Hydrology: Oxfordshire, UK, 2014. [Google Scholar]
  58. Martens, P. Sustainability: Science or fiction? Sustain. Sci. Pract. Policy 2006, 2, 36–41. [Google Scholar] [CrossRef][Green Version]
  59. Potts, S.G.; Imperatriz-Fonseca, V.; Ngo, H.T.; Aizen, M.A.; Biesmeijer, J.C.; Breeze, T.D.; Dicks, L.V.; Garibaldi, L.A.; Hill, R.; Settele, J.; et al. Safeguarding pollinators and their values to human well-being. Nature 2016, 540, 220–229. [Google Scholar] [CrossRef]
  60. Dicks, L.V.; Viana, B.; Bommarco, R.; Brosi, B.; del Coro Arizmendi, M.; Cunningham, S.A.; Galetto, L.; Hill, R.; Lopes, A.V.; Pires, C.; et al. Ten policies for pollinators. Science 2016, 354, 975–976. [Google Scholar] [CrossRef][Green Version]
  61. Harvey, J.A.; Heinen, R.; Armbrecht, I.; Basset, Y.; Baxter-Gilbert, J.H.; Bezemer, T.M.; Böhm, M.; Bommarco, R.; Borges, P.A.; Cardoso, P.; et al. International scientists formulate a roadmap for insect conservation and recovery. Nat. Ecol. Evol. 2020, 4, 174–176. [Google Scholar] [CrossRef]
  62. Science for Enviromental Policy. Pollinators: Importance for Nature and Human Well-Being, Drivers of Decline and the Need for Monitoring; Future Brief 23; European Commission: Brussels, Belgium, 2020. [Google Scholar]
  63. Requier, F.; Andersson, G.K.; Oddi, F.J.; Garibaldi, L.A. Citizen science in developing countries: How to improve volunteer participation. Front. Ecol. Environ. 2020, 18, 101–108. [Google Scholar] [CrossRef]
  64. Kobori, H.; Dickinson, J.L.; Washitani, I.; Sakurai, R.; Amano, T.; Komatsu, N.; Kitamura, W.; Takagawa, S.; Koyama, K.; Ogawara, T.; et al. Citizen science: A new approach to advance ecology, education, and conservation. Ecol. Res. 2016, 31, 1–19. [Google Scholar] [CrossRef][Green Version]
  65. Loos, J.; Horcea-Milcu, A.I.; Kirkland, P.; Hartel, T.; Osváth-Ferencz, M.; Fischer, J. Challenges for biodiversity monitoring using citizen science in transitioning social–ecological systems. J. Nat. Conserv. 2015, 26, 45–48. [Google Scholar] [CrossRef]
  66. Mertz, O.; Ravnborg, H.M.; Lövei, G.L.; Nielsen, I.; Konijnendijk, C.C. Ecosystem services and biodiversity in developing countries. Biodivers. Conserv. 2007, 16, 2729–2737. [Google Scholar] [CrossRef]
  67. Druschke, C.G.; Seltzer, C.E. Failures of engagement: Lessons learned from a citizen science pilot study. Appl. Environ. Educ. Commun. 2012, 11, 178–188. [Google Scholar] [CrossRef]
  68. Deguines, N.; Julliard, R.; de Flores, M.; Fontaine, C. The Whereabouts of Flower Visitors: Contrasting Land-Use Preferences Revealed by a Country-Wide Survey Based on Citizen Science. PLoS ONE 2012, 7, e45822. [Google Scholar] [CrossRef]
  69. Maher, S.; Manco, F.; Ings, T.C. Using citizen science to examine the nesting ecology of ground-nesting bees. Ecosphere 2019, 10, e02911. [Google Scholar] [CrossRef]
  70. Viana, B.; Souza, C.; Moreira, E. Why the views of Latin American Scientists on Citizen Science as a Tool for Pollinator Monitoring and Conservation Matter? Neotrop. Entomol. 2020, 49, 604–613. [Google Scholar] [CrossRef]
  71. Bickford, D.; Posa, M.R.C.; Qie, L.; Campos-Arceiz, A.; Kudavidanage, E.P. Science communication for biodiversity conservation. Biol. Conserv. 2012, 151, 74–76. [Google Scholar] [CrossRef]
  72. Gadermaier, G.; Dörler, D.; Heigl, F.; Mayr, S.; Rüdisser, J.; Brodschneider, R.; Marizzi, C. Peer-reviewed publishing of results from Citizen Science projects. J. Sci. Commun. 2018, 17, L01. [Google Scholar] [CrossRef]
  73. Björk, B.C.; Welling, P.; Laakso, M.; Majlender, P.; Hedlund, T.; Guðnason, G. Open Access to the Scientific Journal Literature: Situation 2009. PLoS ONE 2010, 5, e11273. [Google Scholar] [CrossRef] [PubMed]
  74. WECD. Report of the World Commission on Environment and Development: Our Common Future. 1987. Available online: (accessed on 30 October 2020).
  75. Escobar, H. In Brazil, “Useful Idiots” Protest Cuts to Research and Education. Science 2019, 17. Available online: (accessed on 30 October 2020). [CrossRef]
  76. Guglielmi, G. Mexican science suffers under budget cuts. Nature 2019, 572, 294–295. [Google Scholar] [CrossRef] [PubMed][Green Version]
Figure 1. Global distribution of citizen science studies of bees. All the reported countries were gathered for each study. The study was not represented when individual countries were not reported in the article ( e.g., “Europe”). The map was constructed using the ‘rworldmap’ R package [35].
Figure 1. Global distribution of citizen science studies of bees. All the reported countries were gathered for each study. The study was not represented when individual countries were not reported in the article ( e.g., “Europe”). The map was constructed using the ‘rworldmap’ R package [35].
Sustainability 13 00959 g001
Figure 2. (a) Absolute number of studies related to each SDG identified in the review process and (b) Proportion of research subjects expressed in the studies analysed (number of studies is represented after the bar).
Figure 2. (a) Absolute number of studies related to each SDG identified in the review process and (b) Proportion of research subjects expressed in the studies analysed (number of studies is represented after the bar).
Sustainability 13 00959 g002
Figure 3. Compliance to ECSA principles (a) Number of studies according to total score (number of principles fulfilled) and (b) Proportion of studies following each ECSA principle.
Figure 3. Compliance to ECSA principles (a) Number of studies according to total score (number of principles fulfilled) and (b) Proportion of studies following each ECSA principle.
Sustainability 13 00959 g003
Figure 4. Proportion of data quality control strategies employed in citizen science studies of bees. Each study could apply more than one strategy. Number of studies is represented after the bar.
Figure 4. Proportion of data quality control strategies employed in citizen science studies of bees. Each study could apply more than one strategy. Number of studies is represented after the bar.
Sustainability 13 00959 g004
Table 1. Variables assessed in each study retrieved in the systematic review. Details are given for the variable name, information source (A: article or P: project), definition and levels considered for each variable, and which ECSA principle was being assessed (see also Table S2).
Table 1. Variables assessed in each study retrieved in the systematic review. Details are given for the variable name, information source (A: article or P: project), definition and levels considered for each variable, and which ECSA principle was being assessed (see also Table S2).
GroupVariable NameSourceDefinitionECSA Principle
Study informationProponents (adapted from [31])AAffiliation of study authors-
Funding source (adapted from [31])AFunding institution cited/acknowledged in the article-
ReachASpatial scale (local, regional, or global)-
CountryACountry or countries where the project was performed-
Project durationPProject length and status (short or long-term, active or finished)-
SDGAUN Sustainable Development Goal addressed by the study (see explanation in the text)-
Research subjectAResearch areas explored (when more than one aim was declared, only the main results were considered)9
Hypothesis-ledAWhether authors clearly state that there is a study question or hypothesis to test2
Data quality (modified from [32])AStrategies employed to improve data quality in the citizen science projects3, 6
ProjectinformationProject namePCitizen science project name-
Project purpose (modified from [2])PAim of volunteer participation in the project (biological recording, biological monitoring, crowd-sourcing, or creating technology platforms)-
Degree of participation (modified from [33])AWhether study was contributory, collaborative, co-created, or used crowd-sourced data.1, 3, 4
Studied systemAnimal groupAWhich animal groups were studied-
TaxonATaxonomic name of the focused group-
SocialityASociality level of the bees studied-
Participant informationNumber of participantsANumber of participants contributing to the project. Descriptive statistics were based on exact numbers provided by the study (approximations were not considered)-
Volunteer profileAProfile of participants. “General public” was inferred when no other profile was mentioned-
RecruitmentAMethods employed for recruiting participants-
CommunicationAMethods and tools used to train participants and deliver relevant information about the project3
Volunteer assessment (what?) (modified from [34])ALearning outcomes and perceptions of volunteers3
Volunteer assessment (how?)AMechanisms for volunteer assessment3
Volunteer assessment (when?)AAt which step volunteers were assessed (pre/post survey)3
EthicscommitmentOpen accessAPublication type regarding accessibility or whether study was a conference paper7
Feedback to participantsAWhether authors mention if any feedback was given to the volunteers5
AcknowledgementsAWhether citizen scientists were acknowledged in the study.8
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Koffler, S.; Barbiéri, C.; Ghilardi-Lopes, N.P.; Leocadio, J.N.; Albertini, B.; Francoy, T.M.; Saraiva, A.M. A Buzz for Sustainability and Conservation: The Growing Potential of Citizen Science Studies on Bees. Sustainability 2021, 13, 959.

AMA Style

Koffler S, Barbiéri C, Ghilardi-Lopes NP, Leocadio JN, Albertini B, Francoy TM, Saraiva AM. A Buzz for Sustainability and Conservation: The Growing Potential of Citizen Science Studies on Bees. Sustainability. 2021; 13(2):959.

Chicago/Turabian Style

Koffler, Sheina, Celso Barbiéri, Natalia P. Ghilardi-Lopes, Jailson N. Leocadio, Bruno Albertini, Tiago M. Francoy, and Antonio M. Saraiva. 2021. "A Buzz for Sustainability and Conservation: The Growing Potential of Citizen Science Studies on Bees" Sustainability 13, no. 2: 959.

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop