1. Introduction
Mosquito-borne diseases remain a global public health burden, with increasing mortality and morbidity rates anticipated because of globalization and climate change [
1,
2,
3]. The mosquitoes,
Culex pipiens [L.],
Aedes aegypti [L.], and
Aedes albopictus [Skuse] are globally invasive vector mosquitoes which together have been implicated in various outbreaks of Zika, chikungunya, West Nile virus, and dengue fever [
1,
2]. Some notable examples of outbreaks caused by these mosquitoes include 1868 cases and 89 deaths attributed to West Nile virus in Dallas, Texas, in 2012, vectored by
Cx. pipiens quinquefasciatus [Say], over 42,000 locally acquired cases of Zika in Puerto Rico and the US territories in 2016 and 2017 vectored by
Ae. aegypti, and a 2005 outbreak of chikungunya vectored by
Ae. albopictus on the island of Réunion which saw over 250,000 cases [
1,
2]. Due to the absence of widely available preventive vaccines or prophylactic treatments, mosquito population abundance reduction remains a central strategy for many vector control programs. For over a century, mosquitoes have faced various selective pressures from chemical interventions aimed at reducing populations and mitigating the risk of disease transmission [
4,
5]. Larval mosquito control has long been recognized as a vital element in any strategy for population management and diverse classes of larvicides have been developed to support this objective [
6]. Not surprisingly, resistance to nearly every class of larvicide has been observed around the world both in wild populations as well as laboratory-selected colonies [
7,
8].
Insect growth regulators (IGRs), such as methoprene and pyriproxyfen, were first developed and introduced in the 1970s as “third-generation” pesticides [
9,
10,
11]. These pesticides were designed to offer greater selectivity, fewer non-target effects, and a reduced likelihood of resistance development [
7,
12,
13,
14]. By interfering with gene expression during metamorphosis, the juvenoid IGRs can prevent the development and successful emergence of adult mosquitoes [
15,
16]. Despite the reduced potential for resistance, a variety of reports over recent decades provide overwhelming evidence that, even for juvenoid IGRs, the development of resistance is possible in wild mosquito populations [
7,
8].
To maintain an arsenal of effective larval control materials, it is necessary for public health and other vector control programs to periodically assess wild populations of mosquitoes for susceptibility to existing or potential control materials. The most widely utilized methodology for assessing IGR susceptibility requires a phenotypic bioassay methodology where susceptible larval mosquitoes (most commonly a laboratory-maintained “reference” colony) and field-collected mosquito populations are exposed to a range of concentrations of the IGR in parallel with untreated controls [
17,
18]. Corrected mortality at each concentration is subjected to a probit regression analysis to determine the concentration of IGR that inhibits emergence (IE) of 50, 90, 95%, etc., of larval mosquitoes (i.e., IE
50, IE
90 and/or IE
95).
The baseline “reference” value derived from this procedure can then be used to develop a “discriminating dose” or “diagnostic dose”. For example, the World Health Organization (WHO) recommends two times the IE
99.
9 (the concentration that causes inhibition of emergence in 99.9% of exposed larvae) of a susceptible reference strain as a diagnostic dose [
17]. The diagnostic dose can then be applied to field-collected mosquitoes to determine susceptibility as compared to the reference strain. This method reduces the dependence on a reference colony, which is especially important in geographies or for species where a reference colony may be unavailable. Alternatively, a ratio can be calculated which, most commonly, compares the IE
50 value of field-collected mosquitoes to that of the susceptible reference strain to create a resistance ratio or “RR” [
19]. The WHO has identified resistance ratios at the IE
50 of <5 as indicating susceptible field populations; an RR between 5 and 10 indicates moderate resistance, and an RR > 10 indicates high resistance [
18]. For both the diagnostic dose method and the resistance ratio method, the susceptible reference IE value serves as the only baseline for comparison and so the reliability of this value is critically important for understanding the presence and intensity of resistance that may exist.
WHO standard assessments of mosquito susceptibility to IGR larvicides rely entirely on mathematical comparisons to a baseline susceptible reference IE value. As a result, variability in reference measurements—whether due to bias, experimental errors, or biological differences between reference colonies—can obscure resistance detection or lead to inaccurate assessments of its intensity. For instance, if a susceptible reference colony has an IE50 value that is too high, the resulting RR calculation will be artificially low. The relationship between the reference IE values and the resulting RR follows a rectangular hyperbola, where small changes in the denominator (susceptible IE values) can cause disproportionately large shifts in RR.
Any resistance assessment based on an inaccurate reference baseline risks leading to inappropriate treatment decisions, reduced field effectiveness, or even treatment failures. Although the WHO has published protocols intended to standardize the experimental conditions for deriving reference IE values, the extremely wide variation in published reference IE values significantly limits the interpretation of resistance assessments and complicates comparisons between studies and regions. In addition, the WHO does not report pre-established standard IE values for susceptible mosquito populations. This necessitates individual research groups acquire susceptible strains, maintain said mosquito strain in colony, and evaluate for insecticide susceptibility. The lack of comparability and reliability in susceptible reference measurements has important ramifications for public health and mitigating the threat posed by mosquito vectors of disease. Therefore, understanding the range and variability in published reference values is crucial for evaluating the validity and reliability of experimentally derived IE values, as well as for assessing the ongoing susceptibility of reference colonies maintained globally. Given these challenges, our study aims to systematically assess and synthesize reference IE values to improve the reliability of IGR resistance assessments.
The specific goals of this systematic review and meta-analysis are threefold. First, we aim to summarize and characterize the distribution of published susceptible reference IE values (IE
50, IE
90, and/or IE
95) for three globally invasive vector mosquito species (
Cx. pipiens, Ae. aegypti, and
Ae. albopictus) and two IGRs (methoprene and pyriproxyfen). Second, we aim to generate composite IE values for each species, IE value, and IGR using a DerSimonian and Laird random-effects model. A robust susceptible reference value, synthesized from multiple studies, can serve as a crucial benchmark for public health and vector control professionals to assess susceptibility in field-collected mosquitoes, evaluate the suitability of mosquitoes for use as susceptible references, and assess or monitor the continued susceptibility of laboratory colonies. These values can be used when access to or maintaining a reference colony is unattainable, a common barrier in the mosquito control field [
20], or to validate susceptibility of existing strains. Finally, we aim to compare synthesized IE values with previously published susceptible reference values to contextualize the existing literature and highlight trends or discrepancies in resistance assessment.
2. Methods
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 standard guidelines were used to address the main goals of this study [
21,
22]. The PICO framework was used as follows: Population = pesticide-susceptible laboratory colony mosquitoes intended as a susceptible control or reference population. Intervention = exposure to the insect growth regulators methoprene or pyriproxyfen in a bioassay aligned with WHO protocols;. Comparison = variability in baseline susceptibility reported across the literature. Outcome = IE
50, IE
90, and/or IE
95 values derived from a probit-based analysis [
23]. This meta-analysis was not prospectively registered, as it did not assess a specific hypothesis, treatment effect, or treatment efficacy but instead aimed to examine the variability in control values from previously published research. Given this study’s focus on methodology rather than hypothesis testing or treatment effect quantification, prospective registration was not deemed necessary.
2.1. Literature Search Strategy
The goal of the literature search was to identify reference emergence of inhibition concentrations (IE50, IE90, and/or IE95 values) from three vector species of pesticide-susceptible laboratory mosquitoes exposed to the insect growth regulators methoprene or pyriproxyfen derived using a WHO-aligned dose/concentration-response bioassay. Both authors independently conducted a systematic search of internet databases to identify relevant publication records. Four databases were queried between 3 September 2024 and 10 February 2025: PubMed (last searched 7 February 2025), SciELO (last searched 7 February 2025), J-STAGE (last searched 7 February 2025), and Google Scholar (last searched 10 February 2025). The following keywords and combinations of keywords were used:
PubMed, SciELO, and J-STAGE search terms:
“Aedes aegypti” AND “methoprene” OR “pyriproxyfen” OR “s-31183”
“Aedes albopictus” AND “methoprene” OR “pyriproxyfen” OR “s-31183”
“Culex” AND “methoprene” OR “pyriproxyfen” OR “s-31183”
Google Scholar search terms:
“Aedes aegypti” OR “Aedes albopictus” OR “Culex” AND “Methoprene” OR “pyriproxyfen” OR ““s-31183” AND “emergence inhibition” AND “probit”
There were no search limitations imposed for date or language of publication. All search keywords were evaluated against the full text of the article record. All identified records were independently screened by title and abstract by both authors. Unpublished manuscripts, conference abstracts, and other non-peer reviewed scientific correspondence were excluded from retrieval. The results of the independent searches were compared and collated in Excel (Microsoft, Redmond, WA, USA) to eliminate duplicate records. The full texts of records identified as potentially containing relevant data and variables were retrieved and assessed for inclusion.
2.2. Study Selection and Eligibility Criteria
If necessary, retrieved publications were translated using the translation tool in Adobe Acrobat (Adobe San Jose, CA, USA) or Google Translate (Google Mountain View, CA, USA) to facilitate eligibility review and data extraction. Retrieved studies were required to meet the following criteria to be eligible for inclusion: (i) the study utilized larval
Cx. pipiens complex (
pipiens, quinquefasciatus, or
pallens),
Ae. Aegypti, or
Ae. albopictus laboratory colonies that were regarded by the authors to be a pesticide-susceptible control colony and maintained as such (no publications with F
1 susceptible progeny), (ii) late-instar larval mosquitoes were exposed to methoprene or pyriproxyfen over a range of concentrations to develop mortality percentages in a bioassay experiment that included untreated controls, (iii) publications utilized a continuous exposure (exposure of larvae for ≥24 h) methodology that recorded mortality until all mosquitoes were dead or had emerged successfully, (iv) inhibition of emergence (IE) percentages for various exposures were corrected for control mortality and were analyzed using a probit-based methodology to calculate and report original IE
50, IE
90, and/or IE
95 values. These criteria were constructed to include studies that are aligned with WHO IGR larval resistance testing protocols [
17,
18]. In addition, a publication was excluded if (i) it contained unoriginal reference IE values reprinted and/or cited from previous publications, or (ii) the control/reference mosquitoes were regarded as a pesticide-susceptible reference strain but were identified as F
1 progeny or other field-collected mosquitoes.
2.3. Risk of Bias Evaluation
To assess the risk of bias, we evaluated study-level, outcome-level, and publication-level factors. Since our study aims to characterize the variability in published susceptible reference IE values derived from WHO-standardized IGR testing protocols, we designed our eligibility criteria to minimize study-level bias. We excluded publications with clear sources of variation, such as differences in bioassay design, exposure duration, assay length, and reference strain provenance. This approach ensured our study population closely aligned with WHO methodologies while also isolating experimental heterogeneity, biological variation, and other unknown confounders as the primary remaining sources of bias for characterization in this meta-analysis. Because all reported reference IE values were originally intended as experimental controls, the risk of reporting bias was considered negligible. This methodology enabled a synthesis of reference IE values under comparable experimental conditions, facilitated an analysis of heterogeneity within established protocols, and provided a clearer understanding of true susceptibility variation in mosquito populations to IGRs while minimizing known biases.
At the outcome-level, we evaluated the consistency of bioassay and probit regression methods for determining IE
50, IE
90, and IE
95 values. To address redundancy bias from repetitive IE values in the literature, we excluded publications that reported unoriginal or previously published IE values. To reduce the risk of repeated measure bias, publications with multiple measurements on the same reference strain in the same publication were averaged to produce one set of reference values per publication. Publication bias was evaluated subjectively through funnel plots and objectively using Egger’s regression (
Supplemental Figures S13–S15) [
24].
Included publications were grouped by species and IGR into six distinct subgroups. Each IE value (IE50, IE90, and IE95) for each species/IGR pair was analyzed separately for a total of 18 analyses (3 species × 2 IGRs × 3 IE values). Because Cx. pipiens is a pan-global species complex composed of a variety of subspecies, forms, and hybrids, studies on Culex spp. were first grouped by subspecies to facilitate a subgroup analysis of Cx. quinquefasciatus, pipiens, and pallens to determine if treating the species complex as a single species was appropriate.
2.4. Data Extraction and Formatting
Both authors independently reviewed the retrieved records against the inclusion and exclusion criteria. M.C. extracted the data from the studies identified for inclusion. K.L. audited the data extraction process by comparing data records with the original publications. Any discrepancies were resolved through thorough discussion. No automation tools were used. Publications that met inclusion criteria were grouped by species/IGR pair for data extraction. The following data were extracted from eligible publications:
- (1)
Bibliographical information: author names, publication year, journal of publication, etc.
- (2)
Subject: mosquito species and subspecies, if applicable (for Culex spp.).
- (3)
Intervention: methoprene or pyriproxyfen exposure to larval mosquitoes in a dose/concentration-response bioassay including corrected mortality and probit regression.
- (4)
Outcomes: inhibition of emergence concentration point values (IE50, IE90, and/or IE95 values) as well as any uncertainty estimates, if available (95% CI, SD, SE, etc.).
All inhibition of emergence reference values were converted from their published units (ppb, µg/L, mg/L, etc.) to parts-per-million (ppm ±95% CI) and then Log
10 transformed to stabilize variance prior to statistical analysis. We chose ppm to maintain consistency across studies and facilitate comparisons, as it is commonly used in larvicide efficacy research. While WHO guidelines often use µg/L, ppm is functionally equivalent (1 ppm = 1 mg/L = 1000 µg/L) and allows for uniformity in our meta-analysis without altering result interpretation. Confidence intervals extracted from the literature were also transformed into Log
10 and used to estimate the SD for each IE value. When reported, SE was converted to SD. For publications that lacked reported uncertainty measurements (CI, SD, or SE), the SD was imputed by multiplying the Log
10(SD) to Log
10(IE) ratio for complete studies by the Log
10(IE) value of incomplete studies (those studies requiring an approximated SD) following the method outlined in [
25]. Imputed SDs were used for all further analyses for studies that did not include them.
2.5. Statistical and Sensitivity Analyses
The conversion of concentrations, Log
10 transformations of data, and imputation of standard deviations (SDs) were performed using Microsoft Excel (Microsoft Inc., Redmond, WA, USA). Statistical analyses, including publication bias assessments (funnel plot and Egger’s regression), heterogeneity assessments, and sensitivity analyses, were conducted using the Meta-Essentials: Excel Workbooks for Meta-analysis tool [
26].
The
Cx. pipiens complex mosquitoes (
quinquefasciatus, pipiens, and
pallens) were analyzed in Meta-Essentials using an Analysis of Variance (ANOVA) test to determine if these subspecies groups were significantly different or if they could be treated as a single group for the purposes of computing an overall effect size. Heterogeneity was evaluated both within and across publications using Cochran’s Q, I
2, T
2, and T for all subgroups with more than 3 publications (16 out of 18 species/IGR/IE pairings). Descriptive statistics (minimum, maximum, interquartile range, median, and geometric mean with ± 95% confidence intervals) for each species/IGR/IE value pairing were generated using GraphPad Prism version 10 (GraphPad Software, Boston, MA, USA). Extracted data (IE
conc ± 95% CI) for each species/IGR/IE value pairing were made into a forest plot (
Supplemental Figures S1–S6).
The overall effect size (composite IE values) for each subgroup/IGR pair/IE value was determined using a random-effects model in the Meta-Essentials Excel Workbook. This method calculates a combined effect size using inverse variance weighting and incorporates between-study variance through the DerSimonian–Laird (DL) estimator [
26,
27]. Ninety-five percentile confidence intervals for the DL combined effect values were calculated using a weighted variance methodology [
28,
29]. The DL combined effect value was calculated for each species (
Cx. pipiens complex,
Ae. aegypti, and
Ae. albopictus), each reference IE value (IE
50, IE
90, and IE
95), and each IGR (methoprene or pyriproxyfen), resulting in a total of 18 DL combined effect IE values with corresponding 95% confidence intervals.
To assess the robustness of the DL combined effect susceptible reference values, three sensitivity analyses were performed: (1) A ROUT outlier test [
30] was applied to all species/IGR/IE pairings on log
10 transformed values, using a Q value corresponding to a 1% false discovery rate. Identified outliers were removed, and the DL combined effect value was recalculated to assess their influence. (2) To evaluate potential systematic bias from studies requiring imputed confidence intervals, a second sensitivity analysis was conducted by excluding all values from such studies and recalculating the DL combined effect value. (3) The individual weights of each study used for the DL method were calculated and qualitatively assessed for homogeneity. (4) A geometric mean with 95% CIs was calculated for each species/IGR/IE value to compare against the DL inverse variance weighting methodology, providing an alternative measure of central tendency.
All DL combined effect values (
n = 18) were assessed for certainty using a modified GRADE approach [
31]. Risk of bias and indirectness were considered minimal for each subgroup since all included studies followed WHO protocols, and this meta-analysis focuses exclusively on control values from previous literature. DL combined effect values were downgraded if they exhibited high heterogeneity (I
2 > 75%) and/or if their upper 95% confidence interval exceeded three times the DL combined effect value. If Egger’s regression indicated publication bias within a subgroup pairing, the certainty of the DL combined effect value was downgraded by one level accordingly. In the final analysis, the DL combined effect susceptible values were compared to the original published IE values to calculate a resistance ratio (published IE
50 value/DL combined effect IE
50 value). This analysis aims to identify the number and percentage of publications that may have inadvertently used potentially resistant mosquitoes as susceptible references.