1. Introduction
The human oral microbiome represents a highly dynamic and complex ecological ecosystem comprising hundreds of microbial species that play a pivotal role in maintaining local homeostasis and systemic immunity [
1]. Oral dysbiosis, defined as a pathological imbalance in the relative abundance of microbial communities, has been proposed as a key contributor to the initiation and progression of oral squamous cell carcinoma (OSCC) [
1,
2]. The International Agency for Research on Cancer classifies 10 microbial species, including
Helicobacter pylori,
Hepatitis B virus,
Hepatitis C virus, and
Human papillomavirus, driving 90% of infection-associated cancers [
3]. In the oral cavity, periodontal pathogens, including
Fusobacterium nucleatum,
Prevotella melaninogenica,
Prevotella intermedia, and
Prevotella jejuni, are overrepresented in salivary samples from patients with OSCC [
1,
4,
5]. Several studies have reported alterations in the oral microbiota of patients with OSCC; however, substantial heterogeneity in study design, patient characteristics, sampling procedures, sequencing methodologies, and analytical approaches has limited the identification of a consistent disease-specific microbial signature. Furthermore, the biological interpretation of treatment-associated microbiome changes remains challenging because of the potential influence of multiple clinical and perioperative factors. In this context, saliva has emerged as an encouraging diagnostic biofluid, encompassing a diverse reservoir of molecules indicative of oral pathological conditions.
In the last 15 years, oncogenomics advancements in next-generation sequencing technologies and liquid biopsy is shaping a novel approach for the management of cancer patients [
6]. Despite the growing evidence supporting an association between oral dysbiosis and OSCC onset, it is still unclear whether microbial alterations precede the disease or are a consequence of it. For this reason, salivary analysis is emerging as a promising, non-invasive tool for the dynamic monitoring of disease onset and progression, as well as for monitoring microbiota-related changes over time [
2,
5,
6]. Surgical treatment is accompanied by multiple changes in the oral environment, including tissue removal, wound healing processes, inflammation, modifications in salivary flow, alterations in oral hygiene practices, dietary adaptations, and exposure to perioperative medications. These factors may collectively influence oral microbial communities, making the interpretation of longitudinal microbiome dynamics particularly challenging [
7]. Characterizing longitudinal microbiome dynamics in patients undergoing surgical treatment may contribute to a better understanding of how oral microbial communities vary during the perioperative period and may help generate hypotheses for future biomarker-oriented investigations.
This exploratory pilot study aimed to longitudinally characterize salivary microbiota profiles in patients with OSCC before and after tumor resection using Oxford Nanopore MinION sequencing platform.
3. Discussion
The present single-center longitudinal pilot study explored salivary microbiota profiles in patients with OSCC before and after tumor resection using Oxford Nanopore MinION platform. The primary finding of this study was the detection of longitudinal shifts in microbiota composition and alpha diversity following surgical resection. Given the exploratory design, limited sample size, and the absence of several potentially relevant perioperative variables, these findings should be interpreted as hypothesis-generating observations rather than evidence of microbiome alterations directly attributable to surgical treatment.
To the best of our knowledge, this is the first longitudinal study employing Oxford Nanopore MinION platform sequencing to characterize salivary microbiota profiles in OSCC patients before and after tumor resection. Compared with short-read platforms, ONT provides long-read sequencing capabilities that may facilitate high-resolution taxonomic profiling and represent a promising approach for future microbiome investigations.
To date, only one study has previously analyzed the salivary microbiome profiles of oral cancer patients before and after treatment using Illumina MiSeq System [
5].
Given the methodological differences reported in the literature, unstimulated whole saliva has been selected as the most suitable and reproducible matrix for microbiome analysis [
12,
13].
In the present study, a statistically significant abundance of
Aggregatibacter segnis and
Aggregatibacter sp.
2125159857 was observed in OSCC samples compared to OSCC-free reference cohort. The association between periodontal pathogens and oral carcinogenesis has been proposed and investigated for several years. [
6,
8]. The increased detection frequency of
Aggregatibacter species in OSCC samples is consistent with previous observations linking periodontal dysbiosis and OSCC [
6,
9,
10]. However, the present data do not allow conclusions regarding causality, biological function, or mechanistic involvement in oral carcinogenesis.
The OSCC-free reference cohort included both healthy individuals and patients with OPMDs without histopathological evidence of epithelial dysplasia. The inclusion of these patients was intended to provide a broader clinical context for descriptive comparisons rather than to represent a purely healthy control population. Nevertheless, because OPMDs may already exhibit microbiome alterations independently of malignant transformation, these comparisons should be interpreted with caution and not as evidence of disease-specific microbial differences [
10,
11].
Statistically significant differences were observed in OSCC patients before and after surgical treatment. In OSCC patients before surgical therapy, an increase of
Neisseria subflava,
Treponema sp.
OMZ 838,
Leptotrichia buccalis,
Veillonella sp.
S12025-13, and
Candidatus Minimicrobia vallesae were observed. Among them,
Neisseria has been previously reported to be involved in oral alcohol-related carcinogenesis due to its ability to produce acetaldehyde via alcohol dehydrogenase, suggesting a possible link with alcohol-related risk factors [
8,
13]. Moreover,
Leptotrichia buccalis has been identified in cancer patients following high-dose chemotherapy and hematopoietic stem cell transplantation, particularly in cases with oral mucositis [
14,
15].
Leptotrichia buccalis is considered an opportunistic bacterium and has been associated with infections in immunocompromised patients. In agreement with our findings, in the only other study performed by Mäkinen et al.,
Leptotrichia buccalis was significantly more abundant in the samples collected before surgical therapy compared to after surgical therapy [
5].
Moreover, they also reported an abundance of
Actinomyces odontolyticus,
Streptococcus sanguinis,
Veillonella rogosae,
Fusobacterium nucleatum vincentii,
Capnocytophaga leadbetterii,
Abiotrophia defectiva, Lautropia mirabilis,
Solobacterium moorei,
Porphyromonas endodontalis,
Mogibacterium diversum/neglectum/pumilum/vescum,
Leptotrichia buccalis, and
Streptococcus sp. in pre-surgical samples compared to post-surgical samples [
5].
A significant increase of Glaesserella parasuis, Mogibacterium neglectum, Segatella oris, Prevotella herbatica, Streptococcus parasuis, Streptomyces anulatus, Leptotrichia trevisanii, and Escherichia coli were observed in OSCC patients after surgical treatment. Escherichia coli, a facultative opportunistic pathogen, has been associated with dysbiotic conditions and may reflect alterations in the oral ecological niche.
Interestingly,
Streptomyces species are known producers of bioactive compounds, although their role in the oral microbiome remains poorly defined [
16]. Its increased abundance in post-surgical samples may hypothetically be associated with changes in microbial community composition; however, no functional conclusions can be drawn from the present observational data.
In the study performed by Mäkinen et al.,
Lactobacillus casei/paracasei/rhamnosus and
Actinomyces gerencseriae were significantly more abundant compared to the pre-surgical samples [
5].
Notably, also in our study, a prevalence of Bacilli (e.g., Lactobacillus) was observed in the OSCC-free reference group and OSCC patients after surgical treatment compared to OSCC patients before surgical treatment.
Notably, an increased abundance of
Bacilli, including
Lactobacillus species, was observed in post-surgical samples and in the OSCC-free reference cohort. While
Lactobacillus is commonly associated with beneficial effects on oral microbial balance, the clinical implications of this finding remain unclear in the context of OSCC and were not directly investigated in this study [
17,
18,
19]. Therefore, the present findings should be interpreted as observational associations rather than evidence of a causal or therapeutic role. Furthermore, the increased abundance of
Lactobacillus species observed in post-resection samples may reflect changes occurring during the perioperative period rather than effects specifically attributable to surgery itself.
According to our findings, Crispino et al. observed the diversity of microbial profiles across different stages of OSCC, underscoring the intricate nature of the oral microbial ecosystem [
20].
Several studies have proposed associations between oral microbial dysbiosis and OSCC development, including inflammatory, immunomodulatory, and metabolic pathways. However, the extent to which specific microorganisms contribute to oral carcinogenesis remains uncertain, and causative relationships have not been conclusively established [
2,
21,
22].
However, the precise mechanisms through which the oral microbiota contributes to OSCC pathogenesis and progression remain to be fully elucidated. Moreover, the development of internationally accepted standard procedures for saliva collection and analysis is essential to enable more conclusive and clinically relevant comparison across studies [
23].
Another important aspect to consider is the potential influence of smoking on oral microbiome composition. Previous studies have shown that smoking can affect specific bacterial groups, including
Gammaproteobacteria,
Betaproteobacteria, and
Flavobacteria. In particular, Wu et al. reported that
Betaproteobacteria,
Gammaproteobacteria, and
Flavobacteriia were inversely associated with the number of cigarettes smoked per day and positively associated with years since smoking cessation [
24]. Similarly, Liang et al. observed that smoking reduced oral microbial diversity, with decreased abundance of
Bacteroidetes,
Proteobacteria, and
Lactobacillus, and increased abundance of
Staphylococcus [
25].
In our cohort, four OSCC patients were current smokers, and two reported both smoking and alcohol use, whereas only one individual in the OSCC-free reference group was a smoker, suggesting a potential imbalance in lifestyle-related factors. To further explore this aspect, potential confounders, including age, sex, smoking, and alcohol consumption, were evaluated in relation to the identified microbiome clusters. No apparent enrichment of these variables was observed across clusters (
Supplementary Files); however, given the limited sample size, these analyses should be considered purely descriptive. Therefore, the absence of detectable enrichment should not be interpreted as evidence that potential confounding effects are absent, and residual confounding cannot be excluded. The paired pre- and post-surgery design may reduce the influence of stable individual factors, although it does not fully account for potential confounders.
Overall, this study provides preliminary evidence that salivary microbiota profiles differ between samples collected before and after tumor resection in patients with OSCC. However, the biological significance, clinical utility, and mechanistic basis of these observations remain uncertain. Future multicenter studies incorporating larger cohorts, standardized perioperative data collection, oral health indices, dietary assessment, and longitudinal follow-up will be necessary to determine whether salivary microbiome profiling can contribute meaningfully to OSCC monitoring and biomarker development.
Strengths and Limitations
This study has several strengths and limitations that should be considered when interpreting the findings. A key strength is the paired pre-/post-intervention design within the same OSCC patients, which reduces inter-individual variability and allows the assessment of longitudinal microbiome changes. In addition, the application of ONT sequencing represents an innovative and relatively underexplored approach for high-resolution profiling of the salivary microbiome in oral oncology.
The relatively small sample size represents a limitation of this study and restricts the statistical power to detect subtle microbiome differences, as well as the ability to fully control for potential confounding factors. Moreover, no formal a priori power calculation was performed due to the exploratory design and the lack of comparable longitudinal studies using the Oxford Nanopore Technology platform in this clinical context. Therefore, the findings should be interpreted as preliminary and hypothesis-generating.
Importantly, several factors, such as perioperative antibiotic exposure, inflammatory responses, and environmental changes in the oral cavity following surgery, may act as significant confounders. As these variables were not controlled analytically, their independent effects on the microbiome cannot be disentangled from those of the surgical intervention. Relevant variables such as dietary habits and standardized oral health indices (e.g., DMFT, PSR) were not systematically collected, and residual confounding from lifestyle and clinical factors cannot be excluded.
While the cohort’s geographic and ethnic homogeneity (Italian/Sicilian participants) may reduce intra-group variability, it also limits the generalizability of the findings and precludes the evaluation of population-specific microbiome differences. Larger, multicenter studies across diverse populations are warranted to confirm and extend these observations.
4. Materials and Methods
4.1. Ethics Statement
The study protocol conformed to the ethical guidelines of the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. The study was approved by the institutional review board of the “Paolo Giaccone” Policlinic University Hospital in Palermo (Italy) (approval #11/2020). Written informed consent was obtained from all participants involved in the study. The study reported was assessed following the STROBE guidelines for observational studies [
26].
4.2. Population Recruitment
The subjects were recruited from the Unit of Oral Medicine at the “Paolo Giaccone” Policlinic University Hospital in Palermo (Italy), from December 2022 to May 2024. The patients were selected based on the following inclusion criteria:
Age older than 18 years;
Patients with a histological diagnosis of OSCC before and after surgical treatment;
The localization of OSCC is confined exclusively to the oral cavity, identified based on the 2024 NIH/SEER ICD-0-3.2 topographic classification codes, as detailed below:
Mobile tongue (including ventral/lateral tongue) (C02.0-C02.1-C02.2-C02.3, C02.8, C02.9);
Gingiva (including upper/lower gum and retromolar area) (C03.0, C03.1, C03.9, C06.2);
Hard palate (C05.0);
Buccal mucosa (C06.0, C06.1);
Mouth floor (C04.0, C04.1, C04.8-C04.9).
No previous history of malignancy or therapeutic intervention in the head and neck areas;
Capacity to give informed consent.
Patients were excluded if they were pregnant or breastfeeding, had undergone antibiotic treatment or periodontal care within the past three months, were diagnosed with severe or advanced stages of periodontitis, or had any immunocompromising conditions [
27,
28].
After applying the inclusion and exclusion criteria, 26 participants were included in the study, comprising 16 patients with histologically confirmed OSCC and 10 OSCC-free controls (5 healthy individuals and 5 patients with OPMDs). Salivary samples were obtained from 16 patients diagnosed with OSCC, both before and after surgical treatment, and 10 individuals without OSCC. Among the latter group, 5 patients presented with OPMD, including oral leukoplakia (2/5, 40%) and oral lichen planus (3/5, 60%)—collectively designated as the disease control group—while the remaining 5 were healthy individuals without evidence of dysplasia, comprising the healthy control group.
All enrolled participants completed the study protocol, and paired saliva samples were successfully collected from all OSCC patients before and after surgery. No participants were lost to follow-up after enrollment.
To confirm the diagnosis of OSCC, a histopathological examination was undertaken. After local anesthesia, an incisional biopsy was performed at the Unit of Oral Medicine at the “Paolo Giaccone” Policlinic University Hospital in Palermo. The section from one sample was fixed in formalin solution and sent to the pathology laboratory for histopathological assessment. If the diagnosis of OSCC was confirmed, an unstimulated whole salivary sample was collected. Then, patients were referred to the multidisciplinary unit for treatment. At a routine postoperative follow-up visit, scheduled no earlier than 1 month after tumor resection, a second unstimulated whole saliva sample was collected. Because sample collection was integrated into routine clinical follow-up, the exact postoperative interval was not fully standardized across patients.
Importantly, post-surgical saliva samples were collected before the initiation of any adjuvant therapies (e.g., chemotherapy, radiotherapy), thereby minimizing their potential influence on the observed microbiome changes. Detailed perioperative information regarding antibiotic regimens, postoperative infections, surgical complications, dietary modifications, and oral hygiene changes was not systematically available for all patients and was therefore not included in the analytical models.
An OSCC-free reference group comprising healthy individuals and patients with oral potentially malignant disorders (OPMDs) was additionally recruited to provide contextual comparisons. Given the limited sample size and biological heterogeneity of this cohort, these comparisons were considered descriptive and exploratory.
Given the exploratory nature of this pilot study and the lack of prior longitudinal investigations using Oxford Nanopore Technology in OSCC patients, no formal a priori sample size calculation was performed. The study was primarily designed to generate preliminary data and assess the feasibility of this sequencing approach in a clinical setting.
4.3. Outcome Measures
The following information was collected for each patient: demographic characteristics, anatomical site of the OSCC lesion based on the International Classification of Diseases (ICD, 11th edition), TNM stage (9th version) according to the guidelines of American Joint Committee on Cancer (AJCC) and the International Union Against Cancer (UICC) [
29], smoking habits, alcohol consumption, mechanical risk factors (such as ill-fitting dentures or sharp tooth cusps), follow-up duration, and recurrence data. Participants were classified based on their smoking behavior as never smokers, current smokers, or former smokers. In terms of alcohol intake, they were grouped into non-drinkers, moderate consumers (less than 16 units per week), or heavy consumers (16 or more units per week).
4.4. Sample Collection
Preoperative saliva samples were collected before the diagnostic incisional biopsy. Patients were enrolled in the study only after histopathological confirmation of OSCC. Unstimulated whole saliva samples were collected from each participant in the morning according to standardized saliva collection procedures previously described in the literature [
2,
4]. Participants were instructed to refrain from eating, drinking, or smoking for at least 2 h before sample collection and to rinse their mouths with sterile saline for 60 s before collection. Saliva was allowed to pool on the floor of the mouth and was subsequently collected into sterile Falcon tubes, which were immediately stored at −80 °C until further analysis.
4.5. DNA Extraction and Sample Sequencing
DNA extraction was performed as described by Mauceri et al. in a previous study [
4]. No additional mechanical lysis step (e.g., bead-beating) was included in the extraction protocol. Therefore, taxa characterized by more resilient cell wall structures may have been differentially represented, potentially affecting DNA recovery efficiency and relative abundance estimates. Genomic DNA libraries were prepared using Rapid Sequencing DNA–PCR Barcoding Kit 24 V14 (Oxford Nanopore Technologies, Oxford, UK) (SQK-RPB114.24, protocol version RPB_9191_v114_revC_17Sep20-ONT) according to the manufacturer’s instructions. Briefly, a transposase-based reaction was used to simultaneously fragment the DNA and attach sequencing tags to fragment ends. Rapid Sequencing Adapters were subsequently ligated to the tagged ends before loading onto the flow cell [
30].
Basecalling was performed using MinKNOW version 20.06.4 (Oxford Nanopore Technologies, Oxford, UK), while quality control and taxonomic classification were conducted via the EPI2ME platform (v.2.11.0, WIMP pipeline).
Briefly, each sample contained 5 ng of DNA in 3 μL of nuclease-free water. DNA tagmentation was performed in a single step by incubating the samples at 30 °C and 80 °C for 1 min each in the fragmentation mix (FRM). For 4 ng of tagmented DNA, 1 μL of Rapid Barcode Primer (10 μM; Oxford Nanopore Technologies, Oxford, UK) and 25 μL of LongAmp® Hot Start Taq 2× Master Mix (New England Biolabs, Ipswich, MA, USA), and nuclease-free water were added to reach a final volume of 50 µL.
The prepared mix was amplified under the following cycling conditions: initial denaturation at 95 °C for 3 min, followed by 14 cycles of 95 °C for 15 s, 56 °C for 15 s, 65 °C for 6 min, and a final extension at 65 °C for 6 min. The amplified DNA was then purified using Agencourt AMPure XP beads (Beckman Coulter Life Sciences, Indianapolis, IN, USA) (1 × concentration) and eluted in 10 μL of freshly prepared T50 buffer. DNA concentration was measured using a Qubit™ 3 Fluorometer (Thermo Fisher Scientific, Waltham, MA, US), and fragment size distribution was assessed with a 2100 Bioanalyzer (Agilent Technologies, Santa Clara, CA, USA) using the DNA 12000 Kit (Agilent Technologies, Santa Clara, CA, USA) according to the manufacturer’s instructions.
Barcoded DNA was pooled to a final concentration of 100 fmol in 10 μL of T50 Buffer (Oxford Nanopore Technologies, Oxford, UK). Adapter ligation was performed by adding 1 µL of Rapid Adapter (Oxford Nanopore Technologies, Oxford, UK).) and incubating for 5 min at room temperature. Library preparation and sequencing were carried out on a MinION Flow Cell R10.4.1 (FLO-MIN114; Oxford Nanopore Technologies, Oxford, UK) connected to a MinION Mk1B device (Oxford Nanopore Technologies, Oxford, UK), following the manufacturer’s instructions. The sequencing run lasted up to 48 h using MinKNOW in live basecalling mode with default parameters, generating barcoded FASTQ files. Sequencing data were deposited in the NCBI SRA database under PRJNA1246956. Metagenomic analysis was performed using the EPI2ME Desktop Bioinformatics Tool version 5.2.3. The study reports, generated as a wf-metagenomics-report.html file, reporting sequencing information such as average reads/bases per sample, read length distribution and others, are available as
Supplementary File S1. Patient metadata and analyzed count matrices are available in
Supplementary File S2.
Negative extraction controls (blank samples) were included in all sequencing runs except for Run V, due to logistical constraints. These blanks contained very low microbial read counts and were therefore excluded from the downstream analysis. Running the prevalence method of the Decontam R package (v. 1.30.0), we did not identify contaminants.
4.6. Bioinformatics and Statistical Analysis
Given the pilot nature of the study and the limited sample size, all inferential analyses should be considered exploratory and hypothesis-generating. ONT is a portable DNA sequencing device that connects directly to a laptop via USB. The device contains an array of protein nanopores immersed in a high-salt buffer. During sequencing, an electrical potential is applied, generating an ionic current through the nanopores. As each DNA strand passes through a nanopore, the corresponding current signal is recorded and saved as an individual file on the connected computer. The MinKNOW software (version 20.06.4, Oxford Nanopore Technologies, Oxford, UK), monitors this folder and performs local basecalling.
Processed reads can then be automatically uploaded to the EPI2ME cloud platform for downstream taxonomic classification through the what’s in my pot (WIMP) workflow available through the EPI2ME cloud platform (Oxford Nanopore Technologies, Oxford, UK; accessed June 2021).
WIMP identifies microbial species in real time using a pre-built data structure shared across all runs. This structure is based on taxonomy and a reference database. It links every 24-mer in the database to a specific node in the NCBI taxonomy tree [
31].
Thanks to this pre-processing, new reads can be classified quickly by matching their kmers to the pre-built structure, instead of aligning them to the full reference sequences. During sequencing, the Metrichor agent uploads reads, performs basecalling, and classifies each read using the WIMP model [
13]. WIMP relies on the Kraken algorithm to map kmers, compute the Least Common Ancestor (LCA), and determine the most likely taxonomic placement. Each placement receives a classification score, which represents the fraction of kmers assigned to the LCA within the corresponding taxonomic clade. A higher score indicates a more confident classification [
31]. The WIMP bacterial, viral, and fungal identification module uses a reference database including all RefSeq genomes from these domains. Organisms can be identified to the subspecies or strain level only if that level is represented in the database. If not, the report assigns them to a higher taxonomic rank, such as species or genus [
31]. To prevent the batch effect from influencing the clustering analysis results, the row count matrix was transformed using the ConQuR R package (v. 2.0) [
32]. Hierarchical clustering was performed on the batch-adjusted count matrix. The Bray–Curtis metric was used to calculate the distance among patients, and the Ward-D2 aggregation method was used to build the dendrogram through the function hclust from the stats R package (v. 4.50). Specific taxa associated with each study group were first identified using Venn diagrams to visualize shared and unique taxa across conditions. Subsequently, an enrichment analysis based on Fisher’s exact test was performed to assess whether the occurrence of specific taxa in post-surgical compared with pre-surgical OSCC samples was statistically significant. The microbiome differential abundance analysis between pre- and post-treatment groups was performed by applying the ancombc2 function of the ANCOMBC R package (v. 3.22) to the original count matrix [
33]. To account for the presence of batch effects and paired samples, the patient group and batch variable were considered as fixed effects, while the patients were considered as random effects.
p-values from the differential abundance analysis were adjusted for multiple comparisons using the Benjamini–Hochberg method, and adjusted
p-values < 0.05 were considered statistically significant. The algorithm performs an automatic sensitivity analysis. Taxa that do not pass this analysis are marked in the “passed_ss” column as FALSE and are treated as non-significant. The log-abundance matrix generated by the ANCOM-BC software (v. 3.22) was examined to verify the absence of anomalies in the algorithm’s output. Alpha diversity was assessed by calculating three commonly used indices: richness, Shannon’s index, and inverse Simpson’s index. The indices were computed manually based on the batch-adjusted relative abundance tables and visualized using boxplots. Differences in diversity between groups were evaluated using a bootstrap
t-test, which accounted for the limited sample size and non-normal data distribution, and
p-values < 0.05 were considered statistically significant. Analyses were performed at multiple taxonomic levels, including species, genus, family, class, and phylum, to provide a comprehensive assessment of microbial community composition. Results obtained at each level are reported in the
Supplementary Files, offering a detailed and interpretable description of differential abundance patterns across taxa. All statistical analyses and graphical representations have been performed using R statistical software v4.5.0.
Comparisons involving the OSCC-free reference cohort were interpreted descriptively because the cohort included both healthy individuals and patients with OPMD, resulting in a biologically heterogeneous reference population. Consequently, the primary analytical focus was placed on the longitudinal within-patient comparison between pre- and post-surgical samples.
Because several clinically relevant variables potentially influencing oral microbiota composition (including perioperative antibiotic exposure, postoperative complications, oral hygiene modifications, dietary changes, salivary flow alterations, and Candida colonization) were not systematically available, these factors were not included as covariates in the statistical models. Consequently, the analyses were designed to characterize longitudinal microbiome dynamics rather than establish causal relationships between surgery and microbiome changes.