Next Article in Journal
Special Issue “Lignocellulosic Biomass”
Next Article in Special Issue
Structure of Nanobody Nb23
Previous Article in Journal
Preparation of Cellulose/Laponite Composite Particles and Their Enhanced Electrorheological Responses
Previous Article in Special Issue
Swapping the Positions in a Cross-Strand Lateral Ion-Pairing Interaction between Ammonium- and Carboxylate-Containing Residues in a β-Hairpin
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Patterns in Protein Flexibility: A Comparison of NMR “Ensembles”, MD Trajectories, and Crystallographic B-Factors

Department of Chemistry, College of Science and Health, William Paterson University, 300 Pompton Rd, Wayne, NJ 07470, USA
*
Author to whom correspondence should be addressed.
Molecules 2021, 26(5), 1484; https://doi.org/10.3390/molecules26051484
Submission received: 31 December 2020 / Revised: 18 February 2021 / Accepted: 28 February 2021 / Published: 9 March 2021

Abstract

:
Proteins are molecular machines requiring flexibility to function. Crystallographic B-factors and Molecular Dynamics (MD) simulations both provide insights into protein flexibility on an atomic scale. Nuclear Magnetic Resonance (NMR) lacks a universally accepted analog of the B-factor. However, a lack of convergence in atomic coordinates in an NMR-based structure calculation also suggests atomic mobility. This paper describes a pattern in the coordinate uncertainties of backbone heavy atoms in NMR-derived structural “ensembles” first noted in the development of FindCore2 (previously called Expanded FindCore: DA Snyder, J Grullon, YJ Huang, R Tejero, GT Montelione, Proteins: Structure, Function, and Bioinformatics 82 (S2), 219–230) and demonstrates that this pattern exists in coordinate variances across MD trajectories but not in crystallographic B-factors. This either suggests that MD trajectories and NMR “ensembles” capture motional behavior of peptide bond units not captured by B-factors or indicates a deficiency common to force fields used in both NMR and MD calculations.

Graphical Abstract

1. Introduction

Large molecules and biomolecules can have a high degree of motional flexibility, affecting their function [1]. Common sources of information about protein flexibility and modes of motion include crystallographic B-factors [2], molecular dynamics (MD) simulations [3], and Nuclear Magnetic Resonance (NMR) spectroscopy, including relaxation measurements [4,5,6,7] and even chemical shift data [8,9].
Each of the above techniques for evaluating protein flexibility yields an incomplete picture of protein dynamics in solution. Crystallographic B-factors are affected by packing and other special features of the crystalline state [10]. In addition, many factors may reduce the intensities of the “reflections” in a protein crystal’s X-ray diffraction pattern, and, hence, elevated crystallographic B-factors that may not solely indicate macromolecular flexibility [11]. The quality of MD simulations is dependent on the quality of the seed structure and force field used, despite recent efforts applying MD simulations to NMR-derived structures [12]. NMR relaxation experiments provide a critical source of data for evaluating individual MD trajectories as well as the force fields and other methodological details of MD simulations [13,14]. The combination of multiple assessments of protein flexibility has proven particularly illuminating [15]. For example, the combination of NMR-relaxation data with MD simulations yields a detailed picture of protein dynamics and motional modes [16].
While lacking a universally accepted analog of the B-factor, the NMR-based structure determination process itself provides insight into protein flexibility. Atoms in loop residues and other flexible regions of a protein typically have fewer long-range “contacts” to atoms in other residues. This paucity of contacts leads to both increased flexibility of loop regions [17,18] as well as poor convergence for loop residue positions in NMR-based structure calculations [19,20,21,22], provided the structure refinement process does not lead to inaccurate rather than imprecise coordinates [23]. Moreover, the primary source of structural restraints in NMR-based structure calculations are NOESY (Nuclear Overhauser Effect Spectroscopy) experiments. Fast motions reduce NOEs while intermediate time scale motion causes line broadening that can interfere with the identification of NOESY cross-peaks. Thus, NMR yields a paucity of restraints for particularly flexible regions of a protein leading to poor convergence in NMR-based structure determination, and coordinate uncertainties in an NMR-derived “ensemble” of structures [24]. While, strictly speaking, such coordinate uncertainties measure the local reproducibility of the NMR-based structural determination process, coordinate uncertainties across NMR ensembles are highly correlated to coordinate variances across MD trajectories [25].
While they can provide key insights into protein flexibility and dynamics, evaluation of uncertainties in protein structure coordinates inferred from NMR data is a non-trivial and non-physical process. Typically, NMR-based structure calculations generate multiple (typically 10–40) models [22]. Such collections of structural models are called “ensembles”. Although NMR ensemble generation can effect Boltzmann sampling [19,20,21], generally NMR ensembles, including those analyzed in this study, are not actually Boltzmann ensembles.
Calculation of coordinate variances requires the superimposition of NMR ensembles. However, inclusion of poorly converged coordinates can bias the superimposition process, reducing the applicability of the resulting coordinate variances [26,27]. Limiting the calculation of an optimal superimposition to a core atom set, determined in a superimposition independent manner using either circular variances of backbone dihedral angles [28] or an interatomic variance matrix [27,29], ensures calculation of optimal superimpositions and, hence, of appropriate coordinate uncertainties. Alternatively, assumptions concerning the distribution of coordinate variances can lead to model-based superimposition methods such as THESEUS, which assumes a multivariate Gaussian distribution of coordinate uncertainties [30,31].
Identification of a core atom set is a critical step in solving two distinct, albeit related, problems. Not only does identification of a core atom set an important step in calculating coordinate uncertainties via superimposition, but such a core atom or residue sets also convey in which regions the NMR-based structure calculation process has converged [22]. Since these two problems are different, their optimal solutions may differ slightly. For example, application of the FindCore method, which identifies core atom sets for use in assessing the precision of NMR ensembles, to the distinct, albeit related problem of identifying well-converged core atom sets for CASP10 [32,33], required extension of the FindCore method into an approach known as Expanded FindCore [22].
Software used in the CASP10 competition also required any residue with core atoms to have all backbone heavy atoms in the core. The process of modifying Expanded FindCore to meet this requirement revealed carbonyl oxygens from otherwise well-defined residues whose positions were poorly defined in NMR-based structural calculations. Given the relation between coordinate uncertainties in NMR-derived structures and physical flexibility as described above, this discovery raised questions about the high uncertainties (relative to other backbone heavy atoms in the same residue) of those carbonyl oxygens. How common are these relatively uncertain carbonyl oxygens and is this high relative uncertainty an artifact of the NMR-based structure determination process or is it indicative of a pattern in backbone atom flexibilities?
Addressing these questions requires a comparison of NMR ensembles with complementary structural information, such as that obtained from crystallographic data, as well as with MD trajectories that provide insight into protein flexibility. Protein structures obtained by the North East Structure Genomics (NESG; http://www.nesg.org/ accessed on 31 December 2020) consortium facilitated this analysis. The NESG performed crystallization and HSQC (Heteronuclear Single Quantum Coherence Spectroscopy) screening in parallel for robustly expressed protein targets resulted in more than 40 NMR/X-ray crystal structural pairs [34,35].
The analysis presented here demonstrates the persistence of a pattern in coordinate variances across structural “ensembles” obtained using multiple force fields, superimposition techniques, and sampling schemes (i.e., restrained, simulated annealing and similar schemes in NMR structural refinement vs. the unrestrained constant temperature approach used in MD). This persistent pattern does not necessarily occur in Crystallographic B-factors of backbone heavy atoms. That the relatively high uncertainty of carbonyl oxygens persists, in almost all MD trajectories simulated in this study, indicates that the relatively high uncertainty of carbonyl oxygens is not solely an artifact of NMR-based structural determination. The pattern in backbone heavy atom coordinate uncertainties reflects either a physical reality of peptide bond motion not evident in crystallographic data or a shortcoming common to multiple force fields. If the latter explanation is true, the analysis presented here underscores that further improvements in force field parameterization are necessary for better prediction and calculation of a protein structure and dynamics.

2. Results and Discussion

Figure 1 illustrates how coordinate uncertainty in NMR-derived “ensembles” (panel B) tracks coordinate variance in MD simulations (e.g., at 300 K in panel D). The position of the carbonyl oxygen atom in residue 42 varies both across structural models in the NMR ensemble and over MD trajectories (panels C and D), and this oxygen atom is splayed more than the carbonyl carbon to which it is attached in panels B–D. However, the crystallographic B-factor for this carbonyl oxygen (22.15) is not particularly high nor is it much larger than that of the carbonyl carbon (21.83). Meanwhile, on the opposite side of that peptide bond’s plane, the amide nitrogen from residue 43 is relatively well superimposed in the NMR ensemble and MD trajectory. The motion of the peptide plane appears to pivot around the amide nitrogen and proton. However, in the crystallographic structure, the B-factor (21.47) is barely lower than that of the carbonyl atoms.
Application of Friedman’s test [36] to coordinate uncertainties (Figure 2, first two columns), ranked from lowest to highest on a per-residue basis, of NMR structures, yielded results that confirmed what was observed in the development of the Expanded Findcore method [22]. For almost all NMR ensembles considered, whether superimposed using FindCore or THESEUS, the average rank of the carbonyl oxygen (O) atoms was higher than the average ranks of the amide nitrogen (N), Cα, and carbonyl carbon (C’) atoms. In many structures, the average rank of C’ and N atoms was lower than the average rank of the Cα atoms. Average ranks (averaged on a per-structure basis) of backbone heavy atoms in THESEUS superimposed MD trajectories (Figure 2, third column) were also higher for O atoms and lower for C’ and N atoms. When analyzing crystallographic B-factors, however, average ranks did not generally vary much with the atom type (Figure 2, fourth column).
Multiple comparisons subsequent to Friedman’s test (Figure 3) indicated that, for NMR ensembles and MD trajectories, the coordinate uncertainties and, respectively, variances (as ranked on a per-residue basis) for O atoms were significantly higher than the coordinate uncertainties or variances for N and C’ atoms in almost all ensembles or trajectories explored. In many superimposed NMR ensembles, coordinate uncertainties for O atoms were also significantly higher than coordinate uncertainties for Cα atoms, and, in a few superimposed NMR ensembles, coordinate uncertainties for Cα atoms were higher than those for N and C’ atoms. In most superimposed MD trajectories, coordinate uncertainties for O atoms were also significantly higher than coordinate uncertainties for Cα atoms, but coordinate uncertainties for Cα atoms were not significantly higher than those for N and C’ atoms. However, only a few crystal structures showed any significant differences in coordinate uncertainties between atom types.
Unlike, in the case of superimposed NMR ensembles and MD trajectories, where the coordinate uncertainties or variances of backbone heavy atoms in a residue had a tendency to be lowest for N and C’ atoms and highest for O atoms, no such persistent pattern existed for crystallographic B factors. On the other hand, the pattern in coordinate variances in superimposed MD structures persisted across MD trajectories ran using different forcefields (AMBER99SB vs. OPLS) as well as temperatures (100 K vs. room temperature) and did not depend on whether the SeMET residues found in the crystal structures used to seed MD calculations were replaced with MET residues or not.
That carbonyl oxygens possess a significant tendency to have higher coordinate variances in THESEUS superimposed MD ensembles, as well as having higher coordinate uncertainties across FindCore superimposed NMR “ensembles” indicates the pattern of coordinate uncertainties observed in NMR-derived structures is not solely an artifact of the superimposition method (THESEUS vs. FindCore), not a particular force field used (AMBER and OPLS in MD simulations, CNS [37,38], and XPLOR-NIH [39] in NMR refinement), nor the particular characteristics of an NMR-based structural determination (e.g., a lack of experimentally derived restraints on carbonyl oxygen atoms). The persistence of the tendency for carbonyl oxygens to have higher coordinate variability between ensembles explored via MD simulation and NMR-derived “ensembles”, which typically consist of models resulting from replicated, simulated, annealing calculations, indicates that this tendency is not solely an artifact of the structure sampling scheme used in NMR calculations. It may be the case that NMR structures not refined using CNS or XPLOR-NIH do not generally have carbonyl oxygens with high relative coordinate uncertainties. The one unrefined structure (1XPV) analyzed in this study did have carbonyl oxygens with high relative coordinate uncertainties.
One possible explanation of the high relative carbonyl oxygen uncertainties in superimposed NMR structures and variances in MD trajectories is that forcefields do not adequately restrain the positions of carbonyl oxygens. Carbonyl oxygen atoms are known to favorably interact with aromatic rings via n-π* interactions [40,41] and also participate in hydrogen bonding, whose representation in classical forcefields is often deficient [42]. Hydrogen bonding is important in stabilizing the protein tertiary structure [43], and carbonyl oxygen atoms in regions of a secondary structure typically participate in hydrogen bonds.
Figure 4 shows that carbonyl oxygen atoms with relatively high coordinate uncertainties in NMR structures and with relatively high coordinate variances in MD trajectories occur in carbonyl oxygen atoms participating in intramolecular hydrogen bonding as well as those which are only hydrogen bonded to solvent. Nevertheless, some carbonyl oxygen atoms in a secondary structure have relatively greater coordinate variances across MD trajectories than in NMR structures. As NMR-based structure calculations typically involve additional restraints on hydrogen bonding atoms (based on H/D exchange data and/or secondary structure as established based on resonance assignments), it may be the case that MD simulations could benefit from better representation of hydrogen bonding [42] and other non-covalent interactions [41] in MD forcefields.
In addition to potentially inadequately representing quantum mechanical phenomena such as hydrogen bonding and n-π* interactions, many force fields strongly penalize any deviation of a peptide bond from planarity. In particular, requiring peptide bonds to remain planar may cause more complex motions of the amide backbone to be represented by simple rocking motions along an axis near the N–C bond axis but angled slightly toward the Cα. This motional model, by placing carbonyl oxygens furthest from the axis of motion (and Cα atoms second furthest), inappropriately represents them as being most mobile. Deficiencies in representing hydrogen bonding in force fields [42] may also be problematic when such deficiencies result in insufficient restraints on carbonyl oxygen positions. Hydrogen bonds that are important in stabilizing protein tertiary structure [43], may represent important restraints in a carbonyl oxygen position across MD trajectories just as they are in NMR-based structural determination.
It is possible that the pattern of coordinate uncertainties and variances observed, respectively, in superimposed NMR and MD ensembles actually represents internal motions of peptide bond units in proteins in the solution state. Carbonyl oxygen atoms, branching off from the main polypeptide chain, may have enhanced thermal motion relative to backbone atoms on the main chain. In fact, other atoms branching off from the main chain, including Cβ atoms and even amide protons, tend to have significantly more coordinate uncertainty in superimposed NMR ensembles and coordinate variance across superimposed MD trajectories than amide nitrogen or carbonyl carbon atoms (Figures S1–S, Supplementary Materials). However, more crystallographic structures have significantly higher Cβ B-factors, as compared to amide nitrogen B-factors by Friedman’s test, than higher carbonyl oxygen B-factors as compared to amide nitrogen B-factors.
It is often assumed that crystallographic B-factors correlate well with internal flexibility. The absence of a persistent pattern in the B-factors for backbone atoms suggests that any such pattern observed in MD trajectories and NMR “ensembles” is an artifact. However, even in an ideal case where Crystallographic B-factors arise entirely from static and dynamic disorder, these B-factors reflect protein dynamics in the crystalline state and not in the solution state [44]. Moreover, previous studies have not only shown that NMR coordinate uncertainties correlate well to coordination variances in MD trajectories but also have demonstrated that crystallization has a “flattening” effect on protein flexibility [25]. Additionally, since Debye-Waller theory attributes any reduction in diffraction pattern intensities relative to those expected given a static protein structure to localize harmonic motion, other processes that reduce diffraction pattern intensities may result in over-estimation or even under-estimation of protein flexibility [45]. Relatedly, values obtained for B-factors are dependent on the refinement techniques used in interpreting X-ray data [25].
Nevertheless, the patterns described in this paper as well as the relatively high correlations between the statistical coordinate uncertainties derived from NMR and the putatively physical coordinate variances across MD ensembles may very well indicate deficiencies common to all force fields. Fully exploring the pervasiveness of the patterns described in this paper necessitates MD simulations and analysis of NMR structures beyond the systems studied here. However, the analysis presented in this paper identifies that coordinate variances/uncertainties from at least some MD trajectories and NMR ensembles have properties not found in B-factors. This divergence between B-factors and coordinate variances potentially indicates that there remain critical concerns in force field development. Future studies of MD trajectories will hopefully reveal which potentially inaccurate aspects of force fields, such as the requirement that peptide bonds remain planar and inadequacies in the representation of non-covalent interactions, such as hydrogen bonding as well as solvent/protein interactions, need the most adjustment. Addressing such deficiencies in force field construction can result in better descriptions of protein structure and, hence, facilitate the accurate prediction of protein dynamics, structure, and folding pathways.

3. Materials and Methods

The NMR and crystallographic structures analyzed in this study consisted of all (41) NMR structures and all but one (40) crystallographic structure listed in the “community resource” described by Everett et al. [35], which also outlines standardized methods used by the NESG for solving crystallographic and NMR structures. All but one of the NMR structures (1XPV) analyzed here were refined using CNS [37,38] and/or XPLOR-NIH [39]. MD simulations were performed on a randomly selected set of 12 targets from the community resource, using the conditions indicated in Table S1, Supplementary Materials. Most simulations used the OPLS [46] forcefield, but several simulations were performed with the AMBER99SB [47,48] forcefield as well.
MD simulations were initiated using crystallographic structures retrieved from the Protein Data Bank (PDB, [49]) with the identifications (IDs) listed in Table S1, Supplementary Materials. Simulations were prepared with Schrodinger’s Maestro GUI made available as part of the Desmond [50] software package (which also ran MD simulations), using Na+ or Cl ions to achieve electrical neutrality and the TIP4PEW water model. In order to avoid artifacts due to truncation of the simulated constructs and facilitate parameterization in AMBER99SB, the terminal amino acid residues present in the coordinate sets obtained from the PDB were capped. Simulations ran for up to 36 ns (following default relaxation/minimization protocols), with snapshots recorded every 14.4 ps (up to 2500 snapshots). Re-parameterization of each simulation to use the AMBER99SB force field was performed using Desmond’s Viparr utility. Most simulations were run at room temperature (generally defined for each protein by the temperature at which NMR experiments used to solve the protein’s structure were performed. For all proteins in this study the temperature was very nearly 300 K in order to mimic the conditions in both the NMR tube and during (room temperature) crystallization. Some simulations were also performed at 100 K to mimic conditions obtained during cryo-cooled x-ray diffraction experiments. Simulations were ran both with and without substituting methionine (MET) for the seleno-methionine (SeMET) residues found in crystallographic structures. Dangling ends of protein chains absent from the crystallographic coordinates deposited in the PDB were not filled in computationally but rather were omitted from each simulation.
Initial parsing and visualization of each trajectory were performed using VMD [51]. A simple trajectory rescuer was used prior to initial parsing in VMD for simulations that turned into hung processes. Reformatting was completed for the multi-structural PDB file output from VMD into a multi-model format suitable for further analysis. THESEUS [30] superimposed MD trajectories prior to a coordinate variance calculation and the MATLAB [52] implementation of the FindCore Toolbox superimposed NMR ensembles. Calculation of coordinate uncertainties (calculated as coordinate variances) from FindCore superimposed NMR ensembles used the FindCore Toolbox and calculation of coordinate uncertainties and variances from THESEUS superimposed NMR ensembles and MD trajectories was also performed in MATLAB.
Friedman’s test [36] is a non-parametric analog of ANOVA with repeated measures used here to compare whether coordinate uncertainties, variances, and B-factors are significantly different for different atom types. Application of Friedman’s test proceeded as follows. For each residue in each structure, backbone heavy atom coordinate uncertainties, coordinate variances, or B-factors (depending on the analysis performed) were ranked (from 1–4). For each structure, the resulting ranks were tabulated with columns (treatments) corresponding to a heavy atom type (amide N, Cα, carbonyl carbon, and carbonyl oxygen) and one row (block) for each residue, and the resulting table was subjected to Friedman’s test, which compared column averages (average rank by heavy atom type, averaged on a per-structure basis). MATLAB scripts tabulated B-factor and coordinate variance/uncertainty data for analysis via Friedman’s test and subsequent multiple comparisons, which were also performed in MATLAB. MATLAB was also used to calculate an F-score measuring the relative uncertainties, variances, or B-factors of carbonyl oxygen atoms in a given residue (Equation (1)):
F = ( u ( O ) u ( N ) ) 2 / ( u ( C ) u ( N ) ) 2 ,
where u ( . ) denotes the coordinate uncertainty, variance, or B-factor of the given atom and O , N , and C are the carbonyl oxygen, amide nitrogen, and carbonyl carbon atoms, respectively.’

Supplementary Materials

The following are available online: Table S1: Parameters/Input for MD Simulations. Table S2: Average Ranks of Backbone Atom B-Factors for Crystallographic Structures. Table S3: Average Ranks of Backbone Atom Coordinate Uncertainties for Theseus Superimposed NMR “Ensembles”. Table S4: Average Ranks of Backbone Atom Coordinate Uncertainties for FindCore Superimposed NMR “Ensembles”. Table S5: MD Simulation Results. Table S6: Average Ranks of N, C’, Cα, and Cβ B-Factors for Crystallographic Structures. Table S7: Average Ranks of N, C’, Cα, and Cβ Coordinate Uncertainties for Theseus Superimposed NMR “Ensembles”. Table S8: Average Ranks of N, C’, Cα, and Cβ Coordinate Uncertainties for FindCore Superimposed NMR “Ensembles”. Table S9: Average Ranks of N, C’, Cα, and Cβ Coordinate Variances in Theseus Superimposed MD Trajectories. Table S10: Average Ranks of N, C’, Cα, and H Coordinate Uncertainties for Theseus Superimposed NMR “Ensembles”. Table S11: Average Ranks of N, C’, Cα, and H Coordinate Uncertainties for FindCore Superimposed NMR “Ensembles”. Table S12: Average Ranks of N, C’, Cα, and H Coordinate Variances in Theseus Superimposed MD Trajectories. Figure S1: Distribution of average ranks of coordinate uncertainties, variances, and B-factors of N, Cα, carbonyl C, and Cβ atoms. Figure S2: Results of Friedman’s Test and subsequent multiple comparisons analysis with Cβ atoms. Figure S3: Distribution of average ranks of coordinate uncertainties, variances, and B-factors of N, Cα, carbonyl C, and Cβ atoms. Figure S4: Results of Friedman’s Test and subsequent multiple comparisons analysis with amide H atoms.

Author Contributions

Conceptualization: D.A.S.; Data curation: D.A.S., C.R., A.R. and J.R. Formal analysis: D.A.S., C.R., A.R. and J.R. Investigation: D.A.S., C.R., A.R. and J.R. Methodology: D.A.S. Software: D.A.S., C.R., A.R. and J.R. Writing—original draft: D.A.S., C.R., A.R. and J.R. Writing—review and editing: D.A.S., C.R., A.R. and J.R. All authors have read and agreed to the published version of the manuscript.

Funding

While working on this project during the Summer of 2019, Christopher Reinknecht received a stipend from the Garden State—Louis Stokes Alliance for Minority Participation (GS-LSAMP), an NSF funded program.

Data Availability Statement

Input files used to run the MD simulations analyzed in this paper, the resulting (superimposed) MD trajectories, and all the scripts used to perform the analyses reported here are all archived on Zenodo, doi:10.5281/zenodo.4323630.

Acknowledgments

The authors graciously acknowledge Adrian Roitberg for his insights into the results presented by DAS at the ACS Spring 2014 Meeting in Dallas. The authors also thank Gaetano Montelione for his insights into NMR-based structural determination as well as for his helpful comments and constructive discussion, and John Chodera for his suggestion to publish a previous iteration of this study on bioRxiv. An award of Assigned Release Time for research from the Office of the Provost of William Paterson University of NJ facilitated completion of this work.

Conflicts of Interest

The authors have no conflicts of interest to report.

Sample Availability

Samples of the compounds are not available from the authors.

References

  1. Rashin, A.A.; Rashin, A.H.; Jernigan, R.L. Protein flexibility: Coordinate uncertainties and interpretation of structural differences. Acta Crystallogr. D Biol. Crystallogr. 2009, 65, 1140–1161. [Google Scholar] [CrossRef]
  2. Fenwick, R.B.; Bedem, H.V.D.; Fraser, J.S.; Wright, P.E. Integrated description of protein dynamics from room-temperature X-ray crystallography and NMR. Proc. Natl. Acad. Sci. USA 2014, 111, E445–E454. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Karplus, M.; McCammon, J.A. Molecular dynamics simulations of biomolecules. Nat. Genet. 2002, 9, 646–652. [Google Scholar] [CrossRef]
  4. Sapienza, P.J.; Lee, A.L. Using NMR to study fast dynamics in proteins: Methods and applications. Curr. Opin. Pharmacol. 2010, 10, 723–730. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Wand, A.J. The dark energy of proteins comes to light: Conformational entropy and its role in protein function revealed by NMR relaxation. Curr. Opin. Struct. Biol. 2013, 23, 75–81. [Google Scholar] [CrossRef] [Green Version]
  6. Lipari, G.; Szabo, A. Model-free approach to the interpretation of nuclear magnetic resonance relaxation in macromolecules. 1. Theory and range of validity. J. Am. Chem. Soc. 1982, 104, 4546–4559. [Google Scholar] [CrossRef]
  7. Lipari, G.; Szabo, A. Model-free approach to the interpretation of nuclear magnetic resonance relaxation in macromolecules. 2. Analysis of experimental results. J. Am. Chem. Soc. 1982, 104, 4559–4570. [Google Scholar] [CrossRef]
  8. Robustelli, P.; Stafford, K.A.; Palmer, A.G. Interpreting Protein Structural Dynamics from NMR Chemical Shifts. J. Am. Chem. Soc. 2012, 134, 6365–6374. [Google Scholar] [CrossRef] [Green Version]
  9. Berjanskii, M.V.; Wishart, D.S. A Simple Method to Measure Protein Side-Chain Mobility Using NMR Chemical Shifts. J. Am. Chem. Soc. 2013, 135, 14536–14539. [Google Scholar] [CrossRef]
  10. Eyal, E.; Gerzon, S.; Potapov, V.; Edelman, M.; Sobolev, V. The Limit of Accuracy of Protein Modeling: Influence of Crystal Packing on Protein Structure. J. Mol. Biol. 2005, 351, 431–442. [Google Scholar] [CrossRef]
  11. Read, R.J. Structure-factor probabilities for related structures. Acta Crystallogr. Sect. A Found. Crystallogr. 1990, 46, 900–912. [Google Scholar] [CrossRef]
  12. Li, D.-W.; Brüschweiler, R. Protocol to Make Protein NMR Structures Amenable to Stable Long Time Scale Molecular Dynamics Simulations. J. Chem. Theory Comput. 2014, 10, 1781–1787. [Google Scholar] [CrossRef]
  13. Showalter, S.A.; Brüschweiler, R. Validation of molecular dynamics simulations of biomolecules using NMR spin relaxation as benchmarks: Application to the AMBER99SB force field. J. Chem. Theory Comput. 2007, 3, 961–975. [Google Scholar] [CrossRef] [PubMed]
  14. Brüschweiler, R. Certification of Molecular Dynamics Trajectories with NMR Chemical Shifts. J. Phys. Chem. Lett. 2009, 1, 246–248. [Google Scholar] [CrossRef]
  15. Rueda, M.; Ferrer-Costa, C.; Meyer, T.; Pérez, A.; Camps, J.; Gelpí, J.L.; Orozco, M. A consensus view of protein dynamics. Proc. Natl. Acad. Sci. USA 2007, 104, 796–801. [Google Scholar] [CrossRef] [Green Version]
  16. Showalter, S.A.; Johnson, E.; Rance, M.; Brüschweiler, R. Toward Quantitative Interpretation of Methyl Side-Chain Dynamics from NMR by Molecular Dynamics Simulations. J. Am. Chem. Soc. 2007, 129, 14146–14147. [Google Scholar] [CrossRef] [PubMed]
  17. Zhang, F.; Brüschweiler, R. Contact Model for the Prediction of NMR N−H Order Parameters in Globular Proteins. J. Am. Chem. Soc. 2002, 124, 12654–12655. [Google Scholar] [CrossRef]
  18. Ming, D.; Brüschweiler, R. Reorientational Contact-Weighted Elastic Network Model for the Prediction of Protein Dynamics: Comparison with NMR Relaxation. Biophys. J. 2006, 90, 3382–3388. [Google Scholar] [CrossRef] [Green Version]
  19. Rieping, W.; Nilges, M.; Habeck, M. ISD: A software package for Bayesian NMR structure calculation. Bioinformatics 2008, 24, 1104–1105. [Google Scholar] [CrossRef]
  20. Carstens, S.; Nilges, M.; Habeck, M. Inferential Structure Determination of Chromosomes from Single-Cell Hi-C Data. PLoS Comput. Biol. 2016, 12, e1005292. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Richter, B.; Gsponer, J.; Várnai, P.; Salvatella, X.; Vendruscolo, M. The MUMO (minimal under-restraining minimal over-restraining) method for the determination of native state ensembles of proteins. J. Biomol. NMR 2007, 37, 117–135. [Google Scholar] [CrossRef] [PubMed]
  22. Snyder, D.A.; Grullon, J.; Huang, Y.J.; Tejero, R.; Montelione, G.T. The expanded FindCore method for identification of a core atom set for assessment of protein structure prediction. Proteins Struct. Funct. Bioinform. 2013, 82, 219–230. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Tejero, R.; Bassolino-Klimas, D.; Bruccoleri, R.E.; Montelione, G.T. Simulated annealing with restrained molecular dynamics using CONGEN: Energy refinement of the NMR solution structures of epidermal and type-α transforming growth factors. Protein Sci. 1996, 5, 578–592. [Google Scholar] [CrossRef] [PubMed]
  24. Salvatella, X. Understanding Protein Dynamics Using Conformational Ensembles; Springer International Publishing: New York, NY, USA, 2013; Volume 805, pp. 67–85. [Google Scholar]
  25. Jamroz, M.; Kolinski, A.; Kmiecik, S. CABS-flex predictions of protein flexibility compared with NMR ensembles. Bioinformatics 2014, 30, 2150–2154. [Google Scholar] [CrossRef] [PubMed]
  26. Kirchner, D.K.; Güntert, P. Objective identification of residue ranges for the superposition of protein structures. BMC Bioinform. 2011, 12, 170. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Snyder, D.A.; Montelione, G.T. Clustering algorithms for identifying core atom sets and for assessing the precision of protein structure ensembles. Proteins Struct. Funct. Bioinform. 2005, 59, 673–686. [Google Scholar] [CrossRef]
  28. Hyberts, S.G.; Goldberg, M.S.; Havel, T.F.; Wagner, G. The solution structure of eglin c based on measurements of many NOEs and coupling constants and its comparison with X-ray structures. Protein Sci. 1992, 1, 736–751. [Google Scholar] [CrossRef] [Green Version]
  29. Kelley, L.A.; Gardner, S.P.; Sutcliffe, M.J. An automated approach for defining core atoms and domains in an ensemble of NMR-derived protein structures. Protein Eng. 1997, 10, 737–741. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Theobald, D.L.; Wuttke, D.S. THESEUS: Maximum likelihood superpositioning and analysis of macromolecular structures. Bioinformatics 2006, 22, 2171–2172. [Google Scholar] [CrossRef] [Green Version]
  31. Theobald, D.L.; Wuttke, D.S. Accurate structural correlations from maximum likelihood superpositions. PLoS Comput. Biol. 2008, 4, e43. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Moult, J.; Fidelis, K.; Kryshtafovych, A.; Tramontano, A. Critical assessment of methods of protein structure prediction (CASP)-round IX. Proteins Struct. Funct. Bioinform. 2011, 79, 1–5. [Google Scholar] [CrossRef] [Green Version]
  33. Kryshtafovych, A.; Moult, J.; Bales, P.; Bazan, J.F.; Biasini, M.; Burgin, A.; Chen, C.; Cochran, F.V.; Craig, T.K.; Das, R.; et al. Challenging the state of the art in protein structure prediction: Highlights of experimental target structures for the 10th Critical Assessment of Techniques for Protein Structure Prediction Experiment CASP10. Proteins Struct. Funct. Bioinform. 2013, 82, 26–42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Mao, B.; Tejero, R.; Baker, D.; Montelione, G.T. Protein NMR Structures Refined with Rosetta Have Higher Accuracy Relative to Corresponding X-ray Crystal Structures. J. Am. Chem. Soc. 2014, 136, 1893–1906. [Google Scholar] [CrossRef]
  35. Everett, J.K.; Tejero, R.; Murthy, S.B.K.; Acton, T.B.; Aramini, J.M.; Baran, M.C.; Benach, J.; Cort, J.R.; Eletsky, A.; Forouhar, F.; et al. A community resource of experimental data for NMR/X-ray crystal structure pairs. Protein Sci. 2015, 25, 30–45. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Hollander, M.; Wolfe, D.A.; Chicken, E. Nonparametric Statistical Methods, 3rd ed.; Wiley: Hoboken, NY, USA, 2015; pp. 1–10. [Google Scholar]
  37. Brunger, A.T. Version 1.2 of the Crystallography and NMR system. Nat. Protoc. 2007, 2, 2728–2733. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Brunger, A.T.; Adams, P.D.; Clore, G.M.; Delano, W.L.; Gros, P.; Grosse-Kunstleve, R.W.; Jiang, J.-S.; Kuszewski, J.; Nilges, M.; Pannu, N.S.; et al. Crystallography & NMR System: A New Software Suite for Macromolecular Structure Determination. Acta Crystallogr. Sect. D Biol. Crystallogr. 1998, 54, 905–921. [Google Scholar] [CrossRef]
  39. Schwieters, C.D.; Kuszewski, J.J.; Tjandra, N.; Clore, G.M. The Xplor-NIH NMR molecular structure determination package. J. Magn. Reson. 2003, 160, 65–73. [Google Scholar] [CrossRef] [Green Version]
  40. Jain, A.; Purohit, C.S.; Verma, S.; Sankararamakrishnan, R. Close Contacts between Carbonyl Oxygen Atoms and Aromatic Centers in Protein Structures: π⋅⋅⋅π or Lone-Pair⋅⋅⋅π Interactions? J. Phys. Chem. B 2007, 111, 8680–8683. [Google Scholar] [CrossRef] [PubMed]
  41. Singh, S.K.; Das, A. The n → π* interaction: A rapidly emerging non-covalent interaction. Phys. Chem. Chem. Phys. 2015, 17, 9596–9612. [Google Scholar] [CrossRef] [Green Version]
  42. Lange, O.F.; Van Der Spoel, D.; De Groot, B.L. Scrutinizing Molecular Mechanics Force Fields on the Submicrosecond Timescale with NMR Data. Biophys. J. 2010, 99, 647–655. [Google Scholar] [CrossRef] [Green Version]
  43. Pace, C.N.; Fu, H.; Lee Fryar, K.; Landua, J.; Trevino, S.R.; Schell, D.; Thurlkill, R.L.; Imura, S.; Scholtz, J.M.; Gajiwala, K.; et al. Contribution of hydrogen bonds to protein stability. Protein Sci. 2014, 23, 652–661. [Google Scholar] [CrossRef]
  44. Reichert, D.; Zinkevich, T.; Saalwächter, K.; Krushelnitsky, A. The relation of the X-ray B-factor to protein dynamics: Insights from recent dynamic solid-state NMR data. J. Biomol. Struct. Dyn. 2012, 30, 617–627. [Google Scholar] [CrossRef]
  45. Kuzmanic, A.; Pannu, N.S.; Zagrovic, B. X-ray refinement significantly underestimates the level of microscopic heterogeneity in biomolecular crystals. Nat. Commun. 2014, 5, 3220. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Shivakumar, D.; Williams, J.; Wu, Y.; Damm, W.; Shelley, J.; Sherman, W. Prediction of Absolute Solvation Free Energies using Molecular Dynamics Free Energy Perturbation and the OPLS Force Field. J. Chem. Theory Comput. 2010, 6, 1509–1519. [Google Scholar] [CrossRef] [PubMed]
  47. Salomon-Ferrer, R.; Case, D.A.; Walker, R.C. An overview of the Amber biomolecular simulation package. Wiley Interdiscip. Rev. Comput. Mol. Sci. 2013, 3, 198–210. [Google Scholar] [CrossRef]
  48. Hornak, V.; Abel, R.; Okur, A.; Strockbine, B.; Roitberg, A.; Simmerling, C. Comparison of multiple Amber force fields and development of improved protein backbone parameters. Proteins Struct. Funct. Bioinform. 2006, 65, 712–725. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Berman, H.M.; Westbrook, J.; Feng, Z.; Gilliland, G.; Bhat, T.N.; Weissig, H.; Shindyalov, I.N.; Bourne, P.E. The Protein Data Bank. Nucleic Acids Res. 2000, 28, 235–242. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Bowers, K.J.; Chow, D.E.; Xu, H.; Dror, R.O.; Eastwood, M.P.; Gregersen, B.A.; Klepeis, J.L.; Kolossvary, I.; Moraes, M.A.; Sacerdoti, F.D.; et al. Scalable algorithms for molecular dynamics simulations on commodity clusters. In Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, New York, NY, USA, 11 November 2006; p. 43. [Google Scholar]
  51. Humphrey, W.; Dalke, A.; Schulten, K. VMD: Visual molecular dynamics. J. Mol. Graph. 1996, 14, 33–38. [Google Scholar] [CrossRef]
  52. MATLAB, version 9.2.0.538062 (R2017a); The MathWorks Inc.: Natick, MA, USA, 2017.
Figure 1. Backbone traces of residues 41–43 from Q8ZRJ2. (A) Crystallographic structure (PDB ID 2ES9) colored by a B-factor with blue being low, green being moderate, and red being high. Residue numbers shown in this panel reflect residue numbers in all panels. (B) FindCore superimposition of NMR ensemble (PDB ID 2JN8). This superimposition was calculated using a core atom set drawn from all heavy atoms (using all deposited models in the FindCore calculation) and not merely the residues shown. THESEUS superimposition, calculated from the entire MD trajectory using all heavy atoms, of MD trajectories simulated using the AMBER force field, showing snapshots 100 and 1000, at (C) 100 K and (D) 300 K. In panels (BD), carbonyl oxygens are red, amide nitrogens are blue, carbons are green, and amide hydrogens are white. Note the splaying in the carbonyl oxygens in panels (BD) and the relatively well superimposed amide nitrogens in panels (B) and (D). Even in panel (C), amide nitrogens are better superimposed than carbonyl oxygens. In general, peptide planes appear to pivot with the amide protons and/or amide nitrogens being relatively immobile with the carbonyl oxygens at the opposite end of the peptide plane being relatively mobile. This pattern is not apparent in the B-factors depicted in panel (A).
Figure 1. Backbone traces of residues 41–43 from Q8ZRJ2. (A) Crystallographic structure (PDB ID 2ES9) colored by a B-factor with blue being low, green being moderate, and red being high. Residue numbers shown in this panel reflect residue numbers in all panels. (B) FindCore superimposition of NMR ensemble (PDB ID 2JN8). This superimposition was calculated using a core atom set drawn from all heavy atoms (using all deposited models in the FindCore calculation) and not merely the residues shown. THESEUS superimposition, calculated from the entire MD trajectory using all heavy atoms, of MD trajectories simulated using the AMBER force field, showing snapshots 100 and 1000, at (C) 100 K and (D) 300 K. In panels (BD), carbonyl oxygens are red, amide nitrogens are blue, carbons are green, and amide hydrogens are white. Note the splaying in the carbonyl oxygens in panels (BD) and the relatively well superimposed amide nitrogens in panels (B) and (D). Even in panel (C), amide nitrogens are better superimposed than carbonyl oxygens. In general, peptide planes appear to pivot with the amide protons and/or amide nitrogens being relatively immobile with the carbonyl oxygens at the opposite end of the peptide plane being relatively mobile. This pattern is not apparent in the B-factors depicted in panel (A).
Molecules 26 01484 g001
Figure 2. Distribution of average ranks of coordinate uncertainties, variances, and B-factors of backbone heavy atoms. As described in the main text, atoms in each residue are ranked by (AD) coordinate uncertainty of FindCore superimposed NMR ensembles, (EH) THESEUS superimposed NMR structures, coordinate variances of (IL) THESEUS superimposed MD trajectories and (MP) B-factors. For each structure, an average rank is calculated for each backbone heavy atom type: (first row) amide N, (second row) Cα, (third row) carbonyl C, and (fourth row) carbonyl O. For superimposed NMR ensembles (columns one and two) and MD trajectories (column three), a clear pattern is visible: average ranks for amide nitrogen atoms and carbonyl carbon atoms are often lower than average ranks for Cα atoms. The average ranks for carbonyl oxygen atoms are usually higher. When backbone heavy atoms are ranked by a B-factor, however, the average ranks for all backbone heavy atoms typically are between 2–3. The average ranks plotted in this figure are tabulated in Tables S2–S5, Supplementary Materials.
Figure 2. Distribution of average ranks of coordinate uncertainties, variances, and B-factors of backbone heavy atoms. As described in the main text, atoms in each residue are ranked by (AD) coordinate uncertainty of FindCore superimposed NMR ensembles, (EH) THESEUS superimposed NMR structures, coordinate variances of (IL) THESEUS superimposed MD trajectories and (MP) B-factors. For each structure, an average rank is calculated for each backbone heavy atom type: (first row) amide N, (second row) Cα, (third row) carbonyl C, and (fourth row) carbonyl O. For superimposed NMR ensembles (columns one and two) and MD trajectories (column three), a clear pattern is visible: average ranks for amide nitrogen atoms and carbonyl carbon atoms are often lower than average ranks for Cα atoms. The average ranks for carbonyl oxygen atoms are usually higher. When backbone heavy atoms are ranked by a B-factor, however, the average ranks for all backbone heavy atoms typically are between 2–3. The average ranks plotted in this figure are tabulated in Tables S2–S5, Supplementary Materials.
Molecules 26 01484 g002
Figure 3. Results of Friedman’s Test and subsequent multiple comparisons analysis. A bar, associated with a comparison X < Y, that is n units high, indicates that, in n structures, the assessed measure of coordinate variability is significantly lower for atom type X than for atom type Y. e.g., in panel A, the bar associated with C < O being 39 units high indicates that in 39 NMR ensembles, the coordinate uncertainties (calculated using FindCore superimpositions) for carbonyl carbons are significantly less (according to Friedman’s test) than those for carbonyl oxygens. Mean ranks are considered significantly different if they differ by more than three standard deviations. Assessed measures of coordinate variability are (A) coordinate uncertainties in FindCore superimposed NMR ensembles, (B) coordinate uncertainties in THESEUS superimposed NMR ensembles, (C) coordinate uncertainties in THESEUS superimposed MD trajectories, and (D) crystallographic B-factors. Note that, in almost all superimposed NMR ensembles (independent of superimposition method), as well as in almost all THESEUS superimposed MD trajectories, amide nitrogen and carbonyl carbons have significantly lower coordinate uncertainties than carbonyl oxygens. However, only a small number of crystallographic structures have any significant results using the Friedman’s test to compare B-factors of different atom types.
Figure 3. Results of Friedman’s Test and subsequent multiple comparisons analysis. A bar, associated with a comparison X < Y, that is n units high, indicates that, in n structures, the assessed measure of coordinate variability is significantly lower for atom type X than for atom type Y. e.g., in panel A, the bar associated with C < O being 39 units high indicates that in 39 NMR ensembles, the coordinate uncertainties (calculated using FindCore superimpositions) for carbonyl carbons are significantly less (according to Friedman’s test) than those for carbonyl oxygens. Mean ranks are considered significantly different if they differ by more than three standard deviations. Assessed measures of coordinate variability are (A) coordinate uncertainties in FindCore superimposed NMR ensembles, (B) coordinate uncertainties in THESEUS superimposed NMR ensembles, (C) coordinate uncertainties in THESEUS superimposed MD trajectories, and (D) crystallographic B-factors. Note that, in almost all superimposed NMR ensembles (independent of superimposition method), as well as in almost all THESEUS superimposed MD trajectories, amide nitrogen and carbonyl carbons have significantly lower coordinate uncertainties than carbonyl oxygens. However, only a small number of crystallographic structures have any significant results using the Friedman’s test to compare B-factors of different atom types.
Molecules 26 01484 g003
Figure 4. F-scores comparing UniProt ID Q8ZRJ2 backbone heavy atom coordinate uncertainties and variances. (A) The first model in the NMR “ensemble” 2JN8, (B) final snapshot of the MD trajectory seeded with 2ES9 (replacing Se-MET residues with MET residues, ran at 300 K with the AMBER 99SB forcefield), and (C) crystallographic structure, PDB ID 2ES9, each colored on a per residue bases by the F-score described in the Materials and Methods section (Equation (1)). Red indicates an F-score greater than 10 (relative uncertainty, variance, or B-factor of carbonyl oxygen coordinates quite high), white an F-score equal to 1 and blue and F-score less than 0.1. Green indicates residues for which the carbonyl oxygen coordinate uncertainty, variance, or B-factor for the carbonyl oxygen was actually less than the uncertainty, variance, or B-factor for the corresponding amide nitrogen. Dotted lines indicate hydrogen bonds: carbonyl oxygen atoms with high relative coordinate uncertainties and variances occur in both a hydrogen-bonded secondary structure as well as in loop regions. Some helical regions, likely endowed with extra restraints in the NMR-based structure determination process, do have slightly fewer carbonyl oxygens with high relative coordinate uncertainty as compared with the MD trajectory, illustrating the potential importance of hydrogen bonding in “fixing” the position of carbonyl oxygen atoms with high relative coordinate variances. By comparison, the crystallographic structure, PDB ID 2ES9, has relatively few carbonyl oxygens with high relative B-factors as indicated by the relative dearth of red in panel (C).
Figure 4. F-scores comparing UniProt ID Q8ZRJ2 backbone heavy atom coordinate uncertainties and variances. (A) The first model in the NMR “ensemble” 2JN8, (B) final snapshot of the MD trajectory seeded with 2ES9 (replacing Se-MET residues with MET residues, ran at 300 K with the AMBER 99SB forcefield), and (C) crystallographic structure, PDB ID 2ES9, each colored on a per residue bases by the F-score described in the Materials and Methods section (Equation (1)). Red indicates an F-score greater than 10 (relative uncertainty, variance, or B-factor of carbonyl oxygen coordinates quite high), white an F-score equal to 1 and blue and F-score less than 0.1. Green indicates residues for which the carbonyl oxygen coordinate uncertainty, variance, or B-factor for the carbonyl oxygen was actually less than the uncertainty, variance, or B-factor for the corresponding amide nitrogen. Dotted lines indicate hydrogen bonds: carbonyl oxygen atoms with high relative coordinate uncertainties and variances occur in both a hydrogen-bonded secondary structure as well as in loop regions. Some helical regions, likely endowed with extra restraints in the NMR-based structure determination process, do have slightly fewer carbonyl oxygens with high relative coordinate uncertainty as compared with the MD trajectory, illustrating the potential importance of hydrogen bonding in “fixing” the position of carbonyl oxygen atoms with high relative coordinate variances. By comparison, the crystallographic structure, PDB ID 2ES9, has relatively few carbonyl oxygens with high relative B-factors as indicated by the relative dearth of red in panel (C).
Molecules 26 01484 g004
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Reinknecht, C.; Riga, A.; Rivera, J.; Snyder, D.A. Patterns in Protein Flexibility: A Comparison of NMR “Ensembles”, MD Trajectories, and Crystallographic B-Factors. Molecules 2021, 26, 1484. https://doi.org/10.3390/molecules26051484

AMA Style

Reinknecht C, Riga A, Rivera J, Snyder DA. Patterns in Protein Flexibility: A Comparison of NMR “Ensembles”, MD Trajectories, and Crystallographic B-Factors. Molecules. 2021; 26(5):1484. https://doi.org/10.3390/molecules26051484

Chicago/Turabian Style

Reinknecht, Christopher, Anthony Riga, Jasmin Rivera, and David A. Snyder. 2021. "Patterns in Protein Flexibility: A Comparison of NMR “Ensembles”, MD Trajectories, and Crystallographic B-Factors" Molecules 26, no. 5: 1484. https://doi.org/10.3390/molecules26051484

Article Metrics

Back to TopTop