Abstract
We consider the recovery of a common denominator in a finite fractional-power law from observations with positive abscissae. For every candidate denominator n, the vectors generated by form a linear model space. Denominator identification is therefore a finite model-selection problem, although the spaces need not be nested and can be nearly coincident. The normalised projection residual admits a finite-sample perturbation bound. If the relative noise is at most , its change is bounded uniformly by . A recovery theorem then separates two roles of the ordered penalty : an upper bound prevents the penalty from overriding a genuine residual gap, whereas a lower bound is needed only when several candidates fit the noiseless sample exactly. Thus, the result is a conditional finite-sample guarantee, not an asymptotic consistency theorem. Because every model contains the constant vector, ordinary smallest principal angles are zero; the appropriate geometric diagnostics are nontrivial Friedrichs angles, condition numbers, and signal-dependent residual gaps. Reproducible experiments compare the criterion with unpenalised selection, cross-validation over the same spaces, a continuous-exponent variable-projection fit, and a fractional-power dictionary of equal dimension. Further experiments vary the assumed degree, grid size, sampling design, sample size, and conditioning. An application to planetary orbital data recovers the denominator associated with Kepler’s law. The results also identify regimes in which no reliable denominator claim should be made.
Keywords:
fractional-power law; model selection; projection residual; finite-sample recovery; variable projection; principal angles MSC:
62J05; 62F07; 65F20; 41A10
1. Introduction
Fractional powers occur naturally in local algebraic expansions, similarity laws, singular perturbation theory, and empirical scaling relations. The focus is a deliberately restricted question. Given observations with , can one distinguish among models
when the degree d and a finite set of candidate denominators have been specified? The target is the common denominator n, not an arbitrary power or an unrestricted symbolic expression.
For a candidate n, evaluating the functions at the sampled abscissae gives a matrix . The least-squares fit is the orthogonal projection of the response vector onto . The nonlinear-looking comparison of fractional scales is consequently reduced to a finite collection of linear projections. What remains difficult is identification: different may approximate one another extremely well on a bounded range, and some may fit the same finite sample exactly.
Normalising by the observed response introduces a first-order perturbation, and a noisy residual can reverse the order induced by the penalty unless also satisfies a lower bound. The uniform perturbation bound is therefore derived from the normalised response vector, and both sides of the admissible interval for are established.
All design spaces share the intercept vector , so their smallest ordinary principal angle is identically zero. Consequently, this angle cannot be assumed to be positive. The analysis uses instead the signal-dependent noiseless residual margin. Friedrichs angles after removing common directions remain useful as an observable warning about near-coincidence, but they are not substituted for the required signal-specific gap.
1.1. Relation to Existing Approaches
Classical fractional polynomial regression selects one or two powers from a prescribed set and was developed primarily to model a flexible covariate effect [1,2,3]. Its powers need not share a denominator and it does not seek the ramification index of an expansion. In contrast, model (1) selects a structured block as one object. The two approaches overlap, but their inferential targets differ.
Dictionary methods and symbolic regression search much larger expression classes. SINDy uses sparsity over a user-specified library [4,5]; AI Feynman and modern symbolic regression systems explore compositional structure and accuracy–complexity trade-offs [6,7]. Their flexibility is valuable when the form of the law is unknown. It also changes the question: an unrestricted search may find an accurate expression without identifying a common denominator. Recent benchmarking work stresses that comparisons are meaningful only when representation capacity and tuning budgets are made explicit [7,8].
Allowing n to vary continuously produces a separable nonlinear least-squares problem: the coefficients are linear once n is fixed. This is a standard setting for variable projection [9,10,11]. Our discrete estimator can therefore be viewed as a constrained, interpretability-oriented counterpart of continuous variable projection. Cross-validation provides a natural data-driven comparison and tuning device [12]; information criteria are less informative when all candidate spaces have the same dimension.
Table 1 summarises the distinction.
Table 1.
Scope of the compared methods.
1.2. Contributions and Organisation
The contributions are the following.
- A uniform, explicit perturbation bound is proved for the normalised projection residual, including the required condition .
- The recovery theorem states separate lower and upper requirements on and distinguishes the unique-fit and aliased-fit cases.
- The theoretical result is described as a finite-sample stability guarantee. A Gaussian high-probability corollary is given without claiming standard consistency.
- A complete algorithm, data-dependent diagnostics, and operational rules for d, N, and are supplied.
- Reproducible comparisons use baselines with comparable fractional-power capacity, and the sensitivity analysis includes a real-data example.
2. Model, Identifiability, and Geometric Diagnostics
Let be a nonempty finite candidate grid and put . For distinct , define
We assume and for every . If is a thin orthonormal factor obtained from a QR factorisation or an SVD of a column-scaled , then is the orthogonal projector onto . Forming is unnecessary and is avoided numerically.
For a nonzero vector , write
Let denote the noiseless response, the observation, and
the set of exact fits on the sampled abscissae.
Assumption 1 (Finite-grid identifiability).
There is a target such that . Thus and no smaller candidate fits the noiseless sample exactly.
In an algebraic application, Assumption 1 is motivated by a minimal ramification index. It is nevertheless a statement about the chosen function class and finite sampling design; it cannot be inferred from a small noisy sample without qualification.
Proposition 1 (Generic exclusion of accidental exact fits).
Let , and suppose that, as functions on an open interval , does not belong to for a candidate n. If and the are sampled independently from a distribution with a density on I, then
The statement holds simultaneously for every such n on a finite grid.
Proof.
The functions are linearly independent. Hence, their evaluation determinant at points is a nonzero real-analytic function of those points. Its zero set has Lebesgue measure zero. Membership of the full response vector in would force this determinant to vanish for the first observations. A finite union over n still has probability zero. □
The relevant separation quantity is the signal-dependent margin
with the convention if every candidate is in . Since the grid is finite, whenever is nonempty. The magnitude of g, rather than finiteness alone, determines whether the problem is stable under noise.
Why the Ordinary Smallest Angle Is Not Usable
Every contains . Consequently, the smallest principal angle between any two model spaces is zero. For an x-only diagnostic one may remove their common intersection and compute the Friedrichs angle
A small nontrivial angle warns that some directions in two spaces are hard to distinguish. It does not by itself lower-bound (5), because the actual signal may point in a better or worse separated direction. We therefore use g in the theorem and reserve , scaled condition numbers, and observed residual gaps for diagnostics.
3. Perturbation and Finite-Sample Recovery
The noise level is measured relative to the noiseless response:
No probabilistic assumption is needed in this section.
Lemma 1 (Uniform perturbation of the normalised residual).
Proof.
The estimator minimises
where . The term is an ordered preference for a smaller denominator. It is not a dimension penalty: all have dimension under the rank assumption.
To state the exact conditions, define
Theorem 1 (Finite-sample recovery on a fixed grid).
Proof.
For , Lemma 1 gives , whereas . If , the penalty difference is positive, so . If , then
by (12).
Now let . Assumption A1 implies . Both exact-fit residuals observed under noise lie in , and hence
All competing candidates have therefore been excluded. □
When aliases are possible, the simple but conservative interval
is sufficient because and . It is nonempty if . The two-sided restriction makes the trade-off explicit: too little regularisation cannot resolve noisy aliases, while too much can force a smaller but incorrect denominator.
Remark 1 (No standard consistency claim).
Theorem 1 concerns a fixed finite grid, fixed sampled abscissae, and a bounded relative perturbation. It is not a proof that as . Such a result would require a sampling scheme, a margin bounded uniformly away from zero, and control of the relative noise as m changes.
Proposition 2 (Gaussian high-probability guarantee).
If , then with probability at least ,
If and the conditions of Theorem 1 hold with , recovery has probability at least .
Proof.
The displayed norm bound is the standard Gaussian concentration inequality for the Euclidean norm. On that event, Theorem 1 applies. □
4. Algorithm, Tuning, and Diagnostics
The arithmetic cost for a grid is using thin QR decompositions. Column scaling does not alter but avoids magnitude-driven condition numbers. It cannot remove near-collinearity caused by clustered transformed abscissae (Algorithm 1).
| Algorithm 1 Complete computational workflow |
| Finite-grid projection-residual selection Input: positive abscissae x, nonzero response y, degree d, candidate grid , and a grid of penalty values.
|
4.1. A Reproducible Rule for Choosing
When a credible relative noise bound and estimates of the relevant margins are available, inequalities (12) and (13) give a rule rather than a heuristic: choose inside the nonempty admissible interval. These bounds are conservative, and g, h, and are not all known from a single noisy sample.
Our default practical rule is therefore K-fold cross-validation on a predeclared grid that includes zero. For each fold and each , the exponent is selected on the training part by (9); its coefficients are fitted there and the squared prediction error is evaluated on the validation part. The chosen minimises the mean validation error, with ties resolved in favour of the smaller . This is a predictive tuning rule, not a proof of denominator recovery. If it selects , the data provide no cross-validated reason to impose the ordered preference.
4.2. Choosing the Degree and Candidate Grid
An underestimated degree generally leaves outside and can make a wrong denominator fit better. An overestimated degree enlarges every space, reduces residual gaps, and worsens conditioning. If d is unknown, it should be selected jointly with n using held-out prediction or an information criterion that penalises the dimension . The ordered term does not replace that dimension penalty.
Domain information should set the initial upper limit N. A practical sequential rule is to enlarge and retain a denominator claim only while (i) the selected n is stable, (ii) the observed objective gap does not collapse, and (iii) the scaled condition numbers and nontrivial angles remain acceptable. If , recovery is impossible. An unnecessarily large N adds near-duplicate transformed grids, worsens multiple comparison, and may create poorly conditioned spaces.
4.3. A Data-Specific Stability Statement
Suppose minimises and an external perturbation radius is credible relative to . Applying Lemma 1 with y as the reference shows that the selected model is unchanged throughout that response ball if
This certifies local stability of the computed decision. It does not certify that the assumed fractional-power family is scientifically correct.
5. Numerical Experiments
5.1. Protocol and Reproducibility
All random experiments use Python 3.12.14 with NumPy 2.3.5 and SciPy 1.17.0 default generator with master seed 20260904. Unless stated otherwise, the are regenerated independently in every trial from the log-uniform distribution on ; samples for different m are not nested. Conditional on the sampled , independent Gaussian errors have standard deviation
so that the displayed SNR is nominal. Each table entry is based on 500 trials. The candidate grid is unless varied explicitly. Five folds are newly randomised for each trial. The penalty grid is
The supplementary script (Supplementary Materials) reproduces the tables and records the software-independent data source for the real example.
5.2. Baselines with Comparable Representation Capacity
The main experiment uses and for . We compare:
- PR-CV: criterion (9), with selected by the cross-validation rule above;
- PR-0: unpenalised residual selection on the same spaces;
- n-CV: direct five-fold selection of n on the same spaces;
- continuous: variable projection over , counted as correct when the rounded minimiser equals ;
- FD-CV: cross-validated selection of one power from , reduced to its denominator.
Thus, none of the baselines is handicapped by an integer-only dictionary.
The structured projection criterion is competitive with the methods having the same representational capacity, but Table 2 does not support a claim of universal superiority. Differences are small at high SNR. At 10 dB, is markedly harder than , especially for . The median cross-validated penalty is zero in every row; positive penalties account for the modest improvement over PR-0 in some difficult cases. This observation is consistent with Theorem 1: when the exact minimiser is unique, there is no theoretical lower requirement on .
Table 2.
Exact denominator recovery proportions over 500 trials.
5.3. Degree Mis-Specification, Grid Size, Sampling, and Conditioning
For the sensitivity study, the noiseless law has , true degree three, and coefficients scaled so that several terms remain visible on :
The nominal SNR is 40 dB. Table 3 changes one design choice at a time. Because the degree-sensitivity rows allow model mis-specification, the fourth column reports the signed residual contrast , rather than the margin g in Equation (5). When , this contrast equals g; otherwise, it may be negative, indicating that a competing denominator fits the mis-specified family better than . Condition numbers refer to column-scaled matrices.
Table 3.
Sensitivity to the fitted degree and upper grid limit ().
Underfitting to changes the model and usually changes the selected denominator. Overfitting enlarges the spaces: the noiseless margin collapses by orders of magnitude and conditioning deteriorates. Choosing omits the truth. Here, does not reduce recovery relative to , but it more than doubles the median maximum condition number. Thus, a large grid is not automatically harmful, but it is not cost-free and must be checked.
Table 4 reports the effects of the sampling distribution and sample size. Uniform sampling on a six-decade interval places most observations at large x and provides little information near the lower end.
Table 4.
Effect of the sampling distribution and sample size (, ).
Uniform sampling on a six-decade interval places most observations at large x and provides little information near the lower end. In this example, it produces both small margins and poor conditioning. Log-uniform sampling covers the scale more evenly; increasing m then improves the observed recovery. The comparison is specific to this design and should not be read as a universal optimal-design statement.
5.4. Real Data: Planetary Orbital Periods
The NASA/NSSDC Planetary Fact Sheet reports mean distance from the Sun and orbital period [13]. We use the eight planets, omit the Moon and Pluto, and scale distance and period by the corresponding Earth values. Table 5 lists the original, unscaled planetary data used. The physical reference law is Kepler’s , which lies in the , model through the term.
Table 5.
Planetary data used in the real-data experiment.
Table 6 reports the normalised full-data residuals for the planetary data with and .
Table 6.
Normalised full-data residuals for the planetary data ().
Four-fold cross-validation chooses and the discrete estimator selects ; direct cross-validation over n also selects 2. The fitted coefficient of is after Earth normalisation, with smaller coefficients on the lower powers. A continuous variable-projection fit returns because a cubic in can interpolate the short series in a different way. This is a useful distinction: the discrete grid encodes a rational-structure prior, while the continuous model optimises prediction over a larger family.
6. Discussion and Limitations
The theoretical and numerical results support a deliberately limited claim. The method is a transparent and inexpensive selector for a predeclared family of common-denominator models. Its guarantee is conditional on a finite-sample residual margin, a relative noise bound, and finite-grid identifiability. These conditions can fail even when the underlying functional representation is unique, because finite samples may make competing spaces nearly coincident.
No diagnostic can ensure correctness from the observed data alone. The residual curve, resampling frequencies, condition numbers, nontrivial angles, and stability under changes of d and N are warning devices. They should be reported together. Equation (16) gives a rigorous local stability statement only when an external error radius is credible.
The ordered penalty is not a conventional complexity penalty. All fixed-d models have the same number of coefficients. Its justified role is to prefer a smaller denominator among nearly tied or exactly aliased structured models. Cross-validation may reasonably choose zero, as it often did in our experiments. If the degree is selected at the same time, a separate dimension penalty or held-out criterion is necessary.
The simulations expose several limitations. Recovery can be poor at low SNR, for an incorrect degree, with a small sample, or when the sampling design compresses the transformed abscissae. A larger candidate grid may introduce near-duplicate spaces and numerical instability. The real-data experiment is physically interpretable but small and unusually clean; it does not establish performance for heteroscedastic, dependent, or pre-asymptotic measurements.
Finally, the framework assumes , a fixed polynomial truncation, and a single common denominator. Logarithmic factors, multiple scaling regimes, unknown change points, and general Puiseux series with negative or mixed powers require an enlarged model class. In such settings, fractional polynomial, dictionary, or symbolic regression methods may be more appropriate.
7. Conclusions
Fractional-power denominator recovery can be organised as selection among a finite collection of linear subspaces. The useful part of this formulation is not that it removes identifiability difficulties, but that it makes them visible through projection residuals and numerical diagnostics.
The perturbation bound is first-order in the relative noise and explicitly requires a nonzero normalisation denominator. The recovery theorem shows when an ordered penalty can separate exact aliases without overwhelming genuine residual differences. It also makes clear that no lower penalty is needed in the generic unique-fit case and that the result is finite-sample, not asymptotic consistency.
Balanced experiments show competitive performance when the candidate family is well separated, and substantial degradation when degree, sampling, or conditioning erodes the residual margin. The planetary example demonstrates a setting in which the discrete rational structure has a direct scientific interpretation. Future work should derive sampling-design bounds for the signal-dependent margin and extend the model to jointly selected degrees, heteroscedastic errors, and multiple asymptotic regimes.
Supplementary Materials
The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/math14183358/s1, Python script reproduce_experiments.py: code for reproducing the numerical experiments and tabulated results, including the planetary data used in the real-data example.
Funding
This research received no external funding.
Data Availability Statement
The present study uses the publicly available CIFAR-100 benchmark dataset, an author-generated synthetic pile-driver image corpus, and numerical evaluation data generated by the authors. No confidential field-test data obtained from experimental operation of newly developed equipment are used as the primary experimental dataset in this study.
Acknowledgments
The author thanks the editor and the three anonymous reviewers for helpful comments that improved the clarity and presentation of the work.
Conflicts of Interest
The author declares no conflict of interest.
References
- Royston, P.; Altman, D.G. Regression using fractional polynomials of continuous covariates: Parsimonious parametric modelling. Appl. Stat. 1994, 43, 429–467. [Google Scholar] [CrossRef] [Scilit]
- Ambler, G.; Royston, P. Fractional polynomial model selection procedures: Investigation of the type I error rate. J. Stat. Comput. Simul. 2001, 69, 89–108. [Google Scholar] [CrossRef] [Scilit]
- Sauerbrei, W.; Kipruto, E.; Balmford, J. Effects of influential points and sample size on the selection and replicability of multivariable fractional polynomial models. Diagn. Progn. Res. 2023, 7, 7. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Brunton, S.L.; Proctor, J.L.; Kutz, J.N. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proc. Natl. Acad. Sci. USA 2016, 113, 3932–3937. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Champion, K.; Lusch, B.; Kutz, J.N.; Brunton, S.L. Data-driven discovery of coordinates and governing equations. Proc. Natl. Acad. Sci. USA 2019, 116, 22445–22451. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Udrescu, S.-M.; Tegmark, M. AI Feynman: A physics-inspired method for symbolic regression. Sci. Adv. 2020, 6, eaay2631. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cava, W.L.; Orzechowski, P.; Burlacu, B.; de França, F.O.; Virgolin, M.; Jin, Y.; Kommenda, M.; Moore, J.H. Contemporary symbolic regression methods and their relative performance. In Advances in Neural Information Processing Systems, Datasets and Benchmarks Track; NeurIPS: San Diego CA, USA, 2021; Volume 34. [Google Scholar]
- Aldeia, G.S.I.; Zhang, H.; Bomarito, G.; Cranmer, M.; Fonseca, A.; Burlacu, B.; Cava, W.L.; de França, F.O. Call for action: Towards the next generation of symbolic regression benchmark. In Proceedings of the 2025 Genetic and Evolutionary Computation Conference Companion; Association for Computing Machinery: New York, NY, USA, 2025; pp. 2529–2538. [Google Scholar]
- Golub, G.H.; Pereyra, V. Separable nonlinear least squares: The variable projection method and its applications. Inverse Probl. 2003, 19, R1–R26. [Google Scholar] [CrossRef] [Scilit]
- O’Leary, D.P.; Rust, B.W. Variable projection for nonlinear least squares problems. Comput. Optim. Appl. 2013, 54, 579–593. [Google Scholar] [CrossRef] [Scilit]
- Hong, J.H.; Zach, C.; Fitzgibbon, A. Revisiting the variable projection method for separable nonlinear least squares problems. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2017; pp. 5939–5947. [Google Scholar]
- Arlot, S.; Celisse, A. A survey of cross-validation procedures for model selection. Stat. Surv. 2010, 4, 40–79. [Google Scholar] [CrossRef] [Scilit]
- Williams, D.R. Planetary Fact Sheet–Metric, NASA Goddard Space Flight Center. Available online: https://ergodic.ugr.es/cphys/LECCIONES/ssolar/planetasdatos.html (accessed on 4 September 2026).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.