You are currently viewing a new version of our website. To view the old version click .
Mathematics
  • Article
  • Open Access

3 November 2019

Image Interpolation Using a Rational Bi-Cubic Ball

,
,
,
,
and
1
Fundamental and Applied Sciences Department, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, Seri Iskandar 32610, Perak DR, Malaysia
2
Fundamental and Applied Sciences Department and Centre for Smart Grid Energy Research (CSMER), Institute of Autonomous System, Universiti Teknologi PETRONAS, Bandar Seri Iskandar, Seri Iskandar 32610, Perak DR, Malaysia
3
Department of Information Science, College of Computing Sciences & Engineering, Kuwait University, P.O. Box # 5969, Safat 13060, Kuwait
4
Department of Mathematical Sciences, BUITEMS, Quetta 87300, Pakistan
This article belongs to the Special Issue Mathematical Modeling and Simulation in Science and Engineering Education

Abstract

This study deals with the application of new rational bi-cubic Ball function with six parameters in image interpolation, especially for the grayscale image. These six free parameters can be modified to get better and quality image resolution, and refine the shape of the interpolating surface. This bivariate rational Ball function has been extended from univariate cases by using a tensor product approach. The proposed scheme is tested for image upscaling with factors of two and four through an efficient algorithm. The effectiveness of the proposed scheme is measured by using an image quality assessment (IQA), such as peak-signal-to-noise-ratio (PSNR), root mean square error (RMSE) or feature similarity (FSIM) index. Numerical and graphical results with comparisons against some existing scheme are presented by using MATLAB. The proposed scheme resulted in higher PSNR and FSIM, and smaller RMSE. Thus, the new rational bi-cubic Ball with six parameters is better than the existing scheme via an efficient algorithm.

1. Introduction

Image scaling (up/down) is the task of resizing a digital image, that requires an image interpolation to obtain better resolution. Image interpolation is important in digital signal and image processing [1]. It is a tool that is widely used in image processing tasks, such as zooming, shrinking, rotating and for geometric corrections [2]. In fact, the technology of image processing is widely implemented in many areas such as medical, geology and forensic. There are numerous studies related to image processing and image interpolation due to its benefit to the industry. The technology of digital image processing appeared in the early 1960s through the introduction of the first computer. The moon is the first image taken by Ranger 7 on 31 July 1964 that was used for geometric correction [2]. From then until present, this topic has grown vigorously and lead multifarious research areas.
The common method for image interpolation is bi-cubic spline interpolation that is well documented in MATLAB as interp2 and imresize built-in functions [1]. However, bi-cubic spline requires more computational cost and memory compared to cubic spline. However, for many images, bi-cubic spline gives a higher peak signal-to-noise ratio (PSNR) and root mean square error (RMSE) value. Without a free parameter in the spline description, the user cannot alter the surfaces and images. To overcome this issue, many researchers have suggested various types of rational spline, such as the rational quartic spline, a rational cubic spline with a linear denominator and a rational cubic spline with a quadratic denominator [3,4,5,6,7,8,9] However, these methods suffer from the fact that some of them require the modification of the first partial derivative [3,4,5,6,7]. Researchers in [3,4,7,8] only consider true function value, i.e., where the first derivative is not supplied, and use only, at most, two parameters [10,11].
In early 1974, Ball introduced the main usage of the function to design a Boeing fuselage, as it has the capability to produce a conic section [12]. Majeed et al. [13] have investigated the application of a rational cubic Ball with two parameters for craniofacial reconstruction by utilizing the rational cubic Ball (curve) and reconstructing the curve of the images after doing the image detection to the outer part of the given images [14]. The proposed scheme will be used for image interpolation; i.e., image upscaling through an efficient algorithm. For example, if the original image has a size of about 256 × 256 pixels, then the image output is upgraded by a factor of two; i.e., 512 × 512 pixels. This is an effective topic in image processing, with recent challenges being to find the best function for upscaling images to specific needs, such as PSNR, RMSE and a feature similarity (FSIM) index. Table 1 and Table 2 show works of the existing scheme. Table 3 shows the list of abbreviations used in this study.
Table 1. Literature review.
Table 2. Summary on some related literature review.
Table 3. List of abbreviations.
Since the scheme with more free parameters gives the better quality of image interpolation (upscaling or downscaling), it motivated us to present a new rational bi-cubic Ball function with six parameters defined on rectangular meshes. The main objectives of study are stated as follows:
(a)
To propose a new rational bi-cubic Ball with six parameters.
(b)
To apply the proposed scheme in the application of image interpolation: image upscaling for grayscale images.
(c)
To compare the performance with the existing schemes, such as bi-cubic spline interpolation, nearest neighbor, bilinear interpolant and Karim and Saaban [11].
The remainder of this paper is structured as follows. Section 2 deals with construction of a bivariate rational Ball function with six parameters. The relevant research methodology is described in Section 3. The results and discussion are given in Section 4, while Section 5 is devoted to the conclusion.

2. Rational Bicubic Ball Function

This section discusses the construction of a bivariate rational Ball function with six parameters, which is actually the extension of a univariate rational Ball [18] by adopting tensor product technique.

2.1. A Rational Cubic Ball with Three Parameters

The data set { ( x i , f i ) ,   i = 1 ,   2 ,   ,   n } is given, where x 0 < x 1 < < x n with the first derivative d i ,   i = 1 ,   2 ,   ,   n . Let, h i = x i + 1 x i , Δ i = ( f i + 1 f i ) / h i and θ = ( x x i ) / h i , 0 θ 1 . On each subinterval [ x i , x i + 1 ] , i = 1 ,   2 ,   ,   n 1 . Thus, the rational cubic Ball interpolant with three parameters, α i , β i and γ i , i = 1 , 2 ,   ,   n 1 is defined as follows
S ( x ) S i ( θ ) = P i ( θ ) Q i ( θ )
where,
P i ( θ ) = α i f i ( 1 θ ) 2 + A i ( 1 θ ) 2 θ + B i ( 1 θ ) θ 2 + β i f i + 1 θ 2
Q i ( θ ) = α i ( 1 θ ) 2 + γ i ( 1 θ ) θ + β i θ 2
The rational function satisfies C 1 continuity as follows:
S ( x i ) = f i S ( x i + 1 ) = f i + 1
S ( x i ) = d i S ( x i + 1 ) = d i + 1
when x = x i ; then θ = 0 and x = x i + 1 ; then, θ = 1
A i = γ i f i + α i h i d i
B i = γ i f i + 1 β i h i d i + 1
Thus, the rational cubic Ball defined in Equation (1) can be written as:
S ( x ) = α i f i ( 1 θ ) 2 + ( γ i f i + α i h i d i ) ( 1 θ ) 2 θ + ( γ i f i + 1 β i h i d i + 1 ) ( 1 θ ) θ 2 + β i f i + 1 θ 2 α i ( 1 θ ) 2 + γ i ( 1 θ ) θ + β i θ 2

2.2. A Rational Bi-Cubic Ball with Six Parameters

The univariate Ball given in Equation (1) is extended to the bivariate case by adopting a similar approach to [11]. The rational bi-cubic functions over each rectangular patch [ x i ,   x i + 1 ] × [ y j ,   y j + 1 ] , where i = 0 ,   1 ,   ,   n 1 and j = 0 , 1 ,   ,   m 1 , with the first partial derivative at the starting point, on x -direction, y -direction (see Figure 1), and the mixed partial derivative with respective F i , j , F x i , j , F y i , j and F x y i , j . Let, h i = x i + 1 x i , h ^ j = y j + 1 y j , and θ = x x i h i and = y y i h ^ j , with 0 θ 1 and 0 1 . Thus, the rational bi-cubic Ball with six parameters addressed as α i , j , β i , j , γ i , j , α ^ i , j , β ^ i , j , γ ^ i , j > 0 , i = 0 ,   ,   n 1 and j = 0 ,   ,   m 1 , which is defined as below:
S i , j ( x , y ) = A i ( θ ) H i , j A j ( ) T
with
H i , j = [ F i , j F i , j + 1 F y i , j F y i , j + 1 F i + 1 , j F i + 1 , j + 1 F y i + 1 , j F y i + 1 , j + 1 F x i , j F x i , j + 1 F x y i + 1 , j F x y i , j + 1 F x i + 1 , j F x i + 1 , j + 1 F x y i + 1 , j F x y i + 1 , j + 1 ]
A i ( θ ) = [ a 0 ( θ ) a 1 ( θ ) a 2 ( θ ) a 3 ( θ ) ]
A j ( ) = [ a ^ 0 ( ) a ^ 1 ( ) a ^ 2 ( ) a ^ 3 ( ) ]
where,
a 0 ( θ ) = α i , j ( 1 θ ) 2 + γ i , j θ ( 1 θ ) 2 q i ( θ ) a 1 ( θ ) = β i , j θ 2 + γ i , j ( 1 θ ) θ 2 q i ( θ ) a 2 ( θ ) = α i , j h i ( 1 θ ) 2 θ q i ( θ ) a 3 ( θ ) = β i , j h i ( 1 θ ) θ 2 q i ( θ ) q i ( θ ) = α i , j ( 1 θ ) 2 + γ i , j ( 1 θ ) θ + β i , j θ 2
a ^ 0 ( ) = α ^ i , j ( 1 ) 2 + γ ^ i , j ( 1 ) 2 q j ( ) a ^ 1 ( ) = β ^ i , j 2 + γ ^ i , j ( 1 ) 2 q j ( ) a ^ 2 ( ) = α ^ i , j h ^ j ( 1 ) 2 q j ( θ ) a ^ 3 ( ) = β ^ i , j h ^ j ( 1 ) 2 q j ( ) q j ( ) = α ^ i , j ( 1 ) 2 + γ ^ i , j ( 1 ) + β ^ i , j 2
Figure 1. Pixel points of image.
After some mathematical derivation, the proposed rational bi-cubic Ball surface satisfies Equation (6) below:
{ H i , j ( 0 , 0 ) = F i , j H i , j ( 1 , 0 ) = F i + 1 , j H i , j ( 0 , 1 ) = F i , j + 1 H i , j ( 1 , 1 ) = F i + 1 , j + 1
Based on the observation towards the image refinement when the value of six free parameters in the description were being modified, the proposed rational bi-cubic Ball in Equation (5) can be reduced to a standard bi-cubic Hermite interpolation, where α i , j , β i , j , α ^ i , j , β ^ i , j = 1 and γ i , j , γ ^ i , j = 2 .

3. Application in Image Processing

In this section, an efficient algorithm to apply the proposed scheme into application grayscale image upscaling with factors two and four is introduced. The algorithm is comprised of several steps which are elaborated in a flowchart, as shown in Figure 2.
Figure 2. Flowchart steps of image scaling.

3.1. An Efficient Algorithm for Image Upscaling Using a Rational Bi-Cubic Ball

An efficient algorithm was constructed to implement the proposed scheme in application of image interpolation with grayscale image upscaling. This algorithm requires an input image and parametric values to start the first step. The size of image in pixels can be read as m × n corresponding to vector form that refers to the pixel points that would be interpolated. Figure 2 displays the steps of image (up/down) scaling for factors with even numbers.

3.2. Image Quality Assessment

Image quality assessment (IQA) is used to perceive the quality of the image in many terms, such as peak-signal-to-noise-ratio (PSNR), root mean square error (RMSE) or feature similarity (FSIM) index. In addition, the standard mean square error (MSE) does not have the capability of the human visual system (HVS), to understand an image mainly according to its low-level features [19]. Table 4 provides the lists of terminologies and symbols used in Equations (7)–(9).
Table 4. List of symbols.
The value of PSNR, RMSE and FSIM is defined as follows:
(a)
Peak signal-to-noise ratio (PSNR)
P S N R = 10   log 10 255 2 M S E
where,
M S E = 1 m n i = 0 n j = 0 m | z i j z ¯ i j | 2
(b)
Root mean square error (RMSE)
R M S E = 1 m n i = 0 n j = 0 m | z i j z ¯ i j | 2
(c)
Feature similarity (FSIM) index on the domain Ω
F S I M = x Ω S P G C ( x ) · P C m ( x ) x Ω P C m ( x ) , x ϵ Ω
where,
S P C G ( x ) = [ S P C ( x ) ] · [ S G M ( x ) ]
with
S P C ( x ) = 2 P C O ( x ) · P C I ( x ) + T P P C O 2 ( x ) + P C I 2 ( x ) + T P ,   S G M ( x ) = 2 G M O ( x ) · G M I ( x ) + T G G M O 2 ( x ) + G M I 2 ( x ) + T G

3.3. Parameter Selection

The parametric values are required as inputs to run the proposed function that is used to interpolate the tested image. The parameter selection was done by simulation using MATLAB software version 2015 on version on an Intel® Core™ i5-8250U 1.60 GHz. The stopping criteria used was a PSNR value. If the PSNR value is higher, then the scheme gives a better interpolation image [1]. Figure 3 below shows the steps of parameter simulation:
Figure 3. Flowchart steps of image scaling.
The parametric values for α i , j , β i , j , γ i , j , α ^ i , j , β ^ i , j and γ ^ i , j are varied from lowest value, 0.1, to the highest (optimum value) until the highest PSNR is reached. The list of parameters with different values for the image of “fishing boat” are explained in Table 5, where P1–P27 are the parametric values, and the impact of the parameter set towards PSNR is illustrated graphically in Figure 4 and Figure 5. Based on the Figure 4 and Figure 5, the highest PSNR value obtained among the parameter set (P1–P27) is P10, with values 39.80 and 38.02 for the factors 2 and 4, respectively. Hence, parameter set P10 is used as reference to alter the value of each parameters as shown in Table 6. Table 7 displays the list of parametric values that used in proposed function for all tested images for image upscaling with the factors two and four respectively.
Table 5. The impact of parametric values on the peak signal-to-noise ratio (PSNR) values.
Figure 4. The impact of the parameter set towards PSNR for image upscaling with factor two.
Figure 5. The impact of parameter set towards PSNR for image upscaling with factor four.
Table 6. The impact of parameter values on PSNR values.
Table 7. Parameter value for image upscaling.

4. Result and Discussion

In this section, the proposed rational bi-cubic Ball image interpolation scheme as defined in Equation (5) is tested and compared with some existing scheme. Ten tested grayscale images with size 256 × 256 pixels were chosen, and are shown in Figure 6. The tested images were done with sampling with factors two or four first, to get low-resolution which later one re-upscale with the same factor using the proposed rational bi-cubic Ball function.
Figure 6. The original tested images used for image upscaling; (a) fishing boat; (b) baboon; (c) couple; (d) watch; (e) man; (f) girl; (g) city; (h) sails; (i) dome; (j) house.
The comparison results in terms of PSNR, RMSE and FSIM between the proposed scheme and others are denoted BB. Some existing schemes, such as the conventional method for interpolation are denoted as follows: nearest neighbor (NN), bilinear (BL) and bi-cubic spline (BC), bi-cubic Hermite (BH) and Karim and Saaban [11] (KS). They are shown in Table 8, Table 9 and Table 10. Concerning overall results, we have concluded the proposed scheme gives better results for almost all images, as highlighted in the Table 8, Table 9 and Table 10, compared to existing schemes for various types of IQA used in this study.
Table 8. Comparison results in terms of PSNR.
Table 9. Comparison results in terms of root mean square error (RMSE).
Table 10. Comparison results in terms of feature similarity (FSIM) index.
Figure 7 and Figure 8 show the comparison of PSNR values between image upscaling with factors two and four. Meanwhile, Figure 9 and Figure 10, show the bar charts for the RMSE values for factors two and four, respectively. Figure 11 and Figure 12, show the FSIM values for image upscaling with factors two and four, respectively. Figure 7, Figure 8, Figure 9, Figure 10, Figure 11 and Figure 12 were obtained by using the information gathered in Table 8, Table 9 and Table 10.
Figure 7. A comparison of schemes in regard to PSNR for image upscaling with a factor of two.
Figure 8. A comparison of schemes in regard to PSNR for image upscaling with a factor of four.
Figure 9. A comparison of schemes toward RMSE for image upscaling with a factor of two.
Figure 10. A comparison of schemes toward RMSE for image upscaling with a factor of four.
Figure 11. A comparison of schemes toward FSIM for image upscaling with a factor of four.
Figure 12. Comparison of schemes toward FSIM for image upscaling with a factor of four.
From the numerical experiments by using ten different grayscale images, we found that the proposed scheme, i.e., the rational bi-cubic Ball function, gave higher PSNR values for all images compared with well-established schemes; i.e., bilinear, nearest neighbor, bi-cubic Hermite spline, bi-cubic spline and Karim and Saaban [11]. Image upscaling with a factor of two gave higher PSNR values compared with image upscaling with a factor of four. The main reason is that, to upscale the image four times, then the size of the images will be four times larger than the original image. This will result the low quality, to an extent, in the upscaled images. But the results still better than the other five schemes. In term of FSIM, we found that for all images the proposed scheme is better than the other schemes, as can be seen in Table 10. Finally, in terms of RMSE, we found that the proposed scheme gave smaller value for most images. The results were obtained by simulation to find the best parametric values that would give the best results. This can be considered a new finding, since in [11] there were no free parameters to refine the image interpolation.

5. Conclusions

The numerical comparison of the rational bi-cubic Ball with the existing schemes has been done in detail, and the results show that the proposed scheme gives comparable results, with some advantages. Based on Figure 13 and Figure 14, it can be seen clearly that the proposed scheme can improve the image quality after rescaling with factors of two and four, compared to existing schemes and conventional methods. Moreover, the proposed scheme is a good alternative to the existing scheme for all tested images and we can achieve a smaller error. We conclude that, based on PSNR, RMSE and FSIM, and comparison with all five schemes, the proposed scheme is better. For future research, we intend to apply the genetic algorithm (GA) to determine the optimum parameters automatically. Furthermore, the proposed scheme can be implemented in different applications of image interpolation, such as image zooming and image rotation.
Figure 13. The interpolating image upscaling with a factor of two: (a) nearest neighbor; (b) bilinear; (c) bicubic; (d) bicubic Hermite; (e) Karim and Saaban [11]; (f) the proposed method.
Figure 14. The interpolating image upscaling with a factor of four: (a) nearest neighbor; (b) bilinear; (c) bicubic; (d) bicubic Hermite; (e) Karim and Saaban [11]; (f) the proposed method.

Author Contributions

Conceptualization, N.A.B.Z. and, S.A.A.K.; formal analysis, M.S., A.G. and K.S.N.; software, N.A.B.Z., S.A.A.K., A.B.S. and M.S.; writing—original draft, N.A.B.Z., S.A.A.K., A.B.S. and M.S.; writing—review and editing, S.A.A.K., A.G. and K.S.N.

Funding

This study was fully supported by the Universitas Islam Riau (UIR), Pekan baru, Indonesia and the Universiti Teknologi PETRONAS (UTP), Malaysia, through International Collaborative Research Funding (ICRF): 015ME0-037, and Universiti Teknologi PETRONAS (UTP), through its research grant YUTP:0153AA-H24. The first author is sponsored by UTP’s under Graduate Assistant Scheme.

Acknowledgments

The authors would like to thanks to Universiti Teknologi PETRONAS (UTP) for providing MATLAB software for the implementation of the algorithm.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Charbit, M.; Blanchet, G. Digital Signal and Image Processing Using MATLAB (ISTE). Wiley-ISTE: Great Britain, UK, 2006. [Google Scholar]
  2. Wood, G.; Gonzalez, R.C. Digital Image Processing; Pearson Education Inc.: Upper Saddle River, NJ, USA, 2010. [Google Scholar]
  3. Gao, S.; Zhang, C.; Zhang, Y. A New Algorithm for Image Resizing Based on Bivariate Rational Interpolation. In International Conference on Computational Science; Springer: Berlin/Heidelberg, Germany, 2009; pp. 770–779. [Google Scholar]
  4. Gao, S.; Zhang, C.; Zhang, Y.; Zhou, Y. Medical image zooming algorithm based on bivariate rational interpolation. In International Symposium on Visual Computing; Springer: Berlin/Heidelberg, Germany, 2008; pp. 672–681. [Google Scholar]
  5. Wang, Q.; Tan, J. Multi-focus image fusion algorithm based on rational spline. In Proceedings of the 2007 10th IEEE International Conference on Computer-Aided Design and Computer Graphics, Beijing, China, 15–18 October 2007; pp. 225–229. [Google Scholar]
  6. Yao, X.; Zhang, Y.; Bao, F.; Zhang, C. Rational Spline Image Upscaling with Constraint Parameters. Math. Comput. Appl. 2016, 21, 48. [Google Scholar] [CrossRef]
  7. Zhang, C.Q.; Zhang, Y.N.; Zhang, C.M. Surface Constraint of a Rational Interpolation and the Application in Medical Image Processing. Res. J. Appl. Sci. Eng. Technol. 2012, 4, 3697–3703. [Google Scholar]
  8. Zhang, Y.; Gao, S.; Zhang, C.; Chi, J. Application of a bivariate rational interpolation in image zooming. Int. J. Innov. Comput. Inform. Cont. 2009, 5, 4299–4307. [Google Scholar]
  9. Lakshman, H.; Lim, W.-Q.; Schwarz, H.; Marpe, D.; Kutyniok, G.; Wiegand, T. Image interpolation using shearlet based iterative refinement. Signal Process. Image Commun. 2015, 36, 83–94. [Google Scholar] [CrossRef]
  10. Hussain, M.Z.; Abbas, S.; Irshad, M. Quadratic trigonometric B-spline for image interpolation using GA. PLoS ONE 2017, 12, e0179721. [Google Scholar] [CrossRef] [PubMed]
  11. Karim, S.A.A.; Saaban, A. Shape Preserving Interpolation Using Rational Cubic Ball Function and Its Application in Image Interpolation. Math. Probl. Eng. 2017, 2017, 7459218. [Google Scholar] [CrossRef]
  12. Ball, A. CONSURF. Part one: Introduction of the conic lofting tile. Comput. Des. 1974, 6, 243–249. [Google Scholar] [CrossRef]
  13. Majeed, A.; Piah, A.R.M.; Yahya, Z.R.; Abdullah, J.Y.; Rafique, M. Construction of occipital bone fracture using B-spline curves. Comput. Appl. Math. 2017, 37, 2877–2896. [Google Scholar] [CrossRef]
  14. Majeed, A.; Piah, A.R.M.; Yahya, Z.R. Surface Reconstruction from Parallel Curves with Application to Parietal Bone Fracture Reconstruction. PLoS ONE 2016, 11, e0149921. [Google Scholar] [CrossRef] [PubMed]
  15. Abbas, S.; Hussain, M.Z.; Irshad, M. GA Based Rational cubic B-Spline Representation for Still Image Interpolation. Pak. J. Stat. Oper. Res. 2016, 12, 753–763. [Google Scholar] [CrossRef]
  16. Abbas, S.; Hussain, M.Z.; Irshad, M. Image interpolation by rational ball cubic B-spline representation and genetic algorithm. Alex. Eng. J. 2018, 57, 931–937. [Google Scholar] [CrossRef]
  17. Saaban, A.; Kherd, A.; Jameel, A.F.; Akhadkulov, H.; Alipiah, F.M. Image enlargement using biharmonic Said-Ball surface. J. Phys. Conf. Ser. 2017, 890, 012086. [Google Scholar] [CrossRef]
  18. Karim, S.A.A. Shape preserving by using rational cubic ball interpolant. Far East J. Math. Sci. 2015, 96, 211. [Google Scholar]
  19. Zhang, L.; Zhang, L.; Mou, X.; Zhang, D. FSIM: A Feature Similarity Index for Image Quality Assessment. IEEE Trans. Image Process. 2011, 20, 2378–2386. [Google Scholar] [CrossRef] [PubMed]

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.