Next Article in Journal
Use of a Dielectric Sensor for Salinity Determination on an Extensive Green Roof Substrate
Previous Article in Journal
HGT: A Hierarchical GCN-Based Transformer for Multimodal Periprosthetic Joint Infection Diagnosis Using Computed Tomography Images and Text
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Approach for 3D Modeling of the Regular Relief Surface Topography Formed by a Ball Burnishing Process Using 2D Images and Measured Profilograms

1
Department of Mechanical Engineering and Machine Tools, Technical University of Varna, 9010 Varna, Bulgaria
2
Department of Mechanics and Machine Elements, Technical University of Varna, 9010 Varna, Bulgaria
3
Department of Communication Engineering and Technologies, Technical University of Varna, 9010 Varna, Bulgaria
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(13), 5801; https://doi.org/10.3390/s23135801
Submission received: 15 May 2023 / Revised: 19 June 2023 / Accepted: 19 June 2023 / Published: 21 June 2023
(This article belongs to the Topic Applications in Image Analysis and Pattern Recognition)

Abstract

:
Advanced in the present paper is an innovative approach for three-dimensional modeling of the regular relief topography formed via a ball burnishing process. The proposed methodology involves capturing a greyscale image of and profile measuring the surface topography in two perpendicular directions using a stylus method. A specially developed algorithm further identifies the best match between the measured profile segment and a row or column from the captured topography image by carrying out a signal correlation assessment based on an appropriate similarity metric. To ensure accurate scaling, the image pixel grey levels are scaled with a factor calculated as being the larger ratio between the ultimate heights of the measured profilograms and the more perfectly matched image row/column. Nine different similarity metrics were tested to determine the best performing model. The developed approach was evaluated for eight distinct types of fully and partially regular reliefs, and the results reveal that the best-scaled 3D topography models are produced for the fully regular reliefs with much greater heights. Following a thorough analysis of the results obtained, at the end of the paper, we draw some conclusions and discuss potential future work.

1. Introduction

Mechanical processing of machine parts is a crucial aspect in various industries, including machine building, aircraft and shipbuilding, automotive manufacturing, etc., and it involves designing and conducting operations that are likely to have a profound impact on the quality characteristics of the machine parts’ contact surfaces, with an immediate effect on the operational performance of the corresponding units as a result. The accuracy of dimensions and shape, along with the quality of the mechanical surfaces, is largely dependent on the resultant surface topography. Applying traditional mechanical finishing operations, such as finishing milling, turning, grinding, etc., produces noticeable changes in the quality of the surface topography, which is normally assessed based on the roughness obtained. International standards for surface texture description, such as ISO 21920-2:2022 (profile) [1] and ISO 25178-2:2021 (areal) [2], prescribe a full range of roughness criteria that can be used to describe the characteristics of the mechanical surface topography. The profile topography criteria defined in ISO 21920 is generally suitable for most mechanical surfaces obtained after the finishing process, given the uniform, albeit stochastic, distribution of their roughness. Attaining close values for the roughness criteria, thus, pre-supposes the inconsequentiality of the precise section of the machined surface within which the topographic profile will be measured.
Mechanical surfaces, however, subject to some finishing operations, will easily acquire radically different topography characteristics when compared to traditional surfaces. For instance, the so-called “regular reliefs” (RR), which are produced through the process of ball-burnishing as a finishing operation, are included in that category. Ball burnishing (BB) is a finishing process in which a hard ball of known diameter is pressed firmly against the machined surface, causing plastic deformation (when cold) to occur in the surface layer of the material [3]. When the deform tool follows a complex toolpath trajectory, which occurs as it moves during the BB-operation performed on a CNC lathe or milling machines [4,5], specific RR patterns are imprinted onto the burnished surface. As can be seen in Figure 1a, the areal topography of fully-RR BB-operation is a pattern of comparatively regularly spaced “dimples”, which are created upon the crossing of the plastically deformed traces inscribed using the deform tool.
According to the RR classification [3,6] there are five distinct types of regular reliefs, with the first three of them pertaining to partially regular reliefs, while the last two types refer to fully regular reliefs. A “fully regular relief” means that the plastically deformed traces, which are left behind by the deform tool, cover the burnished surface completely without any remaining “islands” with residual topography from the preceding cutting operation, as opposed to the partially-RR. Each of the five types of RR could be imprinted onto the burnished surface relative to the pre-set BB-process regime parameters. When a BB operation is performed via a CNC machine, the shape and size of the RR cells can vary to a considerable extent [7]. Thus, for example, the cells from a fully-RR topographic representation are generally expected to span the range of 15–150 μm (according to Sz-criterion from ISO 25178-2:2021 [2]) with regard to the burnished material characteristics, the deforming ball diameter, and applied deforming force, while the presumed length of the RR cells borders is likely to exceed 1600 μm. These particular parameters, taken together with the comparatively high recurrence rates of the cells in the X-Y plane, help establish the BB-process-based RRs as a geometric deviation based on “waviness” rather than “surface roughness”. Unlike the traditional mechanical textures, the RR textures retain more lubricants and products of wear within their furrowed dimples. The roughness of the plastically deformed surface within the cells is very low, and the radii of the ridges (i.e., the borders of the cells) are much bigger than those obtained via some other well-known finishing operations. The resulting properties make them well suited for application in heavy loaded units, transport systems, and vehicles that are subjected to harsh operating conditions and are equipped with sliding pairs, metal-rubber joints, couplings, sealing systems, etc.
It is of utmost importance for the RR topographic characteristics to be accurately determined in order to predict their prospective operational behavior or compare them with textures obtained through the adoption of other finishing techniques. Regrettably, the widespread methods for surface topography measurements present an enormous challenge to the RRs. For instance, a single profile, which is measured in a given section, does not give reliable results for the RR topographic criteria, as defined by standards ISO 21920-2:2021 (or former ISO 4287 [8]). This problem occurs because the measured topography profile is conditioned by the section and direction of the stylus of the contact roughness measuring device. Figure 1a depicts four random directions of measuring the surface profile, with the corresponding measured profiles towards these directions being constructed in Figure 1b–e.
As outlined in Figure 1b–e, the profiles derived in the different sections for the same RR topography display a wide disparity both along the profile and in a vertical direction. Hence, if the RR topographic features are determined via a single profile measurement in only one section, the results obtained, in all probability, will be highly controversial. Using the areal approach, in line with the established criteria set forth in the ISO 25178-2:2021 [2] standard, seems more relevant to the case under study. There are many commercial 3D texture measuring devices available nowadays, which use different approaches for contact and non-contact measuring of the surface topography, which is in agreement with the classification specified in ISO 25178 standard, part 6 [9]. Non-contact measuring devices offer significantly higher accuracy and comparatively faster scanning capabilities compared to their contact-based counterparts [10,11,12,13]. Non-contact methods present certain drawbacks, such as the requirement for a specific level of reflectivity in the scanned texture, the non-transparency of the sample material, uneven measurement step in height, etc.
The relatively high cost of the non-contact measuring devices, which could reach several hundred thousand USD relative to their specific characteristics, remains an almost insurmountable obstacle to their common utilization. Another significant constraint on the use of non-contact devices is their limited scanning area, which is characteristic of the cheaper versions in particular, where the dimensions can be generally as small as a few tens or hundreds of micrometers at the expense of the high scanning resolution in height. Such a limited measurement area, however, cannot accommodate even a single cell of the RR, let alone a larger pattern of RR cells to be scanned in its entirety. Alternatively, contact 3D profilometers offer a more cost-effective solution, albeit with a lower resolution in both lateral and height directions, as well as lower scanning speed.
The focus of research is currently shifted towards the possibility of machining processes that incorporate artificial intelligence (AI) and deep learning (DL) techniques for automation control in manufacturing operations and their output. Computer vision (CV), which is one of the fields of AI [14], involves training computers via specially developed algorithms to interpret data from digital image(s) or video(s) in order to recognize objects, patterns, colors, surface characteristics, and other elements. Over the years, numerous research studies reported results related to the CV techniques and algorithms in mechanical processing of machined parts. For instance, CV is used to perform reverse engineering of machine parts [15,16,17], automatic tool selection in computer numerically controlled (CNC) lathe and milling machines [18,19], calculation of the machining time of cutting tools using machined parts images [20], automatic programing, and control of CNC machines [21,22,23], etc. Computer vision techniques are also used in micro-scale surface texture characterization of machined surfaces [24,25], automotive cylinder liner surfaces [26], surface topography using shape from shading [27], nanoscale measurements of diamond machined polar and mixed microstructures [28,29,30,31], micro vision-based precision motion measurements [32], reconstructing high-resolution images from low-resolution images [33], etc.
Several other specific methods used for 3D reconstruction from 2D images of large-scaled objects can be seen in studies by Schonberger et al. [34], Hongmin et al. [35], Gao et al. [36], Munkberg et al. [37], and Fan et al. [38]. They explore different techniques used to obtain three-dimensional reconstruction of urban and/or indoor scenes, which are based on ordered or disordered multi-image sets. One method is to use multiple cameras to capture the reconstructed object from multiple sides through different angles or a single photo- or video-camera that moves around the object and capture images during a certain time interval are used for that purpose. According to the specificity of RRs, they are not directly applicable to their three-dimensional reconstruction for the following reasons: their purpose is to reconstruct a three-dimensional model of the entire object (building, neighbor-hood, or theater hall), rather than the topography of a single surface; the accuracy of the reconstructed model will be relatively high, albeit only compared to the large scale of the objects; and these methods require a large number of captured object images (sometimes more than 150k images), as well as computers with very large random access memory (RAM) and faster processors to complete calculations in a reasonable time interval.
Developed in several research works is the conclusive argument that the long-established approaches [39,40,41] for surface topography recognition could be applied not only for micro- and nanoscale surface textures, but also for the identification of larger-scale textures, such as the RRs discussed above. Given that the scale of a RR is much larger than that of a diamond machined microstructure, it is reasonable to assume that many of the distracting factors influencing the results of micro- and nano-scale measurements will be less pronounced in such a context. This fact will enable the application of 2D images with moderate resolution and cost-effective measuring equipment for the digital recreation of a RR’s topography. The primary objective of the current paper, therefore, is to examine the feasibility of developing a technique for rapid three-dimensional RR topography modeling with the help of two-dimensional greyscale images and profilograms measured via a roughness tester with a stylus.

2. Materials and Methods

The proposed methodology was based on the approach outlined in [24], which applied a machine vision technique to contrast two-dimensional grayscale images with stylus-measured profiles in order to provide a careful assessment of the roughness of mechanically processed surfaces. Obtaining a three-dimensional representation of the RR’s topography was accomplished through three main stages. The first stage involved obtaining the appropriate two-dimensional RR image and its subsequent filtering to compensate for the concomitant image distortions and noise. Identified, at this stage, was the image row and the column with the maximum difference between the highest and lowest values of the pixel grey levels. Employed, in the second stage, was a stylus profilometer to measure the actual RR profile heights in two perpendicular sections, acting as close as possible to the previously identified rows and columns with maximum grey level differences. However, due to the intrinsic difficulty in synchronizing the identified row and column from the RMR image and the profile-measured section, another algorithm was developed to establish the highest level of correlation between the image rows/columns and the real profiles from the measured RR. Once the highest correlation level was established, the scaling factor was calculated as the ratio between the measured profile height and the difference between the highest and lowest pixel grey level values of the row/column. In the final step, the remaining rows/columns from the topography image (TI) were scale limited with the obtained scaling factor. A detailed explanation of the proposed approach, which was based on Python programing language and corresponding libraries, is provided below.

2.1. Methodology for Obtaining a Two-Dimensional Image of the RR Topography

A square area from the RR topography was photographed using trinocular head microscope and 14-megapixel CMOS digital camera with high resolution (see Figure 2a,b). To capture an accurate surface image, it was essential to use a diffuse light source that emitted equalized light from all directions, which was compatible with the pattern being discussed. A diffuse circular video lamp (or so-called “halo-lamp“) was considered quite appropriate for that purpose as it is immovably fixed. To illuminate effectively the RR patterns, it was necessary to ensure that the angle of the light source and the pattern plane is sufficiently low to simulate the conditions of a sunrise or sunset in the mountains, where the peaks are brightly illuminated and the valleys remain dark. This approach minimized the presence of glare from the metallic smooth inner surfaces of the RR cells in the CMOS sensor and helped achieve a clear-cut distinction between the peaks and the valleys.
The values of α (the angle of light) were limited by the dimensions of the halo lamp and the microscope. The angle measurement was performed via simple trigonometric calculations, such as measuring the inner diameter of the circular lamp and the distance between the light emitting plane and the top surface of the RR specimen. The angular measurement of the light direction was selected as a method to facilitate further redesign of the experiment should other equipment with distinctive design and/or dimensions be used.
The pictures obtained in this way were recorded as raster graphic images in bitmap (BMP) files with resolutions of n × n pixels. They had an 8-bit grey level value, i.e., the height range is between 0 and 255, allowing a three-dimensional expression of the RR texture. The 0–255 range provided an ample scale for the RRs as their actual height rarely exceeds 150 μm. The ball-burnished RR textures occasionally contained some fine defects, such as scratches, residual roughness from previous machining, micro-indentations from solid particles, dust, etc., which caused a sharp change in the gray level of a given pixel relative to its neighboring pixels. For the roughness component and surface defects to be filtered, a Gaussian filter [42] was applied to gently smooth the captured images. Prior to applying Gaussian filter, however, the digitalized RR topography was flattened at the base to level the pixels grey values throughout the entire image area. A levelling technique was employed for that purpose, which was based on a mean plane fitted via the Least Squares Method (LSM) [43]. The algorithm for the BMP image processing of the RR topography is illustrated in Figure 3.
The pixel level of every RR TI was scale limited within a 0–255 range, irrespective of the actual texture height, which was likely to result in incorrect proportions when attempting to attain the topography of the RRs.
To obtain an accurate three-dimensional topography representation, therefore, the recorded pixel grey levels in the image matrix were scale limited according to the actual height of the RR. As displayed in Figure 1, a single profile measured in random direction may not produce a truthful representation of the RR topography. Thereupon, to determine the most appropriate section for measuring the height of the surface profile, the stylus traverse direction was parallel to the RR’s TI boundaries. The most suitable fragment for profile measuring was the row (or column) featuring the largest difference between the maximum and minimum grey levels of the pixels. The algorithm (see Figure 3), accordingly, reiterated all rows and columns of the levelled and filtered image, calculating the maximum differences between the highest and lowest pixel levels for each of them. The output was the row (or the column) index with the maximum detected profile heights, which could be used as pointers to pinpoint the section of the RR topography area where, at the subsequent stage, the profiles were to be measured through the assistance of a profilometer.

2.2. Methodology for Scalling the Height of the RRs TI

2.2.1. Obtaining the Best Match between the Measured Profilogram Segment and TI Rows or Columns

The RR topography heights were measured using a stylus profilometer in close proximity to the previously identified optimal sections, as previously explained. The stylus, however, being located on the underside of the detectors, was likely to pose an enormous challenge in determining its exact positioning on the established optimal section (i.e., row or column) via the algorithm described in Figure 3. To compensate for the resulting positioning error, we developed an algorithm to search for the best match between the measured profile and a corresponding row (or column) of the topographic image matrix (see Figure 4).
In step 4 of the algorithm depicted in Figure 4, the measured profilogram was synchronized for each row of the image, meaning that the peaks overlapped as much as possible, generating a “signal”, as specified by the signals theory, that could be subjected to a signal cross-correlation evaluation [44]. The vector of the image row being explored, which contained the pixel grey levels and acted as a kernel, was shifted at distance m against vector x while bearing the heights measured using the profilogram. The signal cross-correlation is calculated as follows:
ρ xy m = 1 N i = 1 N x i m x ¯ · y i y ¯ 1 N i = 1 N x i x ¯ 2 · 1 N i = 1 N y i y ¯ 2
where:
-
ρ xy m —the cross-correlation value between x and y vectors for given m ;
-
m —the phase shift between x and y vectors’ elements;
-
x i —a vector, which contains the measured profilogram heights at position i;
-
x ¯ —the average height of the measured profilogram;
-
y i —a vector, which contains the image row (or column) heights at position i ;
-
y ¯ —the average height of the image rows (or columns).
-
N —the number of the image row vector’s elements (i.e., row pixels).
Stylus profilometers were generally equipped with frequency response filters to distinguish between waviness and roughness. The software tools that collected and processed the measured roughness data could handle both unfiltered and filtered forms. To achieve a more rigorous match between the measured profile of the topography and the rows (or columns) from the captured image, a waviness profile with filtered roughness was implemented. Ensuring that the two filters that were applied to the image and the profilogram had analogous settings was crucial in the attainment of the highest possible degree of similarity. The resolution of the RR’s TI had to be selected in line with the size of the measured area and the actual stylus tip radius being employed. For instance, if the stylus tip radius is 5 μm, the size of the single square pixel from the RR’s TI should also be 5 μm. Failure to adhere to this requirement could result in serious discrepancies between the profilograms collected from the image rows (and columns) and those measured using the profilometer stylus, which, in turn, could lead to an unrealistically low degree of similarity.

2.2.2. Measures Utilized in the Evaluation of the Vector Degree of Similarity

Determining the highest degree of similarity (as shown in step 7 of the algorithm in Figure 4) required the adoption of several alternative criteria (or measures) based on numerous existing approaches from statistics, signal theory, machine learning, etc., that are employed in the assessment of the degree of correlation between data vectors, curves, and strings [45]. Reference was made to the following correlation approaches [46,47]: Pearson’s Correlation Similarity (PCS) [48,49], Spearman’s Correlation Similarity (SCS) [48], Mean Absolute Error (MAE) [50], Mean Square Error (MSE) [51], Cosine Similarity (CS) [52], Difference in Area method (DA) [53], Hamming’s Distance (HD) [54,55], Damerau–Levenshtein’s Distance (DLD) [56], and Discrete Fréchet’s Distance (DFD) [57,58]. Due to the different range limits in which the methods mentioned above tend to calculate the degree of correlation between the examined datasets, they needed to be scale limited between 0 and 1 to ensure a close comparison of the results hereto obtained. To that effect, the approaches described below were used for dataset normalization. They were derived in such a way that if the obtained quantitative assessment tended to 0, the degree of correlation was considered low, and if it tended to 1, the evaluated data had a high degree of correlation.
(a)
Similarity based on PCS: the PCS is a measure based on the statistical Pearson’s moment-product and involves pairing the compared data vectors and considering their respective heights as vectors with random variables. The Pearson’s correlation coefficient for each pair of vectors is calculated via the formula:
S PCS = x i x ¯ y i y ¯ Σ x i x ¯ 2   Σ y i y ¯ 2  
where:
  • S PCS —the similarity measure using the Pearson’s correlation;
  • x i —a vector, which contains the measured profilogram heights at position i ;
  • x ¯ —the average height of the measured profilogram;
  • y i —a vector, which contains the image’s row (or column) heights at position i ;
  • y ¯ —the average height of the image’s rows (or columns).
In the case of a linear relationship between the compared vectors, the S P C S coefficient values can range from 1 to −1. If the height values of both vectors are identical and there is no phase shift between them, S PCS = 1 , and conversely, if there is a 180 degree phase shift, S PCS = 1 . In reality, the likelihood that this metric would fall within the (0, −1) range was negligible due to the initial phase adjustment performed during the cross-correlation evaluation between the profile segments in step 4 of the algorithm (see Figure 4).
(b)
The SCS assessment relies on Spearman’s correlation, which is a statistical measure used to determine the degree of association between paired vector values. It should be noted that the data in the compared vectors have to be ordinal. The equation for determining the SCS coefficient calculation is as follows:
S SCS = 1 6 Σ D 2 n n 2 1
where:
  • S SCS —the similarity measure using the Spearman’s correlation;
  • D—the difference between a ranked pair;
  • n—the number of ranked pairs.
One crucial distinction between the PCS and SCS refers to the sensitivity of the Spearman’s coefficient to non-linear relationships between the pair of vectors under comparison. This specific feature proved particularly useful in accounting for the impact of random noise on the resultant grey values of image rows of pixels.
(c)
The MAE is a statistical measure that evaluates the average absolute difference (or absolute error) between paired values from the compared vectors. The equation applicable for calculating the normalization is as follows:
S MAE = 1 i = 1 n y i x i n
where:
  • S MAE —the similarity measure using the Mean Absolute Error;
  • y i —the normalized height value of TI row at position i ;
  • x i —the normalized height value of profilogram segment at position i ;
  • n —the number of pixels/points of the vectors compared.
(d)
The MSE similarity measure is calculated as follows:
S MSE = 1 i = 1 n y i x i 2 n
where:
  • S MSE —the similarity measure using the Mean Square Error;
  • y i —the normalized height value of TI row at position i ;
  • x i —the normalized height value of profilogram segment at position i ;
  • n —the number of pixels/points of the vectors compared.
Given the normalization of the two vectors compared, both the S MAE and S MSE range presupposes grades within the scope of 0 and 1. The resulting metrics for both vectors were interpreted in the same way: if the value was close to 1, the paired vectors had very high correlation, while a value close to 0 established that a vector pair had a very low correlation.
(e)
In the CS measure, each data vector in the pair was considered to be a vector in an N-dimensional space, where N is the number of the elements involved. This assumption enabled the evaluation of the similarity between each pair of vectors based on the cosine of the angle between them. The equation for calculating the cosine similarity can be expressed as follows:
S CS = cos θ = x y x y
where:
  • S CS —the similarity measure using the cosine values between vectors;
  • x —an image row with pixel heights as an N-dimensional vector,
  • y —a measured profilogram segment as an N-dimensional vector,
  • θ —the angle between the vectors x and y ,
  • x —the length of the vector x ;
  • y —the length of the vector y ;
If the two compared vectors share the same direction, the angle between them will be 0°. Since cos 0 ° = 1 , the value of the CS measure will, therefore, be 1.
The CS is widely used in language processing applications to measure the degree of similarity between two texts’ documents and paragraphs by counting the presence of the specific keywords. The advantage of the CS is that the similarity degree between the N-dimensional vectors is affected by their general direction rather than their length. This fact allowed a comparison between the vectors with different magnitudes of values. In the present methodology, the CS measure was close to 1 when the compared vectors exhibited perfect phase synchronization between their profile peaks and valleys.
(f)
HD can be defined as the number of positions at which two vectors differ. HD metric is herein applied as an 8-bit representation of the paired vectors with a finite number of symbols used, resulting in an alphabet consisting of 256 letters. The HD measure, based on the number of differences found between the two compared vectors, is calculated via the following equation:
S HD = 1 N diff n
where:
-
S HD —the similarity measure using HD
-
N diff —the number of differences found between compared vectors;
-
n —the number of elements of the compared vectors.
When the values of the compared vectors are close to each other, the HD measure will give values near to 1, and conversely, if they are completely different, the HD measure will be 0.
(g)
DLD is a string metric designed to measure the difference degree between two strings (or sequences): v1 and v2. It can be defined as the minimum number of insertions, deletions, or substitutions required to transform v1 into v2. This metric allowed the use of different weights for insertion, deletion, and substitution, making it possible to compare short segments between two strings (i.e., vectors) that were the same but differ only in terms of their starting positions within the given sequence. The DLD measure is computed via the following equation:
S DLD = 1 DLD n
where:
-
S DLD —the similarity measure calculated using DLD
-
DLD —the calculated Damerau–Levenshtein’s Distance;
-
n   —the number of elements of the compared vectors.
When the values of the two vectors being compared matched closely, the DLD measure yielded a result of 1, and if there were no matching segments between them, the DLD measure was, reciprocally, 0.
(h)
The DA measure considers vector pairs to be planar curves in a two-dimensional co-ordinate plane. It utilizes a numerically calculated area enclosed between the curves and the area confined within the lowest and the highest tangents, as illustrated in Figure 5a. The ratio between these two areas can be further adopted as a criterion for discerning the difference between those vectors. The equation for calculating this measure is as follows:
S DA = 1 i = 1 n A i C Ar
where:
  • S DA —the similarity measure using the Difference in Area method;
  • A i C —the enclosed between vectors curves areas;
  • n —the number of vector elements;
  • Ar—the area of the rectangle that encompasses the curves, which is calculated as Ar = L v · V max V min , where L v is the length of the curves (i.e., vectors), V max is the maximum vectors value, and V min is the minimum vectors value.
When the two curves matchrf perfectly, the area between them was zero, and the resultant S DA similarity measure returned to 1. It should be pointed out, however, that the main drawback of using this metric is that there is a strong possibility that a pair of quite different curves (i.e., vectors) would obtain very small values for the sum of the areas contained within them. It is essential, therefore, for the two collated curves to have equal length and heights that are scale limited to represent the same units.
(i)
DFD is a measure of similarity between data vectors, which can be described as follows: a man and a dog restrained by a leash that bind them together, walking along two curves in a flat two-dimensional plane. They can only be at a standstill or walk forward following their own curves. Fréchet’s Distance can be defined as the minimal possible leash length required for the human–dog pair to traverse their respective paths (see Figure 5b). The S DFD metric based on DFD can be expressed as:
S DFD = 1 L DFD L DFD max
where:
  • S DFD —the similarity measure using the Discrete Fréchet’s Distance;
  • L DFD —the Fréchet’s distance between the two compared vectors;
  • L DFD max —the maximum distance between the two asymptotic horizontal lines that encloses the curves, as defined by the vectors.
The calculated similarity degrees for the metrics described above were stored in score vectors for the image rows. Subsequently, the matrix of the TI was transposed, and steps 2 to 8 of the algorithm were repeated to calculate the metric scores for the image matrix columns. Loaded, for the second iteration of comparison, was the second profilogram (filtered according to Section 2.2.1), which was measured in a transverse direction in respect to the first iteration

2.2.3. Scaling the Rows or Columns of the TI

After the highest correlation coefficients by the image rows and columns were established at step 11b of the algorithm (see Figure 4), they were compared, and the larger coefficient was selected. Its index from the TI matrix was used to derive the corresponding row or column vector. The scaling factor was calculated as the ratio between the total height of the profile (according to ISO 21920-2:2022 [1]), as measured by the profilogram, and the distance between the pixels with the highest and lowest grey levels for the selected row or column with the greatest correlation coefficient. This process can be expressed via the following equation:
F sc = R t Pix h TI i j   Pix l TI i j
where:
-
F sc —the scale factor (0 < F sc < 1);
-
R t —the total height of the assessed profile, as measured using the profilogram, in the corresponding direction;
-
Pix h TI i j ,   Pix l TI i j —the pixels with highest and lowest grey level values from the row i (or the column j) of the TI matrix TI with the greatest correlation coefficient, according to Section 2.2.2.
In the final step, the remaining parts of the rows (or columns) of the TI matrix are normalized with the scale factor F sc , as calculated via Equation (11).

2.3. Methodology for Testing the Developed Algorithm

In order to test the present algorithm (see Figure 3 and Figure 4), a flat specimen with eight distinct RR patterns (see Figure 6) was created via BB operations through combinations of settings for the toolpaths and the size of the deforming elements. The goal was to create RRs of different types (i.e., fully and partially regular ones) with relief patterns and topography heights of various shapes and sizes. The specimen was used to check the extent to which the metrics described above could be efficient in identifying the row (or column) of TI that most closely matches the relief profilogram measured along the corresponding direction of the proposed algorithm, as outlined in Figure 4.
The 2024-T6 aluminum alloy was selected as the material used for the flat specimen in view of its excellent machinability and plastic deformation behavior in a cold state. The RR patterns with dimensions of 30 × 30 mm were created via BB-operations onto its upper face (see Figure 6b). The BB operations were carried out using a CNC milling machine HAAS, TM-1, with an adjusted tool for ball burnishing, which was based on [59]. The deforming force was set to 700 N, the feed rate was set to 300 mm/min, and the bearing balls with diameters of 14 mm and 22 mm were used as deforming elements (see Figure 6a). The toolpaths were calculated and converted into NC code using the corresponding methodology for flat surfaces [5].
Two-dimensional images from the eight RR patterns, with each measuring 6 × 6 mm (1200 × 1200 pixels resolution) and having an 8-bit gray scale, were captured using the Bresser GmbH, GE microscope, model Advance ICD 10×–160× equipped with a 14MP Levenhuk Inc., Tampa, FL, USA, CMOS camera, model M1400 PLUS (see Figure 2b). The microscope magnification was set to 15×, and the angle between the planar specimen and the light emitting plane of the circular lamp varied between α1 = 1.27 and α2 = 6.34 degrees (see Figure 2a). To ensure accurate surface imaging, a diffuse circular light source was set to emit an equalized light stream from all directions onto the photographed RR patterns. The Bresser GmbH, GE circular constant video lamp, model BR-RL12 LED was used for that purpose.
The RR profilograms were measured using a Mitutoyo, America Corporation, USA, and model Surftest SJ-310 roughness tester, which was equipped with a stylus that had a radius of 5 μm at the tip, and had the ability to transfer measurement data via a serial (USB) interface to a personal computer. The roughness tester was used to capture the topography profiles in two directions perpendicular to each other, being alongside and transverse to the patterns of the RRs, respectively.
The captured RR images were subjected to base leveling and Gaussian filtering using a 15-pixel-sized window. The measured topography profiles were also filtered using a Gaussian filter in line with the methodology recommendations (see Section 2.2.1). Next, all TIs were subjected to normalization according to the proposed algorithm, as depicted in Figure 4.

3. Results

The results obtained for the estimated correlations between the measured profilograms and TI vectors are summarized in Table 1.
A comparison between the rows and columns indexes, which correspond to the best-matched vectors aligned with the metrics discussed in Section 2.2.2, is shown in Table 2. It should be clarified that the HD and DLD metrics are excluded from that comparison due to the exceptionally low degrees of correlation.
The data reported in Table 1 show that the highest level of correlation degree is obtained for the similarity measure determined via the MSE metric (see Equation (5)). The next highest score is registered for MAE and DA metrics, which have comparatively close correlation, with the worst results being attained via the use of the HD and DLD metrics.
Table 2 shows that the MSE, MAE, DA, and DFD metrics have close best-matched row and column indexes, which explains the comparatively close values between their correlation metrics. They appear interchangeable, with the exception of the time needed for the proper identification of the best-matched rows and columns. For a given TI with resolution 1200 × 1200 pixel, times are as follows: MSE—0.097 s; MAE—0.098 s; DA—1747 s; and DFD—16812 s. Thus, the MSE metric is selected for scaling the TI pixel grey levels in view of its greater correlation score and it requiring the shortest time to identify the best-matched pairs of rows and columns.
Figure 7 displays the best-matched vector pairs “TI row (column)—profilogram segment” for the first four patterns in step nine of the algorithm (see Figure 4), with the remaining four patterns being described in Figure 8. As demonstrated, a high degree of correlation (greater than 95%) between the measured profilograms and the data from the rows and columns of TI patterns is generally observed for all vector pairs. The pairs shown in Figure 7b,d,h, and Figure 8c,e,g achieved the highest S MSE metric scores and corresponded to 1, 2, 4, 6, 7, and 8 RR patterns, respectively, which can be classified as fully regular patterns. The worst S MSE metric scores were obtained for RRs Patterns 3 and 5, which were partially regular or had the smallest topography height. Therefore, it can be concluded that they have areas with topography obtained via the previous cutting operation, in addition to the ball-burnished traces.
The normalized three-dimensional representations of the RR patterns, which were scaled with the assistance of the current methodology, are represented in Figure 9. They were visualized as 3D topography using the Gwyddion software tool [60], with the corresponding values for Sz and Sa criteria being provided in accordance with the ISO 25178-2:2021 [2] standard.

4. Discussion

As illustrated in Figure 7 and Figure 8, the highest correlation degrees, according to the MSE metric, result in a good match for the TI rows/columns and profilograms segments. There are, however, some wide discrepancies in the RRs due to the dispersion of the values in the two compared vectors of the stylus-measured profile and the rows/columns derived from the TIs. Undoubtedly, the factors that account for such a high variance are the different methods through which the compared pairs of vectors are obtained. Nevertheless, it can be argued that the vectors extracted from the topographic image have the same variation character as the measured profilograms. The main differences between them are most consistently observed in the heights of individual peaks, with the peak heights of the TI profiles being greater than those of the measured profilograms. More accurate results for the vectors’ pairs similarities are derived when the surface topography has a clearly formed pattern of cells (i.e., the RR is form IV-th type) and the topography heights are comparatively large. Even if the RRs are from III-th type (i.e., partially regular), the compared vectors matching degrees have comparatively high values, according to the S MSE metric (see pattern 3 from Figure 7e,f, and pattern 6 from Figure 8c,d). The worst results for S MSE   are obtained for Pattern 5 (see Figure 8a,b), which is fully regular and identified based on having the lowest topographic heights and the largest cell sizes. The results identified are in accordance with those observed in [24], showing a tendency in mechanically processed surfaces via other finishing methods.
By comparing the vector pairs generated along and across the RR patterns, as depicted in Figure 7 and Figure 8, it becomes evident that there exists some anisotropy between them, which, in turn, is attributable to the anisotropic properties of the RR topography itself in two perpendicular directions of the profilograms measurement (see Figure 9). Nonetheless, the correlation coefficients retain high values, apart from Patterns 5 and 6, in which the topography height has the smallest values when compared to the other patterns.
To compare the resulting heights of the scaled three-dimensional topography images of RRs (see Figure 9) and the measured profilograms, the ratios of topography criteria Sz and Sa (ISO 25178-2:2021 [2]) and Rz and Ra (ISO 21920-2:2022 [1]) were used. The Rz/Ra ratios were calculated using results obtained for Ra and Rz criteria from six profilograms, three of which were measured along the RR’s areas, while the other three were measured across them. The Ra, the Rz criteria values determined, and the Rz/Ra ratios obtained are shown for every topography pattern and trial in Table 3.
As can be inferred from Table 3, the Rz/Ra ratios for the measured profilograms span the range between 4.92 and 10.12 along, as well as between 4.99 and 11.28 across, the RR direction, while the Sz/Sa ratios for the scaled TIs fall within the range of 5.31 to 10.67. The difference between these two ratios is due to the different objective of the criteria applied. The Sz criterion characterizes the maximum height of the topography within the area (the distance between the highest peak and the deepest pit), while the Rz criterion is the average between the five highest peaks and the five deepest pits. The ratios reported in Table 3, however, show no drastic increase (or decrease) in the proportions between the compared relief heights criteria.
In order to evaluate the degree of equivalence between Rz/Ra and Sz/Sa ratios, 1-Sample Equivalence Tests (1-SET) were performed using Minitab 19 (Minitab, LLC, State College, PA, USA) software [61], allowing us to estimate whether the means of the profilogram ratios Rz/Ra are statistically close enough to the Sz/Sa ratios for TIs. The 1-SET employs the t-test statistic [62] to evaluate two separate null hypotheses:
H0: Δ ≤ δ1, where the difference (Δ) between the mean of the test profilogram ratios and the target ratio (i.e., Sz/Sa) is less than or equal to the lower equivalence limit (δ1);
H0: Δ ≥ δ2, where the difference (Δ) between the mean of the test profilogram ratios and target ratio is greater than or equal to the upper equivalence limit (δ2).
If both null hypotheses are rejected, the difference (Δ) falls within the equivalence interval, and it can be claimed that the test mean and the target value are equivalent. The six ratios determined in Table 3, which were obtained from the six profilograms, when measured along and across are used as a test population, and Sz/Sa ratio is used as target. To determine the lower and upper equivalence limits of the target, ±5% difference is assumed. The obtained results from 1-SET, which were conducted for the eight RR patterns and profilogams measured, are shown in Table 4.
As can be seen from Table 4, the null hypothesis (at 95% confidence level) is rejected for all RR patterns tested, excluding Patterns 5 and 6, where the differences Δ fall outside of the lower and upper limits. The main reasons for such behavior of the RRs of Patterns 5 and 6 are their low topography height and the type of RR used. As can be seen from Figure 6a, Pattern 6 has a partially regular relief, which means that there are areas in which initial topography remained based on the previous machining operation performed. The topography height within these “islands” is quite low in comparison to the RR’s heights, and they are located atop the protrusions, which can produce undesirable light reflections. Although Pattern 5 shows fully regular relief, its topography height is low enough to bring a similar effect. The “hills” in the TIs captured in Patterns 5 and 6 (see Figure 9e,f) most probably result from such reflections from the RRs islands and protrusions with low topographical heights. This finding is also confirmed via the statistical estimates for Patterns 5 and 6, as shown in Table 4. The profilograms means determined for Patterns 5 and 6 are far enough from the target ratios Sz/Sa, which means that confidence intervals for equivalence assessment fall outside of the lower limits, being −0.05∙Sz/Sa. This issue led to null hypothesis confirmation for these two RR patterns and, therefore, the equivalence between three-dimensional topography models of RRs and measured profilograms cannot be claimed in these cases.
Considering the established difficulties related to the recognition of RR’s characteristics, one possible next step could be to use neural networks (NNs) to classify the resulting TIs based on the RRs models obtained via current methodologies. Using supervised machine learning methodologies, however, would prove to be difficult, as it would require a large number of different RRs and corresponding Tis. Therefore, the proposed methodology can be employed for rapid modeling of three-dimensional RR topography, with the aim of training NNs for automatic recognition of the resulting cell patterns.

5. Conclusions

In accordance with the goal set, an overall algorithm for three-dimensional topo-graphic representation of RRs was developed based on two-dimensional images and measurement of profilograms via stylus. A methodology for its application was developed and tested for distinct types of RRs with varying topographic heights and sizes of cell patterns. Nine different approaches for assessment of correlations between measured profilograms and TI rows and columns were examined, and the approach that yielded the highest results (i.e., SMSE) and provided the shortest time for calculation was determined. It was experimentally established that the highest degree of correlation between the compared vectors, when contouring the profile of the topography, was obtained for those RRs with a greater height and a more regular shape of the cell patterns. The methodology proposed here is easily applicable to three-dimensional modeling of these particular topography types of RRs. The worst results were obtained for those RRs patterns that have partially regular reliefs and topographies with low heights, which was also confirmed through the analysis of equivalence conducted based on the t-Test statistic. For such partially regular topographies, it will be necessary to investigate applications of different techniques for three-dimensional imaging and modeling in the future, including the usage of other types of sensors.
In conclusion, it must be mentioned that the main advantages of the developed methodology are its simplicity, the comparatively low-cost equipment needed, and the shorter time required to achieve three-dimensional representation of the RRs topography. The main drawbacks are related to the low reliability of the obtained 3D models when the topography is not fully regular or its heights are comparatively low. The proposed methodology should not be considered as a replacement for or alternative to the existing noncontact methods for three-dimensional metrological scanning of surface topography. It could be employed, however, to rapidly obtain RRs topography three-dimensional models in order to train different types of neural networks, such as the Generative Adversarial Network (GAN), the Siamese Neural Network (SNN), etc., which will be the future work of this team within the pre-defined project aims.

Author Contributions

Conceptualization, S.S.; methodology, S.S. and L.S.B.V.; software, L.S.B.V.; validation, S.S., D.D. and B.N.; formal analysis, S.S. and L.S.B.V.; investigation, B.N. and L.S.B.V.; resources, S.S. and B.N.; data curation, L.S.B.V.; writing—original draft preparation, S.S., B.N. and L.S.B.V.; writing—review and editing, D.D.; visualization, S.S. and L.S.B.V.; supervision, D.D.; project administration, S.S.; funding acquisition, S.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Bulgarian National Science Fund (BNSF), grant number KП-06-H57/6, and the APC was funded by grant contract KП-06-H57/6, entitled “Theoretical and experimental research of models and algorithms for formation and control of specific relief textures on different types of functional surfaces”.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to early stage of the research approach in the work.

Acknowledgments

The authors express their deep gratitude to Milena Zlateva from the Department of Language, Continuing Education and Sport at the Technical University of Varna for her assistance in proofreading the English-language content in the present work.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. ISO 21920-2:2022; Geometrical Product Specifications (GPS)—Surface Texture: Profile—Part 2: Terms, Definitions and Surface Texture Parameters. ISO: Geneva, Switzerland, 2022. Available online: https://www.iso.org/standard/72226.html (accessed on 16 April 2023).
  2. ISO 25178-2:2021; Geometrical Product Specifications (GPS)—Surface Texture: Areal—Part 2: Terms, Definitions and Surface Texture Parameters. ISO: Geneva, Switzerland, 2021. Available online: https://www.iso.org/standard/74591.html (accessed on 16 April 2023).
  3. Шнейдер, Ю.Г. Эксплуатациoнные свoйства деталей с регулярным микрoрельефoм/Серия «Выдающиеся ученые ИТМО» Учебные издания НИУ ИТМО. 2001. Available online: http://books.ifmo.ru/book/78/book_78.htm (accessed on 31 January 2022).
  4. Slavov, S. An Algorithm for Generating Optimal Toolpaths for CNC Based Ball-Burnishing Process of Planar Surfaces. In Advances in Intelligent Systems and Computing; Springer: Cham, Switzerland, 2018; Volume 680, pp. 365–375. [Google Scholar] [CrossRef]
  5. Slavov, S.D.; Dimitrov, D.M.; Konsulova-Bakalova, M.I. Advances in burnishing technology. In Advanced Machining and Finishing; Elsevier: Amsterdam, The Netherlands, 2021; pp. 481–525. [Google Scholar] [CrossRef]
  6. GOST 24773-1981; Surfaces with Regularmicroshape. Classification, Parameters and Characteristics. State Standard of the Union of USR: Moscow, Russia, 1988. Available online: https://gostperevod.com/gost-24773-81.html (accessed on 19 March 2023).
  7. Slavov, S.; Dimitrov, D.; Iliev, I. Variability of regular relief cells formed on complex functional surfaces by simultaneous five-axis ball burnishing. UPB Sci. Bull. Ser. D Mech. Eng. 2020, 82, 195–206. [Google Scholar]
  8. ISO 4287:1997/Cor 2:2005; Geometrical Product Specifications (GPS)—Surface Texture: Profile Method—Terms, Definitions and Surface Texture Parameters—Technical Corrigendum 2. ISO: Geneva, Switzerland, 2005. Available online: https://www.iso.org/standard/41861.html (accessed on 16 April 2023).
  9. ISO 25178-6:2010; Geometrical Product Specifications (GPS)—Surface Texture: Areal—Part 6: Classification of Methods for Measuring Surface Texture. ISO: Geneva, Switzerland, 2010. Available online: https://www.iso.org/standard/42896.html (accessed on 16 April 2023).
  10. Vorburger, T.V.; Rhee, H.G.; Renegar, T.B.; Song, J.F.; Zheng, A. Comparison of optical and stylus methods for measurement of surface texture. Int. J. Adv. Manuf. Technol. 2007, 33, 110–118. [Google Scholar] [CrossRef]
  11. Piska, M.; Metelkova, J. On the comparison of contact and non-contact evaluations of a machined surface—KU Leuven. MM Sci. J. 2014, 476–479. Available online: http://ensam.fme.vutbr.cz/news/2014/MM_Science_201408_MP_JM.pdf (accessed on 20 June 2022). [CrossRef]
  12. Sanz, A.; Negre, A.A.; Fernández, R.; Calvo, F. Comparative Study about the Use of Two and Three-dimensional Methods in Surface Finishing Characterization. Procedia Eng. 2013, 63, 913–921. [Google Scholar] [CrossRef] [Green Version]
  13. Aulbach, L.; Bloise, F.S.; Lu, M.; Koch, A.W. Non-Contact Surface Roughness Measurement by Implementation of a Spatial Light Modulator. Sensors 2017, 17, 596. [Google Scholar] [CrossRef] [Green Version]
  14. Szeliski, R. Computer Vision, 2nd ed.; Springer International Publishing: Cham, Switzerland, 2022. [Google Scholar] [CrossRef]
  15. Hung, Y.Y.; Lin, L.; Park, B.G. Practical 3-D computer vision techniques for full-field surface measurement. Opt. Eng. 2000, 39, 143–149. [Google Scholar] [CrossRef]
  16. Huang, C.-n.; Motavalli, S. Reverse engineering of planar parts using machine vision. Comput. Ind. Eng. 1994, 26, 369–379. [Google Scholar] [CrossRef]
  17. Alshennawy, A.A.; Gadelmawla, E.S.; Elewa, I.M.; Koura, M.M. Construction of three-dimensional models of mechanical products from their orthographic views using computer vision. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 2007, 221, 1053–1063. [Google Scholar] [CrossRef]
  18. Mejia-Ugalde, M.; Dominguez-Gonzalez, A.; Trejo-Hernandez, M.; Morales-Hernandez, L.A.; Benitez-Rangel, J.P. New approach for automatic tool selection in computer numerically controlled lathe by applying image processing. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 2012, 226, 1298–1308. [Google Scholar] [CrossRef]
  19. Mejia-Ugalde, M.; Trejo-Hernandez, M.; Dominguez-Gonzalez, A.; Osornio-Rios, R.A.; Benitez-Rangel, J.P. Directional morphological approaches from image processing applied to automatic tool selection in computer numerical control milling machine. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 2013, 227, 1607–1619. [Google Scholar] [CrossRef]
  20. Gadelmawla, E.S.; Al-Mufadi, F.A.; Al-Aboodi, A.S. Calculation of the machining time of cutting tools from captured images of machined parts using image texture features. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf. 2014, 228, 203–214. [Google Scholar] [CrossRef]
  21. Al-Kindi, G.; Zughaer, H. An approach to improved CNC machining using vision-based system. Mater. Manuf. Process. 2012, 27, 765–774. [Google Scholar] [CrossRef]
  22. Al-Kindi, G.; Zughaer, H. Intelligent vision-based Computerized Numerically Controlled (CNC) machine. Lect. Notes Electr. Eng. 2011, 123, 619–628. [Google Scholar] [CrossRef]
  23. Eladawi, A.E.; Gadelmawla, E.S.; Elewa, I.M.; Abdel-Shafy, A.A. An application of computer vision for programming computer numerical control machines. Proc. Inst. Mech. Eng. Part B: J. Eng. Manuf. 2003, 217, 1315–1324. [Google Scholar] [CrossRef]
  24. Al-Kindi, G.A.; Baul, R.M.; Gill, K.F. An application of machine vision in the automated inspection of engineering surfaces. The Int. J. Prod. Res. 2007, 30, 241–253. [Google Scholar] [CrossRef]
  25. Demircioglu, P.; Bogrekci, I.; Durakbasa, N.M. Micro scale surface texture characterization of technical structures by computer vision. Measurement 2013, 46, 2022–2028. [Google Scholar] [CrossRef]
  26. Lawrence K, D.; Ramamoorthy, B. Surface topography characterization of automotive cylinder liner surfaces using fractal methods. Appl. Surf. Sci. 2013, 280, 332–342. [Google Scholar] [CrossRef]
  27. Worthington, P.L.; Hancock, E.R. Surface topography using shape-from-shading. Pattern Recognit. 2001, 34, 823–840. [Google Scholar] [CrossRef]
  28. Li, H.; Fang, X.; Zhu, Z.; Fu, W.; Zhao, C. The approach of nanoscale vision-based measurement via diamond-machined surface topography. Measurement 2023, 214, 112814. [Google Scholar] [CrossRef]
  29. He, C.L.; Zong, W.J.; Xue, C.X.; Sun, T. An accurate 3D surface topography model for single-point diamond turning. Int. J. Mach. Tools Manuf. 2018, 134, 42–68. [Google Scholar] [CrossRef]
  30. Zhao, C.; Cheung, C.F.; Liu, M. Nanoscale measurement with pattern recognition of an ultra-precision diamond machined polar microstructure. Precis. Eng. 2019, 56, 156–163. [Google Scholar] [CrossRef]
  31. Zhao, C.Y.; Cheung, C.F.; Fu, W.P. An investigation of the cutting strategy for the machining of polar microstructures used in ultra-precision machining optical precision measurement. Micromachines 2021, 12, 755. [Google Scholar] [CrossRef] [PubMed]
  32. Yao, S.; Li, H.; Pang, S.; Zhu, B.; Zhang, X.; Fatikow, S. A Review of Computer Microvision-Based Precision Motion Measurement: Principles, Characteristics, and Applications. IEEE Trans. Instrum. Meas. 2021, 70, 1–28. [Google Scholar] [CrossRef]
  33. Fu, W.; Zhao, C.; Xue, W.; Li, C. An investigation of the influence of microstructure surface topography on the imaging mechanism to explore super-resolution microstructure. Sci. Rep. 2022, 12, 13651. [Google Scholar] [CrossRef]
  34. Schonberger, J.L.; Frahm, J.M. Structure-from-Motion Revisited. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27–30 June 2016; pp. 4104–4113. [Google Scholar] [CrossRef]
  35. Liu, H.; Tang, X.; Shen, S. Depth-map completion for large indoor scene reconstruction. Pattern Recognit. 2020, 99, 107112. [Google Scholar] [CrossRef]
  36. Gao, X.; Zhu, L.; Xie, Z.; Liu, H.; Shen, S. Incremental Rotation Averaging. Int. J. Comput. Vis. 2021, 129, 1202–1216. [Google Scholar] [CrossRef]
  37. Munkberg, J.; Chen, W.; Hasselgren, J.; Shen, T.; Müller, T.; Gao, J.; Fidler, S. Extracting Triangular 3D Models, Materials, and Lighting from Images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, 18–24 June 2022; pp. 8270–8280. [Google Scholar]
  38. Fan, B.; Kong, Q.; Wang, X.; Xaing, S.; Pan, C.; Fua, P. A performance evaluation of local features for image-based 3D reconstruction. IEEE Trans. Image Process. 2019, 28, 4774–4789. [Google Scholar] [CrossRef] [Green Version]
  39. Leach, R. (Ed.) Optical Measurement of Surface Topography; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar] [CrossRef]
  40. Batlle, J.; Mouaddib, E.; Salvi, J. Recent progress in coded structured light as a technique to solve the correspondence problem: A survey. Pattern Recognit. 1998, 31, 963–982. [Google Scholar] [CrossRef]
  41. Tian, G.Y.; Lu, R.S.; Gledhill, D. Surface measurement using active vision and light scattering. Opt. Lasers Eng. 2007, 45, 131–139. [Google Scholar] [CrossRef]
  42. Jain, A.; Gupta, R. Gaussian filter threshold modulation for filtering flat and texture area of an image. In Proceedings of the 2015 International Conference on Advances in Computer Engineering and Applications (ICACEA), Ghaziabad, India, 19–20 March 2015; pp. 760–763. [Google Scholar] [CrossRef]
  43. Scarmana, G. An application of the least squares plane fitting interpolation process to image reconstruction and enhancement: University of Southern Queensland Repository. In Proceedings of the 78th FIG Working Week 2016: Recovering from Disaster, Christchurch, New Zealand, 2–6 May 2016; pp. 11–22. Available online: https://research.usq.edu.au/item/q36yy/an-application-of-the-least-squares-plane-fitting-interpolation-process-to-image-reconstruction-and-enhancement (accessed on 15 April 2023).
  44. Kohn, A.F. Autocorrelation and Cross-Correlation Methods; Wiley Encyclopedia of Biomedical Engineering: Hoboken, NJ, USA, 2006. [Google Scholar] [CrossRef]
  45. SciPy User Guide—SciPy v1.10.1 Manual. Available online: https://docs.scipy.org/doc/scipy/tutorial/index.html#user-guide (accessed on 3 May 2023).
  46. Signal Processing (scipy.signal)—SciPy v1.10.1 Manual. Available online: https://docs.scipy.org/doc/scipy/reference/signal.html (accessed on 3 May 2023).
  47. Statistical Functions (scipy.stats)—SciPy v1.10.1 Manual. Available online: https://docs.scipy.org/doc/scipy/reference/stats.html (accessed on 3 May 2023).
  48. Corder, G.W.; Foreman, D.I. Nonparametric Statistics: A Step-By-Step Approach, 2nd ed.; John Wiley & Sons: Hoboken, NJ, USA, 2014; Available online: https://books.google.com/books/about/Nonparametric_Statistics.html?id=hYVYAwAAQBAJ (accessed on 28 April 2023).
  49. Benesty, J.; Chen, J.; Huang, Y.; Cohen, I. Pearson Correlation Coefficient. In Noise Reduction in Speech Processing; Springer: Berlin/Heidelberg, Germany, 2009; Volume 2, pp. 1–4. [Google Scholar] [CrossRef]
  50. Chai, T.; Draxler, R.R. Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature. Geosci. Model Dev. 2014, 7, 1247–1250. [Google Scholar] [CrossRef] [Green Version]
  51. Serda, M.; Balint, G.; Antala, B.; Carty, C.; Mabieme, J.-M.A.; Amar, I.B.; Kaplanova, A. Synteza i Aktywność Biologiczna Nowych Analogów Tiosemikarbazonowych Chelatorów Żelaza; Uniwersytet Śląski. Wydział Matematyki, Fizyki i Chemii: Bankowa, Poland, 2013; Volume 7, pp. 343–354. [Google Scholar]
  52. Kitasuka, T.; Aritsugi, M.; Rahutomo, F. Semantic Cosine Similarity. 2012. Available online: https://www.researchgate.net/publication/262525676 (accessed on 28 April 2023).
  53. Jekel, C.F.; Venter, G.; Venter, M.P.; Stander, N.; Haftka, R.T. Similarity measures for identifying material parameters from hysteresis loops using inverse analysis. Int. J. Mater. Form. 2019, 12, 355–378. [Google Scholar] [CrossRef]
  54. Bookstein, A.; Kulyukin, V.A.; Raita, T. Generalized hamming distance. Inf. Retr. Boston. 2002, 5, 353–375. [Google Scholar] [CrossRef]
  55. Theodoridis, S.; Koutroumbas, K. Clustering: Basic Concepts. In Pattern Recognition; Academic Press: Cambridge, MA, USA, 2009; pp. 595–625. [Google Scholar] [CrossRef]
  56. pyxDamerauLevenshtein—PyPI. Available online: https://pypi.org/project/pyxDamerauLevenshtein/ (accessed on 3 May 2023).
  57. similaritymeasures—PyPI. Available online: https://pypi.org/project/similaritymeasures/ (accessed on 3 May 2023).
  58. Devogele, T.; Esnault, M.; Etienne, L.; Lardy, F. Optimized Discrete Fréchet Distance between trajectories. In Proceedings of the BigSpatial 2017—6th ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data, Redondo Beach, CA, USA, 7–10 November 2017; pp. 11–19. [Google Scholar] [CrossRef]
  59. Slavov, S.D.; Iliev, I.V. Design and FEM static analysis of an instrument for surface plastic deformation of non-planar functional surfaces of machine parts. Fiability Durab. 2016, 1, 3–9. Available online: https://doaj.org/article/5d09023126684e709cca46eb394d5573 (accessed on 25 April 2023).
  60. Nečas, D.; Klapetek, P. Gwyddion: An open-source software for SPM data analysis. Cent. Eur. J. Phys. 2012, 10, 181–188. [Google Scholar] [CrossRef]
  61. Minitab 21 Support—Minitab. Available online: https://support.minitab.com/en-us/minitab/21/ (accessed on 7 October 2022).
  62. James, G.; Witten, D.; Hastie, T.; Tibshirani, R. An Introduction to Statistical Learning, 2nd ed.; Springer: New York, NY, USA, 2021. [Google Scholar]
Figure 1. Gaussian filtered view of a regular relief’s three-dimensional topography from the IV-th type, obtained after BB-operation: (a) Four random directions for measuring section profiles; (be) resulting topography section profiles in corresponding direction (dashed red lines visualize the ultimate heights of each measured section profiles).
Figure 1. Gaussian filtered view of a regular relief’s three-dimensional topography from the IV-th type, obtained after BB-operation: (a) Four random directions for measuring section profiles; (be) resulting topography section profiles in corresponding direction (dashed red lines visualize the ultimate heights of each measured section profiles).
Sensors 23 05801 g001
Figure 2. Diagram (a) and picture (b) of RR’s topography imaging setup, where: 1—planar specimen with RR texture; 2—photographed area; 3—circular diffuse lamp; 4—light emitting plane; 5—high-resolution 4 k CMOS camera, mounted on microscope’s trinocular head; α1—high and α2—low angle between planar specimen with RR and light emitting plane of halo lamp.
Figure 2. Diagram (a) and picture (b) of RR’s topography imaging setup, where: 1—planar specimen with RR texture; 2—photographed area; 3—circular diffuse lamp; 4—light emitting plane; 5—high-resolution 4 k CMOS camera, mounted on microscope’s trinocular head; α1—high and α2—low angle between planar specimen with RR and light emitting plane of halo lamp.
Sensors 23 05801 g002
Figure 3. An algorithm for initial processing of BMP image that represents RR topography.
Figure 3. An algorithm for initial processing of BMP image that represents RR topography.
Sensors 23 05801 g003
Figure 4. An algorithm for normalizing RR’s TI matrix using stylus-measured profilograms.
Figure 4. An algorithm for normalizing RR’s TI matrix using stylus-measured profilograms.
Sensors 23 05801 g004
Figure 5. Graphical representation of following measures: (a) DA measure; (b) DFD measure.
Figure 5. Graphical representation of following measures: (a) DA measure; (b) DFD measure.
Sensors 23 05801 g005
Figure 6. (a) BB-operations’ toolpaths and 2D images of obtained RRs after their application; (b) RR profiles measuring setup, using roughness tester Mitutoyo America Corporation, Aurora, IL, USA, and model Surftest SJ-310.
Figure 6. (a) BB-operations’ toolpaths and 2D images of obtained RRs after their application; (b) RR profiles measuring setup, using roughness tester Mitutoyo America Corporation, Aurora, IL, USA, and model Surftest SJ-310.
Sensors 23 05801 g006
Figure 7. Diagrams of best-matched TI rows/columns and profilogram segments: Pattern 1—along (a) or across (b); Pattern 2—along (c) or across (d); Pattern 3—along (e) or across (f); Pattern 4—along (g) or across (h).
Figure 7. Diagrams of best-matched TI rows/columns and profilogram segments: Pattern 1—along (a) or across (b); Pattern 2—along (c) or across (d); Pattern 3—along (e) or across (f); Pattern 4—along (g) or across (h).
Sensors 23 05801 g007
Figure 8. Diagrams of best matched TI rows/columns and profilograms segments: Pattern 5—along (a) or across (b); Pattern 6—along (c) or across (d); Pattern 7—along (e) or across (f); Pattern 8—along (g) or across (h).
Figure 8. Diagrams of best matched TI rows/columns and profilograms segments: Pattern 5—along (a) or across (b); Pattern 6—along (c) or across (d); Pattern 7—along (e) or across (f); Pattern 8—along (g) or across (h).
Sensors 23 05801 g008
Figure 9. Resulting RRs topographies scaled based on   F S C : (a) Pattern 1; (b) Pattern 2; (c) Pattern 3; (d) Pattern 4; (e) Pattern 5; (f) Pattern 6; (g) Pattern 7; (h) Pattern 8.
Figure 9. Resulting RRs topographies scaled based on   F S C : (a) Pattern 1; (b) Pattern 2; (c) Pattern 3; (d) Pattern 4; (e) Pattern 5; (f) Pattern 6; (g) Pattern 7; (h) Pattern 8.
Sensors 23 05801 g009aSensors 23 05801 g009b
Table 1. Correlation scores for different metrics applied to RR patterns from Figure 6a.
Table 1. Correlation scores for different metrics applied to RR patterns from Figure 6a.
Patterns with RR S P C S S S C S S M A E S M S E S C S S H D S D L D S D A S D F D
AlongAcrossAlongAcrossAlongAcrossAlongAcrossAlongAcrossAlongAcrossAlongAcrossAlongAcrossAlongAcross
Pattern 10.6890.8730.6250.8250.9260.9360.9840.9880.6870.8720.0070.0020.0340.0760.8530.8730.6030.578
Pattern 20.7890.8910.8110.8570.9280.9580.9840.9940.7790.8910.0050.0200.0160.0470.8560.9150.5040.654
Pattern 30.8220.8150.8500.8000.9310.9310.9810.9860.8110.8140.0070.0070.0420.0150.8620.8610.4040.571
Pattern 40.7000.8440.7370.7880.9240.9370.9800.9870.6880.8420.0090.0060.0320.0470.8480.8740.3610.549
Pattern 50.4210.6230.4360.6680.8840.9210.9650.9810.4140.6230.0010.0040.0030.0160.7670.8420.4940.418
Pattern 60.8120.7970.7580.6940.9390.9310.9890.9830.8120.7960.0090.0060.0830.0250.8770.8620.6510.527
Pattern 70.8130.7700.7440.8270.9430.9340.9890.9850.8060.7700.0080.0120.0990.0480.8860.8680.5710.482
Pattern 80.7490.5690.6920.5220.9400.9170.9880.9810.7490.5640.0170.0050.0370.0100.8800.8330.5420.537
Average0.7240.7730.7070.7480.9270.9330.9830.9860.7180.7720.0080.0080.0430.0350.8540.8660.5160.540
Table 2. TIs row and column indexes in which best match was found between compared vectors, according to metrics.
Table 2. TIs row and column indexes in which best match was found between compared vectors, according to metrics.
Patterns with RR P C S S C S M A E M S E C S D A D F D
Row IndexColumn IndexRow IndexColumn IndexRow IndexColumn IndexRow IndexColumn IndexRow IndexColumn IndexRow IndexColumn IndexRow IndexColumn Index
Pattern 13092723101109428334163530927242833417266
Pattern 2240116023736224335225135024011602433522601171
Pattern 3561055710656108821125610556108172243
Pattern 46010145697455010225910156010145501022687974
Pattern 510054110885379353893542100541179538204533
Pattern 6598345971080595395954259834595396001083
Pattern 7594403428408392252583251594403392252276399
Pattern 8191480195485188681189670191480188681186670
Table 3. Comparison between Rz/Ra rations from measured profilograms and Sz/Sa rations for scaled TIs.
Table 3. Comparison between Rz/Ra rations from measured profilograms and Sz/Sa rations for scaled TIs.
Patterns with RRTrialsStylus-Measured Profilograms3D Topography Images
AlongAcrossSz, μmSa, μmSz/Sa
Rz, μmRa, μmRz/RaRz, μmRa, μmRz/Ra
Pattern 1146.066.616.9758.358.546.8365.599.666.79
237.485.836.4344.697.186.22
339.495.686.9537.985.357.10
Pattern 2155.565.959.3482.458.2310.0282.098.659.49
252.555.679.2754.355.469.95
349.554.9510.0147.595.119.31
Pattern 3159.5412.104.9227.485.035.46122.523.055.31
263.1912.065.2416.512.945.61
364.8311.545.6215.323.074.99
Pattern 4152.027.486.9532.685.086.4374.8611.016.80
261.038.986.8039.947.645.23
359.688.976.6532.605.236.23
Pattern 5119.341.959.9222.722.329.7947.384.4410.67
222.472.2210.1219.892.099.52
313.981.3910.0621.692.239.73
Pattern 6128.313.847.3727.974.296.5242.325.218.12
229.594.696.3116.821.968.58
324.912.998.3315.751.768.95
Pattern 7127.264.056.7317.392.327.4962.839.266.79
228.184.276.6018.532.686.91
326.394.076.4916.302.546.42
Pattern 8117.491.819.6717.521.769.9674.347.3310.14
218.811.959.6417.541.799.80
317.871.7810.0414.111.2511.28
Table 4. Results from 1-Sample Equivalence Tests performed for eight RRs TIs and profilograms measured.
Table 4. Results from 1-Sample Equivalence Tests performed for eight RRs TIs and profilograms measured.
Patterns with RRSz/Sa
(Target)
Profilograms MeanSt. Dev.95% CI for EquivalenceLower and Upper Limits ± 0.05 S z / S a Null Hypothesis (H0)T-Valuep-ValueIs H0 Rejected?Equivalence?
Pattern 16.796.74950.34523(−0.324481; 0.243512)L: −0.3395Δ ≤ −0.33952.12160.044YesYes
U: 0.3395Δ ≥ 0.3395−2.69610.021
Pattern 29.499.65010.37785(−0.150754; 0.470912)L: −0.4745Δ ≤ −0.47454.11380.005YesYes
U: 0.4745Δ ≥ 0.4745−2.03830.049
Pattern 35.315.30900.30520(−0.252061; 0.250084)L: −0.2655Δ ≤ −0.26552.12290.044YesYes
U: 0.2655Δ ≥ 0.2655−2.13880.043
Pattern 46.806.63740.21539(−0.339745; 0.0146286)L: −0.3400Δ ≤ −0.34002.01800.050YesYes
U: 0.3400Δ ≥ 0.3400−5.71530.001
Pattern 510.679.85770.22148(−0.994494; 0.00003)L: −0.5335Δ ≤ −0.5335−3.08340.986NoNo
U: 0.5335Δ ≥ 0.5335−14.8840.000
Pattern 68.127.67741.1082(−1.35423; 0.468990)L: −0.4060Δ ≤ −0.4060−0.080950.531NoNo
U: 0.4060Δ ≥ 0.4060−1.87580.060
Pattern 76.796.77610.39381(−0.337821; 0.310112)L: −0.3395Δ ≤ −0.33952.02550.049YesYes
U: 0.3395Δ ≥ 0.3395−2.19780.040
Pattern 810.1410.1160.58046(−0.501456; 0.453566)L: −0.5070Δ ≤ −0.50702.03840.049YesYes
U: 0.5070Δ ≥ 0.5070−2.24050.038
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Slavov, S.; Van, L.S.B.; Dimitrov, D.; Nikolov, B. An Approach for 3D Modeling of the Regular Relief Surface Topography Formed by a Ball Burnishing Process Using 2D Images and Measured Profilograms. Sensors 2023, 23, 5801. https://doi.org/10.3390/s23135801

AMA Style

Slavov S, Van LSB, Dimitrov D, Nikolov B. An Approach for 3D Modeling of the Regular Relief Surface Topography Formed by a Ball Burnishing Process Using 2D Images and Measured Profilograms. Sensors. 2023; 23(13):5801. https://doi.org/10.3390/s23135801

Chicago/Turabian Style

Slavov, Stoyan, Lyubomir Si Bao Van, Diyan Dimitrov, and Boris Nikolov. 2023. "An Approach for 3D Modeling of the Regular Relief Surface Topography Formed by a Ball Burnishing Process Using 2D Images and Measured Profilograms" Sensors 23, no. 13: 5801. https://doi.org/10.3390/s23135801

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop