1. Introduction
As an artistic treasure of Chinese civilization, Chinese paintings have extremely important artistic and historical value. However, due to the texture of Chinese paintings themselves, they may suffer from irreversible man-made and natural damage over time. As a result, the digital preservation and color reproduction of Chinese paintings are of great significance. Traditional color reproduction techniques are based on color modeling and use multispectral cameras or other imaging devices to record the color of objects. At present, many color workers have proposed color replication and reproduction techniques based on spectral reflectance. Employing spectral reflectance as the foundation for color replication effectively resolves the challenges posed by metamerism [
1,
2,
3]. However, spectral reflectance cannot solve the problems of texture, material, and angle changes, so BRDF was introduced. BRDF itself can achieve true color reproduction, while also solving the problems of texture, material, and angle changes. The bi-directional reflectance property of BRDF means that the reflectance of the sample to be measured varies with the angle of incidence of the light source and the viewing angle, which enables it to describe the energy distribution in different directions when the reflection of light goes through the surface. Simple materials such as standard gray scale plates and reflectance standards also require the measurement of BRDF to achieve characterization [
4]. BRDF theory has significant applications in many fields, including materials analysis [
5], optical remote sensing [
6], and environmental monitoring [
7]. It has also been extended to cover emerging research areas, such as 3D target reconstruction [
8], and virtual reality [
9,
10]. In recent years, the application of artificial intelligence (AI) and machine learning in BRDF modeling has received increasing attention [
11]. These technologies not only improve the realism of modeling, but also have certain advantages in computational efficiency and resource utilization. Although these emerging methods have strong adaptability and advantages, traditional physical models still have high computational stability and interpretability in many application scenarios.
In BRDF numerical simulation, many BRDF modeling methods have been developed presently. Based on the modeling approaches, BRDF can be classified into physical [
12], empirical [
13,
14], and data-driven models [
15]. The physical models always satisfy the law of energy conservation and the law of Helmholtz’s reciprocal inverse, whereas they consist of many parameters and are computationally complex. The empirical models are relatively less complex, but the rendered results often do not fully achieve the expected material effects. The data-driven models have the most realistic fitting effect; yet, they require us to collect a large amount of data. Meanwhile, the data transmission and storage consume a lot of computational resources, and the parameters are not easily adjustable for direct use in rendering. The Monte Carlo method [
9], discrete quadrature method [
16], and spherical harmonic discrete quadrature method [
17] are widely used to study targets with a regular structure and known optical parameters. Kalantari et al. [
18] proposed a new model for analyzing the reflectance distribution of rough surfaces, successfully predicting the non-specular maximum with an increasing incidence angle by analyzing the angular distribution of reflectance. Lai et al. [
19] studied and analyzed the effects of the surface texture and illumination wavelength on BRDF of four different textured fabrics and provided a fast and simple BRDF model with a genetic algorithm to obtain the best model parameters for calculating the BRDF of fabrics.
The current BRDF modeling technology still has limitations in the application of cultural heritage protection. The traditional BRDF measurement method requires a large amount of high-quality data, and the data collection equipment is complex and expensive, which poses a huge challenge to the modeling of cultural heritage. A common technique for obtaining BRDF is the gonioreflectometer, which measures the reflectivity of flat samples [
20]. Kim et al. [
21] captured 2890 images for BRDF reconstruction using a precise rotary stage, which accurately and efficiently rendered the true appearance of the material on a 3D model. Liu et al. [
22] captured 128 multiview images from an unknown environment, and then proposed a neural-rendering-based method called NeRO to reconstruct the geometry and BRDF of the reflecting object. Jianying Hao et al. [
23] proposed a method based on Gaussian process regression to model the reflective properties of real materials, and the results show that the proposed method is able to fit the reflective properties of certain materials well and greatly reduce the BRDF measurement time, while ensuring highly realistic rendering.
In recent years, many industries have been increasing their requirements for image realism quality [
24,
25,
26,
27]; the real image rendering reproduction based on measurement data is gradually emerging. The present methods that guarantee maximum realism are acquiring dense reflection data and directly using the measured data in a mapping method [
28]. However, the disadvantages include the large memory consumption of the measurement data, the bottleneck in computational efficiency, and not being real-time. Most large cultural relics have complex surface structures and are not easy to move, so their color reconstruction faces many challenges. Firstly, the details and textures of large cultural relics are often more complex than standard samples. Secondly, most BRDF data acquisition devices are fixed, and the position and distance of detectors cannot be changed arbitrarily. They are only suitable for collecting small objects and cannot fully collect large objects.
Therefore, in this paper, we build a simple and portable data acquisition platform to measure the optical behavior of visually rich objects using a stationary hyperspectral camera that can take a limited number of images with different illumination directions. We then combine the key advantage where the measured data contain the real reflection information of the object with the BRDF model, which can effectively predict the BRDF from a small number of image samples and reconstruct the RGB image, completing the color reproduction [
29] of a large-scale Chinese painting, which saves computational resources while providing the best visual effect.
2. Materials and Methods
2.1. Experimental Setup
The BRDF describes the distribution of incident light reflected from a surface in each direction of emission. As a result, BRDF is used to represent the proportional relationship between reflected and incident light in a specified direction. BRDF measurement is divided into absolute measurement and relative measurement. Absolute BRDF measurement is using the defined formula to achieve the measurement analysis, which is relatively convenient, and requires less amount of data to be measured but prone to large errors. The relative BRDF measurement is based on the sample ratio method of the relative measurement method. The key to this method is to use known reference surfaces as standards. By comparing the reflection characteristics of the target surface with the reference surface, we can obtain information about the target surface. When the measured material is observed at the same plane of incidence and the same detection angle as the standard plate, the BRDF of the measured material can be expressed in terms of the spectral information of the detected sample and the standard plate as well as the reflectance of the standard plate.
In this paper, relative measurement method is used for BRDF measurement; a standard white plate of polytetrafluoroethylene (PTFE) is used as a reference plate with a BRDF value of
. The reflectance of PTFE can be obtained by metrological calibration or measured with a spectrophotometer. The spectral BRDF equation is as follows:
where
is the spectral information obtained by light incident on the sample to be measured along the
direction and out along the
direction.
is the spectral information obtained from light incident on the standard white plate along the
direction and out along the
direction.
is the hemispherical reflectance of a standard whiteboard and
is the wavelength. Hemispherical reflectance of standard whiteboards was measured directly using an X-Rite 64 spectrophotometer (the spectral range is 400 to 700 nm).
A variety of scenes such as heritage displays, landscape lighting, and indoor lighting are using light-emitting diodes (LEDs) as the lighting source. LED light source has the characteristics of wide spectral range, uniform energy distribution, and stable light output, which can reduce the influence of light source fluctuation on the measurement results during the measurement process again; therefore, we use LED lamp as the light source in this experiment. The irradiance was obtained using a PR-715 spectrophotometer, and the irradiance distribution of this light source is shown in
Figure 1. The uniformity of spectral irradiance can ensure consistency in the measurement results of color chips, thereby improving the stability and reliability of BRDF data. Hyperspectral cameras decompose incident light into different wavelengths by means of a spectroscopic element, generating spectral information for each pixel in multiple spectral bands. This technique not only acquires spatial information about the object, but also provides detailed spectral properties, which are suitable for material analysis and reflection property extraction in BRDF measurements. Therefore, the experiment used a hyperspectral imaging system for data acquisition, which consists of a GaiaField-V10E hyperspectral camera, tripod stabilization equipment, and a companion laptop. The hyperspectral camera has a spectral resolution of 2.8 nm, with an exposure time set to 10.6 ms and a gain of 5.
Before applying the color reproduction method in this paper to complex objects such as Chinese paintings, using color chips can help to verify the accuracy and reliability of the color reproduction method. The Munsell book of color classifies colors based on their hue, value, and chroma, with each color having a unique color number. The Munsell color system covers the entire color spectrum from red to purple, as well as different levels from high saturation to low saturation, and from bright to dim. This wide range of colors allows us to test the performance of the methods used in experiments under various colors, making it easier to evaluate the effectiveness of color reproduction techniques. We randomly selected 56 color chips (each color chip has a size of 2.2 cm × 2 cm, with a matte finish; 56 Munsell notations for color chips are listed in
Appendix A) from The Munsell Book of Color (Munsell 5th Edition) as the study object.
Use a hyperspectral camera to collect data in the 90° direction on the color card and PTFE standard white plate. As shown in
Figure 2, the data were sampled at 5°and 10° illumination intervals from 30° to 150° in turn, with a light source illumination radius of 47 cm, the camera data collection radius is 120 cm. The reason for choosing a 5° and 10° interval is to balance data accuracy and data acquisition complexity. A 5° interval can further reveal the impact of subtle illumination changes on the reconstruction results, while a 10° interval can provide an overall trend. Although smaller intervals can provide more details, the difficulty of data collection will increase, and the required time will also increase. Moreover, interval with smaller differences may not significantly improve reconstruction accuracy, and larger intervals may overlook some details and changes. Therefore, we achieved an appropriate balance between data richness and data acquisition complexity by choosing 5° and 10° interval. After data acquisition, the hyperspectral imaging system comes with software Specview for black and white correction to reduce the impact of light scattering, random noise, and other unfavorable factors that may exist in the data acquisition process [
30]. Subsequently, we went to the Yunnan Provincial Museum to collect the data of an authentic Chinese painting, which is 2 m × 1 m in size; the painting had slight aging, but, because this authentic painting has not yet been publicly exhibited, we were not allowed to collect the data of the whole painting, and only selected an area of 80 cm × 80 cm for data collection. The data collected and analyzed in this study are based on this specific Chinese painting, and the results do not represent the situation of other paintings. The relevant conclusions are also not applicable for promotion to other paintings. The data were sampled at 10° intervals from 30° to 150° in turn, with a light source illumination radius of 100 cm; the camera data acquisition radius was 150 cm. During the data collection process, fluctuations in device temperature and slight deviations in collection angles may introduce errors.
Figure 3 is a flowchart of the experiment, which shows the arrangement of the experimental setup and the processing steps such as the measurement process and data acquisition.
2.2. BRDF Model
BRDF is essentially a parametric modeling of an object’s material and is based on various theoretical and empirical formulae to correctly express the visible results of the material affected by incident light. In most applications, BRDF is usually presented as a mathematical equation. BRDF models, in general, can be divided into three categories: empirical, physical, and data-driven models. In this paper, three models are used for BRDF reconstruction: the five-parameter model in the empirical model, the Cook–Torrance model in the physical model, and segmented linear interpolation belonging to the category of data-driven models.
2.2.1. Five-Parameter Model
The goal of the empirical model is to provide the user with a concise formulation for simulating a specific reflection with relatively low model complexity. The five-parameter model is an empirical model derived from a modification of the Torrance–Sparrow model, which employs simplified parameter settings and is computationally efficient; however, when the model is applied to materials with more complex surfaces, simplification may lead to a risk of decreased accuracy [
31]. The model is simple in style and contains five unknown parameters:
where
,
,
,
, and
are unknown parameters. Concretely,
is the specular reflection coefficient,
is the diffuse reflection coefficient,
and
are parameters related to the target surface material,
is a parameter related to the micro-surface distribution, the geometry function
typically represents shadowing and masking effects,
is the incident zenith angle,
is the outgoing zenith angle,
is the incident azimuth angle, and
is the outgoing azimuth angle; the angular relationship is shown in
Figure 4. The angle relationship between
and
is as follows:
2.2.2. Cook–Torrance Model
The physical model is built based on scientific knowledge of the interaction of light and approximates real-world materials as accurately as possible by incorporating various geometric–optical properties of the material [
32]. Considering that the research object includes color chips with matte surfaces, the Cook–Torrance model can better reflect the specular reflection characteristics when dealing with smooth surfaces, making it suitable for the application scenario of this study. The model improves accuracy through more detailed parameter descriptions and physical modeling, but it has higher parameter sensitivity and computational complexity. The model divides the BRDF into a body diffuse reflection term and a surface reflection term:
where
is the ratio of the energy of the refracted part of the incident light,
is the albedo,
is the ratio of the reflected part,
is the Fresnel reflection term,
is the geometric function,
is the normal distribution function,
is the incident direction of the light,
is the outgoing direction of the light,
represents the normal, and
is a Halfway Vector.
2.2.3. Segmented Linear Interpolation
The data-driven model is a model that uses actual measurement data for fitting. The fitting effect is the most realistic, but requires a large amount of data to implement the model, while the fitting usually requires interpolation and extrapolation of the data to calculate the BRDF data. The advantages of data-driven model include the following: (1) the model is built on the measurement data of real objects, and (2) the rendered reproduction images obtained by the data-driven model are usually more realistic. Segmented linear interpolation is a data-driven interpolation method suitable for continuous function reconstruction using discrete sampling points. This method divides the data into small intervals and uses simple linear equations to estimate the target value within each interval, thereby achieving high computational efficiency and reconstruction accuracy. The advantages of segmented linear interpolation are simple operation, low computational cost, easy implementation, and the fact that the interpolation function is continuous. but there may be insufficient capture of subtle reflection changes when dealing with high complexity surfaces [
33].
2.3. BRDF-Based Color Reproduction Method
CIE1931
XYZ color space is a color space independent of device characteristics and is not only often used as a standard color space for color description but also used as an intermediate transition color space [
34]. Other color systems between the interconversion are relatively easy to achieve. With the CIE 1931 standard observer [
35], any light energy that enters the human eye to produce color perception can be calculated, that is, the CIE chromaticity system tristimulus values
X,
Y, and
Z of the color stimulus function
:
where
is called the normalization factor and the purpose is to adjust the
Y value of the selected standard illuminant to 100 when targeting non-self-illuminated objects. Therefore, we have
If the measured object is a reflector,
is the color stimulus function:
where
is the spectral reflectance of the object and
is the spectral power distribution of the illumination source.
The bidirectional reflection coefficient (BRF) is the ratio of the reflected flux from the surface of the target object to be measured to the reflected flux from an ideal Lambertian body under the same incident and reflected conditions. The relationship between BRF and BRDF is described as follows:
BRF is equivalent to the reflectance factor in chromaticity, and it can effectively combine chromaticity theory and light scattering theory. The experiment can be calculated using the bidirectional reflection coefficient instead of .
Combining Equations (6)–(11), it can be seen that, as long as the BRDF of the target object is obtained, the color tristimulus value X, Y, and Z of the target object can be reconstructed, and with a result that the color-matching ratio of the three primary colors of the sample can be calculated to achieve the true reproduction of the color of the target area.
2.4. Accuracy Evaluation
To further quantify the model reconstruction results and evaluate the reconstruction accuracy, the root mean square error (RMSE) was used to evaluate the spectral reconstruction accuracy; the CIEDE2000 color difference formula and Structural Similarity Index measure (SSIM) are used to evaluate the color reconstruction accuracy.
The RMSE not only avoids the problem that positive and negative errors cannot be summed up but also squares the errors, increasing the role of errors with large values in the index and improving the sensitivity. The RMSE is used to measure the deviation between the estimated reconstructed spectral data and the actual value. The smaller the value, the higher the accuracy of the estimation [
36].
CIEDE2000 color difference is a unified indicator used to measure the color difference and quantify visual differences between colors [
37]. The smaller the color difference value, the higher the matching degree between the reconstructed color and the target color, usually indicating a more accurate color restoration effect.
SSIM is widely used in the field of image processing, especially in areas such as image compression, image restoration, and image quality evaluation. SSIM considers the perceptual features of images by humans and can more comprehensively reflect the image quality perceived by the human eye. The calculation of SSIM is based on three aspects of information: luminance similarity, contrast similarity, and structure similarity. The range of SSIM calculation results is −1 to 1, and the closer the value is to 1, the higher the similarity is between the two image structures and the better the quality; the closer the value is to −1, the lower the structural similarity is and the poorer the quality.
4. Discussion
In this paper, we explore the combination of realistically sampled BRDF data with a five-parameter model, the Cook–Torrance model, and a segmented linear interpolation method for BRDF reconstruction. The experimental results show that the segmented linear interpolation method exhibits excellent performance under multi-angle illumination conditions, especially in reproducing highlights and shadow details more accurately. This result not only proves the feasibility of the model in theory, but also demonstrates its powerful performance in practical applications. In contrast, the five-parameter model and Cook–Torrance model did not perform as expected at larger sampling intervals, resulting in a decrease in reconstruction accuracy. The advantage of the segmented linear interpolation method is that it can still provide high-precision reconstruction results even with a small amount of data, which is of great significance for the digital preservation of cultural heritage.
Although this study shows that the segmented linear interpolation model outperforms other models in testing scenarios of color chips and Chinese paintings, its applicability may be limited in cultural relics with larger sizes or more complex surface features. For example, the surface of three-dimensional objects such as sculptures or ceramics may have richer textures and surface shapes, and the performance of segmented linear interpolation models in handling these complex structures needs further exploration. In addition, the current experimental design mainly focuses on two-dimensional flat cultural relics, and future research can evaluate their applicability more comprehensively by testing the reconstruction performance of various models on different types of three-dimensional cultural relics. We suggest expanding the experimental design in future research by adding more diverse types of cultural relics and surface features to further test the generality and robustness of the model. On this basis, future research can also consider combining with emerging technologies such as AI-assisted color reproduction. AI technology, especially deep learning and neural networks, has made significant progress in the fields of color reconstruction and image restoration. Therefore, future research can consider combining BRDF with AI to leverage their respective advantages and promote the digital development of cultural heritage protection.
However, the framework proposed in this study provides an efficient and reliable solution for the color reconstruction of large-scale artworks, especially in the field of the digital preservation and display of Chinese painting, which has broad application prospects. The application of this method is not limited to Chinese painting, but can also be extended to other types of cultural heritage, 3D specimens, and objects with complex material surfaces, making it an important means of future digital preservation work.
5. Conclusions
This study combined the actual sampled BRDF data with the five-parameter model, Cook–Torrance model, and segmented linear interpolation method for BRDF reconstruction, and compared and analyzed the reconstructed BRDF values under unknown illumination angles with actual measurement values. The results show the following:
When modeling using color chip BRDF data with a sampling interval of 5°, all three modeling methods can accurately reproduce image colors under unknown illumination angles, with the segmented linear interpolation method showing the highest color reproduction accuracy. When modeling using color patch BRDF data with a sampling interval of 10°, the modeling performance of the five-parameter model and Cook–Torrance model is poor, while the segmented linear interpolation method has a very high spectral reconstruction accuracy, very small color reproduction differences, and can accurately predict highlights and shadow details in human visual perception.
Among the three models, the segmented linear interpolation method performed the best and was used to model large Chinese paintings. For the reconstruction predictions of 65° and 125°, the average RMSE of the selected reference color blocks is 0.0450 and 0.0589, and the average CIEDE2000 color difference is 1.07 and 1.50. From the perspective of human visual perception, the difference between the reconstructed images and measured images is minimal, and it can truly record and reproduce the colors of Chinese paintings. The overall research shows that combining a small amount of BRDF sampling data with segmented linear interpolation models can achieve simple and high-precision color reproduction at any lighting angle, providing a new method for the external reconstruction of cultural relics based on BRDF. Future research can further expand the scope of experiments, and explore the modeling performance of different materials and 3D artifacts, to test the universality of this method and further promote digital innovation in cultural heritage protection.