A Novel Spectral Matching Approach for Pigment: Spectral Subsection Identiﬁcation Considering Ion Absorption Characteristics

: Background: Hyperspectral technology has made it possible to perform completely non-invasive investigations on pigment analysis, in particular, on pigment identiﬁcation. The most commonly used method of pigment identiﬁcation is to compare the spectral similarity between ones of unknown target and ones in spectral library, which requires a comprehensive and complete spectral library and is based on overall shape of the spectrum. To a certain extent, it may ignore some of the key absorption characteristics of the spectrum. Methods: A novel spectral matching method was proposed based on the spectrum divided into subsections for identiﬁcation according to the main ion absorption characteristics. Main works: (1) establishing a spectral library suitable for typical pigment identiﬁcation of painting; (2) discussing the main components, as well as the absorption positions of the ions and functional groups contained in pigments frequently used by artists; (3) presenting a novel spectral matching algorithm carried on spectral subsections for pigment identiﬁcation; (4) verifying the feasibility and applicability of proposed method by a Chinese painting and a fresco. Conclusions: The proposed method can correctly identify the main pigments or components contained in the mixed area, which is better than the traditional method and more convenient than the unmixing method, except for some limitations in detecting white and black pigments.


Introduction
As more attention is drawn on the conservation of cultural relics, the use of modern technology to preserve information on the surface of cultural relics to achieve the protection and inheritance of that has become an important development trend in this field. Painted artifacts refer to a kind of cultural relics that adhere pigments to the substrate material through the binding media, including frescoes, paintings, painted potteries, painted clay sculptures, ancient architectural oil paintings, etc. The color on the surface of the precious painted artifacts with a long history such as Chinese paintings and frescoes will appear to be lost or faded in some degree. On the other hand, pigments with vivid the measurement standard of information divergence into Riemannian metric. The difference in component probability of the spectral vector was regarded as the probability variation. The pigment was identified by spectral information divergence, which effectively improved the matching accuracy.
Another commonly used method for spectral identification is to calculate the similarity of features extracted or enhanced from unknown spectra and reference spectra. It differs from the above-mentioned method in that it not only relies on the spectral curve in the standard spectral library, but also the spectral features enhanced for the similarity calculation. Typically, constraining the spectral shape is more important than the spectral magnitude because the former has a direct relationship with the composition of the target [28]. Therefore, it is necessary to enhance the spectral absorption characteristics of unknown spectra and reference spectra before spectral identification to obtain more accurate results. The methods for spectral absorption characteristics enhancement include the first derivative calculation and continuum removal of the spectrum. The derivative analysis of spectra has been widely applied in hyperspectral remote sensing and chemical analysis [29,30]. Fonseca et al. [31] used FORS to non-invasively identify madder-and cochineal based pigments on works of art. The features extracted in the first derivative transformation of the FORS spectra instead of the absorption features were used for pigment identification. This study provided a more robust means of primary identification and could be used to create a decision tree for the identification of madder and cochineal pigments based solely on FORS. Continuum removal is another widely used method for processing and analyzing spectra. It can not only highlight the absorption characteristics of spectral curves, but also normalize them to a unified spectral background, which is beneficial for the comparison between spectra measured in different environments. Furthermore, the original curve after removed continuum can be used for calculating the spectral characteristic parameters in the absorption bands. Wu et al. [32] performed continuum removal both on unknown spectra and reference spectra before spectral matching, and then used the least squares method for spectral features fitting to realize spectral identification. Cen et al. [33] highlighted the absorption and reflection characteristics on the spectral curve after continuum removal of mineral pigment collected, and extracted the band characteristics by using various spectral analysis methods. The identification and analysis of the main pigments of Thangka were realized by quantifying the spectral characteristics such as wavelength position, depth, symmetry, etc. It is of great significance to the identification, restoration, digital archiving, and reproduction of Thangka.
However, due to the similar spectral reflectance characteristics of different pigments with the same color, the above methods are prone to false matching in spectral matching of different materials with the same color [34]. Moreover, the colors on surfaces observed by our naked eyes or instruments are usually caused by a mixture of several kinds of pigments due to painting skills. The recognition ability of the above methods for mixed pigments is also very limited.
Since the absorption positions of main ions and functional groups in pigments will appear in certain intervals [35], we developed a pigment identification method based on the special ion absorption characteristics on subsection of pigment's reflectance spectra. It could extract the certain intervals for spectral subsection identification, which can locate key features of unknown spectra accurately. This method is also effective for the identification of mixed pigments.
In Section 1, the paper starts from an overall introduction of context of the study and a brief review of related works. Section 2 introduces the spectral identification methods proposed in the study in detail, followed by describing the typical pigment spectral library established by our team, the typical ion absorption positions of pigments, Spectral Absorption Index (SAI) and SAM used in our novel method. The description of experiment and the presentation of results presented in Section 3. Furthermore, the results are explained and discussed in Section 4. In Section 5, the conclusion is briefly summarized and future work is outlined as well.

Materials and Methods
The overall process of this study is given in Figure 1. A spectral library suitable for typical pigment identification on surface of paintings is established. Furthermore, a novel spectral subsection identification (SSI) method considering ion absorption characteristics is proposed to identify the types of pigments on the surface of painted artifacts. It is carried out on a Chinese painting created in a laboratory, and an outdoor fresco in Qutan Temple, Qinghai Province, China, created in 1392. Moreover, the traditional identification method using the entire spectrum is also applied to the two samples for comparison. Finally, either the known truth value or X-ray fluorescence (XRF) spectrometer is used to verify the identification effect and applicability of the method.
Remote Sens. 2020, 12, x FOR PEER REVIEW 5 of 25 types of pigments on the surface of painted artifacts. It is carried out on a Chinese painting created in a laboratory, and an outdoor fresco in Qutan Temple, Qinghai Province, China, created in 1392. Moreover, the traditional identification method using the entire spectrum is also applied to the two samples for comparison. Finally, either the known truth value or X-ray fluorescence (XRF) spectrometer is used to verify the identification effect and applicability of the method. The overall process of the study (SSI, spectral subsection identification (SSI) method considering ion absorption characteristics; XRF, X-ray fluorescence).

SSI Method
The SSI method adopts the SAI or SAM method based on the absorption feature of the unknown spectrum in each characteristics subsection to calculate the similarities with standard spectra in corresponding subsection. The final results represent the presence of each pigment in mixture using the index, which are calculated based on the weights assigned to the top three results of each subsection. As shown in Figure 2, the process can be carried out in the next steps. The overall process of the study (SSI, spectral subsection identification (SSI) method considering ion absorption characteristics; XRF, X-ray fluorescence).

SSI Method
The SSI method adopts the SAI or SAM method based on the absorption feature of the unknown spectrum in each characteristics subsection to calculate the similarities with standard spectra in corresponding subsection. The final results represent the presence of each pigment in mixture using the index, which are calculated based on the weights assigned to the top three results of each subsection. As shown in Figure 2, the process can be carried out in the next steps. (1) Perform the continuum removal on the unknown spectrum and the standard spectra in pigment spectral library. (2) Determine the number of subsections for the unknown spectrum as sub_int. The five detection ranges should be checked one by one to select the characteristic subsection(s), where the unknown spectrum has significant absorption characteristics as sub_int = (sub_int1, sub_int2, ... sub_intm) (m is the number of subsections, 0 < m ≤ 5), for subsequent spectral subsection identification. (3) If the unknown spectrum does not have any characteristic subsection, the whole spectrum will be used for traditional identification. Then, go to step (9). (4) Judge whether there is a single absorption feature in each subsection. If it is false, then go to step (6). (5) If there is a single absorption feature in the subsection, the similarities between spectra will be calculated by using SAI. Firstly, the SAI is calculated within the subsection of the unknown spectrum and all standard spectra in the pigment spectral library as SAI_u and SAI_s = (SAI_s1, SAI_s2, ...SAI_sn). Secondly, the difference is calculated between each element in SAI_si and the SAI_u. Finally, the smaller the absolute value result of (SAI_si-SAI_u), the higher is the similarity between the corresponding standard spectrum and the unknown spectrum in this subsection. The top three results with the highest similarity in each subsection will be selected. Then, go to step (7). (6) If there is no single absorption feature in the subsection, the similarities between spectra will be calculated by SAM. Firstly, the standard spectra within the subsection are extracted from pigment spectral library (after continuum removal). Then, we calculate the cosine of the spectral angles between them and the unknown spectrum in corresponding subsection. The larger the cosine value of the spectral angle, the higher is the similarity between the corresponding standard spectrum and the unknown spectrum in this subsection. The top three results with the highest similarity in each subsection will be selected. (7) Assign the weights. The top three pigments obtained in each subsection by step (5) or (6) are assigned weights of 3/3m, 2/3m, and 1/3m in order of ranking, respectively, where m is the number of subsections of the entire spectrum, and 0 < m ≤ 5. It should be noted that the higher (1) Perform the continuum removal on the unknown spectrum and the standard spectra in pigment spectral library. (2) Determine the number of subsections for the unknown spectrum as sub_int. The five detection ranges should be checked one by one to select the characteristic subsection(s), where the unknown spectrum has significant absorption characteristics as sub_int = (sub_int 1 , sub_int 2 , . . . sub_int m ) (m is the number of subsections, 0 < m ≤ 5), for subsequent spectral subsection identification. (3) If the unknown spectrum does not have any characteristic subsection, the whole spectrum will be used for traditional identification. Then, go to step (9). (4) Judge whether there is a single absorption feature in each subsection. If it is false, then go to step (6). (5) If there is a single absorption feature in the subsection, the similarities between spectra will be calculated by using SAI. Firstly, the SAI is calculated within the subsection of the unknown spectrum and all standard spectra in the pigment spectral library as SAI_u and SAI_s = (SAI_s 1 , SAI_s 2 , . . . SAI_s n ). Secondly, the difference is calculated between each element in SAI_s i and the SAI_u. Finally, the smaller the absolute value result of (SAI_s i -SAI_u), the higher is the similarity between the corresponding standard spectrum and the unknown spectrum in this subsection. The top three results with the highest similarity in each subsection will be selected. Then, go to step (7). (6) If there is no single absorption feature in the subsection, the similarities between spectra will be calculated by SAM. Firstly, the standard spectra within the subsection are extracted from pigment spectral library (after continuum removal). Then, we calculate the cosine of the spectral angles between them and the unknown spectrum in corresponding subsection. The larger the cosine value of the spectral angle, the higher is the similarity between the corresponding standard spectrum and the unknown spectrum in this subsection. The top three results with the highest similarity in each subsection will be selected. (7) Assign the weights. The top three pigments obtained in each subsection by step (5) or (6) are assigned weights of 3/3m, 2/3m, and 1/3m in order of ranking, respectively, where m is the number of subsections of the entire spectrum, and 0 < m ≤ 5. It should be noted that the higher ranking indicates that the pigment has a higher similarity with the unknown spectrum in this subsection. Therefore, the larger fraction will be assigned to the pigment. However, the pigment with the largest fraction in one subsection cannot be directly considered to exist in the mixed area, because the final identification result needs to be obtained by accumulating the weight scores of all the subsections. (8) Calculate the corresponding weighted index of each result according to the weights. According to the resulting weights of each characteristic subsection, the weighted index of each result is calculated. In that way, the existence of each pigment in mixture can be represented by the percentage. Moreover, the weighted index of pigment indicates the possibility of existence of the pigment, although it is not a strictly statistical probability. (9) To obtain the final identification result.

Pigment Selection
The suitable pigments for establishing spectral library is crucial for spectral identification, because it usually affects the quality of identification results [36]. After careful investigation and comparison, 32 kinds of pigments of Jiang Sixutang, a famous brand established 300 years ago, were selected for sample making, including 24 kinds of mineral pigments and eight kinds of botanical and chemical pigments [37] (see Table 1). As shown in Table 1, the number following the pigment name means that it was painted in the corresponding times.

Glue Preparation
Since the mineral pigments cannot be directly drawn on the paper, it was necessary to configure a certain concentration of the glue before making experimental samples. There are many types of glue for painting, and the choice of them varies depending on the region. The glue produced by Jiang Sixutang was selected for the study and used as the following steps. Firstly, the desired amount of glue was soaked four times with cold water, and then, hot water at about 80 • C was added six times after it had expanded.

Sample Design
In this study, the sample block of pigment was designed to be a size of 4 cm × 4 cm to ensure a sufficient space for spectral data collection. The Raw Xuan type of paper from Rongbaozhai, with no aluminum on the surface, was selected as a base material to reduce the influence on spectrum. Most samples were painted in one time, two times, and three times with a brush to get three different thickness of pigments to ensure that the absorption characteristics of pigment components can also be observed as the thickness of the samples changed. Part of the sample blocks of glued pigments are shown in Figure 3.

Glue Preparation
Since the mineral pigments cannot be directly drawn on the paper, it was necessary to configure a certain concentration of the glue before making experimental samples. There are many types of glue for painting, and the choice of them varies depending on the region. The glue produced by Jiang Sixutang was selected for the study and used as the following steps. Firstly, the desired amount of glue was soaked four times with cold water, and then, hot water at about 80 °C was added six times after it had expanded.

Sample Design
In this study, the sample block of pigment was designed to be a size of 4 cm × 4 cm to ensure a sufficient space for spectral data collection. The Raw Xuan type of paper from Rongbaozhai, with no aluminum on the surface, was selected as a base material to reduce the influence on spectrum. Most samples were painted in one time, two times, and three times with a brush to get three different thickness of pigments to ensure that the absorption characteristics of pigment components can also be observed as the thickness of the samples changed. Part of the sample blocks of glued pigments are shown in Figure 3.

The Instruments for Data Collection
The instrument used to acquire the spectral data was Analytical Spectral Devices (ASD) FieldSpec4 portable spectroradiometer, whose specific parameters were shown in Table 2. The data collection was carried out in a dark room to avoid the interference from all external light sources. Two halogen lamps, which can provide a source of light that is closest to sunlight, were chosen as an artificial light source for spectral data collection. In the study, if the region of interest (ROI) was large enough, the spectra would be collected by using the well-sealed probe and the internal halogen light source provided by the probe would be used for illumination. Otherwise, the fibers would be directly taken out for data collection and two halogen lamps would be used for illumination, such as the data collection in field. It is necessary to measure each sample multiple times and the data are averaged as a standard spectral curve in order to prevent external light sources and reduce operational errors. The instrument used for auxiliary verification about the reliability of spectral identification results was a portable XRF of XL3T900 with CCD camera, which can be performed for more than 40

The Instruments for Data Collection
The instrument used to acquire the spectral data was Analytical Spectral Devices (ASD) FieldSpec4 portable spectroradiometer, whose specific parameters were shown in Table 2. The data collection was carried out in a dark room to avoid the interference from all external light sources. Two halogen lamps, which can provide a source of light that is closest to sunlight, were chosen as an artificial light source for spectral data collection. In the study, if the region of interest (ROI) was large enough, the spectra would be collected by using the well-sealed probe and the internal halogen light source provided by the probe would be used for illumination. Otherwise, the fibers would be directly taken out for data collection and two halogen lamps would be used for illumination, such as the data collection in field. It is necessary to measure each sample multiple times and the data are averaged as a standard spectral curve in order to prevent external light sources and reduce operational errors. The instrument used for auxiliary verification about the reliability of spectral identification results was a portable XRF of XL3T900 with CCD camera, which can be performed for more than 40 kinds of elements analyses. In this study, the portable XRF was used to test the same region of interest collected by ASD, using the soil model, and the acquisition time of each point is 60 s.

The Typical Pigment Spectral Library
In the study, a typical pigment spectral library was built by the spectral data collected on the laboratory pigment samples, which was the basis for identifying pigment types on painting surfaces. It contained 32 kinds of pigments, 95 spectra in total, some of which are shown in Figure 4. Most of the pigments had a thickness of one layer, two layers, and three layers, while the Alum and Azurite (piece) were only painted with one layer.
Remote Sens. 2020, 12, x FOR PEER REVIEW 9 of 25 kinds of elements analyses. In this study, the portable XRF was used to test the same region of interest collected by ASD, using the soil model, and the acquisition time of each point is 60 s.

The Typical Pigment Spectral Library
In the study, a typical pigment spectral library was built by the spectral data collected on the laboratory pigment samples, which was the basis for identifying pigment types on painting surfaces. It contained 32 kinds of pigments, 95 spectra in total, some of which are shown in Figure 4. Most of the pigments had a thickness of one layer, two layers, and three layers, while the Alum and Azurite (piece) were only painted with one layer.

Typical Ion Absorption Positions of Pigments
As per the investigation of the absorption position of main ions and function groups contained in commonly used pigment [35,38], a complete summary is shown in Table 3.

Typical Ion Absorption Positions of Pigments
As per the investigation of the absorption position of main ions and function groups contained in commonly used pigment [35,38], a complete summary is shown in Table 3. According to the absorption positions summarized in Table 3, it can be found that the main cations include Cu 2+ , Fe 2+ , Fe 3+ , and Hg + , whose absorption positions generally appear before the wavelength of 1000 nm. The main functional groups are CO 3 2− and OH − , whose absorption positions generally appear after the wavelength of 1000 nm. It is further subdivided and defined as the detection range for the spectral subsection identification method. The first range is for cations detection, including 350-550 nm, 600-900 nm, and 700-1120 nm. Another one is for functional group detection, including 1400-1600 nm and 2300-2400 nm.

SAI and SAM
SAI is a comprehensive spectral absorption characteristic parameter. It was first proposed by Wang et al. and applied in extracting mineral composition from hyperspectral image [39]. The specific description is shown in Figure 5 and Equations (1)-(3).
where λ 1 , λ 2 , and λ m are the wavelength of the point S 1 , S 2 , and M, W is the width of the absorption feature, d is the symmetry of the absorption feature, r 1 , r 2 , and r m are the reflectance of the point S 1 , S 2 , and M, and SAI reflects the relative depth characteristics of the spectrum. According to the absorption positions summarized in Table 3, it can be found that the main cations include Cu 2+ , Fe 2+ , Fe 3+ , and Hg + , whose absorption positions generally appear before the wavelength of 1000 nm. The main functional groups are CO3 2− and OH -, whose absorption positions generally appear after the wavelength of 1000 nm. It is further subdivided and defined as the detection range for the spectral subsection identification method. The first range is for cations detection, including 350-550 nm, 600-900 nm, and 700-1120 nm. Another one is for functional group detection, including 1400-1600 nm and 2300-2400 nm.

SAI and SAM
SAI is a comprehensive spectral absorption characteristic parameter. It was first proposed by Wang et al. and applied in extracting mineral composition from hyperspectral image [39]. The specific description is shown in Figure 5 and Equations (1)-(3).
where λ1, λ2, and λm are the wavelength of the point S1, S2, and M, W is the width of the absorption feature, d is the symmetry of the absorption feature, r1, r2, and rm are the reflectance of the point S1, S2, and M, and SAI reflects the relative depth characteristics of the spectrum.
In the SAM method, the spectral curve of n bands is considered as a n-dimensional vector. Generally, the cosine of the angle between two spectral vectors is calculated to evaluate the similarity between these spectra, whose range will be 0 to 1. The larger the cosine value, the more similar the spectra are. In the SAM method, the spectral curve of n bands is considered as a n-dimensional vector. Generally, the cosine of the angle between two spectral vectors is calculated to evaluate the similarity between these spectra, whose range will be 0 to 1. The larger the cosine value, the more similar the spectra are.

Experiment of a Chinese Painting
A Chinese painting was drawn on rice paper by using several commonly used mineral and botanical pigments. During the drawing process, the pigments used were recorded as the reference data to verify the experimental results recognized in this study.

Data Collection of the Chinese Painting
Several typical areas were selected on the surface of the Chinese painting, and their spectra were collected by using ASD. In order to make the sample points distributed as evenly as possible on the entire painting surface and reduce the impacts of subjective selection, a grid was drawn on the orthophoto of the painting firstly, so that the sample points can be selected at each corner point. Then, these sample points can be classified according to different groups and analyzed respectively. Due to the randomness of the grid generation, in the line-by-line spectral acquisition process, if there was less pigment at the intersection or the mixing was too complicated, some points could be ignored or replaced by others that were more suitable and closer to them.
The specific sample points are shown in Figure 6. According to the different colors, these points are divided into five groups, named C1, C2, C3, C4, and C5, listed in Table 4. The data collection environment of the Chinese painting is consistent with the condition of spectral library establishment, which has been described in Section 2.2.2.
Remote Sens. 2020, 12, x FOR PEER REVIEW 11 of 25 A Chinese painting was drawn on rice paper by using several commonly used mineral and botanical pigments. During the drawing process, the pigments used were recorded as the reference data to verify the experimental results recognized in this study.

Data Collection of the Chinese Painting
Several typical areas were selected on the surface of the Chinese painting, and their spectra were collected by using ASD. In order to make the sample points distributed as evenly as possible on the entire painting surface and reduce the impacts of subjective selection, a grid was drawn on the orthophoto of the painting firstly, so that the sample points can be selected at each corner point. Then, these sample points can be classified according to different groups and analyzed respectively. Due to the randomness of the grid generation, in the line-by-line spectral acquisition process, if there was less pigment at the intersection or the mixing was too complicated, some points could be ignored or replaced by others that were more suitable and closer to them.
The specific sample points are shown in Figure 6. According to the different colors, these points are divided into five groups, named C1, C2, C3, C4, and C5, listed in Table 4. The data collection environment of the Chinese painting is consistent with the condition of spectral library establishment, which has been described in Section 2.2.2.    A Chinese painting was drawn on rice paper by using several commonly used mineral and botanical pigments. During the drawing process, the pigments used were recorded as the reference data to verify the experimental results recognized in this study.

Data Collection of the Chinese Painting
Several typical areas were selected on the surface of the Chinese painting, and their spectra were collected by using ASD. In order to make the sample points distributed as evenly as possible on the entire painting surface and reduce the impacts of subjective selection, a grid was drawn on the orthophoto of the painting firstly, so that the sample points can be selected at each corner point. Then, these sample points can be classified according to different groups and analyzed respectively. Due to the randomness of the grid generation, in the line-by-line spectral acquisition process, if there was less pigment at the intersection or the mixing was too complicated, some points could be ignored or replaced by others that were more suitable and closer to them.
The specific sample points are shown in Figure 6. According to the different colors, these points are divided into five groups, named C1, C2, C3, C4, and C5, listed in Table 4. The data collection environment of the Chinese painting is consistent with the condition of spectral library establishment, which has been described in Section 2.2.2.  A Chinese painting was drawn on rice paper by using several commonly used mineral and botanical pigments. During the drawing process, the pigments used were recorded as the reference data to verify the experimental results recognized in this study.

Data Collection of the Chinese Painting
Several typical areas were selected on the surface of the Chinese painting, and their spectra were collected by using ASD. In order to make the sample points distributed as evenly as possible on the entire painting surface and reduce the impacts of subjective selection, a grid was drawn on the orthophoto of the painting firstly, so that the sample points can be selected at each corner point. Then, these sample points can be classified according to different groups and analyzed respectively. Due to the randomness of the grid generation, in the line-by-line spectral acquisition process, if there was less pigment at the intersection or the mixing was too complicated, some points could be ignored or replaced by others that were more suitable and closer to them.
The specific sample points are shown in Figure 6. According to the different colors, these points are divided into five groups, named C1, C2, C3, C4, and C5, listed in Table 4. The data collection environment of the Chinese painting is consistent with the condition of spectral library establishment, which has been described in Section 2.2.2.  Take the red region C1 as an example, where 15 spectra were collected. According to the method mentioned above, three characteristic subsections were determined for the SSI method. Moreover, weights were assigned in order of ranking. The results and weights of each subsection are listed in Table 5. In order to simplify the table, only the numerator of the weight was written after each pigment name (Underlined and bolded), and the denominator, which was 9 (m = 3) in this set of data, was omitted. For example, the top three identification results of the first characteristic subsection of the point 1 are eosin, crimson, and cyan, with the weights given as 3/9, 2/9, and 1/9, respectively. It should be noted that the large fraction here means that the spectrum of the corresponding pigment is more similar to the unknown spectrum in this subsection. The weighted index in the last line is calculated by accumulating the scores in each subsection for all the 15 spectra, followed by averaging (divided by the number of spectra, which is 15 here). It should be noted that the weighted index of a pigment describes the possibility of the existence of the pigment at the test point of the painting. At the same time, it also indicates the content of the pigment to some extent. Therefore, except for the first pigment, the second, and even the third pigment might be picked out as the identification results, depending on the values of their index. The pigment would be regarded as one of the identification results if its index is greater than a given threshold. In identification of the Chinese painting, thresholds depend on the mean value of the weighted index of each region as in Equations (4) and (5): where W mean,i is the weight index mean for the ith point for a region in the Chinese painting, W i is the sum of weights of pigment for the ith point in this region, K i is the kind number of pigments for the ith point in the region, N is the total number of points in this region, and W mean is the mean value of W mean,i for N points in the region. In the pigment identification experiment for the Chinese painting, the W mean of each region is selected as the threshold. According to Equations (4) and (5), the thresholds of the five regions of the Chinese painting were calculated and given in Table 6. The identification results of C1 around the threshold are sorted in descending order of weight index as eosin (0.778), crimson (0.356), and cyan (0.304). Combined with the colors presented in this area and the threshold, the mixed pigments in this area are the most likely to contain eosin pigment, followed by crimson.
In order to make the results more intuitive and clearer, the results in each subsection of all spectra are not listed. The final identification results of the five regions and the weighted indices are directly listed in Table 7. The pigments used in the same five regions of the Chinese painting were also identified by the traditional method of SAM, spectral features match, and binary encoding match in software ENVI. The whole spectral curves were matched with the spectral library built in this study. The weights for each algorithm were set to be 1 and the top three pigments were selected as the results in Table 7.

Comparison of the Identification between the Two Methods in the Chinese Painting
The identification results using two methods in the five regions of Chinese painting are listed in Table 7. The results that meet the threshold of SSI method in each area are bolded in the second column, the top three results of traditional matching methods are listed in the third column, and the truth value recording when the Chinese painting is drawn are listed in the last column.
The results identified by the SSI method and traditional method can be described as follows: 1 C1 was painted with pigments of eosin, crimson, and madder according to the record. The eosin and crimson were identified correctly both by SSI and traditional one, while the pigment madder was missed by the approach proposed.
2 C2 was painted with pigments of crimson and clam meal. Both SSI and the traditional method correctly identified the crimson, but neither identified the clam white.
Remote Sens. 2020, 12, 3415 14 of 22 3 C3 was painted with pigments of malachite and ink, which were correctly identified by using traditional method, while the ink was missed by using SSI method. 4 C4 was painted with pigments of ocher and malachite. The pigments contained in the region were correctly identified by using the SSI method, but the ocher was missed by the traditional one. 5 C5 was painted with pigments of malachite and ocher, which are correctly identified by using SSI method, while the ocher was missed by using the traditional method.

Experiment of a Fresco
The Qutan Temple, which is located in Ledu county, Qinghai province, China, was built in 1392. The huge colorful frescoes, most of them painted by the royal painters in the Ming and Qing Dynasties, are the precious treasure of Qutan Temple. In this study, the spectral data of a small test area located in the west corridor of the Qutan Temple was used to study the applicability of the SSI method for pigment determination. The tradition identification method was also used for comparison. Then, the reliability of identification results was verified by XRF.

Data Collection of the Fresco
Due to the large size of the fresco, it is difficult to perform spectra collection of all points on the fresco using an ASD spectroradiometer. Instead, several typical pigment areas were selected for study. A grid was drawn on the orthophoto of the fresco before data collection, and five regions of interest were selected as F1-5, where a total of 30 spectral data were collected. Their specific location and detailed information are shown in Figure 7 (black points) and Table 8. As the fresco is located in the corridor on the west side of the temple, which is basically in a dark environment, it is necessary to use two halogen lamps for illumination, and to take out the optical fibers and connect them with the pistol handle for measurement.
Remote Sens. 2020, 12, x FOR PEER REVIEW 15 of 25 ② C2 was painted with pigments of crimson and clam meal. Both SSI and the traditional method correctly identified the crimson, but neither identified the clam white. ③ C3 was painted with pigments of malachite and ink, which were correctly identified by using traditional method, while the ink was missed by using SSI method. ④ C4 was painted with pigments of ocher and malachite. The pigments contained in the region were correctly identified by using the SSI method, but the ocher was missed by the traditional one. ⑤ C5 was painted with pigments of malachite and ocher, which are correctly identified by using SSI method, while the ocher was missed by using the traditional method.

Experiment of a Fresco
The Qutan Temple, which is located in Ledu county, Qinghai province, China, was built in 1392. The huge colorful frescoes, most of them painted by the royal painters in the Ming and Qing Dynasties, are the precious treasure of Qutan Temple. In this study, the spectral data of a small test area located in the west corridor of the Qutan Temple was used to study the applicability of the SSI method for pigment determination. The tradition identification method was also used for comparison. Then, the reliability of identification results was verified by XRF.

Data Collection of the Fresco
Due to the large size of the fresco, it is difficult to perform spectra collection of all points on the fresco using an ASD spectroradiometer. Instead, several typical pigment areas were selected for study. A grid was drawn on the orthophoto of the fresco before data collection, and five regions of interest were selected as F1-5, where a total of 30 spectral data were collected. Their specific location and detailed information are shown in Figure 7 (black points) and Table 8. As the fresco is located in the corridor on the west side of the temple, which is basically in a dark environment, it is necessary to use two halogen lamps for illumination, and to take out the optical fibers and connect them with the pistol handle for measurement. Due to the long history of the fresco, it is impossible to obtain recordings or test results of the actual pigments used. Therefore, the portable XRF was used to detect the energy level of elements in Due to the long history of the fresco, it is impossible to obtain recordings or test results of the actual pigments used. Therefore, the portable XRF was used to detect the energy level of elements in each region. A total of 19 test points was collected for five regions, of which the specific location and detailed information are shown in Figure 7 (red points) and Table 8. The high-energy elements detected at each test point and their corresponding values are listed in Table 9. Among them, the elements with energy higher than 10,000 (kev) are bolded. In order to distinguish the difference in the energy level of each element detected, in Table 9, "++" and "+" are used to indicate that its energy is at a 100,000 and 10,000 level, respectively. The recognition ability analysis of the two methods can be performed by comparing the elements detection results with the chemical composition of the spectral identification result. each region. A total of 19 test points was collected for five regions, of which the specific location and detailed information are shown in Figure 7 (red points) and  Table 9. Among them, the elements with energy higher than 10,000 (kev) are bolded. In order to distinguish the difference in the energy level of each element detected, in Table 9, "++" and "+" are used to indicate that its energy is at a 100,000 and 10,000 level, respectively. The recognition ability analysis of the two methods can be performed by comparing the elements detection results with the chemical composition of the spectral identification result. Since XRF can only provide the type of element contained in pigment, it is hard to distinguish those different pigments containing the same ions by XRF. However, it can still be used as an auxiliary method to provide certain information reference for fresco data without truth value. each region. A total of 19 test points was collected for five regions, of which the specific location and detailed information are shown in Figure 7 (red points) and  Table 9. Among them, the elements with energy higher than 10,000 (kev) are bolded. In order to distinguish the difference in the energy level of each element detected, in Table 9, "++" and "+" are used to indicate that its energy is at a 100,000 and 10,000 level, respectively. The recognition ability analysis of the two methods can be performed by comparing the elements detection results with the chemical composition of the spectral identification result. Since XRF can only provide the type of element contained in pigment, it is hard to distinguish those different pigments containing the same ions by XRF. However, it can still be used as an auxiliary method to provide certain information reference for fresco data without truth value. each region. A total of 19 test points was collected for five regions, of which the specific location and detailed information are shown in Figure 7 (red points) and Table 8. The high-energy elements detected at each test point and their corresponding values are listed in Table 9. Among them, the elements with energy higher than 10,000 (kev) are bolded. In order to distinguish the difference in the energy level of each element detected, in Table 9, "++" and "+" are used to indicate that its energy is at a 100,000 and 10,000 level, respectively. The recognition ability analysis of the two methods can be performed by comparing the elements detection results with the chemical composition of the spectral identification result. Since XRF can only provide the type of element contained in pigment, it is hard to distinguish those different pigments containing the same ions by XRF. However, it can still be used as an auxiliary method to provide certain information reference for fresco data without truth value. each region. A total of 19 test points was collected for five regions, of which the specific location and detailed information are shown in Figure 7 (red points) and Table 8. The high-energy elements detected at each test point and their corresponding values are listed in Table 9. Among them, the elements with energy higher than 10,000 (kev) are bolded. In order to distinguish the difference in the energy level of each element detected, in Table 9, "++" and "+" are used to indicate that its energy is at a 100,000 and 10,000 level, respectively. The recognition ability analysis of the two methods can be performed by comparing the elements detection results with the chemical composition of the spectral identification result. Since XRF can only provide the type of element contained in pigment, it is hard to distinguish those different pigments containing the same ions by XRF. However, it can still be used as an auxiliary method to provide certain information reference for fresco data without truth value. each region. A total of 19 test points was collected for five regions, of which the specific location and detailed information are shown in Figure 7 (red points) and Table 8. The high-energy elements detected at each test point and their corresponding values are listed in Table 9. Among them, the elements with energy higher than 10,000 (kev) are bolded. In order to distinguish the difference in the energy level of each element detected, in Table 9, "++" and "+" are used to indicate that its energy is at a 100,000 and 10,000 level, respectively. The recognition ability analysis of the two methods can be performed by comparing the elements detection results with the chemical composition of the spectral identification result. Since XRF can only provide the type of element contained in pigment, it is hard to distinguish those different pigments containing the same ions by XRF. However, it can still be used as an auxiliary method to provide certain information reference for fresco data without truth value. Since XRF can only provide the type of element contained in pigment, it is hard to distinguish those different pigments containing the same ions by XRF. However, it can still be used as an auxiliary method to provide certain information reference for fresco data without truth value.

Pigment Identification of Fresco Using Two Methods
Take the green region F1 of the fresco as an example, where nine spectra were collected for pigment identification. According to the steps mentioned in Section 2.1, four characteristic subsections were determined to perform SSI method. Moreover, weights were assigned in order of ranking. As shown in Table 10, the numerator of the weight that was also written after each pigment name (underlined and bolded), and the denominator, which was 12 (m = 4) in this set of data, was omitted. Similar to the above Chinese painting pigment identification experiment, in addition to the pigment with the highest index, the second or third ranked according to the threshold value may also be selected as the identification result. Considering that the fresco is located in a more complex environment, with older history, and the use of pigments is more diverse, the threshold of the fresco is set lower than that for Chinese painting pigment identification in a more relaxed condition. Therefore, the threshold for each region in the fresco will be calculated by Equation (6). The thresholds for five regions are listed in Table 11.
where TF j is the threshold of the jth region in the fresco, W mean is mean of W mean,i as mentioned in Equation (4), σ is the standard deviation of W mean,i for each region, and j is the number of regions (j = 1, 2, 3, 4, 5). The identification results of F1 around the threshold are sorted in descending order of weight index in the last line of Table 9. It can be seen that the result with the highest weighted index in region F1 is malachite (0.769), followed by chalk (0.250), which are larger than the threshold. Therefore, these two are kept and the rest of are excluded from the final result. Combined with the colors presented in this area, the final identification result can be described as: the mixed pigments in region F1 are most likely to contain malachite, and may also exist a certain amount of chalk. The final identification results of the five regions and their weighted indices are listed in Table 12. In addition, similar to the Chinese painting experiment, the pigments used in the same five regions of fresco are also identified by traditional method. The top three pigments are selected to show the results.

Comparison of Identification between Two Methods in the Fresco
In Table 12, the results that meet the threshold of SSI method, and the topic three results of traditional method in each area are listed in the second and third column, respectively. Moreover, the elements with energies higher than 10,000 detected by using XRF are listed in the last column. The XRF results are approximated as the truth value, and the pigment composition elements, which are correctly identified by the two methods, are in bold to facilitate comparison.
Note: Vermilion, cinnabar, and zinnober are all red pigments based on HgS. Vermilion is a synthetic pigment, which is not stable. Both cinnabar and zinnober are natural mineral pigments containing HgS. According to their particle size, they can be divided into cinnabar and zinnober. Their color is slightly different. The color of zinnober is red and yellow, which is lighter and more delicate than that of cinnabar.
The results identified by the SSI method and traditional method can be described as follows: It should be noted that high-energy Ca elements were detected in some regions, including F1, F2, F4, and F5, which may be caused by the presence of white pigments containing Ca in the mixture, or the base materials of the fresco were collected during the test.
Significantly, Wang et al. [40] collected 22 painting pigment samples from the gallery and architectural painting of Qutan Temple in Qinghai Province. They were analyzed by radioisotopic XRF and XFD and more than 20 kinds of inorganic mineral pigments were recognized. The results are summarized in Table 13 according to their colors. It can be seen that the pigments are basically consistent with that detected by XRF in this study.

Discussion
In this paper, some typical points of interest on a Chinese painting and a fresco were performed using the SSI method and the traditional method, respectively, to determine the type of pigment in these mixed regions. In addition, for the identification of pure samples, we have also performed rigorous experiments and confirmed that the two methods have the same ability to identify pure mineral pigments with the same accuracy rate of 100%. Based on the consideration that the overall research focuses on identifying the type of pigment in mixed area, the experiment of pure samples identification as well as the results are not included in this paper.
Based on the final identification results of the two methods, and combined with the known truth value of pigments or the XRF results, the accuracy of the two methods were calculated in Table 14. Specifically, the accuracy of the Top 3 using the SSI method was obtained by dividing the number of pigments that be correctly identified by the number of actually used at that region, while the Top 3 using the traditional method were calculated by dividing the number of correctly identified element types by the number of elements with above 10,000 kev energy detected by XRF in the same area. The correctness of the first matching result and the correct rate of the top three matching results are used to evaluate the two methods. In the Chinese painting experiment, the pigments used during the drawing process were recorded as the truth value. Therefore, through comparing with the result of the SSI method, it can be summarized as follows: (1) By using the SSI method, the correct rate of the first result in the five regions is 100.0%, and of the top three results 73.4%. Combined with the results of Chinese painting in Table 7, this method has limited ability to identify white and black pigments. Nevertheless, the first result obtained by this method is reliable, and the top three results can correctly identify the main components in the mixed area on the surface of Chinese painting. (2) Through applying the traditional method, the correct rate of the first result is 80.0%, and of the top three results 70.0%, which are lower than for the SSI method. Moreover, combined with the results presented in Table 7, the traditional method missed the ocher and white pigments in each mixed area.
In the fresco experiment, there were no recordings or test results about the actual pigments used due to its long history. Therefore, the XRF results of each ROI were used for qualitative analysis of mixture's components in this paper. It should be noted that, with the limitation of the instrument, only the elements detected by XRF can be used to assist in verifying the identification ability of the proposed method. The instrument can only provide the energy ranking of the commonly used elements contained in the test regions. Therefore, it is difficult to distinguish different pigments with the same element composition, and it is hard to know the possibility of botanical pigments in the mixture. Nevertheless, it can still be used as a means of auxiliary analysis to provide a certain information reference for fresco data without truth values: (1) By using the SSI method, the correct rate of the first result in the five regions is 100.0%, and of the top three results 75.0%. Combined with the identification results of the fresco (in Table 12) and the color of each ROI (in Table 8), the first result obtained by using SSI method is reliable.
(2) By using the traditional method, the correct rate of the first result is 60.0%, and of the top three results 58.4%. It can be seen that the accuracy of the traditional method is also lower than that of the SSI method, even for the fresco.
From the above discussion, it can be concluded that the SSI method can detect the main components contained in the area where multiple pigments are mixed, and the identification result is also consistent with the visual color presented in the area. However, there was some trouble in identifying white and black pigments according to the experiment results of Chinese painting. The possible reason is that the key of the SSI method is to identify the type of pigment in the mixture based on the absorption position of the ion contained in the mineral pigment. However, the black pigment used in the Chinese painting experiment in this paper is ink, of which main component is carbon. It is not a mineral pigment, and its spectral characteristics are not obvious. Therefore, it is difficult to detect out by using the SSI method. On the other hand, according to the use records of Chinese painting pigments, the use of white pigments in the C2 region (the ROI of Chinese painting) is small, which may be the reason why white pigments are not detected by the SSI method. Moreover, it is hard to verify whether there are botanical pigments in the mixture, or to distinguish whether the Ca element in the XRF results is from white pigment or the base material due to the instrument limitations in the fresco experiment. Nevertheless, in general, based on the truth records and the qualitative analysis from the XRF detection results, it can be seen that the SSI method has better performance on identifying multiple typical components in mixed region than the traditional method.

Conclusions
In the study, a typical pigment spectral library is established based on the pigment samples in laboratory. Then, a spectral subsection identification of pigments considering ion absorption characteristics, which divides spectrum into several characteristic subsections based on the main ion absorption position of each pigment, is proposed for determining the pigment type. Furthermore, it is applied to a Chinese painting and a fresco to test the applicability, and the traditional method is also used for comparison.
It can be concluded that the first result obtained by the proposed method can correctly identify the main pigment or component contained in the mixed region, and compared with the traditional method, it can also provide a more complete and more accurate result. The accuracy of the pigment identified by SSI is higher than the traditional method both in the Chinese painting and the fresco experiment.
According to a suitable threshold depending on weighted index, the SSI method can even provide a second or a third pigment identified in a simpler way than the unmixing method. It is better than the conventional identification method that can match only one pigment at a time, and its complexity lies in the traditional method of pigment recognition and spectral unmixing method, which can get more than one pigments at one time for a single point.
However, the proposed method has some limitations in detecting white and black pigments, so that some of the processes may need to be further refined to show a more significant identification advantage. In addition, the proposed method is carried out on the identification of one-dimensional spectral data in this paper. How effective the method is for hyperspectral images, which cannot be ignored, will be further studied.