Next Article in Journal
Identification, Taxonomy and Performance Assessment of Type 1 and Type 2 Spin Bowling Deliveries with a Smart Cricket Ball
Next Article in Special Issue
Impaired Lumbar Extensor Force Control Is Associated with Increased Lifting Knee Velocity in People with Chronic Low-Back Pain
Previous Article in Journal
Remote Sensing Image Scene Classification in Hybrid Classical–Quantum Transferring CNN with Small Samples
Previous Article in Special Issue
Microsoft HoloLens 2 in Medical and Healthcare Context: State of the Art and Future Prospects
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Best Practices for Body Temperature Measurement with Infrared Thermography: External Factors Affecting Accuracy

Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, USA
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(18), 8011; https://doi.org/10.3390/s23188011
Submission received: 3 August 2023 / Revised: 12 September 2023 / Accepted: 15 September 2023 / Published: 21 September 2023
(This article belongs to the Special Issue Human Health and Performance Monitoring Sensors)

Abstract

:
Infrared thermographs (IRTs) are commonly used during disease pandemics to screen individuals with elevated body temperature (EBT). To address the limited research on external factors affecting IRT accuracy, we conducted benchtop measurements and computer simulations with two IRTs, with or without an external temperature reference source (ETRS) for temperature compensation. The combination of an IRT and an ETRS forms a screening thermograph (ST). We investigated the effects of viewing angle (θ, 0–75°), ETRS set temperature ( T E T R S , 30–40 °C), ambient temperature ( T a t m , 18–32 °C), relative humidity (RH, 15–80%), and working distance (d, 0.4–2.8 m). We discovered that STs exhibited higher accuracy compared to IRTs alone. Across the tested ranges of T a t m and RH, both IRTs exhibited absolute measurement errors of less than 0.97 °C, while both STs maintained absolute measurement errors of less than 0.12 °C. The optimal T E T R S for EBT detection was 36–37 °C. When θ was below 30°, the two STs underestimated calibration source (CS) temperature ( T C S ) of less than 0.05 °C. The computer simulations showed absolute temperature differences of up to 0.28 °C and 0.04 °C between estimated and theoretical temperatures for IRTs and STs, respectively, considering d of 0.2–3.0 m, T a t m of 15–35 °C, and RH of 5–95%. The results highlight the importance of precise calibration and environmental control for reliable temperature readings and suggest proper ranges for these factors, aiming to enhance current standard documents and best practice guidelines. These insights enhance our understanding of IRT performance and their sensitivity to various factors, thereby facilitating the development of best practices for accurate EBT measurement.

1. Introduction

Elevated body temperature (EBT) has emerged as a critical indicator for various infectious diseases that have triggered outbreaks, epidemics, and pandemics in recent years. Notable instances include the severe acute respiratory syndrome (SARS) epidemic in 2003, the influenza A (H1N1) epidemic in 2009, the middle east respiratory syndrome (MERS) outbreak in 2012, the Ebola virus disease (EVD) epidemic in 2014, the coronavirus (COVID-19) pandemic from 2020 to 2022, and the Mpox virus (MPV) outbreak in 2022 [1,2,3,4,5,6,7,8,9]. Although relying solely on EBT screening may not suffice as an isolated preventive measure, it can serve as a valuable component within a comprehensive risk management strategy, particularly during the early stages of an epidemic when vaccines and testing resources may be limited or unavailable.
Thermal modalities, including infrared thermographs (IRTs, also known as thermal/infrared cameras/imagers) and non-contact infrared thermometers (NCITs), offer safe, non-contact, and non-invasive methods for EBT screening. These modalities have gained popularity as screening tools for identifying individuals with EBT in public areas during infectious disease pandemics, as they enable fast and real-time detection of infrared (IR) energy radiated by a person’s face. NCITs measure temperature at a single point using a sensor with one or a few pixels. On the other hand, IRTs provide a temperature map of a large area using a sensor with thousands of pixels, which allows for greater flexibility in assessing different regions of the face and improves the effectiveness of temperature estimation [10,11]. Recent studies and evidence in the literature suggest that qualified IRTs, when used properly, can offer superior accuracy in estimating EBT compared to NCITs [12,13,14]. The ability of IRTs to capture temperature distributions across a large area can contribute to more accurate readings and mitigates the impact of localized temperature variations that may occur with NCITs.
In recent years, IRT technology has undergone significant advancements and demonstrates potential across a spectrum of applications [15]. These applications include cancer detection [16], sports medicine [17], foot thermoregulation study [18], sinusitis detection [19], arthritis diagnosis [20], neonatal disease detection [21,22], multiple sclerosis evaluation [23], evaluation of diabetes-associated vascular disorders [24], dermatology [25], pain monitoring [26], dentistry [27], surgical procedures [28], etc. In this study, our focus is on the use of IRTs for EBT measurements.
Many parameters can affect the temperature measurement accuracy of an IRT. Moreira et al. presented a comprehensive checklist of parameters that might impact the measurement of skin temperature using IRTs in sports and exercise medicine, including individual-specific data (e.g., age, sex, body mass index, height, ethnicity), environmental factors (e.g., temperature, humidity, air flow, and sources of infrared radiation), contextual details (e.g., skin dryness, recent activity, measurement time), and instrumental variables (e.g., camera model, software, emissivity configuration) [17]. Zagrodny proposed best practices for accurate temperature measurements with IRTs, including subject preparation, laboratory conditions, and imaging practices [29]. Similar best practices for proper deployment, implementation, and operational practices are also recommended by international standard documents [30] and guidelines [31]. It is challenging to encompass all the factors that can influence IRT accuracy. Therefore, in this study, our focus is solely on environmental parameters (ambient temperature and relative humidity (RH)) and deployment parameters (working distance, viewing angle, and the set temperature of the external temperature reference source (ETRS)).
Our previous work has shown that if specific standardized requirements for basic safety and essential performance of IRTs are met and proper deployment, implementation, and operational guidelines are followed, IRTs can be used to accurately detect EBT [10]. The International Electrotechnical Commission (IEC) standard IEC 80601-2-59:2017 [32] recommends requirements for basic safety (e.g., electrical/mechanical/radiation hazards) and laboratory accuracy of IRTs for detecting EBT. While the basic safety requirements are straightforward, some laboratory accuracy test methods recommended by this standard need to be optimized. We previously implemented and evaluated these methods and proposed modifications to improve their effectiveness [33]. An FDA Regulatory Science Tool to evaluate IRT laboratory performance has also been developed [34]. However, no standards have been established to define requirements for IRT clinical accuracy. We previously conducted a clinical study involving over 1000 subjects to evaluate and compare different metrics and thresholds for quantifying IRT clinical accuracy [14,35].
While previous studies have addressed factors influencing IRT accuracy and recommended optimal temperature measurement practices, a gap remains in terms of systematic, quantitative analyses. Many studies reported their research conditions without quantitatively evaluating their impact on IRT accuracy. Other sources, including certain international standard documents [30], proposed ideal conditions and best practices for IRT use. However, consistently achieving these conditions can be impractical, as exemplified during the COVID-19 pandemic when temperature assessments frequently occurred at suboptimal building entrances. Amidst these considerations, a critical question arises: To what extent can deviations from ideal circumstances be tolerated while maintaining an acceptable level of temperature measurement accuracy? This central query forms the primary focus of our research. Specifically, we concentrate on various environmental and deployment factors within this context. Through this investigation, our aim is to offer practical insights into the permissible range of departure from ideal conditions for accurate temperature measurements. Our study examines environmental conditions including ambient temperature and RH, and deployment parameters including working distance, viewing angle, and the ETRS set temperature. We have chosen to scrutinize these parameters because they are inadequately defined in the international standard document [30] or defined within a narrow range that is unattainable in certain practical applications.
An ETRS—a blackbody radiator with known emissivity and temperature—is often essential to body temperature measurement with an IRT. Our previous study [33] has demonstrated that utilizing an ETRS for offset temperature compensation can improve the accuracy of an IRT when the stability and drift of the IRT alone cannot satisfy the standard accuracy requirements [32]. When combined, an IRT and an ETRS create a screening thermograph (ST) [32,33]. The ETRS temperature should ideally be set near a chosen diagnostic threshold temperature at the measurement site, which is the temperature above which a fever is considered to be present (note: Some IRTs and thermometers measure temperature at one site and convert it to a temperature at a reference site [14]). The ISO/TR 13154 standard document provides an example of setting the ETRS temperature at 35 °C [30]. However, there is currently no consensus on the optimal ETRS set temperature for IRT applications, and the impact of the ETRS set temperature on IRT accuracy has not been sufficiently investigated.
Viewing angle is a significant factor affecting IRT accuracy. The IEC 80601-2-59 and ISO/TR 13154 standard documents [30,32] specify that the target plane should be perpendicular to the IRT optical axis. Research has demonstrated that the emissivity of a flat object surface decreases as the viewing angle increases [36,37]. Consequently, if the IRT emissivity setting is fixed, the IRT will underestimate the object’s temperature at large angles. Several studies have explored concerns related to viewing angles in different applications [38,39,40]. However, these studies were focused on non-medical applications, such as infrastructure, building, and satellite imaging, especially at long working distances or short/medium wavelengths. Hori et al. developed a model for angular-dependent emissivity, but specifically for snow and ice in the 8–13 μm infrared band [41]. Cheng et al. investigated the impact of viewing angle on IRT accuracy, but their study was limited to medium/short wavelength (3–5 µm) IRTs [36]. Therefore, there is a need for a study that simulates a medical application scenario and examines the effect of viewing angle on IRT accuracy in that context.
Accurate body temperature measurement using IRTs and NCITs requires controlled ambient/atmospheric temperature, RH, and distance ranges. The ISO/TR 13154 standard document recommends conducting temperature measurements with IRTs indoors at temperatures of 20 °C to 24 °C and RH between 10% and 50% [30]. The ASTM E1965-98 standard specifies an operating temperature range of 16 °C to 40 °C and an RH range of up to 95% for infrared thermometer applications [42]. Environmental discomfort can affect thermoregulation and acclimatization of the human body [43], potentially impacting the relationship between the temperatures at the measurement site and the reference site [14]. Ambient temperature and RH can also affect skin emissivity by affecting skin moisture levels [44]. Temperature measurement distance is typically determined by the number of pixels required to cover the facial region in thermal images [32]. Additionally, ambient temperature, RH, and measuring distance collectively influence the atmospheric transmittance, which directly affects the accuracy of IRT temperature readings. While the effect of ambient temperature, RH, and working distance on temperature estimation or atmospheric transmittance has been investigated for different NCITs [45] and IRTs [38,46,47,48], there is a lack of consistent data across different documents. Thus, a systematic study is still needed to fully understand the effects of ambient temperature, RH, and measuring distance.
The purpose of this study is to objectively and quantitatively assess the effects of external factors relevant to the validity and practical implementation of IRTs through benchtop measurements and computer simulations. We focused on evaluating the performance of two specific IRTs under varying environmental conditions such as ambient temperature and ambient RH, as well as deployment parameters including working distance, viewing angle, and the ETRS set temperature. We seek to provide valuable insights into the effects of these factors on IRT performance. Through our assessment of these factors across wide ranges, we aim to lay the foundation for appropriate specifications in standard documents, ensuring precise temperature measurements. This contribution aids in advancing, enhancing, deploying, and regulating IRT technologies for highly accurate EBT screening. Preliminary results from this research have been presented at a conference [49], indicating the ongoing progress and dissemination of our findings in this area.

2. IRT Theory

Planck’s law [50] describes the spectral radiance of an ideal blackbody source (an object with emissivity equal to one) in thermal equilibrium at a given absolute temperature as:
L e , Ω , λ = 2 · h · c 2 λ 5 [ e ( h · c k · λ · T ) 1 ] 1
where L e , Ω , λ is the spectral radiance (unit W·m−2·sr−1·µm−1) for a blackbody at a specific wavelength λ (unit µm) and absolute temperature T (unit K). The equation incorporates several fundamental constants: h is the Planck constant equal to 6.6261 × 10−34 J·s, c is the speed of light equal to 2.9979 × 108 m·s−1, and k is the Boltzmann constant equal to 1.3806 × 10−23 J·K−1 [51].
For a Lambertian radiating surface, the radiance it reflects or emits is equal in all directions (isotropic). To calculate its spectral radiant emittance, denoted as M e , λ (in unit of W·m−2·µm−1), the Nusselt analog method can be employed:
M e , λ = π · L e , Ω , λ
Integration of Planck’s law equation for spectral radiant exitance over all wavelengths can obtain the Stefan–Boltzmann formula for a blackbody object as [38,52,53]:
M e = 0 M e , λ d λ = 0 2 π · h · c 2 λ 5 · [ e ( h · c k · λ · T ) 1 ] d λ = 2 · π 5 · k 4   15 · c 2 · h 3 · T 4 = σ · T 4
where M e (unit W·m−2) is the radiant exitance of the object at temperature T, and σ is the Stefan–Boltzmann constant equal to 5.67 × 10−8 W·m−2·K−4. Planck’s law and Stefan–Boltzmann law are derived based on the assumption that the object is in thermal equilibrium.
Most objects in everyday life are called graybodies since their emissivity ε (0 ≤ ε ≤ 1) is less than one. The Stefan–Boltzmann formula for a graybody object can be modified as the following equation, assuming ε is the same across all wavelengths [54,55]:
M e = ε · σ · T 4
An object can also reflect thermal radiation originating from other objects (e.g., sun), for a total amount of ( 1 ε ) · σ · T r e f l 4 radiant flux per unit area (radiant flux density), where T r e f l is the reflected temperature—the temperature of the energy incident upon and reflected from the measurement surface of the object [56]. In rare cases, a small amount of incident radiation might pass through the graybody, which is usually ignored. Radiosity is the total radiant flux leaving (emitted, reflected, and transmitted by) an object’s surface per unit area. When an IRT is used to detect the object’s surface temperature, radiation from the object will reach the IRT sensor after passing through the atmosphere, and therefore should be multiplied by the atmosphere transmittance τ (0 ≤ τ ≤ 1). The value of τ can be affected by environmental factors, such as measuring distance, RH, and atmosphere temperature, which will be discussed in detail in Section 3.4. The IRT sensor will also receive a small amount of ( 1 τ ) · σ · T a t m 4 radiation from the atmosphere with temperature T a t m . Figure 1 illustrates the total radiant flux received by an IRT. The total radiation ( E e , t o t a l , unit W·m−2) received by the IRT sensor can be expressed as follows [55,57]:
E e , t o t a l = ε · τ · σ · T 4 + ( 1 ε ) · τ · σ · T r e f l 4 + ( 1 τ ) · σ · T a t m 4
Based on Equation (5), the object temperature can be calculated as:
T = E e , t o t a l ε · τ · σ ( 1 ε ) · T r e f l 4 ε ( 1 τ ) · T a t m 4 ε · τ 4
In Equation (6), E e , t o t a l and T r e f l [56] can be measured with an IRT sensor, and T a t m can be measured with a thermometer. If there is no external source of IR radiation around the IRT, T r e f l can be considered the same as T a t m . If we know ε and τ , then T can be calculated.
The emissivity of an object’s surface is generally a function of the surface temperature T, wavelength λ , and the direction of the emitted radiation (viewing angle) θ , ε = ε ( T ,   λ ,   θ ) . We can fix θ to remove this factor and multiply ε = ε ( T ,   λ ) to Planck’s equation (Equation (1)), then integrate Planck’s equation to get a specific Stefan–Boltzmann equation for a given object. Based on the ε ( T ,   λ ) function, the specific Stefan–Boltzmann equation might be rather complex without an analytical expression. ε may be assumed constant for the case of IRT body temperature measurement because human skin emissivity does not change significantly over the narrow temperature range (e.g., 34–39 °C) and wavelength range (e.g., 7–14 µm) involved [58]. Equations (4)–(6) assume constant ε .
The Stefan–Boltzmann law gives total radiant exitance over all wavelengths from zero to infinity. However, in practical applications, an IRT sensor cannot detect radiation over all wavelengths. For example, many IRT sensors detect radiation in the 7 to 14 µm range. Therefore, a mathematical model to approximate the Stefan–Boltzmann equation for an IRT sensor can be used in the sensor software. While this model might be more than one, we discussed one model we used in Appendix A.

3. Methodology

Two long-wavelength (i.e., 7–14 µm) IRTs were used to evaluate the effects of environmental conditions (ambient temperature, RH) and deployment parameters (working distance, viewing angle, and ETRS set temperature) on IRT laboratory accuracy in a controlled lab environment simulating medical applications.

3.1. Experimental Setup and Test Method

Bench tests were performed in a closed room with air vents closed. Table 1 lists the devices used in this study with their specifications described in our previous publication [33]. A heater and a humidifier were used to control ambient temperature and RH. Once the desired condition was achieved, they were turned off during the IRT data acquisition to eliminate the effect of airflow. Since our data acquisition was fast (from a few seconds up to 15 min) and the ambient temperature and RH were relatively stable (do not detect change within 30 min), turning off the heater and humidifier did not adversely impact the tests. Figure 2 demonstrates the experimental setups, where the two IRTs were positioned adjacent to each other on a tripod to simultaneously measure the temperatures of both ETRS and calibration source (CS), which are both commercial blackbodies. The ETRS and CS were assembled on a cart with the same height as the IRTs. The ETRS functioned as a reference for IRT offset compensation during temperature measurement, while the CS served as a test target [10,14,33], allowing for the evaluation and comparison of the performance of IRTs. When an IRT and the ETRS work together to provide temperature readings, they form a screening thermograph (ST). The emissivity values of both ETRS and CS are 0.98 ± 0.02, which closely resemble the emissivity of human skin [58]. To comply with the IEC 80601-2-59 standard, the workable target plane (WTP) image was required to have a minimum resolution of 240 × 180 pixels. Unless stated otherwise, both ETRS and CS surfaces were placed within the WTP at a working distance of d = 0.8 m to satisfy this minimum resolution requirement of 240 × 180 pixels, as discussed in our previous publication [33].
Since our goal was to evaluate IRT or ST performance for EBT measurement (typical skin surface temperature), the set temperatures of ETRS ( T E T R S ) and CS ( T C S ) were around the threshold temperature range (36–37 °C for skin temperature [10]). The IRTs measured T E T R S and T C S simultaneously. The T C S directly measured by the IRTs without any temperature compensation are referred to as T I R T . After undergoing a two-step temperature compensation process, the resulting temperatures are referred to as T S T (previously [10], we called the measured T C S after temperature compensation T I R T ). The first step of temperature compensation based on the difference between set T E T R S and measured T E T R S has been described in detail in our previous publication [10]. When both CS and ETRS were set to 37 °C and considering the higher accuracy of the CS compared to the ETRS, we employed the difference between the measured T E T R S and measured T C S for the second-step temperature compensation. This approach allowed us to account for any variations between the two measurements and ensure more precise temperature adjustments.

3.2. Effect of ETRS Set Temperature

The ETRS should be set close to the threshold temperature (the temperature above which a person would be considered to have a fever) to compensate for any offset and improve the accuracy of temperature measurements [33]. The threshold temperatures for different body sites may vary, and the temperature measured at the measurement site can be converted to a different value at a reference site [14]. To evaluate the effects of the ETRS set temperature ( T E T R S ) on the accuracy of the STs in measuring the CS (i.e., the test target) temperature, we performed experiments where we set the CS temperature ( T C S ) at various values including 30, 34, 35, 36, 37, 38, and 40 °C. Throughout these experiments, we maintained a constant T E T R S . Multiple series of experiments were conducted, each with a different T E T R S within the range of 30 °C to 40 °C. In each experiment, a series of thermograms consisting of ten consecutive images were captured at a frame rate of 30 Hz. These thermograms were then averaged to obtain the measured CS temperature using a 50 × 50 pixels area as a region of interest. The measured CS temperature without temperature compensation ( T I R T ) and with temperature compensation ( T S T ) (see Section 3.1 for details) were compared with T C S to calculate the measurement error. The effect of T E T R S on the CS measurement error is discussed in Section 4.1. Our previous study has shown that the threshold temperature based on the whole-face maximum is between 36 °C and 37 °C (Tables 5 and 6 in [10]). The T E T R S was set at 37 °C to investigate the effects of the other external factors, such as ambient temperature, RH, working distance, and viewing angle, on the accuracy of temperature measurement.

3.3. Effect of Viewing Angle

The emissivity ε of a surface can be affected by the viewing angle [36,37,41]. Consequently, any deviation from the zero-degree viewing angle (i.e., the angle between the IRT optical axis and surface normal is zero) due to setup misalignment or an object’s surface curvature, has the potential to introduce measurement artifacts. To quantitatively investigate the effect of viewing angle, a series of measurements were conducted to simulate a fever screening scenario. The IRTs were utilized at a relatively short working distance of 1 m in a typical hospital and office environment: the ambient temperature T a t m was 23 °C and RH was 25%. The same method described in Section 3.1 was applied, except that the CS (target test) was rotated from 0° to 75°, with a step size of 5°. At each angle, thermal images were captured sequentially using both IRTs, and the T I R T and T S T values were obtained by averaging a 20 × 20 pixel area, except for large viewing angles (15 × 20, 10 × 20, and 5 × 20 pixels were averaged for the viewing angles of 65°, 70°, and 75°, respectively for IRT-1; 15 × 20 and 10 × 20 pixels were averaged for the viewing angles of 70° and 75°, respectively for IRT-2). The experiment was conducted four times, with the CS rotated to the right twice and to the left twice. The average values from these four repetitions were utilized to illustrate the effect of viewing angles on temperature measurement.

3.4. Effect of Environmental Factors (Ambient Temperature, RH) and Working Distance

To ensure reliable and consistent temperature measurements, the ISO/TR 13154 standard document recommends maintaining a stable indoor environment with an ambient temperature range of 20 °C to 24 °C and an ambient RH range from 10% to 50% [30]. The IEC 80601-2-59 ED 2017 standard recommends maintaining ambient RH below 50% and ambient temperature below 24 °C [32]. In this paper, we only focus on the effects of ambient temperature and RH on atmospheric transmission. Although an uncomfortable environment can affect IRT accuracy by changing skin moisture and emissivity, thermoregulation and acclimatization of the human body, and the atmosphere transmittance of infrared radiation.
The atmospheric transmittance τ is typically close to one and can be estimated based on the working distance (i.e., the distance between the object and IRT), atmospheric temperature, and ambient RH as follows [47,48,57]:
τ ( d , ω ) = K a t m   · e [ d · ( α 1 + β 1 · ω ) ] + ( 1 K a t m )   · e [ d · ( α 2 + β 2 · ω ) ]
where K a t m is the scaling factor for the atmospheric damping, d is working distance, α 1 and α 2 are attenuation factors for a dry atmosphere without water vapor, β 1 and β 2 are attenuation factors for water vapor, and ω is a coefficient indicating the content of water vapor in the atmosphere, which can be estimated as [47,48,57]:
ω ( ω % , T a t m _ C ) = ω % ·   e ( h 1 + h 2 · T a t m _ C + h 3 · T a t m _ C 2 + h 4 · T a t m _ C 3 )
where ω % is the ambient RH, h 1 , h 2 , h 3 , and h 4 are constants, and T a t m _ C is the atmospheric temperature in Celsius ( T a t m is in Kelvin in this paper). The scaling factors, attenuation factors, and other constants in Equations (7) and (8) which determine τ for a thermal signal, are wavelength-dependent and assumed constant in the spectral range of 7–14 µm in our study.
Previous research has reported specific values for these parameters for a long-wavelength IRT (ThermaCAM PM 595, FLIR Systems Inc., Nashua, NH, USA) [59]. The IRT-1 camera and the ThermaCAM PM 595 camera share a similar spectral range of 7.5 µm to 13 µm, which is comparable to the spectral range of 7 µm to 14 µm for the IRT-2 camera. It is important to note that slight variations in nominal sensor specifications may exist between different manufacturers, even for the same sensor chip. Therefore, the same values from Table 2 were utilized to compute τ for both IRT-1 and IRT-2.
In our study, the IRTs are uncooled microbolometers sensitive to long-wavelength IR radiation (the detail of the IRTs can be found in our previous studies [10,14,33,60]). The estimation of τ was based on the characteristics of the specific IRTs used in the study. The value of τ decreases with increasing distance and RH. The FLIR software ResearchIR Max 4 allows the operator to input the working distance, reflected temperature, RH, and ambient/atmospheric temperature to calculate τ based on Equations (7) and (8). The calculated value matched our manually calculated value. Therefore, we used the software-calculated value directly for IRT-1. However, for IRT-2, we manually calculated τ.
The ISO/TR 13154 standard document recommends an ambient temperature range of 20 °C to 24 °C for temperature measurements with IRTs [30]. The ASHRAE standard 55 recommends an indoor temperature of 19.4 °C to 27.8 °C for thermal comfort purposes [61]. Additionally, our previous clinical study involving over 1000 subjects was conducted over a broader range of ambient temperature (20 °C to 29 °C), but still showed that qualified IRT systems may offer higher diagnostic efficacy compared to commercial NCITs [14]. Table 3 lists the ambient temperature and RH ranges in different studies. In this study, we selected wider ranges of ambient temperature, RH, and working distance for bench tests (second-to-last row in Table 3). We also conducted computer simulations, as discussed in Section 3.5. Due to resource limitations in terms of available equipment like heater, humidifier, and laboratory space, computer simulations enable the study of ambient temperature, RH, and working distance beyond the ranges achievable in our experimental setup (last row in Table 3).
To explore the effects of environmental factors on temperature measurement, a humidifier and a heater were utilized to control the test environment, replicating various conditions. The experimental setup, which includes the IRTs and blackbodies, remains consistent with the setup described in Section 3.1. The IRTs were utilized at a relatively short working distance of 0.8 m. The temperatures of both ETRS and CS were maintained at 37 °C, which can be justified by the findings discussed in Section 4.1. When the effect of RH was evaluated, the ambient temperature was maintained at 24 °C, while the RH varied in the range of 15% to 80% with a step size of 5%. When the effect of ambient temperature was evaluated, the RH was maintained at 35%, and the ambient temperature was adjusted incrementally from 18 °C to 32 °C with a step size of 1 °C. Similar to our previous publication [33], the average temperature of a 50 × 50 pixels region was calculated to determine the ETRS and CS temperatures.
To investigate the effect of working distance on temperature measurement, the ambient temperature and RH were maintained at 24 °C and 50%, respectively. The working distance varied from 0.4 m to 2.8 m in 0.2 m intervals. While the IEC 80601-2-59 standard suggests a minimum coverage of 20 × 20 pixels for ETRS, at the 2.8 m working distance for IRT-2, only 15 × 15 pixels were usable for ETRS temperature calculation. The same numbers of pixels were used to calculate ETRS and CS temperature ( T I R T and/or T S T ). Additionally, two T E T R S values (35 °C and 37 °C) were selected to assess the effect of T E T R S on measurement accuracy at different working distances.

3.5. Computer Simulations

Computer simulations were conducted to assess the effects of ambient temperature, RH, working distance, and the utilization of an ETRS, on IRT and ST accuracies. A wide range of these factors were simulated, including ambient temperature ranging from 15 °C to 35 °C, RH ranging from 5% to 95%, and working distance ranging from 0.2 m to 3.0 m (as indicated in the last line of Table 3). These ranges were intentionally chosen to exceed the recommendations specified in standards, enabling a comprehensive analysis of the effects of these factors on temperature measurements.
We employed MATLAB software (MathWorks) to perform the simulations using the equations in Section 2 and Section 3.4. During the simulations, τ was computed using Equations (7) and (8), and the total radiation ( E e , t o t a l ) received by the IRTs was determined using Equation (5) based on the calculated τ. An object (referred to as CS in the experiments) temperature of 37 °C was assumed. Using E e , t o t a l , the object temperature was calculated with Equation (6), assuming τ is equal to one (i.e., ignoring the effect of ambient temperature, RH, and working distance on τ for temperature calculation). The rationale behind this was that the actual energy received by an IRT sensor is dependent on τ. When calculating the object temperature using the received energy, errors can occur if environmental factors are not considered (i.e., assuming τ = 1). The calculated temperatures were then compared with the actual object temperature (referred to as T C S in the experiments) to estimate the errors and demonstrate the effects of ambient temperature, RH, and working distance under two conditions: without an ETRS and with an ETRS set at 35 °C. The T E T R S can also affect accuracy. To evaluate this effect, the object temperature was set at 37 °C and T E T R S was varied from 20 °C to 50 °C during the simulations. Furthermore, to compare simulation results with benchtop measurement results, we systematically varied one parameter at a time while keeping all other variables constant during simulations, mirroring the methodology detailed in Section 3.4.

4. Results

4.1. Effect of ETRS Set Temperature

Figure 3 demonstrates the accuracy of IRT readout for a T C S range of 30 °C to 40 °C, considering different T E T R S values within the same temperature range. The ETRS compensation correction was not applied in the data demonstrated in Figure 3, and the legend is shown only for informative purposes. Therefore, different curves in each figure show the stability of each IRT and can be considered as their repeatability performance.
Figure 4 demonstrates the effect of T E T R S on ST accuracy within the temperature range of 30 °C to 40 °C, while maintaining T C S in the same range. This figure can be considered as Figure 3 after ETRS temperature compensation. The horizontal dashed lines in the figure represent the recommended laboratory accuracy between −0.5 °C and 0.5 °C as per the IEC 80601-2-59 standard [32], which include the combined standard uncertainty u (including drift, stability, uniformity, etc.) and offset errors ( T S T T C S ). In a previous study (refer to Table 4 in [33]), we determined | u | for ST-1 and ST-2 to be 0.13 °C and 0.11 °C, respectively. The recommended maximum offset errors ± | T S T T C S | can be calculated as ± | 0.5 | u | | , as indicated by the horizontal solid lines in the figure. Furthermore, the rectangular gray area denotes the required evaluation range of 34 °C to 39 °C. In our previous clinical study (refer to Table 5 in [10]), we identified the optimal cut-off temperatures for EBT detection, based on maximum facial temperature, to be 36.29 °C and 36.87 °C for ST-1 and ST-2, respectively, with an oral threshold temperature of 38 °C. Considering these findings, we performed our measurements with the ETRS set at 37 °C, aligning with the established cut-off values for accurate and reliable temperature assessments in detecting EBT.

4.2. Effect of Viewing Angle

Figure 5 illustrates the difference between T C S and its values measured by both STs ( T S T ). The data analysis revealed that the measurement error increases with viewing angle. For viewing angles below 30°, the measurement error remained below 0.05 °C. For viewing angles ranging from 30° to 40°, the temperature differences remained below 0.1 °C. However, the errors became more apparent for angles exceeding 40°. Notably, at a viewing angle of 60°, the temperature underestimation was measured to be 0.46 °C for ST-1 and 0.35 °C for ST-2. Moreover, at a viewing angle of 75°, the temperature underestimation was found to be 1.21 °C for ST-1 and 1.34 °C for ST-2. These results emphasize the sensitivity of both STs to varying viewing angles and the corresponding decrease in measurement accuracy as the viewing angle increases.

4.3. Effects of Ambient Temperature, RH, and Working Distance

A battery of benchtop measurements was performed to investigate the effects of the ambient temperature (ranging from 18 °C to 32 °C), RH (ranging from 15% to 80%), and working distance (ranging from 0.4 m to 2.8 m) on the accuracy of IRTs and STs. T C S was maintained at 37 °C for these measurements. Figure 6 demonstrates the results under various ambient RH and temperatures. The offset errors range from −0.65 °C to 0.65 °C, −0.97 °C to −0.08 °C, −0.12 °C to 0.10 °C, and −0.10 °C to 0.05 °C for IRT-1, IRT-2, ST-1, and ST-2, respectively, within the ambient RH range of 15% to 80% (Figure 6a). Similarly, the offset errors range from −0.30 °C to 0.64 °C, −0.75 °C to −0.14 °C, −0.11 °C to 0.04 °C, and −0.06 °C to 0.02 °C for IRT-1, IRT-2, ST-1, and ST-2, respectively, within the ambient temperature range of 18 °C to 32 °C (Figure 6b). It was observed that the ambient RH and temperature within the investigated ranges had no significant effects on the accuracy of any of the IRTs and STs.
Figure 7 demonstrates the effect of working distance ranging from 0.4 m to 2.8 m with 0.2 m increments on the accuracy of IRTs and STs, while maintaining the ambient temperature at 24 °C and RH at 50%. For T E T R S at 37 °C, the offset errors range from 0.64 °C to 0.76 °C, −0.79 °C to −0.36 °C, −0.09 °C to 0.07 °C, and −0.09 °C to 0.07 °C for IRT-1, IRT-2, ST-1, and ST-2, respectively, within the working distance range of 0.4 m to 2.8 m (Figure 7a). For T E T R S at 35 °C, the offset errors range from 0.59 °C to 0.86 °C, −0.75 °C to −0.38 °C, −0.22 °C to 0.04 °C, and −0.14 °C to 0.01 °C for IRT-1, IRT-2, ST-1, and ST-2, respectively, within the working distance range of 0.4 m to 2.8 m (Figure 7b).

4.4. Computer Simulations to Investigate Effects of Ambient Temperature, RH, and Working Distance

Computer simulations were performed to demonstrate the effects of the ambient temperature, RH, and working distance on the measurement accuracy of an IRT or ST, considering an object temperature of 37 °C. T S T was mathematically calculated by assuming T E T R S at 35 °C.
Figure 8a illustrates the estimated τ considering the external factors, while Figure 8b demonstrates the E e , t o t a l estimation received by an IRT device. Figure 8c,d demonstrate the temperature estimation of a 37 °C object without ETRS and with T E T R S at 35 °C, respectively. These results demonstrate a maximum error of approximately 0.29 °C for an IRT, which can be reduced to 0.04 °C for an ST by utilizing the ETRS temperature compensation.
Figure 9 demonstrates the effect of T E T R S on temperature estimation with T C S at 37 °C. For this simulation, we considered the influence of the external factors on calculation of the E e , t o t a l received by an IRT (Equation (5)). To calculate the temperatures of the object and ETRS based on E e , t o t a l , τ was assumed to be one to simulate errors caused by inaccurate τ. The calculated T E T R S was used to compensate the calculated object temperature to increase accuracy. The results show that the temperature estimation error can vary from −0.33 °C to 0.22 °C for T E T R S of 20 °C and 50 °C, respectively. However, the error is minimal, approximately ±0.02 °C, for T E T R S of 36 °C and 38 °C.
Figure 10 presents simplified two-dimensional curves, extrapolated from the intricate three-dimensional simulation results. These curves visually depict the simulation outcomes concerning the impact of ambient RH, ambient temperature, and distance on IRT and ST measurement accuracies, all simulated under a specific condition where both T C S and T E T R S were set at 37 °C. From Equations (7) and (8), it is evident that all these parameters influence the τ value. If we were to neglect these parameters and assume τ = 1, the directly calculated temperatures would exhibit errors in the absence of an ETRS for temperature compensation.
In all three graphs within Figure 10, ST errors were negligible due to temperature compensation based on T E T R S . However, the IRT errors, which stem from the simulations disregarding the infrared radiation absorbed by the atmosphere and assuming that the detected radiation comprises all the radiation emitted by the subject (i.e., assuming τ = 1), ranged from −0.04 °C to −0.09 °C, −0.05 °C to −0.08 °C, and −0.05 °C to −0.14 °C across varying ambient RH (15% to 80%), ambient temperature (18 °C to 32 °C), and working distance (0.4 m to 2.8 m) ranges, respectively.

5. Discussion

In our previous studies, we investigated the essential requirements for IRTs/STs, including stability, drift, uniformity, minimum resolvable temperature difference, and laboratory accuracy and demonstrated the effectiveness of the IRT systems in both benchtop measurements and clinical studies [10,14,33]. External factors (e.g., viewing angle, T E T R S , ambient temperature, RH, working distance) in these studies were well controlled and their effects on temperature measurement accuracy remained unexplored. The purpose of this study was to delve into these previously unexamined factors and investigate their effects on laboratory benchtop measurements.

5.1. Effect of ETRS Set Temperature

Figure 3 demonstrates the accuracy of the IRTs at different T C S without using the ETRS. The results show higher stability for IRT-1 compared to IRT-2, which agrees with our previous study (see Figure 2 of our previous study [33] for more details). The stability of an IRT can be improved by using a stable ETRS to form an ST. However, T E T R S can affect the ST accuracy. Figure 4 illustrates the importance of T E T R S on the accuracy of the STs. From this figure, the highest accuracy was achieved for T E T R S within the range of 36 °C to 37 °C, which agrees with the cut-off temperature in our clinical study (refer to Table 5 in [10]), specifically for ST-1. While Figure 3 suggested that IRT-2 exhibited higher instability compared to IRT-1, Figure 4 demonstrated that the use of a stable ETRS in ST-2 resulted in significantly improved stability compared to ST-1. When T E T R S was within the range of 36 °C to 37 °C, the offset errors ( T S T T C S ) for both IRTs met the accuracy requirements (i.e., within the two horizontal solid lines in Figure 4), except for when T C S was 34 °C and T E T R S was 37 °C and when T C S was 39 °C and T E T R S was 36 °C for ST-1.

5.2. Effect of Viewing Angle

There is a correlation between the skin temperature measurements and the viewing angles [67,68]. Cheng et al. showed that temperature underestimation becomes significant when viewing angles were beyond 40° on flat surfaces [36]. Muniz et al. demonstrate errors exceeding 2% at viewing angles above 35° with an IRT featuring an 18° and 35° field of view (FOV), and above 25° with an IRT having a 7° FOV [68].
Previous investigations on the effect of viewing angle were limited to short-wavelength IRTs or long-distance measurements in a non-medical setting (e.g., infrastructure, building, and satellite imaging). In our study, we designed the parameters (e.g., IRT wavelength, working distance) to mimic the application of EBT screening. We determined that viewing angles below 30° achieved an error below 0.05 °C, while wider viewing angles exceeding 40° showed significant underestimations of 0.1 °C up to 1.3 °C for an IRT with FOV larger than 14° (Figure 5). For an IRT with a smaller FOV than 14°, a viewing angle of less than 25° might be preferred [68]. These results highlight the importance of properly aligning viewing angles to minimize measurement artifacts and ensure accurate temperature measurements, in agreement with studies conducted for other applications [36,38,69]. Other factors that might change the effects of the viewing angle include the wavelength region of the IR sensor, instantaneous field of view, object material, and object curvature [36,38,40,68,69].

5.3. Effects of Ambient Temperature, RH, and Working Distance

Our previous clinical studies have demonstrated the high sensitivity and specificity of IRTs in detecting EBT when controlling the ambient room temperature and RH [10,14]. Table 3 presents a comparison of the ambient temperature, ambient RH, and working distance ranges for various studies. In this study, we investigated the effects of these factors, considering that certain conditions may necessitate broader room temperature and RH ranges than the current standard recommendations. For instance, maintaining a high RH (e.g., ~70%) and ambient temperature (e.g., ~32 °C) is outside of standard recommendations but can be beneficial for premature neonates [70]. Figure 6 shows the effects of ambient temperature and RH. As anticipated, the STs exhibit significantly superior accuracy compared to the IRTs, strongly indicating that the inclusion of a stable ETRS can greatly enhance accuracy across the wide ranges of ambient temperature and RH examined in this study. Particularly noteworthy is the improved accuracy achieved through the proper use of the ETRS in an optimal set temperature range of 36 °C to 37 °C, which helps minimize the impact of environmental factors. These results indicate that the ambient temperature and RH within the examined ranges had minimal impact on the accuracy of temperature measurements with an ST in the benchtop setting.
Since our study relied on bench tests without human subjects, we should be careful to extend the conclusions regarding the effects of ambient temperature and RH to clinical measurements. Human thermal sensation is primarily influenced by the overall thermal balance of the body, which is affected by various factors including physical activities, clothing levels, and environmental parameters, such as air temperature, mean radiant temperature, air velocity, and air humidity [71]. Conducting a systematic study encompassing all these factors is challenging, and there is no consensus on the proper ranges of these factors to define thermal comfort. However, assuming that other factors are within their optimal ranges or conditions, we will only focus our discussion on ambient temperature and RH. The neutral temperature, often referred to as the comfort temperature, is typically defined as the environmental temperature range within which the oxygen consumption, and thus heat production of homoiothermic subjects, is minimal. For an un-clothed adult, this range falls between 26 °C and 31 °C [72]. Ahmed’s study indicated that under still air conditions and an average RH of 70%, the boundaries of average air temperature for outdoor comfort can vary between 28.5 °C and 32.8 °C [73]. Jing et al. found that about 80% of subjects could not tolerate a thermal environment of 30 °C and 80% RH [74]. It appears that humans are less sensitive to RH compared to ambient temperature. Fountain et al. did not observe a clear difference in humidity response among sedentary subjects within the ranges of 20 °C/60% RH to 26 °C/90% RH [75]. Generally, a 10% increase in RH and a 0.3 °C rise in ambient temperature are both perceived as contributing equally to a warmer sensation [71]. Furthermore, Djamila et al. found that the occupants were thermally comfortable within a wide range of RH, with the mean RH, corresponding to a neutral temperature of 30 °C, being about 73% [76]. The ASTM E1965-98 standard specifies an operating temperature range of 16 °C to 40 °C and an RH range of up to 95% for NCIT applications [42]. Considering that IRTs and NCITs share similar physical principles, these ranges can be used as references. Taking all of these studies, including our own [14], into consideration, it is reasonable to extend the current ambient temperature range (20 °C to 24 °C) and RH range (10% to 50%) to encompass range of 20 °C to 29 °C and 10% to 80% RH, assuming the subject’s skin is dry. Moist skin surfaces resulting from sweating might affect skin emissivity [44] and lead to higher evaporation rates, which in turn can affect surface temperature measurements [77].
Figure 7 shows the effect of the working distance on the benchtop measurements for two sceneries of T E T R S = 37 °C and T E T R S = 35 °C, ranging from 0.4 m to 2.8 m. Distances closer than 0.4 m were not studied because capturing images of both CS and ETRS simultaneously became challenging. The standard recommends that the face should be covered by a minimum of 180 × 240 pixels, while the ETRS region should be covered by at least 20 × 20 pixels [32]. However, it is important to note that the actual number of pixels covering the subject’s face may vary depending on the working distance between the camera and the subject. In our previous studies, a working distance of 0.6 to 0.8 m was adopted to meet the standard criteria for a minimum of 180 × 240 pixels to cover the individual’s face [10,14,33]. IRTs with different pixel counts and FOV specifications require varying working distances to align with standard recommendations. Based on Section 4.1, the optimal ETRS set temperature for EBT screening is between 36 °C and 37 °C. To evaluate the results beyond this optimal range, Figure 7 demonstrates the difference when T C S was kept at 37 °C and 35 °C, respectively. The results indicate that when T E T R S was 37 °C, the STs exhibited smaller errors compared to when T E T R S was 35 °C. The working distance has little effect on IRT and ST accuracies in the working distance range we studied.

5.4. Computer Simulations to Investigate Effects of Ambient Temperature, RH, and Working Distance

The simulation results in Figure 8 illustrate the effects of environmental factors and working distance on τ. The simulation results encompass the E e , t o t a l received by an IRT, considering the actual τ and the temperature readout under the assumption of τ equal to one. These results are presented for both scenarios, with and without the inclusion of an ETRS. Figure 9 illustrates the effect of different T E T R S values on the accuracy of temperature readouts. The results in Figure 8 and Figure 9 highlight the significance of using an ETRS to minimize the effects of external factors on temperature measurements. It is observed that optimal accuracy was achieved when T E T R S was close to the target temperature or threshold temperature. These simulations show how temperature measurement accuracy can be influenced by ambient temperature, RH, working distance, and T E T R S .
Results in Figure 10 demonstrate the influence of ambient RH, ambient temperature, and working distance, with τ set to one to ignore these parameters, while keeping all other parameters constant, mirroring the benchtop results depicted in Figure 6 and Figure 7a. A meaningful comparison of Figure 10a with Figure 6a, Figure 10b with Figure 6b, and Figure 10c with Figure 7a can yield valuable insights since the default parameter values are the same in these figures. The simulation results in Figure 10 reveal that ambient RH, ambient temperature, and measuring distance can directly impact τ, thus affecting the total radiation received by the IRT sensor and the resulting IRT temperature readings. The absolute errors introduced by changes in ambient RH, temperature, and distance are less than 0.14 °C across the simulated parameter ranges. In the experimental data presented in Figure 6 and Figure 7a, proper τ values were utilized based on ambient RH, ambient temperature, and measuring distance, effectively mitigating the influence of these parameters in theory. This explains the absence of discernible trends in experimental errors as these parameters gradually vary. In Figure 6 and Figure 7a, experimental errors for STs range from −0.12 °C to 0.10 °C, and for IRTs, they span from −0.97 °C to 0.76 °C, encompassing all the parameter ranges under study. The experimental errors for IRTs are notably larger than the simulated errors. The primary reason behind this disparity is that the simulations assume an ideal infrared sensor, while inaccuracy in a real sensor typically has a significant impact on measurement errors.

5.5. Study Limitations

In this study, the measurements were conducted indoors without any external sources of infrared radiation. Therefore, the ambient/atmosphere temperature and reflected temperature were assumed to be equal. The American Society for Testing and Materials (ASTM) has provided a test method for measuring the reflected temperature [56], which can be another factor to consider in accurate temperature measurements.
The effect of wind or airflow, which can affect EBT screening accuracy, was not discussed in this paper. However, the ISO standard suggests that the screening area should be free from significant natural and forced convective airflow to ensure accurate measurements [30].
We recommend maintaining an optimal viewing angle below 30° when assuming a flat skin surface and a FOV larger than 14°. However, it is important to consider that the skin has varying levels of curvature at different locations. Depending on the specific area from which thermal radiation will be captured for temperature calculation, these variations in curvature should be considered.
Our study primarily focuses on assessing the influence of ambient temperature and RH on infrared signal detection. Moreover, it is important to note that these two factors, along with others, can affect human thermoregulation and thermal comfort [43]. Consequently, they can influence the relationship between the temperature measured at the measurement site and the reference site temperature [14]. Other factors include physical activities (sedentary and non-sedentary), clothing levels, mean radiant temperature, and air velocity [71,75]. The sweating threshold can vary among individuals and can be affected by various factors, such as subject’s fitness level, environmental conditions, adaptation period, and the RH [78,79]. Changes in RH have a direct relationship with the sweating rate [80], and gender difference can affect sweating capacity (with females generally having lower sweating capacity than males) [81]. Additionally, people in different regions may have diverse perceptions of comfort [82,83], and body mass index can potentially affect temperature measurements, particularly in relation to skin temperature [84]. The investigation of environmental factors that can affect biological/physiological changes was not within the scope of this study. The objective of this study was limited to the benchtop evaluation of the effect of ambient temperature and RH on infrared signal detection, although we did discuss their possible range for clinical measurements.
It is worth mentioning that different models exist for estimating τ [46,55,57] besides the one we used. Minkina et al. presented various models for evaluating τ for long-wavelength (7–14 µm) and short/mid-wavelength (2–5 µm) IR radiation [46]. We did not compare different models for estimation of τ . The model employed in this study to estimate τ is based on the equation provided by the manufacturer of IRT-1 [48].
Our primary aim is to objectively and quantitatively assess the effects of environmental and deployment factors on IRT accuracy and quantify their proper ranges through benchtop measurements and computer simulations. It is important to acknowledge that an accurate temperature measurement can be influenced by a multitude of other factors. Skin temperature naturally fluctuates due to variations in cardiac rhythm throughout the day [17,85,86], and the magnitude of these fluctuations can be influenced by gender and the specific measurement location [85,86]. Physical activity can increase heat production in muscles, impacting body surface temperature, which is why it is advisable to avoid physical activity before temperature measurement [87]. While IRT holds potential for targeted exercise scenarios and sports medicine [87,88,89], our study does not cover these areas. The impact of skin color has been extensively studied in the context of pulse oximeters. However, there is no strong evidence to suggest that skin pigmentation significantly affects IRT accuracy [64]. This is because pulse oximeters gauge the amount of light passing through the skin, where pigmentation can be a factor for light absorption. In contrast, IRTs measure the infrared light emitted from the skin due to the vibration of water and organic molecules, a proceed that is similar across all skin colors.
Several documents offer valuable guidance on best practices for measuring EBT with IRTs. The ISO/TR 13154 standard document [30] outlines guidelines for the deployment, implementation, and operation of IRTs for EBT screening. Additionally, best practice guide [31] offers detailed recommendations and operating procedures for conducting human body temperature screening using IRTs. These documents encompass best practices related to acclimation time, measuring background, sources of radiant heat, obstructions, skin conditions, etc. Due to space constraints, we are unable to comprehensively discuss all the factors that can potentially affect IRT accuracy in this study.
Finally, our study exclusively addresses the detection of EBT using facial thermal images. The necessary minimum resolution is determined with this specific focus. Therefore, we should exercise caution when attempting to extrapolate these results to other medical applications. Additionally, it is important to note that the minimum resolution is defined by pixel count. However, having more pixels in an IRT does not necessarily equate to superior performance compared to the one with fewer pixels. Other parameters, such as instantaneous field of view [90], stability and drift, image uniformity [33], modulation transfer function [91], signal transfer function, noise [92], among others, can have a significant impact on the performance of an IRT.

6. Conclusions

We conducted a comprehensive study combining benchtop measurements and computer simulations to examine the impact of environmental factors (ambient temperature and RH) and deployment variables ( T E T R S , working distance, and object orientation/viewing angle) on the accuracy of IRTs and STs for measuring body temperature. Results emphasized the importance of appropriate calibration and environmental control for reliable temperature readings. Comparison between simulation and experimental data also shows that the hardware performance might be more important than the environmental and deployment parameters for accurate thermal radiation detection. On the other hand, environmental parameters may exert a more significant influence on human body thermal regulation than on thermal signal detection, a topic not covered in this paper.
We have provided quantitative definitions of acceptable ranges for the environmental and deployment parameters under investigation. Some of these ranges have been expanded to accommodate IRT applications in less-than-ideal scenarios. The insights gained from our research inform the development of streamlined test methods and support ongoing efforts in establishing IRT guidelines. Our results will refine IRT standards and promote their practical use in healthcare settings, enhancing the ability to swiftly identify and address potential health risks.

Author Contributions

Conceptualization and funding acquisition, Q.W.; methodology, S.M. and Q.W.; software, S.M., P.G. and Q.W.; investigation, S.M. and Q.W.; data curation, S.M. and Q.W.; formal analysis, S.M. and Q.W.; resources, supervision, and project administration, Q.W.; writing—original draft preparation, S.M. and Q.W.; writing—review and editing, S.M., P.G. and Q.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the U.S. Food and Drug Administration’s Emergency Preparedness program. This project was supported in part by an appointment to the Research Participation Program at the U.S. Food and Drug Administration administered by the Oak Ridge Institute for Science and Education through an interagency agreement between the U.S. Department of Energy and the U.S. Food and Drug Administration.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors gratefully acknowledge Rob Simpson from the National Physical Laboratory in the United Kingdom for reviewing the manuscript, especially the IRT Theory section.

Conflicts of Interest

The mention of commercial products, their sources, or their use in connection with material reported herein is not to be construed as an actual or implied endorsement of these products by the Department of Health and Human Services. This article reflects the views of the authors and should not be construed to represent FDA’s views or policies. The authors declare that they have no competing interests.

Appendix A. Additional Equations

The signal for each pixel ( I p i x ) of IRT-1 can be calculated based on a gain and global offset of the camera as follows [48]:
I p i x = I r a w J 0 J 1
where I r a w is the raw data/signal captured by IRT sensors; J 0 and J 1 are constants given by the IRT-1 manufacture (see Table A1).
The object signal ( S o b j ) which is the corresponding signal level on the subject for each pixel can be calculated as [48]:
S o b j = K 1 · I p i x K 2
where K 1 and K 2 represent functions that depend on the emissivity ( ε ), temperature, and atmospheric transmittance (τ) properties [47,48]. Equation (A2) accounts for the effects of ε , τ, and ambient/atmosphere/reflected temperatures on the signal received by the camera.
K 1 = 1 ε · τ
and
K 2 = [ 1 ε ε · R e B T r e f l F + 1 τ ε · τ · R e B T a t m F + 1 τ E x t O p t i c s ε · τ · τ E x t O p t i c s · R e B T E x t O p t i c s F ]  
where R , B , and F are camera specific constants, which may be accessible from the camera itself. The specific values of R , B , and F for IRT-1 can be found in Table A1. T r e f l is reflected temperature, T a t m is atmosphere temperature, T E x t O p t i c s and τ E x t O p t i c s represent the temperature and transmittance of the external optics, respectively. τ can be estimated based on Equations (7) and (8) (see Section 3.4).
The three terms in Equation (A4) represent the influence of reflected environment, atmosphere environment, and external optics on K 2 . Since external optics were not used in this camera, we can remove that part from the equation. Our measurements were conducted in a small area with no external heat sources, which allows us to assume that the ambient temperature ( T a m b ) , T a t m , and T r e f l are equal. Consequently, we can simplify Equations (A4) into (A5) for our calculations.
K 2 = [ 1 ε ε · R e B T a m b F + 1 τ ε · τ · R e B T a m b F ]
The corresponding object temperature ( T o b j , unit: K) for each pixel can be calculated as follows [48,93]:
T o b j = B ln ( R S o b j + F )
By combining the aforementioned equations, the object temperature (unit: K) related to each pixel can be calculated as follows:
T o b j = B ln ( R [ 1 ε · τ   ·   I r a w J 0 J 1     1 ε ε   ·   R e B T r e f l     F + 1 τ ε · τ · R e B T a t m     F ] + F )
Table A1. IRT-1 camera parameters.
Table A1. IRT-1 camera parameters.
RBF J 0 J 1
16,710.821430.81650790.38906

References

  1. Huang, C.; Wang, Y.; Li, X.; Ren, L.; Zhao, J.; Hu, Y.; Zhang, L.; Fan, G.; Xu, J.; Gu, X. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020, 395, 497–506. [Google Scholar] [CrossRef] [PubMed]
  2. Goeijenbier, M.; Van Kampen, J.; Reusken, C.; Koopmans, M.; Van Gorp, E. Ebola virus disease: A review on epidemiology, symptoms, treatment and pathogenesis. Neth. J. Med. 2014, 72, 442–448. [Google Scholar] [PubMed]
  3. Nishiura, H.; Kamiya, K. Fever screening during the influenza (H1N1-2009) pandemic at Narita International Airport, Japan. BMC Infect. Dis. 2011, 11, 111. [Google Scholar] [CrossRef] [PubMed]
  4. Chiu, W.; Lin, P.; Chiou, H.; Lee, W.; Lee, C.; Yang, Y.; Lee, H.; Hsieh, M.; Hu, C.; Ho, Y. Infrared thermography to mass-screen suspected SARS patients with fever. Asia-Pac. J. Public Health 2005, 17, 26–28. [Google Scholar] [CrossRef]
  5. Mohamed, R.A.E.H.; Aleanizy, F.S.; Alqahtani, F.Y.; Alanazi, M.S.; Mohamed, N. Common Co-morbidities Are Challenging in the Diagnosis of Middle East Respiratory Syndrome (MERS-CoV) in Saudi Arabia. Pak. J. Biol. Sci. 2020, 23, 119–125. [Google Scholar] [CrossRef]
  6. Mouchtouri, V.A.; Christoforidou, E.P.; Menel Lemos, C.; Fanos, M.; Rexroth, U.; Grote, U.; Belfroid, E.; Swaan, C.; Hadjichristodoulou, C. Exit and entry screening practices for infectious diseases among travelers at points of entry: Looking for evidence on public health impact. Int. J. Environ. Res. Public Health 2019, 16, 4638. [Google Scholar] [CrossRef]
  7. Kumar, N.; Acharya, A.; Gendelman, H.E.; Byrareddy, S.N. The 2022 outbreak and the pathobiology of the monkeypox virus. J. Autoimmun. 2022, 131, 102855. [Google Scholar] [CrossRef]
  8. Ng, E.Y.K.; Acharya, R.U. Remote-sensing infrared thermography. IEEE Eng. Med. Biol. Mag. 2009, 28, 76–83. [Google Scholar] [CrossRef]
  9. Centers for Disease Control and Prevention. Enhanced Ebola Screening to Start at Five U.S. Airports and New Tracking Program for All People Entering U.S. from Ebola-Affected Countries. 2014. Available online: https://www.dhs.gov/news/2014/10/08/enhanced-ebola-screening-start-five-us-airports-all-people-entering-us-ebola (accessed on 14 September 2023).
  10. Zhou, Y.; Ghassemi, P.; Chen, M.; McBride, D.; Casamento, J.P.; Pfefer, T.J.; Wang, Q. Clinical evaluation of fever-screening thermography: Impact of consensus guidelines and facial measurement location. J. Biomed. Opt. 2020, 25, 097002. [Google Scholar] [CrossRef]
  11. Makino Antunes, A.C.; Aldred, A.; Tirado Moreno, G.P.; de Souza Ribeiro, J.A.; Brandão, P.E.; Barone, G.T.; Conselheiro, J.d.A.; Goulart, A.C.; Desuó, I.C.; Gomes, G. Potential of using facial thermal imaging in patient triage of flu-like syndrome during the COVID-19 pandemic crisis. PLoS ONE 2023, 18, e0279930. [Google Scholar] [CrossRef]
  12. Selent, M.U.; Molinari, N.M.; Baxter, A.; Nguyen, A.V.; Siegelson, H.; Brown, C.M.; Plummer, A.; Higgins, A.; Podolsky, S.; Spandorfer, P.; et al. Mass screening for fever in children: A comparison of 3 infrared thermal detection systems. Pediatr. Emerg. Care 2013, 29, 305–313. [Google Scholar] [CrossRef] [PubMed]
  13. Tay, M.; Low, Y.; Zhao, X.; Cook, A.; Lee, V. Comparison of Infrared Thermal Detection Systems for mass fever screening in a tropical healthcare setting. Public Health 2015, 129, 1471–1478. [Google Scholar] [CrossRef] [PubMed]
  14. Wang, Q.; Zhou, Y.; Ghassemi, P.; McBride, D.; Casamento, J.P.; Pfefer, T.J. Infrared Thermography for Measuring Elevated Body Temperature: Clinical Accuracy, Calibration, and Evaluation. Sensors 2022, 22, 215. [Google Scholar] [CrossRef] [PubMed]
  15. Lahiri, B.B.; Bagavathiappan, S.; Jayakumar, T.; Philip, J. Medical applications of infrared thermography: A review. Infrared Phys. Technol. 2012, 55, 221–235. [Google Scholar] [CrossRef]
  16. Mambou, S.J.; Maresova, P.; Krejcar, O.; Selamat, A.; Kuca, K. Breast cancer detection using infrared thermal imaging and a deep learning model. Sensors 2018, 18, 2799. [Google Scholar] [CrossRef]
  17. Moreira, D.G.; Costello, J.T.; Brito, C.J.; Adamczyk, J.G.; Ammer, K.; Bach, A.J.; Costa, C.M.; Eglin, C.; Fernandes, A.A.; Fernández-Cuevas, I. Thermographic imaging in sports and exercise medicine: A Delphi study and consensus statement on the measurement of human skin temperature. J. Therm. Biol. 2017, 69, 155–162. [Google Scholar] [CrossRef]
  18. Serantoni, V.; Jourdan, F.; Louche, H.; Sultan, A. Proposal for a protocol using an infrared microbolometer camera and wavelet analysis to study foot thermoregulation. Quant. InfraRed Thermogr. J. 2021, 18, 73–91. [Google Scholar] [CrossRef]
  19. Singh, J.; Arora, A.S. Effectiveness of active dynamic and passive thermography in the detection of maxillary sinusitis. Quant. InfraRed Thermogr. J. 2021, 18, 213–225. [Google Scholar] [CrossRef]
  20. Bardhan, S.; Nath, S.; Debnath, T.; Bhattacharjee, D.; Bhowmik, M.K. Designing of an inflammatory knee joint thermogram dataset for arthritis classification using deep convolution neural network. Quant. InfraRed Thermogr. J. 2022, 19, 145–171. [Google Scholar] [CrossRef]
  21. Ervural, S.; Ceylan, M. Thermogram classification using deep siamese network for neonatal disease detection with limited data. Quant. InfraRed Thermogr. J. 2022, 19, 312–330. [Google Scholar] [CrossRef]
  22. Ornek, A.H.; Ceylan, M. CodCAM: A new ensemble visual explanation for classification of medical thermal images. Quant. InfraRed Thermogr. J. 2023, 1–25. [Google Scholar] [CrossRef]
  23. Pérez-Buitrago, S.; Tobón-Pareja, S.; Gómez-Gaviria, Y.; Guerrero-Peña, A.; Díaz-Londoño, G. Methodology to evaluate temperature changes in multiple sclerosis patients by calculating texture features from infrared thermography images. Quant. InfraRed Thermogr. J. 2022, 19, 1–11. [Google Scholar] [CrossRef]
  24. Ilo, A.; Romsi, P.; Mäkelä, J. Infrared thermography and vascular disorders in diabetic feet. J. Diabetes Sci. Technol. 2020, 14, 28–36. [Google Scholar] [CrossRef]
  25. Vergilio, M.M.; Gomes, G.; Aiello, L.M.; Fontana, M.; Aldred, A.; Ribeiro, J.A.d.S.; Gabbi, T.V.B.; Leonardi, G.R. Evaluation of skin using infrared thermal imaging for dermatology and aesthetic applications. J. Cosmet. Dermatol. 2022, 21, 895–904. [Google Scholar] [CrossRef] [PubMed]
  26. Fokam, D.; Lehmann, C. Clinical assessment of arthritic knee pain by infrared thermography. J. Basic Clin. Physiol. Pharmacol. 2018, 30, 20170218. [Google Scholar] [CrossRef] [PubMed]
  27. Komoriyama, M.; Nomoto, R.; Tanaka, R.; Hosoya, N.; Gomi, K.; Iino, F.; Yashima, A.; Takayama, Y.; Tsuruta, M.; Tokiwa, H. Application of Thermography in Dentistry Visualization of Temperature Distribution on Oral Tissues. Dent. Mater. J. 2003, 22, 436–443. [Google Scholar] [CrossRef]
  28. John, H.E.; Niumsawatt, V.; Rozen, W.M.; Whitaker, I.S. Clinical applications of dynamic infrared thermography in plastic surgery: A systematic review. Gland Surg. 2016, 5, 122. [Google Scholar]
  29. Zagrodny, B. Standardisation Procedure of Infra-Red Imaging in Biomechanics. In Biomechanics in Medicine, Sport and Biology. BIOMECHANICS 2021; Hadamus, A., Piszczatowski, S., Syczewska, M., Błażkiewicz, M., Eds.; Lecture Notes in Networks and Systems; Springer: Cham, Switzerland, 2022; Volume 328. [Google Scholar] [CrossRef]
  30. ISO/TR 13154; Medical Electrical Equipment—Deployment, Implementation and Operational Guidelines for Identifying Febrile Humans Using a Screening Thermograph. International Organization for Standardization: Geneva, Switzerland, 2017.
  31. Pusnik, I.; Saunders, P.; Girard, F.; Knazovicka, L.; Simpson, R.; Machin, G.; Cardenas Garcia, D.; Wang, Q.; Kuelhas, K.; Sadli, M. Best Practice Guide: Use of Thermal Imagers to Perform Traceable Non-Contact Screening of Human Body Temperature. 2021. Available online: https://www.bipm.org/documents/20126/41773843/Best_Practice_Guide_human_body_temp_measurement_thermal_imager_screening.pdf (accessed on 14 September 2023).
  32. IEC 80601-2-59; Medical Electrical Equipment—Part 2-59: Particular Requirements for the Basic Safety and Essential Performance of Screening Thermographs for Human Febrile Temperature Screening. International Electrotechnical Commission: Geneva, Switzerland, 2017.
  33. Ghassemi, P.; Pfefer, T.J.; Casamento, J.P.; Simpson, R.; Wang, Q. Best practices for standardized performance testing of infrared thermographs intended for fever screening. PLoS ONE 2018, 13, e0203302. [Google Scholar] [CrossRef]
  34. Wang, Q. Infrared Thermographs—Methods for Evaluating Laboratory Performance; U.S. Food and Drug Administration, Ed.; European Organization for Nuclear Research (CERN): Geneva, Switzerland, 2023. [Google Scholar] [CrossRef]
  35. Wang, Q.; Zhou, Y.; Ghassemi, P.; Chenna, D.; Chen, M.; Casamento, J.; Pfefer, J.; McBride, D. Facial and Oral Temperature Data from a Large Set of Human Subject Volunteers; Version 1.0.0; PhysioNet, 2023; Available online: https://physionet.org/content/face-oral-temp-data/1.0.0/ (accessed on 14 September 2023).
  36. Cheng, T.-Y.; Deng, D.; Herman, C. Curvature effect quantification for in-vivo IR thermography. Int. Mech. Eng. Congr. Expo. 2012, 2, 127–133. [Google Scholar] [CrossRef]
  37. Dozier, J.; Warren, S.G. Effect of viewing angle on the infrared brightness temperature of snow. Water Resour. Res. 1982, 18, 1424–1434. [Google Scholar] [CrossRef]
  38. Tomita, K.; Chew, M.Y.L. A Review of infrared thermography for delamination detection on infrastructures and buildings. Sensors 2022, 22, 423. [Google Scholar] [CrossRef] [PubMed]
  39. Li, Z.-L.; Tang, B.-H.; Wu, H.; Ren, H.; Yan, G.; Wan, Z.; Trigo, I.F.; Sobrino, J.A. Satellite-derived land surface temperature: Current status and perspectives. Remote Sens. Environ. 2013, 131, 14–37. [Google Scholar] [CrossRef]
  40. Ortiz-Sanz, J.; Gil-Docampo, M.; Arza-García, M.; Cañas-Guerrero, I. IR thermography from UAVs to monitor thermal anomalies in the envelopes of traditional wine cellars: Field test. Remote Sens. 2019, 11, 1424. [Google Scholar] [CrossRef]
  41. Hori, M.; Aoki, T.; Tanikawa, T.; Hachikubo, A.; Sugiura, K.; Kuchiki, K.; Niwano, M. Modeling angular-dependent spectral emissivity of snow and ice in the thermal infrared atmospheric window. Appl. Opt. 2013, 52, 7243–7255. [Google Scholar] [CrossRef] [PubMed]
  42. ASTM E1965-98; Standard Specification for Infrared Thermometers for Intermittent Determination of Patient Temperature. ASTM Committee E20 on Temperature Measurement: West Conshohocken, PA, USA, 2016.
  43. Hanna, E.G.; Tait, P.W. Limitations to thermoregulation and acclimatization challenge human adaptation to global warming. Int. J. Environ. Res. Public Health 2015, 12, 8034–8074. [Google Scholar] [CrossRef] [PubMed]
  44. Bernard, V.; Staffa, E.; Mornstein, V.; Bourek, A. Infrared camera assessment of skin surface temperature–effect of emissivity. Phys. Med. 2013, 29, 583–591. [Google Scholar] [CrossRef] [PubMed]
  45. Spindel, J.F.; Pokrywa, S.; Elder, N.; Smith, C. The environment has effects on infrared temperature screening for COVID-19 infection. Am. J. Infect. Control 2021, 49, 1445–1447. [Google Scholar] [CrossRef]
  46. Minkina, W.; Klecha, D. Atmospheric transmission coefficient modelling in the infrared for thermovision measurements. J. Sens. Sens. Syst. 2016, 5, 17–23. [Google Scholar] [CrossRef]
  47. Patnaik, S. Separate Effects Tests for Studying Thermal Gradient Driven Cracking in UO2 Pellets Undergoing Resistive Heating; University of South Carolina: Columbia, SC, USA, 2021. [Google Scholar]
  48. FLIR System. Toolkit IC2 Dig 16: Developers Guide 1.01 for Agema 550/570, ThermaCAM PM 5 × 5 and the ThermoVision Family (FLIR Publication Number: 557344 Version B); FLIR System: Wilsonville, OR, USA, 2001. [Google Scholar]
  49. Mazdeyasna, S.; Ghassemi, P.; Wang, Q. External factors affecting performance of infrared thermographs for screening elevated body temperature (Conference Presentation). In Proceedings of the Optical Diagnostics and Sensing XXIII: Toward Point-of-Care Diagnostics, San Francisco, CA, USA, 28 January–3 February 2023; p. PC1238706. [Google Scholar] [CrossRef]
  50. Planck, M.; Masius, M. The Theory of Heat Radiation; P. Blakiston’s Son & Co.: Philadelphia, PA, USA, 1914. [Google Scholar]
  51. Minkina, W. Theoretical basics of radiant heat transfer–practical examples of calculation for the infrared (IR) used in infrared thermography measurements. Quant. InfraRed Thermogr. J. 2021, 18, 269–282. [Google Scholar] [CrossRef]
  52. Bityukov, V.; Khudak, Y.I.; Gusein-Zade, N. Analytical derivation of the Stefan–Boltzmann law for integral radiance from Planck’s law for spectral radiance. Bull. Lebedev Phys. Inst. 2018, 45, 46–50. [Google Scholar] [CrossRef]
  53. Wang, K.; Wan, Z.; Wang, P.; Sparrow, M.; Liu, J.; Zhou, X.; Haginoya, S. Estimation of surface long wave radiation and broadband emissivity using Moderate Resolution Imaging Spectroradiometer (MODIS) land surface temperature/emissivity products. J. Geophys. Res. Atmos. 2005, 110, D11109. [Google Scholar] [CrossRef]
  54. Kingston, R.H. Blackbody Radiation, Image Plane Intensity, and Units. In Optical Sources, Detectors, and Systems: Fundamentals and Applications; Acedemic Press: Cambridge, MA, USA, 1995; pp. 1–32. [Google Scholar]
  55. Usamentiaga, R.; Venegas, P.; Guerediaga, J.; Vega, L.; Molleda, J.; Bulnes, F.G. Infrared thermography for temperature measurement and non-destructive testing. Sensors 2014, 14, 12305–12348. [Google Scholar] [CrossRef] [PubMed]
  56. ASTM E1862-14. Standard Practice for Measuring and Compensating for Reflected Temperature Using Infrared Imaging Radiometers. ASTM Committee E-7 on Nondestructive Testing: West Conshohocken, PA, USA, 2014.
  57. Tran, Q.H.; Han, D.; Kang, C.; Haldar, A.; Huh, J. Effects of ambient temperature and relative humidity on subsurface defect detection in concrete structures by active thermal imaging. Sensors 2017, 17, 1718. [Google Scholar] [CrossRef]
  58. Steketee, J. Spectral emissivity of skin and pericardium. Phys. Med. Biol. 1973, 18, 686. [Google Scholar] [CrossRef] [PubMed]
  59. FLIR. THERMACAM® PM 595—High Performance Handheld Infrared Camera. FLIR Systems. 1999. Available online: https://www.atecorp.com/atecorp/media/pdfs/data-sheets/flir-pm595_datasheet.pdf (accessed on 14 September 2023).
  60. Ghassemi, P.; Pfefer, J.; Casamento, J.; Wang, Q. Standardized Assessment of Infrared Thermographic Fever Screening System Performance. Proc. SPIE 2017, 10056, 100560. [Google Scholar] [CrossRef]
  61. The American Society of Heating, Refrigerating and Air-Conditioning Engineers. ANSI/ASHRAE Standard 55-2020: Thermal Environmental Conditions for Human Occupancy; ASHRAE: Peachtree Corners, GA, USA, 2020; Available online: https://www.ashrae.org/technical-resources/bookstore/standard-55-thermal-environmental-conditions-for-human-occupancy (accessed on 14 September 2023).
  62. Martinez-Jimenez, M.A.; Loza-Gonzalez, V.M.; Kolosovas-Machuca, E.S.; Yanes-Lane, M.E.; Ramirez-GarciaLuna, A.S.; Ramirez-GarciaLuna, J.L. Diagnostic accuracy of infrared thermal imaging for detecting COVID-19 infection in minimally symptomatic patients. Eur. J. Clin. Investig. 2021, 51, e13474. [Google Scholar] [CrossRef]
  63. Ng, E.Y.K.; Kaw, G.J.L.; Chang, W.M. Analysis of IR thermal imager for mass blind fever screening. Microvasc. Res. 2004, 68, 104–109. [Google Scholar] [CrossRef]
  64. Charlton, M.; Stanley, S.A.; Whitman, Z.; Wenn, V.; Coats, T.J.; Sims, M.; Thompson, J.P. The effect of constitutive pigmentation on the measured emissivity of human skin. PLoS ONE 2020, 15, e0241843. [Google Scholar] [CrossRef]
  65. Ring, E.F.J.; Jung, A.; Kalicki, B.; Zuber, J.; Rustecka, A.; Vardasca, R. New standards for fever screening with thermal imaging systems. J. Mech. Med. Biol. 2013, 13, 1350045. [Google Scholar] [CrossRef]
  66. Healy, C.; Segal, Z.; Hinnerichs, C.; Ace, E.; Ward, D.; Honovich, J. Globally deployed COVID-19 fever screening devices using infrared thermographs consistently normalize high readings to afebrile range. J. Biomed. Opt. 2021, 26, 043009. [Google Scholar] [CrossRef]
  67. Tkáčová, M.; Hudák, R.; Foffová, P.; Živčák, J. An importance of camera–subject distance and angle in musculoskeletal applications of medical thermography. Acta Electrotech. Et Inform. 2010, 10, 57–60. [Google Scholar]
  68. Muniz, P.R.; Cani, S.P.; Magalhaes, R.d.S. Influence of field of view of thermal imagers and angle of view on temperature measurements by infrared thermovision. IEEE Sens. J. 2013, 14, 729–733. [Google Scholar] [CrossRef]
  69. Scott, M.; Luttig, H.; Strydom, M.; Gonelli, M.; Kruger, D.; Rankine, R.; Broodryk, T. Passive infrared thermography as a diagnostic tool in civil engineering structural material health monitoring. In Proceedings of the Concrete Repair, Rehabilitation and Retrofitting III: 3rd International Conference on Concrete Repair, Rehabilitation and Retrofitting, Cape Town, South Africa, 3–5 September 2012; pp. 3–5. [Google Scholar]
  70. Samartharam, H.; Vasudeva, N.; Ila, S.S. The Role of Humidity in the Management of Premature Neonates in a Rural Incubator. Cureus 2021, 13, e14411. [Google Scholar] [CrossRef]
  71. ISO 7730; Ergonomics of the Thermal Environment—Analytical Determination and Interpretation of Thermal Comfort Using Calculation of the PMV and PPD Indices and Local Thermal Comfort Criteria. International Organization for Standardization: Geneva, Switzerland, 2005.
  72. Brück, K.; Parmelee, A.H., Jr.; Brück, M. Neutral temperature range and range of “thermal comfort” in premature infants. Neonatology 1962, 4, 32–51. [Google Scholar] [CrossRef]
  73. Ahmed, K.S. Comfort in urban spaces: Defining the boundaries of outdoor thermal comfort for the tropical urban environments. Energy Build. 2003, 35, 103–110. [Google Scholar] [CrossRef]
  74. Jing, S.; Li, B.; Tan, M.; Liu, H. Impact of relative humidity on thermal comfort in a warm environment. Indoor Built Environ. 2013, 22, 598–607. [Google Scholar] [CrossRef]
  75. Fountain, M.; Arens, E.A.; Xu, T.; Bauman, F.; Oguru, M. An investigation of thermal comfort at high humidities. ASHRAE Trans. 1999, 105, 4282. [Google Scholar]
  76. Djamila, H.; Chu, C.-M.; Kumaresan, S. Effect of humidity on thermal comfort in the humid tropics. J. Build. Constr. Plan. Res. 2014, 2, 109. [Google Scholar] [CrossRef]
  77. Dafico, L.C.M.; Barreira, E.; Almeida, R.; Carasek, H. Comparison of Infrared Thermography and Other Traditional Techniques to Assess Moisture Content of Wall Specimens. Sensors 2022, 22, 3182. [Google Scholar] [CrossRef]
  78. Bae, J.S.; Lee, J.B.; Matsumoto, T.; Othman, T.; Min, Y.K.; Yang, H.M. Prolonged residence of temperate natives in the tropics produces a suppression of sweating. Pflug. Arch. 2006, 453, 67–72. [Google Scholar] [CrossRef]
  79. Taylor, N.A.; Cotter, J.D. Heat adaptation: Guidelines for the optimisation of human performance. Int. Sport. J. 2006, 7, 33–57. [Google Scholar]
  80. Bullard, R.W. Continuous recording of sweating rate by resistance hygrometry. J. Appl. Physiol. 1962, 17, 735–737. [Google Scholar] [CrossRef] [PubMed]
  81. TORII, M. Maximal sweating rate in humans. J. Hum. Ergol. 1995, 24, 137–152. [Google Scholar]
  82. Yamtraipat, N.; Khedari, J.; Hirunlabh, J. Thermal comfort standards for air conditioned buildings in hot and humid Thailand considering additional factors of acclimatization and education level. Sol. Energy 2005, 78, 504–517. [Google Scholar] [CrossRef]
  83. Lai, D.; Guo, D.; Hou, Y.; Lin, C.; Chen, Q. Studies of outdoor thermal comfort in northern China. Build. Environ. 2014, 77, 110–118. [Google Scholar] [CrossRef]
  84. Reis, H.H.T.; Brito, C.J.; Sillero-Quintana, M.; da Silva, A.G.; Fernández-Cuevas, I.; Cerqueira, M.S.; Werneck, F.Z.; Marins, J.C.B. Can the body mass index influence the skin temperature of adolescents assessed by infrared thermography? J. Therm. Biol. 2023, 111, 103424. [Google Scholar] [CrossRef]
  85. Costa, C.M.A.; Sillero-Quintana, M.; Cano, S.P.; Moreira, D.; Brito, C.; Fernandes, A.; Pussieldi, G.; Marins, J. Daily oscillations of skin temperature in military personnel using thermography. BMJ Mil. Health 2016, 162, 335–342. [Google Scholar] [CrossRef]
  86. Marins, J.C.B.; Formenti, D.; Costa, C.M.A.; de Andrade Fernandes, A.; Sillero-Quintana, M. Circadian and gender differences in skin temperature in militaries by thermography. Infrared Phys. Technol. 2015, 71, 322–328. [Google Scholar] [CrossRef]
  87. Chudecka, M.; Lubkowska, A. Temperature changes of selected body’s surfaces of handball players in the course of training estimated by thermovision, and the study of the impact of physiological and morphological factors on the skin temperature. J. Therm. Biol. 2010, 35, 379–385. [Google Scholar] [CrossRef]
  88. Gómez-Carmona, P.; Fernández-Cuevas, I.; Sillero-Quintana, M.; Arnaiz-Lastras, J.; Navandar, A. Infrared thermography protocol on reducing the incidence of soccer injuries. J. Sport Rehabil. 2020, 29, 1222–1227. [Google Scholar] [CrossRef]
  89. Shvartz, E.; Magazanik, A.; Glick, Z. Thermal responses during training in a temperate climate. J. Appl. Physiol. 1974, 36, 572–576. [Google Scholar] [CrossRef] [PubMed]
  90. Machado, Á.S.; Cañada-Soriano, M.; Jimenez-Perez, I.; Gil-Calvo, M.; Carpes, F.P.; Perez-Soriano, P.; Priego-Quesada, J.I. Distance and camera features measurements affect the detection of temperature asymmetries using infrared thermography. Quant. InfraRed Thermogr. J. 2022, 1–13. [Google Scholar] [CrossRef]
  91. Gunapala, S.; Rafol, S.; Ting, D.; Soibel, A.; Hill, C.; Khoshakhlagh, A.; Liu, J.; Mumolo, J.; Keo, S.; Höglund, L. Modulation transfer function of infrared focal plane arrays. In Proceedings of the SPIE Optical Engineering + Applications, San Diego, CA, USA, 9–13 August 2015; Infrared Remote Sensing and Instrumentation XXIII. p. 960811. [Google Scholar] [CrossRef]
  92. Yoon, S.; Park, J.; Cho, Y. An experimental study on the evaluation of temperature uniformity on the surface of a blackbody using infrared cameras. Quant. InfraRed Thermogr. J. 2022, 19, 172–186. [Google Scholar] [CrossRef]
  93. Lin, J.-W.; Lu, M.-H.; Lin, Y.-H. A Thermal Camera Based Continuous Body Temperature Measurement System. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea, 27–28 October 2019; pp. 1681–1687. Available online: https://openaccess.thecvf.com/content_ICCVW_2019/papers/CVPM/Lin_A_Thermal_Camera_Based_Continuous_Body_Temperature_Measurement_System_ICCVW_2019_paper.pdf (accessed on 14 September 2023).
Figure 1. Principle of the total radiation received by an IRT. [ σ : Stefan–Boltzmann constant, ε : emissivity, τ : atmospheric transmittance, T r e f l : reflected temperature, T: object temperature, T a t m : atmosphere temperature].
Figure 1. Principle of the total radiation received by an IRT. [ σ : Stefan–Boltzmann constant, ε : emissivity, τ : atmospheric transmittance, T r e f l : reflected temperature, T: object temperature, T a t m : atmosphere temperature].
Sensors 23 08011 g001
Figure 2. Schematic of the experimental setup. The red dash-dotted box shows the ST systems.
Figure 2. Schematic of the experimental setup. The red dash-dotted box shows the ST systems.
Sensors 23 08011 g002
Figure 3. Accuracy of (a) IRT-1 and (b) IRT-2 without ETRS compensation. Horizontal dashed lines represent the recommended laboratory accuracy and the rectangular gray area denotes the required evaluation range of 34 °C to 39 °C.
Figure 3. Accuracy of (a) IRT-1 and (b) IRT-2 without ETRS compensation. Horizontal dashed lines represent the recommended laboratory accuracy and the rectangular gray area denotes the required evaluation range of 34 °C to 39 °C.
Sensors 23 08011 g003
Figure 4. Effects of temperature compensation and T E T R S on the accuracy of (a) ST-1 and (b) ST-2. Horizontal dashed and solid lines represent the recommended laboratory accuracy and offset errors, respectively, and the rectangular gray area denotes the required evaluation range of 34 °C to 39 °C.
Figure 4. Effects of temperature compensation and T E T R S on the accuracy of (a) ST-1 and (b) ST-2. Horizontal dashed and solid lines represent the recommended laboratory accuracy and offset errors, respectively, and the rectangular gray area denotes the required evaluation range of 34 °C to 39 °C.
Sensors 23 08011 g004
Figure 5. Effect of viewing angle on temperature accuracy for the two STs. The error bars represent the standard deviation.
Figure 5. Effect of viewing angle on temperature accuracy for the two STs. The error bars represent the standard deviation.
Sensors 23 08011 g005
Figure 6. Effects of ambient RH and temperature: T I R T T C S and T S T T C S versus (a) ambient RH with ambient temperature at 24 °C and (b) ambient temperature with ambient RH at 35%. The working distance was kept at 0.8 m.
Figure 6. Effects of ambient RH and temperature: T I R T T C S and T S T T C S versus (a) ambient RH with ambient temperature at 24 °C and (b) ambient temperature with ambient RH at 35%. The working distance was kept at 0.8 m.
Sensors 23 08011 g006
Figure 7. Effect of the working distance: T I R T T C S and T S T T C S versus working distance with (a) T E T R S = 37 °C and (b) T E T R S = 35 °C.
Figure 7. Effect of the working distance: T I R T T C S and T S T T C S versus working distance with (a) T E T R S = 37 °C and (b) T E T R S = 35 °C.
Sensors 23 08011 g007
Figure 8. Computer simulation results with T C S = 37 °C. ((a): estimated τ based on environmental factors. (b): E e , t o t a l received by IRT based on the estimated τ. (c): calculated T C S measured by an IRT assuming τ = 1. (d): calculated T C S measured by an ST assuming τ = 1 and T E T R S = 35 °C).
Figure 8. Computer simulation results with T C S = 37 °C. ((a): estimated τ based on environmental factors. (b): E e , t o t a l received by IRT based on the estimated τ. (c): calculated T C S measured by an IRT assuming τ = 1. (d): calculated T C S measured by an ST assuming τ = 1 and T E T R S = 35 °C).
Sensors 23 08011 g008
Figure 9. Computer simulation of T E T R S effect: Offset error ( T S T T C S ) of an ST to measure a CS at 37 °C with different T E T R S values assuming τ = 1. ((a): T E T R S = 20 °C; (b): T E T R S = 30 °C; (c): T E T R S = 36 °C; (d): T E T R S = 38 °C; (e): T E T R S = 40 °C; (f): T E T R S = 50 °C).
Figure 9. Computer simulation of T E T R S effect: Offset error ( T S T T C S ) of an ST to measure a CS at 37 °C with different T E T R S values assuming τ = 1. ((a): T E T R S = 20 °C; (b): T E T R S = 30 °C; (c): T E T R S = 36 °C; (d): T E T R S = 38 °C; (e): T E T R S = 40 °C; (f): T E T R S = 50 °C).
Sensors 23 08011 g009
Figure 10. Computer simulations depicting the effects of (a) ambient RH, (b) ambient temperature, and (c) working distance, with both T C S and T E T R S set at 37 °C. If not specified, the default values for ambient temperature and distance were set to 24 °C and 0.8 m, respectively. For the sake of comparison, the ambient RH values were set at 35% and 50% in cases (b,c), mirroring the experimental conditions depicted in Figure 6b and Figure 7a.
Figure 10. Computer simulations depicting the effects of (a) ambient RH, (b) ambient temperature, and (c) working distance, with both T C S and T E T R S set at 37 °C. If not specified, the default values for ambient temperature and distance were set to 24 °C and 0.8 m, respectively. For the sake of comparison, the ambient RH values were set at 35% and 50% in cases (b,c), mirroring the experimental conditions depicted in Figure 6b and Figure 7a.
Sensors 23 08011 g010
Table 1. Equipment list.
Table 1. Equipment list.
Device NamesModels and ManufacturersAbbreviationFunctions and Specifications [33]
Infrared thermographs (IRTs)A325sc, FLIR Systems Inc., Nashua, NH, USAIRT-1Measure test target temperature. Part of an ST, 320 × 240 pixels, spectral range of 7.5–13 µm, Field of view (FOV) 17° and 14° [horizontal and vertical].
8640 P-series, Infrared Cameras Inc., Beaumont, TX, USAIRT-2Measure test target temperature. Part of an ST, 640 × 512 pixels, spectral range of 7–14 µm, FOV 30° and 25° [horizontal and vertical].
Extended area blackbodiesSR-33N-4, CI Systems Inc., Simi Valley, CA, USAETRSWork as an external temperature reference source for offset compensation. Part of an ST.
SR-800R-4D, CI Systems Inc., CACSServe as a calibration source or test target.
HumidifierEE-6913, Crane-USA, Itasca, IL, USA-Control RH in the range of 15–80%.
HeaterHT1188, Supply Chain Sources LLC, Brea, CA, USA-Control T a t m in the range of 18–32 °C.
Weather meterKestrel 4500NV, Weather Republic LLC, Downingtown, PA, USAWMMeasure T a t m and RH, which can be used to assess τ.
Note: In our study, we refer to the graybodies ETRS and CS as blackbodies to align with their commonly used names, considering their high emissivity.
Table 2. IRT-1 camera parameters [47,48,57].
Table 2. IRT-1 camera parameters [47,48,57].
α 1 α 2 β 1 β 2 h 1 h 2 h 3 h 4 K a t m
0.0065690.01262−0.002276−0.006671.55876.939 × 10−2−2.7816 × 10−46.8455 × 10−71.9
Table 3. Environmental factor ranges.
Table 3. Environmental factor ranges.
Ambient Temperature (°C)Ambient RH (%)Working Distance (m)
ISO/TR 13154 [30]20–2410–50NA
IEC 80601-2-59 [32] (Clause 201.7.9.3.1)<24<50NA
Zhou et al. [10] 20–2410–620.6–0.8
Wang et al. [14] 20–2910–620.6–0.8
Martinez-Jimenez et al. [62] 23400.3
Ng et al. [63] 20–2540–75NA
Charlton et al. [64] 28–3019–30NA
Ring et al. [65] 20–21NA<1
Healy et al. [66] 19.8–22.653–700.5–0.8
Current Benchtop 18–32 15–800.4–2.8
Current Simulations15–35 5–950.2–3.0
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mazdeyasna, S.; Ghassemi, P.; Wang, Q. Best Practices for Body Temperature Measurement with Infrared Thermography: External Factors Affecting Accuracy. Sensors 2023, 23, 8011. https://doi.org/10.3390/s23188011

AMA Style

Mazdeyasna S, Ghassemi P, Wang Q. Best Practices for Body Temperature Measurement with Infrared Thermography: External Factors Affecting Accuracy. Sensors. 2023; 23(18):8011. https://doi.org/10.3390/s23188011

Chicago/Turabian Style

Mazdeyasna, Siavash, Pejman Ghassemi, and Quanzeng Wang. 2023. "Best Practices for Body Temperature Measurement with Infrared Thermography: External Factors Affecting Accuracy" Sensors 23, no. 18: 8011. https://doi.org/10.3390/s23188011

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop