Next Article in Journal
Robust Parameter Inversion and Subsidence Prediction for Probabilistic Integral Methods in Mining Areas
Previous Article in Journal
Seasonal Changes in Body Composition, Jump, Sprint, and Agility Performance Among Elite Female Handball Players
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Agreement Between a Wristwatch and a Free Optical Sensor with a Chest Strap in Measuring HR Variations During Front Crawl Swimming

1
Department of Sports and Expressions, Polytechnic of Guarda, 6300-559 Guarda, Portugal
2
Department of Sport Sciences, Instituto Politécnico de Bragança, 5300-253 Bragança, Portugal
3
Sport Physical Activity and Health & Innovation Center (SPRINT), 2040-413 Rio Maior, Portugal
4
Research Centre for Active Living and Wellbeing (LiveWell), Polytechnic of Bragança, 5300-253 Bragança, Portugal
5
Department of Water Sports, Institute of Sports Sciences, University of Physical Culture, 31-571 Cracow, Poland
6
Department of Sports Sciences, Polytechnic of Cávado and Ave, 4806-909 Guimarães, Portugal
*
Author to whom correspondence should be addressed.
Appl. Sci. 2025, 15(11), 5848; https://doi.org/10.3390/app15115848
Submission received: 10 March 2025 / Revised: 17 May 2025 / Accepted: 19 May 2025 / Published: 22 May 2025

Abstract

:
Wearables with optical sensors for heart rate (HR) measurement are widely available in the market. However, their accuracy in water is still underexplored. The aim of the present study was to test the agreement of two different devices for HR monitoring with a chest strap while swimming at different intensities. Twenty male and ten female subjects (mean 19.6 ± 0.7 years old, 173.3 ± 5.4 cm, and 67.1 ± 6.6 kg) performed an intermittent progressive protocol of 3 × 30 s tethered front crawl swimming followed by a 1 min rest period. A chest strap, a wristwatch, and a multi-site optical sensor placed at the temple were used simultaneously. A strong association, an excellent intra-class correlation, and a low mean bias were denoted (R2 = 0.85, ICC = 0.94, b = −1) between HRchest vs. HRtemple. Both indicators increased throughout the test, denoting an increase in accuracy from light to vigorous exercise intensity. HRchest and HRwatch showed a moderate association for the whole test (R2 = 0.23) but a weak association, a poor consistency, and a high mean bias stepwise (0.01 ≤ R2 ≤ 0.06, 0.03 ≤ ICC ≤ 0.42, −48.1 ≤ b≤ −16.1). During swimming, the HR values from the temple showed a better agreement with the chest strap than those from the wristwatch. The temple reading accuracy might be enhanced by using the device during the dryland warm-up routine.

1. Introduction

Swimming is a sport, like many others, where time over a given distance (i.e., speed) is the main performance indicator. During training sessions, various speed-related parameters, such as race pace, maximal aerobic velocity, critical speed, and others, are used for monitoring training intensity [1,2]. However, when it comes to monitoring or evaluating training intensity in real time, land-based sports can rely on a larger variety of physiological or biomechanical parameters. This is due to the larger spectrum of wearable technologies available for such purposes (for example, training load by GPS, oxygen consumption by spiroergometers, etc.), resulting in numerous ways of in situ or a posteriori monitoring of physical effort during sports training or even during competition.
Portable heart rate (HR) or oxygen consumption (VO2) measuring devices can be worn in ecological scenarios for a live assessment of the physiological demands of many activities, such as running [3], cycling [4], tennis [5,6], or soccer [7]. For HR measurement, on land one can rely on valid and reliable HR chest straps that have been used for decades and are deemed the portable HR measurement gold standard [8,9,10]. While these chest straps use electrocardiography measures (i.e., they capture the electrical activity of the heart to detect the QRS complex), other portable sensors, such as built-in wristwatch sensors and other multi-site sensors, use photoplethysmography (PPG). This technology analyzes the subtle light intensity shifts in the arteries caused by changes in blood volume, which are also felt as pulsating blood. Although the measurement principles are completely different, these devices have shown relative robustness in measuring HR [11,12]. However, these assessments of measurement agreement take place almost exclusively in terrestrial environments, leaving it unclear whether the same technology would be equally accurate in aquatic environments.
In water-based environments, monitoring training or competition performance live based on popular physiological parameters such as HR or VO2 becomes impractical. Not only it is essential to overcome the obvious incompatibility between electronic components and water, but there is also the problem of data transmission. Almost all wearable devices transmit to a receiver using technologies such as Bluetooth or ANT+, which, despite their advantages, do not function in aquatic environments. That’s why today, some sensors offer built-in memory, so swimmers can save their training effort and analyze it afterwards. Nevertheless, the saved values still need to be accurate. The body displacement through the water during actual swimming can lead to water passing between the PPG sensors and the skin, potentially impairing the readings [13]. Studies have shown that the pressure between the PPG sensor and the skin influences the reading accuracy, thus the sensor cannot be worn too loosely or tightened to the point of discomfort but requires a moderate pressure, highlighting the importance of full and constant skin contact [14]. Even chest straps might have trouble getting accurate readings during swimming due to the increased water drag after the start and the push-out off the wall after each turn, which might cause the chest strap to fall out of place. Swimmers could bypass this issue by wearing a swimsuit, but this might alter their swimming mechanics and/or buoyancy.
Recently, an alternative approach was developed for one of the PPG sensors available on the market. This specific sensor (OH1+ and Verity sense, Polar Electro, Finland) has been provided with a clip that allows it to be attached to the swimming goggles strap, in this case, and to read HR from the temple. Given the placement site, the sensor can be covered with a swimming cap, which, in theory, might overcome the difficulties mentioned above. Nevertheless, it is still an a posteriori approach since the sensor saves the data to be analyzed later.
A couple of studies have conducted experiments using this free PPG sensor in swimming under different conditions: one has evaluated the agreement between a temple- and an arm-worn sensor with a chest strap in an intermittent and progressive protocol [15]. However, it remains unclear if different intensities would jeopardize the readings or the analyses. The other study reported the validity of the devices using the mean values of minimum HR, maximum HR, and mean HR within different intensity zones [13]. The measure of agreement was presented for the whole test, and the large limits of agreement reported (around 25 and −27 for the upper and lower limits, respectively) leave it unclear exactly when and why the lack of accuracy occurred.
The literature reports mixed findings about exercise intensity and the accuracy of optical sensors in on-land measurements. It has been described that the accuracy rises alongside the exercise intensity [8,13,16], probably due to the increased blood flow. However, at rest it tends to be more accurate than at lower intensities [17,18,19]. On the other hand, there are reports of high exercise intensity being negatively related to accuracy [8,17,20,21], probably due to increased arm swing. Thus, the aim of the present study was to assess the agreement of two different optical devices for HR monitoring with the chest strap while swimming and to check for bias in different intensities directly from rest to maximum intensity and back to rest again. This analysis will help build the body of knowledge and provide a comprehensive understanding of how to interpret possible biases and, ultimately, help monitor, evaluate, and prescribe exercise intensity with rigor. It was hypothesized that the temple sensor would be an accurate method for HR assessment in swimming and would outperform the wristwatch. By confirming the hypothesis, the present study can also provide the user with guidance on which device to use.

2. Materials and Methods

The sample consisted of 30 participants (20 men and 10 women) attending a sports course at a local university (Table 1). The students were randomly chosen from among a pool of 52. All tests took place in the same lane of the same pool at the same time of the day (morning period). The tests were held on two consecutive days, with the water temperature and relative air humidity reported at 28.25 ± 0.35 degrees and 79.0 ± 1.41%, respectively. All participants gave their informed consent to participate in the present study after being informed of the study’s design and potential risks. The exclusion criteria included any recent cardiovascular or respiratory medical event that might impair the results or increase the study’s potential risks. The study was approved by the ethics committee of the institution. All procedures were in accordance with the Declaration of Helsinki regarding human research.

2.1. Protocol

Tethered swimming was used for this study. The participants were tied by the waist to the starting block with a static rope. Although a few concerns have been raised throughout the years about the differences between tethered swimming and free swimming, the purpose of this study was not to analyze swimming technique but to compare the HR readings of different devices at different swimming intensities. Furthermore, tethered swimming was implemented to achieve continuous arm movements while swimming and to mitigate the water flow between the HR sensors and the skin. The subjects performed an incremental step test that consisted of three 30 s bouts at different self-selected paces followed by a 1 min rest period. The aim of this approach was to provide a quick rise in HR at the beginning of the test, followed by a period of regular increase, a steep decrease right after the end of the effort, and finally, a progressively slower decrease during the resting period. All of the tests took place in the lane adjacent to the pool deck to provide a comfortable passive rest after the test. The sign for the beginning of the test and the end of each step (and, therefore, the beginning of the next) was given through whistling. Prior to the first whistle, the subjects were in a horizontal position, sculling, keeping the rope stretched. After the first whistle, the subjects were instructed to keep a slow, comfortable pace for 30 s. Next, another whistle marked the beginning of the second 30 s period, where the subjects now swam at a moderate self-selected pace. After the third whistle, the subjects performed an all-out 30 s front crawl. A final fourth whistle was given for the subjects to stop and immediately grab the side wall, put their feet on the wall’s small step, and rest as relaxed as possible with their arms under the water. The test ended after the 1 min rest period.

2.2. Data Collection

Before entering the pool, the subjects were equipped with a chest strap HR monitor (H10, Polar, Kempele, Finland), a wristwatch (Pacer Pro, Polar, Kempele, Finland), and a free optical sensor (OH1+, Polar, Kempele, Finland). For the present study, both the wristwatch and the free optical sensor were tested against the chest strap. It was assumed that the chest strap measured real HR values. Chest straps manufactured by this brand have been used for decades as a valid and reliable method for assessing HR [22]. Given their superior performance in detecting the QRS complex [9,10], these chest straps are often used as the “gold standard” to test the accuracy of other sensors [9,10]. Moreover, the model used in the present study has specifically been developed and validated for assessing R–R intervals [10], and are thus more accurate than the typical QRS complex detection provided by previous devices. The chest strap was placed around the subjects’ chest, at the xiphoid process, with a close but comfortable fit without moving, as described and shown by the manufacturer [23]. The close fit of the strap alongside the decision to use tethered swimming aimed to ensure the quality of the HR readings. The wristwatch was placed on the top of the wrist, approximately 2 cm (a finger’s width) up from the pisiform bone (commonly known as the “wrist bone”) and a little bit in the direction of the elbow, as recommended by the manufacturer [24]. Different strap sizes were used for the male and female swimmers as the male-sized straps tend to be too large for female wrists. This ensured compliance with another manufacturer guideline that states that the device should be tightened firmly against the skin [24].
The free PPG sensor can be worn in several places, the temple being one of them. It was placed against the temple of the preferred breathing side and attached to the goggle’s straps as described in the owner’s manual [25], with a small add-on: the swim cap was worn outside of the goggles strap and, therefore, the sensor stayed underneath the swim cap. In theory, this tweak could help reduce the probability of the formation of a water film between the skin and the sensor that could affect the readings. The same swimming cap and goggles were used for all participants, ensuring a tight fit of the sensor against the temple and complete coverup throughout the protocol. All three devices recorded HR in real time to their own internal storage; i.e., although available, no real-time transmission was used with either device. This has to do with the inability of Bluetooth and ANT+ technologies to properly transmit data through water. After the test, all of the data were transferred to the Polar Flow website and then transferred to a laptop in CSV format for further analyses. All devices were previously synchronized with the brand’s computer software to ensure they all had the exact same time stamp. Despite the attempt to start all devices at the same time, it is virtually impossible to achieve per-second synchronization. Thus, corrections were made afterwards based on the devices’ time stamp to ensure that all data analyses started and ended according to the test timings. The HR from the chest strap, temple sensor, and wristwatch were treated as HRchest, HRtemple, and HRwatch, respectively. All recordings, by any device, that presented reading failures were discarded.

2.3. Statistical Analysis

Data analyses were performed for each test step separately and for the whole test. Prior to every analysis, a close inspection of the chest strap HR readings was taken to check for artifacts or possible interruptions in the readings. To test for a possible influence of the participant’s sex in the difference between methods, an independent sample t-test was performed. To test for the association between devices, the coefficient of determination (R2) was calculated through a simple linear regression using a statistical software package (SPSS 29, IBM, Armonk, NY, USA). As a rule of thumb, the correlation was interpreted as very weak if R2 < 0.04, weak if 0.04 ≤ R2 < 0.16, moderate if 0.16 ≤ R2 < 0.49, high if 0.49 ≤ R2 ≤ 0.81, and very high if 0.81 ≤ R2 ≤ 1.0 [26]. Using the same software package, the interclass correlation coefficient (ICC) was also calculated to assess the consistency between the device readings. Values less than 0.5, between 0.5 and 0.75, between 0.75 and 0.9, and greater than 0.90 were deemed indicative of poor, moderate, good, and excellent consistency, respectively [27]. To check for the measuring agreement between the devices, a Bland–Altman plot was computed in SigmaPlot (SigmaPlot 14.0, Grafiti LLC, Palo Alto, CA, USA). The lower and upper limits of agreement (LoA) were computed, as usually seen in the literature, as the mean difference ± 1.96 SD [28]. Additionally, the clinically preferable LoA were manually set to a mean difference of −10 and +10 b·min−1. The agreement was considered valid if at least 80% of the values fell within both limits, as described elsewhere [29]. An association of r > 0.90 (R2 > 0.81), a bias of <5 b·min−1, and an ICC > 0.90 were used to deem the readings as accurate.

3. Results

Figure 1 depicts an example of the HR data collected from all three devices in the whole test. There was not one single case where the chest strap underperformed. No visible artifacts nor sudden reading interruptions were identified. Thus, the accuracy of the HR data from the chest strap was assumed. The test for differences between the male and female participants revealed nonsignificant outcomes for both comparisons (for HRchest vs. HRtemple t(3319) = 1.92, p = 0.055 and for HRchest vs. HRwatch t(2796) = 1.25, p = 0.21).
Looking at the HRchest vs. HRtemple comparison, a strong correlation was denoted (R2 = 0.85) when analyzing the whole protocol (Table 2). Stepwise, it varied (0.37 < R2 > 0.93). For the ICC, the first step had a moderate reliability (ICC = 0.71, 95% CI from 0.53 to 0.81), whilst all others showed an excellent reliability (ICC ± 0.94, 95% CI from 0.91 to 0.99). The Bland–Altman plots (Figure 2) revealed that more than 80% of the values fell within the 95% CI boundaries for all situations (separate steps and whole test), which is an indicator of a valid agreement.
Regarding the comparison of the measurement between HRchest and HRwatch, as described in Table 2, a moderate correlation was found when looking at the whole test (R2 = 0.23). However, stepwise, all results revealed a weak correlation between the measuring devices (0.01 ≤ R2 ≤ 0.06). A poor measurement consistency was found in all analyses (0.03 ≤ ICC ≤ 0.42, 95% CI from −0.04 to 0.68). Again, all Bland–Altman (Figure 2) plots indicated a valid agreement between the methods, as more than 80% of the values fell within the 95% CI boundaries for all analyses.

4. Discussion

The present study aimed to evaluate the accuracy of two different HR measuring devices while swimming. Information about the accuracy of wearable PPG sensors in water allow for a considered choice when monitoring HR. It was hypothesized that the free PPG sensor would outperform the wristwatch in tethered front crawl swimming and be sufficiently accurate to be used confidently. Both hypotheses were accepted, as the wristwatch performance was poor (R2 = 0.23, ICC = 0.42, and mean bias equal to −26.5) and the temple sensor’s was excellent (R2 = 0.85, ICC = 0.96, and mean bias equal to −1).

4.1. Agreement Between HRchest and HRwatch

On land, wristwatches from this brand have demonstrated a good agreement with ECG signals in various sports and activities [28,29]. However, in the present study, the wristwatch underperformed in every established criterion (stepwise and in the whole test), as seen in Table 2. The literature reports various criteria for accuracy: the presence of an association above 0.90 (r > 0.90 or R2 > 0.81) and a bias (mean difference) of <3 b·min−1 [17], <5 b·min−1 [30], or <6 b·min−1 [31] are two of the most used criteria. In the present study, an association of r > 0.90 (R2 > 0.81), a bias of <5 b·min−1, and an ICC > 0.90 were used as cut-off points for accuracy and, as such, the measurement of HR by the wristwatch was deemed as inaccurate. In the aquatic environment, one of the studies conducted to assess the agreement between wrist-based and chest-based HR readings reported ICC values ranging from 0.2 (at 61–70% HRmax) to 0.44 (at 81–90% HRmax). This is corroborated by their Bland–Altman plot, where a bias of −9.51 and an LoA of approximately −53 and 34 denote a low agreement between the methods. In the present study, a mean bias of −26.5 with an LoA of −73 and 20 for the whole test is in tandem with the low accuracy reported for the wristwatch PPG during swimming.
Also on land, there are reports of reduced accuracy at higher running velocities, meaning that with quicker and wider arm movements, the accuracy falls [8,14,17,20,32]. In fact, this impairment is acknowledged by the brand, as on their website one can find a disclaimer warning that wrist-based optical heart rate measurement is “not necessarily accurate in sports where you move your hands vigorously” [33]. Thus, a low accuracy during front crawl swimming was somewhat expected not only because of the arm movements but also because of the impact with the water during the entry phase of the arms. In a study with a similar setup to ours, in which Olstad and Zinner [13] do not report any specific watch placement and fit, ICC values as low as 0.2 (at 61–70% HRmax) to 0.44 (at 81–90% HRmax) are reported. The sensor pressure on the skin and the watch placement are stated to affect its accuracy [24,34]. That is the reason why the brand has specific guidelines for watch placement and fit. In the present study, all of the brand’s guidelines were followed. Nevertheless, the wristwatch still performed less well than reported on land. A mean bias of −26.5 with an LoA of −73 and 20 for the whole test is in tandem with the low accuracy reported for the wristwatch PPG during swimming. The sensor placement limitation can be indirectly improved by placing a free PPG sensor on the upper arm that transmits in real time to the watch (as the latter is restricted to wrist use), as, in the upper limbs, proximal readings are more accurate than distal ones [34]. Other studies have also reported a lack of accuracy of wrist-based PPG while swimming whether watch placement is reported or not [35,36]. It should be made clear that none of the studies state that the watches or the technology are to blame; nor does the present one. The explanations put forward by all studies are similar: the presence of water between the sensors and the skin and the heavy arm movements seem to be major factors impairing the HR readings. To surpass the water constraint, the only reliable solution available for PPG devices seems to be to cover the sensor to avoid any contact with the water.
Skin pigmentation has been suggested to potentially affect optical HR readings [21,37,38]. The participants in the present study were all within the Type 3 skin tone type according to the Fitzpatrick skin tone scale (due to the non-presence of individuals of other races in the class), thus no skin-tone-related bias should be expected.
A limitation of the present study may come from the swimming skill of the participants. Despite making all efforts to mitigate the water flow between the sensors and the skin (for example, the adoption of tethered swimming and the placement and fit of the wristwatch), a poor technique might have negatively impacted the wristwatch readings specifically. The participants in this study were attending the second academic year of the sports course. Few had previous contact with swimming classes and the majority were beginners. Beginner swimmers have a rougher technique, which may affect negatively the readings at wrist level. For example, during the catch phase, swimming books suggest there should be approximately a 90° angle at the elbow [39], which, in turn, represents a 90° angle with the water flow. Since the wristwatch sensor is located perpendicularly to the arm, any deviation from this 90° angle at the elbow will increase the flow of water parallel to the arm and, therefore, increase the likelihood of water interfering with the readings. However, Olstad and Zinner [13] evaluated “well-trained competitive swimmers” and the accuracy was still far from desirable.

4.2. Agreement Between HRchest and HRtemple

Previous studies have reported, during land-based activities, a good agreement between this free PPG sensor and ECG signals with the sensor placed on the upper arm, the forearm, or the temple [11]. A good agreement is also reported with the “gold standard” chest straps [21,40,41]. The results of the present study are in tandem. The HRchest vs. HRtemple analysis showed an R2 of 0.85 (very high), an ICC of 0.96 (CI = 0.95–0.96; excellent), and a mean bias of −1, falling within the criteria for accuracy in every measure. Furthermore, lower intensities scored lower in terms of both R2 and ICC, in tandem with the literature for land-based activities [8,16]. However, an individual analysis of the HR measured at the temple (as seen in Figure 2(A1)) revealed that a misreading often occurred during the first part of the test (usually around 30 s), i.e., at a lower intensity. This was not the case for all participants, but there was a trend. One could argue that the low exercise intensity was the root cause of the misreading, as the literature suggests. However, it was during the rest step (the last one), where the HR fell to pre-test values (or below), that the highest accuracy was observed. This gives the impression that the problem was at the beginning of the test, which coincidently is when lower intensities were attained.
In all studies where Bland–Altman plots are presented, their LoA should be interpreted carefully. As pointed out by Giavarina [42], this kind of plot only defines the interval of agreement; it does not say whether the limits are acceptable or not. According to the same authors, the acceptable LoA must be defined a priori, based on clinical necessity, biological considerations, or other goals. This means that statistical agreement is one thing, and clinical acceptability is another. In the present study, it was defined that −10/10 b·min−1 would be a clinically acceptable lower and upper LoA. As such, despite the agreement shown by the Bland–Altman plots (bias < 5 b·min−1), one should not consider the calculated LoA appropriate for any of the cases presented in Figure 2. Instead, consider the proposed −10/10 b·min−1 (red lines in Figure 2). Thus, upon closer inspection of the Bland–Altman plots from the HRchest vs. HRtemple comparison, one can notice that in all plots, the vast majority of the data points fall within the −10/10 b·min−1 range. As a specific example, looking at the overall plot of HRchest vs. HRtemple (Figure 2(A5)) the mean bias is −1, which is very close to zero, but the computed LoA are still larger than 10 b·min−1 (−17.5 and 15.4 to the lower and upper LoA, respectively). This was due to the previously reported higher inaccuracy of the first 30 s readings. Notwithstanding, most of the values represent differences between −10 and 10 b·min−1, which agree with the proposed LoA (red lines in Figure 2). In this study, all devices were started with the subject seated (but not at rest) on the pool’s side wall, fully equipped, just a few seconds before the test start. Thus, there is the possibility that if the temple sensor had been turned on a bit earlier, or if a dry warmup had been performed right before the test start, the values would probably have been more accurate.
This multi-site PPG sensor (in the present study placed at the temple) provides some solutions to the limitations of wrist-based HR measurement, which might justify its results. From a location perspective, it is placed in a site with less movement than anywhere in the upper or lower arm; thus, there are fewer artifacts to be corrected and fewer reading interruptions. Regarding the water contact, the fact that it can be covered by a swimming cap diminishes the probability of water flowing between the sensor and the skin, ensuring uninterrupted, clean readings.
A possible confounding factor may be the presence of hair in the temple zone. In one study, hair was reported to affect the accuracy of PPG [14]. Specially in female participants, who tend to have longer hair, it may affect skin contact with the sensor. Although the difference in HRchest and HRtemple between men and women was not significant, it was very close to significance. Thus, the sensor placement must be kept in mind and the results interpreted carefully, as it is not always possible to completely avoid the hairline despite best efforts.

4.3. Practical Implications

Notwithstanding the usefulness of the HR temple sensor, the present study tested the built-in memory of the devices. However, this free PPG sensor can be paired with the wristwatch. This means that if a swimmer wears both sensors, they can still collect some swimming metrics that might be of interest to the swimmer and/or their coach (like meters swum, speed per lap, or even stroke rate), provided by the wristwatch and the accuracy of the temple-worn PPG sensor.

5. Conclusions

During tethered front crawl swimming, the HR values measured with the chest strap, regularly deemed as the portable gold standard, presented a better agreement with those measured with an optical sensor placed on the temple rather than with a wristwatch. Better monitoring of the training intensity should be expected from the temple HR readings, but, nevertheless, swimmers would benefit from a combination of both devices.
The readings on the temple sensor tend to be more accurate if coaches and/or athletes avoid placing it above any hair and start the sensor’s reading before commencing the swim (while doing the dryland warm up, for example). A newer model of the temple sensor has the possibility of transmitting HR data as well as swimming statistics in real time to dedicated software. As swimmers roll their head to breathe, it could be possible for the software to acquire HR data in this small but cyclical moment and display the swimmer’s internal load instantaneously. A possible line of investigation would be to test the accuracy of the signal transmission to the software. Future studies could also aim to evaluate the accuracy of the HR readings during different strokes, at different intensities, and with different durations. Also, the assessment of the accuracy of other swimming wearables (like intelligent swim goggles) would be an interesting line of research.

Author Contributions

Conceptualization, R.F.B. and J.E.T.; methodology, R.F.B. and J.E.T.; formal analysis, R.F.B.; investigation, V.S., A.P., and G.M.; resources, R.F.B. and J.E.M.; data curation, V.S., A.P., and G.M.; writing—original draft preparation, R.F.B.; writing—review and editing, K.S., M.S., J.E.T., and J.E.M.; supervision, K.S. and M.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of the Polytechnic Institute of Guarda (6/2025 from 9 April 2025).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors upon reasonable request.

Acknowledgments

The authors would like to thank the students who volunteered to participate in the present study.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
HRHeart rate
QRSCombination of the three deflections seen in an electrocardiogram wave
PPGPhotoplethysmography
HRchestHeart rate measured with the chest strap
HRtempleHeart rate measured with the multi-site sensor placed on the temple
HRwatchHeart rate measured with the wristwatch
LoALimits of agreement

References

  1. Dalamitros, A.A.; Fernandes, R.J.; Toubekis, A.G.; Manou, V.; Loupos, D.; Kellis, S. Is Speed Reserve Related to Critical Speed and Anaerobic Distance Capacity in Swimming? J. Strength Cond. Res. 2015, 29, 1830–1836. [Google Scholar] [CrossRef] [PubMed]
  2. Leite, L.B.; Soares, L.L.; de Azambuja Pussieldi, A.; Claudino, J.G.; da Silva, S.F.; de Azambuja Pussieldi, G. Swimming Training Load Control: An Integrated Approach. Rev. Bras. De Educ. Física Saúde E Desempenho 2022, 3, e021. [Google Scholar] [CrossRef]
  3. Biancardi, C.M.; Lagos-Hausheer, L.; Pequera, G.; Castroman, E.; Cazot, F.; Martinez, E.; Bona, R.L. Energetic Cost of Running in Track and Treadmill. In Proceedings of the International Conference on Sport Sciences Research and Technology Support, icSPORTS-Proceedings, Rome, Italy, 16–17 November 2023. [Google Scholar] [CrossRef]
  4. Martnes, J.J.; Bere, E. Physical Activity When Riding an Electric-Assisted Bicycle with and without Cargo. Front. Sports Act. Living 2023, 5, 1179043. [Google Scholar] [CrossRef]
  5. Morais, J.E.; Bragada, J.A. Relationship between Oxygen Uptake Reserve and Heart Rate Reserve in Young Male Tennis Players: Implications for Physical Fitness Monitoring. Int. J. Environ. Res. Public Health 2022, 19, 15780. [Google Scholar] [CrossRef]
  6. Björklund, G.; Swarén, M.; Norman, M.; Alonso, J.; Johansson, F. Metabolic Demands, Center of Mass Movement and Fractional Utilization of V O2max in Elite Adolescent Tennis Players During On-Court Drills. Front. Sports Act. Living 2020, 2, 92. [Google Scholar] [CrossRef]
  7. Teixeira, J.E.; Forte, P.; Ferraz, R.; Branquinho, L.; Morgans, R.; Silva, A.J.; Monteiro, A.M.; Barbosa, T.M. Resultant Equations for Training Load Monitoring during a Standard Microcycle in Sub-Elite Youth Football: A Principal Components Approach. PeerJ 2023, 11, e15806. [Google Scholar] [CrossRef]
  8. Lindsey, B.; Hanley, C.; Reider, L.; Snyder, S.; Zhou, Y.; Bell, E.; Shim, J.; Hahn, J.O.; Vignos, M.; Bar-Kochba, E. Accuracy of Heart Rate Measured by Military-Grade Wearable ECG Monitor Compared with Reference and Commercial Monitors. BMJ Mil. Health 2023, 171, 144–149. [Google Scholar] [CrossRef]
  9. Schaffarczyk, M.; Rogers, B.; Reer, R.; Gronwald, T. Validity of the Polar H10 Sensor for Heart Rate Variability Analysis during Resting State and Incremental Exercise in Recreational Men and Women. Sensors 2022, 22, 6536. [Google Scholar] [CrossRef]
  10. Gilgen-Ammann, R.; Schweizer, T.; Wyss, T. RR Interval Signal Quality of a Heart Rate Monitor and an ECG Holter at Rest and during Exercise. Eur. J. Appl. Physiol. 2019, 119, 1525–1532. [Google Scholar] [CrossRef]
  11. Hettiarachchi, I.T.; Hanoun, S.; Nahavandi, D.; Nahavandi, S. Validation of Polar OH1 Optical Heart Rate Sensor for Moderate and High Intensity Physical Activities. PLoS ONE 2019, 14, e0217288. [Google Scholar] [CrossRef]
  12. Martín-Escudero, P.; Cabanas, A.M.; Dotor-Castilla, M.L.; Galindo-Canales, M.; Miguel-Tobal, F.; Fernández-Pérez, C.; Fuentes-Ferrer, M.; Giannetti, R. Are Activity Wrist-Worn Devices Accurate for Determining Heart Rate during Intense Exercise? Bioengineering 2023, 10, 254. [Google Scholar] [CrossRef] [PubMed]
  13. Olstad, B.H.; Zinner, C. Validation of the Polar OH1 and M600 Optical Heart Rate Sensors during Front Crawl Swim Training. PLoS ONE 2020, 15, e0231522. [Google Scholar] [CrossRef] [PubMed]
  14. Gilgen-Ammann, R.; Buller, M.; Bitterle, J.L.; Delves, S.K.; Veenstra, B.J.; Roos, L.; Beeler, N.; Wyss, T. Evaluation of Pulse Rate Measurement with a Wrist Worn Device during Different Tasks and Physical Activity. Curr. Issues Sport Sci. (CISS) 2018, 3, 11. [Google Scholar] [CrossRef]
  15. López-Belmonte, Ó.; Febles-Castro, A.; Gay, A.; Cuenca-Fernández, F.; Arellano, R.; Ruiz-Navarro, J.J. Validity of the Polar Verity Sense during Swimming at Different Locations and Intensities. Scand. J. Med. Sci. Sports 2023, 33, 2623–2625. [Google Scholar] [CrossRef]
  16. Stock, J.M.; Pohlig, R.T.; Botieri, M.J.; Edwards, D.G.; Dominick, G.M. Heart Rate Equivalency of the Fitbit Charge HR During Continuous Aerobic Exercise. J. Meas. Phys. Behav. 2018, 1, 122–129. [Google Scholar] [CrossRef]
  17. Jo, E.; Lewis, K.; Directo, D.; Kim, M.J.Y.; Dolezal, B.A. Validation of Biofeedback Wearables for Photoplethysmographic Heart Rate Tracking. J. sports Sci. Med. 2016, 15, 540. [Google Scholar]
  18. Lee, C.M.; Gorelick, M. Validity of the Smarthealth Watch to Measure Heart Rate during Rest and Exercise. Meas. Phys. Educ. Exerc. Sci. 2011, 15, 18–25. [Google Scholar] [CrossRef]
  19. Thomas, J.; Doyle, P.; Doyle, J.A. Validity of Optical Heart Rate Measurement in Commercially Available Wearable Fitness Tracking Devices. bioRxiv 2022, 9, 510075. [Google Scholar]
  20. Montalvo, S.; Martinez, A.; Arias, S.; Lozano, A.; Gonzalez, M.P.; Dietze-Hermosa, M.S.; Boyea, B.L.; Dorgo, S. Commercial Smart Watches and Heart Rate Monitors: A Concurrent Validity Analysis. J. Strength Cond. Res. 2023, 37, 1802–1808. [Google Scholar] [CrossRef]
  21. Hermand, E.; Cassirame, J.; Ennequin, G.; Hue, O. Validation of a Photoplethysmographic Heart Rate Monitor: Polar OH1. Int. J. Sports Med. 2019, 40, 462–467. [Google Scholar] [CrossRef]
  22. Laukkanen, R.M.T.; Virtanen, P.K. Heart Rate Monitors: State of the Art. J. Sports Sci. 1998, 16 (Suppl. 1), 3–7. [Google Scholar] [CrossRef] [PubMed]
  23. Polar Research and Technology. Polar H10 Heart Rate Sensor System [White Paper]; Polar Research and Technology: Kempele, Finland, 2019. [Google Scholar]
  24. Polar Research and Technology. Polar Optical Heart Rate [White Paper]; Polar Research and Technology: Kempele, Finland, 2017. [Google Scholar]
  25. Polar Electro. Polar OH1 [Owners Manual]; Polar Electro: Kempele, Finland, 2021. [Google Scholar]
  26. Bragada, J.A.; Bartolomeu, R.F.; Rodrigues, P.M.; Magalhães, P.M.; Bragada, J.P.; Morais, J.E. Validation of StepTest4all for Assessing Cardiovascular Capacity in Young Adults. Int. J. Environ. Res. Public Health 2022, 19, 11274. [Google Scholar] [CrossRef] [PubMed]
  27. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef]
  28. Bland, J.M.; Altman, D.G. Statistical Methods for Assessing Agreement between Two Methods of Clinical Measurement. Int. J. Nurs. Stud. 2010, 47, 931–936. [Google Scholar] [CrossRef]
  29. Morais, J.E.; Barbosa, T.M.; Garrido, N.D.; Cirilo-Sousa, M.S.; Silva, A.J.; Marinho, D.A. Agreement between Different Methods to Measure the Active Drag Coefficient in Front-Crawl Swimming. J. Hum. Kinet. 2023, 86, 41–49. [Google Scholar] [CrossRef]
  30. Terbizan, D.J.; Dolezal, B.A.; Albano, C. Validity of Seven Commercially Available Heart Rate Monitors. Meas. Phys. Educ. Exerc. Sci. 2002, 6, 243–247. [Google Scholar] [CrossRef]
  31. Godsen, R.; Carroll, T.; Stone, S. How Well Does the Polar Vantage XL Heart Rate Monitor Estimate Actual Heart Rate. Med. Sci. Sports Exerc. 1991, 23 (Suppl. 4), 14. [Google Scholar]
  32. Pasadyn, S.R.; Soudan, M.; Gillinov, M.; Houghtaling, P.; Phelan, D.; Gillinov, N.; Bittel, B.; Desai, M.Y. Accuracy of Commercially Available Heart Rate Monitors in Athletes: A Prospective Study. Cardiovasc. Diagn. Ther. 2019, 9, 379–385. [Google Scholar] [CrossRef]
  33. Polar Electro. What are the Pros and Cons of Different Methods for Measuring Heart Rate? Available online: https://support.polar.com/us-en/what_are_the_pros_and_cons_of_wrist_based_heart_rate_measurement_and_measuring_heart_rate_with_a (accessed on 28 February 2025).
  34. Maeda, Y.; Sekine, M.; Tamura, T. Relationship between Measurement Site and Motion Artifacts in Wearable Reflected Photoplethysmography. J. Med. Syst. 2010, 35, 969–976. [Google Scholar] [CrossRef]
  35. Budig, M.; Keiner, M.; Stoohs, R.; Hoffmeister, M.; Höltke, V. Heart Rate and Distance Measurement of Two Multisport Activity Trackers and a Cellphone App in Different Sports: A Cross-Sectional Validation and Comparison Field Study. Sensors 2021, 22, 180. [Google Scholar] [CrossRef]
  36. Cosoli, G.; Antognoli, L.; Veroli, V.; Scalise, L. Accuracy and Precision OfWearable Devices for Real-Time Monitoring of Swimming Athletes. Sensors 2022, 22, 4726. [Google Scholar] [CrossRef] [PubMed]
  37. Shcherbina, A.; Mikael Mattsson, C.; Waggott, D.; Salisbury, H.; Christle, J.W.; Hastie, T.; Wheeler, M.T.; Ashley, E.A. Accuracy in Wrist-Worn, Sensor-Based Measurements of Heart Rate and Energy Expenditure in a Diverse Cohort. J. Pers. Med. 2017, 7, 3. [Google Scholar] [CrossRef] [PubMed]
  38. Hung, S.H.; Serwa, K.; Rosenthal, G.; Eng, J.J. Validity of Heart Rate Measurements in Wrist-Based Monitors across Skin Tones during Exercise. PLoS ONE 2025, 20, e0318724. [Google Scholar] [CrossRef]
  39. Maglischo, E. Swimming Fastest; Human Kinetics: Champaign, IL, USA, 2003. [Google Scholar]
  40. Schubert, M.; Clark, A.; De La Rosa, A. The Polar® OH1 Optical Heart Rate Sensor Is Valid during Moderate-Vigorous Exercise. Sports Med. Int. Open 2018, 2, E67–E70. [Google Scholar] [CrossRef]
  41. Yu, H.; Kotlyar, M.; Dufresne, S.; Thuras, P.; Pakhomov, S. Feasibility of Using an Armband Optical Heart Rate Sensor in Naturalistic Environment. Pac. Symp. Biocomput. 2023, 28, 43–54. [Google Scholar] [CrossRef]
  42. Giavarina, D. Understanding Bland Altman Analysis. Biochem. Medica 2015, 25, 141–151. [Google Scholar] [CrossRef]
Figure 1. Example of an HR–time profile measured by the chest strap (black dots), wristwatch (gray dots), and optical sensor in the temple (white dots) throughout the entire test.
Figure 1. Example of an HR–time profile measured by the chest strap (black dots), wristwatch (gray dots), and optical sensor in the temple (white dots) throughout the entire test.
Applsci 15 05848 g001
Figure 2. Bland–Altman plots of HRchest and HRtemple (A) and HRchest and HRwatch (B) for the first (1), second (2), and third (3) 30 s periods, the recovery period (4), and the whole test (5). Y axes represent the difference between measurements and X axes the mean values. Limits of agreement were computed as the mean difference ± 1.96 SD. ULoA: Upper limit of agreement; LLoA: Lower limit of agreement. The red lines represent the manually set LoA of −10 and 10 b·min−1 mean difference.
Figure 2. Bland–Altman plots of HRchest and HRtemple (A) and HRchest and HRwatch (B) for the first (1), second (2), and third (3) 30 s periods, the recovery period (4), and the whole test (5). Y axes represent the difference between measurements and X axes the mean values. Limits of agreement were computed as the mean difference ± 1.96 SD. ULoA: Upper limit of agreement; LLoA: Lower limit of agreement. The red lines represent the manually set LoA of −10 and 10 b·min−1 mean difference.
Applsci 15 05848 g002
Table 1. Participants’ characteristics.
Table 1. Participants’ characteristics.
Male (N = 20)Female (N = 10)Overall
Age (years)19.7 ± 0.719.4 ± 0.719.6 ± 0.7
Height (cm)176.0 ± 3.8167.6 ± 3.5173.3 ± 5.4
Weight (kg)70.8 ± 3.558.9 ± 4.067.1 ± 6.6
Fitzpatrick skin tone scale (a.u.)3.0 ± 03.0 ± 03.0 ± 0
Table 2. Coefficient of determination, intraclass correlation coefficient, and mean bias between devices in each test step and in the whole test.
Table 2. Coefficient of determination, intraclass correlation coefficient, and mean bias between devices in each test step and in the whole test.
Test StepHRchest × HRtempleHRchest × HRwatch
R2ICC
(95% CI)
Mean Bias
(95% CI)
R2ICC
(95% CI)
Mean Bias
(95% CI)
1st step (0–30 s)0.370.71
(0.53–0.81)
−8.7
(−9.9–−39.7)
0.010.03
(−0.04–0.11)
−48.1
(−49.9–−46.3)
2nd step (30–60 s)0.81 *0.94 *
(0.91–0.96)
−3.1 *
(−3.7–−2.5)
0.04 0.1
(−0.09–0.28)
−46.4
(−48.2–−44.6)
3rd step (60–90 s)0.84 *0.95 *
(0.93–0.96)
−2.1 *
(−2.5–−1.6)
0.06 0.13
(−0.11–0.35)
−42.2
(−44.0–−40.4)
Rest step (90–150 s)0.93 *0.98 *
(0.97–0.99)
1.6 *
(1.3–1.8)
0.04 0.26
(−0.09–0.39)
−16.1
(−17.5–−14.7)
Whole test (0–150 s)0.85 *0.96 *
(0.95–0.96)
−1.0 *
(−1.3–−0.8)
0.230.42
(−0.13–0.68)
−26.5
(−27.3–−25.6)
* Values that fall within the highest level of the effect size and/or met the established criterion for agreement. Values that fall within the “weak” or “poor” level of the effect size or did not meet the established criterion for agreement.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Bartolomeu, R.F.; Silva, V.; Pereira, A.; Morais, G.; Sokołowski, K.; Strzała, M.; Morais, J.E.; Teixeira, J.E. Agreement Between a Wristwatch and a Free Optical Sensor with a Chest Strap in Measuring HR Variations During Front Crawl Swimming. Appl. Sci. 2025, 15, 5848. https://doi.org/10.3390/app15115848

AMA Style

Bartolomeu RF, Silva V, Pereira A, Morais G, Sokołowski K, Strzała M, Morais JE, Teixeira JE. Agreement Between a Wristwatch and a Free Optical Sensor with a Chest Strap in Measuring HR Variations During Front Crawl Swimming. Applied Sciences. 2025; 15(11):5848. https://doi.org/10.3390/app15115848

Chicago/Turabian Style

Bartolomeu, Raul F., Vasco Silva, Ana Pereira, Gonçalo Morais, Kamil Sokołowski, Marek Strzała, Jorge E. Morais, and José E. Teixeira. 2025. "Agreement Between a Wristwatch and a Free Optical Sensor with a Chest Strap in Measuring HR Variations During Front Crawl Swimming" Applied Sciences 15, no. 11: 5848. https://doi.org/10.3390/app15115848

APA Style

Bartolomeu, R. F., Silva, V., Pereira, A., Morais, G., Sokołowski, K., Strzała, M., Morais, J. E., & Teixeira, J. E. (2025). Agreement Between a Wristwatch and a Free Optical Sensor with a Chest Strap in Measuring HR Variations During Front Crawl Swimming. Applied Sciences, 15(11), 5848. https://doi.org/10.3390/app15115848

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop