Next Article in Journal
Evaluation of ECOSTRESS Thermal Data over South Florida Estuaries
Next Article in Special Issue
Wearable Urban Mobility Assistive Device for Visually Impaired Pedestrians Using a Smartphone and a Tactile-Foot Interface
Previous Article in Journal
Indoor Positioning System Based on Global Positioning System Signals with Down- and Up-Converters in 433 MHz ISM Band
Previous Article in Special Issue
Development of a Human-Display Interface with Vibrotactile Feedback for Real-World Assistive Applications
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Portable Interactive Pulse Tactile Recorder and Player System

Department of Mechanical Engineering, National Taiwan University, Taipei 10617, Taiwan
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(13), 4339; https://doi.org/10.3390/s21134339
Submission received: 24 May 2021 / Revised: 19 June 2021 / Accepted: 23 June 2021 / Published: 25 June 2021
(This article belongs to the Special Issue Tactile Sensing and Rendering for Healthcare Applications)

Abstract

:
Pulse palpation is an effective method for diagnosing arterial diseases. However, most pulse measurement devices use preconfigured pressures to collect pulse signals, and most pulse tactile simulators can only display standard or predefined pulse waveforms. Here, a portable interactive human pulse measurement and reproduction system was developed that allows users to take arbitrary pulses and experience realistic simulated pulse tactile feedback in real time by using their natural pulse-taking behaviors. The system includes a pulse tactile recorder and a pulse tactile player. Pulse palpation forces and vibrations can be recorded and realistically replayed for later tactile exploration and examination. To retain subtle but vital pulse information, empirical mode decomposition was used to decompose pulse waveforms into several intrinsic mode functions. Artificial neural networks were then trained based on intrinsic mode functions to determine the relationship between the driving signals of the pulse tactile player and the resulting vibration waveforms. Experimental results indicate that the average normalized root mean square error and the average R-squared values between the reproduced and original pulses were 0.0654 and 0.958 respectively, which indicate that the system can reproduce high-fidelity pulse tactile vibrations.

1. Introduction

Human pulses often reveal a person’s health conditions. Health care personnel and rescuers frequently use pulse palpation first to detect patients’ vital signs. Pulse taking also plays a prominent role in traditional Chinese medicine (TCM). TCM physicians typically take pulses directly by placing their index, middle, and ring fingers at the Cun, Guan, and Chi points on a patient’s wrists, respectively, by using light (<0.9 N), moderate (0.9–1.5 N), or heavy (>1.50 N) forces. Based on pulse depth, rate, shape, and strength, physicians can perceive the patient’s health conditions [1,2,3]. Pulse depth describes the vertical position of a pulse. Pulse rate describes the number of pulses per unit time. Pulse shape describes the width and length of a pulse. Pulse strength describes the forcefulness of the pulse against the finger pressure. Accurate pulse taking often requires rich clinical experience. Because pulse palpation is largely based on the individual’s finger tactile perception, it might be affected by numerous subjective and objective factors. Therefore, training entry-level health care personnel or TCM physicians in pulse taking and reading is extremely challenging.
Computer-aided pulse analysis tools have recently been developed to identify relationships between pulse features and diseases [4,5,6,7,8]. However, the accuracy of an analytical result is often based on the accuracy of the pulse signal acquisition device. With advances in sensor technology, small and lightweight sensors have been developed and applied to pulse measurement, such as optical [9,10], strain-gauge [9,11,12], pressure [11,12,13,14,15,16], piezoelectric [17], piezoresistive [18,19], and polyvinylidene-fluoride (PVDF) [20,21] sensors. Most research has used one or more of these sensors to detect cardiovascular disease or blood pressure. Prior studies have used mechanical methods or preconfigured pressures to collect pulse signals. Users only needed to follow certain steps to operate the devices to record pulse signals. However, TCM physicians and health care personnel often take pulses by switching back and forth between different pressures. Prior pulse taking devices lacked direct tactile interactions between patients and physicians and thus differed from the general practice of health care personnel and TCM physicians. Therefore, a more interactive pulse-taking system allowing users to take pulses by using their natural pulse-taking behaviors and preferred palpation pressures is needed.
In contrast to pulse measurement devices, relatively few studies on pulse tactile display have been conducted. Because of blood pressure against the vascular wall and the contraction and relaxation of heart muscles, a typical pulse waveform is composed of a percussion wave caused by early systolic pulse pressure, a tidal wave caused by late systolic pulse pressure, and a dicrotic notch caused by the rebound of blood [8,15,20]. Therefore, an effective pulse tactile display should present similar pulse features. The most common pulsation simulators are liquid based. For instance, the ViVitro Endovascular Simulator from ViVitro Labs uses pumps to deliver pulsatile flow. Lee et al. [1] developed a cardiovascular simulator using a stepping motor, slider-crank mechanism, piston pump, water, and glycerin to generate pulsatile flow for simulating typical TCM pulse waveforms. Koo et al. [22] built a radial pulsation simulator using a peristaltic pump and magnetorheological (MR) fluids. By controlling the viscosity and motion of the MR fluids with user-defined magnetic fields, arbitrary pulse waveforms were generated. Yang et al. [23] built a radial pulsation simulator using stepping motors and pistons to generate radial artery pressure waveforms reflecting the physiological characteristics of a human cardiovascular system. By carefully controlling the inflow of the fluid, the liquid-driven pulsation simulator created various standard pulse waveforms based on the cardiovascular conditions.
In addition to liquid-driven simulators, researchers have built pneumatic-driven pulsation simulators. A pneumatic-driven mechanism could avoid the problems of liquid-driven pulsation simulators, for example, sporadic pressure waves, bubbles, and leakage. For example, Santos-Carreras et al. [24] used five pneumatic balloon actuators to generate a pulse-like tactile sensation for teleoperated surgery. Although their device conveyed tactile information, detailed pulse features were ignored. Yang et al. [25] built a pneumatic-driven radial pulsation simulator based on a cam-follower mechanism controlled by a DC motor. However, cams needed to be fabricated to simulate different waveforms.
Although most liquid- or pneumatic-driven pulsation simulators can generate a favorable pulse tactile sensation, most are expensive, complex, and bulky. They can only simulate standard or predefined pulse waveforms, and real-time reproduction of arbitrary pulse waveforms was not possible. This study developed a portable and interactive pulsation system that can record and reproduce arbitrary pulse tactile information of any individual in real time. The pulsation measurement part of the system is referred to as the “pulse tactile recorder”, and the pulsation reproduction part is named the “pulse tactile player”. The pulse tactile recorder allows users to take pulses by using their natural pulse-taking behaviors and preferred palpation pressures. The pulse tactile player can realistically reproduce the tactile vibration in real time for further diagnosis or training.

2. Pulse Tactile Recorder

2.1. Hardware Design

Because pulse tactile vibrations vary depending on palpation forces, in addition to vibration information, palpation forces should also be recorded. The structure of the pulse tactile recorder includes a vibration sensor, a force sensor, a sensing tip, a hollow spacer, and a silicon skin. Figure 1 presents a section view of the structure. The PVDF piezo film vibration sensor SDT1-028K (Measurement Specialties) was selected to detect pulse vibration signals because the sensor performs well at both low and high frequencies and the resonant frequency points are >10 MHz. The dimensions of the sensor are 16 mm × 41 mm × 75 μm. The output sensitivity is 15–20 mV/μ strain. The polymer film force sensor FSR 402 (Interlink Electronics) was selected to measure pressing force. The force sensor is 18.28 mm in diameter and 0.45 mm in thickness. The force sensitivity range is between 0.2 and 20 N, with analog output.
On the top of the force sensor is a round pressing area, covered with a silicon skin, where users can place their fingers and exert a pressing force. A hollow spacer is placed between the force and vibration sensors so that the vibration sensor can freely vibrate without being suppressed by the pressing force from fingers. A conical tip, which is used to contact the patients to detect pulse signals, is attached to one side of the vibration sensor.
The Taguchi method was used to optimize the structure design. Table 1 shows four important factors (A: height of the sensing tip; B: thickness of the hollow spacer between FSR and PVDF; C: number of clamping sides; D: material of the sensing tip) and the corresponding levels considered in the structure design. An L9 orthogonal array was used to design the experiment. Table 2 shows the level chosen for each factor in each experiment. Each design was evaluated using a cam mechanism described in the next section. Different hardware layouts might affect sensor sensitivity. If a design provides a higher voltage output, that means the design has higher sensitivity towards deformation. In addition, an effective recorder’s measured profile should fit the original waveform profile as much as possible. Therefore, in this study, a score was given using the following equation to evaluate a design:
Score = R-squared value + norm peak volt
where “R-squared value” is the fit between the original cam profile and the measured profile and “norm peak volt” is the normalized peak voltage of the output signals of each design. Based on the results of the 9 experiments, a standard analysis of the Taguchi method was conducted. The analysis results suggest that factor A with level 1 (5 mm of sensing tip), factor B with level 3 (2 mm of spacer thickness), factor C with level 2 (4 clamping sides), and factor D with level 1 (PLA sensing tip) formed the optimum structure design. The suggested design happened to be one of the 9 experiments in Table 2, with a score of 1.97. In order to check if longer sensing tips led to higher scores, a sensing tip with 7 mm was tested. The score of the 7 mm tip was 1.81 (R2 = 0.96 and norm peak volt = 0.85), which is lower than that of the 5 mm.
The vibration sensor, force sensor, hollow spacer, and silicon skin are clamped inside a shell with total dimensions of 44.6 × 26 × 6 mm3. The whole tactile recorder weighs only 10 g. Users can interact with patients using their natural pulse-taking behaviors with their preferred palpation forces when they are taking pulses, as illustrated in Figure 2.

2.2. Pulse Signal Verification

Figure 3a–c represents pulses taken using the pulse tactile recorder with three pressing forces of 0.78, 1.18, and 1.76 N, respectively. The pulse tactile recorder can record miniscule pulse signals; however, it is apparent that the signals in Figure 3 lack typical pulse features described in [8,15,20]. A typical pulse waveform is composed of a percussion wave, a tidal wave, and a dicrotic notch caused by the rebound of blood. All the features must lie above a baseline. However, the signals in Figure 3 fall below the baseline (0 V) after the peak signals. The reason for this was that when pressure was applied to the PVDF piezo film vibration sensor, the PVDF deformed and generated charges proportionate to the pressure applied. However, the oscilloscope displayed only the voltage generated by the charges. Therefore, the displacement of the PVDF was actually proportional to the integral of the voltage (charge accumulation). An experiment using a cam profile was then performed to verify the accuracy of the recorder, as described as follows.
A cam profile was designed according to a period of pulse waveform using SolidWorks Motion Analysis. The cam was driven by a DC motor at a constant rotational speed of 60 rpm. The pulse tactile recorder was placed on top of the cam, and the sensing tip was contacted with the cam, as portrayed in Figure 4.
When the cam rotated, the cam profile would deform the PVDF sensor according to the profile of the cam, which was a period of pulse waveform. The recorded PVDF signals are presented in Figure 5a. The signals were then integrated to find the displacement variation of the PVDF sensor, as provided in Figure 5b.
The experiment was repeated 10 times. The integral of the recorded signals and the original cam profile were compared using the normalized root mean square error (NRMSE) and R-squared values. The NRMSE was calculated as follows:
N R M S E = R M S E P m a x P m i n
where Pmax and Pmin denote the maximum and minimum values of the original cam waveform. Table 3 shows that the average NRMSE and R-squared values were 0.046 and 0.983, respectively, with low standard deviations, which indicates that the pulse tactile recorder could measure pulses with high accuracy and repeatability.
In this study, the signals recorded by the recorder are called “pulse signals”, and the integrals of the pulse signals are called “pulse waveforms”. Figure 6 displays the pulse waveforms of the pulse signals in Figure 3. All the pulse waveforms now revealed relevant typical pulse features.

3. Pulse Tactile Player

Piezoelectric benders were selected as the actuators to develop the portable pulse tactile player because of their wide bandwidth, fast response, small size, light weight, and low cost. Piezoelectric bimorph benders from Unictron Technologies were used. The active layer of the bimorph is made with lead zirconate titanate ceramic with 0.19 mm thickness for each side. The passive layer is stainless steel with 0.1 mm thickness. The total dimensions of the player are 60 × 20 × 0.48 mm3, and the driving voltage is ±48 V DC. The force generated by one bender is approximately 0.5 N, and the maximum displacement is approximately 1 mm. To generate sufficient pulse force, five piezoelectric benders were used.
The actuating part of the pulse tactile player is pictured in Figure 7. One end of the bender is fixed to a frame, and the other end of the bender is attached to a movable platform. The top of the frame has a 10 mm diameter round hole with a rubber dome placed in the center. The force sensor FSR 402 is placed under the frame to detect finger force. The actuating part is enclosed inside a holder to form a complete unit, as depicted in Figure 8a. Because the sensation of human skin also affects tactile perception, a silicon skin with shore hardness A-10 was fabricated and placed on top of the robber dome, as portrayed in Figure 8b. The final dimensions of the pulse tactile player are 115 × 56.5 × 58 mm3, and the total weight is 310 g. The device is lightweight and portable compared to other pulse tactile displays.
The system block diagram of the control unit is displayed in Figure 9. A Teensy 3.2 USB development board is used to process the driving signals of the pulse tactile player. The amplifier OPA454 (Texas Instruments) is used to amplify the driving signals from 3.3 to 80 Vpp to drive the pulse tactile player.

4. Linear Model

In theory, a linear relationship between the driving signals and the displacement of the piezoelectric benders should exist. Therefore, in most early research, a linear model was adopted to drive a piezoelectric actuator [26,27]. However, prior research also showed that nonlinear relationships might exist due to hysteresis [28,29]. Since pulse waveforms contain many important but minuscule features [30], in the present study, it was not clear if a linear model was sufficient to describe the relationship between the driving signals and the displacements of the piezoelectric benders when simulating a human pulse. In addition, finger pressures might suppress the vibration of the benders and cause a nonlinear relationship. In order to test the linearity of the pulse tactile player, two experiments were conducted. First, a linear relationship was assumed between the driving voltage and the output waveforms. Then, a nonlinear relationship was assumed. The results of the two experiments were compared using the NRMSE and R-squared values between the reproduced and original pulses.
Eight sets of 8 sec wrist pulse signals were collected in each of the three force ranges (<0.9, 0.9–1.5, and >1.5 N) from the pulse tactile recorder. According to the Nyquist–Shannon sampling theorem [31], the sampling rate should be at least two times larger than the target frequency. The sampling rate of the pulse tactile recorder is 1 kHz, which is much higher than the frequency of the human pulse (0.6–2 Hz) so that it can contain sufficient critical pulse information [32]. A mean filter was used to down sample the data to 250 Hz to remove noise, resulting in 2000 data points in each dataset. The pulse signals were then integrated to obtain the original pulse waveforms.
A verification setup was designed to verify the output waveforms (Figure 10). A screw feeder was adjusted to provide the same amount of force on the pulse tactile recorder as the recorded original. A simple linear model was used to drive the pulse tactile player based on the original pulse waveforms. The pulse tactile recorder was placed on the silicon skin of the pulse tactile player to record the vibration signals. Finally, the integrals of the output signals were compared with the original pulse waveforms using the NRMSE and R-squared values. Table 4 and Table 5 show that the average NRMSE and the average R-squared values between the original pulse waveforms and the output waveforms (integral of the output signals) were 0.572 and 0.915, respectively.

5. Nonlinear Model

5.1. Artificial Neural Network

In this study, neural networks were used to model the nonlinear relationship between the driving signals and the output waveforms of the pulse tactile player [33]. A back-propagation multilayer perceptron artificial neural network (ANN) was used to train a nonlinear function, TNN. The training data for the ANN included input data P, which was the displacement of the pulse tactile player, and output data U, which was the driving voltage of the pulse tactile player, as described in (3).
T N N ( P ) = U
After the ANN model was well trained, the corresponding driving voltage to drive the pulse tactile player to reproduce a given pulse tactile vibration could be identified.

5.2. ANN Training Data Collection

The same data acquisition mechanism was used to collect the training data (Figure 10). The pulse tactile recorder was placed on top of the silicon skin of the pulse tactile player. A screw feeder was used to provide specified forces. The driving voltage of the pulse tactile recorder would be the output data U of the ANN model, and the integral of the recorded signals from the pulse tactile player would be the input data P for the ANN model.
Another ten sets of 8 s wrist pulse signals were collected in each of the three force ranges (<0.9, 0.9–1.5, and >1.5N) from the pulse tactile recorder. In all, 30 sets of pulse signals were collected. A mean filter was used to down sample the data to 250 Hz to remove noise, resulting in 2000 data points in each dataset. The pulse signals were then integrated to obtain the corresponding pulse waveforms.
However, if pulse waveforms were to be used to train the ANN model, some miniscule pulse information might be misidentified as noise and removed during the training. To retain both low- and high-frequency miniscule pulse information, empirical mode decomposition (EMD) was used to decompose pulse waveforms into several intrinsic mode functions (IMFs), which were then used to train the ANN model on various frequency scales to retain miniscule characteristics of the pulse waveforms while removing high-frequency noises at the same time. A flowchart of the training data obtainment is presented in Figure 11.
The EMD method was designed for analyzing nonlinear and nonstationary time series data [34,35]. EMD decomposes signals into several IMFs using a sifting process in which predetermined basis functions are not required. IMFs can represent the various frequency scales of the original signals. The combination of all IMFs can accurately represent the original signals without the loss of details during data conversion. EMD has been successfully applied to biological data analysis [36,37,38]. Prior research has shown that using the concept of “divide-and-conquer”, EMD-based neural networks could achieve higher training accuracy and efficiency [39,40]. Research has also demonstrated that EMD is more precise than the Fourier filter in extracting low-frequency components [41] and more efficient than wavelet transform in classifying disturbances [42].
In EMD, cubic splines are used to produce an upper envelope and a lower envelope of the signals. The mean of the two envelopes may be represented as m 1 ( t ) . The difference between the original signal x(t) and m 1 ( t ) is the first component h 1 ( t ) , as follows:
h 1 ( t ) = x ( t ) m 1 ( t )
The same procedure is repeated to find the upper and lower envelopes of h 1 ( t ) , and the mean value is represented as m 11 ( t ) . m 11 ( t ) is then subtracted from h 1 ( t ) to obtain the second component h 11 ( t ) , as follows:
h 11 ( t ) = h 1 ( t ) m 11 ( t )
The same sifting procedure is repeated k times until a stop criterion is satisfied:
h 1 k ( t ) = h 1 ( k 1 ) ( t ) m 1 k ( t )
In this study, the Matlab EMD Toolbox and the Cauchy-type convergence criterion were used [43], as follows:
S D k = t = 0 T | h 1 ( k 1 ) ( t ) h 1 k ( t ) | 2 t = 0 T | h 1 ( k 1 ) ( t ) | 2
where T is the data length. The threshold was set to be 0.1. If SD was smaller than the threshold, the sifting process would stop. The resulting h 1 k ( t ) was an IMF and defined as I M F 1 ( t ) . Each IMF satisfied the following two conditions: (1) the number of extrema and the number of zero crossings must either equal or differ at most by one, and (2) at any data point, the mean value of the envelope defined using the local maxima and the envelope defined using the local minima is zero [35].
I M F 1 ( t ) was then separated from x ( t ) as follows:
r 1 ( t ) = x ( t ) I M F 1 ( t )
The residue, r 1 ( t ) , was treated as a new data set and subjected to the same sifting process until the residue, r n ( t ) , became a monotonic function from which no more IMFs could be extracted, as follows:
r n ( t ) = r n 1 ( t ) I M F n ( t )
The original signal x(t) could be expressed as follows:
x ( t ) = i = 1 n I M F i ( t ) + r n ( t )
where n denotes the total number of IMF components. From experience, one eight-second pulse waveform could be decomposed into at most seven IMFs. Figure 12 presents one pulse waveform and its seven IMFs and one residue. Each IMF had its own main peak frequency and energy intensity. In this study, the energy intensity of each IMF was taken as the weighting of the IMF. Usually, the first three IMFs have the highest energy intensities and affect the waveform the most.
The IMFs were then normalized and taken as the driving signals to drive the pulse tactile player. The vibration signals were recorded using the pulse tactile recorder. Finally, the driving signals and the integrals of the recorded signals provided the output data and input data for the ANN training model, respectively. Because residue was the basic trend of the pulse waveform, it was not used in the training. Here, ten sets of pulse data, each containing 2000 data points, were collected in each force level, and each set of pulse data was decomposed into seven IMFs. Therefore, in total, 70 sets of ANN training data (or 140,000 data points) were provided for each force range.

5.3. ANN Training Model

For each force range, one ANN was trained. In this study, in order to process and reproduce each data point in real time, the input layer and output layer both comprised 1 neuron. In other words, both the input data P and output data U contained one data point only. However, the number of hidden layers, the number of neurons in the hidden layers, and the activation functions were obtained by a trial and error method until satisfactory accuracy and training time were achieved. Finally, one hidden layer comprising 10 neurons was adopted. The sigmoid function and hyperbolic tangent sigmoid function were selected as the activation functions for the hidden layer and the output layer, respectively, as described in (11) and (12).
Sigmoid function
f ( n ) = 1 1 + e n
Hyperbolic tangent sigmoid function
f ( n ) = 2 ( 1 + e 2 n ) 1
In this study, the number of iterations for the ANN training was set to 104 epochs. The learning rate of the training process was set to 0.8. Table 6 lists the NRMSEs of the training results.

5.4. Pulse Reproduction and Verification

5.4.1. Driving Signals

Figure 13 presents a flowchart for reproducing a complete pulsation. Steps 1 to 6 are represented in Figure 11. Based on the force range, Step 7 uses the corresponding ANN model to determine the driving signals for each IMF. Step 8 multiplies each driving signal with the corresponding weighting obtained in Step 5. Because a pulse waveform is decomposed into several IMFs, in order to reproduce a complete pulse vibration, all the driving signals of the IMFs must be combined, as described in Step 9. Finally, the driving signals are up sampled to 1 kHz to obtain the final driving signals of the pulse tactile player, reproducing a complete pulsation.

5.4.2. Verification Results

The same eight sets of 8 sec wrist pulse signals used in the linear model were taken to verify the reproduction performance. The verification setup was identical to the data acquisition and verification mechanism in Figure 10. The integrals of the recorded signals were compared with the original pulse waveforms using the NRMSE and R-squared values.
As can be observed in Table 7, the average NRMSE of the differences between the reproduced pulses and the original pulses is 0.065. This indicates that the trained ANN models predict the pulse waveforms quite well. As Table 8 reports, the average R-squared value is 0.958, indicating that a high linear relationship between the reproduced and original pulse waveforms exists.

6. Discussion

In this study, a simple linear model and ANN models were used to describe the relationship between the driving signals of the pulse tactile player and the pulse tactile vibrations. In order to see if there were any significant differences between the linear model and ANN models, independent sample t-tests with the significant level of 0.05 were conducted. Table 9 shows that the NRMSEs of the ANN models of the three forces are all significantly lower than that of the linear model. It indicates that compared to the linear model, the ANN models have less noise, and the data points of the reproduced waveforms are closer to the original pulse waveforms.
Table 9 also shows that the R-squared values of the ANN models of the moderate and heavy forces are significantly higher than that of the linear model. Although the R-squared value of the ANN model of the light force is not significantly higher, the average value is still higher than that of the linear model. It indicates that the ANN models could provide better fit than the linear model.
Usually, pulse signals taken by light forces are indistinct and contain lots noise. Table 4 shows that the average NRMSE of the light forces is 0.93. To remove signal noise but retain subtle pulse information at various frequency scales, the EMD method was used to decompose pulse waveforms into several IMFs during the ANN training. Table 7 shows that using EMD and ANN models, the average NRMSE of the light forces reduces to 0.062.
By combining all the driving signals of the IMFs, the final driving signals for the pulse tactile player to reproduce a complete pulse tactile vibration were obtained. Figure 12 and Table 6 show that the first three IMFs contain relatively high energy intensities and low NRMSE values. Since the energy intensity of each IMF is used as the weight of the IMF when combining all the driving signals of the IMFs, the first three IMFs affect the final driving signals the most. Therefore, even most of the NRMSE values of IMFs 4–7 are high in Table 6, the average NRMSEs of the ANN models in Table 7 is still very low. The average NRMSE and R2 of the pulse player using the ANN models are 0.065 and 0.958, respectively. The results of the verification indicate that the system can reproduce high-fidelity pulse tactile vibrations.
This study selected a PVDF piezo film vibration sensor to detect pulse vibration signals. Different hardware layouts might affect the measurement performance. Taguchi method results show that the piezo film vibration sensor needs to be firmly clamped and the material of the sensing tip needs to be hard to record high fidelity pulse signals. The results show that the average NRMSE and R2 of the pulse recorder are 0.046 and 0.983, respectively, which indicate that the pulse tactile recorder could measure pulses with high accuracy and repeatability.
The focus of the present study was to design and objectively verify the pulsation recorder and player system. In the future, experienced TCM physicians and patients with different pulse features will be recruited to conduct a subjective clinical trial. In addition, other machine learning methods may be applied to further improve the reproduction performance of the pulse tactile player. A pulse tactile recorder and player system for multiple fingers will also be developed.

7. Conclusions

Human pulses contain much minuscule but important information. Trained TCM physicians and health care personnel are able to discern subtle pulse differences. Therefore, to realistically and accurately simulate human pulse tactile feedback, accurate pulsation measurement and display devices are needed. This study successfully developed a lightweight and portable pulse tactile recorder and player system. Users can interact with patients by using their natural pulse-taking behaviors and preferred palpation forces. After taking arbitrary pulses, the system can render the same pulse tactile feedback under the same palpation forces in real time. The system is expected to be used as a tool to train entry-level health care personnel and TCM physicians in taking and reading pulses.

Author Contributions

Conceptualization, T.-C.H., C.-M.W. and S.S.; methodology, T.-C.H., C.-M.W. and W.-C.L.; software, Y.-M.W.; experiments, T.-C.H., C.-M.W., C.-C.T. and W.-C.L.; data analysis, T.-C.H. and W.-C.L.; writing, T.-C.H., C.-M.W., W.-C.L. and S.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Science and Technology of Taiwan under contract MOST 108-2221-E-002-161-MY2.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of National Taiwan University.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data is available upon request from the authors.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lee, J.-Y.; Jang, M.; Shin, S.-H. Study on the depth, rate, shape, and strength of pulse with cardiovascular simulator. Evid. Based Complement. Altern. Med. 2017, 2017, 1–11. [Google Scholar] [CrossRef] [PubMed]
  2. Luo, C.-H.; Chung, C.-Y. Non-invasive holistic health measurements using pulse diagnosis: II. Exploring TCM clinical holistic diagnosis using an ingestion test. Eur. J. Integr. Med. 2016, 8, 926–931. [Google Scholar] [CrossRef]
  3. Tang, A.C.Y. Review of traditional Chinese medicine pulse diagnosis quantification. In Complementary Therapies for the Contemporary Healthcare; Saad, M., Medeiros, R.D., Eds.; IntechOpen: London, UK, 2012; pp. 61–80. [Google Scholar]
  4. Du, Y.-C.; Stephanus, A. Levenberg-marquardt neural network algorithm for degree of arteriovenous fistula stenosis classification using a dual optical photoplethysmography sensor. Sensors 2018, 18, 2322. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Guo, Q.-L.; Wang, K.-Q.; Zhang, D.-Y.; Li, N.-M. A wavelet packet based pulse waveform analysis for cholecystitis and nephrotic syndrome diagnosis. In Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition, Hong Kong, China, 30–31 August 2008; pp. 513–517. [Google Scholar]
  6. Liu, L.; Li, N.; Zuo, W.; Zhang, D.; Zhang, H. Multiscale sample entropy analysis of wrist pulse blood flow signal for disease diagnosis. In Proceedings of the Intelligent Science and Intelligent Data Engineering, Berlin/Heidelberg, Germany, 31 July–2 August 2013; pp. 475–482. [Google Scholar]
  7. Zhang, Z.; Zhang, Y.; Yao, L.; Song, H.; Kos, A. A sensor-based wrist pulse signal processing and lung cancer recognition. J. Biomed. Inform. 2018, 79, 107–116. [Google Scholar] [CrossRef]
  8. Suguna, G.; Veerabhadrappa, S. A review of wrist pulse analysis. Biomed. Res. 2019, 30, 538–545. [Google Scholar]
  9. Wang, Y.J.; Chen, C.H.; Sue, C.Y.; Lu, W.H.; Chiou, Y.H. Estimation of blood pressure in the radial artery using strain-based pulse wave and photoplethysmography sensors. Micromachines 2018, 9, 556. [Google Scholar] [CrossRef] [Green Version]
  10. Castaneda, D.; Esparza, A.; Ghamari, M.; Soltanpur, C.; Nazeran, H. A review on wearable photoplethysmography sensors and their potential future applications in health care. Int. J. Biosens. Bioelectron. 2018, 4, 195–202. [Google Scholar]
  11. Chu, Y.-W.; Luo, C.-H.; Chung, Y.-F.; Hu, C.-S.; Yeh, C.-C. Using an array sensor to determine differences in pulse diagnosis—Three positions and nine indicators. Eur. J. Integr. Med. 2014, 6, 516–523. [Google Scholar] [CrossRef]
  12. Tyan, C.C.; Liu, S.H.; Chen, J.Y.; Chen, J.J.; Liang, W.M. A novel noninvasive measurement technique for analyzing the pressure pulse waveform of the radial artery. IEEE Trans. Biomed. Eng. 2008, 55, 288–297. [Google Scholar] [CrossRef] [PubMed]
  13. Jin, C.; Xia, C.; Zhang, S.; Wang, L.; Wang, Y.; Yan, H. A wearable combined wrist pulse measurement system using airbags for pressurization. Sensors 2019, 19, 386. [Google Scholar] [CrossRef] [Green Version]
  14. Kaisti, M.; Panula, T.; Leppanen, J.; Punkkinen, R.; Jafari Tadi, M.; Vasankari, T.; Jaakkola, S.; Kiviniemi, T.; Airaksinen, J.; Kostiainen, P.; et al. Clinical assessment of a non-invasive wearable MEMS pressure sensor array for monitoring of arterial pulse waveform, heart rate and detection of atrial fibrillation. NPJ Digit. Med. 2019, 2, 39. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. He, D.; Zheng, L.; Liu, J.; Geng, N.; Dejun, G.; Xu, L. Variation of radial pulse wave contour influenced by contact pressure. In Proceedings of the 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC, Chicago, IL, USA, 26–30 August 2014; Volume 2014, pp. 5635–5638. [Google Scholar]
  16. Chen, C.; Li, Z.; Zhang, Y.; Zhang, S.; Hou, J.; Zhang, H. A 3D Wrist Pulse Signal Acquisition System for Width Information of Pulse Wave. Sensors 2019, 20, 11. [Google Scholar] [CrossRef] [Green Version]
  17. Nie, J.; Ji, M.; Chu, Y.; Meng, X.; Wang, Y.; Zhong, J.; Lin, L. Human pulses reveal health conditions by a piezoelectret sensor via the approximate entropy analysis. Nano Energy 2019, 58, 528–535. [Google Scholar] [CrossRef]
  18. Parikh, K.; Thakker, B. Wrist pulse classification system for healthy and unhealthy subjects. Int. J. Comput. Appl. 2015, 124, 1–5. [Google Scholar] [CrossRef]
  19. Sun, Y.; Dong, Y.; Gao, R.; Chu, Y.; Zhang, M.; Qian, X.; Wang, X. Wearable pulse wave monitoring system based on MEMS sensors. Micromachines 2018, 9, 90. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Li, J.Q.; Li, R.; Chen, Z.Z.; Deng, G.Q.; Wang, H.; Mavromoustakis, C.X.; Song, H.; Ming, Z. Design of a continuous blood pressure measurement system based on pulse wave and ECG signals. IEEE J. Transl. Eng. Health Med. 2018, 6, 1900114. [Google Scholar] [CrossRef] [PubMed]
  21. Li, B.N.; Fu, B.B.; Dong, M.C. Development of a mobile pulse waveform analyzer for cardiovascular health monitoring. Comput. Biol. Med. 2008, 38, 438–445. [Google Scholar] [CrossRef] [PubMed]
  22. Koo, J.-H.; Tantiyartyanontha, T.; Kim, Y.-M.; Kang, H.; Yang, T.-H. Application of magneto-rheological fluids for generating a wide range of radial pulse waveforms. Smart Mater. Struct. 2018, 27, 125010. [Google Scholar] [CrossRef]
  23. Yang, T.H.; Kim, J.U.; Kim, Y.M.; Koo, J.H.; Woo, S.Y. A new blood pulsation simulator platform incorporating cardiovascular physiology for evaluating radial pulse waveform. J. Healthc. Eng. 2019, 2019, 4938063. [Google Scholar] [CrossRef] [Green Version]
  24. Santos-Carreras, L.; Leuenberger, K.; Rétornaz, P.; Gassert, R.; Bleuler, H. Design and psychophysical evaluation of a tactile pulse display for teleoperated artery palpation. In Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 October 2010; Volume 2010, pp. 5060–5066. [Google Scholar]
  25. Yang, T.H.; Jo, G.; Koo, J.H.; Woo, S.Y.; Kim, J.U.; Kim, Y.M. A compact pulsatile simulator based on cam-follower mechanism for generating radial pulse waveforms. Biomed. Eng. Online 2019, 18, 1. [Google Scholar] [CrossRef] [Green Version]
  26. Wang, Q.-M.; Du, X.-H.; Xu, B.; Cross, L.E. Electromechanical coupling and output efficiency of piezoelectric bending actuators. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 1999, 46, 638–646. [Google Scholar] [CrossRef]
  27. Zhou, H.; Henson, B.; Bell, A.; Blackwood, A.; Beck, A.; Burn, R. Linear piezo-actuator and its applications. In Proceedings of the 5th International Conference on Frontiers of Design and Manufacturing (ICFDM’2002), Dalian, China, 10–12 July 2002; pp. 16–20. [Google Scholar]
  28. Shahabi, P.; Ghafarirad, H.; Taghvaeipour, A. Nonlinear vibration analysis of piezoelectric bending actuators: Theoretical and experimental studies. Comptes Rendus Mécanique 2019, 347, 953–966. [Google Scholar] [CrossRef]
  29. Yocum, M.; Abramovich, H. Static behavior of piezoelectric actuated beams. Comput. Struct. 2002, 80, 1797–1808. [Google Scholar] [CrossRef]
  30. Huang, C.-H.; Wang, Y.-M.; Smith, S. Using high-dimensional features for high-accuracy pulse diagnosis. Math. Biosci. Eng. 2020, 17, 6775–6790. [Google Scholar] [CrossRef] [PubMed]
  31. Nyquist, H. Certain topics in telegraph transmission theory. Trans. Am. Inst. Electr. Eng. 1928, 47, 617–644. [Google Scholar] [CrossRef]
  32. Chang, H.; Chen, J.; Liu, Y. Micro-piezoelectric pulse diagnoser and frequency domain analysis of human pulse signals. J. Tradit. Chin. Med. Sci. 2018, 5, 35–42. [Google Scholar] [CrossRef]
  33. Çelik, E.; Uzun, Y.; Kurt, E.; Öztürk, N.; Topaloğlu, N. A neural network design for the estimation of nonlinear behavior of a magnetically-excited piezoelectric harvester. J. Electron. Mater. 2018, 47, 4412–4420. [Google Scholar] [CrossRef]
  34. Huang, N.; Shen, Z.; Long, S.R.; Wu, M.L.C.; Shih, H.H.; Zheng, Q.; Yen, N.C.; Tung, C.-C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
  35. Huang, N.E.; Wu, Z. A review on Hilbert-Huang transform: Method and its applications to geophysical studies. Rev. Geophys. 2008, 46. [Google Scholar] [CrossRef] [Green Version]
  36. Motin, M.A.; Karmakar, C.K.; Palaniswami, M. Selection of empirical mode decomposition techniques for extracting breathing rate From PPG. IEEE Signal. Process. Lett. 2019, 26, 592–596. [Google Scholar] [CrossRef]
  37. Pittara, M.; Orphanidou, C. Robust estimation of pulse rate from a wrist-type PPG during intensive exercise. In Proceedings of the 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA, 18–21 July 2018; Volume 2018, pp. 5515–5518. [Google Scholar]
  38. Liu, Y.; Sun, X.; Sun, Y.; Zhang, K.; Hong, Y.; Wei, B. A pulse wave based blood pressure monitoring and analysis algorithm. In Proceedings of the Artificial Intelligence, Singapore, 8–10 April 2018; pp. 211–221. [Google Scholar]
  39. Guo, Z.; Zhao, W.; Lu, H.; Wang, J. Multi-step forecasting for wind speed using a modified EMD-based artificial neural network model. Renew. Energy 2012, 37, 241–249. [Google Scholar] [CrossRef]
  40. Yu, L.; Wang, S.; Lai, K.K. Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm. Energy Econ. 2008, 30, 2623–2635. [Google Scholar] [CrossRef]
  41. Gai, G. The processing of rotor startup signals based on empirical mode decomposition. Mech. Syst. Signal. Process. 2006, 20, 222–235. [Google Scholar] [CrossRef]
  42. Manjula, M.; Sarma, A.V.R.S. Comparison of empirical mode decomposition and wavelet based classification of power quality events. Energy Procedia 2012, 14, 1156–1162. [Google Scholar] [CrossRef] [Green Version]
  43. Wang, G.; Chen, X.; Qiao, F.-L.; Wu, Z.; Huang, N. On intrinsic mode function. Adv. Adapt. Data Anal. 2010, 2, 277–293. [Google Scholar] [CrossRef]
Figure 1. Section view of the pulse tactile recorder.
Figure 1. Section view of the pulse tactile recorder.
Sensors 21 04339 g001
Figure 2. Use of the pulse tactile recorder to take pulses at the Cun, Guan, and Chi points (left). Top (upper right) and bottom (lower right) views of the recorder.
Figure 2. Use of the pulse tactile recorder to take pulses at the Cun, Guan, and Chi points (left). Top (upper right) and bottom (lower right) views of the recorder.
Sensors 21 04339 g002
Figure 3. Pulse signals with (a) light (0.78 N); (b) moderate (1.18 N); and (c) heavy (1.76 N) pressure at the Guan point on the left wrist.
Figure 3. Pulse signals with (a) light (0.78 N); (b) moderate (1.18 N); and (c) heavy (1.76 N) pressure at the Guan point on the left wrist.
Sensors 21 04339 g003
Figure 4. Pulse verification mechanism.
Figure 4. Pulse verification mechanism.
Sensors 21 04339 g004
Figure 5. Cam profile is linear with the integral of the recorded signals. (a) Cam profile signals recorded by the pulse tactile recorder. (b) Comparison of the cam profile and the integral of the recorded signals.
Figure 5. Cam profile is linear with the integral of the recorded signals. (a) Cam profile signals recorded by the pulse tactile recorder. (b) Comparison of the cam profile and the integral of the recorded signals.
Sensors 21 04339 g005
Figure 6. Integrals of the recorded pulse signals in Figure 3. Pulse waveforms of (a) light, (b) moderate, and (c) heavy forces.
Figure 6. Integrals of the recorded pulse signals in Figure 3. Pulse waveforms of (a) light, (b) moderate, and (c) heavy forces.
Sensors 21 04339 g006
Figure 7. Actuating part of the pulse tactile player.
Figure 7. Actuating part of the pulse tactile player.
Sensors 21 04339 g007
Figure 8. Complete unit of the pulse tactile player. (a) Without a silicon skin. (b) With a silicon skin.
Figure 8. Complete unit of the pulse tactile player. (a) Without a silicon skin. (b) With a silicon skin.
Sensors 21 04339 g008
Figure 9. System block diagram of the control unit of the pulse tactile player.
Figure 9. System block diagram of the control unit of the pulse tactile player.
Sensors 21 04339 g009
Figure 10. Data acquisition and verification mechanism.
Figure 10. Data acquisition and verification mechanism.
Sensors 21 04339 g010
Figure 11. Flowchart of the ANN training data collection process.
Figure 11. Flowchart of the ANN training data collection process.
Sensors 21 04339 g011
Figure 12. Decomposition of a pulse waveform into seven IMFs and one residue. (a) Pulse waveform. (b) IMF 1, (c) IMF 2, (d) IMF 3, (e) IMF 4, (f) IMF 5, (g) IMF 6, (h) IMF 7, and (i) residue.
Figure 12. Decomposition of a pulse waveform into seven IMFs and one residue. (a) Pulse waveform. (b) IMF 1, (c) IMF 2, (d) IMF 3, (e) IMF 4, (f) IMF 5, (g) IMF 6, (h) IMF 7, and (i) residue.
Sensors 21 04339 g012aSensors 21 04339 g012b
Figure 13. Pulse reproduction flowchart.
Figure 13. Pulse reproduction flowchart.
Sensors 21 04339 g013
Table 1. Factors and levels used in the Taguchi method.
Table 1. Factors and levels used in the Taguchi method.
Factor Level
123
Height of the sensing tip5 mm4 mm3 mm
Thickness of the hollow spacer between FSR and PVDF3 mm1 mm2 mm
Number of clamping sides24
Material of the sensing tipPLASilicon
Table 2. Taguchi method experiment results.
Table 2. Taguchi method experiment results.
ExperimentFactor Level (ABCD)R2Normalized
Peak Voltage
Score
111110.980.651.63
212220.970.431.4
313210.9711.97
421210.940.631.57
522110.910.571.48
623120.930.561.49
731220.920.491.41
832120.930.351.28
933210.950.831.78
Table 3. Comparison between the integral of the recorded signals and original cam waveform.
Table 3. Comparison between the integral of the recorded signals and original cam waveform.
No.NRMSER2
10.0490.984
20.0510.983
30.0520.983
40.0510.984
50.0510.983
60.0390.984
70.0420.983
80.0420.982
90.0420.983
100.0420.983
Average0.0460.983
S.D.0.0050.001
Table 4. NRMSE of the linear model.
Table 4. NRMSE of the linear model.
Subject No.ForceAverage
LightModerateHeavy
10.7850.6690.1400.531
20.7870.6300.1410.519
31.0660.7230.1060.632
41.1520.6420.1070.634
51.2570.6670.1080.677
60.7710.6670.1030.514
70.7970.6520.1250.525
80.8270.6970.1190.548
Average0.9300.6680.1190.572
S.D.0.1960.0300.0150.065
Table 5. R-squared values of the linear model.
Table 5. R-squared values of the linear model.
Subject No.ForceAverage
LightModerateHeavy
10.9420.9130.8330.896
20.9410.9080.9550.935
30.8970.9280.9110.912
40.9400.9220.9290.930
50.8970.9210.9530.924
60.9440.9230.8850.917
70.9270.8370.9550.907
80.8820.9090.9100.900
Average0.9210.9080.9170.915
S.D.0.0250.0290.0420.014
Table 6. NRMSEs of the ANN training results.
Table 6. NRMSEs of the ANN training results.
IMFNRMSE
LightModerateHeavy
10.0450.0250.027
20.0770.0230.025
30.1190.0840.085
40.1300.1050.115
50.1210.0690.088
60.1060.0120.060
70.1130.0910.104
Table 7. NRMSE of the ANN models.
Table 7. NRMSE of the ANN models.
Subject No.ForceAverage
LightModerateHeavy
10.1000.0850.0670.084
20.0470.0640.0630.058
30.0540.0820.0580.064
40.0670.0550.0700.064
50.0480.0650.0520.055
60.0690.0540.0600.061
70.0570.0660.0660.063
80.0590.0870.0770.074
Average0.0620.0700.0640.065
S.D.0.0170.0130.0080.009
Table 8. R-squared values of the ANN models.
Table 8. R-squared values of the ANN models.
Subject No.ForceAverage
LightModerateHeavy
10.9560.9840.9780.973
20.8870.9270.9680.928
30.910.980.9580.95
40.9760.990.9660.977
50.9680.9880.9640.974
60.9560.980.9550.964
70.9680.9720.910.95
80.9310.9390.9660.945
Average0.9440.970.9580.958
S.D.0.03170.02370.02060.0172
Table 9. p-values between the linear model and the ANN models.
Table 9. p-values between the linear model and the ANN models.
Pressure
LightModerateHeavyAll
NRMSE0.0000.0000.0000.000
R-SQUARED0.1340.0000.0250.000
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hsieh, T.-C.; Wu, C.-M.; Tsai, C.-C.; Lo, W.-C.; Wang, Y.-M.; Smith, S. Portable Interactive Pulse Tactile Recorder and Player System. Sensors 2021, 21, 4339. https://doi.org/10.3390/s21134339

AMA Style

Hsieh T-C, Wu C-M, Tsai C-C, Lo W-C, Wang Y-M, Smith S. Portable Interactive Pulse Tactile Recorder and Player System. Sensors. 2021; 21(13):4339. https://doi.org/10.3390/s21134339

Chicago/Turabian Style

Hsieh, Tzu-Chieh, Chien-Min Wu, Cheng-Chung Tsai, Wen-Chien Lo, Yu-Min Wang, and Shana Smith. 2021. "Portable Interactive Pulse Tactile Recorder and Player System" Sensors 21, no. 13: 4339. https://doi.org/10.3390/s21134339

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop