Embodied Emotion Recognition Based on Life-Logging

Embodied emotion is associated with interaction among a person’s physiological responses, behavioral patterns, and environmental factors. However, most methods for determining embodied emotion has been considered on only fragmentary independent variables and not their inter-connectivity. This study suggests a method for determining the embodied emotion considering interactions among three factors: the physiological response, behavioral patterns, and an environmental factor based on life-logging. The physiological response was analyzed as heart rate variability (HRV) variables. The behavioral pattern was calculated from features of Global Positioning System (GPS) locations that indicate spatiotemporal property. The environmental factor was analyzed as the ambient noise, which is an external stimulus. These data were mapped with the emotion of that time. The emotion was evaluated on a seven-point scale for arousal level and valence level according to Russell’s model of emotion. These data were collected from 79 participants in daily life for two weeks. Their relationships among data were analyzed by the multiple regression analysis, after pre-processing the respective data. As a result, significant differences between the arousal level and valence level of emotion were observed based on their relations. The contributions of this study can be summarized as follows: (1) The emotion was recognized in real-life for a more practical application; (2) distinguishing the interactions that determine the levels of arousal and positive emotion by analyzing relationships of individuals’ life-log data. Through this, it was verified that emotion can be changed according to the interaction among the three factors, which was overlooked in previous emotion recognition.


Introduction
The theory of the embodied mind has recently emphasized that emotion should be conceptualized as being operated by the inter-connectivity of the body, the behavior, and the environment because the intrinsic function of the emotion is for its adaptive survival in the environment [1,2]. Human physiological changes and behaviors have been dependent with the environment, and the interactions between them is a mechanism to cope with the environment [3]. Most scholars have agreed that there are correlations among the physiological response, behavior, and environment. Nevertheless, emotion has been recognized by fragmentary independent variables without consideration of the relationships among the three main factors. These are, the physiological response, behavior, and environmental factors. Therefore, it has been primitive that a heuristic understanding of the embodied emotion is missing connections among the three main factors. Moreover, the embodied emotions recognized in the laboratory have been difficult to apply to real life, due to its limitation, compared to the experiences in a complex, real-life environment. Ecological validity has been undermined by recognizing emotion in laboratory settings. Emotional expressions tend to be reduced due to social desirability [4]. Therefore, a field study is necessary to test the feasibility that emotional factors measured in laboratory settings are applicable in real environment [5][6][7]. Field studies of emotion recognition have tried to collect data and measure emotion using wearable sensors or smartphone [4, 8,9]. Life-logging applications particularly hold for investigations conducted in the field. An increased use of wearable devices and self-tracking behaviors has been highlighted [10]. Life-logging is the process of automatically recording an aspects of one's life in digital form [11]. They have mainly measured autonomic nervous system (ANS) for analyzing the physiological response in daily life [12][13][14][15][16][17]. The ANS included activities of sympathetic and parasympathetic nervous system, which has been measured by the responses of cardiovascular, respiratory, and electrodermal [18,19]. In particular, the photoplethysmoogram (PPG) has been increasingly measured from portable devices according to the commercialization of wearable devices, such as smart watches [14,16]. Therefore, the PPG signal is attracting attention as a measure of ANS that can be measured in daily life.
Behavioral patterns associated with emotions have based on individual's own mobility patterns in life-logging studies. Stress and depression have been correlated with smaller variation of mobility [20,21]. The individual's own movement patterns can be measured by the global positioning system (GPS) [21,22]. The GPS can be easily measured with sensors built into the smartphone. Emotions have been inherent in physiological mechanisms to adapt to environment [23]. Therefore, emotions have been affected by environmental factors.
The environment changes the physiological responses and human behavior according to emotions, and vice versa [24]. It also affects emotions. Embodied emotions are highly related to the environmental factors, such as sound [25,26] and exposure to ambient noise in daily life has been reported to affect negative emotions and arousal [27][28][29]. Louder or long-lasting noise has been reported to negatively impact emotion. Also, uncontrollable noise has been reported to have more emotional impact. On the other hand, there were the results that the white noise had a positive effect [30,31]. Schuller et al. [32] suggested that arousal is highly correlated with loudness and valence is negative correlated with spectral flux and spectral harmonicity. The arousal and valence levels are the dimension of the Russell's emotional model [33]. These results indicate that ambient noise gives physical and emotional impact on humans and it could be one of the factors to induce emotions. Moreover, field studies of real-time noise monitoring suggested that environmental noise can be measured using smartphones [34][35][36]. Therefore, it can be easily measured in life-logging.
Despite the proposed application of emotion recognition in real-life, there is still little research, which is often overlooked for emotion recognition in real-time, by considering three factors. Therefore, this study attempts to recognize the emotions of the interactions of the three factors in real-life: Physiological responses by measuring PPG, behavior by measuring GPS, and the ambient noise as an environmental factor by measuring sound. The contributions of this study can be summarized as follows: (1) The emotion was recognized in real-life for more practical applications; (2) the proposed method analyzed the interactions of more causes of emotional determination compared with the previous emotion recognition method that employs fewer factors.

Hypothesis
This study hypothesized that the interactions among the physiological response, the behavioral pattern, and the ambient noise would differ in the emotional arousal and valence.

Participant
Seventy-nine participants (35 males) without cardiovascular disease were selected by convenience sampling. Their average age was 23(±3). Everyone was given a detailed explanation and provided consent before the field test. Participants were compensated ($140.38) for their role in the field test.

Data Collection
Data were collected from a field test and not in a usual laboratory environment to ensure the authenticity of the physical experience and environmental factors of daily life. Seventy-nine participants were a part of this field test, which lasted 5 h, every day for 2 weeks, including the weekends. They were given a wearable device and received guidance for the smartphone application developed for this field test. The participants were asked to wear their devices by connecting it to their smartphones throughout the field test. They wore the device throughout the fixed time from 12 pm to 6 pm daily. These 5 h may be a working time or a rest time depending on the participant, but only the people who agreed to continue to measure data during this time participated in the experiment. A notification function in the application was developed to ensure that measurements are taken continuously throughout the experiment without missing data. The application sent a notification to the researcher when there was a lost connection with the sensor or data was not measured for a certain period. If the researcher received the notification from the application, the researcher asked the participant to continuously measure the data via messenger. The collected data consisted of physiological and behavioral responses based on photoplethysmogram, global positioning system location, along with environmental factors based on ambient noise. Physiological responses were separately measured with the wearable device, and the behavioral along with environmental factors were measured with the GPS sensor and microphone embedded in the smartphone, respectively. To avoid disturbing daily activities as much as possible, the wireless PPG sensor, which can be measured with one finger, was worn on the infrequently used hand (mostly left hand) as shown in Figure 1. Also, the data from GPS and the surrounding environment were automatically collected by using the smartphone that the participants always possesses during daily activities. It provided convenience for the participants. The participants only had to connect the application and the sensor at the start of the experiment to collect data.

Recording and Signal Processing
The PPG signals were recorded between 50 and 90 Hz sampling rate with the wireless PPG sensing system (Emotion Science Research Center Inc., Seoul, Korea). Zero-padding and cubic spline interpolation were applicated to stabilize the sampling rate of data to 80 Hz. After the interpolation, Only the frequency components between 0.75 and 2.5 Hz corresponding to the ranges between 50 bpm and 150 bpm, respectively, were extracted by the Butterworth bandpass filter for noise cancelation. The peak was detected in the PPG raw signal by the peak detection algorithm. The peak Participants received an emotional assessment request from the application on time every hour. They answered two emotional questions about how arousal and how pleasant by assessing their overall emotional state during the previous hour, based on the point of emotional evaluation. These two questions are based on two independent dimensions, the arousal axis, and the valence axis, Sensors 2019, 19, 5308 4 of 25 which constitute emotion in Russell's two-dimensional circumplex model [33]. Russell's model is one of the most representative emotional models and has been evaluated on a seven-point Likert scale when rating arousal and valence levels in other emotional assessment studies [37][38][39][40][41][42]. Therefore, in this study, participants self-reported their emotions on a seven-point scale. Specifically, the participant checked one of the radio buttons from 1 to 7 points in the application and clicked the submit button. As with other data, if a subject did not respond to an emotional assessment, the application detected it and alerted the investigator. When the investigator received such an alert, the investigator asked the subject to evaluate the emotion. This experimental procedure was approved by the Institutional Review Board of the Sangmyung University, Seoul, Korea (BE2017-22).

Recording and Signal Processing
The PPG signals were recorded between 50 and 90 Hz sampling rate with the wireless PPG sensing system (Emotion Science Research Center Inc., Seoul, Korea). Zero-padding and cubic spline interpolation were applicated to stabilize the sampling rate of data to 80 Hz. After the interpolation, Only the frequency components between 0.75 and 2.5 Hz corresponding to the ranges between 50 bpm and 150 bpm, respectively, were extracted by the Butterworth bandpass filter for noise cancelation. The peak was detected in the PPG raw signal by the peak detection algorithm. The peak to peak interval (PPI), which is the interval between detected peaks, was calculated by detecting the dominant frequency by Fast Fourier Transformation (FFT), while sliding the raw data signal accumulated for 120 s at intervals of 1 s.

HRV Analysis in Time Domain
Beat per minute (BPM) was calculated by dividing the window size of 60 s with the peak to peak interval (PPI) as: where N was the number of raw PPG signal samples. All variables of the heart rate variability (HRV) were calculated by HRV analysis with the window size of 180 s and interval size of 60 s. The mean of the standard deviation (SDNN) of all PPI for all 3-min segments of the entire recording was calculated as: where SD(PPI) is a standard deviation of PPI. The root mean square of differences between adjacent PPI (RMSSD) was calculated as: The proportion derived by dividing the number of interval differences of PPI greater than 50 ms by the total number of PPI (pNN50) as: where NN50 count is number of PPI greater than 50ms and total NN count is the total number of PPI.

HRV Analysis in Frequency Domain
Very low frequency (VLF) which is the power in the frequency range of 0.0033-0.4 Hz was analyzed as an indicator of sympathetic activity as: where Power is the power spectrum analyzed PPI by FFT and d f is frequency resolution. Low frequency (LF) which is the power in the frequency range of 0.04-0.15 Hz was analyzed as an indicator of both the sympathetic and the parasympathetic activity as: High frequency (HF) which is the power in the frequency range of 0.15-0.4 Hz was analyzed as an indicator of parasympathetic activity as: The VLF, LF, and HF components were also analyzed as percentage and normalized values, respectively. The percentage of each variable were calculated by dividing each variable by the total power. Total power is a band of power spectrum range between 0.0033 and 0.4 Hz as: VLF(%) is VLF divided by the total power as: LF(%) is LF divided by the total power as: HF(%) is HF divided by the total power as: The normalized variables were calculated by natural logarithm of VLF, LF, and HF. lnVLF is natural logarithm of VLF as: where ln is natural logarithm. lnLF is natural logarithm of LF as: lnHF is natural logarithm of HF as: lnHF = ln(HF).
Sensors 2019, 19, 5308 6 of 25 VLF, LF, and HF were also calculated as ratios such as LF/HF ratio, VLF/HF ratio. The LF/HF ratio and VLF/HF ratio represent homeostasis of the sympathetic and parasympathetic activity [43] as: Peak power is the band of power spectrum range between −0.015 and 0.015 Hz based on peak Hz. The peak power is an indicator of homeostasis [43] as: Peak Hz is a hertz of highest peak in power spectrum range of 0.04-0.26 Hz as: Coherence ratio is the peak power divided by difference of total power and peak power which is indicator of the emotional stability [43] as: Dominant power is a power of highest peak in total power spectrum range of 0-0.5 Hz as: Dominant Hz is a hertz of highest peak in total power spectrum range of 0-0.5 Hz as:

Measurement of Behavior Patterns by Analyzing GPS Location
GPS locations were measured in two states: Stationary and transition state. The GPS locations were classified into a stationary state or transition state were defined based on a distance by K-Means algorithm. The GPS location in the stationary state were calculated when the latitude and longitude have changed by less than 1 km per hour, and the GPS locations in the transition state were considered only more than 1 km per hour [21]. The six variables of behavioral patterns were defined by analyzing the GPS locations accumulated for 10 min at intervals of 1 min. Location Variance is the variability in a participant's GPS location which is calculated by logarithm of sum of squares of latitude and longitude as, where σ lat 2 is a sum of squares of latitude and σ lat 2 is a sum of longitude. Number of Clusters is the number of location clusters found by the k-means algorithm. Entropy is a variability of the time spent at the location clusters as, where i was the location cluster, N was the number of clusters, and p i was the ratio of the time spent in the clusters. Circadian Movement is the regularity of moving pattern in daily life as, where f was a bin in frequency domain analyzed from GPS locations by least-squares spectral analysis, N was the number of frequency bins corresponding to 24-h periods, i was the index of frequency bin, and psd( f i ) was the power spectral density at frequency bin f i . The logarithm was applied to correct the skewed distribution. Transition Time is the percentage of time during which a participant was in the non-stationary state. Total Distance is accumulation of distances between the location samples in kilometers taken by a participant as, where i was the GPS location, and N was the total number of GPS locations, and 111.19 was the constant for unit conversion from miles to kilometers.

Measurement of Environmental Factors by Analyzing Ambient Noise
The environmental factors based on ambient noise were analyzed by raw sound signals. The raw signals of ambient noise were recorded every second while accumulated for 5 s. The analyzed features of raw signals were classified with volume and frequency components which are sound amplitude and sound frequency. The sound amplitude was analyzed by averaging the measured the raw signal for 1 min as, where Amplitude is amplitude of ambient noise, and m is a window size. The sound frequency was analyzed by dominant power spectrum in frequency domain.

Statistical Analysis
The relationships among the physiological response, the behavioral pattern, and the ambient noise, based on emotion, were analyzed in the following three steps. First, the pre-processing step that interpolates and normalizes data samples. In the second step, the correlations, between the 31 variables measured the physiological response, the behavioral pattern, and the ambient noise, which are analyzed by the multiple regression. Finally, the hypothesis of this study, which is that significant relationships, resulting from multiple regression, differ depending on the emotions, is verified by ANOVA. Since the above variables have different criteria, data interpolation and standardization were performed to compare among the variables. The data were interpolated by averaging the data and standardized by z-score. After data preprocessing, a multiple regression model was constructed by setting one of the above 31 variables as the dependent variable and the remaining 30 variables as independent variables. The same procedure was repeated for all variables that were not set as dependent variables.
Correlations between the dependent variable and independent variables were analyzed by multiple regression. Multiple regression analysis is convenient to analyze multiple independent variables for a dependent variable. In order to derive a significant correlation between the dependent variable and independent variables by multiple regression, the following constraints should be checked. The multi-collinearity means that there is a strong correlation among independent variables. The independent variables which have multi-collinearity should have been removed to prevent error. In order to this constraint, the variance inflation factor (VIF) which is an indicator of multicollinearity was checked that is less than 10. The second, autocorrelation was tested by Durbin-Watson statistics. The autocorrelation indicates a strong correlation among dependent variables. It was verified that there was not the autocorrelation since the Durbin-Watson statistics were more than 1 and less than 3. Third, the normality and homogeneity of the residuals were tested by the Kolmogorov-Smirnov test (p > 0.1) and Breusch-Pagan (p > 0.05). All assumptions for multiple regression were satisfied, therefore, this study analyzed the multiple regression models. Finally, the existence of any significant independent variable, which affect a dependent variable, was verified (p < 0.05). The suitability of the regression model was verified by the adjusted r-squared, which is more than 0.6. The standardized coefficients (β) obtained as a result of multiple regression are indicators of the influence of each independent variable on the dependent variable.
The standardized coefficients for each person were stored in matrix form as shown in Figure 2. Then, the subjective emotion labels were mapped to the standardized coefficients matrix to form a data structure for ANOVA as shown in Figure 3. The emotion labels indicate the subjective questionnaire score, which is evaluated as seven points for two emotion questionnaires of arousal level and valence level. Samples that were analyzed 79 participants of standardized coefficient data mapped with emotional labels were analyzed for differences between arousal levels or valence levels respectively by ANOVA.

Results
Significant correlations among the physiological responses, the behavioral patterns, and the ambient noise were analyzed by multiple regression for two weeks of data samples of 79 participants'. An example of multiple regression results is shown in Table 1. The significant correlations derived from the multiple regression were analyzed by ANOVA. This analysis analyzed the difference between correlations depending on emotion levels. Specifically, we confirmed whether the standardized coefficients obtained through the multiple regression analysis were different according to the three emotion levels. The emotion was analyzed at the relevant time when a significant correlation was analyzed on the basis of the subjective emotion recorded from the participants. The emotion was recorded on seven-point scales according to the level of arousal, and

Results
Significant correlations among the physiological responses, the behavioral patterns, and the ambient noise were analyzed by multiple regression for two weeks of data samples of 79 participants'. An example of multiple regression results is shown in Table 1. The significant correlations derived from the multiple regression were analyzed by ANOVA. This analysis analyzed the difference between correlations depending on emotion levels. Specifically, we confirmed whether the standardized coefficients obtained through the multiple regression analysis were different according to the three emotion levels. The emotion was analyzed at the relevant time when a significant correlation was analyzed on the basis of the subjective emotion recorded from the participants. The emotion was recorded on seven-point scales according to the level of arousal, and valence, respectively. The level of arousal was classified into three levels based on the median of the assessment. The data larger than the median (5-7 points) were classified as arousal, the median (4-point) was neutral, and the data smaller than the average (1-3 points) were classified as relaxation. Likewise, 5-7 points of valence scores were classified into positive emotion, the median value (4-point) was into neutral, and 1-3 points were into negative emotion. The number of samples by arousal level was 1907 arousal samples, 1699 neutral, and 777 relaxation, respectively. While, 2300 samples were rated positive emotion, 1098 neutral, and 985 negative emotion. Specific descriptive statistics on mean and standard deviation of the standardized coefficients were presented according to the levels of arousal in Table 2. Descriptive statistics of the standardized coefficients according to the levels of valence were described in Table 3. Table 1. An example of the significant causalities analyzed by multiple regression among two weeks data for 79 participants. All assumptions of multiple regression were satisfied. There was no autocorrelation in the residuals (Durbin-Watson value = 2.264). Normality of residuals was satisfied (p-value of Kolmogorov-Smirnov test = 0.728). Homeogeneity of residuals was satisfied (p-value of Breusch-Pagan test = 0.499). Multiple regression was run to predict lnHF from location variance, circadian movement, transition time, total distance, total distance, pNN50, peak hz, and coherence ratio. Only those variables which were not affected by multicollinearity were entered in the multiple-regression (VIF < 10). A significant regression equation was found (F(25, 34)   The significant result of statistics that distinguish the three levels of arousal were presented in Tables 4-21. The significant result of ANOVA (i.e., p < 0.05 in the ANOVA row in the tables) indicates that there is more than one pair of differences among the three levels of emotions. However, this result does not indicate which pair is significant. Therefore, the pairs (arousal-neutral, neutral-relaxation, and arousal-relaxation) that show significant differences should be analyzed. This analysis has been commonly referred to as post-hoc analysis. In this study, an independent t-test was used which is a general method of analyzing the difference between two levels (i.e., p < 0.05 in the T-test row in the tables). This paper presents only the results of the significant differences between all pairs (all emotions). The correlations varied depending on the level of arousal were divided into the relationships within physiological or environmental variables, the relationships between the physiological and behavioral variables, and between the physiological and the environmental variables (Figure 4). There were many correlations between physiological variables, especially variables such as pNN50, SDNN, lnHF, Dominant Power, Dominant Hz, Peak Hz and Coherence ratio. The relationships between physiological and behavioral variables, which differed according to the level of arousal, were correlations between lnHF and Entropy, lnHF and Circadian Movement, Dominant Hz and Transition Time, and Dominant Hz and Total Distance. The relationships between physiological and environmental variables, which differed according to the level of arousal, were correlations between RMSSD and Sound Amplitude, and Dominant Hz and Sound Frequency. There was a correlation between sound amplitude and sound frequency. There was no correlation between the behavioral variables.  Table 9. Results of one-way ANOVA show a significant difference between Arousal-Neutral-Relaxation among variables correlated with LF(%) analyzed by multiple regression. The difference between the two emotion levels was verified by independent t-test.  Table 18. Results of one-way ANOVA show a significant difference between Arousal-Neutral-Relaxation among variables correlated with Entropy analyzed by multiple regression. The difference between the two emotion levels was verified by independent t-test.  Table 21. Results of one-way ANOVA show a significant difference between Arousal-Neutral-Relaxation among variables correlated with Sound Frequency analyzed by multiple regression. The difference between the two emotion levels was verified by independent t-test. Significant correlations and the statistics which distinguish the three levels of valence were presented in Tables 22-32. Correlations that varied according to the level of valence were classified into the relationships within physiological variables, the relationships between the physiological and behavioral variables, the physiological and environmental variables, and between the behavioral and the environmental variables ( Figure 5). There were fewer relationships within the physiological variables in the result of valence than the result of the arousal. The relationship between physiological and behavioral variables was only significant between peak power and total distance. The significant correlations between physiological and environmental variables were VLF/HF ratio and Sound Amplitude, and the relationship between Dominant Hz and Sound Frequency.  Significant correlations and the statistics which distinguish the three levels of valence were presented in Table 22~Table 32. Correlations that varied according to the level of valence were classified into the relationships within physiological variables, the relationships between the physiological and behavioral variables, the physiological and environmental variables, and between the behavioral and the environmental variables ( Figure 5). There were fewer relationships within the physiological variables in the result of valence than the result of the arousal. The relationship between physiological and behavioral variables was only significant between peak power and total distance. The significant correlations between physiological and environmental variables were VLF / HF ratio and Sound Amplitude, and the relationship between Dominant Hz and Sound Frequency.

Discussion and Conclusions
The embodied emotion has differed from the previous view of emotion and it has importantly considered interactions among body, behavior, and environment. Therefore, this study was to recognize the embodied emotion by analyzing correlations among physiological changes, behavior, and environment. The physiological responses were determined by cardiovascular responses in this study. The autonomic nervous system (ANS) has been monitored to recognize emotions in many previous studies [44][45][46]. The behavioral patterns of individuals were determined by features, which were analyzed by GPS (global positioning system) locations, according to suppose that lifestyle patterns were associated with emotion [21]. The amplitude and frequency components of ambient sound were considered as the environmental factors, based on environmental factors, particularly ambient sound, which has been related to emotion and physiological arousal in daily life [25,26].
This study verified that there were differences between interactions that determine the arousal and valence in emotion by analyzing an individual's life-log data. There were more connections between the physiological variables in the result of arousal (Figure 4) than the valence results ( Figure 5). In addition, there was no direct connection between behavioral and environmental variables, while both behavioral and environmental variables were associated with physiological variables, as shown in Figure 4. These relationships between physiological and behavioral variables were also more pronounced in the arousal than the valence. These results showed that the autonomic nervous system response has been highly related to physiological arousal [47][48][49][50]. Coherence ratio, an indicator of physiological coherence, has been associated with VLF, LF, an indicator of sympathetic activation, and VLF (%), an indicator of parasympathetic activation. This was consistent with previous theories that physiological coherence has been determined by the way the sympathetic and parasympathetic nerves have been controlled [51]. In addition, lnHF, another indicator of parasympathetic activity, was linked to dominant rhythms (Dominant Power, Dominant Hz) in cardiac activity, which were also connected to the Coherence ratio. This suggests that cardiac activity varies with the degree of activation of parasympathetic nerves and which might be associated with physiological coherence. This association between the autonomic nervous system and physiological coherence was also connected with the indicators of the regularity of life patterns (Entropy, Circadian Movement) and movement patterns (Transition Time, Total Distance). These results suggested that the physiological homeostasis coincides with the behavioral homeostasis according to the polyvagal theory [51,52]. The relationships between physiological variables and ambient noise (Sound Amplitude and Sound Frequency) were consistent with the results that ambient noise has been related to the arousal in the previous studies [25,26].
The relationships among the physiological, behavioral, and environmental variables were more systemic in the result of valence, as shown in Figure 5. It means that there was a connection between the body-behavior-environment in the valence results, compared with arousal results that the behavioral and environmental variables were only connected to physiological variables, respectively. It seems that the conscious and cognitive judgment processes have been necessary to determine the valence level of emotion compared with the arousal level of emotion, which is determined by unconscious and autonomic physiological control [53].
In summary, the arousal levels of embodied emotion were represented by the more prominent interactions with physiological responses, while the valence levels were represented as a balanced relationship among the physiological, behavioral, and environmental variables. These results suggested that the arousal level is an indicator of the regulation of behavioral and physiological homeostasis to cope with the environment, while the valence level indicates the process of cognitive judgment, taking into consideration the environment and behavior. However, because this study was a field test, the experimental controls were less stringent than the laboratory studies. It might be necessary to remove the device, such as when washing hands, in which case, the researchers may not have detected it. Also, cross-validation of these results should be necessary to feasibility and consistency as this study analyzed the data for two weeks for 79 participants for the twenties. Therefore, additional studies should be supported to ensure reproducibility. Nevertheless, this study is valuable because it analyzed practical data. Further, this study serves as an indicator of interpretations, which proves useful in recognizing embodied emotion based on the life-log data in deep-learning or machine-learning.