chapter 5 analyses of heart rate signals using neuro fuzzy...

21
146 CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY TECHNIQUE 5.1 INTRODUCTION In this chapter, the analysis of heart rate variability using neuro fuzzy technique for mental stress assessment. The activity of the ANS is studied by means of time-frequency analysis of the HRV signal. Spectral decomposition of the Heart Rate Variability before smoking and after smoking was obtained. Mental stress is accompanied by dynamic changes in ANS activity. HRV analysis is a popular tool for assessing the activities of autonomic nervous system. The approach consists of 1) Monitoring of heart rate signals, 2) Signal processing using wavelet transform (different wavelets), 3) Neuro fuzzy evaluation techniques to provide robustness in HRV analysis, 4) Monitoring the function of ANS under different stress conditions. Our experiment involves 20 physically fit persons under different times (before smoking and after smoking). Neuro fuzzy technique has been used to model the experimental data Tan Yun-fu et al (2009). This chapter is organized as follows. Section 5.2 illustrates the proposed method with step by step procedure with the associated problems and section 5.3 describes the neuro fuzzy processing of the heart rate signal for mental stress assessment. Finally, section 5.5 analyzes the proposed method and compares with wavelet based methods.

Upload: others

Post on 27-Jun-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

146

CHAPTER 5

ANALYSES OF HEART RATE SIGNALS USING

NEURO FUZZY TECHNIQUE

5.1 INTRODUCTION

In this chapter, the analysis of heart rate variability using neuro

fuzzy technique for mental stress assessment. The activity of the ANS is

studied by means of time-frequency analysis of the HRV signal. Spectral

decomposition of the Heart Rate Variability before smoking and after

smoking was obtained. Mental stress is accompanied by dynamic changes in

ANS activity. HRV analysis is a popular tool for assessing the activities of

autonomic nervous system. The approach consists of 1) Monitoring of heart

rate signals, 2) Signal processing using wavelet transform (different

wavelets), 3) Neuro fuzzy evaluation techniques to provide robustness in

HRV analysis, 4) Monitoring the function of ANS under different stress

conditions. Our experiment involves 20 physically fit persons under different

times (before smoking and after smoking). Neuro fuzzy technique has been

used to model the experimental data Tan Yun-fu et al (2009). This chapter is

organized as follows. Section 5.2 illustrates the proposed method with step by

step procedure with the associated problems and section 5.3 describes the

neuro fuzzy processing of the heart rate signal for mental stress assessment.

Finally, section 5.5 analyzes the proposed method and compares with wavelet

based methods.

Page 2: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

147

5.2 ARTIFICIAL NEURO FUZZY INFERENCE SYSTEM

Assessment of mental stress under different workload conditions is

a recurrent issue in many engineering and medicine fields. Although mental

stress cannot be measured directly, the physiological response of an operator

can be interpreted to assess the level of mental stress. Several physiological

parameters (like electroencephalograph, blood pressure, heart rate, HRV,

Electro Dermal Activity (EDA), event-related potentials, and

electromyography) have been found sensitive toward any changes occurring

in the mental stress level of an operator. Cardiac activity is the most common

physiological measure for the assessment of mental workload Kumar et al

(2006). An ECG is a cardiac measure that shows sensitivity towards

variations in workload Wu et al (2004). Heart rate variability (a measure of

electrocardiographic activity) has been widely accepted in the literature for

the assessment of mental workload. Electrical activity of heart can be

recorded with surface electrodes on chest or limbs. ECG wave shape may be

altered by cardiovascular diseases, atrial fibrillation, and ventricular

fibrillation and conduction problems. ECG signal comprises of P wave, PG

segment, QRS complex, ST segment and T wave. QRS complex wave shape

is affected by conduction disorders. Ventricular enlargement could cause a

wider than normal QRS complex. The ST segment may be depressed due to

myocardial infarction Lins Chang et al (1989). Presence of noise is one of the

most challenging problems in Signal Processing basically due to the fact that

a signal can pick up noise and be distorted such that the information carried

by the signal can be misinterpreted. Thus, it is important that the impairments

due to noise is reduced or eliminated totally from signals in almost all signal

processing and communications tasks. Filtering is widely used to remove the

noise from the signal. However, in the process, it also removes a part of the

signal, which may be an important part of the signal processing application.

Noise cancellation is mainly used as interference canceling in ECG

Page 3: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

148

Meng Joo Er et al (2005) echo elimination on long distance telephone

transmission lines and antenna side lobe interference canceling. This explains

how ANFIS can be used to identify an unknown nonlinear passage dynamics

that transforms a noise source into an interference component (noise estimate)

in a detected signal. The neural network used in ANFIS is back propagation

and the fuzzy model Guler et al (2005).

Soft computing is a new approach to construct intelligent systems.

The complex real world problems require intelligent systems that combine

knowledge, techniques and methodologies from various sources. Neural

networks recognize patterns and adapt themselves to scope with changing

environments. Fuzzy inference systems incorporate human knowledge and

perform inferencing and decision making.

5.3 PRELIMINARIES

ECG signal analysis is widely used in biomedical applications.

Wiggins et al. proposed a method to classify patients by age based upon

information extracted from their electrocardiograms (ECGs). A large number

of signal processing techniques have been developed and used in ECG. ECG

signals are affected by various kinds of noise and artifacts that may hide

important information of interest. WT technique is used to identify the

characteristic points of the ECG signal with fairly good accuracy, even in the

presence of severe high frequency and low frequency noise Chawla et al

(2011) implemented a fuzzy logic controller algorithm for adaptive cardiac

pacemakers that offer good adaptation of the pacing rate to the physiological

needs of the patient and easy personalization. Neural network and fuzzy logic

gives a powerful soft computing methodology Majumdar et al (2011) in

mental stress assessment. In the wavelet based mental stress assessment Akay

et al (1995), the heart rate signals are processed first using Fourier transform,

and then it is applied to wavelet transform. The activity of the autonomic

Page 4: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

149

nervous system is noninvasive studied by means of Autoregressive (AR)

frequency analysis of the HRV signal. The goodness of the algorithms is first

tested through simulations, and then results obtained on real data during

ischemic episodes are presented. Spectral decomposition of the Heart Rate

Variability during whole night recordings was obtained, in order to assess the

characteristic fluctuations in the heart rate and their spectral parameters

during REM and NREM sleep stages. Mental stress is accompanied by

dynamic changes in ANS activity.

HRV analysis is commonly used as a quantitative marker depicting

the activity of ANS that may be related to mental stress. For mobile

applications Wornell et al (1992) short term ECG measurement may be used

for HRV analysis since the conventional five minute long recordings might be

inadequately long. Short term analysis of HRV features has been investigated

mostly in ECG data from normal and cardiac patients. Thus, short term HRV

features may not have any relevance on the assessment of acute mental stress.

An adaptive neuro-fuzzy filtering Hong et al (2004) which is basically a

nonlinear system for the noise cancellation of biomedical signals (like ECG,

PPG etc) measured by ubiquitous wearable sensor node (USN node). This

presents non-linear adaptive filter which uses Fuzzy Neural Network (FNN)

to treat with the unknown noise and artifacts present in biomedical signals.

The presented work based on ANFF (Adaptive Neuro Fuzzy Filter), where

adaptation process includes neural network learning ability and fuzzy if-then

rules with the optimal weight setting ability. In fuzzy evaluation, stress

assessment is done by interpreting the parameters of autonomic nervous

system activity using a fuzzy model. The most important contribution of this

is to quantify the concept of mental stress and to establish a direct functional

relationship (independent of individual variations) between ANS activities

and mental stress. It seems that the proposed fuzzy evaluation approach,

combined with linear (or nonlinear) analysis of physiological parameters, may

Page 5: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

150

be helpful in various physiological modeling problems for the handling of

uncertainties. The fuzzy evaluation approach, after being applied to mental

stress assessment, motivates the start of new interesting research of physical

and mental stress separation. The validity of using ECG measurement in

mental stress monitoring has been demonstrated in both psychophysiology

and bio-engineering. HRV analysis based on ECG measurement is commonly

used as a quantitative marker describing the activity of the autonomic nervous

system during stress. For example, the mean RR is significantly lower

(i.e., the heart rate is higher) with a mental task than in the control condition

while pNN50 is significantly higher in the control condition than with a

mental task Kania et al (2007). Also, conventional short-term HRV features

(e.g., a 5-minute sample window) may not capture the onset of acute mental

stress for a mobile subject Chen et al (2004). Hence, mental stress can be

recognized with most HRV features calculated within one minute.

5.4 ISSUES

Signal processing techniques suffers due to lack of availability of

standard databases, partly due to the relatively low signal-to-noise ratio Engin

et al (2004). The ANS and especially its sympathetic branch play a significant

path physiological role during the early course of hypertension. The study of

cardiac variability through spectral analysis of RR interval, blood flow and

respiratory activity are based either on FFT or on AR modeling and assume

stationary of data. However, most physiological signals change in short times

and the ANS regulate the cardiovascular function very quickly. Conventional

PSD estimation methods are not suitable for analyzing heart beat signal

whose frequency components change rapidly. On the other hand, TFA has

more desirable characteristics of a time-varying spectrum. An emerging body

of literature seems to suggest that HRV analysis can be potentially used to

measure mental stress. However, a practical problem, which is so far not well

Page 6: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

151

addressed in the literature, is to derive some form of quantitative relations

between parameters of ANS activity and mental stress. Choukari et al (2006)

mental workload is known to significantly influence an operator's task

performance. Extreme levels of mental workload can lead to operator

monotony, low performance and operation errors. Measurement of mental

workload is very important, especially in real time measurement that involves

the representation of real problems. The most direct access to vegetative

functioning can be achieved by following up of heart rate variability (HR The

bar reflex that acts to blunt BP) variations through opposite variations in heart

rate should limit the BP increase produced by an emotional challenge.

However, relations between bar reflex sensitivity and BP reactivity induced by

a psychological stress in a large group of adults have never been firmly

established. In 280 healthy men, rest (10 minutes) and stress (5 minutes) BP

and heart rate were recorded beat to beat by a blood pressure monitor.

5.5 PROPOSED METHOD

Ranganathan et al (2012) the ANS, which controls cardiac muscle,

is of interest for stress detection. ANS is concerned with the regulation of

heart rate, blood pressure, breathing rate, body temperature, and other visceral

activities. The ANS activity is divided into two branches: sympathetic and

parasympathetic, which influence the sinus node of the heart, thereby

modulating heart rate. HRV is a measure of the variability in heart rate. The

proposed work consists of 1) Monitoring of heart rate signals, 2) Signal

processing using wavelet transform (different wavelets), 3) Neuro Fuzzy

evaluation techniques to provide robustness in HRV analysis, 4) Monitoring

the function of ANS under different stress conditions. The R-R intervals are

analyzed using wavelet transform and neuro fuzzy logic to assess ANS

activities. The signal-to-noise (SNR) ratio analysis using different wavelets

Page 7: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

152

are compared and signal estimation is performed using power spectral

density. Disturbed sympathetic and also parasympathetic activity indicates

pathological changes of the cardiovascular system. Hereby, heart rate and its

variability represent important cardiovascular parameters for the assessment

of such regulatory processes. Several studies have shown that low-frequency

oscillations (up to 0.15 Hz) predominantly refer to sympathetic activity, while

respiration-modulated oscillations (around 0.25 Hz) mainly reflect

parasympathetic activity.

Research has proven that patients with essential hypertension,

especially at an early stage without any medication, display an increase in

sympathetic and a reduction in parasympathetic activity of the ANS. To R–R

intervals were measured (R-wave triggered) continuously by

electrocardiogram (ECG) via a bipolar chest lead (cardial lead, Einthoven II).

The QRS identification was based on a high and low pass filtered trigger of

the ECG with an accuracy of 2 ms. Simultaneously with the ECG, respiratory

activity was recorded using a chest belt (thorax expansion). The analogue

signal was digitized at 20 Hz. Breathing cycles per minute (n1 and n2) could

be calculated by displaying the signal analogous to the tachogram.

Insecurities from uncompleted breathing cycles at the beginning and at the

end of the data segment were accounted for by one breathing cycle. The

whole breathing frequency range fresp can be calculated as follows:

fresp = (n1-1)/60... (n2+1)/60 (Hz). The components of the proposed

work and the experimental setup for recording the ECG signal are shown in

Figures 5.1 and 5.2.

Page 8: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

153

Figure 5.1 Components of the proposed work

Figure 5.2 Experimental setup for recording the ECG signal

5.5.1 Procedural Steps in the Proposed Method

Problem 1: In R-R intervals, estimate the level of mental stress on a scale

ranging from 0 to 100 by monitoring the functioning of autonomic nervous

system using HRV analysis.

The solution of above problem not only would provide a

physiological interpretation of a so-called mental stress but also has the direct

applications in engineering fields like adaptive automation and man–machine

Page 9: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

154

interface design. The major difficulties in solving Problem 1 are the

following.

1. HRV signal is non stationary, i.e., it is characterized by time

variations in its frequency components.

2. The alterations in HRV signal due to a change in the level of

mental stress (these alterations would be used to detect the

corresponding change) are subjective to individuals.

To resolve the second difficulty, some of the approaches coming

from the area of neural network have been used and references therein.

However, neural network–based approaches are like a “black box,” since

these do not provide a human-understandable insight into relationships

between ANS activities and level of mental stress.

Problem 2: While enveloping mental stress monitoring algorithms in real-life

ambulatory situations, it is crucial to take human activity (e.g., walking,

sitting, standing, and smoking) into account. Cardiovascular variability is

highly acted by changes in body posture and physical activity. A major

obstacle for ambulatory monitoring is that physiological dyes regulation or

emotion effects can be confounded by physical activity. Many physiological

parameters, including heart rate, respiratory sinus arrhythmia, and skin

conductance level, are strongly acted by both anxiety and exercise. The daily

routines involve psycho physiological body activation characteristics.

5.5.2 Functional Relationship between HRV and Mental Stress

HRV was compared during rest and under mental stress. The

testing procedure consisted of the following phases: habituation, arithmetic

tasks without and with interference, recovery. HRV was analyzed using the

Trigonometric Regressive Spectral (TRS) analysis. Proceeding from the total

Page 10: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

155

variance (ms2), the weighted averaged frequency (Hz) and the variance parts

(ms2) in the frequency bands 'low frequency' (LF-band: 0.04–0.15 Hz) and

'high frequency' (HF-band: 0.15–0.40 Hz) were explored. The variance part

modulated by spontaneous breathing within the HF-band was assessed

additionally. The variance part in the LF-band under mental stress was

significantly increased in the HT group (P<0.01). Activity in the HF-band

(without the respiration-dependent part) under mental stress did not differ

between both groups, whereas the breathing-modulated part of variance in the

HF-band was reduced in the HT subjects. During the recovery period in the

HT group, the weighted averaged frequency was still elevated compared to

baseline, and the variance part in the LF-band was increased, which may point

to delayed recovery behavior. In addition, by using a discriminant analysis

85% of all subjects were reclassified to the original groups, all HT subjects

being assigned 'correctly'. Spectral variance parameters enable early discovery

of altered cardiovascular regulation. Respiration influences variance in the

HF-band in hypertensive subjects and should therefore be paid attention to.

The variance part in the LF-band, weighted averaged frequency and the

respiration-modulated variance in the HF-band turned out to be the most valid

parameters for the differentiation between NT and HT subject.

5.6 ECG SIGNAL PROCESSING USING NEURO FUZZY LOGIC

Neural networks are composed of various functional units operating

in parallel. The architecture of the neural network has been derived from

research on the biological functions of the cerebral cortex. Neural network

can be trained to perform a particular function by adjusting the value of the

connections (weights) between elements. Commonly neural networks are

adjusted, or trained, based on a comparison of the output and the target, until

the network output matches the target. Typically many such input target pairs

are used in the supervised learning to train a network. Back propagation is an

Page 11: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

156

important learning algorithm for training multi layer feed forward networks. It

was created by generalizing the Widrow- Hoff learning rule to multiple layer

networks and nonlinear differentiable transfer functions. Input vectors and the

corresponding output vectors are used to train a network until it can

approximate a function, associates input vectors with specific output vectors

or classify input vectors in an appropriate way as defined by the user

Horikawa et al (1992). Fuzzy inference is the process of formulating the

mapping from a given input to an output using fuzzy logic. The mapping then

provides a basis to its appropriate membership value. Two well known types

are Mamdani-type and Sugeno-type. Both can be implemented in fuzzy logic

toolbox. These two types differ in the way output's are determined. Mamdani-

type inference expects the output membership functions to be fuzzy sets, and

requires defuzzification. A Sugeno fuzzy model has a crisp output, the overall

output is obtained via weighted average, thus neglecting the time consuming

process of defuzzification required in a Mamdani model Kezi Selva Vijila

et al (2006).

In practice, the weighted average operator is occasionally replaced

with the weighted sum operator to reduce computation further mainly in the

training of a fuzzy inference system. The process of identifying a fuzzy model

is generally divided into the identification of the premises and that of the

consequences. And each of the identifying processes is divided into the

identification of the structures and the parameters. The structures of a fuzzy

model mean the combination of the input variables and the number of the

membership functions in the premises and in the consequences. Sugeno's

method finds the best fuzzy model by repeating the followings: (i) the

selection of the structures in the premises, (ii) the identification of the

parameters in the premises, (iii) the selection of the structures is the

consequences, and (iv) the identification of the parameters in the

consequences. The fuzzy training network is shown in Figure 5.3. This

identifying process is time consuming and the characteristics of a fuzzy model

Page 12: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

157

depend heavily on the structures rather than on the parameters of the

membership functions. The selection of the structures is first done once in the

process. The selection of the structures of types I and II is done only in the

premises since the structures of these types in the consequences are

automatically determined with those in the premises. After the structures are

selected, the FNN identifies the parameters of fuzzy models automatically.

Figure 5.3 Neuro fuzzy training network

While implementing the ANN program, the network is trained

using the BPA. The training process of the network is shown in Figure 5.3.

The input unit includes: identifying the parameters of the network, identifying

the weights entering the training patterns and the desired matrices, and

normalizing the input and the desired matrices. The processing unit contains

the training of the network with the input patterns using the error BPA. The

output unit gives the output of the network (the desired value) and

demoralizes them. After the training of the network, the unknown patterns

Page 13: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

158

will be inserted in the program. The network will recognize the pattern and

give the required classification.

Figure 5.4 Flow chart for training algorithm

Page 14: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

159

A MF is a curve that defines how each point in the input space is

mapped to a membership value (or degree of membership) between 0 and 1.

The input space is sometimes referred to as the universe of discourse, a fancy

name for a simple concept. The only condition a membership function must

really satisfy is that it must vary between 0 and 1. The function itself can be

an arbitrary curve whose shape we can define as a function that suits us from

the point of view of simplicity, convenience, speed, and efficiency.

A classical set might be expressed as A = {x | x > 6}. A fuzzy set is an

extension of a classical set. If X is the universe of discourse and its elements

are denoted by x, then a fuzzy set A in X is defined as a set of ordered pairs.

A = {x, µA(x) | x X} where, µA(x) is called the membership function (or

MF) of x in A. The membership function maps each element of X to a

membership value between 0 and 1. The simplest membership functions are

formed using straight lines. Of these, the simplest is the triangular

membership function. Two membership functions are built on the Gaussian

distribution curve: a simple Gaussian curve and a two-sided composite of two

different Gaussian curves. Although the Gaussian membership functions and

bell membership functions achieve smoothness, they are unable to specify

asymmetric membership functions, which are important in certain

applications

5.7 PERFORMANCE ANALYSIS

This section provides the results obtained during the processing of

heart rate signals using wavelet transform and neuro fuzzy techniques.

Wavelet decomposition and reconstruction methods are used to remove the

interferences from the ECG signal so that feature extraction can be done

without much fuss. The resultant signal is obtained using Meyer wavelet but it

may be improved using neuro fuzzy techniques.

Page 15: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

160

0 500 1000 1500-1

-0.5

0

0.5

1Noisy ECG signal

0 500 1000 1500-1

-0.5

0

0.5

1Denoised ECG signal

Figure 5.5 ECG noise removal using Meyer wavelet

Power Spectral Density (PSD) refers to the amount of power per

unit (density) of frequency as a function of the frequency. The power spectral

density, PSD, describes how the power or variance of a time series is

distributed with frequency. The power spectral densities of input ECG signal,

reference noise signal and measured signal are shown in Figure 5.6.

Clustering is the task of assigning a set of objects into groups (called clusters)

so that the objects in the same cluster are more similar (in some sense or

another) to each other than to those in other clusters. Clustering is a main task

of explorative data mining, and a common technique for statistical data

analysis used in many fields, including machine learning, pattern recognition,

image analysis, information retrieval, and bioinformatics.

Page 16: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

161

0 20 40 60 80

2

4

6

8

PSD of Information Signal

Frequency (Hz)0 20 40 60 80

2

4

6

8

PSD of noise signal

Frequency (Hz)

0 20 40 60 80

2

4

6

8

PSD of the measured signal

Frequency (Hz)

Figure 5.6 Power spectral density plots

Cluster analysis itself is not one specific algorithm, but the general

task to be solved. It can be achieved by various algorithms that differ

significantly in their notion of what constitutes a cluster and how to efficiently

find them. Popular notions of clusters include groups with low distances

among the cluster members, dense areas of the data space, intervals or

particular statistical distributions. Clustering can therefore be formulated as a

multi-objective optimization problem. The appropriate clustering algorithm

and parameter settings (including values such as the distance function to use,

a density threshold or the number of expected clusters) depend on the

individual data set and intended use of the results. Cluster analysis as such is

not an automatic task, but an iterative process of knowledge discovery or

interactive multi-objective optimization that involves trial and failure. It will

often be necessary to modify preprocessing and parameters until the result

achieves the desired properties Samit Ari et al (2009). Three types of

Page 17: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

162

clustering approaches are commonly used. They are (1) hierarchical approach,

(2) graph theoretic approach, and (3) objective function-based approach. The

objective function-based approach is very popular. One extensively used

objective function-type clustering algorithm is hard K-means clustering

algorithm. It assigns each pattern exactly to one of the clusters assuming well-

defined boundaries between the clusters. However, there may be some

patterns that belong to more than one cluster. In order to overcome this

problem, the idea of Fuzzy K-means (FKM) algorithm has been introduced.

Unlike the hard K-means, in the FKM each input pattern belongs to all the

clusters with different degrees or membership values. Incorporation of the

fuzzy theory in the FKM algorithm makes it a generalized version of the hard

K-means algorithm from the psycho-physiological point of view; the problem

of pattern clustering is unsuitable for approaches with precise mathematical

formulations.

Fuzzy clustering is a class of algorithms for cluster analysis in

which the allocation of data points to clusters is not "hard" (all-or-nothing)

but "fuzzy" in the same sense as fuzzy logic. In hard clustering, data is

divided into distinct clusters, where each data element belongs to exactly one

cluster. In fuzzy clustering (also referred to as soft clustering), data elements

can belong to more than one cluster, and associated with each element is a set

of membership levels. These indicate the strength of the association between

that data element and a particular cluster. Fuzzy clustering is a process of

assigning these membership levels, and then using them to assign data

elements to one or more clusters. One of the most widely used fuzzy

clustering algorithms is the Fuzzy C-Means (FCM) Algorithm Bezdek et al

(1981). The FCM algorithm attempts to partition a finite collection of n

elements X = {x1, ….. , x n} into a collection of c fuzzy clusters with respect

to some given criterion. Given a finite set of data, the algorithm returns a list

of c cluster centers C = {c1, ……, cc} and a partition matrix U = ui,j [0,1], i =

Page 18: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

163

1 , ……, n, j = 1, …., c where each element uij tells the degree to which

element xi belongs to cluster cj . Like the k-means algorithm, the FCM aims to

minimize an objective function. The standard function is:

k1u (x) 2 / (m 1)d(centerk,x)( )j d(centerj, x)

(5.1)

This differs from the k-means objective function by the addition of the

membership values uij and the fuzzifier m. The fuzzifier m determines the

level of cluster fuzziness. A large m results in smaller memberships uij and

hence, fuzzier clusters. In the limit m = 1, the memberships uij converge to 0

or 1, which implies a crisp partitioning. In the absence of experimentation or

domain knowledge, m is commonly set to 2. The basic FCM Algorithm, given

n data points (x1, . . ., xn) to be clustered, a number of c clusters with (c1, . . .,

cc) the center of the clusters, and m the level of cluster fuzziness.

5.8 FUZZY C-MEANS CLUSTERING

Fan et al (2003) In fuzzy clustering, each point has a degree of

belonging to clusters, as in fuzzy logic, rather than belonging completely to

just one cluster. Thus, points on the edge of a cluster may be in the cluster to a

lesser degree than points in the center of cluster. An overview and comparison

of different fuzzy clustering algorithms is available. Any point x has a set of

coefficients giving the degree of being in the kth cluster wk(x). With fuzzy c-

means, the centroid of a cluster is the mean of all points, weighted by their

degree of belonging to the cluster:

kxk

kx

w (x)xc

w (x) (5.2)

Page 19: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

164

The degree of belonging, wk(x), is related inversely to the distance

from x to the cluster center as calculated on the previous pass. It also depends

on a parameter m that controls how much weight is given to the closest

center. The fuzzy c-means algorithm is very similar to the k-means algorithm:

Choose a number of clusters.

Assign randomly to each point coefficients for being in the

clusters.

Repeat until the algorithm has converged (that is, the

coefficients' change between two iterations is no more than ,

the given sensitivity threshold) :

o Compute the centroid for each cluster, using the formula

above.

o For each point, compute its coefficients of being in the

clusters, using the formula above.

The algorithm minimizes intra-cluster variance as well, but has the

same problems as k-means; the minimum is a local minimum, and the results

depend on the initial choice of weights Pal et al (2005). The expectation-

maximization algorithm is a more statistically formalized method which

includes some of these ideas: partial membership in classes. Fuzzy c-means

has been a very important tool for image processing in clustering objects in an

image. In the 70's, mathematicians introduced the spatial term into the FCM

algorithm to improve the accuracy of clustering under noise. After extracting

desired features from the signal neuro fuzzy training is performed and

clustering techniques are used. The popular clustering techniques are fuzzy c-

means, subtractive and mountain clustering. The fuzzy c-means clustering

Page 20: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

165

using color plot is shown in Figure 5.7 and fuzzy subtractive clustering is

shown in Figure 5.8.

Figure 5.7 Fuzzy C-means clustering using color plot

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Figure 5.8 Fuzzy k-means clustering

In Figure 5.7, while moving along X-axis from cluster 1 to 6, the

stress level does not always increases, since stress associated to the 4th cluster

is higher than the 6th cluster. Also, moving along Y-axis, there is no

significant reduction in the stress level. The reason obviously is that the

different individuals behave differently, and an average behavior in Figure 5.8

Page 21: CHAPTER 5 ANALYSES OF HEART RATE SIGNALS USING NEURO FUZZY …shodhganga.inflibnet.ac.in/bitstream/10603/24192/10/10_chapter5.pdf · Neural networks recognize patterns and adapt themselves

166

may not represent the real facts. Therefore, we need to handle the

uncertainties due to individual variations using a fuzzy inference system. Let

us assume that the mental stress is some unknown function of parameters X,

Y that needs to be approximated by a fuzzy model using subjective mental

workload score (which is an uncertain measure of the mental stress). That is

workload sore mental stress uncertainty

5.9 SUMMARY

This chapter has suggested a new approach to stress assessment

using heart rate signals by neuro fuzzy model. The most important

contribution of this chapter is to establish a direct functional relationship

between heart rate variability and mental stress. The wavelet decomposition

and reconstruction techniques are used for removing noise and to extract

some important time-frequency features. The spectral features are identified

with the application of neuro fuzzy training and mental stress assessment is

done using fuzzy clustering techniques. The fuzzy evaluation approach, after

being applied to mental stress assessment, motivates the start of new

interesting research of physical and mental stress separation. The comparative

analysis is given in detail in the chapter 6.