journal of physical activity and health (2), pp. 221-229. · easier, the original version of champs...

30
This may be the author’s version of a work that was submitted/accepted for publication in the following source: Giles, Kate & Marshall, Alison (2009) Repeatability and accuracy of CHAMPS as a measure of physical activity in a community sample of older Australian adults. Journal of Physical Activity and Health, 6 (2), pp. 221-229. This file was downloaded from: https://eprints.qut.edu.au/19315/ c Copyright 2009 Human Kinetics, Inc. This work is covered by copyright. Unless the document is being made available under a Creative Commons Licence, you must assume that re-use is limited to personal use and that permission from the copyright owner must be obtained for all other uses. If the docu- ment is available under a Creative Commons License (or other specified license) then refer to the Licence for details of permitted re-use. It is a condition of access that users recog- nise and abide by the legal requirements associated with these rights. If you believe that this work infringes copyright please provide details by email to [email protected] Notice: Please note that this document may not be the Version of Record (i.e. published version) of the work. Author manuscript versions (as Sub- mitted for peer review or as Accepted for publication after peer review) can be identified by an absence of publisher branding and/or typeset appear- ance. If there is any doubt, please refer to the published source. http:// www.humankinetics.com/ JPAH/ viewarticle.cfm?jid= p4WnLRHeu3GkHF2Js2LxZED8w7UaN2GLz4MzZ7m&aid=16845&site= p4WnLRHeu3GkHF2Js2LxZED8w7UaN2GLz4MzZ7m

Upload: others

Post on 12-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

This may be the author’s version of a work that was submitted/acceptedfor publication in the following source:

Giles, Kate & Marshall, Alison(2009)Repeatability and accuracy of CHAMPS as a measure of physical activityin a community sample of older Australian adults.Journal of Physical Activity and Health, 6(2), pp. 221-229.

This file was downloaded from: https://eprints.qut.edu.au/19315/

c© Copyright 2009 Human Kinetics, Inc.

This work is covered by copyright. Unless the document is being made available under aCreative Commons Licence, you must assume that re-use is limited to personal use andthat permission from the copyright owner must be obtained for all other uses. If the docu-ment is available under a Creative Commons License (or other specified license) then referto the Licence for details of permitted re-use. It is a condition of access that users recog-nise and abide by the legal requirements associated with these rights. If you believe thatthis work infringes copyright please provide details by email to [email protected]

Notice: Please note that this document may not be the Version of Record(i.e. published version) of the work. Author manuscript versions (as Sub-mitted for peer review or as Accepted for publication after peer review) canbe identified by an absence of publisher branding and/or typeset appear-ance. If there is any doubt, please refer to the published source.

http:// www.humankinetics.com/ JPAH/ viewarticle.cfm?jid=p4WnLRHeu3GkHF2Js2LxZED8w7UaN2GLz4MzZ7m&aid=16845&site=p4WnLRHeu3GkHF2Js2LxZED8w7UaN2GLz4MzZ7m

Page 2: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

QUT Digital Repository: http://eprints.qut.edu.au/

Giles, Kate and Marshall, Alison L. (2009) The repeatability and accuracy of CHAMPS as a measure of physical activity in a community sample of older Australian adults. Journal of Physical Activity and Health, 6(2). pp. 221-229.

© Copyright 2009 Human Kinetics, Inc.

Page 3: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

1

The Repeatability and Accuracy of CHAMPS as a Measure of Physical Activity in a

Community Sample of Older Australian Adults

Kate Giles1 and Alison L. Marshall2

1 Formally Australasian Centre on Ageing, The University of Queensland

2 School of Public Health, Queensland University of Technology

Keywords: measurement, walking, reliability, validity

correspondence contact:

Dr Alison L. Marshall Queensland University of Technology

School of Public Health Victoria Park Rd, Kelvin Grove

QLD 4059 Ph: 07 – 313 85804

Fax: 07 – 313 83369 Email: [email protected]

Page 1 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 4: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

2

The repeatability and accuracy of CHAMPS as a measure of physical activity in a

community sample of older Australian adults

ABSTRACT

Background: One to two-week test-retest reliability and construct validity (against pedometer

step counts) of the CHAMPS physical activity questionnaire were evaluated in older

Australian adults.

Methods: Participants (n=100, aged >65 years) were invited to complete CHAMPS by mail.

Spearman correlation coefficients are reported for physical activity constructs, time

(min/week) and sessions/week for walking, moderate- and vigorous-intensity activity and total

physical activity. Correct classification of participants as meeting physical activity

recommendations assessed using percent agreement and kappa statistics.

Results: 73 participants completed CHAMPS at T1; 54 provided repeat data (T2). 60%

participants provided complete data. Good to excellent test-retest reliability was observed for

all the physical activity constructs (rs=.70 - .89 sessions/week and rs=.65 - .75 for min/week).

Agreement between proportions classified as meeting recommendations at T1 and T2 was

good (79%; Kappa =.55). Fair to low validity coefficients were observed between steps and

T1 CHAMPS walking and total activity sessions/week (rs=0.57 and rs=0.52), and min/week

(rs=0.40 and rs=0.21).

Conclusions: Mailed self-complete CHAMPS data provided reliable and valid estimates of

physical activity in older Australian adults. Observed measurement coefficients were

comparable to those reported in previous evaluations of CHAMPS. Further work is required

to identify strategies to prevent data loss.

Page 2 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 5: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

3

The repeatability and accuracy of CHAMPS as a measure of physical activity in a

community sample of older Australian adults

INTRODUCTION

Ageing is a complex process involving many interacting variables (e.g. genetics, lifestyle

factors, chronic diseases). Physical activity is one of a number of modifiable factors that can

improve the health status of older people. 1 Bauman and colleagues 2 commented that as the

number of older adults in the population increases so will consumption of the health budget

and that physical activity is likely to be one of the most important public health priorities for the

twenty-first century.

Over the past 30 years, strong, consistent epidemiological evidence has emerged which

defines a range of health and social benefits for participation in regular moderate-intensity

physical activity for all adults. 1-7 Some of which include reduced risk of death and illness from

cardiovascular disease, improved self-image, improved quality of life, less depression and

reduced risk of falling.2-7 For older adults, participation in regular physical activity can also

help increase and maintain a sense of general well-being and reduce the functional decline

usually associated with ageing.3 Physical activity can confer protective effects from all cause

mortality even if adopted in later life, 4,5 and these benefits can be achieved within two to three

years of adopting an active lifestyle. 6,7

The American College of Sports Medicine (ACSM) and the American Heart Association (AHA)

recently updated recommendations for the types and amounts of physical activity necessary

to improve and maintain health in older adults (≥65years). 8 The updated recommendations

are similar to the ACSM/AHA recommendation for healthy adults, which state that adults

should accumulate at least 30 mins of moderate-intensity physical activity on at least five

Page 3 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 6: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

4

days of the week or 20 mins of vigorous intensity activity on at least three days per week. 9 To

accurately assess how many older adults are meeting these recommendations researchers

need valid and reliable measures of physical activity suitable for older adults.

Seven questionnaires were identified in the literature designed specifically to measure older

adults physical activity. The Physical Activity Scale for the Elderly (PASE); 15,16 Older Adults

Exercise Status Inventory (OA-ESI); 17 Community Health Activities Model Program for

Seniors (CHAMPS); 14,18 Yale Physical Activity Survey (YPAS); 18 Modified Dallosso

Questionnaire; 16 Questionnaire d’Activite’ Physique Saint- Etienne; 16 and Modified Baecke

Questionnaire. 16 These measures were developed and tested in samples of older adults in

France, Canada and the U.S.A. Excluding the OA-ESI, a variety of criterion measures were

used to assess the validity of the questionnaires (e.g., doubly labeled water, total energy

expenditure/resting metabolic rate ratio, maximum oxygen uptake, short performance

batteries, a 6-minute walk, accelerometers and pedometers). Test-retest reliability of the

PASE, OA-ESI and CHAMPS data were assessed over periods from 1-week up to 6-months.

Harada et al. 18 simultaneously evaluated the measurement properties of PASE, YPAS and

CHAMPS. Two-week test-retest reliability of CHAMPS moderate activity data was good

(ICC=.76), and validity was fair (rp=.48). PASE and YPAS validity coefficients ranged from

rp=.52 - .68 and rp=.46 - .61 respectively. 18 Stewart et al. 14 reported the 6-month stability of

the CHAMPS measure was good (ICC=.67), and modest validity coefficients for activities of

moderate-intensity or greater against physical function tests and self-reported quality of life

measures (rp=.22 - .30). Stewart et al. 14 concluded that since demonstrating the reliability and

construct validity of CHAMPS it would be a useful measure of physical activity for older adults

and consequently it has been used to assess various interventions around the world. 19-20

Page 4 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 7: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

5

Recently Cyarto et al. 21 reported excellent one-week test-retest reliability coefficients (ICC

=.81 - .88) for moderate-intensity activity data collected from CHAMPS administered in small

groups of older Australians living in retirement villages. They also reported low but significant

validity coefficients between CHAMPS data and four physical performance tests (range rs=.19

- .32). 21 However, further examination of the measurement properties of the CHAMPS

questionnaire in diverse population samples and various modes of administration is

warranted.

Interestingly all previous work with the CHAMPS questionnaire has been conducted within the

context of face-to-face administration. As people age they are less willing and able to come to

clinics for face-to-face consultations. No studies were located which have collected CHAMPS

data via mail. The aim of this study was to explore the measurement properties (test-retest

repeatability and construct validity) of data collected from a mailed, self-completed CHAMPS

questionnaire in a sample of free-living older Australian adults. The CHAMPS questionnaire

includes over forty items and is formatted so that if respondents engage in a specific activity,

they report the number of times per week (frequency) they did the activity, and also the

approximate duration (in hours) of participation in a week. 14 To make reporting duration

easier, the original version of CHAMPS used six response categories (i.e., <1 hr/wk-1, 1-2.5

hr/wk -1, 3-4.5 hr/wk -1, 5-6.5 hr/wk -1, 7-8.5 hr/wk -1, and ≥9 hr/wk -1). 14 The response

categories were adjusted in this study to remove the half hr gap between categories and

reduce the duration of each response category to 1-hr intervals instead of 1.5 (i.e., 0.5

hr/week -1, >0.5-1 hr/wk -1, >1-2 hr/wk -1, >2-3 hr/wk -1, >3-4 hr/wk -1, >4-5 hr/wk -1, >5-.6 hr/wk -

1, >6-7 hr/wk -1, ≥7 hr/wk -1). Other modifications included adapting some activity descriptions

Page 5 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 8: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

6

to Australian terms and activities (e.g., lawn bowls), and instead of using a typical week in the

last four as the recall/reference period this version of CHAMPS asked participants to recall

what activities they had undertaken in the past seven days. This paper adds to the current

literature on the CHAMPS questionnaire by examining the potential for it to be administered

without face-to-face contact in adults aged over 65 years. Further, the data are interpreted in

terms of the updated physical activity recommendations. 8,9

METHODS

Design, Participants and Hypotheses

This prospective study assessed the test-retest reliability and construct validity of CHAMPS

physical activity data in Australian adults aged over 65 years. To replicate administration of

this questionnaire as a self-complete population-based assessment of physical activity, data

were collected without any face-to-face contact between the participants and the researchers.

Study procedures were approved by a University Human Research Ethics Committee.

One-hundred older adults were randomly selected from a registry of 130 older adults willing to

be involved in research projects related to ageing. Participants for this study were required to

be aged over 65 years, be able to speak and read English and not have any history of falls

recorded in the database.

Data were collected in three phases. First, 100 randomly selected database registrants

participants were sent; a letter inviting them to participate in this study, a self-complete

version of CHAMPS, and an informed consent form. Those who completed and returned the

self-complete version of CHAMPS (T1) and the informed consent form were sent another

copy of the CHAMPS questionnaire and a pedometer plus step log.

Page 6 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 9: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

7

To ensure the test-retest administrations of the CHAMPS overlapped as much a possible the

participants were asked to complete the second CHAMPS immediately upon receiving it (T2).

They were then asked to wear a YAMAX-SW700 pedometer for the next 7-days, from the

time they woke up until the time they went to bed and record daily steps in the step log. At

the end of the 7-d they were asked to return the CHAMPS questionnaire, the pedometer and

step log in the reply paid envelope. Allowing for delays in postage most individual data

collection was completed within two-weeks.

Data from those who completed and returned the second version of CHAMPS within 1-2

weeks (T2) were matched to their T1 data using unique identifiers and included in the test-

retest reliability analysis. Pedometer/step log data were matched to participants T1 CHAMPS

data to assess construct validity.

Secondary analyses were also conducted between CHAMPS T2 data and the pedometer

data (T3). The analyses were same as those conducted between T1 data and the pedometer

data. However, the T2 validity analyses were considered secondary to the T1 analyses since

completion of the questionnaire at T1 is the closest approximation of how the questionnaire

data would be collected and used in practice, and T2 data may be biased by T1.

It was hypothesised that there will be no differences between the physical activity data

reported between repeat CHAMPS administrations (T1 to T2), indicating that CHAMPS data

were reliable. The second hypothesis was that CHAMPS data will accurately estimate the

amount of walking and total activity the participants do as determined by objectively

measured step counts. Significant positive correlations between the CHAMPS and

Page 7 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 10: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

8

pedometer/step log data will suggest that CHAMPS data can provide an accurate estimate of

older adults’ weekly walking and total physical activity.

Measures

Modifications to CHAMPS were described at the end of the introduction. The first mailed self-

complete questionnaire also included items to assess standard socio-demographic variables

(age, gender, height, weight, education level, marital status, country of birth, main language

spoken at home, ethnicity and employment).

The YAMAX-SW700 pedometer was selected as the objective reference for physical activity

in this study because the sensitivity threshold of the YAMAX pedometer appears to be

appropriate for assessing normal paced walking in healthy older adults. 22 Pedometers are

also low-cost, unobtrusive, and have been shown to provide an accurate, easily

comprehended output (steps) that can be recorded by the wearer. 23,24 Pedometers are also

considered a suitable objective measure of physical activity for older adults because walking

is the preferred leisure time physical activity for older adults. 25 Furthermore, other studies

have used pedometers as the criterion on which the accuracy of self-report questionnaires

have been assessed. 18,24,25,27

Consistent with previous research, participants in this study were asked to wear the

pedometer around their waist on their belt or waistband. Participants were also given a step

log which outlined how to use and wear the pedometer correctly including an exemplar

diagram. The step log also included space for the participants to record the time they put the

pedometer on in the morning and the time they took it off at night, their daily step count, and

any activities in which step counts were not recorded because they took the pedometer off

Page 8 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 11: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

9

during that activity (i.e. water based activities or cycling), including the activity type and

duration. To assess if there were any changes in activity between assessment weeks which

could affect the quality of the data collected between T1 and T2, the step log also asked

participants to rate on a five point scale ‘how much physical activity they did during the last 7

days week as opposed to the week before?’ from 5 “much more activity” to 1 “much less

activity”.

Sample size

According to Sallis and Saelens (2000) the minimum acceptable validity correlation coefficient

for a self-report physical activity questionnaire is r=0.4. 28 Using this correlation estimate, an

alpha of 0.05 and 80% power as acceptable estimates of error, data were required from 47

participants. Previous correlation coefficients reported for the test-retest reliability of the

CHAMPS questionnaire range from ICC=0.67 to ICC=0.88. 14,18,21 Based on these findings

and using alpha 0.05 and power 80%, the sample required to assess test-retest reliability

ranged from 18 to 11 participants respectively. Therefore, the sample size required for the

validity component of this study (n=47) was sufficient to also assess test-retest reliability.

Data preparation and analysis

Data from the self-complete questionnaires (socio-demographic and CHAMPS) and the step

logs were entered into an Excel database, then analysed using SPSS v12. Ten percent of

cases were re-entered and compared to the original entries to check for errors. The data were

also cleaned by running descriptive statistics to identify and check outliers and missing

responses. Chi-square statistics were used to determine if the sample of participants who

responded to the T1 data collection were different to those who provided complete reliability

and validity data.

Page 9 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 12: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

10

As noted by Cyarto et al. (2006) the self-complete version of CHAMPS is vulnerable to

missing data. 21 To estimate the possible effects of missing data in cross-sectional analyses of

physical activity levels of older adults’, data collected from the CHAMPS questionnaire from

those participants who completed CHAMPS at T1 were screened. The proportion of data

missing for each activity category was calculated.

The frequency (sessions/week) and duration (min/week) of walking, moderate- and vigorous-

intensity activity recorded in the CHAMPS questionnaire were assessed separately. Duration

data were then summed to provide an estimate of total activity.

Participant’s total activity data were then categorised according to whether the participant

reported sufficient physical activity to meet the current recommendations for physical activity

(i.e., 150-minutes of moderate-intensity physical activity on most (5) days of the week). 9

Participant’s were defined as insufficiently active if they were not meeting this

recommendation.

The physical activity duration data were also weighted by a MET estimate of energy

expenditure, based on the MET weights used by Stewart et al. 14 These were ≥ 2.5 MET for

walking, ≥3 MET but <6 MET for moderate-intensity activity and ≥ 6 MET vigorous-intensity

activity. These MET estimates are also consistent with those recommended in the recent

physical activity guidelines. 9 Finally data from the moderate- (including moderate-intensity

walking items), and vigorous-intensity constructs were summed to provide an estimate of total

activity (MET.min/wk).

Page 10 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 13: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

11

As the CHAMPS physical activity data were not normally distributed, all analyses were also

conducted on log-transformed CHAMPS data. However, since the findings of the analyses of

the original and transformed data were the same only the findings for the original data are

reported here using Spearman rank order correlation coefficients. The Spearman rank order

statistic uses ranked data (from highest to lowest score) instead of the actual scores. This

process eliminates outliers and normalises the distribution of the data, therefore allowing

correlations to be calculated, even for skewed data. 29 Data are reported as means and

standard deviations as well as the medians and 25th to 75th percentile ranges.

The consistency with which participants were classified as meeting activity recommendations

(sufficiently vs. insufficiently active) was assessed between T1 and T2 using percent

agreement and Cohen’s Kappa. Percent agreement refers to the number of participants

categorised within the same category across repeated measures, as a proportion of the total

sample. 29 Cohen’s Kappa measures agreement between two categorical variables that

corrects for chance agreement. 29

For the construct validity analysis, participant’s daily step count data were summed to

estimate total weekly step count. Of the CHAMPS data, only the walking and total activity

constructs were examined against the pedometer step counts. This is because these activity

constructs provide the most valuable information about the physical activity levels of older

adults and are most likely to be represented by step counts recorded by the pedometer. T1

and T2 CHAMPS walking and total activity data (sessions and MET.min/week) were

compared to the weekly step count data using Spearman correlations.

Page 11 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 14: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

12

Correlation coefficients (Spearman rho, Cohen’s Kappa) calculated in this study were

interpreted according to the cut-off values reported by Sim and Wright (2000). 30 Correlation

coefficients ≥ 0.75 indicate excellent reliability and kappa values between 0 - 0.20 indicate

poor to slight agreement, 0.21 - 0.40 indicate fair agreement, 0.41 - 0.60 indicate moderate

agreement, 0.61 - 0.80 indicate substantial agreement, and 0.81 - 1.00 indicate almost

perfect agreement. 30

RESULTS

Participant characteristics

Of the 100 database registrants invited to participate in the study, 73 returned a completed

questionnaire at T1. Fifty-four (74%) of these consented to participate in further data

collection and thus provided test-retest data (T1 and T2), but due to limited availability of

pedometers only 50 participants were sent a pedometer. Of the 50 sent a pedometer, 47

(94%) provided test-retest and step data. Unfortunately the exact timeframe between

questionnaire administrations could not be determined, but was less than 2-weeks. This time

lag is within the realms of acceptable test-retest repeatability assessment. 31

There were no differences between socio-demographic characteristics of the participants who

completed the questionnaire at T1 and those who consented to further data collection (see

Table 1). Most participants were women, aged 65-74 years, had post-secondary education

(certificate/trade, 28.2%; university, 32.4%), were retired, married, born in Australia, non-

Indigenous and spoke English as their main language. The sample of participants in this

study were generally representative of the wider sample of registry volunteers. Of the 292

volunteers registered at the time this study was conducted, most were women (64%), aged

65-74 years (61%); and were married (58%).

Page 12 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 15: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

13

Insert table 1 about here

Missing data analysis

Data from the 73 participants who returned questionnaires at T1 were screened for

completeness (see Table 2). As previously noted each CHAMPS item has three components.

Most participants completed the yes/no item regarding whether they had done a particular

activity in the past week (range 86% for moderate items to 99% for walking items). Fewer

participants provided complete frequency data than duration data. Complete frequency and

duration data were only available for approximately 63% of the moderate-intensity items and

81% of the vigorous-intensity items. Three-fifths of participants provided sufficient data for

the items necessary to assess whether participants were meeting the current physical activity

recommendations in terms of both frequency and duration.

Insert table 2 about here

Test retest reliability

Spearman correlations between CHAMPS T1 and T2 frequency data (sessions/week) were

good for moderate-intensity physical activity (rs= .70), and excellent for vigorous-intensity

physical activity, walking and HEPA (rs> .75; see Table 2). Correlations between CHAMPS

T1 and T2 duration data (min/week) were slightly lower but remained excellent for walking

(rs= .75). Test-retest reliability of the volume of physical activity reported (MET.min/week)

was again excellent for walking (rs= 0.75) and good for the other constructs (range rs= .62 -

.68; see Table 3). Intra-class correlations were excellent for all physical activity outcomes

Page 13 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 16: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

14

ranging from .78 - .93, except for duration of vigorous-intensity physical activity (ICC=.55).

Repeatability of the categorical estimates of meeting the current physical activity guidelines

(sufficient activity) were moderate with a kappa of .55 and 78% percent agreement (see Table

4).

Insert table 3 about here

Insert table 4 about here

Construct validity

For participants who provided complete T1 CHAMPS data, Spearman correlations between

the weekly step counts and walking frequency and duration were good (rs= .57 and rs= .40

respectively) but lower for total activity (see Table 4). Most participants (63%) reported that

they did ‘about the same amount of activity’, during the 7-d pedometer monitoring period,

giving some confidence to the comparability between the physical activity assessment

periods. However, some 19% of participants did not complete the question.

Insert table 5 about here

For those participants with complete duration data, Spearman’s correlations were considered

good for both walking (rs= 0.61) and HEPA duration (rs= 0.52). Agreement between the T2

self-report CHAMPS physical activity data and the total weekly pedometer step counts was

slightly better(see Table 5). Collectively these results suggest that the self-report data

Page 14 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 17: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

15

collected from the CHAMPS questionnaire has reasonable validity in this sample of older

adults.

DISCUSSION

CHAMPS was originally developed and tested as a self-complete physical activity

questionnaire for older adults in the United States. Stewart et al. (2001) 14 and Harada et al.

(2001) 18 have reported on its reliability and validity. It was shown to have acceptable six-

month stability and two-week test-retest reliability and was validated against various physical

function tests and self-reported quality of life measures. More recently Cyarto et al. (2006) 21

reported CHAMPS had good to excellent reliability coefficients for one-week test-retest

reliability and low but significant predictive validity coefficients against four physical

performance tests in a sample of older Australians living in retirement villages. All previous

work with CHAMPS has been conducted within the context of some face-to-face

administration.

The findings of this study show that physical activity frequency and duration data reported by

community dwelling older adults in a mailed self-complete version of CHAMPS are repeatable

and accurate. Good to excellent test-retest reliability coefficients were observed across all

the physical activity constructs (rs= .70 - .89 for sessions/week and rs= .65 - .75 for min/week),

and agreement between the proportions of participants classified as meeting the updated

physical activity recommendations between T1 and T2 were also good (79%; Kappa =.55).

In this study the validity of the CHAMPS physical activity data was assessed against

objectively measured step counts. It is important to note that there is no gold standard by

which the accuracy of self reported physical activity assessment tools can be assessed

Page 15 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 18: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

16

against. 32 Most self-report physical activity validation studies use accelerometers as their

criterion measure, however Tudor-Locke et al. 33 reported that pedometer step data correlate

strongly (r=0.86) with uniaxial accelerometer data, thus also provide suitable comparison

data.

The correlation coefficients between the weekly step counts and reported walking frequency

and duration recorded in this study were good (rs= .57 and rs= .40 respectively). However,

whilst the correlation coefficients between step counts and total reported physical activity

frequency was good (rs= .52), it was low for total activity duration (rs= .21). This discrepancy

may be explained by the fact that ambulatory activity is the only activity readily captured by a

pedometer. 33 Further that walking is the most preferred leisure time physical activity reported

by older adults. 26 But, for those older adults who do other activities, the pedometers may not

adequately record that activity. 34 This limitation, however, is not unique to this study and the

validity coefficients observed in this study are similar to those reported in previous trials.

14,18,21

What is of concern however, is that complete data were only available for approximately 60%

of participants who returned the questionnaire at T1. Cyarto et al. (2006) reported a similar

phenomenon where up to 25% of participants needed assistance to complete the

questionnaire. 21 When CHAMPS is administered in a face-to-face context, there is

opportunity for researchers to peruse the questionnaire for completeness and elicit complete

responses before the participant leaves the session. This is not possible in mail-based

administration. However, researchers should be encouraged to seek contact telephone

Page 16 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 19: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

17

details from respondents so that they may be telephoned immediately after receipt of the

questionnaire to clarify responses.

Further, as was reported in the introduction, each CHAMPS activity item has three

components, first the participants must indicate if they did the activity(yes/no), then recall and

report total weekly frequency and duration of each activity. Consistent with the report by

Cyarto et al. (2006) 21 participants in this study most often missed reporting the frequency

data, with up to 36% of participants failing to report that component. This may be because

frequency is the only component to be asked in open-ended response format. Further

investigation of closed response format for the frequency component is warranted.

Another way to reduce missing data may be to reformat the questionnaire, by increasing the

space between components so that each component is easier to see. However, this may

result in participants perceiving the questionnaire is too long to complete. If changes are

made to the formatting and response options, further reliability and validity testing is

warranted.

The findings of this study must be interpreted with the following methodological implications in

mind. In this study the CHAMPS recall period was altered. Participants were asked to report

what activity they had done in the past week, as opposed to recall a typical week in the past

four weeks. 14 This change was made because of recent evidence to suggest people are

more easily able to accurately recall past activities in this shorter time frame and it is less

open to over reporting of various activities performed just once in the past month. 13 In light of

this, there are implications for the comparability of the findings of this study or future data

Page 17 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 20: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

18

collected with this instrument to previous data collected using the original CHAMPS

questionnaire.

The following limitations should also be considered. Firstly, whilst study procedures aimed to

minimise the time between repeat administrations, the reliability coefficients may have been

influenced by real variation between repeat data collections. However as noted in the results,

most participants (63%) reported that they did ‘about the same amount of activity’ between

administrations. Another potential influence on reliability may be that participant’s recall of

their physical activity behaviour at T2 may have been affected by an increased awareness of

their physical activity as a result of completing the questionnaire at T1. Thirdly, although the

recruitment goal was met, this did not allow for missing data. Due to missing and incomplete

data in the CHAMPS questionnaire, the final sample available for most analyses was below

that required. However, despite the sample size restrictions to assess hypothesised

correlations between variables, associations between most variables were strong enough to

be detected with a 95% confidence. Finally, only the data that contributed to walking,

moderate- and vigorous-intensity physical activity were included in this study. CHAMPS also

assesses some sedentary and light-intensity activities. Whilst these items were initially

included to discourage older adults reporting these activities in other activity reports,14 further

exploration or comprehensive assessment of sedentary activities may be a valuable addition

to future iterations of the CHAMPS questionnaire.

To conclude, the mail-administered version of the CHAMPS questionnaire evaluated in this

study accurately and reliably estimated frequency and duration of time spent walking, in

moderate- and vigorous-intensity activity and total physical activity. A strength of this study

Page 18 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 21: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

19

was that the recruited participants represent the closest approximation of a non-volunteer

sample as is reasonably possible within a research context. Faith in the ability of collecting

CHAMPS data via mail-based administration is enhanced by the fact there was no face-to-

face contact between researchers and participants in this study. This suggests that this

version of the CHAMPS questionnaire may be particularly useful for research that aims to

establish physical activity levels among older adults who may not typically volunteer to attend

physical activity programs or screening sessions, or who may not be able to answer questions

administered over the phone (e.g., hearing loss due to aging). Further testing of the utility of

CHAMPS population-wide is warranted.

ACKNOWLEDGEMENTS

Participants in this study were recruited from the '50+ Registry' of the Australasian Centre on

Ageing, The University of Queensland. Statistical advice was gratefully received from Dr

Trisha Johnston (Queensland Health).

REFERENCES

1. National Ageing Research Institute. Participation in Physical Activity Amongst Older

People. Victorian Department of Human Services. 2003.

2. Bauman A, Bellew B, Vita P, Brown W & Owen N. Getting Australia Active: towards

better practice for the promotion of physical activity. Melbourne: National Public Health

Partnership. 2002.

3. World Health Organization. The World Health Report- 2002: Reducing Risks, Promoting

Healthy Life. Geneva: World Health Organization. 2002.

4. Kampert JB, Blair SN, Barlow CE, & Kohl H.W. Physical activity, physical fitness and all

cause and cancer mortality. Ann Epidemiol. 1996;6(5): 452-457.

Page 19 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 22: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

20

5. Lee IM & Paffenbarger RS Jr. Physical activity, fitness and longevity. Ageing. 1997; 9: 2-

11.

6. Paffenbarger, R, Hyde R, Wing A, Lee I, Jung D & Kampert J. The association of

changes in physical activity level and other lifestyle characteristics with mortality among

men. N Engl J Med. 1993; 328(8): 538-545.

7. Blair SN, Kohl HW III, Barlow CE, Ralph S, Paffenbarger MD Jr, Gibbons LW & Macera

CA. Changes in physical fitness and all cause mortality: a prospective study of healthy

and unhealthy men. JAMA. 1995; 273: 1093-1098.

8. Nelson ME, Rejeski WJ, Blair SN, Duncan PW, Judge JO, King AC, Macera CA,

Castaneda-Sceppa C. Physical activity and public health in older adults.

Recommendations from the American College of Sports Medicine and the American

Heart Association, Circulation. 2007; 116: 1094-1105.

9. Haskell WL., I-Min, L., Pate RR., Powell KE., Blair SN., Franklin BA., Macera CA., Heath

GE., Thompson PD., Bauman A. Physical Activity and Public Health. Updated

Recommendation for Adults from the American College of Sports Medicine and the

American Heart Association. Circulation. 2007; 116: 1081-1093.

10. Martin KA, Rejeski WJ, Miller ME, James MK, Ettinger WH Jr, & Messier SP. Validation

of the PASE in older adults with knee pain and physical disability. Med Sci Sports Exerc.

1999; 31: 627-633.

11. Dubbert PM, Vander Weg MW, Kirchner KA & Shaw B. Evaluation of the 7-Day Physical

Activity Recall in urban and rural men. Med Sci Sports Exerc. 2004; 36(9): 1646-1654.

12. King AC, Rejesk, WJ, & Buchner DM. Physical activity interventions targeting older

adults: a critical review and recommendations, Am J Prev Med. 1998; 15: 316-333.

Page 20 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 23: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

21

13. Stewart AL, & Hays RD. Conceptual, measurement and analytic issues in assessing

health status in older populations. In: Public Health and Aging, Hickey T & Speers M.

(eds.). Baltimore: The John Hopkins University press. 1997.

14. Stewart AL, Mills KM, King AC, Haskell WL, Gillis D. & Ritter PL. CHAMPS Physical

Activity Questionnaire for Older Adults: outcomes for interventions. Med Sci Sports

Exerc. 2001; 33(7): 1126-1140.

15. Washburn, R.A., Smith, K.W., Jette, A.M., & Janney, C.A. The physical activity scale for

the elderly (PASE): development and evaluation. J Clin Epi. 1993; 46: 153-162.

16. Bonnefoy, M., Normand, S., Pachiaudi, C., Lacour, J.P., Laville, M., & Kostka, T.

Simultaneous validation of ten physical activity questionnaires in older men: a doubly

labeled water study. JAGS. 2001; 49(1): 28-35.

17. O’Brien-Cousins, S. An older adult exercise status inventory: reliability and validity. J

Sport Behav. 1996; 19(4): 288-306.

18. Harada, N. D., Chiu, V., King, A.C., & Stewart, A.L. An evaluation of three self-report

physical activity instruments for older adults. Med Sci Sports Exerc. 2001; 33(6): 962-70.

19. Ball K, Salmon J, Leslie E, Owen N & King AC. Piloting the feasibility and effectiveness

of print- and telephone-mediated interventions for promoting the adoption of physical

activity in Australian adults. J Sci Med Sport. 2005; :8(2): 134-142.

20. Resnicow K, Mccarty F, Blissett D, Wang T, Heitzler C, Lee RE. Validity of a modified

CHAMPS physical activity questionnaire among African Americans. Med Sci Sports

Exerc. 2003; 35(9): 1537-1545.

21. Cyarto EV, Marshall AL, Brown WJ, Dickinson RK. Measurement properties of the

CHAMPS physical activity questionnaire in a sample of older Australians. J Sci Med

Sport. 2006; 9: 319-326.

Page 21 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 24: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

22

22. Cyarto EV, Myers AM, Tudor-Locke C. Pedometer accuracy in nursing home and

community-dwelling older adults. Med Sci Sports Exerc. 2004; 36(2): 205-9.

23. Bassett DR, Ainsworth BE, Leggett SR, Mathien CA, Main JA, Hunter DC & Duncan GE.

Accuracy of five electronic pedometers for measuring distance walked. Med Sci Sports

Exerc. 1996; 28: 1071–1077.

24. Crouter SE, Schneider PL, Karabulut M & Bassett DR. Validity of ten electronic

pedometers for measuring steps, distance, and energy cost. Med Sci Sports Exerc.

2003; 35: 1455–1460.

25. Schneider PL, Crouter SE, Lukajic O & Bassett DR. Accuracy and reliability of ten

pedometers for measuring steps over a 400-m walk. Med Sci Sports Exerc. 2003; 35:

1779-1784.

26. Yusuf HR, Croft JB, Giles WH, Anda RF, Casper ML, Caspersen CJ & Jones DA.

Leisure-time physical activity among older adults: United States, 1990. Arch Int Med.

1996; 156: 1321-1326.

27. Tudor-Locke C, Ainsworth BE, Thompson WW & Matthews CR. Comparison of

pedometer and accelerometer measures of free-living physical activity. Med Sci Sports

Exerc. 2002; 34(12): 2045-2051.

28. Sallis JF & Saelens BE. Assessment of physical activity by self-report: status, limitations

and future direction. Res Quart Exerc Sport. 2000; 71 (2): 1-14.

29. Tilley A. (1999). An Introduction to Research Methodology and Report Writing in

Psychology. Brisbane: Pineapple Press.

30. Sim J & Wright C. Research in health care: concepts, designs and methods.

Cheltenham. Stanley Thornes. 2000.

Page 22 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 25: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

23

31. Craig C, Marshall AL, Sjostrom M, BAUMAN A, et al. International physical activity

questionnaire: 12-country reliability and validity. Medicine and Science in Sports and

Exercise. 2003; 35(8): 1381-1395

32. Ainsworth BE, LaMonte MJ & Tudor-Locke C. Physical activity, In: Anderson R, editor.

Obesity: etiology, assessment, treatment, and prevention. Champaign (IL): Human

Kinetics. 2003.

33. Tudor-Locke C, Williams JE, Reis JP & Pluto D. Utility of pedometers for assessing

physical activity: convergent validity. Sports Med. 2002; 32(12): 795-808.

34. Schneider PL. Crouter SE & Bassett DR Jr. Pedometer measures of free-living physical

activity: comparison of 13 models. Med Sci Sports Exerc. 2004; 36(2): 331-335.

Page 23 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 26: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

24

Table 1: Demographic characteristics of participants

Time 1 n=73 n (%)

Time 2 n=54 n (%)

Chi-square (df) and p-

value

Age 65-69 34 (46.6) 27 (50) 70-74 18 (24.7) 12 (22.2)

>75 21 (28.8) 15 (27.8)

X2(4)=.99, p = 0.90

Gender

Male 28 (38.4) 20 (37) Female 45 (61.6) 34 (63)

X2(1)=.04, p = 0.84

Education

Primary school 7 (9.9) 5 (9.3) grade 10 / 4th form 13 (18.3) 10 (18.5) grade 12 / 6th form 8 (11.3) 6 (11.1)

Certificate / trade 20 (28.2) 16 (29.6) University 23 (32.4) 17 (31.5)

X2(4)=.79, p = 0.99

Employment

Retired 66 (93) 52 (96.3) Casual and/or Part-time Paid work 4 (5.6) 2 (3.7)

Home duties 1 (1.4) 0

X2(1)=.05, p = 0.82

Marital status

married / have partner 46 (63) 33 (61.1) single / divorced / widowed 27 (37) 21 (38.9)

X2(3)=.49, p = 0.92

Country of birth

Australia 57 (78.1) 39 (72.2) England 9 (12.3) 8 (14.8)

Other 7 (9.6) 7 (13.1)

X2(5)=8.12, p = 0.15

Ethnicity

Aust. South Sea Islander 5 (8.6) 4 (8.9) Non-indigenous 53 (91.4) 41 (91.1)

X2(1)=.01, p = 0.95

Main Language spoken at home

English 72 (98.6) 53 (98.1) Missing 1 1 N/A

Page 24 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 27: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

25

Table 2: Number (%) of participants with complete data for each component of the CHAMPS physical activity items (n=73)

Physical activity construct

Yes/No n (%)

Frequency n (%)

Duration n (%)

Frequency & Duration

n (%) Walking 72 (99%) 50 (68%) 67 (92%) 47 (64%) Moderate-intensity 63 (86%) 47 (64%) 60 (82%) 46 (63%) Vigorous-intensity 70 (96%) 59 (81%) 70 (96%) 59 (81%) Total activity* 61 (84%) 44 (60%) 58 (79%) 43 (59%)

* sum of all reported moderate and vigorous walking, and moderate- to vigorous-intensity physical activity.

Page 25 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 28: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

26

Table 3: Descriptive profile and 1-2 week test-retest reliability of physical activity outcomes derived from CHAMPSdata for participants with complete matched data

Time 1 Time 2

Physical activityconstruct n Mean (SD)

Median(25th - 75th %ile)

Mean (SD)Median

(25th - 75th %ile)Spearman

rho

Intra classcorrelation

(95% CI)

Frequency per weekWalking 33 7 (5) 6 (3-10) 7 (6) 5 (2-11) .88 .93 (.86-.97)Moderate-intensity 32 6 (5) 6 (1-11) 7 (6) 6 (1-11) .71 .83 (.66-.92)Vigorous-intensity 38 2 (3) 0 (0-3) 2 (2) 0 (0-3) .76 .86 (.74-.93)Total activity 29 9 (7) 8 (3-13) 9 (8) 8 (2-6) .79 .89 (.77-.95)

Duration (min/week)All Walking 42 232 (156) 180 (128-349) 228 (201) 165 (90-345) .78 .83 (.68-.91)Moderate-intensity 41 348 (382) 255 (68-458) 302 (306) 240 (83-473) .61 .79 (.61-.89)Vigorous-intensity 46 66 (107) 45 (0-90) 63 (98) 30 (0-90) .68 .79 (.61-.88)Total activity 39 395 (440) 300 (90-480) 344 (323) 255 (90-525) .57 .81 (.63-.90)

Volume MET.min/wkWalking 42 793 (585) 668 (338-1059) 802 (759) 597 (225-1076) .75 .85 (.71-.92)Moderate-intensity 41 1234 (1333) 960 (225-1658) 1066 (1083) 885 (251-1702) .63 .80 (.63-.89)Vigorous-intensity 46 413 (689) 270 (0-540) 405 (637) 188 (0-540) .68 .78 (.59-.88)Total activity 39 1553 (1774) 1245 (428-1943) 1344 (1243) 1005 (323-2063 .62 .84 (.69-.91)

Page 26 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 29: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

Page 27 of 28

Table 4: Proportion of participants reporting sufficient physical activity to meet current physical activity recommendations (at least 150 min across five sessions per week) and the consistency of classification over time (n=28)

Time 2

Time 1

Met recommendations

n (%)

Did NOT meet recommendations

n (%) Kappa %

Agreement

Met recommendations 14 (50) 4 (14)

Did NOT meet recommendations 2 (7) 8 (29)

0.55 79

Page 27 of 28 Journal of Physical Activity and Health © Human Kinetics, Inc.

Page 30: Journal of Physical Activity and Health (2), pp. 221-229. · easier, the original version of CHAMPS used six response categories (i.e.,

Measuring older adults physical activity

Page 28 of 28

Table 5: Descriptive profile and criterion validity coefficients of CHAMPS T1 and T2physical activity data (walking and total activity) and pedometer step counts activity for participants with complete matched data

nSteps/wk Mean (SD)

CHAMPS T1 Mean (SD)

Spearman rho

CHAMPS T2 Mean (SD)

Spearman rho

Walking Frequency/wk 34 60,320

(25,068) 7 (5) .57* 7 (6) .60*

Walking MET.min/wk 44 58,295

(23,721) 795 (644) .40* 789 (751) .53*

HEPA Frequency/wk 31 61,190

(23,529) 9 (8) .52* 7 (7) .52*

HEPA MET.min/wk 38 58,019

(22,655) 1539 (1795) .21 1268 (1262) .38*

* significant p<.01

Page 28 of 28Journal of Physical Activity and Health © Human Kinetics, Inc.