- Research article
- Open Access
Concurrent and discriminant validity of ActiGraph waist and wrist cut-points to measure sedentary behaviour, activity level, and posture in office work
BMC Public Health volume 21, Article number: 345 (2021)
Sedentary Behaviour (SB) gets an increasing attention from ergonomics and public health due to its associated detrimental health effects. A large number of studies record SB with ActiGraph counts-per-minute cut-points, but we still lack valid information about what the cut-points tell us about office work. This study therefore analysed the concurrent and discriminant validity of commonly used cut-points to measure SB, activity level, and posture.
Thirty office workers completed four office tasks at three workplaces (conventional chair, activity-promoting chair, and standing desk) while wearing two ActiGraphs (waist and wrist). Indirect calorimetry and prescribed posture served as reference criteria. Generalized Estimation Equations analysed workplace and task effects on the activity level and counts-per-minute, and kappa statistics and ROC curves analysed the cut-point validity.
The activity-promoting chair (p < 0.001, ES ≥ 0.66) but not the standing desk (p = 1.0) increased the activity level, and both these workplaces increased the waist (p ≤ 0.003, ES ≥ 0.63) but not the wrist counts-per-minute (p = 0.74) compared to the conventional chair. The concurrent and discriminant validity was higher for activity level (kappa: 0.52–0.56 and 0.38–0.45, respectively) than for SB and posture (kappa ≤0.35 and ≤ 0.19, respectively). Furthermore, the discriminant validity for activity level was higher for task effects (kappa: 0.42–0.48) than for workplace effects (0.13–0.24).
ActiGraph counts-per-minute for waist and wrist placement were – independently of the chosen cut-point – a measure for activity level and not for SB or posture, and the cut-points performed better to detect task effects than workplace effects. Waist cut-points were most valid to measure the activity level in conventional seated office work, but they showed severe limitations for sit-stand desks. None of the placements was valid to detect the increased activity on the activity-promoting chair. Caution should therefore be paid when analysing the effect of workplace interventions on activity level with ActiGraph waist and wrist cut-points.
Sedentary Behaviour (SB), defined as sitting or reclining with ≤1.5 Metabolic Equivalents (MET) , is a substantial part of the modern lifestyle, accounting for 8.5–10 h a day or 60–70% of waking time [2,3,4]. Up to 72 and 81% of the European Union and United States population works in the tertiary, predominantly office based sector . Office workers spend around 64–82% of their working time sedentary [6,7,8], and accumulate half of their sedentary time during working hours, predominantly in long bouts [9, 10]. Thus, office work is of critical importance for public health, and some public health authorities included SB in their physical behaviour recommendations , but office workers show bad adherence .
The use of workplace interventions to break up prolonged SB, like standing desks and activity-promoting office chairs , is highly recommended . These interventions typically address one of the two components of SB: 1) break up prolonged sitting with standing, or 2) break up prolonged minimal-intensity physical activity (minPA, ≤1.5 MET ) with light-intensity physical activity (LPA, > 1.5 MET) (operational definitions are given in Table 1).
To break up the posture component of SB, there is some evidence that sit-stand desks reduce the sitting time by around 100 min a day in short-term (≤3 months) and 60 min a day in mid-term (3 to 12 months) compared to sit-desks [17, 18], without compromising user comfort and productivity [19, 20]. If combined with other interventions like counselling, prompts or social support, the effect might remain also in long-term (> 12 months) [21, 22]. In contrast, interventions to break up the activity component of SB show inconsistent findings [18, 23], with potentially negative effects on work performance . An activity-promoting chair showed a 20% activity increase compared to normal sitting , with unknown short-, mid- and long-term effects [18, 25].
Unfortunately, the evidence for the effects of workplace interventions is mixed, which could be related to, among other things, the use of inconsistent SB measurements [17, 18, 22, 25]. While self-reported measures are known to have a poor validity [26, 27], the objective methods to measure SB use two different principles: accelerometers worn on the thigh using the sensor orientation versus gravity to determine the posture component of SB (i.e. activPAL, PAL Technologies, Glasgow, SCO), and accelerometers worn on the waist using a proprietary counts-per-minute (cpm) measure to determine the physical activity component of SB (i.e. ActiGraph, ActiGraph Corp., Pensacola, USA) [17, 18, 22]. Posture-based devices are highly valid to measure sitting and should therefore be the first choice to analyse the effects of workplace interventions targeting posture, i.e. reducing the time spent sitting [28, 29]. On the other hand, it is unclear what the activity-based devices tell us about office work. A recent review on daily sedentary patterns included 64 studies, of which 43 used a waist-worn ActiGraph with a cut-point of 50, 100, or 150 cpm . To measure SB, cut-points between 25 and 250 cpm for the vertical axis (VA) and between 100 and 200 cpm for the vector magnitude (VM) are used . However, to measure minPA, the activity component of SB, VA cut-points between 50 and 200 cpm are recommended [32, 33], and to measure sitting, the posture component of SB, VA cut-points between 22 and 150 cpm are recommended [29, 34,35,36]. The ActiGraph is nowadays also worn at the wrist, with a recommended VM cut-point to detect sitting of 1′853 cpm .
Overall, it remains unclear what all these ActiGraph cut-points tell us about office work and workplace interventions, and whether they measure behaviour, activity, or posture (Table 1). The present study therefore analysed the concurrent validity of commonly used waist and wrist cut-points to detect SB, minPA, and sitting, as well as the discriminant validity of commonly used waist and wrist cut-points to separate SB from non-SB (behaviour classification), to separate minPA from LPA (activity classification), and to separate sitting from standing (posture classification).
A convenience sample of 30 office workers from the local community with at least 70% employment rate, all spending at least 50% of their work time at an office desk was recruited. Office workers with silicon allergy were excluded. The participants (53% women) averaged 38.8 ± 9.0 years, 71.2 ± 11.1 kg, and 1.74 ± 0.08 m. They worked on average 40.5 ± 6.6 h a week, of which 78 ± 15% seated at an office desk (self-reported).
Experimental procedure and equipment
All participants visited a single office at the University in Winterthur (SUI) normally used by the researcher in charge of data recording. For the indirect calorimetry measurement, they refrained from eating and consuming sugary and caffeinated drinks for 2 h prior to the measurement, from any kind of physical activity for 12 h, and from nicotine for 2 h [37, 38]. The office was equipped with a sit-stand desk, a laptop with external mouse, a desktop computer with two screens, and two office chairs (a conventional and an activity-promoting chair). To account for different workplace designs, we pragmatically decided to let participant 15 to 24 use a laptop, while the others used a desktop computer (Fig. 1).
Each participant completed four office tasks with different activity levels [12, 39]. Two tasks were computer-assisted (Mouse and Keyboard), one task was partly computer-assisted (Deskwork), and one task was non-computer-assisted (Sorting). The Mouse task was playing mah-jong, the Keyboard task was writing a text, the Deskwork task included successive short tasks like getting a physical folder, search in it, do mental arithmetic, write notes, and switch screen views, and the Sorting task consisted of opening envelopes and stow the documents according to the instruction on it in specified storage compartments and physical folders. Each task was performed at three workplaces: a conventional office chair (Vitra, Birsfeld, SUI), an activity-promoting office chair (rotavis, Winterthur, SUI), and a standing desk (Fig. 1). The activity-promoting chair is described in detail elsewhere [40, 41]. In short, the chair has a moveable seat allowing the user to move the pelvis to the left and right while keeping a stable upper body position to not interfere with office work demands. An unpublished study showed that this chair has the potential to increase the activity level from minPA to LPA, and thus to break up SB. The activity-promoting chair was combined with an oral prompt to remind participants every minute to move the seat of the chair if they did not move it.
Participants were equipped with two ActiGraph accelerometers (wGT3X-BT at the left waist mounted with an elastic stripe, GT9X-Link at the left wrist mounted with a wristband) and the indirect calorimeter (K5, cosmed, Rome, Italy) with size-matched facemask. All sensors were initialised with the same computer to ensure synchronous recordings. The ActiGraphs recorded with 30 Hz and disabled idle sleep mode. The indirect calorimeter recorded with 0.1 Hz in the mixing chamber mode. Note that the study included additional sensors not used for the present analysis and thus reported elsewhere . The participants completed the four tasks at each of the three workplaces in random order, ensuring that the same task and workplace never occurred in succession. Before each task was recorded, participants set up the workplace according to their preferences, but they could modify the setting at any time during the recording. Based on a pilot study in which we observed the onset of steady state energy expenditure after 4 min at the latest, all tasks were recorded for 5 min. After completion of the twelve office tasks, an additional resting measurement was conducted. The participants were lying for 10 min on a yoga mat with the office door closed and the sunblind lowered.
ActiGraph data were downloaded with ActiLife Version 6.13.4 and exported to 1 s-epoch cpm files in csv-format using the normal and the low-frequency-extension filter. Following the recommendation to use the low-frequency-extension filter for lower intensity activities , only the low-frequency-extension filtered data are presented in the manuscript, the normal filtered data can be found in Additional file 1. K5 data were downloaded with Omnia Version 1.6.7 and exported as csv-file. The csv-files were loaded into Matlab 2019a for processing and analyses.
The ActiGraph 1 s-epoch cpm files were summarized into minute-by-minute data using the start information of each task. The time-matched K5 data was processed on a task-by-task level, and all ActiGraph minutes of a task were assigned to either minPA or LPA using the median steady state MET. Therefore, the respiratory gas exchange was converted into the metabolic rate using the Weir equation (metabolic rate = 1.44 [3.94 VO2 + 1.11 VCO2]) and put in relation to the resting metabolic rate. The resting metabolic rate was defined as the median metabolic rate during the second 5 min of the resting measurement [44, 45]. For each task, only steady state data was considered. The onset of steady state was defined by the first minute with less than 10% deviation from the median of all subsequent minutes, but earliest after one and latest after 4 min . All minutes of each task were furthermore assigned into the prescribed posture (sitting for the conventional and activity-promoting chair, standing for the standing desk, verified by direct observation).
To analyse whether the MET values, the activity classification (minPA with ≤1.5 MET or LPA with 1.5–3.0 MET), and the ActiGraph’s cpm values differed between the workplaces and tasks, Generalized Estimation Equations followed by pairwise post-hoc comparisons with Bonferroni-adjusted p-values were used (performed in SPSS 27, IBM, Armonk, USA). Level of significance was set to 0.05. Following the recommendation to include effect sizes as a measure of importance of a statistical effect, significant MET and cpm effects were quantified with the effect size based on the Wilcoxon-matched-pair statistics (ES) . No effect sizes were calculated for the activity classification as we are not aware of an established statistics to calculate effect sizes for binary classification data. The effects were considered small (0.1–0.3), medium (0.3–0.5), or strong (≥0.5) . Note that the workplace effects were analysed to check whether there is an additional need to analyse the discriminant validity for effects caused by workplaces only.
The concurrent validity analysed the ability of the cpm cut-points to detect SB, minPA, and sitting over the entire data set, as well as for each workplace and task separately. The discriminant validity analysed the ability of the cpm cut-points to discriminate SB from non-SB (behaviour classification), to discriminate minPA from LPA (activity classification), and to discriminate sitting from standing (posture classification) on an individual level over the entire data set, as well as for effects caused by workplaces and tasks only. Both validities used kappa statistics with 95% confidence intervals  and ROC curves with sensitivity and specificity. The agreement with the reference criteria was considered poor (kappa < 0.00), slight (0.00–0.20), fair (0.21–0.40), moderate (0.41–0.60), substantial (0.61–0.80), or almost perfect (≥0.81) . The waist-worn ActiGraph used cut-points between 22 and 250 cpm (VA) and between 100 and 200 cpm (VM) [31, 36]. The wrist-worn ActiGraph used cut-points between 1′000 and 3′000 cpm (VM). For a better understanding, the ROC curves include also lower (down to 0 cpm) and higher cut-points (up to 500 and 750 for waist VA and VM, up to 15′000 for wrist VM).
The analysis considered all recorded ActiGraph minutes of each participant. To test for dependence effects (each participant contributed for each workplace-task combination five subsequent minutes), the entire analysis was repeated for each minute individually (minute 1 to minute 5). Since kappa for the individual minutes lay mostly within the 95% confidence interval of the all minutes’ approach (Additional file 2), only the results of the all minutes’ approach are presented.
Of the 1′800 recorded minutes, 1 min had to be excluded due to non-compliance with the study protocol (standing for conventional chair). To simplify the analysis, the missing minute was replaced with the median cpm of the task. Across all workplaces and tasks, the participants reached the steady state MET within the first 2 min in 83.6% of the cases, after 3 min in 12.5% of the cases, and after 4 min in the remaining 3.9% of the cases.
Workplace and task effects on the MET value and the activity classification
There was an overall workplace effect on the MET value and the activity classification (Table 2). The activity-promoting chair caused a significantly higher MET and lower minPA classification compared to the conventional chair and the standing desk (p < 0.001, ES ≥0.66). No differences between the conventional chair and the standing desk were found (p = 1.000).
There was an overall task effect on the MET value and the activity classification as well (Table 2). Sorting caused the highest MET and lowest minPA classification (p < 0.001, ES ≥0.86), and Deskwork caused a higher MET and lower minPA classification then Keyboard and Mouse (p < 0.001, ES ≥0.40). Despite no difference in the minPA classification, Keyboard caused a significantly higher MET value compared to Mouse (p = 0.002, ES = 0.42).
Workplace and task effects on cpm
There was an overall workplace effect on the waist VA and VM but not the wrist cpm (Table 3). The waist VA and VM cpm were highest for the activity-promoting chair (p ≤ 0.007, ES ≥0.34), and lowest for the conventional chair (p ≤ 0.003, ES ≥0.63).
There was an overall task effect on the waist and the wrist cpm. Both placements significantly differed between all tasks (p ≤ 0.002, ES ≥0.29), except between Mouse and Keyboard (p ≥ 0.114).
Concurrent validity to detect SB, minPA, and sitting
All sensors reached a fair agreement with the reference criteria to detect SB (kappa: 0.21–0.35), a moderate agreement to detect minPA (0.52–0.56), and a poor to slight agreement to detect sitting (-0.20–0.03, Fig. 2). The ROC curves showed for both placements the same pattern as kappa, with the detection of minPA having the highest sensitivities and specificities and sitting the lowest, rarely above the 45° line.
Concurrent validity to detect minPA, separated by workplace and task
The minPA detection for each workplace (Fig. 3a) showed for the waist VA and VM a substantial agreement with the reference criterion for the conventional chair and the standing desk (kappa: 0.66–0.70), and a fair agreement for the activity-promoting chair (0.26–0.38). The wrist sensor reached for all workplaces a moderate agreement with the reference criterion (0.51–0.60). For both placements, the ROC curves for the conventional chair and the standing desk were similar but slightly shifted (conventional chair with higher sensitivity and lower specificity), while the curve for the activity-promoting chair was lower.
The minPA detection for each task (Fig. 3b) showed a less clear pattern, except that the Mouse reached the highest agreement with the reference criterion for both placements, moderate for the waist (0.41–0.44) and fair for the wrist (0.32). In line, the Mouse reached the highest sensitivities and specificities in the ROC curves.
Discriminant validity for the behaviour, activity, and posture classification
All sensors reached a slight agreement with the reference criteria to discriminate the behaviour (SB and non-SB, kappa: 0.02–0.19, Fig. 4), a fair to moderate agreement to discriminate the activity level (minPA and LPA, 0.38–0.45), and a poor agreement to discriminate posture (sitting and standing, -0.19 – -0.09). The ROC curves in Fig. 4 do not proceed from the origin (0% sensitivity, 100% specificity) to the most upper right point (100% sensitivity, 0% specificity) since the sensitivity/specificity to discriminate between real differences does not continuously increase/decrease with increasing cut-point.
Discriminant validity for the behaviour, activity, and posture classification, separated by workplace and task effects
For workplace effects, the waist VA and VM showed a slight and poor agreement with the reference criteria to discriminate the behaviour (SB and non-SB, kappa: 0.10 and -0.20), a fair agreement to discriminate the activity level (minPA and LPA, 0.22–0.24), and a poor agreement to discriminate posture (sitting and standing, -0.44 – -0.10). The wrist reached for all classifications a slight agreement with the reference criteria (0.08–0.13). While the waist reached a sensitivity of up to 72% (VM, activity level), the wrist never exceeded a sensitivity of 11%.
For task effects on the activity level, both placements showed a moderate agreement with the reference criteria (0.42–0.48). The sensitivity reached for both placements 75% (waist) and 79% (wrist).
This study analysed the concurrent and discriminant validity of commonly used waist and wrist cpm cut-points while performing four office tasks (Mouse, Keyboard, Deskwork, Sorting) at three workplaces (conventional chair, activity-promoting chair, and standing). The concurrent validity analysed the ActiGraph’s validity to detect SB (≤1.5 MET while sitting), minPA (≤1.5 MET regardless of body posture), and sitting. The discriminant validity analysed the ActiGraph’s validity to separate SB from non-SB (behaviour classification), to separate minPA from LPA (activity classification), and to separate sitting from standing (posture classification).
In general, the validity was higher for the minPA than for the SB and sitting detection, and higher for the activity than the behaviour and posture discrimination. Accordingly, the ActiGraph cpm cut-points represent a measure for activity, and not for SB or posture. Furthermore, the validity was higher to detect task effects than to detect workplace effects. Caution is warranted when analysing workplace effects on the activity level with ActiGraph cpm cut-points.
Concurrent validity to detect SB, minPA, and sitting
No matter which sensor placement nor axis was analysed, there was an overall fair agreement with the reference criteria to detect SB in the study population (Fig. 2). However, when the same cut-points are interpreted as detection of minPA, the agreement was higher (moderate) and the ROC curves showed higher sensitivities and specificities. For the conventional chair and the standing desk, there was even a substantial validity to detect minPA with the waist placement. This indicates that the cpm cut-points investigated in this study measure minPA. However, the workplace analysis in Fig. 3a shows a serious limitation of the waist cut-points with respect to posture. For the VA, the cut-point with highest kappa to detect minPA was substantially higher for the standing desk (around 150 cpm) than for the conventional chair (around 75 cpm). If using the same cut-point to detect minPA for both workplaces (e.g. 100 cpm with a kappa of 0.65 for both workplaces), the detection of minPA has a higher sensitivity and lower specificity for sitting than standing (see ROC curve in Fig. 3a and separate sensitivity and specificity in Additional file 3 - Fig. 2). Thus, standing will be likely classified as more active than sitting even when there is no true difference in the activity level as in the present study. The same observation was also made for the waist VM. This limitation is likely caused by the fixed pelvis height in sitting, which causes fewer cpm compared to standing. A similar observation has repeatedly been reported for cycling [50, 51]. Based on these results, the waist VA and VM should only be used in combination with a posture-based sensor and posture-specific cut-points in case the activity level at a sit-stand desk is analysed. A moderate valid alternative to detect minPA would be to use the wrist VM with similar sensitivities and specificities for the conventional chair and the standing desk.
Although developed to detect physical activity, the ActiGraph was repeatedly calibrated to detect sitting [29, 34,35,36]. For example, Koster and colleagues  reported only slightly different balanced sensitivities and specificities to detect sitting as this study observed to detect minPA (Koster vs. this study): 75.9% vs. 77.1% (waist-worn, VA, 100 cpm), 83.7% vs. 78.1% (waist-worn, VM, 200 cpm), and 79.1% vs. 76.4% (wrist-worn, VM, 1853 cpm). For the sitting detection, this study observed for all cut-points sensitivities and specificities very close to or even below the 45° line in the ROC curve with mostly negative kappa, indicating a similar or lower validity than what would be expected by chance. The large difference is likely a result of the measurement setting. This study recorded exactly the same tasks in sitting and standing, and the observed sensitivities and specificities depended only on body posture. In contrast, the cited studies recorded the natural behaviour in a free-living setting where a substantial agreement between minPA and sitting exists [4, 52]. Matthews and colleagues  reported an average minPA time of 9.7 h a day (ActiGraph waist, VA, 100 cpm), and an average sitting time of 9.8 h a day (activPAL). However, the relationship between the minPA and sitting time varies depending on the study sample, which is why different studies recommend different cut-points to get the most similar minPA and sitting time [29, 34,35,36]. Clarke-Cornwell and colleagues  noticed such a variation even within one sample in relation to day (weekday vs weekends) and task (working vs non-working). Based on our results, we clearly advise against interpreting the ActiGraph measured time as sitting. If the sitting time is of interest, a posture-based device should be employed. If the minPA time is of interest, an activity-based device should be employed. Unless both devices are combined, one should not interpret the results as if SB has been measured. Only when the different constructs are correctly applied, it will get possible to investigate whether minPA, sitting, or the combination thereof (SB) causes the detrimental health effects currently associated with SB. While this clear distinction might be less important for epidemiological studies due to the substantial agreement of minPA and sitting time in free-living, it is all the more important when studying the effects of workplace interventions. These are typically aimed to break up either minPA (e.g. activity-promoting chairs) or sitting (e.g. sit-stand desks), but rarely both (e.g. treadmill desks). For example, if it turns out that the health effects currently associated to SB are in fact caused by minPA but not by sitting, the recommendation for using standing workplaces could be questioned from the sedentary research perspective. Furthermore, if the measured times are interpreted on an individual level to detect daily behaviour patterns or prolonged sitting bouts , the simplification of equating minPA with sitting holds no longer true. In line with Matthews et al. , we noticed in a recent study a very small bias (− 7 min per day) between minPA (ActiGraph, waist-worn, VA, 100 cpm) and sitting (activPAL), but a very large bias (− 105 min per day) between the two sensors when looking at the time spent in bouts ≥10 min . A similar underestimation of prolonged sitting was found in other studies [52, 55], indicating that prolonged sitting (activPAL) contains some LPA minutes (ActiGraph) breaking up SB. In this respect, we consider it important to combine the activPAL to measure sitting with the ActiGraph to measure minPA in order to uncover the true activity level of free-living sitting and standing, inside and outside the office workplace. This combination would further allow to use posture-specific cut-points for the activity classification, to measure SB in line with its definition , and ultimately to fuse the physical behaviour measurements of occupational and public health.
Discriminant validity for the behaviour, activity, and posture classification
The validity to discriminate activity level into minPA and LPA was substantially higher than the validity to discriminate behaviour into SB and non-SB and to discriminate posture into sitting and standing. Accordingly, differences in cpm cut-point classifications should be interpreted as differences in the activity level, and not as differences in the behaviour or posture classification.
To inspect the cut-points’ ability to detect the effect of an active workplace intervention, the study combined an activity-promoting office chair with an oral prompting. This combination had a strong effect on the activity level compared to the conventional chair and the standing desk. It significantly increased the participants MET by around 13%, thereby reducing the minPA time and thus SB by around 32%.
In line, the average cpm for the waist VA and VM significantly differed between the activity-promoting and conventional chair, while there was no workplace effect for the wrist VM (Table 3). This observation can be explained by the investigated chair: The activity-promoting chair reduced the time in minPA by continuous lateral pelvis movements increasing the waist but not the wrist cpm. Accordingly, the waist reached a higher, but still only a fair validity to discriminate the activity level. It is therefore questionable whether the waist placement detects a true activity change induced by a seated active workplace intervention in a future field study. This is all the more remarkable as the activity-promoting chair directly affected the movement pattern of the pelvis. We assume that the conversion from the raw acceleration to the cpm is not sensitive enough to detect an increased activity caused by a continuous, impact-free pelvis motion with a cut-point approach, and would expect even lower validities for an active workplace intervention not affecting the pelvis motion (e.g. cycling desk). Consequently, a seated, impact-free active workplace intervention should not be analysed with a waist or wrist cut-point.
Due to the prescribed posture, the standing desk eliminated SB completely, but there was no effect on the MET value nor on the activity classification. This observation is in line with [56, 57] but stays in contrast to [58, 59].
Despite the same activity level, there was a strong workplace effect on the waist VA and VM cpm (ES ≥0.63), both having significantly higher cpm for the standing desk than the conventional chair. In a study investigating the effect of a sit-stand-desk on the time spent in minPA with a waist-worn sensor (e.g. ), this might wrongly result in standing to be considered more active than sitting. This observation underlines our recommendation to combine the waist placement with a posture-based sensor and apply posture-specific cut-points if participants use a sit-stand desk, and stays in contrast to the Cochrane review on workplace interventions that considered the ActiGraph waist as valid to evaluate the effect of sit-stand desks on SB . The wrist sensor, on the other hand, had no different cpm value between conventional sitting and the standing desk, and detected minPA with a moderate agreement for all workplaces. Thus, if the waist sensor is not combined with a posture-based sensor, the wrist should be the placement of choice to analyse the effect of sit-stand desks on the activity level.
In line to the poor concurrent validity to detect sitting, the validity to discriminate sitting and standing was poor and below what would be expected by chance for all cut-points. We therefore conclude, in accordance with previous research , that the discrimination of posture into sitting and standing with cut-points is not valid.
Research repeatedly observed that the activity level is more influenced by the office task than the workplace [12, 62]. Although this study noticed a strong effect of the activity-promoting chair, it noticed an even stronger effect when changing from a computer-assisted task (Mouse, Keyboard) to a non-computer-assisted task (Sorting, Table 2). The average cpm for all tasks were significantly different, except between Mouse and Keyboard, which had a different MET but no different activity level. The validity to discriminate the activity level caused by task effects was moderate for the waist and fair for the wrist, and all cut-points performed better to discriminate between task effects than workplace effects (Fig. 5). In fact, the waist cut-points are moderate valid to detect task effects on the activity level.
Strengths and limitations
The present study measured an office worker sample while performing office work, and the findings might not be transferrable to situations outside the office. On the other hand, the majority of the population works in the office sector, and office work is the single largest contributor to SB in the population. Office work is therefore a highly relevant behaviour, even for population-based epidemiological studies. The included sample contained office workers in a wide range of age (23–57 years), weight (55–100 kg), height (1.55–1.91 m) and BMI (19.5–33.0 kg/m2), with eight overweight and one obese, but 2/3 were below 40 years. Most of the participants reported to stand less than 5 h a week at their desk, four between 5 to 10 and 10 to 15 h, respectively, and one > 15 h. The average office worker spends around 64–82% of the working time sedentary, while our sample reported to sit for 78% of their working time at an office desk. Thus, we consider our sample to be representative for a general office worker population despite its slightly young age.
This study showed that the three included workplaces were actually different from each other, and both the activity-promoting chair (reducing minPA) and the standing desk (eliminating sitting) reduced SB. To analyse the sensitivity of the observed effects, the entire inferential statistic was repeated with traditional methods (Friedman test), and exactly the same effects as with the Generalized Estimation Equations were observed. However, whether the activity-promoting office chair in combination with oral prompting is an effective intervention to break up SB at office workplaces remains subject to future field studies. Due to the study method with four office tasks performed at each of the three workplaces, the results of the posture analysis are solely caused by body posture, unaffected by the activity level. This is why the presented validities stay in contrast to those reported in field studies with a substantial agreement between sitting and minPA.
Another strength of this study is the inclusion of both a waist- and wrist-worn ActiGraph, and the analysis of VA and VM for the waist sensor. Furthermore, the study used both kappa and ROC curves and studied the concurrent and the discriminant validity, for the low-frequency-extension and the normal filtering (see Additional file 1). We are aware that kappa is affected by the prevalence- and bias-index . The interested reader therefore finds in Additional files 1 and 3 the prevalence-adjusted-bias-adjusted-kappa. However, we consider the kappa to reflect the true situation penalized for prevalence and bias, while the prevalence-adjusted-bias-adjusted-kappa relates to a hypothetical situation with balanced behaviours . With respect to office work, the prominent minPA is a true challenge for each measurement system.
The data of the indirect calorimeter were processed on a task-by-task level, while the ActiGraph data were processed on the typical minute-by-minute level. In case the true activity level was for one task LPA for 1 min and minPA for 4 min, our reference criterion classified the entire 5 min as minPA. It therefore might be that the validity of the ActiGraph cut-points is marginally higher than reported due to the task-by-task processing for the reference criterion. However, no substantial deviations in the individual minute analysis were found (Additional file 2). In this regard, it is also important to mention that the lab-based nature of the present study with only a selection of office tasks is a further limitation. The participants of this study performed each task for 5 min to ensure the detection of a steady-state MET, while in free-living office workers might change from one task to another and from one workplace to another several times a minute. However, office workers are known to spend most of their working time sedentary, and accumulate their sedentary time predominantly in long bouts with rare posture changes [9, 10]. Furthermore, this study classified all tasks into minPA and LPA, although one subject exceeded once the upper MET threshold for LPA (3.0 MET) and should have been classified as moderately physically active. To separate the activity level in minPA and LPA, the study used a threshold of 1.5 MET [1, 64]. This threshold is the reason why the Mouse and Keyboard have a significantly different MET but a similar activity classification. Although widely accepted, it is important to note that the 1.5 MET threshold is arbitrary and there is no health-relevant evidence supporting the threshold. We therefore reported the MET along with the activity level. An increase from 1.35 to 1.45 MET might have similar health effects as an increase from 1.45 to 1.55 MET.
This study showed that the ActiGraph cpm for waist and wrist placement is, independently of the chosen cut-point, a measure for the activity level and not for SB or sitting. The cpm cut-points performed generally better to discriminate the activity level caused by task effects than workplace effects. Waist cut-points were most valid to measure the activity level in conventional seated office work, but they showed severe limitations for sit-stand desks. None of the placements were able to detect the increased activity on the activity-promoting chair. Caution is therefore warranted when analysing workplace interventions such as activity-promoting office chairs and standing desks with ActiGraph waist and wrist cut-points.
Availability of data and materials
The datasets analysed during the current study are available from the corresponding author on reasonable request.
Minimal-intensity physical activity
Light-intensity physical activity
SBRN. Letter to the editor: standardized use of the terms "sedentary" and "sedentary behaviours". Appl Physiol Nutr Metab. 2012;37(3):540–2.
Colley RC, Garriguet D, Janssen I, Craig CL, Clarke J, Tremblay MS. Physical activity of Canadian adults: accelerometer results from the 2007 to 2009 Canadian health measures survey. Health Rep. 2011;22(1):7–14.
Loyen A, Clarke-Cornwell AM, Anderssen SA, Hagstromer M, Sardinha LB, Sundquist K, et al. Sedentary time and physical activity surveillance through accelerometer pooling in four European countries. Sports Med. 2017;47(7):1421–35.
Matthews CE, Kozey-Keadle S, Moore SC, Schoeller DS, Carroll RJ, Troiano RP, et al. Measurement of active and sedentary behavior in context of large epidemiologic studies. Med Sci Sports Exerc. 2018;50(2):266–76.
OECD. OECD Labour Force Statistics 2017.2018.
Gorman E, Ashe MC, Dunstan DW, Hanson HM, Madden K, Winkler EAH, et al. Does an 'Activity-Permissive' Workplace Change Office Workers' Sitting and Activity Time? PLoS One. 2013;8(10):e76723 e.
Nooijen C, Kallings L, Blom V, Ekblom O, Forsell Y, Ekblom M. Common perceived barriers and facilitators for reducing sedentary behaviour among office-workers. Int J Environ Res Public Health. 2018;15(10):S94–S5.
Prince SA, Elliott CG, Scott K, Visintini S, Reed JL. Device-measured physical activity, sedentary behaviour and cardiometabolic health and fitness across occupational groups: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2019;16(1):30.
Parry S, Straker L. The contribution of office work to sedentary behaviour associated risk. BMC Public Health. 2013;13.
Ryan CG, Dall PM, Granat MH, Grant PM. Sitting patterns at work: objective measurement of adherence to current recommendations. Ergonomics. 2011;54(6):531–8.
Klepac Pogrmilovic B, O'Sullivan G, Milton K, Biddle SJH, Bauman A, Bull F, et al. A global systematic scoping review of studies analysing indicators, development, and content of national-level physical activity and sedentary behaviour policies. Int J Behav Nutr Phys Act. 2018;15(1):123.
Grooten WJA, Ang BO, Hagstromer M, Conradsson D, Nero H, Franzen E. Does a dynamic chair increase office workers' movements? - results from a combined laboratory and field study. Appl Ergon. 2017;60:1–11.
Buckley JP, Hedge A, Yates T, Copeland RJ, Loosemore M, Hamer M, et al. The sedentary office: an expert statement on the growing case for change towards better health and productivity. Br J Sports Med. 2015;49(21):1357–62.
Holtermann A, Schellewald V, Mathiassen SE, Gupta N, Pinder A, Punakallio A, et al. A practical guidance for assessments of sedentary behavior at work: a PEROSH initiative. Appl Ergon. 2017;63:41–52.
"sit", Merriam-Webster Online Dictionary. https://www.merriam-webster.com/dictionary/sit: Merriam-Webster, Accessed 31 Oct. 2020.
"stand", Merriam-Webster Online Dictionary. https://www.merriam-webster.com/dictionary/stand: Merriam-Webster, Accessed 31 Oct. 2020.
Hutcheson AK, Piazza AJ, Knowlden AP. Work site-based environmental interventions to reduce sedentary behavior: a systematic review. Am J Health Promot. 2018;32(1):32–47.
Shrestha N, Kukkonen-Harjula KT, Verbeek JH, Ijaz S, Hermans V, Pedisic Z. Workplace interventions for reducing sitting at work. Cochrane Database Syst Rev. 2018;6:CD010912.
Ojo SO, Bailey DP, Chater AM, Hewson DJ. The impact of active workstations on workplace productivity and performance: a systematic review. Int J Environ Res Public Health. 2018;15(3):14.
Karol S, Robertson MM. Implications of sit-stand and active workstations to counteract the adverse effects of sedentary work: a comprehensive review. Work. 2015;52(2):255–67.
Edwardson CL, Yates T, Biddle SJH, Davies MJ, Dunstan DW, Esliger DW, et al. Effectiveness of the stand more AT (SMArT) work intervention: cluster randomised controlled trial. BMJ. 2018;363:15.
Stephenson A, McDonough SM, Murphy MH, Nugent CD, Mair JL. Using computer, mobile and wearable technology enhanced interventions to reduce sedentary behaviour: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2017;14:17.
Bergman F, Wahlström V, Stomby A, Otten J, Lanthén E, Renklint R, et al. Treadmill workstations in office workers who are overweight or obese: a randomised controlled trial. Lancet Public Health. 2018;3(11):e523–e35.
Koepp GA, Moore GK, Levine JA. Chair-based fidgeting and energy expenditure. BMJ Open Sport Exerc Med. 2016;2(1):e000152.
Tew GA, Posso MC, Arundel CE, McDaid CM. Systematic review: height-adjustable workstations to reduce sedentary behaviour in office-based workers. Occup Med (Lond). 2015;65(5):357–66.
Chastin SFM, Dontje ML, Skelton DA, Cukic I, Shaw RJ, Gill JMR, et al. Systematic comparative validation of self-report measures of sedentary time against an objective measure of postural sitting (activPAL). Int J Behav Nutr Phys Act. 2018;15(1):21.
Prince SA, Cardilli L, Reed JL, Saunders TJ, Kite C, Douillette K, et al. A comparison of self-reported and device measured sedentary behaviour in adults: a systematic review and meta-analysis. Int J Behav Nutr Phys Act. 2020;17(1):31.
Edwardson CL, Rowlands AV, Bunnewell S, Sanders J, Esliger DW, Gorely T, et al. Accuracy of posture allocation algorithms for thigh- and waist-worn accelerometers. Med Sci Sports Exerc. 2016;48(6):1085–90.
Kozey-Keadle S, Libertine A, Lyden K, Staudenmayer J, Freedson PS. Validation of wearable monitors for assessing sedentary behavior. Med Sci Sports Exerc. 2011;43(8):1561–7.
Boerema ST, van Velsen L, Vollenbroek MM, Hermens HJ. Pattern measures of sedentary behaviour in adults: a literature review. Digit Health. 2020;6:2055207620905418.
Migueles JH, Cadenas-Sanchez C, Ekelund U, Delisle Nystrom C, Mora-Gonzalez J, Lof M, et al. Accelerometer data collection and processing criteria to assess physical activity and other outcomes: a systematic review and practical considerations. Sports Med. 2017;47:1821–45.
Lopes VP, Magalhães P, Bragada J, Vasques C. Actigraph calibration in obese/overweight and type 2 diabetes mellitus middle-aged to old adult patients. J Phys Act Health. 2009;6(1):133–40.
Crouter SE, DellaValle DM, Haas JD, Frongillo EA, Bassett DR. Validity of ActiGraph 2-regression model and Matthews and NHANES and cut-points for assessing free-living physical activity. J Phys Act Health. 2013;10(4):504–14.
Clarke-Cornwell AM, Farragher TM, Cook PA, Granat MH. Empirically derived cut-points for sedentary behaviour: are we sitting differently? Physiol Meas. 2016;37(10):1669–85.
Kim Y, Barry VW, Kang M. Validation of the ActiGraph GT3X and activPAL accelerometers for the assessment of sedentary behavior. Meas Phys Educ Exerc Sci. 2015;19(3):125–37.
Koster A, Shiroma EJ, Caserotti P, Matthews CE, Chen KY, Glynn NW, et al. Comparison of sedentary estimates between activPAL and hip- and wrist-worn ActiGraph. Med Sci Sports Exerc. 2016;48(8):1514–22.
Compher C, Frankenfield D, Keim N, Roth-Yousey L. Evidence analysis working G. best practice methods to apply to measurement of resting metabolic rate in adults: a systematic review. J Am Diet Assoc. 2006;106(6):881–903.
Fullmer S, Benson-Davies S, Earthman CP, Frankenfield DC, Gradwell E, Lee PS, et al. Evidence analysis library review of best practices for performing indirect calorimetry in healthy and non-critically ill individuals. J Acad Nutr Diet. 2015;115(9):1417–46 e2.
Kuster RP, Huber M, Hirschi S, Siegl W, Baumgartner D, Hagströmer M, et al. Measuring Sedentary Behavior by Means of Muscular Activity and Accelerometry. Sensors (Basel). 2018;18(11):4010.
Kuster RP, Bauer CM, Gossweiler L, Baumgartner D. Active sitting with backrest support: is it feasible? Ergonomics. 2018;61(12):1685–95.
Kuster RP, Bauer CM, Oetiker S, Kool J. Physiological motion Axis for the seat of a dynamic office chair. Hum Factors. 2016;58(6):886–98.
Kuster RP, Baumgartner D, Hagströmer M, Grooten WJA. Where to place which sensor to measure sedentary behaviour? A method development and comparison among various sensor placements and signal types. J Measure Phys Behav. 2020; Forthcoming.
Cain KL, Conway TL, Adams MA, Husak LE, Sallis JF. Comparison of older and newer generations of ActiGraph accelerometers with the normal filter and the low frequency extension. Int J Behav Nutr Phys Act. 2013;10:51.
Borges JH, Langer RD, Cirolini VX, Pascoa MA, Guerra-Junior G, Goncalves EM. Minimum time to achieve the steady state and optimum abbreviated period to estimate the resting energy expenditure by indirect Calorimetry in healthy young adults. Nutr Clin Pract. 2016;31(3):349–54.
Popp CJ, Tisch JJ, Sakarcan KE, Bridges WC, Jesch ED. Approximate time to steady-state resting energy expenditure using indirect Calorimetry in young. Healthy Adults Front Nutr. 2016;3:49.
Fritz CO, Morris PE, Richler JJ. Effect size estimates: current use, calculations, and interpretation. J Exp Psychol Gen. 2012;141(1):2–18.
Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. New Jersey: Lawrence Erlbaum Associates; 1988. p. 567.
Garner JB. The standard error of Cohen's kappa. Stat Med. 1991;10:767–75.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.
Wetten AA, Batterham M, Tan SY, Tapsell L. Relative validity of 3 accelerometer models for estimating energy expenditure during light activity. J Phys Act Health. 2014;11(3):638–47.
Crouter SE, Kuffel E, Haas JD, Frongillo EA, Bassett DR Jr. Refined two-regression model for the ActiGraph accelerometer. Med Sci Sports Exerc. 2010;42(5):1029–37.
Edwardson CL, Henson J, Biddle SJH, Davies MJ, Khunti K, Maylor B, et al. activPAL and ActiGraph assessed sedentary behavior and Cardiometabolic health markers. Med Sci Sports Exerc. 2020;52(2):391–7.
Marcotte RT, Petrucci GJ Jr, Cox MF, Freedson PS, Staudenmayer JW, Sirard JR. Estimating sedentary time from a hip- and wrist-worn accelerometer. Med Sci Sports Exerc. 2020;52(1):225–32.
Kuster RP, Grooten WJA, Baumgartner D, Blom V, Hagströmer M, Ekblom Ö. Detecting prolonged sitting bouts with the ActiGraph GT3X. Scand J Med Sci Sports. 2020;30(3):572–82.
Kerr J, Carlson J, Godbole S, Cadmus-Bertram L, Bellettiere J, Hartman S. Improving hip-worn accelerometer estimates of sitting using machine learning methods. Med Sci Sports Exerc. 2018;50(7):1518–24.
Burns J, Forde C, Dockrell S. Energy expenditure of standing compared to sitting while conducting office tasks. Hum Factors. 2017;59(7):1078–87.
Monnard CR, Miles-Chan JL. Energy cost of standing in a multi-ethnic cohort: are energy-savers a minority or the majority? PLoS One. 2017;12(1):e0169478.
Gibbs BB, Kowalsky RJ, Perdomo SJ, Grier M, Jakicic JM. Energy expenditure of deskwork when sitting, standing or alternating positions. Occup Med (Lond). 2017;67(2):121–7.
Betts JA, Smith HA, Johnson-Bonson DA, Ellis TI, Dagnall J, Hengist A, et al. The energy cost of sitting versus standing naturally in man. Med Sci Sports Exerc. 2019;51(4):726–33.
Mansoubi M, Pearson N, Biddle SJ, Clemes SA. Using sit-to-stand workstations in offices: is there a compensation effect? Med Sci Sports Exerc. 2016;48(4):720–5.
van Nassau F, Chau JY, Lakerveld J, Bauman AE, van der Ploeg HP. Validity and responsiveness of four measures of occupational sitting and standing. Int J Behav Nutr Phys Act. 2015;12:144.
Ellegast RP, Kraft K, Groenesteijn L, Krause F, Berger H, Vink P. Comparison of four specific dynamic office chairs with a conventional office chair: impact upon muscle activation, physical activity and posture. Appl Ergon. 2012;43(2):296–307.
Sim J, Wright CC. The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005;85(3):257–68.
Tremblay MS, Aubert S, Barnes JD, Saunders TJ, Carson V, Latimer-Cheung AE, et al. Sedentary behavior research network (SBRN) - terminology consensus project process and outcome. Int J Behav Nutr Phys Act. 2017;14(1):75.
The authors acknowledge the support of Mary Huggler in recruiting.
RK was funded through a personal grant from the Swiss National Science Foundation (grant 187637). The funder had no influence on study design, data collection, analysis, interpretation, and in writing the manuscript. Open Access funding provided by Karolinska Institute.
Ethics approval and consent to participate
This bi-national project was approved by the regional ethics board in Stockholm (DNR 2018/554–31/1), and it received a declaration of non-objection from the regional ethics board in Zurich. Every participant signed an informed consent prior to study inclusion.
Consent for publication
Both participants gave their written consent to publish Fig. 1.
RK and DB significantly contributed to the development of the activity-promoting chair. DB is the inventor of the activity-promoting chair technology and owner of rotavis AG who holds the right to commercialise the chair technology. The technology is patented by the Federal Institute of Technology Zurich (ETH Zurich).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
Additional file 2.
Additional file 3.
Prevalence-adjusted-bias-adjusted-kappa and sensitivity and specificity, shown for each figure in the manuscript.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Kuster, R.P., Hagströmer, M., Baumgartner, D. et al. Concurrent and discriminant validity of ActiGraph waist and wrist cut-points to measure sedentary behaviour, activity level, and posture in office work. BMC Public Health 21, 345 (2021). https://doi.org/10.1186/s12889-021-10387-7
- Activity-promoting chair
- Physical activity
- ROC curve
- Sit-stand desk
- Workplace intervention