Table 1 Overview of questions asked in each round
Number of experts | 1. Which factors are associated with the RTW of long-term disabled workers? | 2. Which of these identified RTW factors can be targeted using VR interventions? | 3. What are the most effective VR interventions to target these factors? | |
|---|---|---|---|---|
Round 1 | 21 | Scoring 58 RTW factors retrieved from literature and practice on their association with RTW. Answer options were (1) totally disagree – (5) totally agree - ≥ 80% (4) agree or (5) totally agree accepted - ≥ 70%—80% (4) agree or (5) totally agree consensus not reached and presented again in the next round - < 70% (4) agree or (5) totally agree left out of remaining rounds Option to add new relevant RTW factors | Scoring 58 RTW factors on whether they can be influenced by VR interventions. Answer options were (1) yes or (2) no - ≥ 80% (1) yes accepted - ≥ 70%—80% (1) yes consensus not reached and presented again in the next round - < 70% (1) yes left out of remaining rounds | N/A |
Round 2 | 20 | Scoring RTW factors for which consensus was not reached in round 1 - ≥ 80% (4) agree or (5) totally agree accepted - < 80% (4) agree or (5) totally agree left out of remaining rounds Scoring the newly added RTW factors in round 1 on their association with RTW - Same answering categories and consensus rules as in round 1 | Scoring RTW factors for which consensus was not yet reached - ≥ 80% (1) yes accepted - < 80% (1) yes left out of remaining rounds Scoring newly added RTW factors - Same answering categories and consensus rules as in round 1 | N/A |
Round 3 | 20 | Scoring newly added factors for which consensus was not reached in round 2 - ≥ 80% (4) agree or (5) totally agree accepted - < 80% (4) agree or (5) totally agree left out of remaining rounds | Scoring newly added factors for which consensus was not yet reached - ≥ 80% (1) yes accepted - < 80% (1) yes left out of remaining rounds | N/A |
Round 4 | 19 | N/A | N/A | Scoring VR interventions for factors for which consensus was reached for questions 1 and 2. Answer options were (1) not effective, (2) somewhat effective, and (3) very effective - ≥ 70% (3) very effective accepted - ≥ 50% and < 70% (3) very effective consensus not reached and presented again in the next round - < 50% very effective left out of remaining round |
Round 5 | 20 | N/A | N/A | Due to time constraints, we limited the number of factors to be discussed. Therefore, for the fifth round we selected RTW factors for which ≥ 70% of the experts (5) totally agreed that the factor was important for RTW, and for which there was consensus that this factor could be influenced with a VR intervention (round 2). This resulted in a total of eight factors. For these factors VR interventions were scored for which consensus was not yet reached in round 4. Answer options were (1) not effective or (2) somewhat or very effective - ≥ 70% (2) somewhat or very effective accepted - < 70% intervention is seen as ineffective in targeting a factor |