Through the Eyes of Patients: The Effect of Training General Practitioners and Nurses on Perceived Shared Decision-Making Support.

Advanced cancer patients may need to make treatment decisions that depend on their personal evaluation of the benefits and harms of treatment options and hence require shared decision making (SDM). For example, they may need to choose between starting or forgoing systemic therapy, as treatment outcomes are uncertain and possibly limited while the burden of side effects may be high. 1 , 2 SDM involves both the health care professional (HCP) and the patient, exchanging information about treatment options as well as patient values and preferences, to reach consensus about the preferred treatment. 3 – 6 Patients generally make decisions about cancer treatment with medical specialists. However, general practitioners (GPs) and nurses may have a complementary, supporting role in SDM. 7 – 10 A recent survey among patients and survivors showed that they appreciate the involvement of GPs and nurses after a cancer diagnosis. 11 , 12

Attention for such interprofessional SDM and decision support by GPs and nurses has increased over the past years. 13 – 15 Previous studies have identified 3 strategies HCPs may deploy to support SDM: 1) checking the quality of a decision (i.e., exploring whether patients are conscious of the existence of a decision, informed about the different options, and whether their values and preferences are incorporated into the treatment decision), 2) complementing SDM (i.e., contributing to the SDM process by increasing choice awareness, clarifying information, or supporting preference construction), and 3) enabling SDM (i.e., organizing activities to ensure that the SDM process will continue beyond HCPs’ direct involvement). 16 , 17

Research shows that training can strengthen SDM support knowledge and skills of HCPs. 18 – 21 We previously evaluated a training program in SDM support for GPs and nurses by having expert observers assess video-recorded simulated consultations conducted before and after the training. These observers established a medium-sized significant improvement in SDM support behavior after training. 21 Former research, however, has shown that patients and trained observers evaluate the SDM behavior of clinicians differently. 22 , 23 This stresses the necessity of exploring patient perspectives. Little is known about if and how patients experience support of GPs and nurses in decision making about cancer treatment after such training programs. While SDM support conversations might help patients make decisions, 24 such attempts of HCPs might also go unnoticed or not facilitate or even hinder making a high-quality decision. 25 Acquiring insights into whether a training program for GPs and nurses affects not only ratings of trained observers but also patients’ perceptions of SDM support would help understand whether the training program may indeed benefit patients in making treatment decisions and is therefore clinically relevant.

The aim of this study is to examine the effect of the training program for GPs and nurses on cancer patients’ and survivors’ perceived SDM support when assessing video-recorded simulated consultations. The primary outcome is SDM support as perceived by these so-called analogue patients (APs), which includes the perceived degree of SDM supportive behaviors of HCPs and the perceived benefit of this behavior for patients to feel more empowered to make a treatment decision. Secondary outcomes included self-reported SDM, satisfaction with the communication, conversation appreciation and helpfulness as well as decision-making satisfaction and confidence, and an overall rating of SDM support. In addition, the study aimed to examine which AP and HCP characteristics are associated with AP-perceived SDM support.

Methods

Design

We previously conducted standardized patient assessments (SPAs) before and after a training program on SDM support for GPs and nurses. 21 The video-recorded SPAs were assessed by trained observers to evaluate the trainings’ effectiveness. In the current innovative, experimental study design, video recordings ( n = 32) of SPAs of GPs ( n = 8) and nurses ( n = 8) conducted before (SPA T0) and after (SPA T2) the training were assessed by at least 4 cancer patients or survivors ( n = 132); each participant watched 1 SPA. See Box 1 for more information on the SPAs and Figure 1 for the study design. The assessments took place between June 2021 and March 2022. The STROBE guidelines 26 were followed where applicable in this report. The funding source had no role in the study.

Setting, Participants, and Recruitment

The study was powered to establish a medium effect (i.e., participants’ ability to discriminate between trained and untrained HCPs on SDM support) of the training program (Cohen’s d = 0.5) and required 128 participants (G*Power, α = 0.05, β = 0.80, t test). Participants were eligible if they were (previously) diagnosed with cancer and at least 50 y old, to increase engagement with the patient in the SPA. Cancer patients and survivors acted as APs (i.e., untrained viewers providing their perception of the interaction while taking on the patient role). 27 APs can be used if real patient perceptions are not possible but one is interested in subjective patient perceptions, 27 , 28 as APs’ and clinical patients’ perceptions of communication largely overlap. 28 Participants were recruited through the patient panels of PanelCom and Kanker.nl, both of which target (ex)cancer patients. Snowballing was also applied by asking participants who had completed the study to invite eligible people in their network. Recruitment continued until at least 128 participants completed a questionnaire. Invitation e-mails were sent, and interested participants received participant information prior to receiving the online questionnaire invitation. The questionnaire required all participants to provide informed consent and sign a confidentiality agreement. Twenty gift vouchers were raffled among the participants. The Human Ethics Committee at the Amsterdam UMC location AMC provided ethical clearance for the study (W20_168 # 20.199).

Study Procedures

A random selection of video-recorded SPAs (before and after training) from 8 GPs and 8 nurses was made, after verifying HCPs’ consent and checking the quality of the video-recorded SPAs. The video recordings were anonymized and uploaded in a safe digital environment. The APs’ online questionnaire contained a Web link to the recorded SPA that was randomly assigned to them. They first reported baseline characteristics and were subsequently instructed that they were going to watch a simulated conversation between an HCP and a patient (an actor). Personal and medical background information of the patient case was shared briefly as well as the context in which the conversation took place. APs were explicitly asked to not only observe but also sympathize with the actor-patient, that is, to put oneself in the shoes of the patient while watching the video recording and to pay particular attention to how the HCP and patient talked about the treatment decision. After watching the SPA, APs assessed primary and secondary outcomes in the questionnaire. Afterward, they could voluntarily express any comments about the study, questionnaire, or video recording in an open answer field. All but this last part of the questionnaire were mandatory to progress through the questionnaire.

Measurements

Baseline characteristics

APs reported their age (in categories), sex, educational level, and medical background, that is, whether they have (had) cancer (distinguishing patients and survivors), whether this cancer is curable, year of (first) diagnosis, type of cancer, and type of treatment. In addition, APs’ preferred decisional role was measured with the Control Preference Scale (a 1-item measure with 5 different treatment decision-making roles 29 ), which was adjusted for analyses to reflect an active, shared, or passive patient role. 30 APs’ attitude toward striving for quantity or quality of life was assessed with the Quantity Quality Questionnaire, an 8-item questionnaire for assessing patient attitudes concerning tradeoffs between quality of life and quantity of life. 31 Responses were given on a 5-point Likert scale (1 = I strongly disagree to 5 = I strongly agree ). Two subscales were constructed by adding the respective item scores: striving for length of life and quality of life (4 items each). Lastly, 1 item assessed whether APs ever had such a conversation about the cancer treatment decision with their GP or nurse (yes/no), and, if yes, another item assessed APs’ perception of the comparability of the SPA with their own experience (1 = not at all to 10 = very much ).

Fidelity and validity check

The digital environment in which APs watched the video-recorded SPAs provided analytic information on how many times the SPA was watched and for how long, in quartiles. This information was reviewed to gain insight in the fidelity of viewing SPAs but could not be linked to APs’ identification numbers. Moreover, interpretation should be cautious, as missing (parts of) viewings could also mean the AP did not turn on cookies or had Internet connection issues. Regarding the validity of the procedure, engagement with the video was measured, using the validated 9-item Dutch shortened Video Engagement Scale (VES-sf). 32 , 33 This reflected “the extent to which participants are able to view, immerse and imagine themselves being in the video and potentially being emotionally touched by the video.” 32 , 33 One item relating to whether participants paid attention was used as a screener, as this was considered a prerequisite to engage in the research and may bias results if too low. 32 Items were rated on a 7-point Likert scale (1 = completely disagree to 7 = completely agree ) and averaged, with higher scores reflecting greater engagement. In addition, 2 subscales were constructed: immersion and emotional impact, both of which were calculated by averaging the corresponding 4 items. 32

Primary outcome

Because no patient-reported instrument on SDM support exists, 13 self-developed items were used to assess SDM support ( Appendix B ). Six items focused on the perceived HCP behavior , based on the 3 strategies of SDM support 16 , 17 : checking the quality of a decision (1 item), complementing SDM (4 items), and enabling SDM (1 item). An example was “In this conversation, the HCP helped to make it clear that there is a choice between several treatment options.” Seven items focused on the perceived patient benefit of SDM support (i.e., being more empowered to make a treatment decision after the consultation). These benefits referred to 3 aspects important for making high-quality treatment decisions 34 : being choice aware (2 items), informed (2 items), and able to make a decision aligned with patient values (3 items). For example, 1 item stated, “If you were the patient, after this conversation it would be clearer to you what you think of the pros and cons of the treatment(s).” All items were rated on a 6-point Likert scale (0 = completely disagree to 5 = completely agree ). Two total scores were calculated: SDM support – HCP behavior and SDM support – patient benefit . These were calculated by averaging the items corresponding to each strategy or quality aspect, respectively, and subsequently averaging these 3 scores (range 0–5). The items were pilot tested with the first 4 participants, which resulted in some small refinements only.

Secondary outcomes

Next to self-developed items, the validated 3-item CollaboRATE 35 was administered, which assesses patient-reported SDM . The items (e.g., “how much effort was made to include what matters to you most in choosing what to do next”) were rated on a 10-point Likert scale (0 = made no effort at all to 9 = made every effort ), summed, and transformed to reflect a score on a range of 0 to 100. Second, satisfaction with the communication in the consultation was assessed with the 5-item Patient Satisfaction Questionnaire (PSQ). 36 – 38 Items were slightly adapted to fit the AP setting (e.g., how well the HCP addressed the needs of the patient) and assessed on a visual analog scale (VAS; range 0–100). The total score of the PSQ was the average of the 5 items (range 0–100). Four additional study-specific items focused on the participants’ decision-making satisfaction (i.e., how satisfied they would be with the way the HCP spoke about the treatment decision), conversation appreciation (i.e., how much they would appreciate this conversation with the HCP), perceived conversation helpfulness (i.e., to what extent would the conversation with the HCP have helped in making a treatment decision), and decision-making confidence (i.e., how confident they are that a good decision has been or will be made). These items were also assessed on a VAS (range 0–100). Lastly, 1 global item assessed the overall rating of SDM support (i.e., the degree to which the HCP assisted the patient in making an appropriate decision) with a Likert scale response (1 = not at all to 10 = to a very strong degree ).

Statistical Analyses

First, linear mixed models (LMMs) were computed for exploring whether APs differentiated trained from untrained HCPs while accounting for the hierarchical structure of the data (cancer patients and survivors [level 1] within training condition [time, level 2] within HCPs [level 3]). There were no missing data. A random factor for the HCP level was used. If the variance between HCPs was too low, this random factor was removed, and AP assessments were treated as independent assessments that were not nested. Effect size was presented by Cohen’s d ( d = 0.20 small, d = 0.50 medium, d = 0.80 large effects 39 ). In addition, the intraclass correlations between APs’ assessments were calculated with 1-way random-effects models as each SPA was assessed by a different set of raters. 40 Also, correlations between APs’ assessments and trained observers’ assessments from the previous study 21 were calculated. Next, HCP discipline and its interaction with training status (HCP discipline × before/after training) were added to the LMMs to examine possible differences between GPs and nurses. Post hoc analyses were conducted for GPs and nurses separately. Subsequently, it was investigated which variables were associated with SDM support. Characteristics relating to APs’ decision-making preferences (i.e., preferred decisional role, striving for quality and length of life), APs’ similarities with the SPA patient (i.e., age, sex, patient v. survivor, palliative v. curative, corresponding type of cancer [yes/no], chemotherapy [yes/no]), SPA HCP characteristics (i.e., sex, discipline, years of experience), and APs’ video engagement (i.e., VES subscale immersion and emotional impact, ever had such a conversation, comparability) were added to the model as fixed factors one by one and maintained if P < 0.20. Nonsignificant variables ( P > 0.05) were eliminated from the model one by one for simplification. All analyses were performed in IBM SPSS Statistics 26 (ICM, Amonk, NY).

Results

Participant and Video Details

APs ( N = 132) were recruited through PanelCom ( n = 106, response rate 23.6%), n = 19 through Kanker.nl (response rate 7.6%), and n = 7 by snowballing. Reasons for nonresponse were unknown. One AP was excluded from analyses as the VES screener item was ≤2, making the final sample size N = 131. Most APs were aged 60 to 69 y (47.3%), female (60.3%), survivors (58.0%), and more than half had received chemotherapy (61.1%). Within the group of participants who were currently having cancer, most were in the palliative phase (80.0%). See Table 1 for more participant details. As one respondent did not meet the screener criterion of the VES and was excluded from further analyses, video recordings of SPAs ultimately were assessed by three ( n = 1), four ( n = 27) or five ( n = 4) APs. Ninety-three percent ( n = 122) of the respondents had watched their assigned SPA in full. See details in Appendix C .

Evaluating SPAs before and after Training

APs did not significantly differ in their assessments of SPAs of HCPs before and after training on both primary outcomes. Effect sizes were small ( Table 2 ). The intraclass correlations between APs for SDM support reflected poor agreement ( SDM support – HCP behavior : 0.17 (before training) and −0.02 (after training); SDM support – patient benefit : −0.01 (before training) and 0.13 (after training)). Correlations between trained observers’ and APs’ assessments were low as well (−0.08 ≤ correlation ≤ 0.48; 0.055 ≤ P ≤ 0.982). The secondary outcomes did not differ significantly between SPAs before and after training either ( P values ranging from 0.361 to 0.545 with very small negative effect sizes).

Differences between HCP Disciplines

The size of the effect of the training (before/after) on perceived patient benefit as well as the overall rating of SDM support differed significantly between GPs and nurses (interaction term HCP discipline × before/after training: P = 0.034 and P = 0.049, respectively). Post hoc analyses within each HCP discipline separately showed that effect sizes for GPs were larger than those for nurses (Cohen’s d = 0.17 v. −0.06 and 0.20 v. −0.18, respectively), but none were significant. None of the effects on the other primary and secondary outcomes differed between disciplines ( Table 3 ).

Variables Associated with SDM Support

Table 4 presents the variables associated with SDM support – HCP behavior and patient benefit , respectively. For both outcomes, only comparability with previous personal experiences with conversations with a GP or nurse about cancer treatment decisions (if any) was significantly associated, F (1, 51) = 18.34, P < 0.001, d = 0.60; F (1, 51) = 15.73, P < 0.001, d = 0.56. This implies that the more comparable the SPA was with the AP’s own experiences with conversations with GPs or hospital nurses about the cancer treatment decision, the higher the AP’s assessment of the SPA.

Discussion

This innovative, experimental study demonstrated that cancer patients and survivors (i.e., APs) did not differentiate trained from untrained HCPs when evaluating SDM support. Although trained observers established a medium effect of the training on SDM support behavior of HCPs, 21 this effect was apparently not sufficiently large to be perceived by APs or it was not meaningful enough to them. In line, we found low correlations between assessments of trained observers and APs. This corroborates previous research on SDM as rated by observers and patients. 20 , 22 , 23 , 41 – 44 APs may assess and prioritize differently than observers do, underscoring the necessity of evaluating outcomes on the patient level in clinical practice. 45 , 46 Hence, the clinical relevance of the training program still needs to be established. 46 , 47 Possibly, training programs and evaluation outcomes of this nature should be better adapted to patients’ wishes and needs by, for example, developing training programs and evaluation criteria in co-creation with patients.

APs were not more satisfied with the communication of trained HCPs. Moreover, satisfaction scores in general were lower compared with previous studies in a clinical setting (e.g., in internal medicine outpatient consultations) 38 and in SDM conversations with oncologists. 48 Possibly, APs are more critical of shown communication, as they are not evaluating their own doctor. Besides, not all patients may appreciate involvement of GPs or hospital nurses in decision making about cancer care, be it before or after a training. Previous research has indicated various patient experiences regarding involvement of GPs and nurses: patients reported experiencing decision support by GPs as comforting 49 and valuable for SDM, 24 but they also prefer or expect specialist-led care. 50 Moreover, exposing patients to SDM means exposing them to uncertainty and responsibility, which may not be beneficial to all patients. 25 , 51 In the current study, a few APs indicated in their open answers confusion about the responsibilities of medical specialists and HCPs such as GPs or nurses. Some felt that topics discussed were the responsibility of the medical specialist, as they initially discuss and eventually make the treatment decision with the patient. In addition, some APs worried that the conversation might have raised more questions and uncertainty. Patients’ varying experiences regarding SDM support were corroborated by the poor agreement between APs’ assessments in this study, which was much lower compared with the agreement between trained observers in the previous study evaluating the training’s effectiveness (Triple-S: 0.67). 21 This stresses the importance of tailoring the amount and content of SDM conversations to patients’ needs and wishes. Future research should look further into different patients’ experiences and needs regarding SDM support.

Although both GPs and nurses are important to support SDM in the interprofessional SDM process, they have different responsibilities and expertise in the health care system. 7 , 52 APs assessed GPs’ SDM support behavior typically higher, which corresponds with findings of the prior training evaluation by observers. Possibly, APs may more clearly perceive SDM support by GPs or, in some way, value it higher. Another possible explanation may be that the SPA cases may have been less applicable to the individual nurse’s situation, as nurses’ responsibilities differ largely between functions and hospitals. For example, some nurses have more decisional responsibility or more knowledge about certain cancer types than others, because of different organizational structures. This may have caused that the conversations for nurses were less appropriate and comfortable, which APs may have sensed in some way.

In addition to the fact that APs differ largely in their assessments and appreciation of SDM support, other reasons for their lack of distinction between trained and untrained HCPs may be of a more methodological nature. The current absence of measures to asses APs’ evaluation of consultation recordings made us use self-developed, nonvalidated measures as primary outcome (see Appendix B ) and validated measures not designed for use in a study among APs. These measures could have been too insensitive to pick up an effect. An additional limitation worth mentioning may be selection bias, as only cancer patients and survivors interested in (patient-provider communication) research participated. For example, most had a high level of education, and compared with a 2015 review, 30 the share of patients who wanted an active (34% v. 28%) or shared (57% v. 44%) decisional role was somewhat higher in our sample. Related, a bias may be present in the randomly selected sample of HCPs who were part of the current study. When compared with the total sample of HCPs in the prior training evaluation study, this smaller sample had similar overall effect sizes on SDM support scores as rated by trained observers, but effect sizes were relatively low for nurses and high for GPs when compared with the full sample. Therefore, conclusions on differences between GPs and nurses should be interpreted cautiously. In addition, the a priori SDM support experience of HCPs was unknown. Lastly, it remains uncertain how engaged APs were while watching the SPAs.

Next to the aforementioned methodological limitations, APs may have reported their satisfaction with general communication skills of HCPs rather than SDM support behavior, as was reported in previous research. 53 The training program did not pay extensive attention to such general communication skills. Besides, although we used standardized patients in the SPAs, these conversations varied considerably in content other than SDM support. Also, responses between the different actors varied. Other issues may be related to APs’ engagement and ability to put oneself in the shoes of the patient in the video, although VES scores were comparable with previous research based on video recordings. 32 The simulated context, the content, as well as the online modality of SPAs may not have been representative of APs’ personal experiences. Similarly, the sometimes suboptimal quality of the recorded SPAs may have affected immersion. The implications of video quality on APs’ immersion and perceptions are not yet empirically tested. 54 Related, in clinical practice, SDM support is often part of a larger SDM process with multiple conversations and HCPs. 13 , 55 Since the SPA only showed 1 conversation with 1 HCP, it may have been complicated for APs to consider whether this SDM support benefited the patient in their specific context and in the long run.

This innovative, experimental study design, having APs assess SPAs used for the evaluation of a training program, should be further developed and refined. A strength is the possibility to standardize the context and the patient characteristics in an SPA, ensuring all variation is attributable to the HCP. Moreover, the AP design increased the reliability of ratings, as multiple APs could assess the same HCP, and allowed for reuse of collected data and a comparison of APs’ assessments with observers’ assessments. A possible disadvantage is that there may be large differences between APs’ hypothetical and patients’ actual experiences regarding SDM support. APs may also have (unconsciously) included previous experience when assessing the conversations, which is supported by the fact that the one variable associated with their evaluation of SDM support was comparability with previous experiences. Patients who did not have a comparable experience were more critical, which may imply they used their own experience as the standard. Interesting research topics could be to explore whether APs can better differentiate trained HCPs if a larger training effect was established by observers, making the topic of interest more clearly visible, and, if possible in terms of the general data protection regulation, recordings of clinical consultations with real patients could be used to increase representativeness and immersion. Also, due to the length of the SPA recordings, APs in the current study were asked to assess only 1 recording, limiting within-AP comparisons. This is an important issue in view of the low correlation between assessments of APs who watched a similar video. Future studies could explore if patients are able to discriminate untrained from trained HCPs when watching multiple recordings.

Conclusion

Training GPs and hospital nurses did not affect cancer patients’ and survivors’ perceived SDM support when assessing video-recorded simulated consultations. This conclusion should be drawn with caution due to the innovative study design with associated limitations, among which using a non-validated primary outcome. Since this was one of the first studies aiming at gaining insight in patient perceptions regarding SDM support in an experimental study design, future research on this topic is needed as well as further development of the study design.

Implications

As patients did not pick up any training effect, the clinical relevance of training in SDM support for GPs and nurses still remains to be established. The large variation in cancer patients’ and survivors’ assessments of SDM support suggests patients differ in their perception of SDM support. Hence, HCPs should tailor their (offering of) SDM support to patients’ needs and wishes. It is important to create a better understanding of the reasons underlying this study’s findings. Future research should develop validated measures and explore experiences of patients with SDM support by means of other research methodologies. Qualitative studies would provide more insight into patients’ perceptions of SDM support from GPs and nurses, for example, by having APs thinking aloud while watching an SPA. Such qualitative studies might also show how the training program could be improved to meet the needs of patients. In addition, studies with video vignettes (i.e., videos that are systematically manipulated for characteristics of interest and respondents’ judgments being elicited by questionnaires) 56 , 57 could systematically explore whether and what characteristics of SDM support patients prefer.

Supplemental Material

sj-docx-1-mdm-10.1177_0272989X231203693 – Supplemental material for Through the Eyes of Patients: The Effect of Training General Practitioners and Nurses on Perceived Shared Decision-Making Support

Click here for additional data file.

Supplemental material, sj-docx-1-mdm-10.1177_0272989X231203693 for Through the Eyes of Patients: The Effect of Training General Practitioners and Nurses on Perceived Shared Decision-Making Support by Danique W. Bos – van den Hoek, Ellen M. A. Smets, Rania Ali, Dorien Tange, Hanneke W. M. van Laarhoven and Inge Henselmans in Medical Decision Making

Acknowledgments

We would like to express our gratitude to all cancer patients and survivors who participated in this study. Similarly, we would like to thank all GPs, nurses, and actors who consented for using their video-recorded simulated consultations in the current study. In addition, we are thankful to PanelCom and kanker.nl for their efforts in recruiting participants and Pythia Nieuwkerk for her help in the statistical analyses.

Footnotes

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article. The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Financial support for this study was provided entirely by a grant from the Netherlands Organization of Health Research and Development (ZonMw, #844001514). The funding agreement ensured the authors’ independence in designing the study, interpreting the data, writing, and publishing the report.

ORCID iD: Danique W. Bos – van den Hoek https://orcid.org/0000-0002-2351-0068

Contributor Information

Danique W. Bos – van den Hoek, Amsterdam UMC location University of Amsterdam, Department of Medical Psychology, Amsterdam, The Netherlands Amsterdam Public Health Research Institute, Quality of Care Program, Amsterdam, The Netherlands; Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands.

Ellen M. A. Smets, Amsterdam UMC location University of Amsterdam, Department of Medical Psychology, Amsterdam, The Netherlands Amsterdam Public Health Research Institute, Quality of Care Program, Amsterdam, The Netherlands; Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands.

Rania Ali, Amsterdam UMC location University of Amsterdam, Department of Medical Psychology, Amsterdam, The Netherlands.

Dorien Tange, Dutch Federation of Cancer Patient Organizations (NFK), Utrecht, The Netherlands.

Hanneke W. M. van Laarhoven, Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands Amsterdam UMC location University of Amsterdam, Department of Medical Oncology, Amsterdam, The Netherlands.

Inge Henselmans, Amsterdam UMC location University of Amsterdam, Department of Medical Psychology, Amsterdam, The Netherlands; Amsterdam Public Health Research Institute, Quality of Care Program, Amsterdam, The Netherlands; Cancer Center Amsterdam, Cancer Treatment and Quality of Life, Amsterdam, The Netherlands; Amsterdam UMC Location University of Amsterdam, Department of General Practice, Amsterdam, The Netherlands.

References

1. Prigerson HG, Bao Y, Shah MA, et al. Chemotherapy use, performance status, and quality of life at the end of life. JAMA Oncol. 2015;1:778–84.

2. Howie L, Peppercorn J. Early palliative care in cancer treatment: rationale, evidence and clinical implications. Ther Adv Med Oncol. 2013;5:318–23.

3. Charles C, Gafni A, Whelan T. Shared decision making in the medical encountr: what does it mean? (or it takes at least two to tango). Soc Sci Med. 1997;44:681–92.

4. Stiggelbout AM, Pieterse AH, De Haes JC. Shared decision making: concepts, evidence, and practice. Patient Educ Couns. 2015;98:1172–9.

5. Bomhof-Roordink H, Gartner FR, Stiggelbout AM, Pieterse AH. Key components of shared decision making models: a systematic review. BMJ Open. 2019;9:e031763.

6. Elwyn G, Durand MA, Song J, et al. A three-talk model for shared decision making: multistage consultation process. BMJ. 2017;359:j4891.

7. de Wit NJ. A “time out consultation” in primary care for elderly patients with cancer: better treatment decisions by structural involvement of the general practitioner. Eur J Cancer Care (Engl). 2017;26.

8. Dahlhaus A, Vanneman N, Guethlin C, Behrend J, Siebenhofer A. German general practitioners’ views on their involvement and role in cancer care: a qualitative study. Fam Pract. 2014;31:209–14.

9. McCarter SP, Tariman JD, Spawn N, et al. Barriers and promoters to participation in the era of shared treatment decision-making. West J Nurs Res. 2016;38:1282–97.

10. Tariman JD, Szubski KL. The evolving role of the nurse during the cancer treatment decision-making process: a literature review. Clin J Oncol Nurs. 2015;19:548–56.

11. Noteboom EA, Perfors IA, May AM, et al. GP involvement after a cancer diagnosis; patients’ call to improve decision support. BJGP Open. 2021;5:bjgpopen20X101124.

12. NFK. You’ve Had (Had) Cancer: How Do You Experience Support by Your GP and Nurse? Utrecht (the Netherlands): Nederlandse Federatie van Kankerpatiëntenorganisaties; 2019.

13. Legare F, Stacey D, Pouliot S, et al. Interprofessionalism and shared decision-making in primary care: a stepwise approach towards a new model. J Interprof Care. 2011;25:18–25.

14. Stacey D, Legare F, Pouliot S, Kryworuchko J, Dunn S. Shared decision making models to inform an interprofessional perspective on decision making: a theory analysis. Patient Educ Couns. 2010;80:164–72.

15. Lewis KB, Stacey D, Squires JE, Carroll S. Shared decision-making models acknowledging an interprofessional approach: a theory analysis to inform nursing practice. Res Theory Nurs Pract. 2016;30:26–43.

16. Bos-van den Hoek DW, Thode M, Jongerden IP, et al. The role of hospital nurses in shared decision-making about life-prolonging treatment: a qualitative interview study. J Adv Nurs. 2021;77:296–307.

17. Bos-van den Hoek DW, van der Velden NC, Huisman R, et al. Role of GPs in shared decision making with patients about palliative cancer treatment: a qualitative study in the Netherlands. Br J Gen Pract. 2022;72:e276–84.

18. Stacey D, O’Connor AM, Graham ID, Pomey M-P. Randomized controlled trial of the effectiveness of an intervention to implement evidence-based patient decision support in a nursing call centre. J Telemed Telecare. 2006;12:410–5.

19. Boland L, Legare F, Carley M, et al. Evaluation of a shared decision making educational program: the Ottawa Decision Support Tutorial. Patient Educ Couns. 2019;102:324–31.

20. Berger-Hoger B, Liethmann K, Muhlhauser I, Haastert B, Steckelberg A. Nurse-led coaching of shared decision-making for women with ductal carcinoma in situ in breast care centers: a cluster randomized controlled trial. Int J Nurs Stud. 2019;93:141–52.

21. Bos-van den Hoek DW, Smets EMA, Ali R, et al. A blended learning for general practitioners and nurses on skills to support shared decision-making with patients about palliative cancer treatment: a one-group pre-posttest study. Patient Educ Couns. 2023;112:107712.

22. Diendere G, Farhat I, Witteman H, Ndjaboue R. Observer ratings of shared decision making do not match patient reports: an observational study in 5 family medicine practices. Med Decis Making. 2021;41:51–9.

23. Brom L, De Snoo-Trimp JC, Onwuteaka-Philipsen BD, Widdershoven GA, Stiggelbout AM, Pasman HR. Challenges in shared decision making in advanced cancer care: a qualitative longitudinal observational and interview study. Health Expect. 2017;20:69–84.

24. Noteboom EA, de Wit NJ, van Asseldonk I, et al. Off to a good start after a cancer diagnosis: implementation of a time out consultation in primary care before cancer treatment decision. J Cancer Surviv. 2020;14:9–13.

25. de Haes H. Dilemmas in patient centeredness and shared decision making: a case for vulnerability. Patient Educ Couns. 2006;62:291–8.

26. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007;4:1623–7.

27. Blanch-Hartigan D, Hall JA, Krupat E, Irish JT. Can naive patients put themselves in patients’s shoes? Reliability and validity of the analogue patient methodology. Med Care. 2013;51:e16–21.

28. van Vliet LM, van der Wall E, Albada A, Spreeuwenberg PM, Verheul W, Bensing JM. The validity of using analogue patients in practitioner-patient communication research: systematic review and meta-analysis. J Gen Intern Med. 2012;27:1528–43.

29. Degner LF, Sloan JA, Venkatesh P. The control preference scale. Can J Nurs Res. 1997;29:21–43.

30. Brom L, Hopmans W, Pasman HRW, Timmermans DRM, Widdershoven GAM, Onwuteaka-Philipsen BD. Congruence between patients’ preferred and perceived participation in medical decision-making: a review of the literature. BMC Med Inform Decis Mak. 2014;14:25.

31. Stiggelbout AM, De Haes JCJM, Kiebert GM, Kievit J, Leer JH. Tradeoffs between quality and quantity of life: development of the QQ questionnaire for cancer patient attitudes. Med Decis Making. 1998;16:184–92.

32. Lehmann V, Hillen MA, Verdam MGE, et al. The Video Engagement Scale (VES): measurement properties of the full and shortened VES across studies. Int J Soc Res Methodol. 2023;26:305–18.

33. Visser LN, Hillen MA, Verdam MG, Bol N, de Haes HC, Smets EM. Assessing engagement while viewing video vignettes; validation of the Video Engagement Scale (VES). Patient Educ Couns. 2016;99:227–35.

34. Stacey D, Murray MA, Legare F, Dunn S, Menard P, O’Connor A. Decision coaching to support shared decision making: a framework, evidence, and implications for nursing practice, education, and policy. Worldviews Evid Based Nurs. 2008;5:25–35.

35. Barr PJ, Thompson R, Walsh T, Grande SW, Ozanne EM, Elwyn G. The psychometric properties of CollaboRATE: a fast and frugal patient-reported measure of the shared decision-making process. J Med Internet Res. 2014;16:e2.

36. Blanchard CG, Ruckdeschel JC, Fletcher BA, Blanchard EB. The impact of oncologists’ behaviors on patient satisfaction with morning rounds. Cancer. 1986;58:387–93.

37. Ong LML, Visser MRM, Lammes FB, De Haes JCJM. Doctor-patient communication and cancer patients’ quality of life and satisfaction. Patient Educ Couns. 2000;40:145–56.

38. Zandbelt LC, Smets EMA, Oort FJ, Godfried MH, De Haes HCJM. Satisfaction with the outpatient encounter: a comparison of patients’ and physicians’ views. J Gen Intern Med. 2004;19:1088–95.

39. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Mahwah (NJ): Lawrence Erlbaum Associates; 1988.

40. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–63.

41. Kasper J, Hoffmann F, Heesen C, Kopke S, Geiger F. MAPPIN’SDM—the multifocal approach to sharing in shared decision making. PLoS One. 2012;7:e34849.

42. Kasper J, Heesen C, Kopke S, Fulcher G, Geiger F. Patients’ and observers’ perceptions of involvement differ. Validation study on inter-relating measures for shared decision making. PLoS One. 2011;6:e26255.

43. Wunderlich T, Cooper G, Divine G, et al. Inconsistencies in patient perceptions and observer ratings of shared decision making: the case of colorectal cancer screening. Patient Educ Couns. 2010;80:358–63.

44. Geessink NH, Ofstad EH, Olde Rikkert MGM, van Goor H, Kasper J, Schoon Y. Shared decision-making in older patients with colorectal or pancreatic cancer: determinants of patients’ and observers’ perceptions. Patient Educ Couns. 2018;101:1767–74.

45. Kirkpatrick D, Kirkpatrick J. Evaluating Training Programs: The Four Levels. San Francisco (CA): Berrett-Koehler; 2006.

46. de Haes H, Bensing J. Endpoints in medical communication research, proposing a framework of functions and outcomes. Patient Educ Couns. 2009;74:287–94.

47. Anvari F, Lakens D. Using anchor-based methods to determine the smallest effect size of interest. J Exp Soc Psychol. 2021;96:104159.

48. Henselmans I, van Laarhoven HWM, van Maarschalkerweerd P, et al. Effect of a skills training for oncologists and a patient communication aid on shared decision making about palliative systemic treatment: a randomized clinical trial. Oncologist. 2020;25:e578–88.

49. Wieldraaijer T, de Meij M, Zwaard S, van Weert H, Wind J. Introducing a time out consultation with the general practitioner between diagnosis and start of colorectal cancer treatment: patient-reported outcomes. Eur J Cancer Care (Engl). 2019;28:e13141.

50. Lawrence RA, McLoone JK, Wakefield CE, Cohn RJ. Primary care physicians’ perspectives of their role in cancer care: a systematic review. J Gen Intern Med. 2016;31:1222–36.

51. Fisher KA, Tan ASL, Matlock DD, Saver B, Mazor KM, Pieterse AH. Keeping the patient in the center: common challenges in the practice of shared decision making. Patient Educ Couns. 2018;101:2195–201.

52. Tariman JD, Mehmeti E, Spawn N, et al. Oncology nursing and shared decision making for cancer treatment. Clin J Oncol Nurs. 2016;20:560–3.

53. Schoenfeld EM, Probst MA, Quigley DD, et al. Does shared decision making actually occur in the emergency department? Looking at it from the patients’ perspective. Acad Emerg Med. 2019;26:1369–78.

54. Hillen MA, van Vliet LM, de Haes HC, Smets EM. Developing and administering scripted video vignettes for experimental research of patient-provider communication. Patient Educ Couns. 2013;91:295–309.

55. Rapley T. Distributed decision making: the anatomy of decisions-in-action. Sociol Health Illn. 2008;30(3):429–44.

56. Atzmüller C, Steiner PM. Experimental vignette studies in survey research. Methodology. 2010;6:128–38.

57. Evans SC, Roberts MC, Keeley JW, et al. Vignette methodologies for studying clinicians’ decision-making: validity, utility, and application in ICD-11 field studies. Int J Clin Health Psychol. 2015;15:160–70.

Associated Data

Supplementary Materials

sj-docx-1-mdm-10.1177_0272989X231203693 – Supplemental material for Through the Eyes of Patients: The Effect of Training General Practitioners and Nurses on Perceived Shared Decision-Making Support

Click here for additional data file.

Supplemental material, sj-docx-1-mdm-10.1177_0272989X231203693 for Through the Eyes of Patients: The Effect of Training General Practitioners and Nurses on Perceived Shared Decision-Making Support by Danique W. Bos – van den Hoek, Ellen M. A. Smets, Rania Ali, Dorien Tange, Hanneke W. M. van Laarhoven and Inge Henselmans in Medical Decision Making