Introduction
Cancer is undoubtedly one of the most serious events in a person's life. Such events can be associated with anxiety, concerns, and important decisions. In surveys of cancer patients, they frequently expressed a desire for more information [ 1 ]. Information can help to reduce anxiety [ 2 ] and to make decisions more thoughtfully [ 3 ]. However, the need for information and the perceived lack of information depend, for example, on the socio-demographic situation and differ at every phase of cancer care trajectory [ 1 , 4 ].
Nowadays, cancer patients' information needs are mainly met through direct conversations with medical staff, but the importance of online resources increases when searching for health information. While the internet was in third place a few years ago, it is now the second most common used source for information [ 5 – 8 ].
Information related to cancer available online is very heterogeneous. This information is often incomplete, of insufficient or poor quality, or difficult to read [ 9 , 10 ]. The quality is highly dependent on the particular provider or website publisher, as studies on immunotherapy [ 11 ], bladder cancer [ 12 ], thyroid cancer [ 13 ], multiple myeloma [ 14 ], and radiotherapy for lung cancer [ 15 ], or breast cancer [ 16 ] showed. Furthermore, there are substantial differences between oncologists' and non-medical practitioners' websites [ 9 ].
Liebl et al. [ 17 ] analyzed 77 German websites with cancer information and found a discrepancy between visibility (which sites appear at the top of online searches) and quality criteria such as the HONcode [ 18 ]. Herth et al. [ 10 ] analyzed 60 German websites regarding cancer diets and found significant differences between many profit-driven websites with lower quality and only a few trustworthy websites with higher quality. On the one hand, when searching for information, patients and people who advise or care for patients, have many opportunities and possibilities through the internet. On the other hand, patients and their advisors or caregivers are also increasingly faced with challenges mainly regarding the flood of information and the quality of the information provided. When using the Internet (e)health literacy skills are becoming increasingly important.
Providing cancer patients with quality-assured, evidence-based information, which are readable and understandable for medical laypeople, was one of the goals of the PIKKO project [ 19 ]. A web-based knowledge database (WDB), which could be accessed via a website, was one module in this project. Patients should be able to find reliable information about their disease in one trustworthy place in order to improve individual health literacy and to support informed decisions during the decision making process. For the same reasons, this WDB should also be available to patient navigators, who should advise and support patients.
This paper aims to provide information about the utilization of a patient-oriented, web-based information database and therefore considers the following questions: Who were the users of the WDB? How was the WDB used? Which content was used? How did users rate the WDB? Furthermore, the influence of the usage of the WDB on the health literacy of the participating patients in PIKKO will be described.
Methods
The STROBE Statement for cohort studies 2007 [ 20 ] was used to report this study.
Setting
This analysis was part of the project “Patient information, communication and competence empowerment in oncology” (PIKKO).
The PIKKO project
PIKKO was a care concept for cancer patients. It was funded by the Innovation Fund of the Federal Joint Committee in Germany from 2017 to 2021 (funding number: 01NVF17011). It provided cancer patients with an additional counseling and information pathway that consisted of the modules (1) patient navigator (PN) for first level support around oncological care, (2) courses (e.g., nutrition, physical activity) as well as psychological and psycho-social counseling service offered by the Saarland Cancer Society, and (3) a web-based knowledge database (WDB). In the PIKKO project [ 19 ], an intervention group (IG) that had access to all three modules was compared with a control group (CG) without access to the modules. Data on the use of the intervention modules and various psychological parameters, including health literacy, were analyzed. Patients were surveyed up to five times (baseline + one follow-up every three months).
Web-based knowledge database
The WDB named "My PIKKO" was developed and provided by the German Cancer Society (GCS) for the PIKKO study. It was accessible via the internet from 2018 to 2020. Each patient in the IG was given an individual login at the initial appointment with the PN through which the WDB could be used as often and as long as they desired. Information on patient name, date of birth, and cancer type was stored securely in terms of data protection law and was not part of the analysis.
The WDB consisted of several chapters: general information on cancer, information on the patient's specific type of cancer (e.g., breast cancer), and socio-legal topics. Cancer chapters included topics on carcinogenesis, prevention, diagnosis, therapy, nutrition, physical activity, psychological support, palliative care, side effects, and naturopathy. Socio-legal topics included insurance, legal regulations and support, rehabilitation, and financial matters. In addition, there were checklists and guidance notes, the possibility to search for relevant addresses, a reading list, a glossary for medical vocabulary, and a list of abbreviations.
The texts were written in a way that was understandable to laypersons, using quality-assured, evidence-based information provided by GCS staff, and were updated throughout the duration of the project. The evidence base was ensured through systematic literature searches in MEDLINE and EMBASE (via Ovid). Since the evidence base was generally reduced in the case of rare tumors, secondary literature was also used in such cases, for example Clincal Practice Giudelines by the ESMO [ 21 ]. After the texts were created, a comparison was made with the German guidelines [ 22 ]. Since the texts were primarily intended for medical laypeople, criteria of quality-assured health information were applied (in particular “DISCERN” [ 23 ], “HONCode” [ 18 , 24 ] and “Good Practice Health Information” [ 25 ]). Overall, the texts were written in a neutral language; aggravations or trivializations were not used, and no interpretations of the medical information or recommendations for action were described. With regard to readability, the texts were written using the Flesch-Reading Ease Scale [ 26 ] and the fourth Vienna Formula (in German: Wiener Sachtextformel) [ 27 ] to create texts with an average readability level of 9 to 10 years of schooling. The formulas were incorporated in the editorial backend so that the readability of a text was automatically shown and could be used in real-time by the GCS staff.
In addition to patients, PNs also had their own login. They could use this to inform for themselves and to search for information together with the patient during an appointment or to demonstrate the use of the WDB.
Two screenshots of the WDB can be seen in online resource 1. To view a demo version of the WDB (in German, for other languages, please use the translation algorithms integrated into the browser), please follow the link in the reference and use the word ‘testnutzer’ as username and password [ 28 ].
Study design
The analysis of the use of the WDB was done in an observational study. Access to the database by persons authorized to do so was recorded over a period of two years, including the time of access and database pages visited. Two cohorts were investigated: patients and PNs.
Participants
As described, all IG patients and all PNs had access to the WDB. However, the usage was voluntary. Patients in the IG met the eligibility criteria of the PIKKO study [ 19 ], i.e. age between 18 and 90 years, any cancer of any stage, no statutory guardianship, sufficient knowledge of the German language, no severe visual or hearing impairment, no dementia or other mental limitations. PNs were medical assistants or nurses with at least two years of professional experience in the oncology field. They received special training by the GCS in using PIKKO to provide support and counseling to patients.
Variables
To evaluate the utilization of the WDB, various parameters were compared between the groups (IG, PNs):
number of users (absolute number and percentage)
accesses to the WDB (absolute number and percentage)
accesses per single user (mean, M, standard deviation, SD, maximum, max, and median)
accesses per day per single user (M, SD, max and median)
the total time spent on the WDB per individual user in minutes
the total time per individual user per access in minutes
one-time accesses as well as accesses over different months (1 month, 3 months, …, 12 months, more than 12 months) (absolute number and percentage)
number of patients who accessed the topic (absolute number and percentage)
accesses to the topic (absolute number and percentage)
the median time spent on the topic in seconds
In addition, to clarify the acceptance of the WDB among patients, responses to the following questions were collected (Table 1 ):
Table 1
Additional questions as part of the PIKKO survey on the web-based knowledge database (WDB) regarding usage
| Question | Answer options |
| If you did not use the WDB, why not? | open-ended text |
| What did you use the WDB for? | a choice of answer options |
| Do you usually use the internet to get information? | yes/no |
| Did "My PIKKO" help you make more informed decisions? | yes/no |
| Have you been able to find all the information you needed? | yes/no |
| Do you think "My PIKKO" is an appropriate way to provide information about diseases? | yes/no |
| What suggestions do you have for improvement and what information or functions did you miss? | open-ended text |
For multiple-choice or yes/no questions, the frequency of the different responses (absolute number and percentage) were reported. Lastly, an overall patient rating was reported, which is a 6-point scale modulated after the German school grading system with which each participant was familiar (1 = very good to 6 = insufficient).
Data sources
All variables of utilization were taken from the logfile of the WDB. This file was read out by the technical administrator at the end of the data collection in the PIKKO project on October 3, 2020. In the logfile, every access to a subpage was recorded. The subpage was archived with its ID, title, topic, and chapter affiliation. In addition, each access was assigned to the user group. Since the transfer of knowledge was the goal of the WDB, only visits on the content elements were tracked. The use of the checklists, guidance notes, address search, reading lists, glossary and list of abbreviations were not recorded.
From the PIKKO patient survey, the total number of patients who had potentially gained access to the WDB (= all patients with an initial appointment with PN, regardless of their active participation in the intervention and/or patient survey) was determined. The total number of PNs participating in the PIKKO study, as well as socio-demographic and clinical characteristics of participating patients and answers to the patient acceptance questions were also taken from this source [ 19 ].
The analysis of the influence of the WDB on health literacy has already been described by the authors elsewhere [ 29 ] and will be taken up here due to its relevance in terms of content. For a description of the statistics of this analysis, please also refer to this publication.
Sample size
753 patients were included in the IG in the PIKKO project [ 19 ].
Quantitative variables
The variables recorded in the logfile could be used without much modification. The time a user spent on a page was calculated based on the timestamp when the page was accessed. The duration is crucial for all variables that are related to time.
Health literacy
Health literacy was measured as part of the PIKKO survey [ 29 ] at all measurement time points using the HLS-EU-Q47 [ 30 ] (follow-up measurements: n = 301, min = 1, max = 4, median = 2). The score ranges from 0 to 50, with higher values indicating a higher level of health literacy. The cut-off between limited and non-limited health literacy is 33.
Analyzes of qualitative variables
Patients' open-ended explanations for not using the WDB (from the patient survey) were grouped into six categories: technical reasons , no need , no time , avoidance of thinking about cancer , health reasons , or no motivation .
All suggestions for improvement or missing information and functions were assigned to one of six categories: (1) wish for more information ; (2) wish for structural or design changes ; (3) wish for interactivity with medical staff ; (4) wish for the possibility of exchanges with other patients ; (5) suggestions for further functionalities ; (6) wish for functions regarding doctor appointments .
Both category systems were formed by inductive coding [ 31 ]. All statements could be clearly assigned to the categories mentioned.
Statistical methods
To examine differences between users and non-users of the WDB in terms of their socio-demographic and clinical characteristics, F-tests and chi-square test were performed (independent variable: user or non-user; dependent variables: age, gender etc.). Cramer-V [ 32 ] (V > 0.1: small effect; V > 0.3: medium effect; V > 0.5: strong effect) and partial Eta-squared [ 33 ] (ƞ 2 > 0.01: small effect; ƞ 2 > 0.06: medium effect; ƞ 2 > 0.14: strong effect) were used as effect sizes.
User numbers, access data and patient acceptance questions were analyzed descriptively.
To analyze the context, we used the accessed subpages that were already categorized as topics on the website. Then we determined which topics were accessed how often by the two groups. For each topic, the absolute and relative frequencies of accesses, the absolute and relative number of patients who accessed the topic, and the median time spent (in seconds) on each topic, were determined. The variables were then ranked to show which topics were of most interest to patients and PNs.
The software we used was SPSS Statistics 27.
Results
Participants
A total of n = 15 PNs worked in the PIKKO project. According to the logfile, 86.7% (13/15) used their own login. For the IG of the PIKKO project, 753 cancer patients were recruited. Of these, 110 dropped out prior to initial meeting with the PNs, eight were excluded due to missing eligibility criteria, and eight died (see Fig. 1 ). This left 83.3% (627/753) who could potentially have received a login to the WDB in an initial appointment with the PN. According to the logfile, 65.9% (413/627) used their login at least once to access the WDB.

In the patient survey, n = 580 patients in the IG participated at baseline. In total, 75.2% (436/580) answered questions about the WDB across all follow-ups. Of these, 25.5% (111/436) stated that they never used the WDB and 74.5% (325/436) used it at least once. See also Fig. 1 .
The reasons for never using the WDB were: 25.2% (28/111) for technical reasons, 24.3% (27/111) no need, 13.5% (15/111) no time, 6.3% (7/111) avoid of thinking about cancer, 5.4% (6/111) for health reasons, and 4.5% (5/111) no motivation. In n = 37 cases, no reason was given.
Descriptive data
Patients
Characteristics within the subgroup of users are presented and compared with the non-users in Table 2 .
Table 2
Baseline socio-demographic and clinical characteristics of users and non-users of the WDB
| user | non-user | statistic | |
| Number of patients | 325 | 111 | |
| Age M (SD) | 57.8 (10.0) | 58.8 (12.3) | F(1, 434) = 0.662, p = 0.416, η 2 = 0.002 |
| Gender % (n) | |||
| Female | 70.2% (228) | 61.3% (68) | χ 2 (1) = 3.0001, p = 0.083, V = 0.083 |
| Male | 29.8% (97) | 38.7% (43) | |
| School level % (n) | |||
| < 10 years of school | 43.1% (140) | 56.8% (63) | χ 2 (2) = 6.612, p = 0.037, V = 0.123 |
| 10 years of school | 28.9% (94) | 24.3% (27) | |
| > 10 years of school | 28.0% (91) | 18.9% (21) | |
| Education years (school + vocational) M (SD) | 12.6 (3.1) | 11.8 (2.9) | F(1, 434) = 5.952, p = 0.015, η 2 = 0.014 |
| Marital status % (n) | |||
| Single | 13.5% (44) | 15.3% (17) | χ 2 (3) = 1.701, p = 0.637, V = 0.062 |
| Married | 69.5% (226) | 64.9% (72) | |
| Divorced | 11.1% (36) | 10.8% (12) | |
| Widowed | 5.8% (19) | 9.0% (10) | |
| Living with the partner % (n) | 78.1% (250) | 72.5% (79) | χ 2 (1) = 1.451, p = 0.228, V = 0.058 |
| Children living in the household % (n) | 22.0% (70) | 20.7% (23) | χ 2 (1) = 0.081, p = 0.776, V = 0.014 |
| Financial worries % (n) | 12.4% (40) | 16.4% (18) | χ 2 (1) = 1.120, p = 0.290, V = 0.051 |
| Period of the most recent illness % (n) | |||
| up to 1 year (acute) | 78.4% (243) | 80.0% (84) | χ 2 (2) = 0.204, p = 0.903, V = 0.022 |
| 2–5 years | 16.1% (50) | 14.3% (15) | |
| > 6 years | 5.5% (17) | 5.7% (6) | |
| Enrollment inpatient % (n) | 77.2% (251) | 64.9% (72) | χ 2 (1) = 6.590, p = 0.010, V = 0.123 |
| Groups of cancer % (n) | |||
| Gastrointestinal (C00-25) | 17.8% (58) | 26.1% (29) | χ 2 (1) = 3.551, p = 0.059, V = 0.090 |
| Lung and larynx (C32-34) | 10.2% (33) | 11.7% (13) | χ 2 (1) = 0.213, p = 0.645, V = 0.022 |
| Female genitals / breast (C50-56) | 54.8% (178) | 43.2% (48) | χ 2 (1) = 4.403, p = 0.036, V = 0.100 |
| Male genitals (C61-62) | 4.9% (16) | 5.4% (6) | χ 2 (1) = 0.040, p = 0.841, V = 0.010 |
| Leukaemia, lymphoma (C81-96) | 11.4% (37) | 10.8% (12) | χ 2 (1) = 0.027, p = 0.869, V = 0.008 |
| Cancer status % (n) | |||
| Tumour spread | 54.5% (177) | 38.7% (43) | χ 2 (1) = 8.182, p = 0.004, V = 0.137 |
| Lymph node metastases | 20.9% (68) | 22.5% (25) | χ 2 (1) = 0.126, p = 0.722, V = 0.017 |
| Distant metastases | 10.8% (35) | 16.2% (18) | χ 2 (1) = 2.299, p = 0.129, V = 0.073 |
| Relapse | 3.1% (10) | 0.9% (1) | χ 2 (1) = 1.593, p = 0.207, V = 0.060 |
| Cancer treatment % (n) | |||
| CT, ABT, HT | 48.0% (156) | 56.8% (63) | χ 2 (1) = 2.538, p = 0.111, V = 0.076 |
| Radiotherapy | 14.8% (48) | 13.5% (15) | χ 2 (1) = 0.106, p = 0.745, V = 0.016 |
| Surgery, past and present | 37.2% (121) | 31.5% (35) | χ 2 (1) = 1.170, p = 0.279, V = 0.052 |
| Artificial nutrition | 0.9% (3) | 2.7% (3) | χ 2 (1) = 1.931, p = 0.165, V = 0.067 |
| Rehabilitation | 14.8% (48) | 10.8% (12) | χ 2 (1) = 1.092, p = 0.296, V = 0.050 |
| No treatment | 19.1% (62) | 23.4% (26) | χ 2 (1) = 0.970, p = 0.325, V = 0.047 |
| Internet user (usually) % (n) | 90.3% (290) | 67.3% (72) | χ 2 (1) = 32.699, p < 0.001 , V = 0.276 |
| Health literacy score at baseline M (SD) | 33.852 (7.699) | 33.088 (8.809) | F(1, 319) = 0.518, p = 0.472, η 2 = 0.002 |
The user and non-user groups differed significantly (all small effects) in the level of education (users 12.6 years vs. non-users 11.8 years), the number enrolled as inpatients (77.2% of users vs. 64.9% of non-users), the incidence of cancer of the female genitals/breast (54.8% of users vs. 43.2% of non-users) and tumor status (54.5% of users vs. 38.7% of non-users with metastatic tumor).
The difference between people who answered ‘yes’ in at least one of the follow-up surveys to the question of whether they usually use the internet to search for information was also evident. Significantly more users answered ‘yes’ than non-users (90.3% vs. 67.3%).
On average, users were aged 58 years old, predominantly female (70.2%), married (69.5%), had an acute cancer (78.4%) and were currently undergoing treatment (80.9%).
Patient navigators
The PIKKO study involved 15 PNs who were predominantly female (93.3%, 14/15) and had a mean age of 46 years (SD = 12.6). At the beginning of the study, they had worked in the medical sector for 20.5 years (SD = 9.7) on average, and all had a further qualification in oncology with an average of 15.4 years (SD = 8.8) of experience. Professionally, 33.3% were medical practice assistants (5/15), 60.0% were nurses (9/15), and one (6.7%) was a physician. In addition to qualifications in oncology, 13.3% had advanced qualifications in social work (2/15), 26.7% as a breast care nurse (4/15), 40.0% in palliative care (6/15), and 26.7% in pain management (4/15). 60% (9/15) worked, recruited, enrolled, and primarily met patients at a medical department of a hospital, 20.0% in a nonmedical department of a hospital (3/15), and 20.0% in an outpatient unit of an oncological specialist (3/15). During the project, three PNs dropped out, one for personal and two for health reasons.
Utilization of WDB
As Table 3 shows, patients represented the majority (96.9%) of users, while PNs were responsible for about one-third of all accesses (33.9%). However, individual patients used the WDB on average less (twice) than the individual PN (37 times), although there were patients with a much higher usage (maximum 30 times). There was little difference in mean daily use between patients (1.1) and PNs (1.2). However, the mean total time spent using the WDB also differed between the groups and was higher for the PNs (328 min vs. 29 min for patients). This was contrasted in time spent per access, where patients stayed longer (12 min) on the WDB than PNs (9 min). Longer-term use of the WDB was only found in a few patients. Less than 10% (37/413) of patients used the WDB beyond a period of half a year, whereas the majority (12/13) of PNs did so.
Table 3
Characteristics of the two user groups (patients and patient navigators, PNs) with regard to different parameters for using the WDB
1 absolute number and percentage, 2 mean (standard deviation), maximum, median
| Patients | PNs | |
| Number of Users 1 | 96.9% (413/426) | 3.1% (13/426) |
| Accesses to the WDB 1 | 66.1% (940/1,423) | 33.9% (483/1,423) |
| Accesses per single user 2 | 2 (2), 30, 1 | 37 (69), 261, 13 |
| Accesses per day per single user 2 | 1.1 (0.3), 3.0, 1.0 | 1.2 (0.2), 1.5, 1.2 |
| total time spent on the WDB per individual user in minutes 2 | 29 (49), 408, 12 | 328 (542), 2,043, 105 |
| total time per individual user per access in minutes 2 | 12 (13), 92, 8 | 9 (3), 15, 8 |
| one-time accesses 1 | 55.2% (228/413) | 0 |
| accesses within 1 month 1 | 15.2% (63/413) | 0 |
| accesses within 3 months 1 | 10.4% (43/413) | 7.7% (1/13) |
| accesses within 6 months 1 | 10.2% (42/413) | 0 |
| accesses within 9 months 1 | 3.9% (16/413) | 38.5% (5/13) |
| accesses within 12 months 1 | 2.9% (12/413) | 7.7% (1/13) |
| accesses within more than 12 months 1 | 2.2% (9/413) | 46.2% (6/13) |
Topic analysis
The topic analysis (Table 4 and Fig. 2 ) examined the categories to which the pages were assigned and the frequency with which these categories were accessed, irrespective of the exact type of cancer represented by the content.
Table 4
Topic analysis of the two accessing groups: patients and patient navigators (PNs). Absolute number and percentage of patients who accessed the topic T(Pat), absolute number and percentage of accesses to the topic T(A), the median time spent on the topic in seconds T(t)
| Topic | Patient | PNs | |||
| T(Pat) | T(A) | T(t) | T(A) | T(t) | |
| therapy | 41.6% (172/413) | 17.4% (1,063/6,096) | 98 | 27.6% (798/2,890) | 24 |
| nutrition | 40.9% (169/413) | 12.9% (785/6,096) | 41 | 8.0% (232/2,890) | 30 |
| side effects | 34.1% (141/413) | 7.9% (483/6,096) | 74 | 7.6% (219/2,890) | 50 |
| physical activity | 32.0% (132/413) | 6.3% (386/6,096) | 52 | 1.4% (41/2,890) | 78 |
| carcinogenesis | 31.5% (130/413) | 10.1% (617/6,096) | 76 | 7.2% (209/2,890) | 24 |
| insurance | 30.0% (124/413) | 7.6% (463/6,096) | 51 | 6.5% (189/2,890) | 10 |
| naturopathy | 29.1% (120/413) | 6.1% (371/6,096) | 55 | 15.3% (442/2,890) | 21 |
| prevention | 22.3% (92/413) | 4.3% (260/6,096) | 69 | 1.9% (55/2,890) | 13 |
| rehabilitation | 22.0% (91/413) | 4.8% (291/6,096) | 66 | 4.6% (133/2,890) | 35 |
| financial matters | 20.1% (83/413) | 5.0% (302/6,096) | 74 | 3.6% (104/2,890) | 28 |
| diagnosis | 18.4% (76/413) | 6.1% (370/6,096) | 56 | 4.8% (139/2,890) | 12 |
| psychological support | 18.4% (76/413) | 3.1% (192/6,096) | 86 | 1.3% (39/2,890) | 61 |
| legal regulations and supports | 18.2% (75/413) | 6.1% (370/6,096) | 31 | 8.5% (245/2,890) | 13 |
| palliative care | 8.0% (33/413) | 0.9% (52/6,096) | 51 | 1.1% (31/2,890) | 30 |
| general information about cancer | 4.6% (19/413) | 1.5% (91/6,096) | 21 | 0.5% (14/2,890) | 23 |

Regarding the number of patients (Fig. 2 , orange bars) interested in each topic, the top three topics were therapy (41.6%, #1), nutrition (40.9%, #2) and side effects (34.1%, #3). In terms of number of accesses by this group, ranks 1 (17.4%) and 2 (12.9%) were the same, but carcinogenesis held the 3rd place (10.1%) and relegated side effects to the 4th place (7.9%). In terms of mean time spent on topics, nutrition fell to 13th place (41 s), while psychological support took over 2nd place (86 s) (1st place remained therapy with 98 s, 3rd place was carcinogenesis with 76 s).
In the PN group (Fig. 2 , blue bars), the most frequent accesses were related to pages dealing with therapy (27.6%, #1), naturopathy (15.3%, #2) and legal regulations/support (8.5%, #3). The top 3 differed significantly when looking at the median time PNs spend on the topics. Here, physical activity was #1 (78 s), psychological support was #2 (61 s), and side effects was #3 (50 s).
Therapy was the top topic in 4 of the 5 variables.
Patient usage, acceptance and rating of WDB
In response to the question ‘ What was the purpose of using the WDB?’, patients could choose one or more responses. 60.0% (195/325) used the WDB to prepare for a medical appointment, while 51.4% (167/325) used it for appointment with the PN. 83.7% (272/325) of patients accessed the WDB to answer questions regarding cancer or treatments that arose, while 92.3% (300/325) and 87.4% (284/325) of patients used the WDB to get general or specific information about cancer, respectively.
Of the 325 patients surveyed, 224 (68.9%) reported that "My PIKKO" helped them make more informed decisions. 75.7% (246/325) reported finding all the information they wanted. That "My PIKKO" was an appropriate way to provide information about diseases was affirmed by 89.8% (292/325) of patients. The 132 open-end comments from 59 patients regarding suggestions for improvement or missing information or functions elucidated that 83.1% wanted more information (49/59); 18.6% suggested further functionalities (11/59); 11.9% wished for interactivity with medical staff (7/59); 10.2% desired structural, design change (6/59); 8.5% wished for the possibility for exchanges with other patients (5/59); and 3.4% wanted appointment functions (2/59).
On a scale from 1 to 6, the WDB was given a mean overall grade of 2.16 (SD = 0.74, median = 2). This corresponds to the second best grade (‘good’) in the German school system.
Health literacy
The curve growth models (Table 5 ) revealed an interaction effect between initial health literacy and use of the WDB [ 29 ]. Patients with initially higher health literacy benefit significantly more from more frequent use of the WDB through improved health literacy scores (Fig. 3 ).
Table 5
Regression analyses for dose effects of visits to the WDB
*** p < .001, **p < .01, * p < .05, b… regression coefficient, SE… standard error, β… standardized regression coefficient
| predictors | b | SE | β |
| intercept | 13.22 *** | 1.23 | 0.01 |
| Pre-test as baseline | 0.62 *** | 0.04 | 0.66 |
| t (0 = baseline) | 0.20 | 0.17 | 0.02 |
| Sessions | -0.08 | 0.13 | 0.11 |
| Sessions x t | -0.01 | 0.02 | -0.01 |
| Sessions x pre-test | 0.01 * | 0.00 | 0.05 |
![Fig. 3 Predicted values of health literacy as a function of cumulated number of visits to the WDB and baseline health literacy. Results of growth curve models [ 29 ]](/library/4394239/assets/071b1959fbd37fc1c8b847fcb3c448d5c6c4ba797d1485e300bbe2d3e8ad38fb.jpg/)
Discussion
This study aimed to evaluate the utilization, patient ratings, and patient acceptance of a web-based database that offers evidence-based information on cancer to patients in a language understandable to laypersons.
Key results
Who? About 66% of patients who received a login used it. Reasons for not using it were primarily technical or time-related. Only in a few cases did the patients already feel informed and therefore saw no need for it. The users reported that they in general use the internet to search for information significantly more often than the non-users. Responsible for nearly one-third of accesses over the entire period of availability, were PNs.
How? PNs used it significantly longer than individual patients. They demonstrated it to patients or prepared for a patient contact. Patients stopped using it when their questions were resolved, their cancer treatment was completed, or when they did not find what they were looking for. However, patients spent more time per access, suggesting that they engaged more deeply with the content.
What? The vast majority of patients surveyed said that they used it as a source of information, rather than to specifically prepare for appointments. Nearly 70% felt more informed by using it, and 75% found what they were looking for. Content of interest differed between the two user groups. Therapy , nutrition , side effects and carcinogenesis were the topics of high interest among patients, as well as psychological support , if you look at the time spent on the topics. Among PNs, some favorite patient topics ( therapy , side effects, psychological support ) were read often and long, but additionally naturopathy , legal regulations/support , and physical activity were of greater interest. These may have been topics that were requested by patients in counseling sessions, so PNs prepared for these topics.
Quality? Almost 90% of the patients surveyed considered the WDB to be a suitable tool of searching for medical information, an assessment which was also expressed by PNs in verbal conversations with us. Patients gave the overall rating of ‘ Good’ , which suggests potential for improvement. This could be seen from the open-ended comments of the surveys where patients suggested that additional more detailed or in-depth information on a wide range of topics would improve the service.
Limitations
First, the PIKKO eligibility criteria reduced the potential users. Further, only the IG could use the WDB. Finally, not every potential user could or would use the WDB because of the reasons described above (technical, need, time, avoidance, health, motivation). Thus, the number of actual users is considerably smaller than the number of potential users within the overall PIKKO collective. A selection bias and the fact that there are multiple barriers to participate in studies [ 34 ] and to use of the internet for information [ 35 ] limit the generalization of the results, so interpretations and conclusions should always be considered with these limitations in mind.
The WDB was primarily a source of information for cancer patients. There were no interactive elements that would have provided an additional incentive to use it.
Although our two data sources referred to the same population (patients in PIKKO) the two sources could not be linked due to the anonymous data collection in the logfile. While it could be assumed that patients who provided information on the utilization of the WDB in the patient survey actually used it, this cannot be verified with absolute certainty.
Interpretation
The digital offer of an easily accessible, quality-assured, and evidence-based information source was well received by cancer patients. Although not all participants used the WDB, the high percentage of users showed that there was sufficient interest and need. PNs also used it to prepare for appointments with patients and were thus better able to answer frequently-asked questions. Both, the usage on its own as well as the usage by PNs ultimately fulfilled the cancer patients' need for information.
Measurable benefits were seen in the fact that a majority of users felt better informed and found the information they were looking for. As we showed in further PIKKO analyses [ 29 ], patients with already high health literacy at baseline, as measured by the HSL-EU-Q47 [ 30 ] benefited in particular. These patients increased their health literacy by using the WDB (analysis of dose effects). Presumably, higher health literacy enables better reception of information (e.g. via the WDB), which in turn has a positive effect on health literacy. This fits with the finding that WDB users were also significantly more likely to use the internet as a general source of information. In another paper, we were also able to show that the WDB continued to be used in times of the first COVID-19 lockdown and that even the number of accesses increased [ 36 ].
The relatively short time spent on the pages may be related either to the fact that patient and PN questions could be clarified quickly. Missing information could be another explanation. One suggestion for improvement is therefore to expand the content. Furthermore, the WDB did not offer interactive elements that kept users on the site longer, which leads to further potential for improvement.
Apps were gaining more importance than individual websites during the last years [ 37 ]. For this reason, the technical conversion to a native app could also represent an opportunity to improve the utilization and health related effects of the WDB.
Frequently accessed topics by patients often related to the acute treatment of cancer or how to deal with it. This can be attributed to the fact that many patients with new diagnoses cancer or undergoing acute treatment were recruited in the PIKKO project. Almost exclusively, this recruitment took place in hospitals or oncology practices. In contrast, recruitment did not take place in places of aftercare such as general practitioners' practices or rehabilitation facilities. Patients in aftercare may have other topics of interest.
Conclusion
Access to reliable information is essential for health related decision making. Our findings confirm that cancer patients have a high need for information [ 5 ] and are willing to seek it out digitally [ 6 ]. Persons who advise cancer patients (here, PNs) also benefitted from access to a source of information to better answer patients' questions. Currently, especially in the context of cancer, there exists an amount of dangerous disinformation online [ 38 ], high quality information websites are less visible in online searches [ 17 ], and profit-driven websites have lower quality [ 10 ].
In addition, since 2022, an artificial intelligence (AI) chatbot, ChatGPT 3.5, has been available to a broad, interested public [ 39 ]. This adds another dimension to information searches. The ability to have an AI search the internet for information carries the risk that without source identification, the origin of the information and if it is trustworthy cannot be known with certainty by users. Here, medical care faces new challenges in terms of patient information.
Information sources like "My PIKKO" are an essential step for improving the information situation on the internet. The WDB represents a trustworthy, evidence-based and target group-appropriate source of information for cancer patients.
Supplementary Information
Below is the link to the electronic supplementary material.
(PNG 478 KB)
High Resolution Image (Two screenshots of the WDB. The main menu is shown at the top. The blue icon "Krebsarten" has been replaced by the cancer type activated for the patient. The lower area shows a subpage on the topic of therapy TIF 3889 KB)
Acknowledgements
We would like to thank Anna Bäcker, Katja Brenk-Franz, Heide Wenzel and Clara Korn from IPMPP Jena for their valuable support in planning and conducting the PIKKO evaluation.
Furthermore, we thank Katrin Clauß, Elizabeth Hertel, Viola Kasper, Fabian Kattlun, René Meyer, Annika Momberg, Juliane Poeck, Sarah Salomo, Julika Skrobacz, and Robert Terbach for their valuable work on the knowledge database “My PIKKO”.
We would also like to thank all consortium partners of the PIKKO study, namely the IKK Südwest, the AOK Rhineland-Palatinate/Saarland, the KNAPPSCHAFT, the Techniker Krankenkasse, the German Cancer Society, the Saarland Cancer Society, and the Jena University Hospital, for the good cooperation.
Last but not least, we thank all patient navigators, psychooncologists, medical as well as non-medical staff and of course the participating patients for their support.
Abbreviations
Control group
German Cancer Society
Intervention group
Patient information, communication and competence empowerment in oncology
Patient navigator
Web-based knowledge database
Author contributions
All authors contributed to the study conception and design. Material preparation, data collection and analyses were performed by N.S. and U.A.. The first draft of the manuscript was written by N.S. and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Conceptualization: U.A., F.B., J.H., C.K., B.S.; Methodology: N.S., U.A.; Formal analyses and investigation: N.S., U.A.; Writing—original draft preparation: N.S.; Writing—review and editing: C.K., U.A., F.B., J.H., B.S.; Funding acquisition: F.B., J.H., B.S.; Resources: C.K., F.B., Supervision: F.B., B.S., J.H..
Funding
Open Access funding enabled and organized by Projekt DEAL. PIKKO was funded by the Innovation Fund of the Federal Joint Committee (Gemeinsamer Bundesausschuss) (01NVF17011) in the period from 1 Aug 2017 to 28 Feb 2021.
Data availability
The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.
Declarations
Ethics approval and consent to participate
This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the ethics committee of medical association of the Saarland (2 Nov 2017/No. 114/17). The informed consent by study participants was obtained in a written way.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
1. Paterson C, Toohey K, Bacon R, Kavanagh PS, Roberts C (2023) What are the unmet supportive care needs of people affected by cancer: an umbrella systematic review. Semin Oncol Nurs 39:151353. 10.1016/j.soncn.2022.151353 10.1016/j.soncn.2022.151353
2. Husson O, Mols F, van de Poll-Franse LV (2011) The relation between information provision and health-related quality of life, anxiety and depression among cancer survivors: a systematic review. Ann Oncol 22:761–772. 10.1093/annonc/mdq413 10.1093/annonc/mdq413
3. Gaston CM, Mitchell G (2005) Information giving and decision-making in patients with advanced cancer: A systematic review. Soc Sci Med 61:2252–2264. 10.1016/j.socscimed.2005.04.015 10.1016/j.socscimed.2005.04.015
4. Thorne S, Hislop TG, Kim-Sing C, Oglov V, Oliffe JL, Stajduhar KI (2014) Changing communication needs and preferences across the cancer care trajectory: insights from the patient perspective. Support Care Cancer 22:1009–1015. 10.1007/s00520-013-2056-4 10.1007/s00520-013-2056-4
5. Rudolph I, Seilacher E, Köster M-J, Stellamanns J, Liebl P, Zell J, Ludwig S, Beck V, Hübner J (2015) Der Informationsbedarf von Patienten mit Krebserkrankungen in Deutschland – eine Befragung von Patienten und Angehörigen. Dtsch Med Wochenschr 140:e43–e47. 10.1055/s-0041-100585 10.1055/s-0041-100585
6. Keinki C, Seilacher E, Ebel M, Ruetters D, Kessler I, Stellamanns J, Rudolph I, Huebner J (2016) Information needs of cancer patients and perception of impact of the disease, of self-efficacy, and locus of control. J Cancer Educ 31:610–616. 10.1007/s13187-015-0860-x 10.1007/s13187-015-0860-x
7. Gaisser A, Sonnet M, Weg-Remers S (2016) Wo suchen und finden Krebspatienten verlässliche Informationen? Forum 31:53–58. 10.1007/s12312-015-0010-8 10.1007/s12312-015-0010-8
8. Borges U Jr, Riese C, Baumann W (2018) Internet use by oncology outpatients: results of a survey in Germany. Gesundheitswesen 80:1088–1094. 10.1055/s-0043-104213 10.1055/s-0043-104213
9. Schallock H, Bartmann B, Keinki C, Huebner J (2019) Online information on oncologists’ and non-medical practitioners’ websites in Germany: A critical comparison. Patient Educ Couns 102:2038–2048. 10.1016/j.pec.2019.05.022 10.1016/j.pec.2019.05.022
10. Herth N, Kuenzel U, Liebl P, Keinki C, Zell J, Huebner J (2016) Internet information for patients on cancer diets - an analysis of German websites. Oncol Res Treat 39:273–281. 10.1159/000445861 10.1159/000445861
11. Nicolas-Joseph M, Ould Brahim L, Boureanu MI, Frati FYE, Bourdache LR, Belzile E, Lambert SD (2023) An evaluation of the suitability, readability, quality, and usefulness of online resources for patients with cancer receiving immunotherapy. Patient Educ Couns 110:107640. 10.1016/j.pec.2023.107640 10.1016/j.pec.2023.107640
12. Salem J, Paffenholz P, Bolenz C, von Brandenstein M, Cebulla A, Haferkamp A, Kuru T, Lee CT, Pfister D, Tsaur I, Borgmann H, Heidenreich A (2019) Websites on bladder cancer: an appropriate source of patient information? J Cancer Educ 34:381–387. 10.1007/s13187-017-1316-2 10.1007/s13187-017-1316-2
13. Kuenzel U, Monga Sindeu T, Schroth S, Huebner J, Herth N (2018) Evaluation of the quality of online information for patients with rare cancers: thyroid cancer. J Cancer Educ 33:960–966. 10.1007/s13187-017-1173-z 10.1007/s13187-017-1173-z
14. Staemmler H, Sauer S, Kreutzer EP, Brandt J, Jordan K, Kreuter M, Kriegsmann M, Goldschmidt H, Müller-Tidow C, Egerer G, Kriegsmann K (2022) Quality of online information on multiple myeloma available for laypersons. Curr Oncol 29:4522–4540. 10.3390/curroncol29070358 10.3390/curroncol29070358
15. Hopmans W, Verstegen NE, Haasbeek CJA, Damman OC, Slotman BJ, Timmermans DRM, Senan S (2012) An evaluation of websites providing patient information on stereotactic body radiation therapy (SBRT) for stage I lung cancer in three Western European countries. J Radiosurg SBRT 1:303–315
16. Janssen S, Käsmann L, Fahlbusch FB, Rades D, Vordermark D (2018) Side effects of radiotherapy in breast cancer patients : The Internet as an information source. Strahlenther Onkol 194:136–142. 10.1007/s00066-017-1197-7 10.1007/s00066-017-1197-7
17. Liebl P, Seilacher E, Koester MJ, Stellamanns J, Zell J, Hubner J (2015) What cancer patients find in the internet: the visibility of evidence-based patient information - analysis of information on German websites. Oncol Res Treat 38:212–218. 10.1159/000381739 10.1159/000381739
18. Team HON (2020) HONcode certification: Key points of the certification. https://en.wikipedia.org/wiki/Health_On_the_Net_Foundation . Accessed 15 July 2024
19. Schneider N, Bäcker A, Brenk-Franz K, Keinki C, Hübner J, Brandt F, von der Winkel G, Hager L, Strauss B, Altmann U (2020) Patient information, communication and competence empowerment in oncology (PIKKO) – evaluation of a supportive care intervention for overall oncological patients. Study protocol of a non-randomized controlled trial. BMC Med Res Methodol 20:120. 10.1186/s12874-020-01002-1 10.1186/s12874-020-01002-1
20. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP (2007) The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med 147:573–577. 10.7326/0003-4819-147-8-200710160-00010 10.7326/0003-4819-147-8-200710160-00010
21. ESMO Clinical Practice Guidelines. https://www.esmo.org/guidelines . Accessed 15 July 2024
22. Deutsche Krebsgesellschaft Leitlinienprogramm Onkologie. https://www.leitlinienprogramm-onkologie.de/home . Accessed 15 July 2024
23. DISCERN-Online (2005) DISCERN Online - quality criteria for patient information [DISCERN-Online - Qualitätskriterien für Patienteninformationen]. http://www.discern.de/ . Accessed 15 July 2024
24. Kahl K (2018) Gesundheitskompetenz: Gut informiert im Netz. Dtsch Arztebl 115(27-28): A-1344 / B-1134 / C-1126
25. Steckelberg A, Berger B, Köpke S, Heesen C, Mühlhauser I (2005) Kriterien für evidenzbasierte Patienteninformationen. Z Arztl Fortbild Qualitatssich 99:343–351
26. Flesch R (1948) A new readability yardstick. J Appl Psychol 32:221–233. 10.1037/h0057532 10.1037/h0057532
27. Bamberger R, Vanacek E (1984) Lesen - Verstehen - Lernen - Schreiben. Die Schwierigkeitsstufen von Texten in deutscher Sprache. Jugend und Volk / Sauerlaender, Wien
28. PIKKO project (2021) Demo version "Mein PIKKO". https://mein.pikko.de/accounts/sign_in . Accessed 15 July 2024
29. Schneider N, Bäcker A, Strauß B, Hübner J, Rubai S, Wagner S, Schwarz-Fedrow D, Hager L, Brenk-Franz K, Keinki C, Brandt F, Altmann U (2023) Patient information, communication and competence empowerment in oncology: results and learnings from the PIKKO study. Support Care Cancer 31:327. 10.1007/s00520-023-07781-9 10.1007/s00520-023-07781-9
30. HLS-EU Consortium (2012) Comparative Report Of Health Literacy In Eight EU Member States. The European Health Literacy Survey HLS-EU (second extended and revised version; date 22 Jul 2014), Online publication http://health-literacy.eu . Accessed 15 July 2024
31. Mayring P (2010) Qualitative Inhaltsanalyse. Grundlagen und Techniken, 12. Aufl. Beltz Verlag, Weinheim Basel
32. Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences - 2nd ed. Lawrence Erlbaum Associates, Hillsdale
33. Kirk RE (1996) Practical significance: a concept whose time has come. Edu Psychol Meas 56:746–759. 10.1177/0013164496056005002 10.1177/0013164496056005002
34. Fayter D, McDaid C, Eastwood A (2007) A systematic review highlights threats to validity in studies of barriers to cancer trial participation. J Clin Epidemiol 60:990–1001. 10.1016/j.jclinepi.2006.12.013 10.1016/j.jclinepi.2006.12.013
35. Ferraris G, Monzani D, Coppini V, Conti L, Maria Pizzoli SF, Grasso R, Pravettoni G (2023) Barriers to and facilitators of online health information-seeking behaviours among cancer patients: A systematic review. Digit Health 9:20552076231210664. 10.1177/20552076231210663 10.1177/20552076231210663
36. Schneider N, Strauß B, Hübner J, Keinki C, Brandt F, Rubai S, Altmann U (2023) The impact of the COVID-19 pandemic restrictions on the health care utilization of cancer patients. BMC Cancer 23:439. 10.1186/s12885-023-10945-9 10.1186/s12885-023-10945-9
37. Springer F, Mehnert-Theuerkauf A (2022) Content features and its implementation in novel app-based psycho-oncological interventions for cancer survivors: a narrative review. Curr Opin Oncol 34:313–319. 10.1097/cco.0000000000000836 10.1097/cco.0000000000000836
38. Hübner J, Mücke R, Münstedt K, Micke O (2012) Kritische analyse der Internetseiten der Gesellschaft für Biologische Krebsabwehr. Onkologe 18:908–914. 10.1007/s00761-012-2332-9 10.1007/s00761-012-2332-9
39. Berger U, Schneider N (2023) How ChatGPT will change research, education and healthcare? Psychother Psychosom Med Psychol 73:159–161
Associated Data
Supplementary Materials
(PNG 478 KB)
High Resolution Image (Two screenshots of the WDB. The main menu is shown at the top. The blue icon "Krebsarten" has been replaced by the cancer type activated for the patient. The lower area shows a subpage on the topic of therapy TIF 3889 KB)
Data Availability Statement
The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.