Development and Promotion of An Mhealth App For Adolescents Based On The European Code Against Cancer: Retrospective Cohort Study
Development and Promotion of An Mhealth App For Adolescents Based On The European Code Against Cancer: Retrospective Cohort Study
Development and Promotion of An Mhealth App For Adolescents Based On The European Code Against Cancer: Retrospective Cohort Study
Original Paper
Meritxell Mallafré-Larrosa1,2, MD; Ginevra Papi1, MSc; Antoni Trilla2, MD, PhD; David Ritchie1, PhD
1
Association of European Cancer Leagues, Brussels, Belgium
2
Faculty of Medicine and Health Sciences, University of Barcelona, Barcelona, Spain
Corresponding Author:
Meritxell Mallafré-Larrosa, MD
Association of European Cancer Leagues
Chaussée de Louvain 479
Brussels, 1030
Belgium
Phone: 32 2 256 2000
Fax: 32 2 256 2003
Email: [email protected]
Abstract
Background: Mobile health technologies, underpinned by scientific evidence and ethical standards, exhibit considerable promise
and potential in actively engaging consumers and patients while also assisting health care providers in delivering cancer prevention
and care services. The WASABY mobile app was conceived as an innovative, evidence-based mobile health tool aimed at
disseminating age-appropriate messages from the European Code Against Cancer (ECAC) to adolescents across Europe.
Objective: This study aims to assess the outcomes of the design, development, and promotion of the WASABY app through a
3-pronged evaluation framework that encompasses data on social media promotion, app store traffic, and user engagement.
Methods: The WASABY app’s content, cocreated with cancer-focused civil society organizations across 6 European countries,
drew upon scientific evidence from the ECAC. The app’s 10 modules were designed using the health belief model and a gamification
conceptual framework characterized by spaced repetition learning techniques, refined through 2 rounds of testing. To evaluate
the effectiveness of the app, we conducted a retrospective cohort study using the WASABY app’s user database registered from
February 4 to June 30, 2021, using a 3-pronged assessment framework: social media promotion, app store traffic, and user
engagement. Descriptive statistics and association analyses explored the relationship between sociodemographic variables and
user performance analytics.
Results: After extensive promotion on various social media platforms and subsequent traffic to the Apple App and Google Play
stores, a sample of 748 users aged between 14 and 19 years was included in the study cohort. The selected sample exhibited a
mean age of 16.08 (SD 1.28) years and was characterized by a predominant representation of female users (499/748, 66.7%).
Most app users identified themselves as nonsmokers (689/748, 92.1%), reported either no or infrequent alcohol consumption
(432/748, 57.8% and 250/748, 33.4%, respectively), and indicated being physically active for 1 to 5 hours per week (505/748,
67.5%). In aggregate, the app’s content garnered substantial interest, as evidenced by 40.8% (305/748) of users visiting each of
the 10 individual modules. Notably, sex and smoking habits emerged as predictors of app completion rates; specifically, male
and smoking users demonstrated a decreased likelihood of successfully completing the app’s content (odds ratio 0.878, 95% CI
0.809-0.954 and odds ratio 0.835, 95% CI 0.735-0.949, respectively).
Conclusions: The development and promotion of the WASABY app presents a valuable case study, illustrating the effective
dissemination of evidence-based recommendations on cancer prevention within the ECAC through an innovative mobile app
aimed at European adolescents. The data derived from this study provide insightful findings for the implementation of Europe’s
Beating Cancer Plan, particularly the creation of the EU Mobile App for Cancer Prevention.
KEYWORDS
adolescent health; cancer prevention; digital health; ECAC; European Code Against Cancer; health promotion; mHealth; mobile
app; mobile health; NCD; noncommunicable disease; primary prevention
Returning to the home screen, users can review their profiles, perceptions, attitudes, and intentions related to health behaviors.
earn reward badges, and track their progress. Additionally, they Consistent with similar apps assessed in the existing literature
can access the final quiz and the ranking of the top learners. and using a methodology evocative of the well-known Duolingo
Regarding the badges, the app uses an incentive-based Language app [37], the app was also grounded in a conceptual
mechanism wherein achievement badges are unlocked upon framework of gamification, characterized by spaced repetition
completing each module, with icons becoming colorful as users learning techniques aimed at promoting efficient and effective
advance in their learning (Figure 1, screenshot 5). By clicking learning, especially in achieving long-term information retention
on the progress button, users can monitor which modules they compared to concentrated massed practice [38].
have completed, have not started, or are currently ongoing
Third, the 10 content modules and associated quizzes that
(Figure 1, screenshot 6). Upon the completion of all modules,
resulted from the selection of specific ECAC messages and their
users have the opportunity to take a final quiz to test their
operationalization through the HBM underwent a series of
knowledge.
revisions, which were conducted by cancer leagues to assess
Importantly, real-time progress data are recorded, enabling users their adequacy, comprehensibility, and accuracy. We used a
to share their progress and quiz results with friends and other structured approach to ensure the adequacy and accuracy of the
players. This contributes to the creation of an international content. Initially, we used the nominal group technique to
ranking list of “top learners” across Europe. These features collaboratively define the scope of each module. Subsequently,
foster a competitive spirit, instill a sense of accomplishment, an iterative expert review process engaged specialists from both
and encourage the repeated use of the app. medical and educational domains within the ECL’s network of
cancer leagues. These experts critically assessed and refined
Aim of the Study the content to enhance its clarity and alignment with user needs.
In this paper, we present the preliminary findings of the design, Subsequent refinements were made to ensure that the messaging
iterative development, and promotion of the WASABY app, would be suitable for a reading level appropriate for 12-year-old
made available to European adolescents in real-life settings. children. This was achieved following beta and alpha tests with
The objectives of this study were threefold: (1) to analyze data the app’s target population.
pertaining to the app’s promotion on social media, (2) to assess
the traffic generated on Google Play and Apple App stores, and WASABY App Testing
(3) to evaluate the level of user participation and engagement The beta version of the app was developed for Android devices
with the app. and made available in the 27 EU member states (plus the United
Kingdom). It underwent a first round of testing through a
Methods web-supported 19-item questionnaire to assess comprehension
and suitability of the app’s content. From May 27 to June 10,
WASABY App Development 2020, a social media campaign was used to recruit 83 testers
The WASABY app’s content was developed by drawing upon within the app’s target group (ie, healthy 14- to 19-year-olds
the ECAC’s scientific evidence [5]. Specifically, a total of 6 residing in Europe) from 25 EU countries to participate in the
cancer leagues located in Spain (Asociación Española Contra beta test (Multimedia Appendix 1).
el Cáncer), the United Kingdom (Cancer Focus Northern Originally developed in English, the app was later translated
Ireland), Slovenia (Zveza slovenskih društev za boj proti raku; into 6 additional languages (French, German, Italian, Romanian,
Association of Slovenian Cancer Societies), France (La Ligue Slovenian, and Spanish) and adapted to be used on iOS devices.
contre le Cancer), Switzerland (Krebsliga), and Romania It underwent a second round of testing (alpha test) to check for
(Societatea Româna de Cancer) were engaged in this process. functionality and technical aspects through a dedicated 18-item
Additionally, a total of 111 adolescents aged between 14 and questionnaire, enrolling a total of 28 testers: 4 individuals per
19 years from 25 EU Member States actively participated in 2 language and 2 per platform (Android and iOS). The final
testing rounds. version of the app included feedback implemented from the 2
First, a selection of relevant ECAC messages (specifically, subsequent rounds of testing and was made available in all
ECAC messages 1-7 and 10-11) was made, taking into countries of the WHO Europe region in both the Google Play
consideration the age group of the target audience. Second, and Apple App stores.
materials sourced from the ECAC’s scientific website [35], Study Design and Population
which served as the foundation for the content of the app, were
operationalized by applying the health belief model (HBM) We conducted a retrospective cohort study using data from the
[36]. The operationalization of the HBM within the WASABY app’s database of registered users, covering the period from
app involved the strategic design and presentation of content February 4 to June 30, 2021. The sample size was determined
that aligned with the core constructs of the model. The process based on the available retrospective cohort of 976 registered
involved integrating educational modules and interactive users. Exclusion criteria were applied to users outside of the
elements to raise awareness of the risks of unhealthy behaviors, age target group (14- to 19-year-olds) and those with invalid or
emphasizing the benefits of adopting healthy habits, providing partially missing registration data. Anonymized data were used
practical strategies to overcome barriers, and incorporating cues for all analyses. This study adhered to the STROBE
to action to boost users’ confidence in making positive lifestyle (Strengthening the Reporting of Observational Studies in
changes. Thus, the app’s content was crafted to influence users’ Epidemiology) reporting guideline [39].
WASABY App Evaluation Framework Variables from the user registry database were collected,
A 3-pronged evaluation framework was developed with including anonymized user identification, demographics (birth
indicators reflecting the promotion of the app on social date, sex, country, region, and language), anthropometrics
media, the traffic generated on Google Play and Apple App (height and weight, through which BMI was calculated), and
stores, and the level of engagement exhibited by app users. self-reported cancer risk factors (physical activity, tobacco use,
Instagram-powered analytics were monitored and analyzed and alcohol consumption). The database also contained
monthly during the study period. Variables collected included: information on the completion of the app’s modules according
accounts reached, content interactions, profile visits, website to 3 variables (visits, readings, and completed auto-evaluation).
taps, top posts, and follower-specific analysis. The app’s traffic Variables were operationalized to serve as proxies for the
in app stores was analyzed through Google- and Apple-powered following constructs: content interest, content completion, and
key performance indicators (KPIs), including product page quiz completion (Table 1 presents details on variable definition
views, product installations, conversion rate, deletions, crashes, and assessment). Overall, the app as a tool was considered
and average rating [40,41]. Such KPIs were stratified by country, completed upon 100% module reading registry.
date, and download source.
Table 1. Variables capturing WASABY mobile app individual user performance. Each variable was assessed separately for each of the app’s 10 content
modules.
Variable Construct Definition and interpretation
Module vis- Content inter- Variable registering the amount of page visits into a specific module. Interest was operationalized as a continuous
its est variable, by which greater values capture greater interest.
Module Content Variable registering the click on “I have read it” button present at the end of each module. Content completion was
readings completion operationalized as a dichotomous variable, considered complete if 1 or more readings were recorded.
Completed Quiz comple- Variable registering the number of completed quiz questions per module (7 available per module, with unlimited response
autoevalua- tion opportunities). Quiz completion was operationalized as a dichotomous variable, by which a given module’s autoevalu-
tions ation was considered complete if 3 or more questions were registered.
WASABY App User Engagement were included in the study cohort. Table 2 includes a summary
During the study period, a total of 976 users were fully of the sample demographics. As more than half (n=392, 52.4%)
registered in the app’s database. After applying all inclusion of the sample was composed of users from Slovenia, this
and exclusion criteria, 748 users aged between 14 and 19 years subgroup is reported separately.
Countrya
Belgium 7 (0.9) N/Ab
Bulgaria 16 (2.1) N/A
Czechia 13 (1.7) N/A
Denmark 1 (0.1) N/A
Germany 13 (1.7) N/A
Estonia 12 (1.6) N/A
Ireland 12 (1.6) N/A
Greece 14 (1.9) N/A
Spain 14 (1.9) N/A
France 5 (0.7) N/A
Croatia 23 (3.1) N/A
Italy 25 (3.3) N/A
Latvia 21 (2.8) N/A
Lithuania 17 (2.3) N/A
Luxembourg 3 (0.4) N/A
Hungary 12 (1.6) N/A
Malta 5 (0.7) N/A
The Netherlands 9 (1.2) N/A
Austria 2 (0.3) N/A
Poland 34 (4.6) N/A
Portugal 13 (1.7) N/A
Romania 49 (6.6) N/A
Slovenia 392 (52.4) N/A
Slovakia 13 (1.7) N/A
Finland 5 (0.7) N/A
Sweden 6 (0.8) N/A
United Kingdom 10 (1.3) N/A
Switzerland 1 (0.1) N/A
Northern Macedonia 1 (0.1) N/A
BMI (kg/m2)
10-18 89 (11.9) 35 (8.9)
18-20 180 (24.1) 94 (24)
20-25 359 (48) 203 (51.8)
25-30 84 (11.2) 43 (11)
30-35 18 (2.4) 9 (2.3)
35-40 7 (0.9) 4 (1)
>40 7 (0.9) 3 (0.8)
Unknown 4 (0.5) 1 (0.3)
a
8 countries within the World Health Organization Europe region were excluded, given there were no registered users in the WASABY app database
(Cyprus, Iceland, Liechtenstein, Norway, Montenegro, Albania, Serbia, and Turkey).
b
N/A: not applicable.
Overall, the mean age was 16.08 (SD 1.28) years with a median accounting for 66.7% (499/748) of all users (Slovenia: 281/392,
of 16 years, similar to Slovenia’s cohort (mean 16.31, SD 3.83; 71.7%). The app’s interface was predominantly accessed in
median 16 years). Female users were overrepresented, English (351/748, 46.9%) or Slovenian (350/748, 46.7%).
Self-reported anthropometric data were used to estimate BMI, Self-reported behavioral risk factors related to tobacco smoking,
and the cohort had a mean of 21.86 (SD 4.18) kg/m2. alcohol consumption, and physical activity were collected upon
Approximately 72.1% (539/748) of users fell within the 18-25 registration (Table 3). Most users identified themselves as
kg/m2 range, which is considered normal according to nonsmokers (689/748, 92.1%) and reported either no or
international standards. infrequent alcohol consumption (432/748, 57.8% and 250/748,
33.4%, respectively). Moreover, 67.5% (505/748) of users
indicated being physically active for 1-5 hours per week.
Table 3. Self-reported risk factors upon use registration in the WASABY app.
Self-reported risk factors Overall (N=748), n (%) Slovenia (n=392), n (%)
Tobacco use (cigarettes per day)
None 689 (92.1) 361 (92.1)
1-5 38 (5.1) 22 (5.6)
5-10 14 (1.9) 8 (2)
10-20 4 (0.5) 0 (0)
≥20 3 (0.4) 1 (0.3)
Alcohol consumption (frequency)
None 432 (57.8) 221 (56.4)
Rarely 250 (33.4) 131 (33.4)
Only on weekends 50 (6.7) 27 (6.9)
Often 12 (1.6) 10 (2.6)
Everyday 4 (0.5) 3 (0.8)
Physical activity (approximate hours per week)
Sedentary 70 (9.4) 28 (7.1)
1 125 (16.7) 61 (15.6)
3 238 (31.8) 121 (30.9)
5 142 (19) 84 (21.4)
>5 173 (23.1) 98 (25)
The individual and overall app’s performance was investigated (276/748) reading all of them and 34.5% (258/748) finishing
through 3 variables (defined in Table 1 and results presented in all self-assessment quizzes. Notably, Slovenian users
Table 4). In aggregate, the app’s content garnered substantial demonstrated the highest level of engagement: they were most
interest, as evidenced by 40.8% (305/748) of users accessing likely to access all modules (190/392, 48.5%), read the modules’
each of the 10 individual modules. Similarly, a comparable contents (167/392, 42.6%), and complete the quizzes (145/392,
proportion of users completed the modules, with 36.9% 37%).
Table 4. WASABY app performance metrics in terms of app interest, content completion, and quiz completion (operationalized variable description
available in Table 1).
App use constructs Overall (N=748), n (%) Slovenia (n=392), n (%)
App interest (number of modules visited)
0 36 (4.8) 31 (7.9)
1 101 (13.5) 43 (11)
2 75 (10) 30 (7.7)
3 72 (9.6) 22 (5.6)
4 47 (6.3) 18 (4.6)
5 48 (6.4) 23 (5.9)
6 33 (4.4) 18 (4.6)
7 14 (1.9) 6 (1.6)
8 7 (0.9) 2 (0.5)
9 10 (1.3) 9 (2.3)
10 (all) 305 (40.8) 190 (48.5)
Content completion (number of modules read)
0 139 (18.6) 75 (19.1)
1 86 (11.5) 30 (7.7)
2 62 (8.3) 27 (6.9)
3 53 (7.1) 19 (4.9)
4 41 (5.5) 17 (4.3)
5 35 (4.7) 18 (4.6)
6 27 (3.6) 18 (4.6)
7 11 (1.5) 7 (1.8)
8 6 (0.8) 2 (0.5)
9 12 (1.6) 12 (3.1)
10 (all) 276 (36.9) 167 (42.6)
Quiz completion (number of modules with quiz completed)
0 171 (22.9) 88 (22.5)
1 83 (11.1) 29 (7.4)
2 61 (8.2) 31 (7.9)
3 62 (8.3) 31 (7.9)
4 37 (5) 16 (4.1)
5 29 (3.9) 17 (4.3)
6 18 (2.4) 10 (2.6)
7 9 (1.2) 5 (1.3)
8 6 (0.8) 6 (1.5)
9 14 (1.9) 14 (3.6)
10 (all) 258 (34.5) 145 (37)
Significant differences were observed by sex in terms of the Additionally, significant variations were noted in the
number of modules visited, read, and quizzes completed (P=.02, abovementioned associations concerning self-reported user risk
P=.047, and P=.03, respectively), with male users being less factors based on dichotomized tobacco consumption (P=.04,
likely to complete the overall app (OR 0.878, 95% CI P=.07, and P=.03). Self-reported tobacco users demonstrated
0.809-0.954). Conversely, there were no differences found by a reduced likelihood of completing the app (OR 0.835, 95% CI
age group (dichotomized as 14-16 years vs 17-19 years) in the 0.735-0.949). No notable distinctions were detected concerning
abovementioned tested associations. alcohol consumption or physical activity. Finally, while
https://cancer.jmir.org/2023/1/e48040/ JMIR Cancer 2023 | vol. 9 | e48040 | p. 10
(page number not for citation purposes)
XSL• FO
RenderX
JMIR CANCER Mallafré-Larrosa et al
evaluating the app’s performance based on individual modules, result suggests that covering multiple domains of cancer
a decreasing linear relationship was observed while progressing prevention is feasible without deterring user interest and
through module 1 (on tobacco) to module 10 (on cancer adherence.
prevention; Figure 1).
As shown in Figure 2, a decreasing linear relationship was
observed in the app’s completion across the 10 individual
Discussion modules, with the highest level of interest and completion
Principal Findings reported for module 1 (focused on tobacco), which gradually
decreased until module 10 (focused on the ECAC). While it is
The results of the WASABY app pilot study have demonstrated reasonable to expect a decline in user retention across the
the potential of an mHealth app to promote evidence-based modules as users progress through the app [46], the added value
cancer prevention recommendations to European adolescents. of the WASABY app concept lies in addressing the multiple
While most mHealth apps addressing cancer prevention have recommendations of the ECAC. Therefore, if users discontinue
focused on specific risk factors (such as body weight [43]) or using the app after completing the initial modules that focus on
specific cancer sites (such as breast cancer [44]) and a plethora lifestyle-related risk factors, they will not benefit from the
of interventions targeting patients with cancer and survivors of crucial knowledge related to cancer prevention, particularly
cancer have been developed [45], there is currently no other myths and misconceptions (addressed in module 9), thereby
comprehensive app based on the ECAC that specifically targets reducing the potential impact of the app. The data from the pilot
adolescents aged between 14 and 19 years, to the best of our also showed that sex was a predictor of completion of the
knowledge. modules. This may be explained by an overrepresentation of
The app was successful in engaging a large proportion of users female users, with approximately two-thirds of users identifying
across all its modules, with 40.8% (305/748) of users visiting as female. Conversely, nonsmoker users were more likely to
all 10 modules. Similarly, 36.9% (276/748) of users completed adhere throughout the content until the last module, underlining
each module, and 34.5% (258/748) completed the entire app the importance of understanding the sociodemographics of the
autoevaluation assessment, indicating that over one-third of target audience to best target the messaging in novel digital
users in the pilot study completed the app. Given that the content health interventions [47]. Additionally, such characteristics shall
of the app covers a wide range of cancer risk factors and be considered as well in the promotion and recruitment methods
protective measures as outlined in the ECAC, this encouraging for app users to achieve a more representative reach among the
target population.
Figure 2. WASABY app performance metrics by module (1-10) in terms of app interest, content completion, and quiz completion.
Comparing the results of this study with the findings of previous lifestyle risk factors can be effective in improving physical
studies in the literature becomes difficult when considering the activity and fruit and vegetable consumption, indicating the
small population sizes and heterogeneous designs of mHealth potential for multirisk factor application targeting adolescents
interventions. A systematic review and meta-analysis reported [48]. An earlier scoping review on apps to promote healthy
that eHealth school-based interventions addressing multiple lifestyle among adolescents concluded that the ability to set
personal goals enhances self-monitoring and increases awareness entirely through social media channels. Therefore, much of the
[49]. The review also determined that most apps were data collected for this study relied on self-reporting, and no
implemented as part of therapy or to strengthen school programs, measures were in place to validate user app registration.
supporting the original conceptual design of the pilot Additionally, due to the scope of the study analysis, which was
intervention for the WASABY app [49]. Additionally, a total rather exploratory, no adjustments by age or sex groups were
of 2 umbrella reviews published in 2023 on digital interventions conducted in the statistical analysis. Lastly, the data reported
to moderate alcohol consumption in young people and physical were insufficient to determine whether the app promotion was
inactivity and nutrition in young people [50] identified the only reaching health-literate populations within the target group.
potential of digital interventions to increase physical activity It is, therefore, not possible to determine whether the app’s pilot
and improve nutrition in school-age children and reduce alcohol reached a representative cross-section of the population or if it
consumption in certain subpopulations of younger people, was installed and completed by individuals who were already
especially if active feedback is provided by the mHealth more likely to comply with the recommendations of the ECAC.
intervention. The overall body of evidence is characterized by This would be a key area of further research in future studies
substantial heterogeneity, inconsistent population groups, and on mHealth tools.
intervention definitions. This indicates that the effectiveness of
mHealth tools for health promotion may suffer from the small
Future Recommendations
effects of interventions, which remain detectable for a short The app was developed to promote and encourage adolescents
period of time after the conclusion of the intervention. to follow the ECAC recommendations. Evidence suggests that
the ECAC is not well-known among the general public [51].
Finally, during the pilot period, the promotion strategy of the Therefore, the app could help to improve awareness and,
app relied partially on the support of nongovernmental subsequently, knowledge and adherence to these
organizations (NGOs) to increase awareness and ultimately recommendations. With this objective in mind, the European
integrate the app into their existing multidimensional health Commission has mandated the development of the “EU Mobile
education programs. Cancer leagues are key NGOs acting as App for Cancer Prevention” under Europe’s Beating Cancer
primary promoters of the ECAC at the national, regional, and Plan [52]. The results and lessons learned from the WASABY
local levels, marking them out as ideal promoters of the app. app should be taken into account for this new EU endeavor. To
Cancer leagues were involved in the cocreation process from improve adherence and retention, future iterations of the app or
the early stages of the app’s development. Notably, the number comparable tools should further gamify its content, providing
of downloads was particularly influenced by the endorsement motivation and incentives to complete each module. It is also
and promotion of the app through the national leagues, with essential to consider the sociodemographic characteristics of
users in Slovenia demonstrating the highest engagement rates the target population when promoting apps to ensure they reach
across all modules. They were most likely to access all modules a more diverse and representative population. Engaging with
(190/392, 48.5%), read the modules’ contents (167/392, 42.6%), NGOs to cocreate and promote the WASABY app was
and complete the quizzes (145/392, 37%). This highlights the beneficial, but further research is required to assess the
success of the Zveza slovenskih društev za boj proti raku feasibility of embedding the app as an intervention within a
(Association of Slovenian Cancer Societies) in adopting the broader health education program. Furthermore, it is necessary
WASABY app for youth-targeted initiatives and demonstrates to evaluate the impact of knowledge acquisition of the ECAC
that with committed support from a key stakeholder for the recommendations on the intention to adopt the recommendations
promotion of the app, it is possible to achieve good uptake. in daily life.
Limitations Conclusions
There are several limitations that should be acknowledged. First, The experience gained from designing, developing, and
as this study was designed to evaluate the outcomes of the promoting the WASABY app provides a valuable case study
design, development, and dissemination of the WASABY app, on the effective dissemination of evidence-based
the evaluation framework’s scope was limited in terms of time recommendations on cancer prevention within the ECAC
and reach. As a result, certain dimensions, such as knowledge through an innovative digital health tool aimed at European
acquisition and user retention, could not be adequately evaluated adolescents. The data obtained from this study show the
due to the lack of monitoring of KPIs over a longer period (ie, potential of an mHealth app that addresses multiple risk factors,
at 6 and 12 months after completion). Additionally, the fidelity thus laying the groundwork for the creation of new tools to
of the tool implementation was impacted by the COVID-19 encourage healthy lifestyles and mitigate NCDs. The insights
pandemic. The initial plan was to pilot the tool through in-person derived from the study also hold significance for the
demonstration at existing health education outreach programs implementation of Europe’s Beating Cancer Plan, particularly
organized by cancer leagues in 6 European countries. However, the development of the “EU Mobile App for Cancer Prevention”
the app’s promotion and dissemination had to be conducted [52].
Acknowledgments
The authors would like to thank the following individuals within the cancer leagues who participated in the collaborative process
of creating the content for the WASABY app: Sebastian del Busto (Asociación Española Contra el Cáncer); Gerry McElwee
(Cancer Focus Northern Ireland); Maja Primic-Žakelj, Urška Ivanuš, and Katja Jarm (Zveza slovenskih društev za boj proti raku);
Annick de Gaulle (La Ligue contre le Cancer); Florian Suter (Krebsliga); and Adriana Melnic (Societatea Româna de Cancer).
Additionally, the authors extend their acknowledgment to the Association of European Cancer Leagues (ECL) Youth Ambassadors
for the European Code Against Cancer (ECAC), whose pivotal role in disseminating and promoting the WASABY app on social
media is highly appreciated. The development of the app was overseen by the ECL secretariat team, with technical assistance
provided by Adhere Health Inc (formerly Salumedia Tecnologías S.L.U.) and graphic design work executed by Outcrowd Studio
as subcontractors.
The project through which the WASABY mobile app was developed and this paper was submitted for publication has received
funding from the European Commission’s Pilot Projects scheme under grant agreement PP-2-5-2016 (#769767). The opinions
and findings presented in this publication are those of the authors and do not necessarily reflect the views of the European
Commission. The European Commission and its agencies are not responsible for any use that may be made of the information it
contains.
Data Availability
The WASABY app’s content is available on GitHub [53]. The data that support the findings of this study are available from the
corresponding author upon reasonable request.
Authors' Contributions
MML contributed to conceptualization, methodology, formal analysis, writing, and original draft preparation. GP was involved
in project implementation, writing, reviewing, and editing. AT performed writing, reviewing, and editing. DR contributed to
conceptualization, supervision, project administration, methodology, writing, reviewing, and editing.
Conflicts of Interest
None declared.
Multimedia Appendix 1
WASABY App testing results from a web-supported 19-item questionnaire to assess comprehension and suitability of the App’s
content.
[PDF File (Adobe PDF File), 10205 KB-Multimedia Appendix 1]
Multimedia Appendix 2
Privacy policy, legal notice, and terms of use.
[DOCX File , 40 KB-Multimedia Appendix 2]
Multimedia Appendix 3
App stores' key performance indicators.
[DOCX File , 13 KB-Multimedia Appendix 3]
References
1. Wild CP, Espina C, Bauld L, Bonanni B, Brenner H, Brown K, et al. Cancer prevention Europe. Mol Oncol
2019;13(3):528-534 [FREE Full text] [doi: 10.1002/1878-0261.12455] [Medline: 30667152]
2. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN
estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2021;71(3):209-249
[FREE Full text] [doi: 10.3322/caac.21660] [Medline: 33538338]
3. Hofmarcher T, Lindgren P, Wilking N, Jönsson B. The cost of cancer in Europe 2018. Eur J Cancer 2020;129:41-49 [FREE
Full text] [doi: 10.1016/j.ejca.2020.01.011] [Medline: 32120274]
4. Ferlay J, Laversanne M, Ervik M, Lam F, Colombet M, Mery L, et al. Global cancer observatory: cancer tomorrow. In:
The Global Cancer Observatory. Lyon, France. International Agency for Research on Cancer; 2020.
5. Schüz J, Espina C, Villain P, Herrero R, Leon ME, Minozzi S, et al. European Code Against Cancer 4th Edition: 12 ways
to reduce your cancer risk. Cancer Epidemiol 2015;39(Suppl 1):S1-S10 [FREE Full text] [doi: 10.1016/j.canep.2015.05.009]
[Medline: 26164654]
6. Janik-Koncewicz K, Ritchie D, Blicharz U, Zatoński WA. Towards systematic evaluation of the European Code Against
Cancer. dissemination of the code in Poland. J Health Inequal 2017;3(2):162-166 [doi: 10.5114/jhi.2017.74211]
7. Global action plan for the prevention and control of noncommunicable diseases 2013-2020. World Health Organization
(WHO). Geneva. World Health Organization; 2013. URL: http://apps.who.int/iris/bitstream/10665/94384/1/
9789241506236_eng.pdf [accessed 2023-11-09]
8. Mikkelsen B, Williams J, Rakovac I, Wickramasinghe K, Hennis A, Shin HR, et al. Life course approach to prevention
and control of non-communicable diseases. BMJ 2019;364:l257 [FREE Full text] [doi: 10.1136/bmj.l257] [Medline:
30692103]
9. Viner RM, Ross D, Hardy R, Kuh D, Power C, Johnson A, et al. Life course epidemiology: recognising the importance of
adolescence. J Epidemiol Community Health 2015;69(8):719-720 [FREE Full text] [doi: 10.1136/jech-2014-205300]
[Medline: 25646208]
10. Patton GC, Olsson CA, Skirbekk V, Saffery R, Wlodek ME, Azzopardi PS, et al. Adolescence and the next generation.
Nature 2018;554(7693):458-466 Nature Publishing Group [FREE Full text] [doi: 10.1038/nature25759] [Medline: 29469095]
11. Spotlight on adolescent health and well-being. Findings from the 2017/2018 Health Behaviour in School-Aged Children
(HBSC) survey in Europe and Canada. International report. Volume 1. Key findings. World Health Organization. Regional
Office for Europe.. World Health Organization. Regional Office for Europe; 2020. URL: https://apps.who.int/iris/handle/
10665/332091 [accessed 2023-09-09]
12. Leech RM, McNaughton SA, Timperio A. The clustering of diet, physical activity and sedentary behavior in children and
adolescents: a review. Int J Behav Nutr Phys Act 2014;11:4 [FREE Full text] [doi: 10.1186/1479-5868-11-4] [Medline:
24450617]
13. Meader N, King K, Moe-Byrne T, Wright K, Graham H, Petticrew M, et al. A systematic review on the clustering and
co-occurrence of multiple risk behaviours. BMC Public Health 2016;16:657 [FREE Full text] [doi:
10.1186/s12889-016-3373-6] [Medline: 27473458]
14. Freeman JL, Caldwell PHY, Scott KM. The role of trust when adolescents search for and appraise online health information.
J Pediatr 2020;221:215-223.e5 [doi: 10.1016/j.jpeds.2020.02.074] [Medline: 32446485]
15. Marttunen M, Salminen T, Utriainen J. Student evaluations of the credibility and argumentation of online sources. J Educ
Res 2021;114(3):294-305 [FREE Full text] [doi: 10.1080/00220671.2021.1929052]
16. Hesse BW, Kwasnicka D, Ahern DK. Emerging digital technologies in cancer treatment, prevention, and control. Transl
Behav Med 2021;11(11):2009-2017 [FREE Full text] [doi: 10.1093/tbm/ibab033] [Medline: 34850933]
17. Recommendations on digital interventions for health system strengthening. World Health Organization. URL: https://www.
who.int/publications/i/item/9789241550505 [accessed 2023-11-09]
18. Bamgboje-Ayodele A, Smith AB, Short CE, Fardell JE, Shaw J, Beatty L, et al. Barriers and facilitators to the availability
of efficacious self-directed digital health tools for adults living with cancer and their caregivers: a systematic literature
review and author survey study. Patient Educ Couns 2021;104(10):2480-2489 [doi: 10.1016/j.pec.2021.03.012] [Medline:
33741232]
19. Aapro M, Bossi P, Dasari A, Fallowfield L, Gascón P, Geller M, et al. Digital health for optimal supportive care in oncology:
benefits, limits, and future perspectives. Support Care Cancer 2020;28(10):4589-4612 [FREE Full text] [doi:
10.1007/s00520-020-05539-1] [Medline: 32533435]
20. Hors-Fraile S, Schneider F, Fernandez-Luque L, Luna-Perejon F, Civit A, Spachos D, et al. Tailoring motivational health
messages for smoking cessation using an mHealth recommender system integrated with an electronic health record: a study
protocol. BMC Public Health 2018;18(1):698 [FREE Full text] [doi: 10.1186/s12889-018-5612-5] [Medline: 29871595]
21. Graham AK, Neubert SW, Chang A, Liu J, Fu E, Green EA, et al. Applying user-centered design methods to understand
users' day-to-day experiences can inform a mobile intervention for binge eating and weight management. Front Digit Health
2021;3:651749 [FREE Full text] [doi: 10.3389/fdgth.2021.651749] [Medline: 34713124]
22. Chulasai P, Chinwong D, Chinwong S, Hall JJ, Vientong P. Feasibility of a smoking cessation smartphone app (Quit with
US) for young adult smokers: a single arm, pre-post study. Int J Environ Res Public Health 2021;18(17):9376 [FREE Full
text] [doi: 10.3390/ijerph18179376] [Medline: 34501966]
23. Chung LMY, Fong SSM, Law QPS. Younger adults are more likely to increase fruit and vegetable consumption and
decrease sugar intake with the application of dietary monitoring. Nutrients 2021;13(2):333 [FREE Full text] [doi:
10.3390/nu13020333] [Medline: 33498678]
24. Lin PH, Grambow S, Intille S, Gallis JA, Lazenka T, Bosworth H, et al. The association between engagement and weight
loss through personal coaching and cell phone interventions in young adults: randomized controlled trial. JMIR Mhealth
Uhealth 2018;6(10):e10471 [FREE Full text] [doi: 10.2196/10471] [Medline: 30341051]
25. Hutton A, Prichard I, Whitehead D, Thomas S, Rubin M, Sloand E, et al. mHealth interventions to reduce alcohol use in
young people: a systematic review of the literature. Compr Child Adolesc Nurs 2020;43(3):171-202 [FREE Full text] [doi:
10.1080/24694193.2019.1616008] [Medline: 31192698]
26. Heikkilä M, Lehtovirta M, Autio O, Fogelholm M, Valve R. The impact of nutrition education intervention with and without
a mobile phone application on nutrition knowledge among young endurance athletes. Nutrients 2019;11(9):2249 [FREE
Full text] [doi: 10.3390/nu11092249] [Medline: 31540535]
27. Watanabe-Ito M, Kishi E, Shimizu Y. Promoting healthy eating habits for college students through creating dietary diaries
via a smartphone app and social media interaction: online survey study. JMIR Mhealth Uhealth 2020;8(3):e17613 [FREE
Full text] [doi: 10.2196/17613] [Medline: 32229468]
28. Krzyzanowski MC, Kizakevich PN, Duren-Winfield V, Eckhoff R, Hampton J, Carr LTB, et al. Rams have heart, a mobile
app tracking activity and fruit and vegetable consumption to support the cardiovascular health of college students: development
and usability study. JMIR Mhealth Uhealth 2020;8(8):e15156 [FREE Full text] [doi: 10.2196/15156] [Medline: 32755883]
29. Brinker TJ, Heckl M, Gatzka M, Heppt MV, Rodrigues HR, Schneider S, et al. A skin cancer prevention facial-aging mobile
app for secondary schools in Brazil: appearance-focused interventional study. JMIR Mhealth Uhealth 2018;6(3):e60 [FREE
Full text] [doi: 10.2196/mhealth.9794] [Medline: 29523502]
30. Hacker E, Horsham C, Vagenas D, Jones L, Lowe J, Janda M. A mobile technology intervention with ultraviolet radiation
dosimeters and smartphone apps for skin cancer prevention in young adults: randomized controlled trial. JMIR Mhealth
Uhealth 2018;6(11):e199 [FREE Full text] [doi: 10.2196/mhealth.9854] [Medline: 30487115]
31. Badawy SM, Kuhns LM. Texting and mobile phone app interventions for improving adherence to preventive behavior in
adolescents: a systematic review. JMIR Mhealth Uhealth 2017;5(4):e50 [FREE Full text] [doi: 10.2196/mhealth.6837]
[Medline: 28428157]
32. Eppes EV, Augustyn M, Gross SM, Vernon P, Caulfield LE, Paige DM. Engagement with and acceptability of digital media
platforms for use in improving health behaviors among vulnerable families: systematic review. J Med Internet Res
2023;25:e40934 [FREE Full text] [doi: 10.2196/40934] [Medline: 36735286]
33. Ribeiro N, Moreira L, Almeida AMP, Santos-Silva F. Can smartphones promote cancer prevention behaviours in healthy
young adults? A prospective study. J Cancer Educ 2019;34(5):847-853 [doi: 10.1007/s13187-018-1382-0] [Medline:
29931456]
34. Haug S, Boumparis N, Wenger A, Schaub MP, Castro RP. Efficacy of a mobile app-based coaching program for addiction
prevention among apprentices: a cluster-randomized controlled trial. Int J Environ Res Public Health 2022;19(23):15730
[FREE Full text] [doi: 10.3390/ijerph192315730] [Medline: 36497804]
35. European Code Against Cancer. International Agency for Research on Cancer (IARC). 2015. URL: https://cancer-code-europe.
iarc.fr/index.php/en/ [accessed 2023-11-09]
36. Rosenstock IM. The health belief model and preventive health behavior. Health Educ Monogr 1974;2(4):354-386 SAGE
Publications; Sage CA: Los Angeles, CA, . [doi: 10.1177/109019817400200405]
37. Freeman C, Kittredge A, Wilson H, Pajak B. The duolingo method for app-based teaching and learning. Duolingo Research
Report. 2023. URL: https://duolingo-papers.s3.amazonaws.com/reports/duolingo-method-whitepaper.pdf [accessed
2023-11-09]
38. Carpenter SK, Pan SC, Butler AC. The science of effective learning with spacing and retrieval practice. Nat Rev Psychol
2022;1(9):496-511 [doi: 10.1038/s44159-022-00089-1]
39. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. STROBE Initiative. The Strengthening
the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational
studies. Lancet 2007;370(9596):1453-1457 [FREE Full text] [doi: 10.1016/S0140-6736(07)61602-X] [Medline: 18064739]
40. Google play store key performance indicators. Google. URL: https://play.google.com/console/about/stats/ [accessed
2022-10-01]
41. Apple store key performance indicators. Apple. URL: https://developer.apple.com/app-store-connect/analytics/ [accessed
2022-10-01]
42. Our projects: WASABY. Association of European Cancer Leagues. URL: https://www.cancer.eu/our-projects-wasaby/
[accessed 2023-09-09]
43. Islam MM, Poly TN, Walther BA, Li YCJ. Use of mobile phone app interventions to promote weight loss: meta-analysis.
JMIR Mhealth Uhealth 2020;8(7):e17039 [FREE Full text] [doi: 10.2196/17039] [Medline: 32706724]
44. Houghton LC, Howland RE, McDonald JA. Mobilizing breast cancer prevention research through smartphone apps: a
systematic review of the literature. Front Public Health 2019;7:298 [FREE Full text] [doi: 10.3389/fpubh.2019.00298]
[Medline: 31781525]
45. Silva EH, Lawler S, Langbecker D. The effectiveness of mHealth for self-management in improving pain, psychological
distress, fatigue, and sleep in cancer survivors: a systematic review. J Cancer Surviv 2019;13(1):97-107 [doi:
10.1007/s11764-018-0730-8] [Medline: 30635865]
46. Sardi L, Idri A, Fernández-Alemán JL. A systematic review of gamification in e-Health. J Biomed Inform 2017;71:31-48
[FREE Full text] [doi: 10.1016/j.jbi.2017.05.011] [Medline: 28536062]
47. Henson P, David G, Albright K, Torous J. Deriving a practical framework for the evaluation of health apps. Lancet Digit
Health 2019;1(2):e52-e54 [FREE Full text] [doi: 10.1016/S2589-7500(19)30013-5] [Medline: 33323229]
48. Champion KE, Parmenter B, McGowan C, Spring B, Wafford QE, Gardner LA, et al. Effectiveness of school-based eHealth
interventions to prevent multiple lifestyle risk behaviours among adolescents: a systematic review and meta-analysis. Lancet
Digit Health 2019;1(5):e206-e221 [FREE Full text] [doi: 10.1016/S2589-7500(19)30088-3] [Medline: 33323269]
49. Dute DJ, Bemelmans WJE, Breda J. Using mobile apps to promote a healthy lifestyle among adolescents and students: a
review of the theoretical basis and lessons learned. JMIR Mhealth Uhealth 2016;4(2):e39 [FREE Full text] [doi:
10.2196/mhealth.3559] [Medline: 27150850]
50. McDermott KT, Noake C, Wolff R, Espina C, Foucaud J, Steindorf K, et al. Digital interventions to moderate alcohol
consumption in young people: a cancer prevention Europe overview of systematic reviews. Front Digit Health 2023;5:1178407
[FREE Full text] [doi: 10.3389/fdgth.2023.1178407] [Medline: 37288171]
51. Ritchie D, Mallafré-Larrosa M, Ferro G, Schüz J, Espina C. Evaluation of the impact of the European code against cancer
on awareness and attitudes towards cancer prevention at the population and health promoters' levels. Cancer Epidemiol
2021;71(Pt A):101898 [FREE Full text] [doi: 10.1016/j.canep.2021.101898] [Medline: 33611135]
52. Europe's beating cancer plan. European Commission. Brussels; 2021. URL: https://www.europarl.europa.eu/legislative-train/
theme-promoting-our-european-way-of-life/file-europe-s-beating-cancer-plan [accessed 2023-11-09]
53. WASABY app. GitHub. URL: https://github.com/mm5951/WASABY_App [accessed 2023-11-09]
Abbreviations
ECAC: European Code Against Cancer
ECL: Association of European Cancer Leagues
EU: European Union
GDPR: General Data Protection Regulation
HBM: health belief model
KPI: key performance indicator
mHealth: mobile health
NCD: noncommunicable disease
NGO: nongovernmental organization
OR: odds ratio
STROBE: Strengthening the Reporting of Observational Studies in Epidemiology
WHO: World Health Organization
Edited by T de Azevedo Cardoso; submitted 09.04.23; peer-reviewed by N Ribeiro, M Brinzac; comments to author 16.06.23; revised
version received 09.09.23; accepted 27.10.23; published 25.11.23
Please cite as:
Mallafré-Larrosa M, Papi G, Trilla A, Ritchie D
Development and Promotion of an mHealth App for Adolescents Based on the European Code Against Cancer: Retrospective Cohort
Study
JMIR Cancer 2023;9:e48040
URL: https://cancer.jmir.org/2023/1/e48040/
doi: 10.2196/48040
PMID:
©Meritxell Mallafré-Larrosa, Ginevra Papi, Antoni Trilla, David Ritchie. Originally published in JMIR Cancer
(https://cancer.jmir.org), 25.11.2023. This is an open-access article distributed under the terms of the Creative Commons Attribution
License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any
medium, provided the original work, first published in JMIR Cancer, is properly cited. The complete bibliographic information,
a link to the original publication on https://cancer.jmir.org/, as well as this copyright and license information must be included.