Influence of Animation- Versus Text-Based Delivery of a Web-Based Computer-Tailored Smoking Cessation Intervention on User Perceptions
Keywords:digital health, eHealth, computer tailoring, smoking cessation, user experience, user engagement
Computer-tailored (CT) digital health interventions have shown to be effective in obtaining behaviour change. Yet, user perceptions of these interventions are often unsatisfactory. Traditional CT interventions rely mostly on text-based feedback messages. A way of presenting feedback messages in a more engaging manner may be the use of narrated animations instead of text. The goal of this study was to assess the effect of manipulating the mode of delivery (animation vs. text) in a smoking cessation intervention on user perceptions among smokers and non-smokers. Smokers and non-smokers (N = 181) were randomized into either the animation or text condition. Participants in the animation condition assessed the intervention as more effective (ηp2 = .035), more trustworthy (ηp2 = .048), more enjoyable (ηp2 = .022), more aesthetic (ηp2 = .233), and more engaging (ηp2 = .043) compared to participants in the text condition. Participants that received animations compared to text messages also reported to actively trust the intervention more (ηp2 = .039) and graded the intervention better (ηp2 = .056). These findings suggest that animation-based interventions are superior to text-based interventions with respect to user perceptions.
Benowitz, N. L. (2010). Nicotine addiction. New England Journal of Medicine, 362(24), 2295-2303. https://doi.org/10.1056/NEJMra0809890
Carr, N. G. (2011). The shallows: What the internet is doing to our brains (1st ed.). W.W. Norton.
Cheung, K. L., Wijnen, B., & de Vries, H. (2017). A review of the theoretical basis, effects, and cost effectiveness of online smoking cessation interventions in the Netherlands: A mixed-methods approach. Journal of Medical Internet Research, 19(6), Article: e230. https://doi.org/10.2196/jmir.7209
Cisco. (2019). Cisco visual networking index: Forecast and trends, 2017–2022. https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11-741490.html
Crutzen, R., Beekers, N., van Eenbergen, M., Becker, M., Jongen, L., & van Osch, L. (2014). E‐loyalty towards a cancer information website: Applying a theoretical framework. Psycho‐Oncology, 23(6), 685-691. https://doi.org/10.1002/pon.3471
Crutzen, R., Cyr, D., & de Vries, N. K. (2011). Bringing loyalty to e-health: Theory validation using three internet-delivered interventions. Journal of Medical Internet Research, 13(3), Article: e73. https://doi.org/10.2196/jmir.1837
Crutzen, R., Cyr, D., & de Vries, N. K. (2012). The role of user control in adherence to and knowledge gained from a website: Randomized comparison between a tunneled version and a freedom-of-choice version. Journal of Medical Internet Research, 14(2), Article: e45. https://doi.org/10.2196/jmir.1922
Crutzen, R., de Nooijer, J., Brouwer, W., Oenema, A., Brug, J., & de Vries, N. K. (2009). A conceptual framework for understanding and improving adolescents’ exposure to internet-delivered interventions. Health Promotion International, 24(3), 277-284. https://dx.doi.org/10.1093/heapro/dap018
de Vries, H. (2017). An integrated approach for understanding health behavior; the I-change model as an example. Psychology and Behavioral Science International Journal, 2(2), 555-585. https://doi.org/10.19080/PBSIJ.2017.02.555585
de Vries, H., & Brug, J. (1999). Computer-tailored interventions motivating people to adopt health promoting behaviours: Introduction to a new approach. Patient Education and Counseling, 36(2), 99-105. https://psycnet.apa.org/doi/10.1016/S0738-3991(98)00127-X
de Vries, H., Kremers, S., Smeets, T., Brug, J., & Eijmael, K. (2008). The effectiveness of tailored feedback and action plans in an intervention addressing multiple health behaviors. American Journal of Health Promotion, 22(6), 417-424. https://doi.org/10.4278/ajhp.22.6.417
Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B., & Glozier, N. (2011). A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of Medical Internet Research, 13(3), Article: e52. https://doi.org/10.2196/jmir.1772
Eysenbach, G. (2005). The law of attrition. Journal of Medical Internet Research, 7(1), Article: e11. https://doi.org/10.2196/jmir.7.1.e11
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175-191. https://doi.org/10.3758/BF03193146
Hughes, J. R., Keely, J., & Naud, S. (2004). Shape of the relapse curve and long‐term abstinence among untreated smokers. Addiction, 99(1), 29-38. https://doi.org/10.1111/j.1360-0443.2004.00540.x
Kalogeropoulos, A., Cherubini, F., & Newman, N. (2016). The future of online news video. Reuters Institute for the Study of Journalism. https://ora.ox.ac.uk/objects/uuid:b712713d-5429-4a91-862b-badb41803338
Kanera, I. M., Willems, R. A., Bolman, C. A., Mesters, I., Zambon, V., Gijsen, B. C., & Lechner, L. (2016). Use and appreciation of a tailored self-management eHealth intervention for early cancer survivors: Process evaluation of a randomized controlled trial. Journal of Medical Internet Research, 18(8), Article: e229. https://doi.org/10.2196/jmir.5975
Krebs, P., Prochaska, J. O., & Rossi, J. S. (2010). A meta-analysis of computer-tailored interventions for health behavior change. Preventive Medicine, 51(3), 214-221. https://doi.org/10.1016/j.ypmed.2010.06.004
Liu, Z. (2005). Reading behavior in the digital environment: Changes in reading behavior over the past ten years. Journal of Documentation, 61(6), 700-712. https://doi.org/10.1108/00220410510632040
Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press.
Mayer, R. E. (2018). Thirty years of research on online learning. Applied Cognitive Psychology, 33, 152-159. https://doi.org/10.1002/acp.3482
Meppelink, C. S., van Weert, J. C. M., Haven, C. J., & Smit, E. G. (2015). The effectiveness of health animations in audiences with different health literacy levels: An experimental study. Journal of Medical Internet Research, 17(1), Article: e11. https://doi.org/10.2196/jmir.3979
Ministerie van Binnenlandse Zaken en Koninkrijksrelaties. (2018). Tabaks- en rookwarenwet. https://wetten.overheid.nl/BWBR0004302/2018-11-17
Nationaal Expertisecentrum Tabaksontmoediging. (2018). Kerncijfers roken 2017. Trimbos-instituut. https://assets.trimbos.nl/docs/cdade14e-20dc-462a-9f63-1b71ee995a84.pdf
Nunn, A., Crutzen, R., Haag, D., Chabot, C., Carson, A., Ogilvie, G., Shoveller, J., & Gilbert, M. (2017). Examining e-loyalty in a sexual health website: Cross-sectional study. JMIR Public Health and Surveillance, 3(4), Article: e75. https://doi.org/10.2196/publichealth.5393
Perski, O. (2017). Study protocol: Development and psychometric evaluation of a self-report instrument to measure engagement with digital behaviour change interventions. Open Science Framework. https://osf.io/cj9y7
Perski, O., Blandford, A., Garnett, C., Crane, D., West, R., & Michie, S. (2019). A self-report measure of engagement with digital behavior change interventions (DBCIs): Development and psychometric evaluation of the “DBCI engagement scale”. Translational Behavioral Medicine, 10(1), 267-277. https://doi.org/10.1093/tbm/ibz039
Perski, O., Blandford, A., West, R., & Michie, S. (2017). Conceptualising engagement with digital behaviour change interventions: A systematic review using principles from critical interpretive synthesis. Translational Behavioral Medicine, 7(2), 254-267. https://doi.org/10.1007/s13142-016-0453-1
Petty, R. E., & Cacioppo, J. T. (1986). The elaboration likelihood model of persuasion. In Communication and Persuasion (pp. 1-24). Springer. https://doi.org/10.1007/978-1-4612-4964-1_1
Prochaska, J. O., & DiClemente, C. C. (1983). Stages and processes of self-change of smoking: Toward an integrative model of change. Journal of Consulting and Clinical Psychology, 51(3), 390. https://doi.org/10.1037/0022-006X.51.3.390
Prochaska, J. O., & Velicer, W. F. (1997). The transtheoretical model of health behavior change. American Journal of Health Promotion, 12(1), 38-48. https://doi.org/10.4278/0890-1171-12.1.38
Rijksinstituut voor Volksgezondheid en Milieu. (2018). Roken - cijfers & context - gevolgen. RIVM. https://www.volksgezondheidenzorg.info/onderwerp/roken/cijfers-context/gevolgen#node-sterfte-door-roken
Ruiter, R. A. C., Kessels, L. T. E., Jansma, B. M., & Brug, J. (2006). Increased attention for computer-tailored health communications: An event-related potential study. Health Psychology, 25(3), 300-306. https://doi.org/10.1037/0278-6126.96.36.1990
Ryota, K., & Kep Kee, L. (2016). How has the internet reshaped human cognition? Neuroscientist, 22(5), 506-520. https://doi.org/10.1177/1073858415595005
Short, C. E., DeSmet, A., Woods, C., Williams, S. L., Maher, C., Middelweerd, A., Müller, A. M., Wark, P. A., Vandelanotte, C., Poppe, L., Hingle, M. D., & Crutzen, R. (2018). Measuring engagement in eHealth and mHealth behavior change interventions: Viewpoint of methodologies. Journal of Medical Internet Research, 20(11), Article: e292. https://doi.org/10.2196/jmir.9397
Short, C. E., Rebar, A. L., Plotnikoff, R. C., & Vandelanotte, C. (2015). Designing engaging online behaviour change interventions: A proposed model of user engagement. The European Health Psychologist, 17(1), 32-38. https://www.ehps.net/ehp/index.php/contents/article/view/763
Smit, E. S., Linn, A. J., & van Weert, J. C. M. (2015). Taking online computer-tailoring forward: The potential of tailoring the message frame and delivery mode of online health behaviour change interventions. The European Health Psychologist, 17(1), 25-31. https://www.ehps.net/ehp/index.php/contents/article/view/762
Soetens, K. C., Vandelanotte, C., de Vries, H., & Mummery, K. W. (2014). Using online computer tailoring to promote physical activity: A randomized trial of text, video, and combined intervention delivery modes. Journal of Health Communication, 19(12), 1377-1392. https://doi.org/10.1080/10810730.2014.894597
Stanczyk, N. E., Bolman, C., Muris, J. W., & de Vries, H. (2011). Study protocol of a Dutch smoking cessation e-health program. BMC Public Health, 11(1), Article: 847. https://doi.org/10.1186/1471-2458-11-847
Stanczyk, N. E., Bolman, C., van Adrichem, M., Candel, M., Muris, J., & de Vries, H. (2014). Comparison of text and video computer-tailored interventions for smoking cessation: Randomized controlled trial. Journal of medical Internet research, 16(3), Article: e69. https://doi.org/10.2196/jmir.3016
Stanczyk, N. E., Crutzen, R., Bolman, C., Muris, J., & de Vries, H. (2013). Influence of delivery strategy on message-processing mechanisms and future adherence to a Dutch computer-tailored smoking cessation intervention. Journal of Medical Internet Research, 15(2). https://doi.org/10.2196/jmir.2153
Stanczyk, N. E., de Vries, H., Candel, M. J., Muris, J. W., & Bolman, C. A. (2016). Effectiveness of video- versus text-based computer-tailored smoking cessation interventions among smokers after one year. Preventive Medicine, 82, 42-50. https://doi.org/10.1016/j.ypmed.2015.11.002
Stanczyk, N. E., Smit, E. S., Schulz, D. N., de Vries, H., Bolman, C., Muris, J. W., & Evers, S. M. (2014). An economic evaluation of a video-and text-based computer-tailored intervention for smoking cessation: A cost-effectiveness and cost-utility analysis of a randomized controlled trial. PloS one, 9(10), Article: e110117. https://doi.org/10.1371/journal.pone.0110117
Steiger, J. H. (2004). Beyond the F test: Effect size confidence intervals and tests of close fit in the analysis of variance and contrast analysis. Psychological Methods, 9(2), 164-186. https://doi.org/10.1037/1082-989X.9.2.164
van der Heide, I., Wang, J., Droomers, M., Spreeuwenberg, P., Rademakers, J., & Uiters, E. (2013). The relationship between health, education, and health literacy: Results from the Dutch adult literacy and life skills survey. Journal of Health Communication, 18(sup1), 172-184. https://doi.org/10.1080/10810730.2013.825668
van der Mispel, C., Poppe, L., Crombez, G., Verloigne, M., & De Bourdeaudhuij, I. (2017). A self-regulation-based eHealth intervention to promote a healthy lifestyle: Investigating user and website characteristics related to attrition. Journal of Medical Internet Research, 19(7), Article: e241. https://doi.org/10.2196/jmir.7277
van het Schip, C., Cheung, K. L., Vluggen, S., Hoving, C., Schaper, N. C., & de Vries, H. (2020). Spoken animated self-management video messages aimed at improving physical activity in people with Type 2 diabetes: Development and interview study. Journal of Medical Internet Research, 22(4), Article: e15397. https://doi.org/10.2196/15397
Vandelanotte, C., & Mummery, W. K. (2011). Qualitative and quantitative research into the development and feasibility of a video-tailored physical activity intervention. International Journal of Behavioral Nutrition and Physical Activity, 8(1), 1-11. https://doi.org/10.1186/1479-5868-8-70
Walthouwer, M. J. L., Oenema, A., Lechner, L., & de Vries, H. (2015). Comparing a video and text version of a web-based computer-tailored intervention for obesity prevention: A randomized controlled trial. Journal of Medical Internet Research, 17(10), Article: e236. https://doi.org/10.2196/jmir.4083
World Health Organization. (2018). Classification of digital health interventions v1.0: A shared language to describe the uses of digital technology for health. World Health Organization. https://www.who.int/reproductivehealth/publications/mhealth/classification-digital-health-interventions/en/
How to Cite
Copyright (c) 2021 Jan Mathis Elling, Hein de Vries
This work is licensed under a Creative Commons Attribution 4.0 International License.
The authors agree to the following license and copyright agreement:
a. Authors retain copyright in their work.
b. Authors grant the European Journal of Health Communication the right of first publication online on the internet (on the publication platform HOPE of the Main Library of the University of Zurich).
c. The electronic contributions on the internet are distributed under the „Creative Commons Attribution 4.0 International“- License (CC BY 4.0). This license allows others to copy and redistribute the work in any medium or format, to remix, transform and build upon the material with an acknowledgement of the work's authorship and initial publication in the European Journal of Health Communication . These conditions are irrevocable. The full text of the license may be read under http://creativecommons.org/licenses/by/4.0/.
d. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of their work, as long as the conditions of the CC BY 4.0 License are fulfilled and initial publication in the European Journal of Health Communication is acknowledged.
e. Authors grant the Editors commercial rights, using a publishing house, to produce hardcopy volumes of the journal for sale to libraries and individuals, as well as to integrate the manuscript, its title, and its abstract in databases, abstracting and indexing services, and other similar information services.
f. This agreement is subject to possible legal disclosure obligations.
g. This agreement is governed by Swiss law. Court of jurisdiction is Zürich.