- Research article
- Open access
- Published:
MANTRA: development and localization of a mobile educational health game targeting low literacy players in low and middle income countries
BMC Public Health volume 20, Article number: 1171 (2020)
Abstract
Background
Mobile technology is increasingly important for delivering public health interventions to remote populations. This research study developed, piloted, and assessed a serious game for mobile devices that teaches geohazard, maternal, and neonatal health messages. This unique mHealth intervention aimed at low-literacy audiences in low resource settings is part of the Maternal and Neonatal Technologies in Rural Areas (MANTRA) project: Increasing maternal and child health resilience before, during, and after disasters using mobile technology in Nepal.
Methods
The serious game was developed through a co-creation process between London and Kathmandu based researchers by email and video-calling, and face-to-face with local stakeholders in Nepal. The process identified core needs, developed appropriate pictograms and mechanics, and tailored the pilot serious game to the local cultural context. Evaluations and feedback from end users took place in rural villages and suburban Kathmandu in Province Three. Field evaluation sessions used mixed methods. Researchers observed game play and held focus group discussions to elicit qualitative feedback and understand engagement, motivation, and usability, and conducted a paired pre- and post-game knowledge assessment.
Results
The MANTRA serious game is contextualized to rural Nepal. The game teaches 28 learning objectives in three modules: maternal health, neonatal health, and geohazards, through picture matching with immediate audio and visual feedback. User feedback from focus groups demonstrated high engagement, motivation, and usability of the game.
Conclusions
This MANTRA study is a unique mHealth intervention of a serious game to teach core health and geohazards messages to low-literacy audiences in rural Nepal. Although the mobile game is tailored for this specific context, the developmental process and insights could be transferable to the development of other games-based interventions and contextualized for any part of the world. Successfully targeting this low-literacy and illiterate audience makes the MANTRA development process the first of its kind and a novel research endeavor with potential for widespread impact and adoption following further game development.
Trial registration
This project was approved by the University College London Ethics Committee in London, United Kingdom [10547/001], and the Nepal Health Research Council in Kathmandu, Nepal [Reg. No. 105/2017]. All participants provided informed written consent.
Background
The 2015 Nepal earthquake isolated communities and reduced access to medical advice and healthcare services, including vital support for vulnerable populations like pregnant and perinatal women and their newborns [1, 2]. mHealth, defined as the use of mobile and wireless technologies for health [3], can help overcome obstacles to public health initiatives in times of disaster and crisis as well as day-to-day exposure to hazards, remote populations, rough terrain, and limited distribution channels [4, 5].
The project in Nepal entitled “Maternal and Neonatal Technologies in Rural Areas (MANTRA): Increasing maternal and child health resilience before during and after disasters using mobile technology” investigated building women’s resilience by improving access to information and communications before, during, and after environmental disasters by developing an mHealth intervention to support and expand existing participatory learning public health interventions, social protection mechanisms, and awareness of everyday geohazards [6,7,8,9,10,11,12].
mHealth is rapidly expanding in health education, including low and middle income countries (LMICs) [13]. These interventions are economically attractive options due to scalability and ease of modifying or adding content compared to traditional and face to face methods for distributing health campaigns and messages to the public in low income settings [14, 15]. Serious games, aimed at conveying educational knowledge rather than mere entertainment [16], are a type of intervention within mHealth.
The authors did not find any publication on a serious game targeted to a low-literacy adult audience in LMICs and covering maternal health, neonatal health, and geohazards topics. Two of the largest serious game interventions aimed at low-literacy audiences, although in a high income setting, are the eBug and edugames4all projects, which are for children [17,18,19]. Lessons for developing serious games according to the needs of low-literacy users could be transferred from research aimed at other illiterate audiences, such as toddlers and young children. One example is a game consisting solely of images, animation, and audio, called “Listening with Lemur”, which is for children aged one and a half to 3 years with recent cochlear implants [20]. Such a game is text-free and image based, with simple game mechanics and structure, and designed for a specific user group. This makes the game ideal for young children and illiterate users unfamiliar with smartphones. These related projects highlight the importance of co-creation, iterative development, and focus groups with the target audience, to gain qualitative feedback to ensure that games match audience capabilities.
More research and evidence is needed to fully explore the challenges of implementing a serious game for health in a low resource setting. Kostkova succinctly presents the challenges facing the digital health sector and the huge potential to impact the health sector, especially in LMICs [13]. Serious games for health are no exception to these challenges or potential, and research into the needs, challenges, and existing health systems in a region or nation is required to ensure the technology is useful and accepted by patients, communities, health workers, and healthcare systems [13, 21].
The MANTRA project study area is rural Nepal. Nepal is a suitable study area for piloting an mHealth intervention because of rising access to mobile phones [22, 23], risks inherent to a dispersed population in a geologically active region [6, 24], and vulnerabilities at national, community and individual scales [25]. Communication links have been strengthened as the number of mobile phone subscriptions in Nepal reached 110 subscriptions per 100 people in 2016 [23], growing from about 9 million subscriptions in 2010 to over 32 million in 2016 [22]. Nepal’s Demographic and Health Survey 2016 reports that mobile phone ownership is highest among the 20–24 age group for both women and men, at 85 and 96% respectively [25]. Rising access to mobile phones supports the use of mobile health tools to reach a population.
In Nepal, primary healthcare is largely delivered by rural health workers at local health facilities, with outreach conducted by Female Community Health Volunteers (FCHVs) to provide healthcare education their local area (often c.1000 population) [26]. In a disaster situation like the 25 April, 2015 earthquake, broken transportation links isolated communities from healthcare and medical advice [2, 27]. Kavrepalanchok district was one of 14 districts highly affected by the 2015 and accessible for research, so study locations were selected from this district, now within Province 3 [2, 27].
The Nepal context shares many similarities and barriers to other LMICs, like a large rural population, a large illiterate adult population, and rising mobile phone ownership [22, 24, 28]. Many of the lessons learned through the MANTRA development process could be transferable to other LMIC settings.
From this research context, we developed a serious game. Our objective in presenting the development process for the MANTRA serious game is to offer insight and a pathway for future research and implementation of similar mHealth interventions targeting a low-literacy audience. We incorporate best practice for serious games in low-resource settings by working towards low cost, geographical scalability, easy localization to new countries and cultural settings, and engagement to deliver important public health messages [3, 4, 13, 29,30,31]. By contributing to the growing body of research for mHealth interventions, this research aims to share a novel, transferable process to build a game for low-literacy populations. The value of presenting this research is in sharing a transferable process for developing mHealth interventions and localizing an exciting mHealth product specifically to a low literacy audience, challenging the usual settings and methods for engaging this hard-to-reach target audience.
Methods
To present this novel serious game aimed at low-literacy audiences about maternal health, neonatal health, and geohazards, the remainder of the article is structured into four parts. Methods details the process of designing and contextualizing the MANTRA serious game. Results presents the MANTRA serious game. Discussion reflects on lessons learned by the research team and the successes, practicalities, and opportunities to improve the process for subsequent iterations of the MANTRA game and other studies. The Conclusions section suggests value of this process and the transferability of insights and the localization and contextualization process.
Co-creation and co-design were guiding principles throughout the design process. Co-creation is “collective creativity” and co-design specifies that this principle “is applied across the whole span of a design process” [32], bringing decision-making, power, and stake in the end product [33]. Additional considerations were setting priorities based on user needs, input from domain experts, iterative co-design for localization and contextualization, and controlled environment testing [30, 34, 35]. The game design methodology builds on these guiding principles and typical software development processes [34, 36, 37]. Co-creation discussions throughout the project were conducted through video calling and collaborative online workspaces. The method is divided into four stages, illustrated as four colored boxes in Fig. 1.
Process workflow
Explore
The grey ‘Exploration’ box begins the methodology with research into the needs and context of the users and wider setting. Other components of the MANTRA research program were helpful to understand the target audience experience related to maternal and neonatal health, the 2015 earthquake, and mobile technologies.
Initial research for the game, context, and user needs included previous work in Nepal by coauthors and Health Research and Social Development Forum (HERD) and research on mobile phone use and telecommunication infrastructure. Most importantly, a field trip in March 2017 organized by HERD assessed local conditions, studied site needs, and preliminary technical constraints to inform the serious game design, context, and artwork. To supplement these game-focused explorations, a few questions on mobile phone interest and use were included in focus group discussions for 5 groups and about 60 qualitative interviews to provide context from the target audience and potential end users of the serious game. However, these qualitative studies were primarily about experience of maternal and perinatal health in earthquake disasters with health workers, women, and support people (in preparation). Discussions among the research team built an understanding of end user needs and cultural context, based in research expertise and experience living in Nepal. This foundation informed the serious game design and artwork.
Content
The orange ‘Content’ box builds on the exploration step with domain experts defining learning objectives and working with game designers to choose game mechanics suited to presenting learning objectives to users. Learning objectives are specific pieces of information or concepts within the topic, or module, that support broad project goals [18, 38,39,40]. Game mechanics are the rules, procedures, and essential interactions that create a meaningful game [38, 41], and game structure encompasses the construction of questions, feedback, and progression mechanisms in the game.
Game mechanics were informed by the exploration stage insight that many end users in the target audience were unlikely to be familiar with smartphones. User needs of the target audience drove the selection and design of the game mechanics, so the MANTRA serious game has a simple structure and intuitive game mechanics. Ultimately, we selected a ‘drag and drop’ multiple-choice format with immediate feedback and accumulating leaves and flowers as progress mechanisms from a range of options including binary questions (yes/no), story-based, and facts by rote learning, etc. We developed both a touchscreen tutorial and a training level to accompany the game, since a training level for complex games (such as storytelling mechanics or problem based learning) can help players with little familiarity of digital games or lower reading skills [36, 42, 43]. The game has three levels of increasing complexity to allow players to repeatedly see and interpret the learning objectives, since learning is reinforced by repeatedly seeing the content and receiving immediate feedback on correct or incorrect answers [18, 44].
The learning objectives are represented by small pictograms to be accessible to the low-literacy target audience. The MANTRA learning objectives were co-designed by HERD and domain experts, incorporating research from the exploration stage [7, 45,46,47]. These learning objectives were built upon picture cards developed by Mother and Infant Research Activities (MIRA) and University College London for previous participatory learning and action women’s group trials on neonatal mortality in Nepal [11, 48, 49]. They also drew upon neonatal sepsis management guidelines for FCHVs as tested in the Nepal plains [11, 50, 51]. Then, the co-authors (NS, GH) and artist (DS) distilled key features of each learning objective for pictogram development.
Artwork
The yellow ‘Artwork’ box highlights the first cyclic iterative process of the artist, domain experts, and in country partners creating abstract images, or pictograms, to convey learning objectives to the target audience, with informal input from in country colleagues on the suitability of artwork styles, logic, and symbols. These initial pictograms were placed in the game and tested within the research team to build an initial version of the game to evaluate with end users. In country partner HERD was invaluable in localization and contextualization of the game and artwork to the specific culture and setting of Kavrepalanchok district, now part of Province Three, in Nepal. Artwork was redesigned after the field evaluations to incorporate feedback and suggestions from the user evaluations.
Nepal-based co-authors advised suitable graphics and sounds to convey good and positive feedback or bad and negative feedback, clothing for women and infants, clues for scale in geohazard pictograms, and to convey danger. The co-creation process for localization and contextualization was realized through frequent dialogue via emails and video calling between the UK based researchers building the artwork and game mechanics and the Nepal based researchers advising from their personal and professional experience living in Nepal.
Field evaluations
The next step is field testing with end users in the target audience. The green ‘Field Evaluations’ box contains steps with end users to evaluate the game for design, user experience, and knowledge gain through observations and feedback. Then, the second cycle illustrated in Fig. 1 continues, returning to the content and artwork cycle to include community end user input in the next version of the game.
We completed two iterations of this cycle, with two mixed methods field evaluations with end users in ten sessions. Sessions consisted of game play observations, focus group discussions about the game experience, and a paired pre- and post- game knowledge assessment. Subjects were recruited using the chain-referral method [52]. HERD researchers asked contacts in the villages to request FCHVs and other community members to participate in the study. Most sessions consisted of female participants although one session consisted of men in the community to test their attitude and acceptance of the game. The first evaluation cycle in October 2017 consisted of 6 sessions, and the second cycle in November 2017 had 4 sessions, averaging 7.1 participants in a session. Participant characteristics are briefly presented in section 3.3.1, discussed in greater detail in Mueller et al. (in preparation) [53], and focus group methodology in Kayastha [54]. In each session, researchers used two methods to evaluate the user experience. The first was observation during game sessions supported by video recordings of participants playing the game. The second method was focus group discussions to bring the target audience into the co-creation process, gain feedback on the game, and understand the user experience, such as likes and dislikes about the game and artwork, clarify confusing messages, and gather suggestions for future versions of the serious game (topic guide in Table 1). Focus group discussions were facilitated by HERD researchers, audio recorded in Nepali, transcribed and translated to English for the game designers to read and incorporate end user feedback into the game design. A paired pre- and post-game knowledge assessment was also part of these sessions to measure knowledge gain from playing the game by McNemar analyses and paired T-tests (52, in preparation).
Iterations
We successfully completed two iterations of field evaluations, essential steps to evaluate the pilot version of the serious game. Our longer-term plan is for iterations of content, artwork, and field evaluations to continue and test future versions of the game product with a wider user base, and eventually liaise with appropriate authorities for approval and distribution. This future work is detailed in the Discussion section.
Ethics approval and consent to participate
The MANTRA project research studies were approved by the University College London Ethics Committee in London, United Kingdom [10,547/001] and the Nepal Health Research Council in Kathmandu, Nepal [Reg. No. 105/2017]. HERD co-authors and researchers explained the research to participants and all focus group and interview participants provided informed written consent. The funding body played no role beyond the funding call in the design of the study, data collection, analysis, data interpretation, or writing the manuscript.
Technical aspects
Each digital intervention has to take into account technical constraints in the setting. We considered available telecommunications publications and data, in country colleagues and partners, and available devices, local mobile phone infrastructure, availability and reliability of data networks as well as availability of electricity infrastructure for charging devices.
The MANTRA game intervention was built in Unity game framework [55] for Android, iOS, and Windows mobile devices. For field testing, the game was installed on six Samsung Galaxy 7 smartphones to minimize the chance of variation and unforeseen problems. Since mobile data networks are limited in rural areas of Nepal and users may not be able to afford to pay for data to play online, an internet connection is not required to play the game [25, 56]. Later, when internet was available, game data was uploaded to a MongoDB back end database running on a Heroku server [57, 58].
Results
Game mechanics
Modules were chosen based on the project goals and to assemble learning objectives into thematic groups for focused teaching of maternal health, neonatal health, and geohazards. In the game intervention, players select which module they wish to complete from the home screen as shown in Fig. 2.
Touchscreen tutorial
A touch screen tutorial was developed and included in the start of user sessions to help players unfamiliar with smartphones to understand a touch screen interface. For simplicity, the‘drag and drop’ mechanism is the only action needed in the game. Figure 3 is a screenshot of the hint that appears in the MANTRA tutorial if the user has not moved the baby cutout into the photograph after a short time. An animated hand moves the baby outline across the screen into the gap in the photograph. Then, the player has another opportunity to try the ‘drag and drop’ interaction.
Training level
Following the touchscreen tutorial, a training video of animated example questions demonstrated expected user interactions, the concept that each learning objective tile (square) is associated with a response tile (circle), and to drag their chosen response tile across the screen. Like in the tutorial, an animated hand drags a learning objective tile across the screen to a response tile as pictured in Fig. 4. Initially, the training level of the MANTRA intervention was outside the game. In the November evaluation sessions, the training level was integrated into the game intervention to automatically appear after the touchscreen tutorial in a new user session to make the flow easier for a new user.
Increasing complexity, repetition, and error pool
Each module contains three levels of complexity (Fig. 5), allowing players to repeatedly see and interpret the learning objectives. Questions are formed by selecting a learning objective with its paired urgency pictogram, which will be the correct answer, then randomly selecting one to three other learning objectives of the opposite urgency or risk for the incorrect answer(s) depending on the level. Once a question was successfully answered, the learning objective was not selected to be a correct answer again in that level (but is shown again in higher levels). If a question was answered incorrectly, the correct learning objective was added to an error pool and shown up to three times throughout the level. The player continues the level until all learning objectives are seen and either a single learning objective is answered incorrectly three times and the player ‘fails’ the level, or the error pool contains only two learning objectives and the player ‘passes’ the level, progressing to the next level.
Game feedback and progression
Immediate feedback to each question is given to reinforce learning, a standard method in games to improve learning outcomes. If the user correctly matches the learning objective and response, the feedback is a green checkmark and fireworks accompanied by an audio clip of birdsong, while an incorrect match results in a black X accompanied by an audio clip of thunder.
Two scores show progression through the game. Within a level, each correct answer adds a leaf to a flower stem as a score as seen on the right side of the screenshots in Fig. 5. When the player has accumulated enough leaves, the level is successfully completed and a large flower appears with fireworks and birdsong. These flowers accumulate during a single user session, and appear at the top right of the screen as in Fig. 5.
Learning objectives and artwork
To reach a low-literacy population, the learning objectives were presented as small pictograms illustrating landscape scenes or medical conditions that were suitable for display on a smartphone screen. The co-designed pictograms used in the November field evaluation sessions are illustrated in Fig. 6.
Artwork
Tailoring the artwork to the local culture was successful since focus group participants said the pictured women and infants reflect themselves and their community, the colors are beautiful, and they like the positive progress and feedback notifications.
Localization, contextualization and cultural appropriateness
The MANTRA serious game has numerous examples of localization and contextualization. For instance, women in the artwork were depicted wearing pink, since married Nepali women wear pink and red, and infants wear a hat for warmth. Roaming dogs are a common sight in Nepal, so they were incorporated as a clue for scale in geohazard pictograms. The birdsong and thunder audio clips and progress flowers were selected since the study areas were primarily rural villages and our HERD colleagues recommended that these would be understood as ‘positive’ and ‘negative’ in Nepali culture. In focus group discussions, participants mentioned a red, yellow, and green system to note progressive danger that they observed in a tape measuring tool to measure childrens’ arms to indicate malnutrition, which we incorporated into the game color schemes to represent danger and risk.
Evaluation and the user experience
Participant characteristics
Thirty-six of 71 participants reported owning smartphones. The 71 participants across four locations had education ranging from informal to a bachelor’s degree and an average age of 40 years.
Observations of game play
During the MANTRA pilot study, researchers observed many players talking and joking with each other during game sessions despite facilitators asking participants to avoid discussion while playing the game and to do their best without assistance. People preferred to interact with others while playing. Another insight into the game logic was that a question could be answered twice, as several players discovered they could quickly replay a question during the immediate negative feedback to answer correctly and receive positive feedback of fireworks and birdsong. Observations also indicated that the ‘drag and drop’ touch screen tutorial may need expansion, since several participants struggled with the interaction until they were assisted by a facilitator or fellow participant.
Focus group discussions
Study participants suggested supplementing tutorial and teaching levels with audio to provide verbal instructions about game play and to communicate information that may not be easily conveyed through artwork. Animation of learning objectives such as convulsions would better communicate important clues of a condition. Another common suggestion was a group game format or pairing players to encourage discussion among the community, transfer knowledge between generations, and assist with smartphone and touchscreen interfaces. Suggestions were documented for continued future development of the MANTRA serious game.
FCHVs revealed the serious game aided them in recalling prior knowledge and training on maternal and newborn health issues. The FCHV participants also said that the intervention strengthened their confidence in approaching communities, and supported their dedication to existing health programs [54, 60, 61].
The MANTRA game was well received by participants and stakeholders while recognizing that the game is still in the development stages. Participants said they enjoyed the game experience, felt motivated to continue playing or play again, learned from the game, and would like to share the game within the community.
Discussion
In the broader picture of mHealth and public health, the exploratory study from MANTRA is an example of designing and implementing a serious game intervention as a method to educate and empower groups and communities. Insights from technical implementation and field evaluations of the iterative process may help adapt the design process for application to future educational game interventions.
Strengths and transferability
MANTRA is the first study of its kind, developing a serious game through co-creation with a hard-to-reach low-literacy audience that was successfully evaluated with user feedback and knowledge gain from the game. This unique achievement was enabled by several principles and team strengths.
This unique study demonstrates the opportunities of truly multidisciplinary research efforts driven not by academic pursuit alone, but by the local need in the target area and target audience in an underprivileged country. Varied expertise brings together geoscience, computer science, disaster risk reduction, gender analysis, and maternal and child health to work on a common problem for social good. The serious game resulting from the development method benefits from this range of expertise, experience, and involvement of end users through co-creation with experts and the target audience.
The presented game development method is generic and therefore transferable to other digital interventions for low-literacy audiences. Pictogram sets can be switched out for newly designed pictograms that are contextualized and localized to other study areas, countries, or topics. Some participant suggestions looked beyond the purpose of a serious game, but are interesting in identifying wants and needs, such as adding functionalities like communications or call functions to provide support, advice, and information about existing health programs. These suggestions also highlight the potential for the serious game to expand into other functions to further support risk and health-seeking behaviors among low-literacy audiences and complement existing health programs.
Limitations and challenges
Our pilot study of the MANTRA intervention has limitations and faced several challenges. Due to the exploratory nature of the pilot study and short time frame, participant selection targeted a specific audience and limited the geographic area of the study, therefore our sample is unlikely to be representative of the diverse population of Nepal. A further limitation is the possibility of a negative impact on women due to misunderstanding of the messages in the game, which could result in users internalizing the wrong information from the intervention. While researchers attempted to correct misunderstandings, in an educational environment, misunderstandings leading to unintentional decisions and negative consequences are not fully in the control of researchers.
The research team varied throughout the conception and 9 month duration of the project, ranging from six researchers and expanding to over 10 team members. As the MANTRA research team was dispersed and distant from the study area, it was not feasible to include end users in more than 2 cycles of formal feedback due to time and resource constraints. In light of these constraints for researchers as well as end users, the principle of co-design guides our actions and designs choices, but we understand it is not practical to co-create and co-design every decision needed to create a game. In the short time frame and with the limited resources available, we were not able to enlist a game developer in Nepal to assist with on the ground localization, contextualization, and field testing. If this had been possible, iterations of the design process could be rapidly completed, and the local cultural knowledge of the developer(s) would make the game easier for participants to understand, especially the geohazard content which was very new to participants.
Another consideration was designing a game that would be accessible to an already vulnerable target audience of low-literacy women. Clear visual communication and intuitive game interactions were high priorities to reach this already vulnerable sector, which constrained communication of learning objectives, progress tracking, and immediate feedback.
Field testing facilities were open community spaces, which posed difficulties for implementing a single user study with rigorous test conditions since participants chatted while playing. This challenging testing environment is well known among in-situ and semi-structured qualitative studies [61, 62]. Although rigorous user testing was not practical, in-situ testing provided valuable insights of how the intervention would actually be used in a facilitated educational group or as a stand-alone game to play at home. Far from being a challenge or limitation, the tendency to play together could remove barriers, such as lack of familiarity with a smartphone, and stimulate discussion about healthcare and geohazards, which could help to spread the educational messages of the intervention.
Although many problems were not apparent in the short duration of field evaluation sessions in the MANTRA pilot study, evidence from other studies demonstrates issues of implementing digital interventions. Problems with technology include the expense of devices and risk of theft, privacy concerns, capability to alter or delete software and data, and access to electricity, mobile networks, and internet. Problems with social dynamics include restrictions upon mobile phone use that may be imposed upon women and mobile phones being taken away or modified by family members [61, 63, 64]. These issues may create difficulties for end users themselves, within their household, and for implementation of interventions.
Scale up
Scaling up a pilot intervention for public distribution could take several paths. A larger study with a greater number of participants could better represent diverse populations by randomly selecting participants from various regions in the study area. Involving a Nepalese game developer could accelerate the process of adjusting the game to the local audience by undertaking continued testing and development of the game to make it as contextualized as possible, and reduce time consuming communication between researchers in different time zones. Another pathway for scaling up is providing FCHVs with tablets to take to community workshops where the educational game intervention would be a facilitated group activity. An additional possibility is designing the game to be used in the home without a facilitator.
Several distribution issues are anticipated. One obstacle is incomplete coverage of mobile networks to download the game and update it regularly. Rather than requiring a formal distribution point and internet connection, the file could be shared from smartphone to smartphone via Bluetooth or a wired connection, although this approach has logistical challenges. Mobile coverage is growing, and projections suggest that soon most of the country could be covered by a mobile network [22, 56]. Another obstacle is interoperability between available hardware devices for large scale distribution.
Importantly, formal involvement of government stakeholders would integrate digital interventions into existing government public health programs. A consultative MANTRA workshop with government and non-governmental organization (NGO) stakeholders provided an opportunity to present the research team’s preliminary findings and gather feedback. Stakeholders recognized the value of the MANTRA serious game to engage and educate the public on vital health issues, and interest in further research was widespread. However, the stakeholders recognized that the game is ‘still a work in progress’ which would need more development to be understandable to all Nepalese users before being ready for public distribution.
Game play in practice
Researchers were able to reach a target audience in a controlled environment in the community with smartphones brought by the study facilitators. This study in a controlled environment leaves some questions about reaching a target audience in everyday life [62]. Firstly, engagement remains a challenge. Even though participants enjoyed playing the games in facilitated sessions among their peers, would they continue playing at home for educational reasons when busy with their households? [61, 62]. Secondly, home use of the game intervention might increase women’s agency if they are able to cite the game as a source of reliable information and use this to negotiate healthcare access in traditional Nepali patriarchal households, where husbands and mothers-in-law often make decisions regarding healthcare [65, 66].
Future work
Looking forward, future work would be field evaluation testing to represent a larger population by incorporating individuals across generations and genders while randomly selecting participants from various regions in Nepal. This expanded evaluation would build evidence and best practice for outreach and delivery of vital health information through educational games as public health interventions. Such future research could involve designing new modules such as nutrition, and also explore the potential for scale up, reaching and impacting target audiences, and effectively involving project partners and stakeholders in the co-design process. Producing behavior change is the ultimate purpose of the serious game intervention and remains a challenging open research question to be addressed by a longitudinal follow up study.
Conclusions
Public health interventions for vulnerable populations in hard to reach settings in LMICs are rarely undertaken due to the cost, logistical difficulties and lack of scalability. Recently, mobile technology has begun to fill this gap by providing an infrastructure for reaching out to remote rural areas. Low-literacy and illiterate audiences are a challenging target group for digital mediums as they require brand new approaches when traditional text-based designs may not be appropriate.
In this paper, we described the MANTRA serious game development process for a public health intervention aimed at low-literacy women in remote rural communities in Nepal to improve their knowledge and healthcare seeking behavior around maternal, neonatal health and geohazards. This novel approach for a serious game as an mHealth intervention relies on several fundamental principles: a co-design process to develop culturally appropriate gamified mobile technology that is contextualized to the local population, pictograms-based artwork, user interfaces suitable for an illiterate audience, and evaluation with the target population.
Although the MANTRA serious game was designed for women in rural Nepal, insights from the developmental process could be transferable to other interventions and cultural or geographic settings. The development process itself is successful in that the resulting serious game for public health was engaging and enjoyable for the low-literacy target audience and participants identified with the setting of the serious game. These achievements in reaching a hard to reach low-literacy target audience in an LMIC setting support the MANTRA development process as a novel research endeavor with the potential for wider adoption and impact in public health interventions intended for low-literacy audiences in LMICs.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request for 10 years after publication.
Abbreviations
- LMICs:
-
Low and middle income countries
- FCHVs:
-
female community health volunteers
- HERD:
-
Health Research and Social Development Forum
References
Menendez C, Lucas A, Munguambe K, Langer A. Ebola crisis : the unequal impact on women and children’s health. Lancet Glob Heal. 2015;3:e130. https://doi.org/10.1016/S2214-109X(15)70009-4.
World Health Organization. Situation Report #19 26-05-2015 Nepal Earthquake 2015. 2015. https://reliefweb.int/sites/reliefweb.int/files/resources/who-sitrep19-26-may-2015.pdf.
Agarwal S, Lefevre AE, Lee J, L’engle K, Mehl G, Sinha C, et al. Guidelines for reporting of health interventions using Mobile phones: Mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ. 2016;352:1–10.
Mechael PN. The Case for mHealth in Developing Countries. Innov Technol Governance, Glob. 2009:103–18. https://doi.org/10.1162/itgg.2009.4.1.103.
IFRC, Trilogy International Partners. TERA (Trilogy Emergency Relief Application) and Beneficiary Communication. https://www.ifrc.org/en/what-we-do/beneficiary-communications/tera/. Accessed 6 Jan 2020.
Hearn GJ. B2 Desk studies. Geol Soc London, Eng Geol Spec Publ. 2011;24:71–101. https://doi.org/10.1144/EGSP24.6.
Saville NM, Shrestha BP, Style S, Harris-Fry H, Beard BJ, Sen A, et al. Impact on birth weight and child growth of participatory learning and action women’s groups with and without transfers of food or cash during pregnancy: findings of the low birth weight South Asia cluster-randomised controlled trial (LBWSAT) in Nepal. PLoS One. 2018;13:1–29.
Nair N, Tripathy P, Sachdev HS, Pradhan H, Bhattacharyya S, Gope R, et al. Effect of participatory women’s groups and counselling through home visits on children’s linear growth in rural eastern India (CARING trial): a cluster-randomised controlled trial. Lancet Glob Heal. 2017;5:e1004–16. https://doi.org/10.1016/S2214-109X(17)30339-X.
Gram L, Skordis-Worrall J, Manandhar DS, Strachan D, Morrison J, Saville N, et al. The long-term impact of community mobilisation through participatory women's groups on women's agency in the household: a follow-up study to the Makwanpur trial. PLoS ONE 2018;13(5):e0197426.https://doi.org/10.1371/journal.pone.0197426.
Fottrell E, Osrin D, Alcock G, Azad K, Bapat U, Beard J, et al. Cause-specific neonatal mortality: analysis of 3772 neonatal deaths in Nepal, Bangladesh, Malawi and India. Arch Dis Child Fetal Neonatal Ed. 2015;100:F439–47. https://doi.org/10.1136/archdischild-2014-307636.
Shrestha BP, Bhandari B, Manandhar DS, Osrin D, Costello A, Saville N. Community interventions to reduce child mortality in Dhanusha, Nepal: Study protocol for a cluster randomized controlled trial. Trials. 2011;12:136. https://doi.org/10.1186/1745-6215-12-136.
Mueller S, Soriano D, Boscor A, Saville NM, Arjyal A, Baral S, et al. MANTRA: a serious game improving knowledge of maternal and neonatal health and geohazards in Nepal | European journal of public health | Oxford academic. Eur J Pub Health. 2019;29 https://academic.oup.com/eurpub/article/29/Supplement_4/ckz185.329/5624115. Accessed 9 May 2020.
Kostkova P. Grand challenges in digital health. Front Digit Heal. 2015:1–5. https://doi.org/10.3389/fpubh.2015.00134.
Beratarrechea A, Lee AG, Willner JM, Jahangir E, Ciapponi A, Rubinstein A. The impact of Mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemed e-Health. 2014;20:75–82. https://doi.org/10.1089/tmj.2012.0328.
Stockwell MS, Kharbanda EO, Martinez RA, Vargas CY, Vawdrey DK, Camargo S. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized control trial. JAMA. 2012;307:1702–8. https://doi.org/10.1001/jama.2012.502.
Susi T, Johannesson M, Backlund P. Serious games - an overview. 2007. http://his.diva-portal.org/smash/get/diva2:2416/FULLTEXT01.pdf.
Molnar A, Kostkova P. Ubiquitous Bugs and Drugs Education for Children Through Mobile Games, Proc 6th Int Conf Digit Heal Conf - DH ‘16; 2016. p. 77–8. https://doi.org/10.1145/2896338.2896366.
Molnar A, Kostkova P. Learning about hygiene and antibiotic resistance through mobile games evaluation of learning effectiveness. ACM Int Conf Proceeding Ser. 2018;2018(April):95–9.
Lazareck LJ, Farrell D, Kostkova P, Lecky DM, McNulty CAM, Weerasinghe D. Learning by gaming - Evaluation of an online game for children, 2010 Annu Int Conf IEEE Eng Med Biol Soc EMBC’10; 2010. p. 2951–4.
Torrente J, Serrano-laguna Á, Fisk C, Brien BO, Aleksy W, Manjón BF, et al. Introducing Mokap: a novel approach to creating serious games. 5th Int Conf Digit Heal. 2015;1:17–24.
Sardi L, Idri A, Fernández-Alemán JL. A systematic review of gamification in e-health. J Biomed Inform. 2017;71:31–48. https://doi.org/10.1016/J.JBI.2017.05.011.
The World Bank. Mobile Cellular Subscriptions. 2018. https://data.worldbank.org/indicator/IT.CEL.SETS?locations=NP. Accessed 18 Jul 2018.
The World Bank. Mobile cellular subscriptions (per 100 people). The World Bank Data. 2019. https://data.worldbank.org/indicator/IT.CEL.SETS.P2?end=2017&locations=NP-1W&start=1960&view=chart. Accessed 30 Jan 2019.
The World Bank. Rural Population (% of total population) - Nepal. DataBank. 2019. https://data.worldbank.org/indicator/SP.RUR.TOTL.ZS?locations=NP&view=chart. Accessed 7 Jan 2020.
Ministry of Health Nepal, New ERA, ICF. Nepal demographic and health survey 2016. Kathmandu; Ministry of Health Nepal; 2017.https://doi.org/10.3389/fpubh.2017.00181.
Khatri RB, Mishra SR, Khanal V. Female community health volunteers in community-based health programs of Nepal: future perspective. Front public Heal. 2017;5:181. https://doi.org/10.3389/fpubh.2017.00181.
World Health Organization. NEPAL EARTHQUAKE 2015: Country Update and Funding Request. p. 2015. http://www.who.int/emergencies/nepal/nepal-donor-may.pdf.
The World Bank. Literacy rate, adult total (% of people ages 15 and above) - Nepal. DataBank. 2019. https://data.worldbank.org/indicator/SE.ADT.LITR.ZS?end=2018&locations=NP&start=1981&view=chart. Accessed 7 Jan 2020.
Ushaw G, Davison R, Eyre J, Morgan G. Adopting Best Practices from the Games Industry in Development of Serious Games for Health, 5th International Conference on Digital Health 2015 - DH ‘15; 2015. p. 1–8. https://doi.org/10.1145/2750511.2750513.
Martinez B, Hall-Clifford R, Coyote E, et al. Agile Development of a Smartphone App for Perinatal Monitoring in a Resource-Constrained Setting. J Health Inform Dev Ctries. 2017;11(1). http://www.jhidc.org/index.php/jhidc/article/view/158/212.
Molnar A, Virseda J, Frias-Martinez V. Insights from EducaMovil: Involving teachers in creating educational content for mobile learning games. J Interact Learn Res. 2015;26:209–21 http://ovidsp.ovid.com/ovidweb.cgi?T=JS&PAGE=reference&D=psyc11&NEWS=N&AN=2015–24610-005.
Thabrew H, Fleming T, Hetrick S, Merry S. Co-design of eHealth Interventions With Children and Young People. Front Psychiatry. 2018;9:1–6.
Smith RC, Bossen C, Kanstrup AM. Participatory design in an era of participation. CoDesign. 2017;13:65–9. https://doi.org/10.1080/15710882.2017.1310466.
Osborne O’Hagan A, Coleman G, O’Connor RV. Software Development Processes for Games: A Systematic Literature Review. In: Barafort B, O’Connor RV, Poth A, Messnarz R, editors. Systems, Software and Services Process Improvement. Berlin, Heidelberg: Springer Berlin Heidelberg; 2014. p. 182–93. https://doi.org/10.1007/978-3-662-43896-1_16.
Grace L, Jackson GT, Totten C, Parker J, Rice J. Designing microgames for Assessment: A case study in rapid prototype iteration. ACM Int Conf Proceeding Ser. 2015:16–9-Nove. https://doi.org/10.1145/2832932.2832969.
Farrell D, Kostkova P, Lazareck L, Weerasinghe D, Weinberg J, Lecky DM, et al. Developing e-bug web games to teach microbiology. J Antimicrob Chemother. 2011;66(SUPPL. 5):33–8.
Kostkova P, Farrell D, de Quincey E, Weinberg J, Lecky D, McNulty C. eBug - teaching children hygiene principles using educational games. Stud Health Technol Inform. 2010;160(Pt 1):600–4.
Molnar A, Kostkova P. On effective integration of educational content in serious games: Text vs. game mechanics, Proc - 2013 IEEE 13th Int Conf Adv Learn Technol ICALT 2013; 2013. p. 299–303.
Molnar A, Kostkova P. Seamless Evaluation Integration into IDS Educational. 8th Int Conf Found Digit Games. 2013; Cmi:322–9. http://www.fdg2013.org/program/papers/paper42_molnar_kostkova.pdf. Accessed 2 Dec 2018.
Jamieson P, Grace L. A framework to help analyze if creating a game to teach a learning objective is worth the work. Proc - Front Educ Conf FIE. 2016;2016-Novem.
Jacob Habgood MP, Ainsworth SE. Motivating children to learn effectively: exploring the value of intrinsic integration in educational games. J Learn Sci. 2011;20:169–206.
Molnar A, Kostkova P. Edu-interact:an authoring tool for interactive digital storytelling based games. Bull IEEE Tech Comm Learn Technol. 2016;18:10–3 http://eprints.lancs.ac.uk/123797/. Accessed 18 Feb 2019.
Molnar A, Kostkova P. Gaming to master the game - Game usability and game mechanics. In: 3rd IEEE International Conference on Serious Games and Applications for Health (SeGAH). Rio de Janeiro; 2014. p. 1–7.
Muis KR, Ranellucci J, Trevors G, Duffy MC. The effects of technology-mediated immediate feedback on kindergarten students’ attitudes, emotions, engagement and learning outcomes during literacy skills development. Learn Instr. 2015;38:1–13. https://doi.org/10.1016/J.LEARNINSTRUC.2015.02.001.
Health Research and Social Development Forum. Health Research And Social Development Forum. 2019. https://www.herd.org.np/. Accessed 19 Feb 2019.
Saville NM, Shrestha BP, Style S, Harris-Fry H, Beard BJ, Sengupta A, et al. Protocol of the low birth weight South Asia trial (LBWSAT), a cluster-randomised controlled trial testing impact on birth weight and infant nutrition of participatory learning and action through women’s groups, with and without unconditional transfers of fortified food or cash during pregnancy in Nepal. BMC Pregnancy Childbirth. 2016;16:320. https://doi.org/10.1186/s12884-016-1102-x.
Hearn G, Petley D, Hart A, Massey C, Chant C. Landslide risk assessment in the rural sector: guidelines on best practice. 2003. https://www.gov.uk/dfid-research-outputs/landslide-risk-assessment-in-the-rural-sector-guidelines-on-best-practice-add017.
Manandhar PDS, Osrin D, Prasad Shrestha B, Mesko N, Morrison J, Man Tumbahangphe K, et al. Effect of a participatory intervention with women’s groups on birth outcomes in Nepal: cluster-randomised controlled trial. Lancet. 2004;364:970–9.
Morrison J, Thapa R, Hartley S, Osrin D, Manandhar M, et al. Understanding how women’s groups improve maternal and newborn health in Makwanpur, Nepal: a qualitative study. Int Health. 2010;2:25–35. https://doi.org/10.1016/j.inhe.2009.11.004.Understanding.
Sharma J. Community-based management of neonatal infections in Nepal. Kathmandu: Final report of Morang Innovative Intervention Program (MINI-1); 2008.
Gargi K. Community-Based Management of Neonatal Infections in Nepal. Kathmandu: Final report of Morang Innovative Intervention Program (MINI-II); 2009. https://www.jsi.com/JSIInternet/Inc/Common/_download_pub.cfm?id=10660&lid=3.
Biernacki P, Waldorf D. Snowball sampling: problems and techniques of chain referral sampling. Sociol Methods Res. 1981;10:141–63. https://doi.org/10.1177/004912418101000205.
Mueller S, Soriano D, Boscor A, Saville N, Arjyal A, Baral S, et al. MANTRA: Improving knowledge of maternal health, neonatal health, and geohazards in women in rural Nepal using a mobile serious game (submitted to Frontiers in Public Health: Digital Public Health).
Kayastha R. mHealth: Women’s perception, its acceptability and opportunities. [unpublished MSc dissertation] University College London; United Kingdom. 2018.
Unity Technologies. Unity. 2017. https://unity.com/. Accessed 9 May 2020.
Gautam DK. NTC and Ncell: telecommunication and strategies. South Asian J Bus Manag Cases. 2016;5:126–33.
The most popular database for modern apps | MongoDB. https://www.mongodb.com/. Accessed 19 Jun 2020.
Cloud Application Platform | Heroku. https://www.heroku.com/. Accessed 19 Jun 2020.
Mother and Infant Research Activities. 2019. http://www.mira.org.np/mira/. Accessed 19 Feb 2019.
Ilozumba O, Dieleman M, Kraamwinkel N, Van Belle S, Chaudoury M, Broerse JEW. “I am not telling. The mobile is telling”: factors influencing the outcomes of a community health worker mHealth intervention in India. PLoS One. 2018;13:e0194927. https://doi.org/10.1371/journal.pone.0194927.
Shorey S, Yang YY, Dennis C-L. A Mobile health app-based postnatal educational program (home-but not alone): descriptive qualitative study. J Med Internet Res. 2018;20:e119. https://doi.org/10.2196/jmir.9188.
Rogers Y, Marshall P. Research in the Wild: Morgan & Claypool Publishers; 2017. Accessed 2 Dec 2018.
Ministry of Health NNE and I. Nepal demographic and health survey key findings. Kathmandu, Nepal Minist Heal Nepal. 2016;2017.
Paudel D, Ahmed M, Pradhan A, Lal DR. Successful use of tablet personal computers and wireless technologies for the 2011 Nepal demographic and health survey. Glob Heal Sci Pract. 2013;1:277–84. https://doi.org/10.9745/GHSP-D-12-00056.
Acharya DR, Bell JS, Simkhada P, van Teijlingen ER, Regmi PR. Women’s autonomy in household decision-making: a demographic study in Nepal. Reprod Health. 2010;7:15. https://doi.org/10.1186/1742-4755-7-15.
Diamond-Smith N, Raj A, Prata N, Weiser SD. Associations of women’s position in the household and food insecurity with family planning use in Nepal. PLoS One. 2017;12:1–17.
Acknowledgements
We thank the participants in rural and peri-urban communities who took part in the field evaluation sessions of the game and those who participated in the qualitative research to develop its content. This includes reproductive age women, Female Community Health Volunteers, health workers, and men in the community who welcomed us and readily gave up their time to work with us.
Funding
This project was funded by the United Kingdom Research Councils Global Challenges Research Fund [Project: 538621 Award: 173142]. The funding body played no role beyond the funding call in the design of the study, data collection, analysis, data interpretation, or writing the manuscript.
Author information
Authors and Affiliations
Contributions
SM contributed to design of the work and drafting the article. DS developed the pictograms and contributed to design of the serious game and evaluations. AB contributed to design of the serious game. NS contributed to the conception and design of the work, particularly perinatal health messages, as well as acquisition of field data. AA contributed to the acquisition of field data. MF, SB, and VLM contributed to conception of the work. AA, NS, and SB assisted to contextualize the content of the game. GH contributed to conception and design of the work, particularly geohazard messages. RK interpreted focus group data. PK contributed to conception, design, analysis, interpretation, and drafting of the work. All authors read and approved the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This project was approved by the University College London Ethics Committee in London, United Kingdom [10547/001], and the Nepal Health Research Council in Kathmandu, Nepal [Reg. No. 105/2017]. All participants provided informed written consent.
Consent for publication
All participants in the MANTRA project signed consent forms including use and publication of their image.
Competing interests
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Mueller, S., Soriano, D., Boscor, A. et al. MANTRA: development and localization of a mobile educational health game targeting low literacy players in low and middle income countries. BMC Public Health 20, 1171 (2020). https://doi.org/10.1186/s12889-020-09246-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12889-020-09246-8