RefCheck Maintenance Notice

On Monday, December 3, 2018, from 16:00-18:00 EST, RefCheck will be undergoing maintenance. RefCheck is the process where, during copyediting, all references are extracted from the manuscript file, parsed, matched against various databases (eg, PubMed and CrossRef), and automatically corrected. For more information on RefCheck, please visit our Knowledge Base.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 20.11.18 in Vol 1, No 2 (2018): Jul-Dec

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/11569, first published Jul 12, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    A Fall Risk mHealth App for Older Adults: Development and Usability Study

    1Department of Kinesiology and Community Health, University of Illinois at Urbana Champaign, Urbana, IL, United States

    2Department of Internal Medicine, Wake Forest School of Medicine, Winston-Salem, NC, United States

    *these authors contributed equally

    Corresponding Author:

    Jacob J Sosnoff, PhD

    Department of Kinesiology and Community Health

    University of Illinois at Urbana Champaign

    906 South Goodwin Avenue

    Urbana, IL, 61801

    United States

    Phone: 1 217 244 7006

    Fax:1 217 244 6086

    Email:


    ABSTRACT

    Background: Falls are the leading cause of injury-related death in older adults. Due to various constraints, objective fall risk screening is seldom performed in clinical settings. Smartphones offer a high potential to provide fall risk screening for older adults in home settings. However, there is limited understanding of whether smartphone technology for falls screening is usable by older adults who present age-related changes in perceptual, cognitive, and motor capabilities.

    Objective: The aims of this study were to develop a fall risk mobile health (mHealth) app and to determine the usability of the fall risk app in healthy, older adults.

    Methods: A fall risk app was developed that consists of a health history questionnaire and 5 progressively challenging mobility tasks to measure individual fall risk. An iterative design-evaluation process of semistructured interviews was performed to determine the usability of the app on a smartphone and tablet. Participants also completed a Systematic Usability Scale (SUS). In the first round of interviews, 6 older adults participated, and in the second round, 5 older adults participated. Interviews were videotaped and transcribed, and the data were coded to create themes. Average SUS scores were calculated for the smartphone and tablet.

    Results: There were 2 themes identified from the first round of interviews, related to perceived ease of use and perceived usefulness. While instructions for the balance tasks were difficult to understand, participants found it beneficial to learn about their risk for falls, found the app easy to follow, and reported confidence in using the app on their own. Modifications were made to the app, and following the second round of interviews, participants reported high ease of use and usefulness in learning about their risk of falling. Few differences were reported between using a smartphone or tablet. Average SUS scores ranged from 79 to 84.

    Conclusions: Our fall risk app was found to be highly usable by older adults as reported from interviews and high scores on the SUS. When designing a mHealth app for older adults, developers should include clear and simple instructions and preventative strategies to improve health. Furthermore, if the design accommodates for age-related sensory changes, smartphones can be as effective as tablets. A mobile app to assess fall risk has the potential to be used in home settings by older adults.

    JMIR Aging 2018;1(2):e11569

    doi:10.2196/11569

    KEYWORDS



    Introduction

    In adults 65 years or older, 1 in 4 will fall per year [1]. Falls are also the leading cause of injury-related death in older adults [2]. The Centers for Disease Control and Prevention recommends annual falls screening for all older adults. However, objective fall screening is rarely assessed in clinical settings, in part because it requires expensive equipment, clinicians have time constraints, or they may not have the training or relevant expertise [3].

    Mobile technology such as smartphones offer a potential solution for measuring fall risk objectively, inexpensively, and with minimal training required. Unlike gold-standard technology for fall risk assessment (ie, force plates, stand-alone accelerometers, and high-speed motion capture cameras), smartphones are commercially available and cost-efficient [4]. While smartphone technology may be useful, older adults tend to be slow to adopt new technologies [5]. However, having high perceived usefulness (the belief that using a system enhances performance) and high perceived ease of use (the belief that a system is free of effort) are foundational determinants of technology acceptance [6].

    High perceived usefulness and perceived ease of use may explain why older adults are the fastest-growing population of smartphone users [7]. As of 2017, 42% of adults 65 years and older own a smartphone [8]. Moreover, 74% of adults aged 50-64 years own smartphones [8]. Furthermore, the use of health apps is growing among older adults, enabling these individuals to monitor and improve their health through their own device [9]. In addition to tracking health, apps can also provide feedback to help users reach health goals [10]. Therefore, the adoption of smartphone apps for older adults should be designed for high perceived ease of use and perceived usefulness.

    There is growing evidence of the validity of smartphone usage for fall risk screening. There have been 2 recent systematic reviews that have indicated that smartphone accelerometers and smartphone apps have the potential to measure fall risk through quantifying gait and balance [11,12]. For instance, Ozinga and Alberts [13] found high correlations in root mean square acceleration and 95% volume of acceleration between an iPad and 3D-motion capture during static balance conditions. An app called the uTUG, which measures performance during the Timed Up and Go (TUG), was developed by 1 group [14]. Additionally, another study developed a fall risk app based on the Aachen Falls Prevention Scale and found their app to be related to users’ self-reported history of falls [15]. The growing body of evidence for smartphone use to measure fall risk brings strong potential for falls screening in the home setting. This provides an opportunity for older adults to assess their individual fall risk, a necessary step in determining the type of fall prevention treatment needed.

    Health apps targeting falls prevention are becoming more common, but previously developed apps center on a single task, such as the TUG or a specific questionnaire. Because fall risk is multifactorial, there is a need for an app to assess multiple influences on fall risk. These past apps provide an important foundation for mobile fall risk assessment, but an app that measures multiple risk factors helps determine which measures are useful for individualized fall risk. In addition to developing health apps to measure fall risk, a critical next step is to ensure usability by the target users. Our review of the literature indicated that the usability aspect is typically not part of the reported evaluations [13,16,17]. A smartphone can effectively address the issue of inadequate fall risk screening but only if older adults are able to use the app. A usable app must be designed to accommodate age-related changes in perceptual, cognitive, and motor capabilities [18]. Designing for accommodation of age-related changes is necessary but not sufficient for ensuring usability by older adults [19]. Usability testing with members of the target user group is needed to identify additional usability challenges. Therefore, the purpose of this study was to develop a fall risk app and test the usability of the app in healthy, older adults. A smartphone app that measures fall risk through a battery of assessments and is usable by our target population will improve falls screening and help identify those in need of fall prevention resources.


    Methods

    App Design and Development

    The fall risk app, Steady, was developed in Android Studio 3.1.2 for smartphone and tablet devices. Steady consists of 2 components. The first is a 13-item questionnaire of health history (ie, age, gender, number of falls in the last year, and perceived balance confidence [20]; Figure 1). These questions were chosen because they are associated with falls and recurrent falls in community-dwelling older adults [21]. The second component is a progressive postural stability test (Figure 2), wherein the device guides participants through 5 progressively difficult tasks. These include 4 30-second balance tasks (eyes open, eyes closed, tandem, and single leg) plus a 30-second sit-to-stand test. These tasks were chosen because they have been shown to discriminate between high and low risk of falling in older adults [4,22]. Instructions prior to each balance task are provided through text, and users are asked to hold the phone against their chest for the duration of each test. Safety instructions to wear sturdy shoes and the option to skip a balance task were provided prior to the start of each task. On completion of each task, users report whether they attempted the task. If so, they then report whether they were able to complete the task (Figure 3). These data, alongside data from the health history questionnaire, are entered into a weighted algorithm to produce a score ranging from 0-100 and classified into a very low, low, moderate, high, or very high risk of falling (Figure 4). Lower scores represent a greater risk for falls.

    Figure 1. Screenshot of the healthy history questionnaire.
    View this figure
    Figure 2. Screenshot of the tandem stance task.
    View this figure
    Figure 3. Participants report their ability to complete each balance task.
    View this figure
    Figure 4. Final fall risk score; lower scores represent a greater risk for falls.
    View this figure

    The first iteration of the app was developed with consideration for age-related changes that might influence usability. With respect to sensory changes, we ensured that the font was at least size 14 and sans serif, the recommended font size and type for older adults [23]. All text is black text on a white background to maximize contrast. The app also utilizes an audio component for the balance tasks. To begin each balance task, 5 identical beeps are presented, and the 30-second posture task begins at a unique (ie, higher) sixth beep. We ensured that the audio is loud enough for older adults to hear, and we added vibrations during each auditory tone for those hard of hearing. We minimized the cognitive demands by listing 1 set of instructions or task per screen. In doing so, we aimed to reduce working memory overload. In total, there are 10 screens to navigate before receiving a final fall risk score. Lastly, we accommodated motor capabilities of older adults by incorporating large buttons when entering information.

    Usability Testing

    Participant Characteristics

    A total of 11 healthy, older adults participated in usability testing. Our approach was to have older adults interact with the app, identify usability issues, improve the design, and then have another group of older adults interact with the app. This iterative approach is ideal for identifying use challenges. Nielson [24] has argued that small numbers of participants (~5) are sufficient for identifying usability problems. Consequently, we included 6 older adults in our first iteration and 5 in our second. Inclusion criteria included being over 70 years of age, self-reported ability to swipe on a touchscreen device, and able to stand with or without aid. All procedures were approved by the University of Illinois at Urbana-Champaign Institutional Review Board, and all participants completed written informed consent prior to participation.

    Testing Environment

    Usability testing was performed at 2 sites selected for convenience for the participants. The first was an unoccupied apartment at a local retirement community. Testing was performed in the living room of this apartment to mimic using the app in one’s own home. We tested 5 participants from the first iteration and 3 participants from the second iteration at the apartment. The second site was a research laboratory on a University campus. This site used an open space in the research laboratory. We tested 1 participant from the first iteration and 2 participants from the second iteration at the research lab.

    Procedures

    An iterative design-evaluation process of semistructured, videotaped interviews was used to determine the optimal usability of Steady [25]. Participants were presented with a smartphone (Samsung Galaxy S6) and tablet (Samsung Galaxy Tab S3) and asked to pick their choice of device to use first. After selecting a device, participants were asked to open the app and follow all instructions while thinking aloud and narrating their thoughts. In addition, a series of open-ended questions related to ease of use, recommendations for modifications, and feasibility were asked after completing the healthy history questionnaire, after completing the balance tasks, and after receiving their final fall risk score. These questions are included in Multimedia Appendix 1. After completion, participants repeated the testing measures with the alternate device and were asked to report differences in using the smartphone and tablet. Participants then completed the Systematic Usability Scale (SUS) [26] for both the smartphone and tablet. The SUS is widely used to quantify the usability of user-machine interfaces, consisting of 10 standard questions on a 5-point Likert scale, with higher scores indicating greater usability [26]. The SUS ranges from 0 to 100, with higher scores representing greater usability.

    After the first iterative cycle, changes were made to the app based on identified issues from the interviews. The second iterative cycle was conducted on 5 older adults, following the same format as the first cycle. No new usability challenge themes emerged after the second cycle.

    Data and Statistical Analysis

    All videotapes and field notes taken during the interview were transcribed verbatim. Qualitative data from transcripts and field notes were reviewed by KH to develop a coding system. Based on their content, data were assigned with codes, and codes with similar content were grouped into thematic categories.

    Following a mixed-methods approach, SUS data were used to complement the qualitative results. SUS scores were averaged for each participant and transformed into a usability score out of 100, where the average score was 68 [27].


    Results

    Participant Characteristics

    Demographic information of all participants is provided in Table 1.

    Iteration 1

    Usability Testing Interviews

    Transcript analysis and coding revealed 2 distinct usability themes, namely, perceived ease of use and perceived usefulness.

    Perceived Ease of Use

    Overall, participants found the app easy to follow and free of clutter. Some participants found difficulties swiping between screens and answering the balance confidence questions in the health history questionnaire. In the first iteration, a slide bar was used to indicate a percentage for 0 through 100 (Figure 5). However, 4 participants were unable to drag the slide bar or needed multiple attempts. Therefore, the slide bar was replaced with a key-in entry (Figure 6), and forward and back arrows were added to each screen.

    Participants reported confusion following the instructions to begin and end each balance task. The first 5 beeps prior to starting each balance task was programmed to allow time for participants set-up for each task. However, 4 of the 6 participants were confused about when to start or stop each task. Participants thought the task ended at the sixth beep instead of starting at the sixth beep. As a potential solution, instructions were added prior to each balance task explaining when each task begins and ends within the second iteration of the app (Figure 7).

    Additionally, participants completed the health history questionnaire and balance tasks in the incorrect order. In the first iteration, participants’ fall risk would be displayed following the completion of the balance tasks, regardless of whether the health history questionnaire was completed. This resulted in an inaccurate initial score. This resulted because the button to initiate the balance tasks was displayed above the button for the health history, and participants often completed the balance tasks first. To address this issue in the second iteration, only the questionnaire button is displayed until the questionnaire is complete (Figure 8).

    In comparing using the smartphone and the tablet, there were few differences reported. No differences between the 2 devices were reported by 3 participants. There was 1 participant who preferred holding the tablet for the balance tasks, and 2 participants preferred holding the phone for the balance tasks.

    Perceived Usefulness

    Participants enjoyed learning their risk of falling from the app. There were 4 of the 6 participants who reported concerns and fear of falling, indicating that this app may address their concerns. For example, 1 participant mentioned that it helped her think about her balance and falls.

    I think this [the app] would be helpful for me because I wasn’t too steady. This helps me think about balance exercises when I go to the gym.
    [Female, 74 years old]

    It appeared that the greatest benefit for participants was to receive their fall risk and be more aware of falls. Half of the participants reported this benefit. Moreover, all participants who received a high risk of falls wanted to receive fall prevention strategies to lower their fall risk.

    Participants also reported confidence and acceptance in using the app on their own if it were downloaded on their own device. There were 4 participants who explained that the app was easy to follow on their own. There was 1 participant who indicated that she may need assistance to start the app but could finish on her own. While a caregiver may not be needed, some participants mentioned they would want to be near a sturdy object in case they lose their balance. This was further included in the safety instructions provided at the start of each in-app testing session.

    I am comfortable using [the app] by myself.
    [Female, 77 years old]

    A summary of the main issues, with sample quotes, in the first iteration and the solutions implemented in the second iteration are described in Table 2.

    Usability Testing Questionnaire

    The average score on the SUS for the smartphone was 79.17, and the average score on the SUS for the tablet was 77.92 (Figure 9). Blue bars represent scores for the tablet, and orange bars represent scores for the phone. These scores represent good usability for both devices [27]. Average scores on each of the 10 items are reported in Table 3. A 5-point Likert scale was used, with higher scores indicating greater usability.

    Table 1. Demographic information of all participants.
    View this table
    Figure 5. In the first iteration, balance confidence was presented as a slide bar.
    View this figure
    Figure 6. In the second iteration, the balance confidence questions were changed to key-in entries.
    View this figure
    Figure 7. Instructions were added in the second iteration to clarify the start and end of each balance task.
    View this figure
    Figure 8. To prevent users from receiving an inaccurate fall risk score, users are prompted to answer health history questions at start up.
    View this figure
    Table 2. Main issues, with sample quotes, identified from the first round of usability testing with solutions implemented in the second iteration of the app.
    View this table
    Figure 9. Systematic Usability Scale scores for iterations 1 and 2.
    View this figure
    Table 3. Average scores on each question of the Systematic Usability Scale for iterations 1 and 2.
    View this table

    Iteration 2

    Usability Testing Interviews

    Transcript analysis and codes in the second round of interviews revealed 2 distinct themes, namely, perceived ease of use and perceived usefulness.

    Perceived Ease of Use

    In the second round of interviews, participants reported little to no difficulty in navigating through the app and understanding the instructions. Participants in the second round preferred the smartphone over the tablet. There were 3 participants who preferred the smartphone more because it was easier to hold against their chest. The tablet was preferred by 1 participant because it was easier to read, while 1 reported no differences. No other problems related to ease of use were identified during the second round of interviews.

    Perceived Usefulness

    Similar to responses from the first interviews, 4 participants reported a benefit of learning about their risk of falling. Participants also reported that Steady would be useful for them and other older adults, especially for those who do not have access to fall risk screening.

    In this place [retirement community] we have a lot of exercises and programs and balance tests, but I think there are a lot of people who are at home and who don’t have access to all that, and I think it could be very helpful to them.
    [Female, 83 years old]

    After receiving their fall risk score, 4 participants also wanted to understand fall prevention strategies they could adopt. Participants suggested the app displaying simple exercises that they could practice at home.

    Furthermore, not only did participants find Steady to be useful but they also reported that they would be able to use it on their own. Of the 5 participants, 4 reported that they could complete the app on their own. Because the tests are short, the instructions are clear, and the app is easy to follow, participants reported that they would be able to use Steady in their own homes. There was 1 participant who indicated they would want a caregiver’s help to assist in spotting during the balance tasks.

    The instructions were clear and I could download this on my own phone and use it on my own. [Male, 85 years old].
    Usability Testing Questionnaire

    The average score for the SUS on the smartphone was 84, and the average score for the SUS on the tablet was 80 (Figure 9). The average scores on each of the 10 items are reported in Table 3.


    Discussion

    Principal Findings

    The purpose of this study was to develop a mobile app to measure fall risk in older adults and to test whether the app was usable by an older adult population. The iterative development and testing of a fall risk mobile app resulted in a usable device for older adults to measure their risk of falling. Through 2 rounds of usability testing, Steady accommodated for age-related perceptual, cognitive, and motor changes to promote use in older adults. When using Steady, participants reported that the app was easy to follow, they had little difficulty receiving a fall risk score (ie, positive ease of use), and the app was beneficial to bring awareness and knowledge of their risk of falling (ie, high perceived usefulness). High SUS scores also indicated high usability for both the smartphone and tablet, although older adults appeared to prefer using the phone for the balance activities.

    This study suggests the potential for mobile technology to offer fall risk screening to older adults. The 2 themes generated from the interviews were perceived ease of use and perceived usefulness. Both perceived ease of use and perceived usefulness are factors that predict technology acceptance among older adults [5]. This suggests that older adults may have high acceptance of a fall risk app. Furthermore, a fall risk app that older adults find both usable and useful has high potential to provide falls screening to older adults outside a clinical setting. Along with previous studies that have found smartphones to provide valid balance and fall risk screening, mobile technology may offer a solution to identify high fall risk older adults to seek fall prevention treatment.

    Through iterative usability testing, we identified key lessons to use when developing a mobile health (mHealth) app for older adults. First, instructions should be as clear and simple as possible. This became evident when the 30-second balance task instructions were confusing for our participants. Rewording the instructions and maintaining the consistency of these instructions drastically improved performance. Second, measuring fall risk is a necessary step to prevent falls, but older adults also wanted to learn how to lower their fall risk. While participants reported high usefulness, there is potential to increase usefulness by adding prevention strategies. When developing a health app, both measurement and prevention strategies should be taken into consideration. Third, a smartphone can be just as effective as a tablet if the app has high perceived ease of use. We found that by incorporating large font sizes, keeping text consistent, and using contrasting colors, participants found no differences in reading or entering information in the phone or tablet. Because Steady involves holding the device to the chest, the smartphone was found to be the more feasible device. Following these lessons may help develop a highly usable mHealth app for older adults.

    Comparison With Prior Work

    To the authors’ knowledge, this is the first study to test the usability of an app that measures fall risk in older adults. Because fall risk screening is underutilized in clinical settings, this study suggests that a smartphone app can not only offer fall risk screening but also be used by older adults. Compared to previous studies, Steady provides a quick and understandable fall risk output. A previous study used a smartphone worn at the hip to monitor fall risk during a dancing game [28]. Another study tested the usability of mobile technology to detect falls in older adults [29]. Although both studies found high usability, neither the game nor the fall detection app provided a fall risk score for users. Providing fall risk knowledge to older adults is the first step to seeking treatments to lower their risk of falling.

    A previous study developed and tested an app to measure fall risk based on the Aachen Fall Prevention Scale [15]. This app determines fall risk based on a set of questionnaires and completion of a 10-second balance task. Similarly, the Steady app also includes questionnaires and mobility tasks, but it utilizes valid and known predictors of fall risk and incorporates 5 balance tasks that are related to elevated fall risk in older adults. Furthermore, the previous study did not test the usability, and it is unclear whether older adults found the app easy to use on their own.

    A recent study performed a survey of German-speaking internet users to identify features of a falls prevention app would increase user satisfaction, such as having fall risk treatments decided by a health care professional or having gaming elements incorporated for physical activity integration [30]. Steady accomplishes 1 of their findings, namely, to identify fall risk through a standardized test [30]. Because Steady is a fall risk identification app and currently does not include an intervention component, the other features do not apply. Future studies should determine whether the design features reported from the survey are consistent with those identified in the United States, and future iterations of fall risk assessment and prevention apps should follow these guidelines.

    Limitations

    A limitation in the design of Steady is that the balance tasks are constrained to individuals who can stand with or without aid. This limits older adults with significant mobility impairments (ie, wheelchair users) from using the app. Wheelchair users have shown to have an elevated fall risk [28], and future iterations of Steady should develop and test fall risk for wheelchair users. Steady also uses visual text to guide users through the app, which is a limitation for older adults with significant vision impairment. Future iterations of Steady should also include an auditory instruction to guide users through the app. It is also possible that individuals with pacemakers may find that holding a smartphone or tablet to their chest interferes with their pacemaker. Therefore, future efforts should also determine whether the phone can be placed at the hip or another area away from a pacemaker.

    In addition, our sample of older adults is well-educated. Almost all participants had a college degree or higher. Those with higher education levels may also have greater technology experience, and they may perceive different issues with usability than older adults with lower education levels. Although smartphone and tablet usage were recorded from participants, the type of device (ie, Android, Apple, or Windows), was not recorded. Therefore, it is unclear if preference toward the smartphone was due to current usage of an Android smartphone. Future studies will collect the type of operating platform in addition to technology usage.

    While the accelerometer embedded in the smartphone captured data during the balance tasks, the acceleration results were not incorporated into the final fall risk score. In the next iteration, the fall risk score will include both balance performance from acceleration data and health history questionnaire data. This will enhance the classification of low-, moderate-, and high-risk fallers. Furthermore, the next iteration will also include fall prevention strategies, as this was a common request among participants. Future directions should also include a long-term evaluation of Steady and determine its health impact on older adults. Next steps for Steady will be to determine the validity and reliability of the algorithm compared with standard fall risk tests in older adults. Ultimately, a fall risk app that is usable for older adults, valid compared with standard fall risk assessments, and reliable over time may provide a tool to increase knowledge of individual fall risk in older adults.

    Conclusions

    In conclusion, through a mixed-methods, iterative design, we developed and tested an app on a smartphone and tablet to measure older adults’ risk of falling. After 1 round of usability testing, confusion with task instructions and visual and tactile errors were corrected. After the second round of testing, older adults found the app useful and easy to use. High SUS scores for both the smartphone and tablet also indicated high usability, but participants preferred holding the smartphone over the tablet. A fall risk app has the potential to be used by older adults to measure their risk of falling.

    Acknowledgments

    We would like to thank Dr Douglas Wajda for his assistance in designing the mobile app. We would also like to thank our funding source, Collaborations in Health, Aging, Research, and Technology, for supporting this project.

    Conflicts of Interest

    JJS has partial ownership in Sosnoff Technologies, LLC, a company that may be affected by the research reported in the enclosed paper. This conflict of interest is managed by a plan approved by the University of Illinois at Urbana-Champaign.

    Multimedia Appendix 1

    Questions asked during semistructured interviews for usability testing.

    PDF File (Adobe PDF File), 199KB

    References

    1. Florence C, Bergen G, Atherly A, Burns E, Stevens J, Drake C. Medical Costs of Fatal and Nonfatal Falls in Older Adults. J Am Geriatr Soc 2018 Apr;66(4):693-698. [CrossRef] [Medline]
    2. Center for Disease Control. 2012. National Estimates of the 10 Leading Causes of Nonfatal Injuries Treated in Hospital Emergency Departments, United States, 2013   URL: https://www.cdc.gov/injury/wisqars/pdf/leading_causes_of_nonfatal_injury_2015-a.pdf
    3. Smith ML, Stevens JA, Ehrenreich H, Wilson AD, Schuster RJ, Cherry CO, et al. Healthcare providers' perceptions and self-reported fall prevention practices: findings from a large new york health system. Front Public Health 2015;3:17 [FREE Full text] [CrossRef] [Medline]
    4. Rogers ME, Rogers NL, Takeshima N, Islam MM. Methods to assess and improve the physical parameters associated with fall risk in older adults. Prev Med 2003 Mar;36(3):255-264. [Medline]
    5. Mitzner T, Rogers W, Fisk A. Predicting older adults' perceptions about a computer system designed for seniors. Universal Access in the Information Society 2016;15(2):271-280. [CrossRef]
    6. Davis FD. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 1989;13(3):319-340. [CrossRef]
    7. Joe J, Demiris G. Older adults and mobile phones for health: a review. J Biomed Inform 2013 Oct;46(5):947-954 [FREE Full text] [CrossRef] [Medline]
    8. Anderson M, Perrin A. Washington, DC: Pew Research Center for Internet & Technology. 2017 May. Technology use among seniors   URL: https:/​/www.​silvergroup.asia/​wp-content/​uploads/​2017/​07/​Technology-use-among-seniors-_-Pew-Research-Center.​pdf [accessed 2018-10-25] [WebCite Cache]
    9. Krebs P, Duncan D. Health App Use Among US Mobile Phone Owners: A National Survey. JMIR Mhealth Uhealth 2015 Nov 04;3(4):e101 [FREE Full text] [CrossRef] [Medline]
    10. Higgins JP. Smartphone Applications for Patients' Health and Fitness. Am J Med 2016 Jan;129(1):11-19. [CrossRef] [Medline]
    11. Reyes A, Qin P, Brown CA. A standardized review of smartphone applications to promote balance for older adults. Disabil Rehabil 2018 Dec;40(6):690-696. [CrossRef] [Medline]
    12. Roeing KL, Hsieh KL, Sosnoff JJ. A systematic review of balance and fall risk assessments with mobile phone technology. Arch Gerontol Geriatr 2017 Nov;73:222-226. [CrossRef] [Medline]
    13. Ozinga SJ, Alberts JL. Quantification of postural stability in older adults using mobile technology. Exp Brain Res 2014 Dec;232(12):3861-3872. [CrossRef] [Medline]
    14. Mellone S, Tacconi C, Schwickert L, Klenk J, Becker C, Chiari L. Smartphone-based solutions for fall detection and prevention: the FARSEEING approach. Z Gerontol Geriatr 2012 Dec;45(8):722-727. [CrossRef] [Medline]
    15. Rasche P, Mertens A, Bröhl C, Theis S, Seinsch T, Wille M, et al. The “Aachen fall prevention App” - a Smartphone application app for the self-assessment of elderly patients at risk for ground level falls. Patient Saf Surg 2017;11:14 [FREE Full text] [CrossRef] [Medline]
    16. Galán-Mercant A, Cuesta-Vargas AI. Mobile Romberg test assessment (mRomberg). BMC Res Notes 2014 Sep 12;7:640 [FREE Full text] [CrossRef] [Medline]
    17. Kosse NM, Caljouw S, Vervoort D, Vuillerme N, Lamoth CJC. Validity and Reliability of Gait and Postural Control Analysis Using the Tri-axial Accelerometer of the iPod Touch. Ann Biomed Eng 2015 Aug;43(8):1935-1946. [CrossRef] [Medline]
    18. Rogers W, O'Brien M, Fisk A. 17 Cognitive Engineering to Support Successful Aging. In: The Oxford handbook of cognitive engineering. New York, NY: Oxford University Press; 2013:286-301.
    19. Fisk A, Rogers W, Charness N. Designing for Older Adults: Principles and Creative Human Factors Approaches. Boca Raton: CRC Press; Mar 26, 2009.
    20. Schepens S, Goldberg A, Wallace M. The short version of the Activities-specific Balance Confidence (ABC) scale: its validity, reliability, and relationship to balance impairment and falls in older adults. Arch Gerontol Geriatr 2010;51(1):9-12 [FREE Full text] [CrossRef] [Medline]
    21. Shumway-Cook A, Baldwin M, Polissar NL, Gruber W. Predicting the probability for falls in community-dwelling older adults. Phys Ther 1997 Aug;77(8):812-819. [Medline]
    22. Chiu AYY, Au-Yeung SSY, Lo SK. A comparison of four functional tests in discriminating fallers from non-fallers in older people. Disabil Rehabil 2003 Jan 07;25(1):45-50. [Medline]
    23. Bernard M, Liao C, Mills M. The effects of font type and size on the legibility and reading time of online text by older adults. 2001 Presented at: CHI '01 Extended Abstracts on Human Factors in Computing Systems; March 31 - April 05, 2001; Seattle, Washington p. 176. [CrossRef]
    24. Nielsen J. Nielsen Norman Group. 2012 Jun 04. How many test users in a usability study   URL: https://www.nngroup.com/articles/how-many-test-users/ [accessed 2018-10-25] [WebCite Cache]
    25. Kvale S, Steinar. InterViews: An introduction to qualitative research interviewing. In: Person-centered leadership. Thousand Oaks, Calif: Sage Publications, c1996; 1996.
    26. Brooke J. SUS-A Quick and Dirty Usability Scale. 1996.   URL: https://hell.meiert.org/core/pdf/sus.pdf [accessed 2018-10-25] [WebCite Cache]
    27. Bangor A, Kortum P, Miller J. An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction 2008 Jul 30;24(6):574-594. [CrossRef]
    28. Rice LA, Ousley C, Sosnoff JJ. A systematic review of risk factors associated with accidental falls, outcome measures and interventions to manage fall risk in non-ambulatory adults. Disabil Rehabil 2015;37(19):1697-1705. [CrossRef] [Medline]
    29. Harte R, Quinlan L, Glynn L, Rodríguez-Molinero A, Baker PM, Scharf T, et al. Human-Centered Design Study: Enhancing the Usability of a Mobile Phone App in an Integrated Falls Risk Detection System for Use by Older Adult Users. JMIR Mhealth Uhealth 2017 May 30;5(5):e71 [FREE Full text] [CrossRef] [Medline]
    30. Rasche P, Mertens A, Brandl C, Liu S, Buecking B, Bliemel C, et al. Satisfying Product Features of a Fall Prevention Smartphone App and Potential Users' Willingness to Pay: Web-Based Survey Among Older Adults. JMIR Mhealth Uhealth 2018 Mar 27;6(3):e75 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    mHealth: mobile health
    SUS: Systematic Usability Scale
    TUG: Timed Up and Go


    Edited by G Eysenbach; submitted 12.07.18; peer-reviewed by P Rasche, C Parsey, B Chaudhry; comments to author 22.08.18; revised version received 21.09.18; accepted 14.10.18; published 20.11.18

    ©Katherine L Hsieh, Jason T Fanning, Wendy A Rogers, Tyler A Wood, Jacob J Sosnoff. Originally published in JMIR Aging (http://aging.jmir.org), 20.11.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Aging, is properly cited. The complete bibliographic information, a link to the original publication on http://aging.jmir.org, as well as this copyright and license information must be included.