Published on in Vol 5, No 4 (2022): Oct-Dec

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/39301, first published .
Older Wheelchair Users Recommend Age-Friendly Design Improvements to a Wheelchair Maintenance App: Mixed Methods Development Study

Older Wheelchair Users Recommend Age-Friendly Design Improvements to a Wheelchair Maintenance App: Mixed Methods Development Study

Older Wheelchair Users Recommend Age-Friendly Design Improvements to a Wheelchair Maintenance App: Mixed Methods Development Study

Original Paper

1Department of Rehabilitation Science and Technology, University of Pittsburgh, Pittsburgh, PA, United States

2Occupational Therapy Division, Ohio State University Wexner Medical Center, Columbus, OH, United States

Corresponding Author:

Anand Mhatre, PhD

Occupational Therapy Division

Ohio State University Wexner Medical Center

453 W 10th Ave

Columbus, OH, 43210

United States

Phone: 1 (614) 688 2081

Email: anand.mhatre@osumc.edu


Background: Wheelchair part failures have doubled over the past decade. Preventative wheelchair maintenance reduces wheelchair failures and prevents user consequences. We are developing a smartphone app called WheelTrak, which alerts users when maintenance is required, to encourage maintenance practices and compliance.

Objective: This mixed methods study aimed to develop a wheelchair maintenance app using broad stakeholder advice and investigate older adults’ interaction experience with the app and their perceived barriers to and facilitators of maintenance.

Methods: Interviews were conducted with stakeholders, including mobility device users, to generate needs statements and app specifications. The app was designed in 2 stages. Stage 1 involved the development of the app according to the specifications and evaluation of the app interface by lead users. Stage 2 included the revision of the app screens and manual functionality testing. Usability testing and semistructured interviews were conducted with older wheelchair and scooter users. The System Usability Scale was used to measure app usability.

Results: Interviews with power and manual wheelchair users (37/57, 65%), wheelchair service providers (15/57, 26%), manufacturers (2/57, 4%), seating and mobility researchers (1/57, 2%), and insurance plan providers (2/57, 4%) informed the needs and specifications of the app technology. The 2-stage development process delivered a fully functional app that met the design specifications. In total, 12 older adults (mean age 74.2, SD 9.1 years; n=10, 83% women; and n=2, 17% men) participated in the usability testing study. Of the 12 participants, 9 (75%) agreed to use WheelTrak for preventative maintenance. WheelTrak scored an average System Usability Scale score of 60.25 (SD 16). Four overarching themes were identified: WheelTrak app improvements, barriers to maintenance, consequences related to mobility device failure, and smart technology use and acceptance. Older adults preferred the simplicity, readability, personalization, and availability of educational resources in the app. Barriers to maintenance pertained to health issues and lack of maintenance knowledge among older adults. Facilitators of maintenance included notification for maintenance, app connectivity with the service provider, reporting of device failure, and the presence of a caregiver for maintenance.

Conclusions: This study highlighted age-friendly design improvements to the app, making it easy to be used and adopted by older wheelchair users. The WheelTrak app has close to average system usability. Additional usability testing will be conducted following app revision in the future.

JMIR Aging 2022;5(4):e39301

doi:10.2196/39301

Keywords



The Calamity of Wheelchair Failures

According to the World Health Organization, older adults will be using ≥2 assistive devices by 2030 to overcome barriers and experience full and equal participation in society [1]. Wheelchairs are assistive devices that serve as a primary means of mobility and independence for older adults and are linked to improved well-being and delayed need for long-term care. Unfortunately, although wheelchairs play a significant role in the lives of older adults and people with locomotor disabilities, they are known to break down frequently. Cross-sectional study findings over the past 2 decades show that approximately 45% to 88% of wheelchair users experience wheelchair part failures every 6 months owing to failures of wheelchair casters, rear wheels, brakes, frames, and seating systems [2-7]. Comparatively, in low- and middle-income countries, where rehabilitation services are scarce and outdoor environments are adverse, part failures occur every 2 to 3 months [8-13]. A high incidence of part failures among older wheelchair users was found in a study conducted in El Salvador [14,15]. Approximately 57% of the older adults have experienced part failures in the past 3 months of wheelchair use owing to high-risk failures of critical wheelchair parts such as casters and wheels. Approximately 75% to 95% of the older participants rated their wheelchairs as unsatisfactory and in unsafe working condition, which can contribute to part failure [14,15]. One-third of wheelchair breakdowns result in adverse events, including injuries, pain, depression, and hospitalization [2,4,6,12,13]. Overall, wheelchair part failures negatively affect the lives of older wheelchair users globally, thus increasing public health and personal burden.

Need for Wheelchair Maintenance

Community-based and secondary data analysis studies [7,16,17] and the World Health Organization’s guidelines [18] recommend preventative wheelchair maintenance to avoid failures that can lead to breakdowns, which make the wheelchair dysfunctional. A randomized controlled trial with 216 manual wheelchair users found that active checkups and maintenance in 12 months led to no wheelchair accidents in the treatment group [17]. The number of accidents in the control group remained the same. Despite this evidence, preventative maintenance is rarely conducted. This can be attributed to unfavorable health care policies; lack of user training, knowledge, and capability; and lack of tools for repair, among several other reasons. Researchers have developed resources such as training programs and maintenance checklists that include consensus-based, generic maintenance schedules for inspection and cleaning of wheelchair parts to support maintenance practices [17]. However, the checklists cannot monitor wheelchair use in the community and predict wheelchair failures to inform maintenance. In other industries, maintenance schedules are dependent on product use. For instance, in automobiles, the odometer indicates oil change based on the distance traveled by the vehicle [19]. In aircraft and heavy equipment industries, vibration-based condition monitoring systems are used to generate alerts for part replacement and preventative maintenance events and to prevent equipment damage and downtime [20,21]. Unfortunately, no such tools exist to monitor wheelchair use and wear down, determine the probability of high-risk failure, and alert users and wheelchair providers about maintenance and part replacement events.

Availability of New Technology

The widespread availability of low-cost activity monitoring tools, such as sensors and smartphones, offer an opportunity to track real-time wheelchair use characteristics and guide maintenance. Smartphones are widely available around the world. For instance, in low- and middle-income countries—approximately one-third of older individuals (aged >60 years) and people with disabilities have a smartphone, and that number continues to increase [22-24]. Therefore, we are developing a mobile health (mHealth) technology called WheelTrak to enable use-based maintenance practices for wheelchair users and stakeholders involved in wheelchair repair. The concept comprises a smartphone app connected via Bluetooth to a low-power sensor unit that attaches to the wheelchair and collects road shock data when the wheelchair is in motion. Shocks experienced over time will be benchmarked against a wheelchair wear index (WWI) that can predict the occurrence of critical wheelchair failure. When maintenance is required according to WWI, users can be notified through the WheelTrak smartphone app.

This paper describes the staged design process and usability testing of the WheelTrak smartphone app. The study aimed to evaluate the usability of the WheelTrak app for preventative maintenance and understand the barriers to and facilitators of maintenance, which can inform the future development of the technology. 


A systematic design procedure proposed by Ulrich and Eppinger [25] was used to gather raw data and develop needs statements for the WheelTrak maintenance technology. The design and testing process followed in this study is shown in Figure 1.

Figure 1. App design and testing process.
View this figure

Needs Identification

Multiple stakeholders in the wheelchair industry, who are associated with repairs and maintenance, including wheelchair users, were interviewed as a part of the technology transfer programs at the University of Pittsburgh. The interviews were conducted at a conference, in person at a wheelchair clinic, or via phone. Initial stakeholders were affiliated with the University of Pittsburgh’s Rehabilitation Science and Technology Continuing Education program. Then, stakeholders were recruited using the snowball sampling method or word of mouth at the conference or approached via social media platforms.

Customer discovery style interviews were conducted. Users were asked about their daily life activities and journey as a user of a mobility device. Likes and dislikes about the wheelchair and its use settings were collected. Instances where the user experienced inconveniences or consequences owing to wheelchair part failure or repair were discussed. Furthermore, users were probed regarding their understanding and awareness of preventative maintenance and related training. Opinions on wheelchair failures and repair services from wheelchair providers were collected. Users were asked about the features they would like to see in an mHealth preventative maintenance technology.

Wheelchair service providers were asked about their business operations and challenges, criteria for product selection and prescription, repair experiences of technicians, reimbursement versus costs, cascading effects of repairs on their operations, and experiences with clients and insurance. Providers were queried about the development and integration of new technology in their day-to-day repair-related operations. Wheelchair manufacturers and insurance plan providers were presented generic data on wheelchair part failures and asked to share their viewpoints on the existing state of affairs regarding repairs and maintenance. They were questioned about benefits of and risks with new maintenance-related technology and its integration into service. After each interview, the interviewee was asked for referrals for additional interviews. No identifiable information was collected during the interviews.

Raw data from interviewees were documented using handwritten notes, either by the author (AM) or 2 other researchers (refer to the Acknowledgments section). Notes included facts, insights, and quotes stated by the interviewees. Pain points for each stakeholder were extracted from the notes manually. These pain points were considered for generation of needs statements. For the providers, who articulated the needs well, direct quotes were converted into needs statements. Needs statements for the WheelTrak technology (app, sensor, and web-based platform) were generated by the author (AM) and a researcher (refer to the Acknowledgments section).

App Specification Development

On the basis of needs statements related to the maintenance app and benchmarking to existing health apps, functional requirements or specifications were generated for the WheelTrak app by authors (AM and FW) and another researcher (refer to the Acknowledgments section). These specifications focused on a low-fidelity version of the app or the minimum viable prototype for usability testing.

App Design—Stage 1

Using app specifications, screen wireframes were brainstormed by the author (AM) and other researchers (refer to the Acknowledgments section) and hand drawn subsequently. These screens were drafted in Adobe Illustrator (Adobe Inc) by a researcher and uploaded to a rapid prototyping platform. The platform established a sequence among the screens. Active, ultralight wheelchair users, who can be considered as lead users, tested the app prototype and provided suggestions.

App Design—Stage 2

Feedback from the users was implemented by revising the app screens in Adobe Illustrator. Then, the screens were migrated to Android Studio (Google). A low-fidelity WheelTrak app prototype was deployed on a smartphone for manually testing the appearance and functionality of app screens. Following several design iterations performed by the author (FW), the app screens and incorporated features addressed the app specifications.

Usability Testing

Ethics Approval

An institutional review board application (STUDY20100451) was reviewed and approved by the Human Research Protection Office committee at the University of Pittsburgh. Potential participants were contacted via phone, and a script approved by the institutional review board regarding study introduction was followed to seek verbal consent from interested older wheelchair users.

Participant Recruitment

Inclusion criteria for participants were as follows: (1) aged ≥60 years and (2) had a manual wheelchair, power wheelchair, or scooter. Participants were recruited through the University of Pittsburgh Pepper Center Registry. Semistructured interviews were conducted with older wheelchair and scooter users to perform usability testing with the WheelTrak app.

Usability Testing Procedure

Before the interview was conducted, recruitment, screening, interview availability, and location were determined. We conducted the interviews using a set of questions (Multimedia Appendix 1) for older adults based on early wheelchair user interaction experiences related to WheelTrak development. During the interviews, participants were asked about their experiences with wheelchair failure, repair and maintenance, barriers to and facilitators of maintenance, and technology use. The app designed in stage 2 was downloaded in an Android phone. The interviewer demonstrated selective WheelTrak screens and allowed the participant to use the app afterward. Participants were asked questions regarding their impressions about the app. They were probed regarding whether the app would fit into their lifestyle and how often they would use it. Open-ended questions on the use of app features—wheelchair use data, failure reporting, maintenance notification, and awards—were asked. Finally, participants completed the System Usability Scale (SUS), which is a self-report, validated instrument widely used to assess users’ satisfaction with use, internal beliefs, motivation, attitudes, and intentions toward technology [26].

Data Analysis

Interviews were audio recorded and then transcribed verbatim. Transcripts were deidentified. A systematic approach to qualitative thematic analysis was used to analyze interview data and identify and develop codes and themes using NVivo (version 12 Plus; QSR International). First, all interviews were read by a researcher (AB) to gain an overview of the content. Open, axial, and selective coding strategies were used, enabling the researchers to interact with, compare, and reduce the data constantly. These strategies create a dynamic and nonlinear process that enables themes to be identified, coded, and interpreted [27]. Open coding is the first level of coding used to identify common concepts and themes expressed through interviews [28]. These ideas were given a descriptive label or code. The second level of coding used was axial coding, which was used to further refine, align, combine, and categorize existing themes that share similar ideas [27]. Finally, selective coding (third level of coding) was used to condense categories identified during axial coding, to discover overarching and main themes from participant interviews [27]. Two researchers (AB and AM) collaborated and created the coded interview results.

To evaluate the usability of WheelTrak quantitatively, the average of SUS total scores of all participants was computed. An SUS score of 80 out of 100 indicates that users are impressed with the app and would recommend it to others. An SUS score of approximately 68 is an average usability rating that indicates scope for improvement, and a score <51 indicates lack of usability and need for improvement [26].


Needs Identification Results

Stakeholders listed in Table 1 were interviewed during the Randall Family Big Idea Competition (February 2019 to April 2019) and the School of Health and Rehabilitation Sciences Innovation Challenge (January 2020 to April 2020). Overall, stakeholders appreciated the development of preventative maintenance technology.

Table 1. Stakeholder feedback on wheelchair failures, repairs, and maintenance (N=57).
StakeholderParticipants, n (%)Pain pointsNotable quotesNeeds statements
Power and manual wheelchair users37 (65)
  • Failures degrade quality of life
  • Repairs and expensive bills from providers
  • Repair waiting times exceeding 6-7 months
  • Tired of waiting on phone to talk to someone and getting the runaround
  • Never received any wheelchair training
  • Small failures lead to big consequences
  • Need to keep track of wheelchair use
  • Users have to take wheelchair to the provider many times
  • Time off work is common
  • Maintenance is not performed despite training
  • “The app is totally needed even for smaller repairs on my own chair.”
  • “I could fix my own brakes instead of waiting for a provider.”
  • “You learn to become your own mechanic. It’s easier to do it (repairs) yourself.”
  • “Often the providers have ordered the wrong parts. I have to call providers to remind them to order parts.”
  • “If your chair breaks, you are out of the chair, it is frustrating.”
  • “Maintenance user manual is a piece of paper, nobody sees it.”
  • “Insurance won’t cover loose brakes which can cause falls or tips.”
  • WheelTrak sends maintenance alerts before device failure.
  • WheelTrak is user-friendly.
  • WheelTrak connects end user to the provider for reporting failures and scheduling repair.
  • WheelTrak allows user to order parts from vendors for small repairs.
  • WheelTrak displays wheelchair use data.
  • WheelTrak is available through a subscription service.
Wheelchair providers15 (26)
  • Financial losses from wheelchair repairs
  • “Repairs are the bane of our existence. This technology can make repairs easy.”
  • “Insurance does not look at long term savings.”
  • “...Seems like they (insurance) purposely drag their feet and stall these things.”
  • WheelTrak performs repair coordination and scheduling.
  • WheelTrak clubs repairs in a distant area and reduces technician trips.
Wheelchair manufacturer2 (4)
  • Loss of reputation
  • “We will find how our products are performing.”
  • WheelTrak acts as a wheelchair add-on technology.
Seating and mobility researcher1 (2)
  • No immediate consequence
  • “This will bring peace to the wheelchair sector; suppliers won’t have to go through the hassle of convincing the insurance through paperwork.”
  • WheelTrak can report health and mobility outcomes.
Insurance plan provider2 (4)
  • No consequence, but concerned about the risk to the patient population
  • “...We can more accurately measure causes for a failure, which is fantastic, and would help with claims justification.”
  • None reported.

App Specification Development

The app specifications were generated explicitly in this study for targeted use by wheelchair or mobility device users (Textbox 1).

App specifications for targeted use by wheelchair or mobility device users.
  • User account setup
    • The user should be able to register and log in to the app using an email or their Google or Facebook accounts.
    • The user should be able to retrieve and edit their information.
  • Communicate wheelchair use data
    • The app displays daily and weekly travel distance, speed, and impacts.
  • Wheelchair information
    • The app collects and displays data on wheelchair purchase, model, and manufacturer.
  • Wheelchair failure reporting
    • The app records wheelchair failure for communicating repair to the wheelchair provider.
  • Push notification
    • The app sends a notification when maintenance is required.
  • Health data collection
    • The app collects mobility outcomes data every 3 months using the validated Functional Mobility Assessment tool [29]. This feature was requested by the sponsors of the study. It was hypothesized that wheelchair condition is related to functional mobility outcomes and health.
  • Reward user
    • The user scores an award for attaining maintenance milestones.
  • Platform and device
    • The app can be used on Android phone and tablet.
  • Data storage platform
    • The app uses Firebase (Google).
  • Connectivity
    • The app uses Bluetooth Low Energy 4.0.
Textbox 1. App specifications for targeted use by wheelchair or mobility device users.

Stage 1 App Design Results

Dummy prototype screens based on specifications and brainstormed wireframes were deployed on Marvel app display engine (Figure 2). In total, 5% (2/37) of the adult wheelchair users navigated through the sequence of screens and were excited at the prospect of having a wheelchair maintenance app for reminders. Both users liked the color contrast, layout, and app features. A user requested for increment in text size and optimization of the display on use factors such as distance, speed, and impacts. Another user requested the inclusion of a parts store, which was beyond the scope of this study.

Figure 2. WheelTrak app account setup (A), wheelchair information (B), main screen (C), and maintenance notification (D).
View this figure

Stage 2 App Design Results

Apple Health and Fitbit were installed in the phone, and essential health app features, including data display and user account management, were reviewed [30,31]. The feedback from stage 1 and other app reviews informed the development of next version of the screens. The revised screens (Figure 3) were built and deployed on an Android smartphone for iterative specification testing. The app screens and features met the design specifications. The WheelTrak app’s main screen displays wheelchair use data. The records tab at the bottom left of the main screen shows daily and weekly use. Wheelchair information collection, failure reporting, health data collection, and scoring of awards are displayed on separate app screens and can be navigated through icons at the bottom of the main screen. User account set up and sensor connection is performed when the user logs in for the first time. Data retrieval from and deposition on the cloud occurs in the background. No glitches or crashes were encountered in the app version used for usability testing.

Figure 3. WheelTrak login screen (A), main screen (B), maintenance notification (C), and failure report screen (D).
View this figure

Usability Testing Results

In total, 12 older adult wheelchair and scooter users participated in usability testing. Overall, 25% (3/12) of the interviews were conducted via phone and Zoom Meetings (Zoom Video Communications), a web-based meeting platform [32]. The remaining interviews (9/12, 75%) were conducted at the participants’ residence or at the University of Pittsburgh’s Department of Rehabilitation Science and Technology Design Studio. Table 2 presents the demographic characteristics of the participants. Interview themes were classified as shown in Table 3.

Table 2. Demographic and wheelchair use characteristics of participants (n=12).
CharacteristicsParticipants
Age (years), mean (SD)74.2 (9.1)
Gender, n (%)

Women10 (83)

Men2 (17)
Type of residence, n (%)

House5 (42)

Apartment7 (58)
Living arrangement, n (%)

Live alone without assistance2 (17)

Live alone with assistance6 (50)

Live with a family member for assistance4 (33)
Mobility devices, n (%)

Manual wheelchair4 (33)

Electric wheelchair4 (33)

Manual and electric wheelchairs1 (8)

Manual wheelchair and walker1 (8)

Scooter2 (17)
Stated liking the mobility device, n (%)12 (100)
Disliked aspects about wheelchair or scooter, n (%)

Difficulty in avoiding bumping into objects when driving backward1 (8)

Going over thresholds2 (17)

Decreased battery power1 (8)

Wheelchair is uncomfortable owing to spasticity in lower extremities1 (8)

Lack of portability1 (8)
Indoor mobility device activities, n (%)

All indoor activities4 (33)

Some indoor activities (eg, mobility around apartment, house, or job; eating; transfers; mopping floors; and assisting with carrying things from kitchen to dining room)8 (67)
Outdoor mobility device activities, n (%)

All outdoor activities, using vehicle for transportation3 (25)

Activities without vehicle, using own wheelchair8 (67)

Activities just outside the house (eg, sit on the porch)1 (8)
Table 3. Interview themes (n=12).
Themes and categoriesParticipants, n (%)
WheelTrak app improvement

Improve readability


Increase text size6 (50)


Increase icon size3 (25)


Change pie graph colors8 (67)

Prioritize simplicity


Simplify4 (33)


Make graphs and charts easy to understand8 (67)


The awards screen of the app is unnecessary for older adults11 (92)

Include personalization


Use a phone to contact the provider for maintenance, instead of connecting via WheelTrak4 (33)


Send the maintenance notification to the provider through WheelTrak8 (67)


Maintain privacy regarding maintenance events9 (75)

Education


Provision of manual, guide, or video for maintenance6 (50)
Barriers to maintenance

Lack of maintenance training11 (92)

Low confidence in conducting maintenance5 (42)

Lack of ability to conduct maintenance owing to health issues8 (67)
Consequences related to mobility device failure

Reported failures and repairs10 (83)

Reported consequences after failures6 (50)

Repairs by providers were not timely3 (25)
Smart technology use and acceptance

Use of smartphone or tablet9 (75)

Stated that they will use WheelTrak app9 (75)


Only when they remember1 (8)


Once a day1 (8)


Once a week1 (8)


If they had a bumpy ride or travel1 (8)


When they received a maintenance notification1 (8)


Everyday4 (33)

Comments and Additional Findings on WheelTrak App Improvement

Comprehension of the information displayed on the app screens varied across participants and depended on their health conditions and technology use experiences:

I’ve had a cataract operation, so it’s hard to read.
[Participant 5]
The text size is too condensed it would be more beneficial to have a font that everyone can read.
[Participant 4]

In addition, 67% (8/12) of the participants reported difficulty in reading the chart, especially the pie graph owing to the similarity in colors. The size of icons at the base of the main WheelTrak screen created complications in navigating through various app screens. Participant 3 does not have a smartphone, so it was difficult for them to touch the icons and input information. Participant 10 and participant 6 experienced seizures and difficulty in touching the icons.

Simplification of the app was noted as a priority by 33% (4/12) of the participants:

...If you want old people to use the app then you have to make it simpler.
[Participant 3]

The 33% (4/12) of the participants indicated improvements to the information and graphical elements on the main screen.

WheelTrak app screens for failure reporting, wheelchair information collection, and notifications were considered to be the most important by the participants. Convenience was a common feature among these pages owing to access to provider information. One-third of the participants (4/12, 33%) valued the connection with a wheelchair provider for maintenance and repair purposes. Half of the study participants (6/12, 50%) liked the functionality of reporting wheelchair failures using the app. By contrast, most participants (11/12, 92%) reported the awards page to be unnecessary and noted that they would not be motivated by it. Overall, 50% (6/12) of the participants indicated that it would be helpful to have a manual, guide, or training video for learning wheelchair parts, app functions, and maintenance tasks.

When asked how participants would like to be notified about maintenance, phone call, SMS text message, or email were the preferred choices. Overall, 75% (9/12) of the participants preferred privacy regarding maintenance notification. They feared that if their children or spouses were notified of maintenance, it will increase their care burden.

Comments on Barriers to Maintenance

In total, 92% (11/12) of the participants in the study were not trained in mobility device maintenance. A collective lack of maintenance knowledge and confidence was observed:

You don’t want to mess anything up and just like me, I don’t know how to really do the parts, so I would have to learn about it first.
[Participant 6]

Additional barriers noted were health issues, including vision problems and lack of strength and dexterity in the hands, making manipulating objects difficult. Of the 12 participants, 3 (25%) stated that they would ask someone to do maintenance. Approximately one-third of the study participants (4/12, 33%) conducted maintenance activities including fixing armrests, inflating tires, and replacing scooter spark plug. Participant 11 received training from a wheelchair maintenance program and conducted maintenance with assistance from their spouse.

Comments on Consequences Related to Mobility Device Failure

Overall, 83% (10/12) of the participants reported wheelchair repairs and failures before the study. Brakes, wheels, and tires incurred the most failures. These parts were replaced during repair. Other failures were found with armrests, battery connections, grip handles, back support, front struts, and cushions. In total, 50% (6/12) of the participants reported consequences associated with these failures. Participant 3 and participant 10 stated that they are aware that their brakes are not secure and may slip, causing them to be more cautious and fearful when standing up. The scooter of participant 2 broke down on a transportation bus and they could not perform their daily life activities afterward. Overall, 17% (2/12) of the participants reported receiving a loaner chair that they did not like, thus causing frustration. Most repairs were completed by wheelchair service providers or the Veteran Affairs. They were timely, except for 25% (3/12) of the participants. Participant 6 stated that their repair took a week, whereas participant 7 stated that it took 2 months. Participant 11 experienced a front caster fracture failure during regular use and stated that their wheelchair has not been repaired yet. Overall, >4 months have elapsed, and the participant still uses a loaner chair.

Comments on Smart Technology Use and Acceptance

More than half of the older wheelchair user participants (9/12, 75%) used smart technology, that is, smartphones and tablets. Participants expressed proficiency in using their flip phones, home phones, or smartphones. All participants (12/12, 100%) indicated that they keep their phones on them or close to them. These places include their bag, wheelchair pocket, pants pocket, rollator basket, and kitchen or bedroom. Overall, 17% (2/12) of the participants indicated that they kept their phones on them to report falls. Regarding usability, the most significant barrier noted was remembering to charge the devices. Almost all participants (11/12, 92%) noted that they charge their phone daily or when it alerts them about low battery. The participants disliked short charging cords or plugging the charging cable into the wall socket.

Additional Feedback on WheelTrak Technology

All study participants (12/12, 100%) recognized the importance of routine maintenance for wheelchairs during the interviews. In total, 75% (9/12) of the participants appreciated WheelTrak’s development and wanted to use the technology (app and sensor). Of the 12 participants, 3 (25%) participants (participant 6, participant 8, and participant 11) did not favor using the maintenance technology. Participant 6 reported that her wheelchair has electronics that track daily distance and speed:

I know my chair pretty well when something is going to break, so I don’t need the app.
[Participant 6]

Participant 8 and participant 11 reported that they would not use the app because they are inactive. Participant 6 and participant 8 experienced wheelchair failures and subsequent consequences before the study.

Quantifying WheelTrak Usability

The average SUS score was 60.25 (SD 16). Figure 4 shows the average score for each SUS item. As far as individual scores are concerned, participant 6 had the highest SUS score of 90 but stated that they would not use WheelTrak. They expressed that the app was designed well and easy to use. Participant 1 had the lowest SUS score of 35; they were unfamiliar with using a smartphone and experienced extreme difficulty in using the WheelTrak app.

Figure 4. Mean scores for individual SUS items.
View this figure

Principal Findings

Our study demonstrates that older adults using wheelchairs favor the use of the WheelTrak smartphone app for conducting preventative maintenance and suggests age-friendly modifications to improve the usability of the app.

Preventative maintenance reduces the frequency of wheelchair failures and breakdowns, thus preventing adverse health consequences to older users [7,16,17]. To encourage maintenance practices and compliance, we are leveraging the existing capabilities of smartphones and sensors and developing an mHealth app called WheelTrak. A systematic design process used to gather technology design requirements revealed multiple development areas for maintenance technology, including the app, from the perspective of diverse stakeholders. This study specifically aimed to evaluate the usability of and barriers to the WheelTrak smartphone app with the older subset of the target user population. All the older wheelchair and scooter user participants in the study (12/12, 100%) recognized the importance of conducting maintenance, and 75% (9/12) of them expressed interest in using WheelTrak for maintenance purposes. This demonstrates that although some older adults did not use smartphones or tablets, they still perceived WheelTrak positively. In addition, participants rated the WheelTrak app for close to average usability, according to the SUS score. They recommended design improvements to make WheelTrak more inclusive for use and adoption by the older population.

Facilitators for app-based preventative maintenance included smart technology use, relevant app features, and interest in conducting maintenance with support from family member. Overall, 75% (9/12) of the participants used smart technology, which is slightly more than the statistics reported by the Pew Research Center [33]. Most smart technology users (9/12, 75%) were interested in using the WheelTrak app for maintenance. Specifically, the features such as maintenance reminders, failure reporting using photos of failure, and ability to connect with the provider were much appreciated. This outcome indicates that the WheelTrak technology provides convenience and relief from pain points on failures and scheduling repairs, as listed in Table 1. These pain points have plagued the wheelchair user community for decades. Users were motivated to leverage the existing resources and family member or caregiver support for conducting maintenance. Aligning with the notable quotes listed in Table 1, users are interested in conducting small repairs, which can avert the occurrence of major failure-related consequences.

As measured by the SUS instrument, the usability of the WheelTrak app exhibits significant variability across the SUS items, as seen in Figure 4. Key reasons for such variability can be attributed to familiarity with and challenges in using digital technology, confidence in device maintenance, usability issues with the current WheelTrak app version, and existing bias toward mobility device capabilities, as found during the study. These reasons may be characteristic of the older population of wheelchair users. These app usability findings prompt the development of a new app version for older adults, based on feedback collected in this study.

The WheelTrak app has close to average usability rating (SUS score=60.5), as the app features are yet to be tailored to the capabilities of older adults. When app screens were demonstrated to older users, comprehension of wheelchair use information through animated line graphs was difficult. Challenges were encountered with navigation through different screens. Although all the participants (12/12, 100%) conceded the importance of maintenance, most of them (8/12, 67%) experienced health limitations to perform general maintenance. Such limitations are commonly noted as barriers in mHealth literature about older adults. Limited physical ability, cognition, perception, and motivation have been cited as barriers to using mHealth technologies [34]. In addition, as highlighted in a previous app review study [35], the variations in capabilities of our study cohort showed that one size does not fit all; hence, we need to tailor the app to different older adult personas. We plan to address the barriers found during usability testing and accommodate the recommendations suggested by the older adults.

Older adults recommended simplicity in visualization and information communication. Accordingly, we plan to develop new specifications for text and icon size. The amount of information on each page shall be reduced and displayed in text format for easy comprehension. We may use paper prototyping and testing to develop such specifications and test new app workflows. Use graphs, color fading, and animations can be removed completely. Similarly, the awards and records screens are not appealing to the older adults and can be removed. The valuable feedback collected in this study on app design improvements—optimal typography, color contrast, icon size, and information personalization—can apply to other apps developed for the older population of wheelchair users.

Personalization of app features is highly valued by older adults. The users want to exercise control over app communication. Privacy of use and maintenance data and communication of maintenance events via phone or app will be based on user selection. These options could be selected during the installation of the app, with support from a technical person who may be a family member, caregiver, assistive technology professional, or wheelchair provider technician.

All except 1 participant (11/12, 92%) were unaware of maintenance training and lacked technical knowledge about wheelchairs. This finding was synonymous with the user feedback collected during needs assessment. Although barriers to training availability exist, half of the study participants (6/12, 50%) expressed willingness to educate themselves about maintenance through videos, manuals, and resources in the app. The WheelTrak app can incorporate such training materials to increase maintenance knowledge, familiarize users with WheelTrak app–enabled maintenance, and assist users in taking charge of maintenance. Furthermore, we anticipate the integration of WheelTrak technology in the in-person and remote wheelchair maintenance training programs to augment maintenance training capabilities and outcomes [36]. With increasing smartphone adoption among older adults and people with disabilities, a low-cost tool such as WheelTrak can assist in scaling maintenance training and enable great compliance.

Most participants (8/12, 67%) expected WheelTrak to alert providers about upcoming maintenance events. This motivates us to explore the development of WheelTrak for the wheelchair provider group. Providers incur wheelchair repair losses, a finding from provider feedback during needs assessment and a cross-sectional study that surveyed >125 providers [37]. According to the provider’s feedback obtained during the app design phase, these losses can be prevented if WheelTrak can streamline and schedule upcoming repairs. Accordingly, web-based platform development can be investigated in the future for providers.

Participants’ experiences with wheelchair failures and repairs are similar to those reported in the literature [3-5] and needs assessment phase. These events result in long time without the wheelchair and severely limited mobility, as repair wait times stretch beyond months, which means spending more time in bed [3]. It is not surprising that wheelchair failures are associated with pressure injuries and rehospitalization [6]. Consequences include time off work, numerous calls and trips to the provider, and expensive repair bills if insurance does not cover repair. In addition, older users’ frustrations with loaner wheelchairs were documented in this study.

A trained participant (participant 11) who conducts maintenance experienced a high-risk failure during regular wheelchair use. These findings support the development of WheelTrak technology for monitoring wheelchair condition and informing users about upcoming high-risk failures and maintenance events. WheelTrak plans to predict failures, especially those related to wheels and brakes. These parts need to be replaced to avoid risks related to tips and falling out of the wheelchair, which can cause injury to the user.

The barriers and consequences realized in this study and recent studies on repair experiences of wheelchair providers demonstrate that it is crucial to address the repair-related needs of mobility device users and providers. Furthermore, as WheelTrak develops, health care policies must enact provisions and support preventative maintenance practices. Reimbursements for service and maintenance activities can be allowed with justification provided by ground truth data collected by WheelTrak.

Limitations

First, the design phase cast a wide net for gathering WheelTrak app requirements, but the usability test was conducted only with older adults, a subset of the intended WheelTrak user population. This may have affected the SUS usability score. Second, the usability testing study concentrated on app navigation and interaction and was limited to specific app screens that older participants would use. For instance, user account setup, sensor connectivity via Bluetooth, cloud connectivity, and health information collection using the Functional Mobility Assessment tool are features available in the app. These features will be tested in future studies with other user cohorts. Finally, we aimed to limit potential bias in soliciting positive feedback for WheelTrak. For this purpose, AB was initially recruited to conduct interviews.

Future Studies

We plan to develop an age-friendly version of the app based on study results and conduct focus group testing. In addition to SUS, we plan to include other validated tools to understand users’ cognitive load while performing tasks in the app. As part of ongoing studies, the app’s current version will be tested with other mobility-assistive device users (aged 60 years) to identify their perceptions and usability of WheelTrak. WheelTrak development will include other modes of informing participants about maintenance such as SMS text messages, email, and phone calls, in addition to app notifications. Along with app development, we are conducting field studies to monitor wheelchair use and develop a WWI-based preventative maintenance model.

Conclusions

The WheelTrak preventative maintenance app has been identified as a tool that older adults can use for maintenance notifications and reporting wheelchair failures to providers. Despite challenges in using smart technology, older adults expressed interest in educating themselves about maintenance and conducting WheelTrak-led maintenance with caregiver or provider support. The WheelTrak app has close to average usability for older adults with disabilities. Findings from the study informed the research team about improvements to the app, making it easy to be used and adopted by wheelchair users across their life span.

Acknowledgments

This study was supported by the National Institute on Aging (R03 #AG069836) through the National Academy of Medicine Healthy Longevity Challenge and the Year of Pitt Global funding from the University of Pittsburgh. The authors would like to sincerely thank the stakeholders and study participants for their time and contribution to this study. In addition, the authors thank Aaron Anderson for his contribution to initial needs, specification development, and app screen design in stage 1 and earlier. The authors wish to thank Jake Meadows and Adam Cunningham for taking handwritten notes, brainstorming stakeholder interview questions, and developing the app. The authors thank Brian Robinson, Vineeth Poojary, and Surya Sankaralingam for participating in the technology transfer programs and for their assistance with the project. The authors are grateful to the Pepper Center Registry administrators at the University of Pittsburgh for providing access to the registry and for recruitment.

Data Availability

The data sets generated and analyzed during this study are available from the corresponding author upon reasonable request.

Authors' Contributions

AM led the study and manuscript writing while at the University of Pittsburgh’s Department of Rehabilitation Science and Technology and transitioned to The Ohio State University’s Division of Occupational Therapy during the review and editing process.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Interview guide.

DOCX File , 21 KB

  1. Assistive technology. World Health Organization. 2018 May 18.   URL: https://www.who.int/news-room/fact-sheets/detail/assistive-technology [accessed 2020-01-26]
  2. Gaal RP, Rebholtz N, Hotchkiss RD, Pfaelzer PF. Wheelchair rider injuries: causes and consequences for wheelchair design and selection. J Rehabil Res Dev 1997 Jan;34(1):58-71. [Medline]
  3. Toro ML, Worobey L, Boninger ML, Cooper RA, Pearlman J. Type and frequency of reported wheelchair repairs and related adverse consequences among people with spinal cord injury. Arch Phys Med Rehabil 2016 Oct;97(10):1753-1760. [CrossRef] [Medline]
  4. Henderson GV, Boninger ML, Dicianno BE, Worobey LA. Type and frequency of wheelchair repairs and resulting adverse consequences among veteran wheelchair users. Disabil Rehabil Assist Technol 2022 Apr;17(3):331-337. [CrossRef] [Medline]
  5. Worobey L, Oyster M, Pearlman J, Gebrosky B, Boninger ML. Differences between manufacturers in reported power wheelchair repairs and adverse consequences among people with spinal cord injury. Arch Phys Med Rehabil 2014 Apr;95(4):597-603. [CrossRef] [Medline]
  6. Hogaboom NS, Worobey LA, Houlihan BV, Heinemann AW, Boninger ML. Wheelchair breakdowns are associated with pain, pressure injuries, rehospitalization, and self-perceived health in full-time wheelchair users with spinal cord injury. Arch Phys Med Rehabil 2018 Oct;99(10):1949-1956. [CrossRef] [Medline]
  7. Mhatre A, Pearlman J, Schmeler M, Krider B, Fried J. Community-based wheelchair caster failures call for improvements in quality and increased frequency of preventative maintenance. Spinal Cord 2022 Jan;60(1):58-62 [FREE Full text] [CrossRef] [Medline]
  8. Rispin K, Riseling K, Wee J. A longitudinal study assessing the maintenance condition of cadres of four types of wheelchairs provided in low-resource areas. Disabil Rehabil Assist Technol 2018 Feb;13(2):146-156. [CrossRef] [Medline]
  9. Reese N, Rispin K. Assessing wheelchair breakdowns in Kenya to inform wheelchair test standards for low-resource settings. In: Proceedings of the 2015 RESNA Annual Conference. 2015 Presented at: RESNA '15; June 10-14, 2015; Denver, CO, USA.
  10. Toro ML, Garcia Y, Ojeda AM, Dausey DJ, Pearlman J. Quantitative exploratory evaluation of the frequency, causes and consequences of rehabilitation wheelchair breakdowns delivered at a paediatric clinic in Mexico. Disabil CBR Incl Dev 2012 Dec 05;23(3):48-64. [CrossRef]
  11. Saha S. Outcomes of assistive technology in Indian population with locomotor disability. Manipal University. 2013.   URL: https://shodhganga.inflibnet.ac.in/handle/10603/44846?mode=full [accessed 2020-01-26]
  12. Saha R, Dey A, Hatoj M, Podder S. Study of wheelchair operations in rural areas covered under the District Rehabilitation Centre (DRC) scheme. Indian J Disabil Rehabil 1990 Jul:57-87.
  13. Mukherjee G, Samanta A. Wheelchair charity: a useless benevolence in community-based rehabilitation. Disabil Rehabil 2005 May 20;27(10):591-596. [CrossRef] [Medline]
  14. Pearlman J, D'Innocenzo M, Garcia-Mendez Y, Rosen P, Rodriguez V. Wheelchair user's voice: evaluation of appropriate wheelchair provision in El Salvador. In: Proceedings of the 2020 RESNA Annual Conference. 2020 Presented at: RESNA '20; September 23-24, 2020; Virtual.
  15. Garcia Y, Pearlman J, Rosen P. The wheelchair user’s voice: preliminary results related to unmet need for assistive technology in Indonesia and El Salvador. World Health Organization Global Perspective on Assistive Technology. 2019.   URL: https:/​/momentum4humanity.​org/​wp-content/​uploads/​2021/​04/​UCPW_The-wheelchair-users-voice_-Preliminary-results-related-to-​unmet-need-for-assistive-technology-in-Indonesia-and-El-Salvador.​pdf [accessed 2021-08-15]
  16. Chen WY, Jang Y, Wang JD, Huang WN, Chang CC, Mao HF, et al. Wheelchair-related accidents: relationship with wheelchair-using behavior in active community wheelchair users. Arch Phys Med Rehabil 2011 Jun;92(6):892-898. [CrossRef] [Medline]
  17. Hansen R, Tresse S, Gunnarsson RK. Fewer accidents and better maintenance with active wheelchair check-ups: a randomized controlled clinical trial. Clin Rehabil 2004 Sep;18(6):631-639. [CrossRef] [Medline]
  18. Borg J, Khasnabis C. Guidelines on the provision of manual wheelchairs in less resourced settings. World Health Organization. 2008 May 13.   URL: https://www.who.int/publications/i/item/9789241547482 [accessed 2021-10-22]
  19. Schwartz SE, Smolenski DJ. Development of an automatic engine oil-change indicator system. SAE Trans 1987;96(7):62-78 [FREE Full text] [CrossRef]
  20. Carden EP, Fanning P. Vibration based condition monitoring: a review. Struct Health Monitor 2004 Dec;3(4):355-377. [CrossRef]
  21. Shagluf A, Longstaff A, Fletcher S. Maintenance strategies to reduce downtime due to machine positional errors. In: Proceedings of Maintenance Performance Measurement and Management Conference. 2014 Presented at: MPMM '14; September 4-5, 2014; Coimbra, Portugal p. 111-118. [CrossRef]
  22. Barbareschi G, Aranda Jan C, Nique M, Barajas R, Holloway C. Mobile phones as assistive technologies: gaps and opportunities. University College London. Geneva, Switzerland: World Health Organization; 2019.   URL: https:/​/discovery.​ucl.ac.uk/​id/​eprint/​10084648/​1/​Mobile-Phones-as-Assistive-Technologies-Gaps-and-Opportunities.​pdf [accessed 2020-01-26]
  23. Silver L. Smartphone ownership is growing rapidly around the world, but not always equally. Pew Research Center. 2019 Feb 6.   URL: https:/​/www.​pewresearch.org/​global/​2019/​02/​05/​smartphone-ownership-is-growing-rapidly-around-the-​world-but-not-always-equally/​ [accessed 2020-01-26]
  24. Aranda-Jan C, Boutard A. The mobile disability gap: how do persons with disabilities access and use mobile in Kenya and Bangladesh? GSMA. 2019 Dec 3.   URL: https:/​/www.​gsma.com/​mobilefordevelopment/​programme/​assistive-tech/​the-mobile-disability-gap-how-do-persons-with-disabilities-access-and-use-mobile-in-kenya-and-bangladesh/​ [accessed 2020-01-26]
  25. Ulrich KT, Eppinger SD. Product Design and Development. 5th edition. Boston, MA, USA: McGraw-Hill Higher Education; 2011.
  26. Brooke J. SUS: a 'quick and dirty' usability scale. In: Jordan PW, thomas B, McClelland IL, Weerdmeester B, editors. Usability Evaluation in Industry. London, UK: CRC Press; 1996:189-194.
  27. Williams M, Moser T. The art of coding and thematic exploration in qualitative research. Int Manag Rev 2019;15(1):45-55.
  28. Herlache-Pretzer E, Winkle MY, Csatari R, Kolanowski A, Londry A, Dawson R. The impact of service dogs on engagement in occupation among females with mobility impairments: a qualitative descriptive study. Int J Environ Res Public Health 2017 Jun 16;14(6):649 [FREE Full text] [CrossRef] [Medline]
  29. Kumar A, Schmeler MR, Karmarkar AM, Collins DM, Cooper R, Cooper RA, et al. Test-retest reliability of the functional mobility assessment (FMA): a pilot study. Disabil Rehabil Assist Technol 2013 May;8(3):213-219. [CrossRef] [Medline]
  30. The Health app. With a healthy dose of updates. Apple. 2022.   URL: https://www.apple.com/ios/health/ [accessed 2022-04-16]
  31. Fitbit App. The fitness app for everyone. Fitbit. 2022.   URL: https://www.fitbit.com/gb/app [accessed 2022-04-16]
  32. About Us. Zoom.   URL: https://explore.zoom.us/en/about/?_ga=2.183338918.1266762592.1650160778-1536767917.1643990643 [accessed 2022-04-16]
  33. Faverio M. Share of those 65 and older who are tech users has grown in the past decade. Pew Research Center. 2022 Jan 13.   URL: https:/​/www.​pewresearch.org/​fact-tank/​2022/​01/​13/​share-of-those-65-and-older-who-are-tech-users-has-​grown-in-the-past-decade/​ [accessed 2022-09-21]
  34. Wildenbos GA, Peute L, Jaspers M. Aging barriers influencing mobile health usability for older adults: a literature based framework (MOLD-US). Int J Med Inform 2018 Jun;114:66-75. [CrossRef] [Medline]
  35. McGarrigle L, Todd C. Promotion of physical activity in older people using mHealth and eHealth technologies: rapid review of reviews. J Med Internet Res 2020 Dec 29;22(12):e22201 [FREE Full text] [CrossRef] [Medline]
  36. Toro ML, Bird E, Oyster M, Worobey L, Lain M, Bucior S, et al. Development of a wheelchair maintenance training programme and questionnaire for clinicians and wheelchair users. Disabil Rehabil Assist Technol 2017 Nov;12(8):843-851. [CrossRef] [Medline]
  37. Ruffing JJ, Schmeler MR, Schein RM, Mhatre A. A cross-sectional descriptive analysis of complex rehabilitation technology (CRT) supplier opinions on the current state of wheelchair repair services. Disabil Rehabil Assist Technol (forthcoming) 2022 Sep 12:1-6 [FREE Full text] [CrossRef] [Medline]


mHealth: mobile health
SUS: System Usability Scale
WWI: wheelchair wear index


Edited by T Leung; submitted 05.05.22; peer-reviewed by RL Kirby, B Chaudhry; comments to author 11.07.22; revised version received 27.08.22; accepted 29.08.22; published 18.10.22

Copyright

©Alyssa Boccardi, Fangzheng Wu, Jon Pearlman, Anand Mhatre. Originally published in JMIR Aging (https://aging.jmir.org), 18.10.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Aging, is properly cited. The complete bibliographic information, a link to the original publication on https://aging.jmir.org, as well as this copyright and license information must be included.