This paper is in the following e-collection/theme issue:

Internet Access and Digital Technology Use in an Elderly Population (180) Research Instruments, Questionnaires, and Tools (545) Human Factors and Usability Case Studies (748) Aging in Place (231) Prevention and Health Promotion (899) Web-based and Mobile Health Interventions (3128) Assisted Living for the Elderly and Nursing Home Care (147)

Published on in Vol 6 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/49500, first published .
A Digital Tool for the Self-Assessment of Homes to Increase Age-Friendliness: Validity Study

A Digital Tool for the Self-Assessment of Homes to Increase Age-Friendliness: Validity Study

A Digital Tool for the Self-Assessment of Homes to Increase Age-Friendliness: Validity Study

Authors of this article:

Roslyn Aclan1 Author Orcid Image ;   Stacey George2 Author Orcid Image ;   Kate Laver1 Author Orcid Image
Article Authors Cited by Tweetations (6) Metrics

    Original Paper

    1College of Medicine and Public Health, Flinders University of South Australia, Adelaide, Australia

    2Caring Futures Institute, College of Nursing and Health Sciences, Flinders University of South Australia, Adelaide, Australia

    Corresponding Author:

    Roslyn Aclan, BHth, MOT

    College of Medicine and Public Health

    Flinders University of South Australia

    Flinders Drive, Bedford Park

    Adelaide, 5001

    Australia

    Phone: 61 0425730839

    Email: roslyn.dalistan@flinders.edu.au


    Background: Age-friendly environments in homes and communities play an important role in optimizing the health and well-being of society. Older people have strong preferences for remaining at home as they age. Home environment assessment tools that enable older people to assess their homes and prepare for aging in place may be beneficial.

    Objective: This study aims to establish the validity of a digital self-assessment tool by assessing it against the current gold standard, an occupational therapy home assessment.

    Methods: A cohort of adults aged ≥60 years living in metropolitan Adelaide, South Australia, Australia, assessed their homes using a digital self-assessment tool with 89 questions simultaneously with an occupational therapist. Adults who were living within their homes and did not have significant levels of disabilities were recruited. Cohen κ and Gwet AC1 were used to assess validity.

    Results: A total of 61 participants (age: mean 71.2, SD 7.03 years) self-assessed their own homes using the digital self-assessment tool. The overall levels of agreement were high, supporting the validity of the tool in identifying potential hazards. Lower levels of agreement were found in the following domains: steps (77% agreement, Gwet AC1=0.56), toilets (56% agreement, κ=0.10), bathrooms (64% agreement, κ=0.46), and backyards (55% agreement, κ=0.24).

    Conclusions: Older people were able to self-assess their homes using a digital self-assessment tool. Digital health tools enable older people to start thinking about their future housing needs. Innovative tools that can identify problems and generate solutions may improve the age-friendliness of the home environment.

    JMIR Aging 2023;6:e49500

    doi:10.2196/49500

    Keywords

    age-friendliness; aging; home environment; self-assessment; digital; tool 


    Background

    Worldwide, people are living longer because of increased life expectancy and declining fertility rates [1]. Recent data show that the number of older people aged >60 years will increase from 1 billion in 2020 to 1.4 billion in 2030 [2]. By 2050, the number of older people aged ≥60 years will double, reaching 2.1 billion [2]. Aging leads to changes in intrinsic capacity (eg, physical and cognitive abilities) and functional ability. In turn, the environment in which the person lives may require adaptation. Over time, the home environment must be able to support a decline in both intrinsic capacity and functional ability [3].

    The establishment of age-friendly environments in homes and communities will play an important role in optimizing the health and well-being of society [4]. Most people want to remain in their own homes as they age [5,6]. A survey of >10,000 Australians found that 80% of older people wanted to remain in their current homes [7]. Approximately 20% of older people preferred to live in long-term facilities [7]. In Canada, a population-wide survey of people aged 65 years found that >70% had not moved in the past 5 years [8,9]. In Hong Kong, research has found a strong preference among older people to stay at their homes, with family members, or in places that are familiar with their living environment [10]. Aging in place refers to the ability to remain at home for as long as possible, despite a decline in functional ability [11]. Supporting adults to age in place requires consideration of the house as not only a building but also a home [11]. Older people feel strongly connected with their homes and communities, as they provide security, comfort, and a place for self-reflection [5]. Homes are also considered a place to cherish memories and maintain a sense of belonging, which prevents loneliness [12,13]. The ability to age in place depends on the appropriateness of the home, the potential to make alterations to the home, cost and availability of suitable housing alternatives, and formal supports [14].

    Occupational therapists often conduct home environment assessments and recommend modifications to improve safety and function in older people and reduce the risk of falls [15]. Examples of home modifications are the installation of grab rails in the shower, decluttering of overcrowded bedrooms, and installation of threshold ramps to eliminate trip hazards within the home [16]. Despite the proven benefits of home environment assessments, access is limited, particularly in rural areas, and assessments are usually available only after injury or illness [17-19]. Home environment assessments can take considerable time, averaging 80 minutes per home assessment [20]. Older adults have identified the potential benefits of adaptations and modifications earlier in the course of aging [21] and are receptive to more education about actions that can be taken to support aging in place [22].

    To date, most home environment assessment tools have been developed for administration by occupational therapists [23]. Furthermore, most tools have been developed for use with older people with impaired functional ability, rather than those who are considering future needs to support aging in place [23]. A recent review of home accessibility assessment tools identified 7 home accessibility assessment tools that were considered promising; however, none of the tools had strong evidence supporting reliability and validity [24]. In recent years, home self-assessment tools have emerged. Ziebart et al [25] described the development of a self-assessment checklist that could be used by older adults to assess fall risks in the house [25]. The Home Safety Self-Assessment is another tool that includes a self-assessment checklist and has been shown to have good reliability and validity [26]. Further research aimed at developing and validating tools that can be used by older people to assess their homes to prepare for aging in place is required.

    This Study

    This project is part of a research program that seeks to develop a digital health tool to enable middle-aged and older people to self-assess their own homes to understand how to improve the accessibility and age-friendliness of the home environment. The tool was co-designed with older people and developed into a prototype. This study aimed to determine the validity of a home environment self-assessment tool and investigate the levels of agreement between completion by an occupational therapist and completion by an older adult. The research questions were as follows: (1) is it feasible for older people to self-assess their own home environment using a digital health tool? and (2) what are the levels of agreement between an occupational therapist and older person when using a home environment assessment tool?


    Study Design

    This study involved recruiting a cohort of older adults who completed the home environment self-assessment tool at the same time as an occupational therapist. The study design was used to establish the agreement (validity) of the self-assessment tool by assessing it against the current gold standard, an occupational therapy home assessment. This study was conducted across metropolitan Adelaide, South Australia, Australia.

    Ethics Approval

    This study was approved by the Flinders University Human Research Ethics Committee (project number 5303).

    Participants

    Participants were recruited if they met the following criteria: (1) being aged ≥60 years, (2) living within their own home either in a private dwelling or in a retirement village, (3) not having a significant level of disability (measured using the Modified Rankin Score, where people must score 2, which indicates that the participant is “able to carry out all usual duties and activities” or “unable to carry out all previous activities but able to look after own affairs without assistance”) [27]. Participants were included if they were aged ≥60 years. Although the ages of 60 to 65 years are not classified as older age, it is at these ages that many people plan retirement and consider longer-term living options [28].

    Recruitment

    The participants were recruited from June to November 2022 through local council newsletters, the research department’s registry of interested participants, and existing research networks. Individuals who expressed interest were contacted by the lead researcher (RD) via phone or email. They were provided with a copy of the participation information sheet and a written consent form. The included participants were offered an honorarium in recognition of their time (Aus $20; US $13) and a copy of their self-assessment results and the occupational therapy home assessment results at the end of the study.

    Instrument

    The self-assessment tool was specifically developed for this research program based on a review of existing tools and co-design workshops with older people [29]. In this study, the tool was made available via a website and displayed on a tablet computer (iPad; Apple, Inc). The self-assessment tool was developed using a co-design process led by an occupational therapist (KL) and built by a website designer. The tool contains 89 questions within the following domains: general safety, cleaning and maintenance, front entry and garden, hallways, kitchen, toilets, bedrooms, living rooms, bathrooms, laundry, backyard, internal steps, and neighborhood. Each question comprised the following possible responses: yes (satisfactory), no (needs improvement), and not applicable (not present). Participants also answered demographic questions related to their socioeconomic status; marital status; level of education; living status; housing type; ownership of housing; community services received; and whether they considered relocating in the future, which was recorded as a categorical variable, that is, as yes, no, or not applicable. In this study, a maximum of 2 of each area were assessed and data presented for ease of reporting (eg, 2 bathrooms and 2 bedrooms).

    Data Collection

    Potentially eligible participants were screened against the eligibility criteria by the lead researcher and occupational therapist, as mentioned earlier. Upon obtaining consent via phone or email, a time and date were scheduled for each participant to complete the self-assessment and receive the standardized occupational therapy home assessment. Before each visit, an offsite previsit risk assessment was completed to ensure that there were no specific safety risks to the therapist and research assistant (eg, COVID-19 infection).

    Self-Assessment Procedure

    At each visit, the occupational therapist demonstrated the use of the self-assessment tool using a study iPad with an inbuilt Wi-Fi card for internet access. The occupational therapist used an adapted version of the self-assessment program using a second iPad (which reflects that the therapist is the administrator, rather than the participant). A copy of the self-assessment tool is available on the internet [30]. The participant and occupational therapist simultaneously completed the self-assessment using the study iPads. The participant and the occupational therapist walked through the home together, did not discuss the content of the assessment, and scored each question independently. If 2 people were living in the same house, the occupational therapist and research assistant ensured that the 2 people were not sharing answers to limit bias.

    Data Analysis

    Data were entered into Microsoft Excel (Microsoft Corp) and exported to SPSS (IBM Corp) and Stata (StataCorp) software [31,32]. Descriptive statistics were used to report categorical and continuous variables, including the participants’ demographic characteristics, responses to questions regarding the type of housing they lived in, the ownership of their home, formal services received, their postcode, whether they considered relocating in the future, and level of confidence using digital technology. Socioeconomic status was categorized according to the Australian Bureau of Statistics Index of Relative Socioeconomic Advantage and Disadvantage [33]. Each socioeconomic area was given a score (eg, Statistical Area Level 1). The scores ranged from a low index score (more disadvantaged, Statistical Area Level 1) to a high index score (most advantaged, Statistical Area Level 5) [33].

    The rooms of each home were assessed using a series of questions related to home safety, which could be given a “yes/no” response. A total of 7 possible responses were developed: yes-yes, no-no, no-yes, yes-no, not applicable-not applicable, yes-not applicable, and no-not applicable. The κ statistic measure of agreement was used to examine the interrater reliability and level of agreement between the participant and occupational therapist using the same self-assessment tool. The level of agreement was determined through individual items. κ scores were presented to provide the agreement between the raters. κ scores ranged from 0, which represented no agreement beyond what can be expected by chance, to 1, which represented perfect agreement between the raters [34]. For this analysis, Cohen κ guidelines of interpretation were applied as suggested by McHugh [34]; values 0 to 0.20 indicated no agreement, 0.21 to 0.39 indicated minimal agreement, 0.40 to 0.59 indicated weak agreement, 0.60 to 0.79 indicated moderate agreement, 0.80 to 0.90 indicated strong agreement, and >0.90 indicated almost perfect agreement. This analysis interpreted any κ <0.60, suggesting inadequate agreement between the 2 raters [34].

    Variations of κ were used to assess validity. Where the results showed a high agreement but the κ value was low, Gwet AC1 was applied. Dettori and Norvell [35] suggested that there are limitations to κ; high agreement can result in low κ [35,36], and κ values depend on sample sizes, the number of categories, and distribution of responses. Gwet AC1 was used to overcome these problems [35]. Wongpakaran et al [37] recommended that Gwet AC1 be considered for interrater reliability analyses alongside Cohen κ.


    Participants

    A total of 61 participants completed the self-assessment tool. Table 1 presents the demographic characteristics of these 61 participants. The mean age of the participants was 71.2 (SD 7.03) years. The sample consisted of slightly more female participants (34/61, 56%) than male participants (27/61, 44%). Among the 61 participants, 39% (n=24) lived with a spouse or family member and conducted the self-assessment independently but within the same home at the same time. A total of 59 (97%) participants were assessed as having no disability, 1 (2%) participant had no significant disability despite symptoms, and 1 (2%) participant had a slight disability but was able to look after their own affairs without assistance [27]. All self-assessments were conducted in metropolitan Adelaide. Houses that were considered as “other” were homes built within retirement villages or were defined as apartments by the participant. Almost all the participants (60/61, 98%) did not use a mobility aid at home.

    Table 1. Demographic characteristics of the participants (N=61).
    DemographicsValues
    Age, mean (SD; range)71.2 (7.03; 60-88)
    Sex, n (%)

    		Male27 (44)

    		Female34 (56)
    Level of education, n (%)

    		High school9 (15)

    		Higher education44 (72)

    		Other6 (10)
    Marital status, n (%)

    		Married40 (66)

    		Not married21 (34)
    Living status, n (%)

    		Alone15 (25)

    		Living with spouse38 (62)

    		Living with family member6 (10)

    		Other1 (2)
    Type of housing, n (%)

    		House50 (82)

    		Town house1 (2)

    		Unit4 (7)

    		Other6 (10)
    Ownership, n (%)

    		Private owner57 (93)

    		Private rental1 (2)

    		Other3 (5)
    Services, n (%)

    		Cleaning and gardening2 (3)

    		Cleaning3 (5)

    		Gardening2 (3)

    		None51 (84)
    Socioeconomic status, n (%)

    		SAa1 (most disadvantaged)5 (8)

    		SA26 (10)

    		SA316 (26)

    		SA421 (34)

    		SA5 (least disadvantaged)13 (21)
    Considering relocation, n (%)

    		Yes2 (3)

    		No49 (80)

    		Considering10 (16)
    Mobility aid use at home, n (%)

    		Yes1 (2)

    		No60 (98)

    aSA: Statistical Area.

    The average time taken to complete the self-assessment tool was 23 (SD 8.12) minutes. Table 2 shows the responses on the use and confidence in the use of the self-assessment tool. A total of 16 (26%) out of the 61 participants had minor technical difficulties with the use of the self-assessment tool on the iPad. These technical difficulties were due to accidentally exiting the self-assessment application and not knowing how to return to the original screen or being unable to scroll up or down the iPad. Despite technical difficulties, more than half (44/61, 72%) of the participants found the self-assessment tool easy to use.

    Table 2. Responses to the questions on the self-assessment tool.
    Responses to questionsValues
    Time taken to complete the self-assessment tool (min), mean (SD; range)23 (8.12; 11-60)
    Was the self-assessment tool easy to use? (1: hard; 10: easy)

    		1044 (72)

    		914 (23)

    		81 (2)

    		7.51 (2)

    		71 (2)
    Were there any technical difficulties?

    		Yes16 (26)

    		No45 (74)

    Levels of Agreement

    Overview

    Most participants (52/61, 85%) lived in homes with ≥2 bedrooms, 2 bathrooms, and 1 living room. In homes with >2 bedrooms, one of the bedrooms was used as a study room, for guests, for storage, or for grandchildren. Only 18% (11/61) of the homes had internal steps. Among the 61 participants, 11 (18%) had a 3-bedroom house, 7 (11%) had a 4-bedroom house, and only 2 (3%) had a 5-bedroom house. Most participants (60/61, 98%) had a backyard or shared outdoor space within a retirement village or an apartment.

    An overview of the levels of agreement between each participant and occupational therapist is outlined in Tables 3 and 4. Overall, all the “general” and “neighborhood”-related questions demonstrated an almost perfect agreement, as all these questions became a point of discussion related to the opinion of the participant.

    Table 3. Agreement levels for cleaning, front access, hallways, and kitchen between the occupational therapist and participant.
    Domain and questions asked between ratersAgreement (%)Cohen κGwet AC195% CI
    Cleaning

    		1. Are clotheslines easy to access (height and location)?850.34a0.810.76-0.94

    		2. Is there an irrigation system in place with ease of watering?930.890.910.87-1.00

    		3. Are there strategies to change lightbulbs, access high cupboards and clean gutters which don’t require use of a ladder?890.69a0.860.80-0.97

    		4. Are long lasting lightbulbs (LED) installed to reduce the need for frequent changing?970.66a0.970.92-1.00

    		5. Is the home largely clutter free?900.750.840.82-0.98

    		6. Is there a supportive step stool available to access items which are just out of reach950.700.950.90-1.00
    Front access

    		1. Are paths relatively flat and approximately 1000mm wide?720.19a0.600.61-0.84

    		2. Do paths and driveways have a non-slip texture and are they free of moss?790.24a0.710.68-0.89

    		3. Is the gate easy to open?850.68a0.810.76-0.94

    		4. Are steps a suitable height (115-190mm) and depth (240mm-355mm) and stable?790.510.730.68-0.89

    		5. Is it easy to unlock the front door and use the door handle?890.33a0.860.80-0.97

    		6. Is a lockable screen door in place to enable access to fresh air and maintain security?870.57a0.850.78-0.96

    		7. Is there space within the garage or carport to easily open the car door and get out?930.57a0.930.87-1.00

    		8. Is the letterbox easy to access and open?750.00a0.690.64-0.87

    		9. Is there at least one way to access the home without a step?770.560.540.66-0.88
    Hallways

    		1. Are hallways free of clutter and unnecessary furniture?870.50a0.820.78-0.96

    		2. Are floor coverings secure and in good condition?790.36a0.740.68-0.89

    		3. Is the house free of internal steps?970.910.950.92-1.00
    Kitchen

    		1. Is there room within the kitchen to easily manoeuvre?1001.001.001.00-1.00

    		2. Are benches clear?820.38a0.750.72-0.92

    		3. Are rugs and floor coverings secure and in good condition?790.460.740.68-0.89

    		4. Are you able to easily reach or commonly used items without tiptoes, a stepladder, or bending too low?920.40a0.910.85-0.99

    		5. Are taps easy to turn on, off and adjust?980.00a0.980.95-1.00

    		6. Can appliance controls easily be accessed?1001.001.001.00-1.00

    		7. Is there space next to the microwave, oven, and stove top to place hot food?800.46a0.700.70-0.91

    		8. Is there a carbon monoxide detector installed to detect carbon monoxide and prevent poisoning?930.48a0.930.87-1.00

    		9. Is there a space in the kitchen areas where you could sit if needed to prepare food?890.18a0.870.80-0.97

    		10. Are stools a comfortable height and stable?840.700.780.74-0.93

    		11. Are the oven and microwave located at a suitable height? With Access between knee and shoulder?770.23a0.680.66-0.88

    		12. Are bench tops a suitable height (850mm to 1050mm)?1001.001.001.00-1.00

    aWhere the results showed a high agreement but the κ value was low, Gwet AC1 was applied.

    Table 4. Agreement levels for internal steps, bathroom, toilet, bedroom, lounge area, laundry, and backyard between the occupational therapist and participant.
    Domain and questions asked between ratersAgreement (%)Cohen κGwet AC195% CI
    Internal step

    		1. Do internal stairs have a sturdy rail in place?910.620.880.71-1.00

    		2. Are doorways a minimum of 850mm wide?1001.001.001.00-1.00

    		3. Are door handles lever style?820.680.750.55-1.00

    		4. Can doors and windows be easily opened to allow for fresh air?73−0.06a0.680.41-1.00
    Bathroom 1

    		1. Is there room within the bedroom to easily manoeuvre?780.29a0.670.66-0.88

    		2. Are rugs or mats secure and in good condition?640.460.480.52-0.76

    		3. Is there adequate ventilation with presence of a fan or easily opened window?1001.001.001.00-1.00

    		4. Is the transition between the floor and shower flat?610.270.220.48-0.73

    		5. Is a shower hose in place?820.840.890.85-0.99

    		6. Are taps easy to turn on, off and adjust?660.08a0.490.53-0.78

    		7. Is water thermostatically controlled to a delivery temperature of 45 degrees?840.700.770.74-0.93

    		8. Is the floor surface non-slip?670.330.380.55-0.79

    		9. Is the shower cubicle a minimum of 900×900mm?920.700.900.85-0.99
    Bathroom 2

    		1. Is there room within the bathroom to easily manoeuvre?560.140.250.42-0.71

    		2. Are rugs or mats secure and in good condition?460.290.190.31-0.61

    		3. Is there adequate ventilation with presence of a fan or easily opened window?94−0.04a0.930.86-1.00

    		4. Is the transition between the floor and shower flat?540.200.110.39-0.69

    		5. Is a shower hose in place?920.840.890.83-1.00

    		6. Are taps easy to turn on, off and adjust?630.14a0.400.48-0.77

    		7. Is water thermostatically controlled to a delivery temperature of 45 degrees?900.800.860.80-1.00

    		8. Is the floor surface non-slip?710.330.490.57-0.84

    		9. Is the shower cubicle a minimum of 900×900mm?790.410.750.67-0.92
    Toilet 1

    		1. Is the toilet a suitable height (460mm-480mm)?550.100.270.40-0.71

    		2. Are rugs or mats secure and in good condition and necessary?700.530.580.59-0.82

    		3. Does the door swing outwards?900.790.870.82-0.98
    Toilet 2

    		1. Is the toilet a suitable height (460mm-480mm)?550.01a0.270.40-0.71

    		2. Are rugs or mats secure and in good condition and necessary?620.420.450.46-0.80

    		3. Does the door swing outwards?890.790.860.78-1.00
    Bedroom 1

    		1. Is the bed a comfortable height to access and rise from?930.31a0.930.87-1.00

    		2. Is there space to easily manoeuvre within the bathroom?750.16a0.670.64-0.87

    		3. Is there access to light and phone next to the bed?970.65a0.960.92-1.00

    		4. Are floor covering secure and in good condition?840.38a0.810.74-0.93

    		5. Is there somewhere to sit while dressing and putting on shoes?920.51a0.910.85-0.99

    		6. Is it easy to access clothing and shoes without excessive reaching or bending?93−0.03a0.930.87-1.00

    		7. Is it easy to open and close windows and blinds?850.12a0.820.76-0.94

    		8. Can the temperature in the bedroom be easily adjusted?920.720.900.85-0.99
    Bedroom 2

    		1. Is the bed a comfortable height to access and rise from?850.39a0.830.74-0.95

    		2. Is there space to easily manoeuvre within the bedroom?810.47a0.770.70-0.92

    		3. Is there access to light and phone next to the bed?900.41a0.900.82-0.99

    		4. Are floor covering secure and in good condition?900.58a0.890.82-0.99

    		5. Is there somewhere to sit while dressing and putting on shoes?940.65a0.930.88-1.00

    		6. Is it easy to access clothing and shoes without excessive reaching or bending?960.73a0.960.91-1.00

    		7. Is it easy to open and close windows and blinds?750.22a0.640.63-0.87

    		8. Can the temperature in the bedroom be easily adjusted?900.620.890.82-0.99
    Living area 1

    		1. Is there space to easily manoeuvre within the living area?870.29a0.840.78-0.96

    		2. Are floor covering secure and in good condition?800.09a0.780.70-0.90

    		3. Is there good storage so that all items have a spot?950.38a0.950.90-1.00

    		4. Is the room free of cords in walkways which may cause trips?970.00a0.970.92-1.00

    		5. Is it easy to access heating and cooling controls?930.53a0.930.87-1.00

    		6. Is it easy to open and close windows and blinds?90−0.03a0.890.82-0.98

    		7. Are chairs in the room easy to get in and out of?440.020.040.31-0.57
    Living area 2

    		1. Is there space to easily manoeuvre within the living area?870.650.780.73-1.00

    		2. Are floor covering secure and in good condition?730.13a0.690.57-0.90

    		3. Is there good storage so that all items have a spot?870.52a0.840.74-1.00

    		4. Is the room free of cords in walkways which may cause trips?900.37a0.880.79-1.00

    		5. Is it easy to access heating and cooling controls?1001.001.001.00-1.00

    		6. Is it easy to open and close windows and blinds?770.15a0.730.61-0.93

    		7. Are chairs in the room easy to get in and out of?530.07a0.420.34-0.73
    Laundry

    		1. Is there adequate bench space in the laundry?840.650.790.74-0.93

    		2. Can all appliances be easily accessed and plugged in when needed?850.40a0.830.76-0.94

    		3. Is there room in the house to hang small items of laundry to dry when needed?970.780.960.92-1.00

    		4. Is the washing machine front-loading?1001.001.001.00-1.00
    Back garden

    		1. Are paths relatively flat and approximately 1000mm wide?780.24a0.750.68-0.89

    		2. Are doorways a minimum of 850mm wide?1001.001.001.00-1.00

    		3. Is it possible to access the clothesline without excessive reaching?630.29a0.520.51-0.76

    		4. Is the garden low maintenance in terms of watering requirements, lawn mowing and management of autumn leaves?550.240.390.42-0.68

    		5. Are there shady areas outside to sit?930.57a0.920.87-1.00

    		6. Is outdoor furniture sturdy, comfortable and easy to get on/off?830.40a0.810.74-0.93

    aWhere the results showed a high agreement but the κ value was low, Gwet AC1 was applied.

    Among the 61 participants, the domains that demonstrated the lowest agreement levels between the occupational therapist and participant were the front garden and entry (72% to 93% agreement), bathrooms (46% to 100% agreement), toilets (54% to 92% agreement), and backyards (55% to 100% agreement).

    Front Access

    Items that showed a moderate level of agreement were paths being flat and wide (72% agreement, Gwet AC1=0.60), paths and driveways having a nonslip texture and being free of moss (79% agreement, Gwet AC1=0.71), and the letter box being easy to access and open (75% agreement, Gwet AC1=0.69). Items with weak agreement were related to the front steps of the house. For example, steps being of a suitable height and depth and stable demonstrated 79% agreement (κ=0.51), and whether the home had at least 1 way to access it without a step demonstrated 77% agreement (Gwet AC1=0.56). No participant assessed the front steps as being unsuitable and unstable, as opposed to the occupational therapist, who assessed 17 front steps as being unsuitable and unstable.

    Hallways

    The item that showed a strong agreement was the hallways being free of clutter and unnecessary furniture (87% agreement, Gwet AC1=0.82). A total of 13 floor coverings within the hallways were assessed by the occupational therapist as being unsafe; by contrast, no participant assessed the floor coverings as being unsafe.

    Kitchen

    The responses to a total of 12 questions regarding the kitchen were compared for levels of agreement between the occupational therapist and participant. There was an overall weak to almost perfect level of agreement, as shown in Table 3. The occupational therapist assessed the oven and microwave to be at an unsuitable height on 14 (23%) out of 61 occasions; by contrast, no participant assessed the oven or microwave to be at an unsuitable height.

    Bathroom 1

    For the 9 questions regarding bathrooms, the levels of agreement varied from minimal to almost perfect, as shown in Table 4.

    Both the occupational therapist and participant agreed (100% agreement, κ=1.00) that there was adequate ventilation with the presence of a fan or window. There was moderate agreement (78% agreement, Gwet AC1=0.67) for bathroom 1 being easy to maneuver in and for the shower cubicle being a minimum of 900×900 mm in size (92% agreement, κ=0.70). There was a weaker level of agreement for rugs or mats being secure (64% agreement, κ=0.46) and for taps being easy to turn on, turn off, and adjust (66% agreement, κ=0.49). Moreover, there was minimal agreement for the transition between the floor and shower being flat (61% agreement, κ=.27) and for the floor surfaces being nonslip (67% agreement, κ=0.33). Most participants did not believe that “shower lips” and “shower alcove tracks” were home hazards and commonly considered these transitions to be flat.

    Toilet 1

    For the 3 questions regarding toilets, the levels of agreement varied from no agreement to strong agreement, as shown in Table 4. Toilet 1’s height had the lowest agreement (no agreement between the occupational therapist and participant; 56% agreement, κ=0.10) among the items. Both the occupational therapist and participant agreed that the toilet heights were suitable on 31 (51%) out of 61 occasions, whereas on 27 (44%) out of 61 occasions, the occupational therapist assessed the toilet height as being unsuitable. Participants commonly indicated the toilet height as currently manageable and not an area of concern.

    Bedroom 1

    For the 8 questions regarding bedrooms, the levels of agreement varied from moderate to almost perfect, as shown in Table 4.

    The participants and occupational therapist both highly agreed that there was easy access to light and phone next to the bed (97% agreement, Gwet AC1=0.96). Other items that indicated a high level of agreement were the bed being of a comfortable height to access and rise from (93% [almost perfect] agreement, Gwet AC1=0.93), clothing and shoes being easy to access (93% [almost perfect] agreement, Gwet AC1=0.93), having a place to sit when dressing and putting on shoes (92% [almost perfect] agreement, Gwet AC1=0.91), and the temperature in the bedroom being easily adjustable (92% [almost perfect] agreement, κ=0.72). Although the participants were asked to assess bed heights, most participants (56/92, 61%) interpreted the bed height question as “was the bed comfortable,” rather than whether the bed was at a “comfortable height.”

    Living Areas

    Living areas 1 and 2 were classified by the participants as their main living areas where they watch television, rumpus rooms, or sitting areas.

    For the 7 questions regarding living areas, the levels of agreement varied from no agreement to almost perfect agreement, as shown in Table 3.

    An almost perfect level of agreement was evident for the following items: the walkways in the lounge area being free of cords (97% agreement, Gwet AC1=0.97), the lounge area having good storage capacity (95% agreement, Gwet AC1=0.95), and having easy access to heating and cooling controls (93% agreement, Gwet AC1=0.93). A strong agreement level was illustrated for there being enough circulation space (90% agreement, Gwet AC1=0.84) and for the windows or blinds being easy to open (90% agreement, Gwet AC1=0.89) within the living area.

    Floor coverings in the lounge area seemed to indicate “lower” levels of agreement (80% [moderate] agreement, Gwet AC1=0.78). The occupational therapist disagreed with the participant and indicated that 8 (13%) out of 61 lounges had unsafe floor coverings.

    Among the items assessing living area 1, the lowest level of agreement was for whether the chairs in the room were easy to get in and out of (no agreement between the occupational therapist and participant; 44% agreement, κ=0.02).

    Backyard

    For the 6 questions regarding the backyard, the levels of agreement varied from minimal agreement to almost perfect agreement, as shown in Table 3.

    There was an almost perfect level of agreement between the participants and occupational therapist for whether the back garden doorway was a minimum of 850 mm wide (100% agreement, κ=1.00) and for whether there were shady areas outside to sit (93% agreement, Gwet AC1=0.92). Whether the outdoor furniture was sturdy, comfortable, and easy to get on and off also had a high level of agreement (83% [strong] agreement, Gwet AC1=0.81).

    There was a moderate level of agreement for the paths being relatively flat and approximately 1000 m wide (78% agreement, Gwet AC1=0.75). Here, the occupational therapist disagreed on 9 (15%) out of 60 occasions, and there was agreement between the raters on only 2 (3%) occasions. Among the items regarding the backyard, the lowest agreement levels were observed for whether it was possible to access the clothesline without excessive reaching (63% [weak] agreement, Gwet AC1=0.52) and whether the garden was low maintenance (κ=0.24, minimal agreement with 55%).


    Principal Findings

    In this study, a digital home environment self-assessment tool was tested with older people, and its validity was determined through an assessment of the levels of agreement between an occupational therapist and older person. The overall levels of agreement were high, supporting the validity of the tool in identifying potential hazards. Lower levels of agreement were found between the occupational therapist and older participants in the following domains: steps, toilets, bathrooms, and backyards. Items regarding the height of toilets; height of chairs in the lounge; loose rugs, mats, or floor coverings; height of kitchen appliances; and transition between shower alcoves and bathroom flooring also displayed lower levels of agreement. Lower levels of agreement likely occurred owing to (1) the subjective nature of some questions, such as “is there at least one way to access the home without a step?” and (2) the more critical lens through which an occupational therapist assesses the home environment. There were no items where participants were more likely to identify hazards than the occupational therapist.

    Participants found the tool to be relatively simple and quick to complete, and overall, there were high levels of agreement. The study conducted by Ali and Kumar [38] also found that older people were able to self-assess potential risk factors at home. They also found that self-assessments led to older people being able to initiate minor modifications to their homes, including the removal of throw rugs and the reorganization of kitchen appliances. Other research has shown that older people prefer self-assessment approaches that go beyond identifying hazards and provide them with potential solutions to ensure that their home is safe and comfortable [39]. Checklists and recommendations for improving the age-friendliness of the home environment may also be useful for architects and designers to help them gain insights into the practical needs of older people.

    Although older people were able to self-assess their homes, there were often occasions of disagreement between the perspective of the occupational therapist and that of the participant. In particular, the assessments of steps, toilets, bathrooms, and the backyard showed conflicting results. Occupational therapists have extensive training in environmental assessments with an emphasis on safety [29]. Another study has also shown that occupational therapists are more critical of the environment than other people [40]. Lower levels of agreement were commonly observed for items assessing bathrooms and toilets. These areas have been shown to be particularly hazardous for older people. Gell et al [41] found that bathroom modifications were common and usually increased after multiple falls. Similarly, Wellecke et al [42] found that bathroom modifications were frequently required to support aging in place. Their study also found that large step-free showers and bathrooms on the ground floor were beneficial [42]. It was clear from the participants in this study that bathrooms and toilets were not an area of concern for them yet. Bathroom and toilet modifications, such as the addition of grab rails, may be a key feature to consider in the design of new buildings in an age-ready city.

    We also found a difference in agreement levels for items regarding the backyard, with many participants indicating that their gardens did not require high maintenance, despite the occupational therapist believing they did. Research shows that gardening stimulates a greater level of well-being, better physical and mental health, and better sleep quality among older people [43]. However, as aging takes place, older people have also described concerns about maintaining large gardens [44]. Suitable gardening solutions, such as landscaping options and irrigation systems for reducing maintenance, may facilitate age-friendly environments. Given that most older people experience a sense of connection with their homes [12,13], practical support for gardening or access to parks and gardens within walking distance can support the development of healthy aging cities.

    Limitations

    This study has several limitations that should be acknowledged. Participants were recruited through a variety of methods, and the use of convenience sampling may have influenced the results, as the population was not representative of the general population. Most participants (50/82, 61%) lived in metropolitan areas with high socioeconomic status. These living conditions may differ from those in other countries and those of other older populations. Further research should include participants with a lower socioeconomic status and those living in rural or remote areas.

    The results may have been influenced by the variations in the interpretation of the questions. For example, some participants indicated that some questions were ambiguous. For example, the interpretation of the question “is the home largely clutter free?” depended on the person’s perception of clutter. Some of our participants (eg, spouses or family relatives) lived in the same house; however, the assessments were completed independently and without consultation between the cohabitants. Finally, our CIs may have been narrower with a larger sample size.

    Conclusions

    In conclusion, older people were able to self-assess their own homes using a digital health tool. The purpose of the digital tool was to enable people to start thinking about future housing decisions. This study showed that although agreement levels were generally high, older people and occupational therapists may still have different views on the safety of home environments. In particular, the items regarding steps, toilets, bathrooms, and backyards were subject to different perspectives. Following this research, the digital tool will be slightly modified to address questions for which there was a higher level of disagreement. Attempts will be made to reduce the ambiguity of some questions. Tools that identify potential problems and generate solutions are likely to be of value in supporting future housing decisions as populations age.

    Acknowledgments

    This work was supported in part by the Australian Research Council Discovery Early Career Research Fellowship grant (project ID: DE200101494). The authors would like to thank all the participants for their contributions to this study. They would like to acknowledge Kaitlyn Ford, Rachel Lane, and Elizabeth Potter for their assistance with data collection and Dr Pawel Skuza for assistance with data analysis.

    Conflicts of Interest

    None declared.

    1. Ageing: global Population. World Health Organization. Oct 2010. URL: https://www.who.int/news-room/q-a-detail/population-ageing [accessed 2021-08-03]
    2. Ageing and health. World Health Organization. Oct 01, 2022. URL: https://www.who.int/news-room/fact-sheets/detail/ageing-and-health [accessed 2021-08-03]
    3. Silver hues: building age-ready cities. The World Bank. Apr 05, 2022. URL: https://www.worldbank.org/en/topic/urbandevelopment/publication/age-ready-cities [accessed 2023-04-15]
    4. Decade of healthy ageing: baseline report. World Health Organization. Jan 14, 2021. URL: https://www.who.int/publications/i/item/9789240017900 [accessed 2021-08-03]
    5. Hatcher D, Chang E, Schmied V, Garrido S. Exploring the perspectives of older people on the concept of home. J Aging Res. Jun 18, 2019;2019:2679680. [FREE Full text] [CrossRef] [Medline]
    6. Kramer C, Pfaffenbach C. Should I stay or should I go? Housing preferences upon retirement in Germany. J Hous Built Environ. 2016;31(2):239-256. [FREE Full text] [CrossRef]
    7. What Australians think of ageing and aged care. Royal Commission into Aged Care Quality and Safety. Jul 13, 2020. URL: https:/​/agedcare.​royalcommission.gov.au/​sites/​default/​files/​2020-07/​research_paper_4_-_what_australians_think_of_ageing_and_aged_care.​pdf [accessed 2021-08-03]
    8. Northcott HC, Petruik CR. The geographic mobility of elderly Canadians. Can J Aging. Sep 2011;30(3):311-322. [CrossRef] [Medline]
    9. Health care in Canada, 2011: a focus on seniors and aging. Canadian Institute for Health Information. URL: https://publications.gc.ca/collections/collection_2011/icis-cihi/H115-15-2011-eng.pdf [accessed 2022-07-10]
    10. Chui E. Ageing in place in Hong Kong—challenges and opportunities in a capitalist Chinese city. Ageing Int. 2008;32(3):167-182. [FREE Full text] [CrossRef]
    11. Pani-Harreman KE, Bours GJ, Zander I, Kempen GI, van Duren JM. Definitions, key themes and aspects of ‘ageing in place’: a scoping review. Ageing Soc. Mar 18, 2020;41(9):2026-2059. [FREE Full text] [CrossRef]
    12. Coleman T, Wiles J. Being with objects of meaning: cherished possessions and opportunities to maintain aging in place. Gerontologist. Jan 24, 2020;60(1):41-49. [CrossRef] [Medline]
    13. Glass AP, Vander Plaats RS. A conceptual model for aging better together intentionally. J Aging Stud. Dec 2013;27(4):428-442. [CrossRef] [Medline]
    14. Older Australians. Australian Institute of Health and Welfare. Feb 2021. URL: https://www.aihw.gov.au/reports/older-people/older-australians/contents/summary [accessed 2022-02-01]
    15. Stark S, Keglovits M, Arbesman M, Lieberman D. Effect of home modification interventions on the participation of community-dwelling adults with health conditions: a systematic review. Am J Occup Ther. 2017;71(2):7102290010p1-7102290010p1. [CrossRef] [Medline]
    16. Stark S, Landsbaum A, Palmer JL, Somerville EK, Morris JC. Client-centred home modifications improve daily activity performance of older adults. Can J Occup Ther. Jul 2009;76 Spec No:235-245. [FREE Full text] [CrossRef] [Medline]
    17. Ninnis K, Van Den Berg M, Lannin NA, George S, Laver K. Information and communication technology use within occupational therapy home assessments: a scoping review. Br J Occup Ther. Jul 12, 2018;82(3):141-152. [FREE Full text] [CrossRef]
    18. Read J, Jones N, Fegan C, Cudd P, Simpson E, Mazumdar S, et al. Remote home visit: Exploring the feasibility, acceptability and potential benefits of using digital technology to undertake occupational therapy home assessments. Br J Occup Ther. Oct 2020;83(10):648-658. [FREE Full text] [CrossRef]
    19. van Gaans D, Dent E. Issues of accessibility to health services by older Australians: a review. Public Health Rev. Jul 16, 2018;39(1):20. [FREE Full text] [CrossRef] [Medline]
    20. Lannin NA, Clemson L, McCluskey A. Survey of current pre-discharge home visiting practices of occupational therapists. Aust Occup Ther J. Jun 2011;58(3):172-177. [CrossRef] [Medline]
    21. Renaut S, Ogg J, Petite S, Chamahian A. Home environments and adaptations in the context of ageing. Ageing Soc. Mar 27, 2014;35(6):1278-1303. [FREE Full text] [CrossRef]
    22. Dalistan R, George S, Laver K. Considering the home environment and planning for the future: a qualitative exploration of the views of older adults and individuals with older relatives. Scand J Occup Ther (Forthcoming). Mar 27, 2023:1-13. [CrossRef] [Medline]
    23. Barras S. A systematic and critical review of the literature: the effectiveness of occupational therapy home assessment on a range of outcome measures. Aust Occup Ther J. Dec 2005;52(4):326-336. [FREE Full text] [CrossRef]
    24. Patry A, Vincent C, Duval C, Careau E. Psychometric properties of home accessibility assessment tools: a systematic review. Can J Occup Ther. Jun 2019;86(3):172-184. [CrossRef] [Medline]
    25. Ziebart C, Dewan N, Tuazon J, MacDermid J. Development of the home fall hazard checklist. Rehabil Res Pract. May 31, 2021;2021:5362197. [FREE Full text] [CrossRef] [Medline]
    26. Tomita MR, Saharan S, Rajendran S, Nochajski SM, Schweitzer JA. Psychometrics of the Home Safety Self-Assessment Tool (HSSAT) to prevent falls in community-dwelling older adults. Am J Occup Ther. Nov 2014;68(6):711-718. [CrossRef] [Medline]
    27. Broderick JP, Adeoye O, Elm J. Evolution of the Modified Rankin Scale and its use in future stroke trials. Stroke. Jul 2017;48(7):2007-2012. [CrossRef]
    28. Gibler KM, Tyvimaa T. Middle-aged and elderly Finnish households considering moving, their preferences, and potential downsizing amidst changing life course and housing career. J Hous Elderly. 2015;29(4):373-395. [FREE Full text] [CrossRef]
    29. Laver K, Davis A, Gwilt I, Dalistan R, Lane R, Block H. Self-assessment of the home environment to plan for successful ageing: report from a digital health co-design workshop. PLOS Digit Health. Jul 7, 2022;1(7):e0000069. [FREE Full text] [CrossRef] [Medline]
    30. Flinders University. URL: https://home-check.co/ [accessed 2023-10-18]
    31. IBM SPSS statistics for Windows. IBM Corp. 2021. URL: https://www.ibm.com/products/spss-statistics [accessed 2022-02-24]
    32. Stata statistical software in release 17. StataCorp LLC. 2021. URL: https://www.stata.com/stata-news/news36-2/ [accessed 2022-03-23]
    33. Census of population and housing: socio-economic indexes for areas (SEIFA), Australia, 2016. Australian Bureau of Statistics. 2018. URL: https://www.abs.gov.au/ausstats/abs@.nsf/mf/2033.0.55.001 [accessed 2022-11-30]
    34. McHugh ML. Interrater reliability: the kappa statistic. Biochem Med (Zagreb). 2012;22(3):276-282. [FREE Full text] [Medline]
    35. Dettori JR, Norvell DC. Kappa and beyond: is there agreement? Global Spine J. Jun 03, 2020;10(4):499-501. [FREE Full text] [CrossRef] [Medline]
    36. Feinstein AR, Cicchetti DV. High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. Jan 1990;43(6):543-549. [CrossRef] [Medline]
    37. Wongpakaran N, Wongpakaran T, Wedding D, Gwet KL. A comparison of Cohen's Kappa and Gwet's AC1 when calculating inter-rater reliability coefficients: a study conducted with personality disorder samples. BMC Med Res Methodol. Apr 29, 2013;13(1):61. [FREE Full text] [CrossRef] [Medline]
    38. Ali N, Kumar S. Assessing the physical needs and creating a barrier free environment at home for the person with challenging conditions and elderly. Int J Convergence Healthc. Jul 30, 2022;2(2):80-16. [FREE Full text] [CrossRef]
    39. Lorraine James B, Saville-Smith K. Designing housing decision-support tools for resilient older people. Archit Sci Rev. Aug 02, 2018;61(5):305-312. [FREE Full text] [CrossRef]
    40. Mackenzie L, Byles J, Higginbotham N. Reliability of the home falls and accidents screening tool (HOME FAST) for identifying older people at increased risk of falls. Disabil Rehabil. Mar 20, 2002;24(5):266-274. [CrossRef] [Medline]
    41. Gell NM, Brown H, Karlsson L, Peters DM, Mroz TM. Bathroom modifications, clutter, and tripping hazards: prevalence and changes after incident falls in community-dwelling older adults. J Aging Health. Dec 2020;32(10):1636-1644. [CrossRef] [Medline]
    42. Wellecke C, D'Cruz K, Winkler D, Douglas J, Goodwin I, Davis E, et al. Accessible design features and home modifications to improve physical housing accessibility: a mixed-methods survey of occupational therapists. Disabil Health J. Jul 2022;15(3):101281. [FREE Full text] [CrossRef] [Medline]
    43. Corley J, Okely JA, Taylor AM, Page D, Welstead M, Skarabela B, et al. Home garden use during COVID-19: associations with physical and mental wellbeing in older adults. J Environ Psychol. Feb 2021;73:101545. [FREE Full text] [CrossRef] [Medline]
    44. Coleman T, Kearns RA, Wiles J. Older adults’ experiences of home maintenance issues and opportunities to maintain ageing in place. Hous Stud. Sep 28, 2016;31(8):964-983. [FREE Full text] [CrossRef]

    Edited by Y Du; submitted 31.05.23; peer-reviewed by C Ziebart, S Popolizio; comments to author 28.06.23; revised version received 05.07.23; accepted 29.08.23; published 26.10.23.

    Copyright

    ©Roslyn Aclan, Stacey George, Kate Laver. Originally published in JMIR Aging (https://aging.jmir.org), 26.10.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Aging, is properly cited. The complete bibliographic information, a link to the original publication on https://aging.jmir.org, as well as this copyright and license information must be included.