[go: up one dir, main page]

WO2016081830A1 - Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using wearable display - Google Patents

Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using wearable display Download PDF

Info

Publication number
WO2016081830A1
WO2016081830A1 PCT/US2015/061848 US2015061848W WO2016081830A1 WO 2016081830 A1 WO2016081830 A1 WO 2016081830A1 US 2015061848 W US2015061848 W US 2015061848W WO 2016081830 A1 WO2016081830 A1 WO 2016081830A1
Authority
WO
WIPO (PCT)
Prior art keywords
patient
rehabilitation
stroke
brain injury
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2015/061848
Other languages
French (fr)
Inventor
Claude Bernard NGUYEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Pennsylvania Penn
Original Assignee
University of Pennsylvania Penn
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Pennsylvania Penn filed Critical University of Pennsylvania Penn
Publication of WO2016081830A1 publication Critical patent/WO2016081830A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1104—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb induced by stimuli or drugs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/7445—Display arrangements, e.g. multiple display units
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
    • A61B2505/09—Rehabilitation or training
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0015—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
    • A61B5/002—Monitoring the patient using a local or closed circuit, e.g. in a room or building
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A61B5/1128—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique using image analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/40—Detecting, measuring or recording for evaluating the nervous system
    • A61B5/4058—Detecting, measuring or recording for evaluating the nervous system for evaluating the central nervous system
    • A61B5/4064—Evaluating the brain
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles

Definitions

  • the subject matter described herein relates to stroke or brain injury rehabilitation. More particularly, the subject matter described herein relates to methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using a wearable display.
  • Stroke is the leading cause of disability in the United States. Disability includes paralysis, loss of coordination, language impairment, and vision impairment. Effective physical therapy is crucial to stroke rehabilitation. However, traditional physical therapy is resource intensive and expensive. Newer types of physical therapy involve computers and console-based sensors, such as the Kinect ® sensor. However, such sensors are stationary and thus tied to a particular location. Moreover, existing applications for fixed and mobile platforms are typically not tied to deficits of an individual patient. What is needed is a rehabilitation platform that facilitates rehabilitation activities in different locations and that can be customized to individual patients' deficits.
  • One system includes a wearable display for displaying images to a brain injury or stroke rehabilitation patient.
  • a processor is operatively associated with the wearable display for controlling the images displayed to the patient.
  • a brain injury or stroke rehabilitation application is executable by the processor for providing for selection of patient tailored rehabilitation activity domains and for controlling the wearable display to prompt the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains.
  • the system further includes at least one sensor for monitoring the patient's rehabilitation activities, and the brain injury or stroke rehabilitation application records results from the patient participation in the rehabilitation activities.
  • the subject matter described herein may be implemented in hardware, software, firmware, or any combination thereof.
  • the terms “function” “node” or “module” as used herein refer to hardware, which may also include software and/or firmware components, for implementing the feature being described.
  • the subject matter described herein may be implemented using a computer readable medium having stored thereon computer executable instructions that when executed by the processor of a computer control the computer to perform steps.
  • Exemplary computer readable media suitable for implementing the subject matter described herein include non-transitory computer-readable media, such as disk memory devices, chip memory devices, programmable logic devices, and application specific integrated circuits.
  • a computer readable medium that implements the subject matter described herein may be located on a single device or computing platform or may be distributed across multiple devices or computing platforms.
  • Figure 1 is a block diagram illustrating a system for patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein;
  • Figure 2 includes drawings of computer screen shots and an overall flow of patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein;
  • Figure 3 is a flow chart illustrating an exemplary process for patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein.
  • FIG. 1 is a block diagram illustrating an exemplary system for patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein.
  • the system includes a wearable display 100, for displaying images to a brain injury or stroke rehabilitation patient.
  • Wearable display 100 may be any suitable wearable display capable of displaying virtual images to the patient and either allowing the patient to view the patient's real environment in real time through the display or displaying video of the patient's real environment.
  • a wearable display suitable for use with embodiment of the subject matter described herein is an eyeglasses mounted, see through display, such as the Google Glass ® display.
  • a wearable display suitable for use with embodiments of the subject matter described herein is a head mountable display, such as an augmented reality (AR) or virtual reality (VR) display that is part of a helmet or other frame designed to be worn on the patient's head.
  • AR augmented reality
  • VR virtual reality
  • the system further includes a processor 102 for controlling the images displayed to the patient via wearable display 100.
  • processor 102 may be an on-board processor in that the processor is physically mounted to the same frame (e.g., helmet or eyeglasses frame) as wearable display 100.
  • processor 102 may be located on a separate device, such as a mobile phone or other portable device, that is communicatively but not physically coupled to the display.
  • a combination of on-board and off-board processing is also intended to be within the scope of the subject matter described herein.
  • the system illustrated in Figure 1 further includes a stroke or brain injury rehabilitation application 104 that provides for user selection of patient tailored rehabilitation activity domains and for controlling wearable display 100 to prompt the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains. Examples of stroke or brain injury rehabilitation activities will be provided below.
  • the system illustrated in Figure 1 further includes at least one sensor 106 for monitoring patient participation in the rehabilitation activities and recording results from the patient participation.
  • Sensor 106 may be a camera, accelerometer, gyroscope, Global Positioning System (GPS) receiver, or any combination thereof that is capable of monitoring a patient's participation in rehabilitation activities.
  • GPS Global Positioning System
  • Sensor 106 may be located on the same platform as wearable display
  • wearable display 100 or may be located on a separate platform from wearable display 100 without departing from the scope of the subject matter described herein.
  • some sensors such as a camera, may be mounted to the same frame as wearable display 100 and other sensors, such as a GPS receiver, may be located on a mobile phone that is separate from the physical platform or frame of wearable display 100.
  • Application 104 may record results of the patient's participation in rehab activities as recorded by sensor 106.
  • application 104 may be written for use with an open source operation system, such as Android ® .
  • an open source operating system may allow application 104 to be used on current platforms that use Android ® , such as the Google Glass ® platform and also on future computing platforms that are developed for the Android ® operating system.
  • the system illustrated in Figure 1 may further include a communication interface 108 for communicating results of the patient's participation in a rehabilitation activity to an external process or computing platform 110.
  • Communication interface 108 may be a wireless communication interface, such as a Bluetooth, Wi-Fi, or cellular interface.
  • communication interface 108 may be a wired interface, such as a universal serial bus (USB) interface.
  • USB universal serial bus
  • Figure 2 illustrates drawings of computer screen shots of exemplary rehabilitation activities that may be facilitated by application 104 as well as an overall flow of application operation.
  • the patient or the rehabilitation provider selects a mode of operation for application 104.
  • the modes of operation include independent mode and collaborative mode.
  • application 104 operates under control of the patient without interaction with the provider.
  • collaborative mode application 104 prompts the patient to perform rehabilitation activities in collaboration with the provider.
  • application 104 provides for selection of rehabilitation domains tailored to a patient's deficits.
  • the rehabilitation domains include balance, coordination, endurance, strength, upper extremity control, vision training, language, and cognition.
  • application 104 controls wearable display 100 to display images that guide the patient through rehabilitation activities corresponding to the selected domains.
  • application 104 provides feedback to the provider.
  • the feedback may include timing, trajectory, video, or other indication of results of the patient's participation in the rehabilitation activities.
  • the leftmost image drawing illustrates an example of a rehabilitation activity that may be facilitated by application 104 for the upper extremity control domain.
  • application 104 controls wearable display 100 to display a virtual object to the patient.
  • Application 104 via display 100, the patient to hit or touch the apparent location of the virtual object as displayed to the patient on display 100. The patient then moves the patient's hand to the apparent location of the virtual object. If the patient correctly selects the apparent location, application 104 may provide positive auditory and/or visual feedback to the patient.
  • Application 104 may also record the timing and trajectory of the patient's extremity in moving towards the apparent location of the virtual object.
  • application 104 displays images to the patient corresponding to the balance and/or coordination rehabilitation domains.
  • application 104 locks or focuses on an object that the patient sees through wearable display 100.
  • the object may be an image of the physical therapist or physician.
  • Application 104 controls display 100 to display a visual prompt which tells the patient in which direction to move to go towards the targeted object. The patient's movements, timing of the movements, and trajectory may be recorded.
  • application 104 controls display 100 to display a virtual balance indicator to the patient, which corresponds to the coordination and upper extremity control rehabilitation domains.
  • the patient is prompted to raise the patient's arms to a certain height and make the patient's arms level with each other.
  • the virtual balance indicator indicates the relative vertical positions of the patient's hands or arms.
  • FIG. 3 is a flow chart illustrating an exemplary process for stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein.
  • a wearable display is provided for displaying images to a stroke or brain injury rehabilitation patient.
  • the wearable display may be any of the types of wearable displays described above.
  • a selection of patient tailored rehabilitation domains is received.
  • the selection of rehabilitation domains may be received by application 104 in response to patient or provider input. Examples of such domains are displayed in block 202 in Figure 2.
  • images are displayed on the wearable display for prompting the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains.
  • the images may be virtual images that the patient sees in combination with the patient's perception of the real world or video images of the patient's environment. Examples are illustrated in the images in Figure 2.
  • results from the patient's participation in the rehabilitation activities are recorded by application 104.
  • the results may be video of the patient's participation in rehab activities or information, such as statistics, derived from the patient's participation as detected by sensor 106.
  • the results may be stored in memory on the same platform as wearable display 100 or may be communicated off platform to a mobile phone or computer that is communicatively coupled to the display platform.
  • the results are communicated to the provider. For example, the results may be communicated to a physician or therapist through a wired or wireless interface.
  • a wearable display platform includes a special purpose computing platform, i.e., a wearable display platform, that is specifically controlled to prompt the patient to participate in stroke or brain injury rehabilitation activities.
  • a wearable display platform improves the technological fields of stroke and brain injury rehabilitation.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Physiology (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Medicinal Chemistry (AREA)
  • Primary Health Care (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Chemical & Material Sciences (AREA)
  • Epidemiology (AREA)
  • Rehabilitation Tools (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using a wearable display are provided. One system includes a wearable display for displaying images to a brain injury or stroke rehabilitation patient. A processor is operatively associated with the wearable display for controlling the images displayed to the patient. A brain injury or stroke rehabilitation application is executable by the processor for providing for selection of patient tailored rehabilitation activity domains and for controlling the wearable display to prompt the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains. The system further includes at least one sensor for monitoring the patient's rehabilitation activities, and the brain injury or stroke rehabilitation application records results from the patient participation in the rehabilitation activities.

Description

DESCRIPTION
METHODS, SYSTEMS, AND COMPUTER READABLE MEDIA FOR
PROVIDING PATIENT TAILORED STROKE OR BRAIN INJURY REHABILITATION USING WEARABLE DISPLAY
PRIORITY CLAIM
This application claims the priority benefit of U.S. Provisional Patent Application Serial No. 62/082,404, filed November 20, 2014, the disclosure of which is incorporated herein by reference in its entirety.
TECHNICAL FIELD
The subject matter described herein relates to stroke or brain injury rehabilitation. More particularly, the subject matter described herein relates to methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using a wearable display.
BACKGROUND
Stroke is the leading cause of disability in the United States. Disability includes paralysis, loss of coordination, language impairment, and vision impairment. Effective physical therapy is crucial to stroke rehabilitation. However, traditional physical therapy is resource intensive and expensive. Newer types of physical therapy involve computers and console-based sensors, such as the Kinect® sensor. However, such sensors are stationary and thus tied to a particular location. Moreover, existing applications for fixed and mobile platforms are typically not tied to deficits of an individual patient. What is needed is a rehabilitation platform that facilitates rehabilitation activities in different locations and that can be customized to individual patients' deficits.
Accordingly, there exists a need for methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using a wearable display. SUMMARY
Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using a wearable display are provided. One system includes a wearable display for displaying images to a brain injury or stroke rehabilitation patient. A processor is operatively associated with the wearable display for controlling the images displayed to the patient. A brain injury or stroke rehabilitation application is executable by the processor for providing for selection of patient tailored rehabilitation activity domains and for controlling the wearable display to prompt the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains. The system further includes at least one sensor for monitoring the patient's rehabilitation activities, and the brain injury or stroke rehabilitation application records results from the patient participation in the rehabilitation activities.
The subject matter described herein may be implemented in hardware, software, firmware, or any combination thereof. As such, the terms "function" "node" or "module" as used herein refer to hardware, which may also include software and/or firmware components, for implementing the feature being described. In one exemplary implementation, the subject matter described herein may be implemented using a computer readable medium having stored thereon computer executable instructions that when executed by the processor of a computer control the computer to perform steps. Exemplary computer readable media suitable for implementing the subject matter described herein include non-transitory computer-readable media, such as disk memory devices, chip memory devices, programmable logic devices, and application specific integrated circuits. In addition, a computer readable medium that implements the subject matter described herein may be located on a single device or computing platform or may be distributed across multiple devices or computing platforms.
BRIEF DESCRIPTION OF THE DRAWINGS
The subject matter described herein will now be explained with reference to the accompanying drawings of which: Figure 1 is a block diagram illustrating a system for patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein;
Figure 2 includes drawings of computer screen shots and an overall flow of patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein; and
Figure 3 is a flow chart illustrating an exemplary process for patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein.
DETAILED DESCRIPTION
Figure 1 is a block diagram illustrating an exemplary system for patient tailored stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein. Referring to Figure 1 , the system includes a wearable display 100, for displaying images to a brain injury or stroke rehabilitation patient. Wearable display 100 may be any suitable wearable display capable of displaying virtual images to the patient and either allowing the patient to view the patient's real environment in real time through the display or displaying video of the patient's real environment. One example of a wearable display suitable for use with embodiment of the subject matter described herein is an eyeglasses mounted, see through display, such as the Google Glass® display. Another example of a wearable display suitable for use with embodiments of the subject matter described herein is a head mountable display, such as an augmented reality (AR) or virtual reality (VR) display that is part of a helmet or other frame designed to be worn on the patient's head.
In Figure 1 , the system further includes a processor 102 for controlling the images displayed to the patient via wearable display 100. Processor 102 may be an on-board processor in that the processor is physically mounted to the same frame (e.g., helmet or eyeglasses frame) as wearable display 100. In other implementations, processor 102 may be located on a separate device, such as a mobile phone or other portable device, that is communicatively but not physically coupled to the display. A combination of on-board and off-board processing is also intended to be within the scope of the subject matter described herein.
The system illustrated in Figure 1 further includes a stroke or brain injury rehabilitation application 104 that provides for user selection of patient tailored rehabilitation activity domains and for controlling wearable display 100 to prompt the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains. Examples of stroke or brain injury rehabilitation activities will be provided below.
The system illustrated in Figure 1 further includes at least one sensor 106 for monitoring patient participation in the rehabilitation activities and recording results from the patient participation. Sensor 106 may be a camera, accelerometer, gyroscope, Global Positioning System (GPS) receiver, or any combination thereof that is capable of monitoring a patient's participation in rehabilitation activities.
Sensor 106 may be located on the same platform as wearable display
100 or may be located on a separate platform from wearable display 100 without departing from the scope of the subject matter described herein. In some implementations, some sensors, such as a camera, may be mounted to the same frame as wearable display 100 and other sensors, such as a GPS receiver, may be located on a mobile phone that is separate from the physical platform or frame of wearable display 100. Application 104 may record results of the patient's participation in rehab activities as recorded by sensor 106.
In one embodiment, application 104 may be written for use with an open source operation system, such as Android®. Using an open source operating system may allow application 104 to be used on current platforms that use Android®, such as the Google Glass® platform and also on future computing platforms that are developed for the Android® operating system.
The system illustrated in Figure 1 may further include a communication interface 108 for communicating results of the patient's participation in a rehabilitation activity to an external process or computing platform 110. Communication interface 108 may be a wireless communication interface, such as a Bluetooth, Wi-Fi, or cellular interface. In an alternate implementation, communication interface 108 may be a wired interface, such as a universal serial bus (USB) interface.
Figure 2 illustrates drawings of computer screen shots of exemplary rehabilitation activities that may be facilitated by application 104 as well as an overall flow of application operation. In Figure 2, in block 200, the patient or the rehabilitation provider (physical therapist or physician) selects a mode of operation for application 104. In the illustrated example, the modes of operation include independent mode and collaborative mode. In the independent mode, application 104 operates under control of the patient without interaction with the provider. In collaborative mode, application 104 prompts the patient to perform rehabilitation activities in collaboration with the provider. In block 202, application 104 provides for selection of rehabilitation domains tailored to a patient's deficits. In the illustrated example, the rehabilitation domains include balance, coordination, endurance, strength, upper extremity control, vision training, language, and cognition. Once the user (i.e., the provider or the patient) selects the domains, application 104 controls wearable display 100 to display images that guide the patient through rehabilitation activities corresponding to the selected domains. In block 204, application 104 provides feedback to the provider. The feedback may include timing, trajectory, video, or other indication of results of the patient's participation in the rehabilitation activities.
In the upper part of Figure 2, the leftmost image drawing illustrates an example of a rehabilitation activity that may be facilitated by application 104 for the upper extremity control domain. In the illustrated example, application 104 controls wearable display 100 to display a virtual object to the patient. Application 104, via display 100, the patient to hit or touch the apparent location of the virtual object as displayed to the patient on display 100. The patient then moves the patient's hand to the apparent location of the virtual object. If the patient correctly selects the apparent location, application 104 may provide positive auditory and/or visual feedback to the patient. Application 104 may also record the timing and trajectory of the patient's extremity in moving towards the apparent location of the virtual object. In the central image drawing in Figure 2, application 104 displays images to the patient corresponding to the balance and/or coordination rehabilitation domains. In the illustrated example, application 104 locks or focuses on an object that the patient sees through wearable display 100. In this example, the object may be an image of the physical therapist or physician. Application 104 controls display 100 to display a visual prompt which tells the patient in which direction to move to go towards the targeted object. The patient's movements, timing of the movements, and trajectory may be recorded.
In the rightmost image drawing in Figure 2, application 104 controls display 100 to display a virtual balance indicator to the patient, which corresponds to the coordination and upper extremity control rehabilitation domains. The patient is prompted to raise the patient's arms to a certain height and make the patient's arms level with each other. The virtual balance indicator indicates the relative vertical positions of the patient's hands or arms.
Figure 3 is a flow chart illustrating an exemplary process for stroke or brain injury rehabilitation using a wearable display according to an embodiment of the subject matter described herein. Referring to Figure 3, in step 300, a wearable display is provided for displaying images to a stroke or brain injury rehabilitation patient. The wearable display may be any of the types of wearable displays described above. In step 302, a selection of patient tailored rehabilitation domains is received. The selection of rehabilitation domains may be received by application 104 in response to patient or provider input. Examples of such domains are displayed in block 202 in Figure 2.
In step 304, images are displayed on the wearable display for prompting the patient to perform brain injury or stroke rehabilitation activities corresponding to the selected domains. The images may be virtual images that the patient sees in combination with the patient's perception of the real world or video images of the patient's environment. Examples are illustrated in the images in Figure 2. In step 306, results from the patient's participation in the rehabilitation activities are recorded by application 104. The results may be video of the patient's participation in rehab activities or information, such as statistics, derived from the patient's participation as detected by sensor 106. The results may be stored in memory on the same platform as wearable display 100 or may be communicated off platform to a mobile phone or computer that is communicatively coupled to the display platform. In step 308, the results are communicated to the provider. For example, the results may be communicated to a physician or therapist through a wired or wireless interface.
Thus, the subject matter described herein, by providing patient tailored stroke or brain injury rehabilitation using a wearable display, includes a special purpose computing platform, i.e., a wearable display platform, that is specifically controlled to prompt the patient to participate in stroke or brain injury rehabilitation activities. Such a platform improves the technological fields of stroke and brain injury rehabilitation.
It will be understood that various details of the presently disclosed subject matter may be changed without departing from the scope of the presently disclosed subject matter. Furthermore, the foregoing description is for the purpose of illustration only, and not for the purpose of limitation.

Claims

CLAIMS What is claimed is:
1 . A system for providing patient tailored stroke or brain injury rehabilitation using a wearable display, the system comprising:
a wearable display for displaying images to a stroke or brain injury rehabilitation patient;
a processor operatively associated with the display for controlling the images displayed to the stroke or brain injury rehabilitation patient;
a stroke or brain injury rehabilitation application executable by the processor for providing for selection of patient tailored stroke or brain injury rehabilitation activity domains and for controlling the display to prompt the patient to perform stroke or brain injury rehabilitation activities corresponding to the selected domains; and at least one sensor for monitoring patient participation in the rehabilitation activities, wherein the application records results of the patient participation in the rehabilitation activities based on the monitoring by the at least one sensor.
2. The system of claim 1 wherein the wearable display comprises a see through display for displaying virtual images corresponding to the rehabilitation domains to the patient and for allowing the patient to view a real environment in which the patient is located through the display.
3. The system of claim 1 wherein the wearable display comprises a video display for displaying video images of a real environment in which the patient is located combined with virtual images corresponding to the selected rehabilitation domains.
4. The system of claim 1 wherein the stroke or brain injury rehabilitation application provides for selection from one or more of balance, coordination, endurance, strength, upper extremity control, vision training, language, and cognition rehabilitation domains.
5. The system of claim 1 wherein the stroke or brain injury rehabilitation application controls the display to display a virtual object on the display and a prompt for prompting the patient to move one of the patient's extremities to an apparent location of the virtual object.
The system of claim 1 wherein the stroke or brain injury rehabilitation application focuses on a local target and displays a virtual image for directing the patient to move towards the local target.
The system of claim 1 wherein the stroke or brain injury rehabilitation application displays a virtual level indicator to the patient corresponding to a relative vertical position of extremities of the patient.
A method for providing patient tailored stroke or brain injury rehabilitation using a wearable display, the method comprising:
providing for selection of patient tailored stroke or brain injury rehabilitation activity domains;
controlling a wearable display to prompt the patient to perform stroke or brain injury rehabilitation activities corresponding to the selected domains;
monitoring patient participation in the rehabilitation activities; and
recording, from the monitoring, results of the patient participation in the rehabilitation activities.
The method of claim 8 wherein the wearable display comprises a see through display for displaying virtual images corresponding to the rehabilitation domains to the patient and for allowing the patient to view a real environment in which the patient is located through the display.
The method of claim 8 wherein the wearable display comprises a video display for displaying video images of a real environment in which the patient is located combined with virtual images corresponding to the selected rehabilitation domains.
The method of claim 8 wherein providing for selection of stroke or brain injury rehabilitation domains includes providing for selection from one or more of balance, coordination, endurance, strength, upper extremity control, vision training, language, and cognition rehabilitation domains.
The method of claim 8 wherein controlling the wearable display comprises controlling the display to display a virtual object on the display and a prompt for prompting the patient to move one of the patient's extremities to an apparent location of the virtual object.
The method of claim 8 wherein controlling the wearable display comprises controlling the display to focus on a local target and displaying a virtual image for directing the patient to move towards the local target.
The method of claim 8 wherein controlling the wearable display comprises controlling the display to display a virtual level indicator to the patient corresponding to a relative vertical position of extremities of the patient.
A non-transitory computer readable medium having stored thereon executable instructions that when executed by a processor of a computer controls the computer to perform steps comprising:
providing for selection of patient tailored stroke or brain injury rehabilitation activity domains;
controlling a wearable display to prompt the patient to perform stroke or brain injury rehabilitation activities corresponding to the selected domains;
monitoring patient participation in the rehabilitation activities; and
recording, from the monitoring, results of the patient participation in the rehabilitation activities.
PCT/US2015/061848 2014-11-20 2015-11-20 Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using wearable display Ceased WO2016081830A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462082404P 2014-11-20 2014-11-20
US62/082,404 2014-11-20

Publications (1)

Publication Number Publication Date
WO2016081830A1 true WO2016081830A1 (en) 2016-05-26

Family

ID=56014597

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/061848 Ceased WO2016081830A1 (en) 2014-11-20 2015-11-20 Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using wearable display

Country Status (1)

Country Link
WO (1) WO2016081830A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109545325A (en) * 2019-01-18 2019-03-29 董安琴 A kind of wearable upper limb intelligent rehabilitation device of hemiplegic patient
EP3621084A1 (en) * 2018-09-10 2020-03-11 Przedsiebiorstwo Produkcyjno Uslugowe "Stolgraf" Pasternak, Rodziewicz Spolka Jawna A system and a method for generating a virtual reality environment for exercises via a wearable display
US10950336B2 (en) 2013-05-17 2021-03-16 Vincent J. Macri System and method for pre-action training and control
US11116441B2 (en) 2014-01-13 2021-09-14 Vincent John Macri Apparatus, method, and system for pre-action therapy
US11673042B2 (en) 2012-06-27 2023-06-13 Vincent John Macri Digital anatomical virtual extremities for pre-training physical movement
US11804148B2 (en) 2012-06-27 2023-10-31 Vincent John Macri Methods and apparatuses for pre-action gaming
US11904101B2 (en) 2012-06-27 2024-02-20 Vincent John Macri Digital virtual limb and body interaction
WO2025243030A1 (en) 2024-05-21 2025-11-27 Imperial College Innovations Limited Monitoring limb movement

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080191864A1 (en) * 2005-03-31 2008-08-14 Ronen Wolfson Interactive Surface and Display System
US20120108909A1 (en) * 2010-11-03 2012-05-03 HeadRehab, LLC Assessment and Rehabilitation of Cognitive and Motor Functions Using Virtual Reality
US20140276130A1 (en) * 2011-10-09 2014-09-18 The Medical Research, Infrastructure and Health Services Fund of the Tel Aviv Medical Center Virtual reality for movement disorder diagnosis and/or treatment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080191864A1 (en) * 2005-03-31 2008-08-14 Ronen Wolfson Interactive Surface and Display System
US20120108909A1 (en) * 2010-11-03 2012-05-03 HeadRehab, LLC Assessment and Rehabilitation of Cognitive and Motor Functions Using Virtual Reality
US20140276130A1 (en) * 2011-10-09 2014-09-18 The Medical Research, Infrastructure and Health Services Fund of the Tel Aviv Medical Center Virtual reality for movement disorder diagnosis and/or treatment

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11673042B2 (en) 2012-06-27 2023-06-13 Vincent John Macri Digital anatomical virtual extremities for pre-training physical movement
US11804148B2 (en) 2012-06-27 2023-10-31 Vincent John Macri Methods and apparatuses for pre-action gaming
US11904101B2 (en) 2012-06-27 2024-02-20 Vincent John Macri Digital virtual limb and body interaction
US10950336B2 (en) 2013-05-17 2021-03-16 Vincent J. Macri System and method for pre-action training and control
US11116441B2 (en) 2014-01-13 2021-09-14 Vincent John Macri Apparatus, method, and system for pre-action therapy
US11944446B2 (en) 2014-01-13 2024-04-02 Vincent John Macri Apparatus, method, and system for pre-action therapy
EP3621084A1 (en) * 2018-09-10 2020-03-11 Przedsiebiorstwo Produkcyjno Uslugowe "Stolgraf" Pasternak, Rodziewicz Spolka Jawna A system and a method for generating a virtual reality environment for exercises via a wearable display
CN109545325A (en) * 2019-01-18 2019-03-29 董安琴 A kind of wearable upper limb intelligent rehabilitation device of hemiplegic patient
WO2025243030A1 (en) 2024-05-21 2025-11-27 Imperial College Innovations Limited Monitoring limb movement

Similar Documents

Publication Publication Date Title
WO2016081830A1 (en) Methods, systems, and computer readable media for providing patient tailored stroke or brain injury rehabilitation using wearable display
US11036292B2 (en) Menu navigation in a head-mounted display
US9818230B2 (en) Environmental interrupt in a head-mounted display and utilization of non field of view real estate
JP2022000640A (en) Information processing device, information processing method, and information processing program
KR101988110B1 (en) Virtual Reality Education System and Method based on Bio Sensors
US20180204380A1 (en) Method and apparatus for providing guidance in a virtual environment
KR102516096B1 (en) Information processing system and information processing method
KR101792715B1 (en) Exercise management system simulating real environment
KR102512855B1 (en) Information processing device and information processing method
US20200143774A1 (en) Information processing device, information processing method, and computer program
KR102160669B1 (en) Medical communication virtual training simulation system and method
KR20180057870A (en) Method for generating motion information and electronic device thereof
EP4468124A1 (en) Method and system for guiding a user in calibrating an eye tracking device
US12099115B2 (en) Method for operating electronic data glasses in a motor vehicle, and electronic data glasses
JP2019076302A (en) Ar device, method, and program
US12009097B2 (en) Wireless communication system for remote medical assistance
KR102894676B1 (en) Extended reality device providing immersive services in the experience space, a management device for managing the same, and control methods thereof
KR20170090877A (en) Apparatus and Method for Interactive User Calibration
KR20220046177A (en) Method and device for virtual reality-based eye health measurement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15860463

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15860463

Country of ref document: EP

Kind code of ref document: A1