Project overview on multimodal XR-AI platform for tele-rehab and the
reciprocal care coupling with health guidance
Abstract
The purpose of this project is to mitigate and solve issues regarding
health care services such as rehabilitation and specific health guidance
while alleviating spatio-temporal, economic, and cognitive constraints
by establishing remote technology foundation. There are four themes in
this project titled “Multimodal XR-AI (XR powered by AI) platform
development for tele-rehabilitation and the reciprocal care coupling
with health guidance.” In theme #1, we have been developing MR3
(Multi-Modal Mixed Reality for Remote Rehab) devices consisting of Wear
and Mannequin for supporting detailed assessments of customers’ physical
functions and tactile interaction respectively. The central issue of
theme #2 is to support intrinsic motivation for rehabilitation and
exercise training through XR technologies as in virtual co-embodiment
and hand redirection. In addition, we have also been investigating how
to deal with one-to-many (a small number of providers) and zero-to-many
(no providers) situations. Theme #3 has aimed on establishing AI
technology foundation for creating, monitoring progress of, and updating
tele-rehab programs mainly for the upper limb. Systems for always-on
monitoring during daily life and work developed in theme #4 is expected
to be served as a common foundation for various tele-healthcare
services.