loading page

Project overview on multimodal XR-AI platform for tele-rehab and the reciprocal care coupling with health guidance
  • +15
  • Takeshi Kurata ,
  • Kunihiro OGATA ,
  • Shusuke KANAZAWA ,
  • Yumeko IMAMURA ,
  • Akihiro SATO ,
  • Satoki OGISO ,
  • Yoshiyuki Kobayashi ,
  • Ryosuke Ichikari ,
  • Satoshi NAKAE ,
  • Mitsunori TADA ,
  • Tomoki AOYAMA ,
  • Hiroki SHIMIZU ,
  • Hideaki KUZUOKA ,
  • Takuto NAKAMURA ,
  • Takeshi KOSHIHARA ,
  • Masao KURODA ,
  • Hidemitsu SORIMACHI ,
  • Kensuke Oshima
Takeshi Kurata
AIST, AIST

Corresponding Author:[email protected]

Author Profile
Kunihiro OGATA
Author Profile
Shusuke KANAZAWA
Author Profile
Yumeko IMAMURA
Author Profile
Akihiro SATO
Author Profile
Satoki OGISO
Author Profile
Yoshiyuki Kobayashi
Author Profile
Ryosuke Ichikari
Author Profile
Satoshi NAKAE
Author Profile
Mitsunori TADA
Author Profile
Tomoki AOYAMA
Author Profile
Hiroki SHIMIZU
Author Profile
Hideaki KUZUOKA
Author Profile
Takuto NAKAMURA
Author Profile
Takeshi KOSHIHARA
Author Profile
Masao KURODA
Author Profile
Hidemitsu SORIMACHI
Author Profile
Kensuke Oshima
Author Profile

Abstract

The purpose of this project is to mitigate and solve issues regarding health care services such as rehabilitation and specific health guidance while alleviating spatio-temporal, economic, and cognitive constraints by establishing remote technology foundation. There are four themes in this project titled “Multimodal XR-AI (XR powered by AI) platform development for tele-rehabilitation and the reciprocal care coupling with health guidance.” In theme #1, we have been developing MR3 (Multi-Modal Mixed Reality for Remote Rehab) devices consisting of Wear and Mannequin for supporting detailed assessments of customers’ physical functions and tactile interaction respectively. The central issue of theme #2 is to support intrinsic motivation for rehabilitation and exercise training through XR technologies as in virtual co-embodiment and hand redirection. In addition, we have also been investigating how to deal with one-to-many (a small number of providers) and zero-to-many (no providers) situations. Theme #3 has aimed on establishing AI technology foundation for creating, monitoring progress of, and updating tele-rehab programs mainly for the upper limb. Systems for always-on monitoring during daily life and work developed in theme #4 is expected to be served as a common foundation for various tele-healthcare services.