{"id":4786,"date":"2024-06-07T11:13:39","date_gmt":"2024-06-07T11:13:39","guid":{"rendered":"https:\/\/pan-assistant.de\/?page_id=4786"},"modified":"2024-11-26T08:29:06","modified_gmt":"2024-11-26T08:29:06","slug":"mesmerize","status":"publish","type":"page","link":"https:\/\/wp.pan-assistant.de\/?page_id=4786&lang=en","title":{"rendered":"Front Page"},"content":{"rendered":"

Problem<\/h2>

Post-traumatic brain injury, individuals often struggle with adapting to both familiar and unfamiliar environments, including their own residences. The intensive reorientation training necessary to mitigate these issues demands a significant amount of personnel resources. Currently, there is no provision for in-house training.<\/p> <\/div>

\"\"<\/div> <\/div><\/div> <\/div>
\"\"<\/div>

Solution<\/h2>

The PAN-Assistant is designed to facilitate independent training for patients within their own environments (route training in the therapy area, orientation training at home). Utilizing software, patients can virtually rehearse their individual routes and visit landmarks.

Gradually, the affected individuals are expected to learn to navigate, for instance, within the therapy area.<\/p> <\/div> <\/div><\/div> <\/div>

Details<\/h2>

Cognitive impairments are a common aftermath of brain damage (e.g., stroke or traumatic brain injury). Some individuals also experience disorientation, which hinders their ability to navigate both familiar and unfamiliar environments, including their own homes. The capacity to acquire new knowledge is often compromised as well.

Currently, disorientation is managed in everyday clinical practice through repeated practice of action steps in individual therapeutic care. This method is labor-intensive and time-consuming, resulting in inadequate treatment coverage, particularly for severely affected patients. The \u201cPAN-Assistant\u201d project is developing software for self-training that enables safe and individually tailored virtual path and orientation training. Technologies from the realms of virtual reality (VR) and augmented reality (AR) are being utilized.

Given the often severe and typically complex physical and\/or mental limitations in individuals with severe brain injuries, the development of digital therapy concepts presents both a technical and clinical challenge. The project team comprises industrial partners as well as academic and clinical institutions. Special emphasis is placed on the continuous involvement of the affected individuals to develop a digital training tool that is accepted by people with disabilities and is therapeutically beneficial.

In the future, the \u201cPAN Assistant\u201d aims to provide a technical solution for individually tailored orientation training to enhance the independence and participation of the affected individuals. This introduces a novel therapeutic approach that complements and expands current practice. The fundamental principles of this technology will also be applicable in other areas of neurorehabilitation in the future.<\/p><\/div> <\/div>

<\/div> <\/div><\/div> <\/div>

Results<\/h2> <\/div> <\/div>
<\/i>
AR-Showcase<\/h5>

In our augmented reality showcase, we aim to raise our patients\u2019 environmental awareness through active engagement with and co-creation of their surroundings. The resident initially chooses the starting area and is then routed to the location with the help of an on-screen map. Once arrived, a specific location is chosen in AR and marked with a personal sculpture object. Throughout successive training sessions, the shape and appearance of the sculpture is designed by the patients choices and the characteristics of its location. Once the rehab residence ends, the patient can take home their creation as a physical 3D print. Additionally our designers have also developed a case for people with hemiparesis that makes it easier to use the iPad with just one hand.\n<\/p> <\/div>

<\/i>
Wearable \/ Amulet<\/h5>

Lastly, we developed a small, neck-worn wearable called the Amulet that interacts with stationary display devices positioned at various landmarks throughout the rehab center. This device enables patients to practice preset routes at their own pace. The Amulet acts solely as a spatial checklist to navigate sequentially along the chosen route, but when a patient approaches a nearby display device, the display becomes active and indicates the correct direction with a clear visual cue. For example, if a patient passes the entrance and is approaching the garden landmark, the wearable will vibrate to draw the patient\u2019s attention, and a moving arrow will appear on the garden display, indicating the direction to the next waypoint. Progress along the route is updated on the trainer\u2019s user interface.<\/p> <\/div>

<\/i>
VR-Showcase<\/h5>

In the first showcase, we use immersive virtual reality with a head mounted display in which residents can virtually navigate through 3D scans of the rehab center. This includes their living area, the outdoor area and the therapy building, but also a route outside the rehab center to the nearest bus stop which includes sequential panorama pictures. They train relevant routes by completing tasks such as finding an object and placing it in a specific location. Depending on the level of difficulty, they can follow arrows or our virtual avatar PANi and consult a map of the surroundings.\n

\n<\/p>

Latest update: 06\/20\/2024<\/h5><\/div>
<\/i>
Trainer UI<\/h5>

A trainer interface includes manuals of each system and enables tracking the resident\u2019s progression and adjustment of training difficulty. Each resident has their own profile where relevant info, like their individual needs, is documented and where they and the therapy team can review completed training sessions and plan upcoming ones.<\/p> <\/div><\/div><\/div> <\/div>

Gallery<\/h2> <\/div> <\/div>
<\/div>
<\/div>
AR-Showcase \u2013 erste User Tests<\/a><\/div> <\/div><\/div> <\/div>

AR showcase:
First usage tests with residents on the grounds of the P.A.N. Zentrum<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
AR-Showacase \u2013 Verbesserter Hardware-Prototyp<\/a><\/div> <\/div><\/div> <\/div>

AR showcase:
A self-developed cover for one-handed use of the tablet for residents with physical limitations<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
AR-Showcase \u2013 verschiedene Bereiche<\/a><\/div> <\/div><\/div> <\/div>

AR showcase:
Division of the entire site into different areas, with different elements to discover<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

Wearable \/ Amulet:
The first prototype of the \u201cAmulet\u201d, which inconspicuously assists in finding the target<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

Wearable \/ Amulet:
Beacons with illuminated arrows communicate with the \u201cAmulet\u201d to indicate a change of direction<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

Wearable \/ Amulet:
Construction of a self-developed beacon with light indicator <\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

VR showcase:
PANi shows the way to the library in the virtual image of the PAN center<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

VR showcase:
A minimap helps to classify your own location in the entire environment<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

VR showcase:
PANi asks the resident for help to find the way to the mailbox<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

Draft of the Trainer UI:
A dashboard provides an overview of the latest events<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

Draft of the Trainer UI:
A dashboard provides an overview of the latest events<\/p><\/div> <\/div><\/div> <\/div>

<\/div>
<\/div>
Design \u2013 Dashboard<\/a><\/div> <\/div><\/div> <\/div>

Draft of the Trainer UI:
A dashboard provides an overview of the latest events<\/p><\/div> <\/div><\/div> <\/div><\/div>

<\/div> <\/div><\/div> <\/div>

Partner<\/h2> <\/div> <\/div>
\"\"<\/div>
\"\"<\/div>
\"\"<\/div>
\"\"<\/div>
\"\"<\/div> <\/div><\/div> <\/div>

CONTACT NOW<\/h2>

We will gladly answer your questions.<\/p><\/div> <\/div>