Article

In this research work, we present a Multimodal Guidance System (MGS) whose aim is
to provide dynamic assistance to persons with disabilities (PWD) while performing
manual activities such as drawing, coloring in and foam-cutting tasks. The MGS
provides robotic assistance in the execution of 2D tasks through haptic and sound
interactions. Haptic technology provides the virtual path of 2D shapes through
the point-based approach,
while sound technology provides audio feedback inputs
related to the hand's velocity while sketching and filling or cutting operations.
By combining this Multimodal System with the haptic assistance, we have created a
new approach with possible applications to such diverse fields as physical
rehabilitation, scientific investigation of sensorimotor learning and assessment
of hand movements in PWD.
The MGS has been tested by people with specific
disorders affecting coordination, such as Down syndrome and developmental
disabilities, under the supervision of their teachers and care assistants inside
their learning environment.
A Graphic User Interface has been designed for
teachers and care assistants in order to provide training during the test
sessions. Our results provide conclusive evidence that the effect of using the
MGS increases the accuracy in the tasks operations. IMPLICATIONS FOR
REHABILITATION: The Multimodal Guidance System (MGS) is an interface that offers
haptic and sound feedback while performing manual tasks. Several studies
demonstrated that the haptic guidance systems can help people in recovering
cognitive function at different levels of complexity and impairment. The
applications supported by our device could also have an important role in
supporting physical therapist and cognitive psychologist in helping patients to recover motor and visuo-spatial abilities.

Langue : ANGLAIS