Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Deep transfer learning in human-robot interaction for cognitive and physical rehabilitation purposes
Aqdus Ilyas C., Rehm M., Nasrollahi K., Madadi Y., Moeslund T., Seydi V. Pattern Analysis & Applications25 (3):653-677,2022.Type:Article
Date Reviewed: Oct 17 2022

Despite the huge number of publicly available images, emotion recognition for real applications suffers from a lack of relevant images. This challenge is considered here, where the task involves interpreting the facial expressions of patients with severe impairments who are under cognitive and physical rehabilitation in a specialized center.

The authors built a small dataset of facial expressions, involving the patients in engaging activities, with the aim to cover the six standard emotion expressions. According to the literature, they adopted a convolutional neural network (CNN), pre-trained on a large number of images from healthy people, to extract features and then fine-tune them with patient data. This transfer learning overcomes the limitations of learning from small datasets.

Since the end goal is to provide healthcare personnel with a better understanding of their patients’ emotions, and to then use this knowledge to tailor rehabilitation activities, an automatic system based on the Pepper robot was tested. The robot uses audio, visual, and gestures to motivate patients when they exhibit negative emotions; moreover, data collected from the robot gives feedback to the operators.

The paper has many technical details and considerations, both about the images and the learning methods, which can be of interest in reproducing the results or extending them to other cases.

According to the authors, the salient results show improvement with regards to the accuracy of emotion recognition and provide preliminary indications that a robot in the rehabilitation process can make it more effective. Some questions, however, remain. What about the costs of such a system? What about the risks of automatizing human-to-human interactions? Finally, what are the opinions of the patients? These and many more questions arise from reading the paper.

Reviewer:  G. Gini Review #: CR147504 (2301-0008)
Bookmark and Share
  Editor Recommended
Featured Reviewer
Health (J.3 ... )
Robotics (I.2.9 )
Would you recommend this review?
Other reviews under "Health": Date

Spangler R.Type: Article
Jul 1 1988
Mapping the brain and its functions
Pechura C., Martin J., National Academy Press, Washington, DC, 1991. Type: Book (9780309044974)
Sep 1 1992
Personal computers and the disabled
McWilliams P., Doubleday, New York, NY, 1984. Type: Book (9789780385196857)
Aug 1 1985

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2023 ThinkLoud®
Terms of Use
| Privacy Policy