Supporting Non-Verbal Children Through Human-Robot Interaction

  • Subject:Supporting Non-Verbal Children Through Human-Robot Interaction
  • Type:B.Sc./M.Sc.
  • Supervisor:

    Rixen

Motivation
Nonverbal children can encounter challenges in expressing their basic needs, particularly in the bustling environment of a childcare center where they may easily go unnoticed. The objective of this thesis is to leverage a NAO Robot for the automatic identification of Nonverbal Communication Cards (NCC) utilized by these children. Such cards feature symbols representing specific needs or intentions, allowing the child to communicate desires such as "I am hungry," "I need to use the toilet," "Yes," "No," and more.
Solution
In this thesis, the student is developing a system aimed at detecting and verbalizing the child's intentions through NCCs. This system involves the collaboration between the NAO and an Android tablet. Given the intended use in the dynamic setting of a childcare center, the emphasis of the research lies in ensuring the system's stress resistance. The student will inform their development through the latest knowledge from relevant scientific literature and will evaluate it in a user study upon completion. Successful completion requires good to very good programming skills in Python or Java. While a basic understanding of robotics and human-robot interaction is advantageous, it is not mandatory. The research offers intensive, personalized supervision and the opportunity to contribute to current research areas.
Possible Tasks
  1. Related Work
    Analysis of the research related state-of-the-art of children-robot interaction in the context of disabilities
  2. System Development
    Implement a robust tablet application (Android) that allows the visual detection and identification of communication cards and enables a general control of the required components on the NAO itself through choregraphe or python/java.
  3. Evaluation
    Evaluate the application in a user study. Potentially in the context of an inclusive daycare center.
Research outcome
This work should contribute to the growing body of work on the interaction of social robots and children. If the student is interested, they can engage together with the advisor/supervisor in submitting the thesis as part of a paper to appropriate publication outlets.
Required Skills
Successful completion requires good to very good programming skills in Python or Java. While a basic understanding of robotics and human-robot interaction is advantageous, it is not mandatory. The student should be interested in robots and motivated to support the target group through their thesis.