Introduction
English Social Robot is a robot designed specifically for
kindergarten student and
primary
school students. Its primary function is to facilitate English language learning in
an
engaging and interactive manner.
The English Social Robot is equipped with various technologies and features to perform a range
of
functions, including:
- Using AI cameras to identify hand gestures during interactive learning.
- "Text to Speech" capability which allows students to verbally communicate with
the
robot, providing answers to questions and interacting in real-time.
- Integrating sophisticated language models, such as ChatGPT, into the backend
system
to evaluate the students' verbal responses, providing immediate and accurate
feedback.
- Generating images from a simple description with a text-to-image AI model,
enabling
the robot to generate pictures and adding a visual dimension to the learning
experience.
UX Opportunities
user flow revolves around a robot application that offers
various features. It
includes a chat mode where users can interact with the robot through conversation.
Additionally, there is a face registration feature that allows users to register their
faces for personalized experiences.
The application also offers three distinct story modes. The first is the listen mode,
where the robot engages users by narrating stories and encouraging active listening. The
second is the co-tell mode, which involves branching narratives where users can actively
participate in storytelling alongside the robot.
To enhance interaction, the application incorporates a hand gesture feature that allows
users to use gestures to control certain actions or trigger specific responses from the
robot.
Lastly, retell mode provides a space for children to freely retell their own
stories, fostering creativity and self-expression. Additionally, the application
utilizes GPT to grade the user's storytelling result, providing feedback and evaluation.


UI Components
Designed 72 screens for the english social robot application, utilizing a total of 70
components. These prototypes effectively showcase the functionality of various modules
within the application.
Text-to-Image Generation
Immerse yourself in a groundbreaking learning experience where images come to life
through the power of text-to-image AI models. Witness the magic as the robot
effortlessly generates vivid pictures from simple descriptions, elevating the learning
journey with a captivating visual dimension.
Exploring a Range of Emotions with Robot Facial Expressions
By leveraging advanced technologies and techniques, we have developed a sophisticated
system that allows the robot to display a wide spectrum of emotions, including joy,
surprise, sadness, anger, and many more. Through carefully designed facial movements and
expressions, our goal is to create a more engaging and relatable human-robot
interaction.
Issue Log