WO2018223523A1

WO2018223523A1 - Educational robot

Info

Publication number: WO2018223523A1
Application number: PCT/CN2017/096869
Authority: WO
Inventors: 袁晖
Original assignee: 深圳市科迈爱康科技有限公司
Priority date: 2017-06-08
Filing date: 2017-08-10
Publication date: 2018-12-13
Also published as: CN107369341A

Abstract

In an educational robot, a main controller (11) determines a facial region of a student from video data collected by a visual module (17), extracts characteristic information of the facial region, and determines, according to the characteristic information, whether the attention of the student is paying attention. If the student is distracted, an alert instruction is transmitted to an alert component. Upon receiving the alert instruction transmitted by the main controller, the alert component transmits alert information to effectively and timely alert a distracted student.

Description

Educational robot

Technical field

The invention relates to the field of artificial intelligence technology, and in particular to an educational robot.

Background technique

Educational robots are robotic finished products, suits or parts that are specially developed by manufacturers to stimulate students' interest in learning and to develop students' comprehensive abilities. In addition to the robot body itself, educational robots also have corresponding control software and teaching textbooks.

According to the shape, educational robots can be divided into two categories: one is a robot with a basic shape, and students can add modules and modify them. The other type is a building block robot with no fixed shape and only a pile of parts. Students can build robots of various shapes according to their own imagination. The basic structure of the two types of robots mainly includes functional modules such as the main board, various sensors, motion devices, and generators.

Applying educational robots to the teaching of traditional courses can develop early intelligence and stimulate students' interest in learning. Educational robots can be introduced in various traditional disciplines, injecting new teaching elements into traditional courses and increasing the vitality of the curriculum. For example, in the plane geometry class, writing a program in Logo language allows the robot to walk out of various trajectories and draw corresponding graphics in the simulation environment to visually visualize students' understanding of various graphics; for example, in In the physics class, robots can be used to replace the traditional car to verify the relationship between speed, displacement and time of uniform linear motion. For example, in the music class, the teacher can let the robot dance according to the beat of the music (doing various actions). In order to cultivate students' sense of rhythm.

However, most of the current educational robots have a fixed shape and a single color. Students are relatively short-term relatives, and it is easy to gradually lose interest and lead to inattention.

The above content is only used to assist in understanding the technical solutions of the present invention, and does not constitute an admission that the above is prior art.

Summary of the invention

The main object of the present invention is to provide an educational robot aimed at solving the technical problem that students are prone to inattention in the process of learning through an educational robot.

To achieve the above object, the present invention provides an educational robot including: a vision module, a main controller, and a reminder component;

The visual module is configured to perform video collection on a student, obtain video data, and send the obtained video data to the main controller;

The main controller is configured to determine a face area of the student from the video data, extract feature information of the face area, and determine, according to the feature information, whether the attention of the student is concentrated, and the attention of the student When the force is not concentrated, sending a reminder instruction to the reminder component;

The reminding component is configured to send reminder information when receiving the reminder instruction sent by the main controller.

Preferably, the main controller is further configured to extract an eyeball feature of the face region, and determine whether the student's attention is concentrated according to the eyeball feature.

Preferably, the main controller is further configured to extract an eyeball feature of the eye region, match the eyeball feature with a preset feature set, and determine whether the student's attention is concentrated according to the matching result.

Preferably, the main controller is further configured to extract an eyeball feature of the face region within a preset time range, and match an eyeball feature in the preset time range with a preset feature set, where the matching result is When the match is unsuccessful, it is determined that the student's attention is not concentrated.

Preferably, the reminding component comprises: a music playing module and/or a color conversion module;

The music playing module is configured to play music when receiving the reminder instruction sent by the main controller;

The color conversion module is configured to convert the current illumination color when receiving the reminder instruction sent by the main controller.

Preferably, the educational robot further comprises: a remote connection module;

The remote connection module is configured to remotely connect with other robots to form a blockchain network.

Preferably, the educational robot further includes: a data transmission module and a human machine interface module;

The data transmission module is configured to acquire first multimedia information that is being played by the target robot, and send the first multimedia information to the main controller, where the target robot belongs to the educational robot a robot with the same blockchain;

The main controller is further configured to forward the first multimedia information to the human interface module;

The human interface module is configured to play the multimedia information.

Preferably, the educational robot further comprises: a data storage module;

The human interface module is further configured to receive a keyword input by a user, and transmit the keyword to the main controller;

The main controller is further configured to search for second multimedia information corresponding to the keyword in the data storage module, and feed back the second multimedia information to the human interface module.

Preferably, the main controller is further configured to forward the keyword to the data transmission module;

The data transmission module is further configured to search for third multimedia information corresponding to the keyword in the target robot, and send the third multimedia information to the main controller;

The main controller is further configured to forward the third multimedia information to the human interface module.

Preferably, the educational robot further comprises: a positioning module and a moving module connected to the main controller.

The invention determines the face area of the student from the video data acquired by the main controller from the visual module, extracts the feature information of the face area, and determines whether the attention of the student is concentrated according to the feature information, in the student's When the attention is not concentrated, the reminding component sends a reminding instruction, and the reminding component sends a reminding message when receiving the reminding instruction sent by the main controller, so that when the student's attention is not concentrated, the student can be promptly and effectively reminded.

DRAWINGS

1 is a block diagram showing the structure of a remote diagnosis and treatment robot according to a first embodiment of the present invention;

2 is a structural block diagram of a remote diagnosis and treatment robot according to a second embodiment of the present invention;

FIG. 3 is a schematic diagram of a blockchain network according to an embodiment of the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Referring to FIG. 1, a first embodiment of the present invention provides an educational robot, including: a visual module 17, a main controller 11, and a reminding component;

The visual module 17 is configured to perform video capture on a student, obtain video data, and send the obtained video data to the main controller 11;

In a specific implementation, the visual module 17 can adopt a camera. Of course, since the robot may be applied to a plurality of students, in order to improve the imaging shooting angle, thereby ensuring that a plurality of students can be photographed, the embodiment The visual module 17 can employ a fisheye camera.

The main controller 11 is configured to determine a face area of the student from the video data, extract feature information of the face area, and determine, according to the feature information, whether the student's attention is concentrated, in the student's When the attention is not concentrated, sending a reminder instruction to the reminding component;

It should be noted that the main controller 11 may identify a human body region in the video data by using a preset human body model, and then determine a facial region of the student from the human body region according to a positional relationship between the facial body and the human body.

It can be understood that the feature information of the face area can select an expression feature (ie, whether the facial region of the student has an expression such as a daze or the like), but since the number of students is large, it is difficult to accurately extract, so that the feature information is accurate. In the embodiment, the feature information of the face area may select an eyeball feature, that is, the main controller 11 is further configured to extract an eyeball feature of the face region, and determine the eyeball feature according to the eyeball feature. Whether the students’ attention is concentrated.

In order to facilitate judging whether the attention of the student is concentrated, a preset feature set may be pre-established, that is, the preset feature set includes a plurality of eye features capable of reflecting attention concentration, and is determined by means of feature matching. Whether the attention of the student is concentrated, that is, the main controller 11 is further configured to extract an eyeball feature of the eye region, match the eyeball feature with a preset feature set, and determine according to the matching result. Whether the student's attention is concentrated.

In a specific implementation, when the student concentrates, the pupil is usually staring at the educational robot. Therefore, the eyeball feature may be the pupil orientation information. Of course, the eyeball feature may also adopt other information, which is not in this embodiment. Limit it.

It should be understood that, because the student may have a blinking phenomenon, if a match is made when the student blinks, a mismatch may occur, and in order to avoid the problem, in the embodiment, the main controller may also be used to extract the The eyeball feature of the face area in the preset time range is matched with the preset feature set in the preset time range, and when the matching result is unsuccessful, the student's attention is determined not to be concentrated.

It can be understood that, when the attention of the student is not concentrated, the main controller 11 may pre-determine whether the learning time exceeds a preset time length, and if the preset time length is not exceeded, may send the reminder component. The reminder instruction, if it exceeds the preset length of time, indicates that the student may be in a fatigue period, and may prompt the student to take a break to suspend the study.

It should be noted that in order to facilitate the reminder when the students are not focused, it is necessary to issue a reminder message, but in the specific implementation, the method of playing music and color conversion can be used to remind the student, thereby stimulating the student's learning. Interest, that is, referring to FIG. 2, the reminder component may include: a music playing module 16 and/or a color conversion module 50;

The music playing module 16 is configured to play music when receiving the reminder instruction sent by the main controller 11;

In a specific implementation, the music may be a relaxing music, such as: light pure music, and the like.

The color conversion module 50 is configured to convert the current illumination color when receiving the reminder instruction sent by the main controller 11.

It can be understood that the educational robot usually emits light when working (for example, the current illuminating color is white, that is, white light is emitted), thereby prompting the student to be in a working state, and the color conversion module 50 can convert the current illuminating color, for example, : Converts the current illuminating color from white to sky blue.

Of course, in the specific implementation, other methods can be used for reminding, for example, the fragrance (such as floral fragrance), the robot deformation, the remote person video communication, and the like are implemented, which is not limited in this embodiment.

In this embodiment, the main controller determines the facial region of the student from the video data acquired by the visual module, extracts feature information of the facial region, and determines whether the student's attention is concentrated according to the feature information, and the student is When the attention is not concentrated, the reminding component sends a reminding instruction, and the reminding component sends a reminding message when receiving the reminding instruction sent by the main controller, so that when the student's attention is not concentrated, the student can be promptly and effectively reminded .

In this embodiment, the educational robot further includes: a remote connection module 15;

The remote connection module 15 is configured to remotely connect with other robots to form a blockchain network. The blockchain network may refer to FIG. 3.

It should be noted that the blockchain network has no limitation on the geographical location of the robot, that is, not only can several robots in the same region form a blockchain network, but also several robots in different regions can form a block. Chain network.

In this embodiment, the educational robot may further include: a data transmission module 14 and a human machine interface module 12;

The data transmission module 14 is configured to acquire first multimedia information that is being played by the target robot, and send the first multimedia information to the main controller 11, where the target robot is Robots belonging to the same blockchain;

The main controller 11 is further configured to forward the first multimedia information to the human interface module;

The human interface module 12 is configured to play the multimedia information.

It should be noted that the human interface module 12 is a module for interacting with the student, which may be a combination of a display and a keyboard, or a touch screen, and of course, other components. Limit it.

In order to facilitate the search of the multimedia information according to the student's needs, in this embodiment, the educational robot further includes: a data storage module 13;

The human interface module 12 is further configured to receive a keyword input by a user, and transmit the keyword to the main controller 11;

In a specific implementation, the keyword may be input through a keyboard, and of course, the input may be performed by using a voice or the like, which is not limited in this embodiment.

It should be noted that the user may be a student, and of course, may also be a teacher. This embodiment does not limit this.

The main controller 11 is further configured to search for the second multimedia information corresponding to the keyword in the data storage module 13, and feed back the second multimedia information to the human interface module. 12.

Since the storage space of the data storage module 13 of one robot is limited, in order to ensure as many resources as possible in the blockchain, different multimedia information may be stored in the data storage module 13, that is, the main controller 11, Also used to forward the keyword to the data transmission module 13;

The data transmission module 13 is further configured to search for third multimedia information corresponding to the keyword in the target robot, and send the third multimedia information to the main controller 11;

The main controller 11 is further configured to forward the third multimedia information to the human interface module 12.

In order to facilitate remote voice communication, in the embodiment, the educational robot further includes: a voice module 18 connected to the main controller 11.

In order to facilitate the movement, in the embodiment, the educational robot further includes: a positioning module 40, a moving module 30 and a vision module 17 connected to the main controller.

It can be understood that, in order to facilitate management of the power supply, in this embodiment, a power management module 20 connected to the main controller 11 may also be disposed.

In the embodiment of the present invention, in a middle school located in a certain place in Shenzhen, the physics teacher starts the educational robot and begins to explain the gravitation to dozens of students. Subsequently, a student asked questions to understand the actual impact of gravity on the major planets in the solar system. At this time, the physics teacher instructs the educational robot to access the Internet by voice, search for and present the best relevant pictures or videos to the students. After receiving the voice command, the educational robot automatically accesses the blockchain network to search for and analyze related data. In less than a minute, the educational robot played a small piece of a mock documentary about the movement of the major planets of the solar system under the gravitational force of the teachers and students, which answered the student's problems well and inspired the students. Their interest in learning.

In an embodiment of the present invention, a professor at a certain university in Guangzhou started an educational robot and began to explain organic synthesis to dozens of students. Then, in order to give students a better understanding of palladium-catalyzed hydrogenation experiments, the chemistry professor remotely connected to a petrochemical company located in Maoming by voice-directed educational robots. After receiving the voice command, the educational robot automatically accesses the blockchain network and establishes a remote connection with the educational robot located at the relevant petrochemical company. Then, the two educational robots interacted remotely to show the teachers and students in the classroom the pictures and sounds of the practical application of the palladium-catalyzed hydrogenation process, as well as the engineers' field explanations. Therefore, the students have profoundly learned the basic principles and practical applications of palladium-catalyzed hydrogenation experiments.

In the embodiment of the present invention, a primary school student is located in a certain place in Beijing, and a primary school student learns English accompanied by an educational robot. Later, through facial recognition, the educational robot found that the pupil's attention began to decline, and there was no concentrated learning. At this time, the educational robot began to gradually change from pure white to sky blue, while playing light and pure music, which made the pupils feel refreshed, and immediately resumed their interest in learning and re-concentrated their spirits to learn English.

In the embodiment of the present invention, a primary school student is located in a certain place in Xi'an, and a primary school student learns mathematics accompanied by an educational robot. During a period of time, the educational robot repeatedly found that the primary school student was not focused, and then issued a reminder to the parents or remote teaching staff: the teaching materials currently used are not suitable for the student. After receiving the confirmation from the primary school student, the parents or distance learning personnel will send out the demand information in the blockchain network, quickly find the teaching materials that meet the needs of the primary school students, re-energize the primary school students' interest in learning mathematics, and improve the teaching efficiency.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or Also includes other elements not explicitly listed, or Includes elements inherent to such a process, method, item, or system. In the absence of more restrictions, an element defined by the phrase "including one..." is not excluded from the process of including the element, There are additional identical elements in the method, item or system.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims

An educational robot, characterized in that the educational robot comprises: a visual module, a main controller and a reminding component;

The visual module is configured to perform video collection on a student, obtain video data, and send the obtained video data to the main controller;

The main controller is configured to determine a face area of the student from the video data, extract feature information of the face area, and determine, according to the feature information, whether the attention of the student is concentrated, and the attention of the student When the force is not concentrated, sending a reminder instruction to the reminder component;

The reminding component is configured to send reminder information when receiving the reminder instruction sent by the main controller.
The educational robot according to claim 1, wherein the main controller is further configured to extract an eyeball feature of the face region, and determine whether the student's attention is concentrated according to the eyeball feature.
The educational robot according to claim 2, wherein the main controller is further configured to extract an eyeball feature of the eye region, match the eyeball feature with a preset feature set, and determine according to a matching result. Whether the student's attention is concentrated.
The educational robot according to claim 3, wherein the main controller is further configured to extract an eyeball feature of the face region within a preset time range, and to select an eyeball feature within the preset time range The preset feature set is matched, and when the matching result is unsuccessful, the student's attention is determined to be inconsistent.
The educational robot according to claim 1, wherein the reminding component comprises: a music playing module and/or a color conversion module;

The music playing module is configured to play music when receiving the reminder instruction sent by the main controller;

The color conversion module is configured to convert the current illumination color when receiving the reminder instruction sent by the main controller.
The educational robot according to claim 2, wherein the reminding component comprises: a music playing module and/or a color converting module;

The music playing module is configured to play music when receiving the reminder instruction sent by the main controller;

The color conversion module is configured to convert the current illumination color when receiving the reminder instruction sent by the main controller.
The educational robot according to claim 3, wherein the reminding component comprises: a music playing module and/or a color converting module;

The music playing module is configured to play music when receiving the reminder instruction sent by the main controller;

The color conversion module is configured to convert the current illumination color when receiving the reminder instruction sent by the main controller.
The educational robot according to claim 4, wherein the reminding component comprises: a music playing module and/or a color conversion module;

The music playing module is configured to play music when receiving the reminder instruction sent by the main controller;

The color conversion module is configured to convert the current illumination color when receiving the reminder instruction sent by the main controller.
The educational robot according to claim 1, wherein the educational robot further comprises: a remote connection module;

The remote connection module is configured to remotely connect with other robots to form a blockchain network.
The educational robot according to claim 2, wherein the educational robot further comprises: a remote connection module;

The remote connection module is configured to remotely connect with other robots to form a blockchain network.
The educational robot according to claim 3, wherein the educational robot further comprises: a remote connection module;

The remote connection module is configured to remotely connect with other robots to form a blockchain network.
The educational robot according to claim 4, wherein the educational robot further comprises: a remote connection module;

The remote connection module is configured to remotely connect with other robots to form a blockchain network.
The educational robot according to claim 9, wherein the educational robot further comprises: a data transmission module and a human machine interface module;

The data transmission module is configured to acquire first multimedia information that is being played by the target robot, and send the first multimedia information to the main controller, where the target robot belongs to the educational robot a robot with the same blockchain;

The main controller is further configured to forward the first multimedia information to the human interface module;

The human interface module is configured to play the multimedia information.
The educational robot according to claim 13, wherein the educational robot further comprises: a data storage module;

The human interface module is further configured to receive a keyword input by a user, and transmit the keyword to the main controller;

The main controller is further configured to search for second multimedia information corresponding to the keyword in the data storage module, and feed back the second multimedia information to the human interface module.
The educational robot according to claim 14, wherein the main controller is further configured to forward the keyword to the data transmission module;

The data transmission module is further configured to search for third multimedia information corresponding to the keyword in the target robot, and send the third multimedia information to the main controller;

The main controller is further configured to forward the third multimedia information to the human interface module.
The educational robot according to claim 1, wherein said educational robot further comprises: a positioning module and a moving module connected to the main controller.
The educational robot according to claim 2, wherein said educational robot further comprises: a positioning module and a moving module connected to the main controller.
The educational robot according to claim 3, wherein said educational robot further comprises: a positioning module and a moving module connected to the main controller.
The educational robot according to claim 4, wherein the educational robot further comprises: a positioning module and a moving module connected to the main controller.
The educational robot according to claim 1, wherein said educational robot further comprises: a power management module connected to said main controller.