CN106816054A - For the interactive teaching method and terminal of intelligent robot - Google Patents
For the interactive teaching method and terminal of intelligent robot Download PDFInfo
- Publication number
- CN106816054A CN106816054A CN201710196860.0A CN201710196860A CN106816054A CN 106816054 A CN106816054 A CN 106816054A CN 201710196860 A CN201710196860 A CN 201710196860A CN 106816054 A CN106816054 A CN 106816054A
- Authority
- CN
- China
- Prior art keywords
- teaching
- knowledge
- scene
- interactive
- interactive teaching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The present invention provides a kind of interactive teaching method and terminal for intelligent robot.Interactive teaching method includes:Current scene picture is obtained using image collecting device;Image procossing is carried out to current scene picture, to identify each object in current scene picture;Each object that will identify that is identified;Whether there is the knowledge entry for corresponding to each object for being identified in judgemental knowledge storehouse;If having corresponding knowledge entry in knowledge base, determine whether whether knowledge entry associates with Teaching Module;Combining with teaching module generates the multi-modal output data related to the content of courses and exports.Artificial intelligence equipment of the invention can carry out graphical analysis to the scene in reality, and under corresponding teaching applied environment with reference to knowledge base searching go out corresponding knowledge and carry out Scene Teaching to user, make the study of knowledge closer to the life of user.Triggered by similar scene, carry out knowledge teaching, user can be allowed to more fully understand knowledge.
Description
Technical field
The present invention relates to field in intelligent robotics, specifically, it is related to a kind of interactive teaching side for intelligent robot
Method and terminal.
Background technology
With the progress of science and technology, the application field of artificial intelligence has been deep into side's aspect of people's life
Face.Current company type intelligent robot can substitute the partial function of the mankind step by step in terms of man-machine interaction, with
Talked at family.
However, intelligent robot except with can substitute the mankind carry out some interaction function in addition to, in fact may be used also
Various experience are brought with to user.For example, being imparted knowledge to students instead of teacher, being provided knowledge etc..However, for deepization of this respect
Application, scientific and technical personnel are also having tried to.
The content of the invention
It is an object of the invention to provide a kind of interactive teaching method and terminal for intelligent robot.According to the present invention
Interactive teaching method, it is comprised the following steps:
Current scene picture is obtained using image collecting device;
Image procossing is carried out to the current scene picture, to identify each object in the current scene picture;
Each object that will identify that is identified;
Whether there is the knowledge entry for corresponding to each object for being identified in judgemental knowledge storehouse;
If in knowledge base have corresponding knowledge entry, determine whether the knowledge entry whether with Teaching Module
Association;
The multi-modal output data related to the content of courses is generated with reference to the Teaching Module and export.
Interactive teaching method of the invention, it is preferred that in the teaching for judging to have associated by the knowledge entry
During module, ask whether to enter the voice messaging of Scene Teaching to user's output.
Interactive teaching method of the invention, it is preferred that the Teaching Module includes multiple Scene Teaching applications;
Wherein, judge that the step of whether the knowledge entry associates with Teaching Module further includes:
Judge the knowledge entry whether with the Teaching Module in any Scene Teaching association;
The step of generating the multi-modal output data related to the content of courses with reference to the Teaching Module and export is further
Including:
It is determined that the Scene Teaching application associated with the knowledge entry, starts the Scene Teaching application, answered with reference to described
With generating the multi-modal output data related to the content of courses and export.
Interactive teaching method of the invention, the Scene Teaching application preferably includes poem teaching, interesting English
Practise, Chinese idiom building sequence is played.
Interactive teaching method of the invention, the knowledge base is preferably stored on far-end server, is taken by accessing
Device is engaged in search the corresponding knowledge entry of the associated element.
Interactive teaching method of the invention, it is preferred that in the step of each object that will identify that is identified,
Each object that will identify that carries out permutation and combination as the associated element in Scene Teaching to the associated element.
Whether interactive teaching method of the invention, have in preferred judgemental knowledge storehouse correspond in one embodiment
The knowledge entry of the permutation and combination.
According to another aspect of the present invention, a kind of interactive teaching terminal for intelligent robot is additionally provided.It is described
Interactive teaching terminal includes:
Image collecting device, it is used to obtain current scene picture;
Memory, is stored thereon with program;
CPU, it is connected with the memory, and to perform described program, described program is operationally completed such as
Step in upper described method;
Loudspeaker, to carry out interactive voice with user, and by multi-modal defeated related to the content of courses of voice output
Go out data.
Interactive teaching terminal of the invention, preferably described interactive teaching terminal also includes display screen, and it is used to
The display multi-modal output data related to the content of courses to be exported.
Present invention be advantageous in that, artificial intelligence equipment of the invention can carry out image point to the scene in reality
Analysis, and under corresponding teaching applied environment with reference to knowledge base searching go out corresponding knowledge Scene Teaching is carried out to user, make
Life of the study of knowledge closer to user.Triggered by similar scene, carry out knowledge teaching, user can be allowed more preferably geographical
Solution knowledge.
Other features and advantages of the present invention will be illustrated in the following description, also, the partly change from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for specification, with reality of the invention
Apply example to be provided commonly for explaining the present invention, be not construed as limiting the invention.In the accompanying drawings:
Fig. 1 shows the overall procedure of the interactive teaching method for being used for intelligent robot according to an embodiment of the invention
Figure;
Fig. 2 shows the detailed process of the interactive teaching method for being used for intelligent robot according to an embodiment of the invention
Figure;
Fig. 3 shows the Scene Teaching application example included according to the present invention;And
Fig. 4 shows the structured flowchart of interactive teaching terminal according to an embodiment of the invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, the embodiment of the present invention is made below in conjunction with accompanying drawing
Further describe in detail.
Embodiment one
As shown in figure 1, which show the interactive teaching method for being used for intelligent robot according to an embodiment of the invention
Overview flow chart.
Method starts from step S101, and intelligent robot obtains current scene picture using image collecting device.Intelligent machine
Device people perceives scene within the vision using its vision system in real time in the interaction with user.It is particularly on the scene
When scape changes, intelligent robot can be perceived first, and opened image collecting function and carried out image capture.
Next, in step s 102, intelligent robot carries out image procossing to the current scene picture for being captured, to know
Each object not gone out in current scene picture.Then, each object that will identify that is identified, step S103.
In step S104, according to the knowledge base of the object search intelligent robot for being identified, to be in judgemental knowledge storehouse
The no knowledge entry preserved corresponding to each object for being identified.If having corresponding knowledge entry in knowledge base, enter one
Step judges whether the knowledge entry associates with Teaching Module, step S105.Interactive teaching method of the invention, preferably
It is that in the step of each object that will identify that is identified, each object that will identify that is used as the association unit in Scene Teaching
Element, and permutation and combination is carried out to associated element.In one embodiment, it is preferred that, intelligent robot needs judgemental knowledge storehouse
In whether have corresponding to the permutation and combination knowledge entry.
Step S106, combining with teaching module generates the multi-modal output data related to the content of courses and exports.
In one embodiment, it is preferred that, there is correspondence knowledge entry in knowledge base and there is knowledge entry institute
During the Teaching Module of association, ask whether to enter the voice messaging of Scene Teaching to user's output.
Teaching Module includes multiple Scene Teaching applications, and Scene Teaching application preferably includes poem teaching, interesting English
Practise, Chinese idiom building sequence is played, as shown in Figure 3.The present invention only lists these three Scene Teaching applications as an example, in practical application
More Scene Teaching applications can be realized in Teaching Module.
Wherein, the step of whether judgemental knowledge entry associates with Teaching Module further includes:
Judgemental knowledge entry whether with Teaching Module in any Scene Teaching association;
Combining with teaching module generates the multi-modal output data related to the content of courses and is further included the step of output:
It is determined that the Scene Teaching application associated with knowledge entry, starts Scene Teaching application, connected applications generation and teaching
The related multi-modal output data of content is simultaneously exported.
Interactive teaching method of the invention, knowledge base is preferably stored on far-end server, by intelligent robot
Access server searches the corresponding knowledge entry of associated element.
Embodiment two
After intelligent robot opens Scene Teaching application, camera shoots real time picture.The time of captured in real-time picture
Interval can voluntarily be set.Camera obtains current scene picture in real time, by carrying out graphical analysis, identifies many in picture
Object is planted, and object is identified, step S201.
Object to identifying is arranged, and the permutation and combination of each element is obtained, by being directed in server judgemental knowledge storehouse
Whether the element combinations have corresponding knowledge entry, step S202.If it has, then being putd question to from equipment to user, if open
Scene TeachingIf obtaining positive response, output correspondence knowledge entry.
Under a situation, such as intelligent robot photographs a pictures, after analysis in the interaction with user
Obtain element combinations:Face+flower, analysis obtains the correspondence entry that is stored with knowledge base.At this moment, intelligent robot can inquire use
Family:" this image and scene allow me to remember stich, and you want to listenIf " obtain the affirmative acknowledgement (ACK) of user after, open situation poem
Teaching application:" me is so allowed to tell you.In today last year this door, the peach blossoms are as lovely as one's sweetheart's cheeks.People does not know in face that where exists, peach
Flower still laughs at spring breeze." according to the present invention, intelligent robot as needed, can also explain the meaning of above-mentioned poem, analyze feelings
Border, reaches the effect taught through lively activities.
In another case, such as intelligent robot photographs a pictures in the interaction with user, analysis
After obtain element combinations:The moon+sky.For the element of combination, retrieved in knowledge base, found wherein corresponding word
Bar, environment inquiry:" see【The moon】(content can be changed with element in this bracket) feels a strong urge to write poetry suddenly, wants with me to poem”
If obtaining the affirmative acknowledgement (ACK) of user, intelligent robot will open band【Month】The application of the poem building sequence game of word.
In for the Teaching Module of such as English study, a pictures are photographed, by the vision system of intelligent robot
Element is obtained after system analysis:Cup.Then retrieved in knowledge base, and determined there is corresponding entry, Ran Houshe in knowledge base
It is standby to inquire:" you know【Cup】English" if the affirmative acknowledgement (ACK) of user is obtained, tell user:" the English of cup
It is Glass. "
In summary, interactive teaching method of the invention realizes various object elements by flexibly using machine vision
Identification and mark, knowledge dissemination is carried out then in conjunction with the situation for identifying, such that it is able to deepen the impression of learner, enhancing religion
Learn the interest of application.
Because the method for the present invention describes what is realized in computer systems.The computer system can for example be set
In the control core processor of robot.For example, method described herein can be implemented as what can be performed with control logic
Software, it is performed by the CPU in robot control system.Function as herein described can be implemented as storage to be had in non-transitory
Programmed instruction set in shape computer-readable medium.When implemented in this fashion, the computer program includes one group of instruction,
When group instruction is run by computer, it promotes computer to perform the method that can implement above-mentioned functions.FPGA can be temporary
When or be permanently mounted in non-transitory tangible computer computer-readable recording medium, for example ROM chip, computer storage,
Disk or other storage mediums.In addition to being realized with software, logic as herein described can utilize discrete parts, integrated electricity
What road and programmable logic device (such as, field programmable gate array (FPGA) or microprocessor) were used in combination programmable patrols
Volume, or embodied including any other equipment that they are combined.All such embodiments are intended to fall under model of the invention
Within enclosing.
Therefore, according to another aspect of the present invention, a kind of interactive teaching terminal for intelligent robot is additionally provided
400, as shown in Figure 4.The interactive teaching terminal 400 includes:
Image collecting device 401, it is used to obtain current scene picture;
Memory 403, is stored thereon with program;
CPU 402, it is connected with the memory, and with configuration processor, the program operationally completes above-mentioned
Step in method;
Loudspeaker 405, to carry out interactive voice with user, and by multi-modal related to the content of courses of voice output
Output data.
Additionally, interactive teaching terminal also includes display screen 404, it is used to show to be exported related to the content of courses many
Mode output data.
It should be understood that disclosed embodiment of this invention is not limited to ad hoc structure disclosed herein, process step
Or material, and the equivalent substitute of these features that those of ordinary skill in the related art are understood should be extended to.Should also manage
Solution, term as used herein is only used for describing the purpose of specific embodiment, and is not intended to limit.
" one embodiment " or " embodiment " mentioned in specification means special characteristic, the structure for describing in conjunction with the embodiments
Or characteristic is included at least one embodiment of the present invention.Therefore, the phrase " reality that specification various places throughout occurs
Apply example " or " embodiment " same embodiment might not be referred both to.
While it is disclosed that implementation method as above, but described content is only to facilitate understanding the present invention and adopting
Implementation method, is not limited to the present invention.Any those skilled in the art to which this invention pertains, are not departing from this
On the premise of the disclosed spirit and scope of invention, any modification and change can be made in the formal and details implemented,
But scope of patent protection of the invention, must be still defined by the scope of which is defined in the appended claims.
Claims (9)
1. a kind of interactive teaching method for intelligent robot, it is characterised in that the described method comprises the following steps:
Current scene picture is obtained using image collecting device;
Image procossing is carried out to the current scene picture, to identify each object in the current scene picture;
Each object that will identify that is identified;
Whether there is the knowledge entry for corresponding to each object for being identified in judgemental knowledge storehouse;
If having corresponding knowledge entry in knowledge base, determine whether whether the knowledge entry closes with Teaching Module
Connection;
The multi-modal output data related to the content of courses is generated with reference to the Teaching Module and export.
2. interactive teaching method as claimed in claim 1, it is characterised in that judging exist associated by the knowledge entry
During Teaching Module, ask whether to enter the voice messaging of Scene Teaching to user's output.
3. interactive teaching method as claimed in claim 1, it is characterised in that the Teaching Module includes that multiple Scene Teachings should
With;
Wherein, judge that the step of whether the knowledge entry associates with Teaching Module further includes:
Judge the knowledge entry whether with the Teaching Module in any Scene Teaching association;
The multi-modal output data related to the content of courses is generated with reference to the Teaching Module and further included the step of output:
It is determined that the Scene Teaching application associated with the knowledge entry, starts the Scene Teaching application, with reference to application life
Into the multi-modal output data related to the content of courses and export.
4. interactive teaching method as claimed in claim 3, it is characterised in that the Scene Teaching application include poem teaching,
Interesting English study, Chinese idiom building sequence game.
5. the interactive teaching method as any one of claim 1-4, it is characterised in that the knowledge base is stored in distal end
On server, the corresponding knowledge entry of the associated element is searched by access server.
6. interactive teaching method as claimed in claim 5, it is characterised in that in the step that each object that will identify that is identified
In rapid, each object that will identify that carries out permutation and combination as the associated element in Scene Teaching to the associated element.
7. interactive teaching method as claimed in claim 6, it is characterised in that whether have in judgemental knowledge storehouse correspond to it is described
The knowledge entry of permutation and combination.
8. a kind of interactive teaching terminal for intelligent robot, it is characterised in that the interactive teaching terminal includes:
Image collecting device, it is used to obtain current scene picture;
Memory, is stored thereon with program;
CPU, it is connected with the memory, and to perform described program, described program is operationally completed such as right
It is required that the step in method any one of 1-7;
Loudspeaker, to carry out interactive voice with user, and by the voice output multi-modal output number related to the content of courses
According to.
9. interactive teaching terminal as claimed in claim 8, it is characterised in that the interactive teaching terminal also includes display screen,
It is used to show the multi-modal output data related to the content of courses to be exported.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710196860.0A CN106816054A (en) | 2017-03-29 | 2017-03-29 | For the interactive teaching method and terminal of intelligent robot |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710196860.0A CN106816054A (en) | 2017-03-29 | 2017-03-29 | For the interactive teaching method and terminal of intelligent robot |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106816054A true CN106816054A (en) | 2017-06-09 |
Family
ID=59116400
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710196860.0A Pending CN106816054A (en) | 2017-03-29 | 2017-03-29 | For the interactive teaching method and terminal of intelligent robot |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106816054A (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108876676A (en) * | 2018-06-15 | 2018-11-23 | 四川文理学院 | A kind of robot teaching's method and system based on scene |
CN109147433A (en) * | 2018-10-25 | 2019-01-04 | 重庆鲁班机器人技术研究院有限公司 | Childrenese assistant teaching method, device and robot |
CN110110043A (en) * | 2019-04-11 | 2019-08-09 | 中山大学 | A kind of multi-hop visual problem inference pattern and its inference method |
CN110827179A (en) * | 2019-10-18 | 2020-02-21 | 引力互联国际有限公司 | Method, apparatus and storage medium for providing artificial intelligence education |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101681564A (en) * | 2007-05-22 | 2010-03-24 | 株式会社阿奈特 | Content generation system, content generation device, and content generation program |
CN202058320U (en) * | 2011-04-28 | 2011-11-30 | 北京银盘电子技术有限公司 | Reading pen with display screen |
CN103914996A (en) * | 2014-04-24 | 2014-07-09 | 广东小天才科技有限公司 | Method and device for acquiring character learning materials from picture |
CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method and smartphone for implementing reading learning |
CN104575137A (en) * | 2015-01-19 | 2015-04-29 | 肖龙英 | Split-type scene interaction multimedia intelligent terminal |
-
2017
- 2017-03-29 CN CN201710196860.0A patent/CN106816054A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101681564A (en) * | 2007-05-22 | 2010-03-24 | 株式会社阿奈特 | Content generation system, content generation device, and content generation program |
CN202058320U (en) * | 2011-04-28 | 2011-11-30 | 北京银盘电子技术有限公司 | Reading pen with display screen |
CN103914996A (en) * | 2014-04-24 | 2014-07-09 | 广东小天才科技有限公司 | Method and device for acquiring character learning materials from picture |
CN104253904A (en) * | 2014-09-04 | 2014-12-31 | 广东小天才科技有限公司 | Method and smartphone for implementing reading learning |
CN104575137A (en) * | 2015-01-19 | 2015-04-29 | 肖龙英 | Split-type scene interaction multimedia intelligent terminal |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108876676A (en) * | 2018-06-15 | 2018-11-23 | 四川文理学院 | A kind of robot teaching's method and system based on scene |
CN109147433A (en) * | 2018-10-25 | 2019-01-04 | 重庆鲁班机器人技术研究院有限公司 | Childrenese assistant teaching method, device and robot |
CN110110043A (en) * | 2019-04-11 | 2019-08-09 | 中山大学 | A kind of multi-hop visual problem inference pattern and its inference method |
CN110827179A (en) * | 2019-10-18 | 2020-02-21 | 引力互联国际有限公司 | Method, apparatus and storage medium for providing artificial intelligence education |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107240319B (en) | A kind of interaction Scene Teaching system for the K12 stage | |
CN106816054A (en) | For the interactive teaching method and terminal of intelligent robot | |
WO2019156332A1 (en) | Device for producing artificial intelligence character for augmented reality and service system using same | |
CN109658352A (en) | Optimization method and device, electronic equipment and the storage medium of image information | |
US11657085B1 (en) | Optical devices and apparatuses for capturing, structuring, and using interlinked multi-directional still pictures and/or multi-directional motion pictures | |
US9076345B2 (en) | Apparatus and method for tutoring in convergence space of real and virtual environment | |
CN111008542A (en) | Object concentration analysis method and device, electronic terminal and storage medium | |
CN112289239B (en) | Dynamically adjustable explaining method and device and electronic equipment | |
CN110213668A (en) | Generation method, device, electronic equipment and the storage medium of video title | |
CN110298327A (en) | A kind of visual effect processing method and processing device, storage medium and terminal | |
CN113160231A (en) | Sample generation method, sample generation device and electronic equipment | |
CN107438019A (en) | Smart home learning control method, device and system | |
CN105072478A (en) | Life recording system and method based on wearable equipment | |
CN110868538A (en) | Method and electronic equipment for recommending shooting posture | |
Paterson et al. | The world through Glass: developing novel methods with wearable computing for urban videographic research | |
CN109089045A (en) | A kind of image capture method and equipment and its terminal based on multiple photographic devices | |
CN105320242A (en) | Photographing method and photographing terminal | |
CN107479906A (en) | cross-platform online education mobile terminal based on Cordova | |
US20190034757A1 (en) | Method and system for on-device image recognition | |
CN108647710A (en) | A kind of method for processing video frequency, device, computer and storage medium | |
CN104112374B (en) | Distant learning scoring apparatus and method | |
CN113822263A (en) | Image annotation method and device, computer equipment and storage medium | |
WO2023241377A1 (en) | Video data processing method and device, equipment, system, and storage medium | |
CN202907086U (en) | Campus video system based on Internet of things | |
Zheng et al. | Uavs in multimedia: Capturing the world from a new perspective |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170609 |
|
RJ01 | Rejection of invention patent application after publication |