CN106816054A - For the interactive teaching method and terminal of intelligent robot - Google Patents

For the interactive teaching method and terminal of intelligent robot Download PDF

Info

Publication number
CN106816054A
CN106816054A CN201710196860.0A CN201710196860A CN106816054A CN 106816054 A CN106816054 A CN 106816054A CN 201710196860 A CN201710196860 A CN 201710196860A CN 106816054 A CN106816054 A CN 106816054A
Authority
CN
China
Prior art keywords
teaching
knowledge
scene
interactive
interactive teaching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710196860.0A
Other languages
Chinese (zh)
Inventor
赖昱竹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Guangnian Wuxian Technology Co Ltd
Original Assignee
Beijing Guangnian Wuxian Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Guangnian Wuxian Technology Co Ltd filed Critical Beijing Guangnian Wuxian Technology Co Ltd
Priority to CN201710196860.0A priority Critical patent/CN106816054A/en
Publication of CN106816054A publication Critical patent/CN106816054A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention provides a kind of interactive teaching method and terminal for intelligent robot.Interactive teaching method includes:Current scene picture is obtained using image collecting device;Image procossing is carried out to current scene picture, to identify each object in current scene picture;Each object that will identify that is identified;Whether there is the knowledge entry for corresponding to each object for being identified in judgemental knowledge storehouse;If having corresponding knowledge entry in knowledge base, determine whether whether knowledge entry associates with Teaching Module;Combining with teaching module generates the multi-modal output data related to the content of courses and exports.Artificial intelligence equipment of the invention can carry out graphical analysis to the scene in reality, and under corresponding teaching applied environment with reference to knowledge base searching go out corresponding knowledge and carry out Scene Teaching to user, make the study of knowledge closer to the life of user.Triggered by similar scene, carry out knowledge teaching, user can be allowed to more fully understand knowledge.

Description

For the interactive teaching method and terminal of intelligent robot
Technical field
The present invention relates to field in intelligent robotics, specifically, it is related to a kind of interactive teaching side for intelligent robot Method and terminal.
Background technology
With the progress of science and technology, the application field of artificial intelligence has been deep into side's aspect of people's life Face.Current company type intelligent robot can substitute the partial function of the mankind step by step in terms of man-machine interaction, with Talked at family.
However, intelligent robot except with can substitute the mankind carry out some interaction function in addition to, in fact may be used also Various experience are brought with to user.For example, being imparted knowledge to students instead of teacher, being provided knowledge etc..However, for deepization of this respect Application, scientific and technical personnel are also having tried to.
The content of the invention
It is an object of the invention to provide a kind of interactive teaching method and terminal for intelligent robot.According to the present invention Interactive teaching method, it is comprised the following steps:
Current scene picture is obtained using image collecting device;
Image procossing is carried out to the current scene picture, to identify each object in the current scene picture;
Each object that will identify that is identified;
Whether there is the knowledge entry for corresponding to each object for being identified in judgemental knowledge storehouse;
If in knowledge base have corresponding knowledge entry, determine whether the knowledge entry whether with Teaching Module Association;
The multi-modal output data related to the content of courses is generated with reference to the Teaching Module and export.
Interactive teaching method of the invention, it is preferred that in the teaching for judging to have associated by the knowledge entry During module, ask whether to enter the voice messaging of Scene Teaching to user's output.
Interactive teaching method of the invention, it is preferred that the Teaching Module includes multiple Scene Teaching applications;
Wherein, judge that the step of whether the knowledge entry associates with Teaching Module further includes:
Judge the knowledge entry whether with the Teaching Module in any Scene Teaching association;
The step of generating the multi-modal output data related to the content of courses with reference to the Teaching Module and export is further Including:
It is determined that the Scene Teaching application associated with the knowledge entry, starts the Scene Teaching application, answered with reference to described With generating the multi-modal output data related to the content of courses and export.
Interactive teaching method of the invention, the Scene Teaching application preferably includes poem teaching, interesting English Practise, Chinese idiom building sequence is played.
Interactive teaching method of the invention, the knowledge base is preferably stored on far-end server, is taken by accessing Device is engaged in search the corresponding knowledge entry of the associated element.
Interactive teaching method of the invention, it is preferred that in the step of each object that will identify that is identified, Each object that will identify that carries out permutation and combination as the associated element in Scene Teaching to the associated element.
Whether interactive teaching method of the invention, have in preferred judgemental knowledge storehouse correspond in one embodiment The knowledge entry of the permutation and combination.
According to another aspect of the present invention, a kind of interactive teaching terminal for intelligent robot is additionally provided.It is described Interactive teaching terminal includes:
Image collecting device, it is used to obtain current scene picture;
Memory, is stored thereon with program;
CPU, it is connected with the memory, and to perform described program, described program is operationally completed such as Step in upper described method;
Loudspeaker, to carry out interactive voice with user, and by multi-modal defeated related to the content of courses of voice output Go out data.
Interactive teaching terminal of the invention, preferably described interactive teaching terminal also includes display screen, and it is used to The display multi-modal output data related to the content of courses to be exported.
Present invention be advantageous in that, artificial intelligence equipment of the invention can carry out image point to the scene in reality Analysis, and under corresponding teaching applied environment with reference to knowledge base searching go out corresponding knowledge Scene Teaching is carried out to user, make Life of the study of knowledge closer to user.Triggered by similar scene, carry out knowledge teaching, user can be allowed more preferably geographical Solution knowledge.
Other features and advantages of the present invention will be illustrated in the following description, also, the partly change from specification Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing a further understanding of the present invention, and constitutes a part for specification, with reality of the invention Apply example to be provided commonly for explaining the present invention, be not construed as limiting the invention.In the accompanying drawings:
Fig. 1 shows the overall procedure of the interactive teaching method for being used for intelligent robot according to an embodiment of the invention Figure;
Fig. 2 shows the detailed process of the interactive teaching method for being used for intelligent robot according to an embodiment of the invention Figure;
Fig. 3 shows the Scene Teaching application example included according to the present invention;And
Fig. 4 shows the structured flowchart of interactive teaching terminal according to an embodiment of the invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, the embodiment of the present invention is made below in conjunction with accompanying drawing Further describe in detail.
Embodiment one
As shown in figure 1, which show the interactive teaching method for being used for intelligent robot according to an embodiment of the invention Overview flow chart.
Method starts from step S101, and intelligent robot obtains current scene picture using image collecting device.Intelligent machine Device people perceives scene within the vision using its vision system in real time in the interaction with user.It is particularly on the scene When scape changes, intelligent robot can be perceived first, and opened image collecting function and carried out image capture.
Next, in step s 102, intelligent robot carries out image procossing to the current scene picture for being captured, to know Each object not gone out in current scene picture.Then, each object that will identify that is identified, step S103.
In step S104, according to the knowledge base of the object search intelligent robot for being identified, to be in judgemental knowledge storehouse The no knowledge entry preserved corresponding to each object for being identified.If having corresponding knowledge entry in knowledge base, enter one Step judges whether the knowledge entry associates with Teaching Module, step S105.Interactive teaching method of the invention, preferably It is that in the step of each object that will identify that is identified, each object that will identify that is used as the association unit in Scene Teaching Element, and permutation and combination is carried out to associated element.In one embodiment, it is preferred that, intelligent robot needs judgemental knowledge storehouse In whether have corresponding to the permutation and combination knowledge entry.
Step S106, combining with teaching module generates the multi-modal output data related to the content of courses and exports.
In one embodiment, it is preferred that, there is correspondence knowledge entry in knowledge base and there is knowledge entry institute During the Teaching Module of association, ask whether to enter the voice messaging of Scene Teaching to user's output.
Teaching Module includes multiple Scene Teaching applications, and Scene Teaching application preferably includes poem teaching, interesting English Practise, Chinese idiom building sequence is played, as shown in Figure 3.The present invention only lists these three Scene Teaching applications as an example, in practical application More Scene Teaching applications can be realized in Teaching Module.
Wherein, the step of whether judgemental knowledge entry associates with Teaching Module further includes:
Judgemental knowledge entry whether with Teaching Module in any Scene Teaching association;
Combining with teaching module generates the multi-modal output data related to the content of courses and is further included the step of output:
It is determined that the Scene Teaching application associated with knowledge entry, starts Scene Teaching application, connected applications generation and teaching The related multi-modal output data of content is simultaneously exported.
Interactive teaching method of the invention, knowledge base is preferably stored on far-end server, by intelligent robot Access server searches the corresponding knowledge entry of associated element.
Embodiment two
After intelligent robot opens Scene Teaching application, camera shoots real time picture.The time of captured in real-time picture Interval can voluntarily be set.Camera obtains current scene picture in real time, by carrying out graphical analysis, identifies many in picture Object is planted, and object is identified, step S201.
Object to identifying is arranged, and the permutation and combination of each element is obtained, by being directed in server judgemental knowledge storehouse Whether the element combinations have corresponding knowledge entry, step S202.If it has, then being putd question to from equipment to user, if open Scene TeachingIf obtaining positive response, output correspondence knowledge entry.
Under a situation, such as intelligent robot photographs a pictures, after analysis in the interaction with user Obtain element combinations:Face+flower, analysis obtains the correspondence entry that is stored with knowledge base.At this moment, intelligent robot can inquire use Family:" this image and scene allow me to remember stich, and you want to listenIf " obtain the affirmative acknowledgement (ACK) of user after, open situation poem Teaching application:" me is so allowed to tell you.In today last year this door, the peach blossoms are as lovely as one's sweetheart's cheeks.People does not know in face that where exists, peach Flower still laughs at spring breeze." according to the present invention, intelligent robot as needed, can also explain the meaning of above-mentioned poem, analyze feelings Border, reaches the effect taught through lively activities.
In another case, such as intelligent robot photographs a pictures in the interaction with user, analysis After obtain element combinations:The moon+sky.For the element of combination, retrieved in knowledge base, found wherein corresponding word Bar, environment inquiry:" see【The moon】(content can be changed with element in this bracket) feels a strong urge to write poetry suddenly, wants with me to poem” If obtaining the affirmative acknowledgement (ACK) of user, intelligent robot will open band【Month】The application of the poem building sequence game of word.
In for the Teaching Module of such as English study, a pictures are photographed, by the vision system of intelligent robot Element is obtained after system analysis:Cup.Then retrieved in knowledge base, and determined there is corresponding entry, Ran Houshe in knowledge base It is standby to inquire:" you know【Cup】English" if the affirmative acknowledgement (ACK) of user is obtained, tell user:" the English of cup It is Glass. "
In summary, interactive teaching method of the invention realizes various object elements by flexibly using machine vision Identification and mark, knowledge dissemination is carried out then in conjunction with the situation for identifying, such that it is able to deepen the impression of learner, enhancing religion Learn the interest of application.
Because the method for the present invention describes what is realized in computer systems.The computer system can for example be set In the control core processor of robot.For example, method described herein can be implemented as what can be performed with control logic Software, it is performed by the CPU in robot control system.Function as herein described can be implemented as storage to be had in non-transitory Programmed instruction set in shape computer-readable medium.When implemented in this fashion, the computer program includes one group of instruction, When group instruction is run by computer, it promotes computer to perform the method that can implement above-mentioned functions.FPGA can be temporary When or be permanently mounted in non-transitory tangible computer computer-readable recording medium, for example ROM chip, computer storage, Disk or other storage mediums.In addition to being realized with software, logic as herein described can utilize discrete parts, integrated electricity What road and programmable logic device (such as, field programmable gate array (FPGA) or microprocessor) were used in combination programmable patrols Volume, or embodied including any other equipment that they are combined.All such embodiments are intended to fall under model of the invention Within enclosing.
Therefore, according to another aspect of the present invention, a kind of interactive teaching terminal for intelligent robot is additionally provided 400, as shown in Figure 4.The interactive teaching terminal 400 includes:
Image collecting device 401, it is used to obtain current scene picture;
Memory 403, is stored thereon with program;
CPU 402, it is connected with the memory, and with configuration processor, the program operationally completes above-mentioned Step in method;
Loudspeaker 405, to carry out interactive voice with user, and by multi-modal related to the content of courses of voice output Output data.
Additionally, interactive teaching terminal also includes display screen 404, it is used to show to be exported related to the content of courses many Mode output data.
It should be understood that disclosed embodiment of this invention is not limited to ad hoc structure disclosed herein, process step Or material, and the equivalent substitute of these features that those of ordinary skill in the related art are understood should be extended to.Should also manage Solution, term as used herein is only used for describing the purpose of specific embodiment, and is not intended to limit.
" one embodiment " or " embodiment " mentioned in specification means special characteristic, the structure for describing in conjunction with the embodiments Or characteristic is included at least one embodiment of the present invention.Therefore, the phrase " reality that specification various places throughout occurs Apply example " or " embodiment " same embodiment might not be referred both to.
While it is disclosed that implementation method as above, but described content is only to facilitate understanding the present invention and adopting Implementation method, is not limited to the present invention.Any those skilled in the art to which this invention pertains, are not departing from this On the premise of the disclosed spirit and scope of invention, any modification and change can be made in the formal and details implemented, But scope of patent protection of the invention, must be still defined by the scope of which is defined in the appended claims.

Claims (9)

1. a kind of interactive teaching method for intelligent robot, it is characterised in that the described method comprises the following steps:
Current scene picture is obtained using image collecting device;
Image procossing is carried out to the current scene picture, to identify each object in the current scene picture;
Each object that will identify that is identified;
Whether there is the knowledge entry for corresponding to each object for being identified in judgemental knowledge storehouse;
If having corresponding knowledge entry in knowledge base, determine whether whether the knowledge entry closes with Teaching Module Connection;
The multi-modal output data related to the content of courses is generated with reference to the Teaching Module and export.
2. interactive teaching method as claimed in claim 1, it is characterised in that judging exist associated by the knowledge entry During Teaching Module, ask whether to enter the voice messaging of Scene Teaching to user's output.
3. interactive teaching method as claimed in claim 1, it is characterised in that the Teaching Module includes that multiple Scene Teachings should With;
Wherein, judge that the step of whether the knowledge entry associates with Teaching Module further includes:
Judge the knowledge entry whether with the Teaching Module in any Scene Teaching association;
The multi-modal output data related to the content of courses is generated with reference to the Teaching Module and further included the step of output:
It is determined that the Scene Teaching application associated with the knowledge entry, starts the Scene Teaching application, with reference to application life Into the multi-modal output data related to the content of courses and export.
4. interactive teaching method as claimed in claim 3, it is characterised in that the Scene Teaching application include poem teaching, Interesting English study, Chinese idiom building sequence game.
5. the interactive teaching method as any one of claim 1-4, it is characterised in that the knowledge base is stored in distal end On server, the corresponding knowledge entry of the associated element is searched by access server.
6. interactive teaching method as claimed in claim 5, it is characterised in that in the step that each object that will identify that is identified In rapid, each object that will identify that carries out permutation and combination as the associated element in Scene Teaching to the associated element.
7. interactive teaching method as claimed in claim 6, it is characterised in that whether have in judgemental knowledge storehouse correspond to it is described The knowledge entry of permutation and combination.
8. a kind of interactive teaching terminal for intelligent robot, it is characterised in that the interactive teaching terminal includes:
Image collecting device, it is used to obtain current scene picture;
Memory, is stored thereon with program;
CPU, it is connected with the memory, and to perform described program, described program is operationally completed such as right It is required that the step in method any one of 1-7;
Loudspeaker, to carry out interactive voice with user, and by the voice output multi-modal output number related to the content of courses According to.
9. interactive teaching terminal as claimed in claim 8, it is characterised in that the interactive teaching terminal also includes display screen, It is used to show the multi-modal output data related to the content of courses to be exported.
CN201710196860.0A 2017-03-29 2017-03-29 For the interactive teaching method and terminal of intelligent robot Pending CN106816054A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710196860.0A CN106816054A (en) 2017-03-29 2017-03-29 For the interactive teaching method and terminal of intelligent robot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710196860.0A CN106816054A (en) 2017-03-29 2017-03-29 For the interactive teaching method and terminal of intelligent robot

Publications (1)

Publication Number Publication Date
CN106816054A true CN106816054A (en) 2017-06-09

Family

ID=59116400

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710196860.0A Pending CN106816054A (en) 2017-03-29 2017-03-29 For the interactive teaching method and terminal of intelligent robot

Country Status (1)

Country Link
CN (1) CN106816054A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108876676A (en) * 2018-06-15 2018-11-23 四川文理学院 A kind of robot teaching's method and system based on scene
CN109147433A (en) * 2018-10-25 2019-01-04 重庆鲁班机器人技术研究院有限公司 Childrenese assistant teaching method, device and robot
CN110110043A (en) * 2019-04-11 2019-08-09 中山大学 A kind of multi-hop visual problem inference pattern and its inference method
CN110827179A (en) * 2019-10-18 2020-02-21 引力互联国际有限公司 Method, apparatus and storage medium for providing artificial intelligence education

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101681564A (en) * 2007-05-22 2010-03-24 株式会社阿奈特 Content generation system, content generation device, and content generation program
CN202058320U (en) * 2011-04-28 2011-11-30 北京银盘电子技术有限公司 Reading pen with display screen
CN103914996A (en) * 2014-04-24 2014-07-09 广东小天才科技有限公司 Method and device for acquiring character learning materials from picture
CN104253904A (en) * 2014-09-04 2014-12-31 广东小天才科技有限公司 Method and smartphone for implementing reading learning
CN104575137A (en) * 2015-01-19 2015-04-29 肖龙英 Split-type scene interaction multimedia intelligent terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101681564A (en) * 2007-05-22 2010-03-24 株式会社阿奈特 Content generation system, content generation device, and content generation program
CN202058320U (en) * 2011-04-28 2011-11-30 北京银盘电子技术有限公司 Reading pen with display screen
CN103914996A (en) * 2014-04-24 2014-07-09 广东小天才科技有限公司 Method and device for acquiring character learning materials from picture
CN104253904A (en) * 2014-09-04 2014-12-31 广东小天才科技有限公司 Method and smartphone for implementing reading learning
CN104575137A (en) * 2015-01-19 2015-04-29 肖龙英 Split-type scene interaction multimedia intelligent terminal

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108876676A (en) * 2018-06-15 2018-11-23 四川文理学院 A kind of robot teaching's method and system based on scene
CN109147433A (en) * 2018-10-25 2019-01-04 重庆鲁班机器人技术研究院有限公司 Childrenese assistant teaching method, device and robot
CN110110043A (en) * 2019-04-11 2019-08-09 中山大学 A kind of multi-hop visual problem inference pattern and its inference method
CN110827179A (en) * 2019-10-18 2020-02-21 引力互联国际有限公司 Method, apparatus and storage medium for providing artificial intelligence education

Similar Documents

Publication Publication Date Title
CN107240319B (en) A kind of interaction Scene Teaching system for the K12 stage
CN106816054A (en) For the interactive teaching method and terminal of intelligent robot
WO2019156332A1 (en) Device for producing artificial intelligence character for augmented reality and service system using same
CN109658352A (en) Optimization method and device, electronic equipment and the storage medium of image information
US11657085B1 (en) Optical devices and apparatuses for capturing, structuring, and using interlinked multi-directional still pictures and/or multi-directional motion pictures
US9076345B2 (en) Apparatus and method for tutoring in convergence space of real and virtual environment
CN111008542A (en) Object concentration analysis method and device, electronic terminal and storage medium
CN112289239B (en) Dynamically adjustable explaining method and device and electronic equipment
CN110213668A (en) Generation method, device, electronic equipment and the storage medium of video title
CN110298327A (en) A kind of visual effect processing method and processing device, storage medium and terminal
CN113160231A (en) Sample generation method, sample generation device and electronic equipment
CN107438019A (en) Smart home learning control method, device and system
CN105072478A (en) Life recording system and method based on wearable equipment
CN110868538A (en) Method and electronic equipment for recommending shooting posture
Paterson et al. The world through Glass: developing novel methods with wearable computing for urban videographic research
CN109089045A (en) A kind of image capture method and equipment and its terminal based on multiple photographic devices
CN105320242A (en) Photographing method and photographing terminal
CN107479906A (en) cross-platform online education mobile terminal based on Cordova
US20190034757A1 (en) Method and system for on-device image recognition
CN108647710A (en) A kind of method for processing video frequency, device, computer and storage medium
CN104112374B (en) Distant learning scoring apparatus and method
CN113822263A (en) Image annotation method and device, computer equipment and storage medium
WO2023241377A1 (en) Video data processing method and device, equipment, system, and storage medium
CN202907086U (en) Campus video system based on Internet of things
Zheng et al. Uavs in multimedia: Capturing the world from a new perspective

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170609

RJ01 Rejection of invention patent application after publication