CN110349461A - Education and entertainment combination method and system based on children special-purpose smart machine - Google Patents
Education and entertainment combination method and system based on children special-purpose smart machine Download PDFInfo
- Publication number
- CN110349461A CN110349461A CN201910503243.XA CN201910503243A CN110349461A CN 110349461 A CN110349461 A CN 110349461A CN 201910503243 A CN201910503243 A CN 201910503243A CN 110349461 A CN110349461 A CN 110349461A
- Authority
- CN
- China
- Prior art keywords
- smart machine
- data
- user
- children special
- purpose smart
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The present invention provides the education and entertainment combination method based on children special-purpose smart machine, it includes: user inputs multi-modal data by children special-purpose smart machine client, and multi-modal data is corresponding with problem data；Multi-modal data is transmitted to cloud and parsed by children special-purpose smart machine, obtains the matching result of multi-modal data and problem data；Matching result is back to children special-purpose smart machine；Children special-purpose smart machine client exports virtual reward multi-modal data to matching result.Children special-purpose smart machine provided by the invention, has question and answer learning functionality, exports problem data to user, receive the multi-modal data of input, multi-modal data is transmitted to cloud to parse, obtains matching result, the corresponding virtual reward multi-modal data of output matching result.Children education can be combined with entertainment for children, in the time of fragmentation, give child user forward direction joyful experience, excitation child user is learnt, and the usage experience of user is improved.
Description
Technical field
The present invention relates to artificial intelligence fields, specifically, be related to a kind of education based on children special-purpose smart machine with
Amusement combines method and system.
Background technique
With the continuous development of science and technology, the introducing of information technology, computer technology and artificial intelligence technology, for
Industrial circle is gradually walked out in the research of smart machine, gradually extends to medical treatment, health care, family, amusement and service rows
The fields such as industry.And requirement of the people for smart machine also conform to the principle of simplicity single duplicate mechanical action be promoted to have anthropomorphic question and answer, from
Main property and the equipment interacted with other smart machines, human-computer interaction also just become determine smart machine development it is important because
Element.Therefore, the interaction capabilities for promoting smart machine improve the class human nature and intelligence of smart machine, are present urgent need to resolve
Major issue.
Therefore, the education and entertainment combination method and system based on children special-purpose smart machine that the present invention provides a kind of.
Summary of the invention
To solve the above problems, the present invention provides a kind of education and entertainment combination sides based on children special-purpose smart machine
Method, the method comprise the steps of:
User inputs multi-modal data, the multi-modal data and problem data by children special-purpose smart machine client
It is corresponding；
The multi-modal data is transmitted to cloud and parsed by children special-purpose smart machine, obtains the multi-modal data
With the matching result of problem data；
The matching result is back to the children special-purpose smart machine；
The children special-purpose smart machine client exports virtual reward multi-modal data to the matching result.
According to one embodiment of present invention, the method further includes: pass through children special-purpose smart machine client obtain
The classes and grades in school information of user.
According to one embodiment of present invention, the multi-modal data is transmitted to cloud and parse and include:
Semanteme parsing, touch action parsing, classes and grades in school information correspond to topic answer parsing.
According to one embodiment of present invention, further includes: history learning is checked by the corresponding parent end of the client
Record.
According to one embodiment of present invention, virtual reward multi-modal data is accomplished in that
Under entertainment mode, while exporting the virtual reward multi-modal data, user account increases at least one joy
Happy energy, the virtual reward multi-modal data include animation mode.
According to one embodiment of present invention, the method also includes:
The identity characteristic information for obtaining active user, judges the user property of active user, determines active user
Classification, wherein the classification of user includes: child user.
According to another aspect of the present invention, a kind of program product is additionally provided, it includes any one of as above for executing
The series of instructions of the method and step.
According to another aspect of the present invention, a kind of education and entertainment knot based on children special-purpose smart machine is additionally provided
It attaches together and sets, described device includes:
First module is used for user by children special-purpose smart machine client and inputs multi-modal data, the multimode
State data are corresponding with problem data；
Second module is used to children special-purpose smart machine the multi-modal data is transmitted to cloud parse, obtain
Take the matching result of the multi-modal data and problem data；
Third module is used to for the matching result to be back to the children special-purpose smart machine；
It is more to matching result output virtual reward to be used for the children special-purpose smart machine client for 4th module
Modal data.
According to another aspect of the present invention, a kind of children special-purpose smart machine is additionally provided, it is as above any for executing
The series of instructions of method and step described in.
According to another aspect of the present invention, a kind of education and entertainment knot based on children special-purpose smart machine is additionally provided
Collaboration system, the system includes:
Children special-purpose smart machine as described above；
Cloud has semantic understanding, visual identity, cognition calculating and affection computation, with children special-purpose described in decision
Smart machine exports multi-modal data.
It is special that education and entertainment combination method provided by the invention based on children special-purpose smart machine provides a kind of children
With smart machine, have question and answer learning functionality, problem data can be exported to user, receive the multi-modal data of user's input,
Multi-modal data is transmitted to cloud to parse, obtains matching result, exports matching result on children special-purpose smart machine
Corresponding virtual reward multi-modal data.The present invention can combine children education with entertainment for children, fragmentation when
Between in, give child user forward direction joyful experience, excitation child user learnt, improve the usage experience of user.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention can be by specification, right
Specifically noted structure is achieved and obtained in claim and attached drawing.
Detailed description of the invention
Attached drawing is used to provide further understanding of the present invention, and constitutes part of specification, with reality of the invention
It applies example and is used together to explain the present invention, be not construed as limiting the invention.In the accompanying drawings:
Fig. 1 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
Method flow diagram；
Fig. 2 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
The flow chart of the multi-modal data of virtual reward is exported in method；
Fig. 3 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
Education and entertainment combination schematic diagram in method；
Fig. 4 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
The module frame chart of device；
Fig. 5 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
The structural block diagram of system；
Fig. 6 shows the education and entertainment knot based on children special-purpose smart machine according to another embodiment of the invention
The structural block diagram of collaboration system；
Fig. 7 shows the education and entertainment knot based on children special-purpose smart machine according to another embodiment of the invention
Close method flow diagram；And
Fig. 8 shows user, children special-purpose smart machine, cloud and parent end according to an embodiment of the invention
Cubic data flow diagram.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, the embodiment of the present invention is made below in conjunction with attached drawing
Further it is described in detail.
It is clear to state, it needs to carry out before embodiment as described below:
The children special-purpose smart machine that the present invention mentions supports multi-modal human-computer interaction, has natural language understanding, vision
The AI abilities such as perception, language voice output, emotional facial expressions movement output；Configurable social property, personality attribute, personage's technical ability
Deng making user enjoy intelligent and personalized Flow Experience.In the particular embodiment, children special-purpose smart machine can be
Virgin Story machine, desk lamp, alarm clock, intelligent sound box, children's plate, children's wrist-watch and children AI robot etc..
Children special-purpose smart machine obtains the multi-modal data of user, under ability beyond the clouds is supported, to multi-modal data
Semantic understanding, visual identity, cognition calculating, affection computation are carried out, to complete the process of decision output.
The cloud being previously mentioned is to provide the children special-purpose smart machine to carry out semantic understanding (language to the interaction demand of user
Say semantic understanding, Action Semantic understandings, visual identity, affection computation, cognition calculate) processing capacity terminal, realize with use
The interaction at family exports multi-modal data with children special-purpose smart machine described in decision.
Each embodiment of the invention is described in detail with reference to the accompanying drawing.
Fig. 1 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
Method flow diagram.
As shown in Figure 1, in step s101, user inputs multi-modal data by children special-purpose smart machine client,
Multi-modal data is corresponding with problem data.
In one embodiment, can have dedicated client on children special-purpose smart machine, in the time of fragmentation
(such as: 1-3 minutes) it is inner, child user can be learnt and be entertained by client.
Further, when first entering client and being registered, the information of children can be bound, wherein youngster
Virgin information includes the classes and grades in school information of children.Alternatively, it is also possible to be bound with parent end (e.g., mobile device end).Parent deposits at end
It is on the smart machine of children guardian.Parent end can be wechat public platform, by children for learning data in smart phone
It is presented to the product module of children guardian.
Specifically, when user is learnt by client, client exports the problem of matching with user identity number
According to receiving the multi-modal data of user's input, multi-modal data is corresponding with problem data.
In addition, parent end can be passed through after the data of the particular child user in client and parent end are bound
Check that history learning records.
Then, in step s 102, multi-modal data is transmitted to cloud and parsed by children special-purpose smart machine, is obtained
The matching result of multi-modal data and problem data.
Specifically, multi-modal data can be child user by voice, touch screen, image and with upper type combine
Operation is inputted.
Further, the resolving in cloud includes semantic parsing, touch action parses, classes and grades in school information corresponds to topic answer
Parsing.
Further, cloud can to multi-modal data carry out semanteme, speech waveform evaluation and test, image analysis, gesture parse,
The AI such as touch screen track differentiate that the corresponding answer data of comparison problem data determines the result of answering of child user.
Then, in step s 103, matching result is back to children special-purpose smart machine.Cloud and children special-purpose intelligence
Equipment is communicated, and after obtaining matching result beyond the clouds, matching result is transmitted to children special-purpose smart machine.
Finally, in step S104, children special-purpose smart machine client is multi-modal to matching result output virtual reward
Data.
In one embodiment, virtual reward multi-modal data is accomplished in that under entertainment mode, and output is empty
While quasi- reward multi-modal data, user account increases at least one amusement energy, and virtual reward multi-modal data includes dynamic
Picture mode, the amusement energy are the reward with described problem Data Matching, and the animation mode can be virtual in client
The output of upgrading or the game clearance of image.
According to one embodiment of present invention, the identity characteristic information for obtaining active user belongs to the user of active user
Property is judged, determines the classification of active user, wherein the classification of user includes: child user.The present invention towards user group
Mainly child user, it is therefore desirable to determine the identity attribute of user.Judge user identity mode be there are many kinds of, it is general come
It says, the identity of user can be distinguished by face recognition function or fingerprint recognition mode.Other can judge user identity
Mode can also apply to the present invention, the present invention makes limitation not to this.
Fig. 2 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
The process of the multi-modal data of virtual reward is exported in method.
As shown in Fig. 2, in step s 201, user bound information and parent end.It is loaded on children special-purpose smart machine
There is the dedicated client of study, in the registration process for first entering client, needs to carry out user information and parent end
Binding.The essential informations such as the classes and grades in school information of user are inputted, user and specific parent end are bound.For example, by children
User A is that the classes and grades in school information of Third school grade and the parent end of its guardian are bound.
Then, in step S202, subject topic is exported.In this step, client exports problem data, problem data
Related to the classes and grades in school information of user, problem data includes subject topic.For example, the classes and grades in school of current child user A is Third school grade, that
Client exports subject topic relevant to Third school grade pupil when exporting problem data.I.e. if binding has user's
The subject topic of classes and grades in school information, output is related to user's classes and grades in school information.
Then, in step S203, the multi-modal data of input is received.After client exports subject topic, user is waited
Input multi-modal data, user by voice, touch screen, image and with upper type combination combination operation input.
Then, in step S204, cloud parsing.Cloud can carry out semanteme to multi-modal data, speech waveform is evaluated and tested,
The AI such as image analysis, gesture parsing, touch screen track differentiate that the corresponding answer data of comparison problem data determines child user
It answers result.Multi-modal data answer data corresponding with problem data is compared, judge multi-modal data whether with answer
Case data fit evaluates answering for user, obtains matching result.
Then, in step S205, matching result is received.Matching result is back to children special-purpose smart machine by cloud,
Children special-purpose smart machine receives the matching result of cloud transmission.
Then, in step S206, judge whether to need to export reward.When child user input multi-modal data with answer
When case data are consistent, it is judged to needing to export reward, when there is inconsistency, judgement does not need output reward.
Then, in step S207, virtual reward multi-modal data is exported.If the judgement result in step S206 is
It is to export virtual reward multi-modal data.Virtual reward multi-modal data is achieved in that, under entertainment mode, output is empty
While quasi- reward multi-modal data, user account increases at least one amusement energy, and virtual reward multi-modal data includes dynamic
Picture mode can be visual stimulus and virtual objects reward of animation form etc.., the amusement energy be and described problem number
According to matched reward, the animation mode can be the output of upgrading or the game clearance of the virtual image in client.
Finally, not exporting virtual reward multi-modal data in step S208.If the judgement result in step S206 is
It is no, virtual reward multi-modal data is not exported.Optionally, exportable prompt child user continues to answer a question or reduction problem etc.
Grade.
Fig. 3 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
Education and entertainment combination schematic diagram in method.
In one embodiment, client has mode of learning and entertainment mode.Each mode has accordingly
Energy, the energy in mode of learning are study energy, and the numerical value for learning energy can be natural number.In completing mode of learning
After learning tasks, the study energy in user account can be increased.For example, study energy is integer, when initial, in user account
Study energy be 0, after user completes a learning process, increase by 1 study energy in user account.
In order to illustrate it is clear, illustrate:
The study energy can be used in entering entertainment mode.Such as: when the study energy in user account is more than or equal to 3
When a, an entertainment mode can be entered.After i.e. user completes 3 learning processes, an entertainment mode just can enter.Learning
It in mode and entertainment mode, can be set objectives in the way of game as child user, such as constantly gain a victory over the enemy, encouraged
It encourages.When fighting with virtual enemies, the knowledge point that user can be learnt is changed into question-and-answer problem proposition, only answers questions problem,
It can gain a victory over the enemy, give user with positive excitation.
Entertainment mode includes amusement energy, and the numerical value for entertaining energy can be natural number, after entering entertainment mode, amusement
Energy can be used in playing game.It such as include different types of game, every kind of game joy required when entering in entertainment mode
Happy energy is different.Only after having a certain number of amusement energy, it can just enter corresponding game.Have in game increase or
The standard for deducting amusement energy automatically exits from amusement after the amusement depleted of energy or playtime of user reach preset time
Mode.
Such as Fig. 3, child user is learnt under mode of learning, obtains the chance of game.Has certain in user
After habit can be practiced, user can consume study energy and carry out game, and user obtains positive feedback experience in gaming.In depleted of energy
When, entertainment mode is exited, mode of learning is again introduced into and is learnt.
Parent end can check that the history learning data of user, history learning data can store beyond the clouds.Parent looks at end
The learning outcome for seeing user, after parent is satisfied with to learning outcome, parent can enough buy more study for child user
Technical ability.Child user is enabled to pass through more approach to obtain study energy.
By recycling above, preferably user can be motivated to learn, realize the combination of study and amusement.In fragment
In the time of change, child user forward direction joyful experience is given, excitation child user is learnt, and the usage experience of user is improved.
Fig. 4 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
The module frame chart of device.
As shown in figure 4, education and entertainment coupling apparatus include the first module 401, the second module 402, third module 403 with
And the 4th module 404.Wherein, the first module 401 includes acquiring unit 4011.Second module 402 includes transmission unit 4021, solution
Analyse unit 4022 and result unit 4023.4th module 404 includes reward unit 4041 and output unit 4042.
First module 401 inputs multi-modal data, multi-modal number by children special-purpose smart machine client for user
According to corresponding with problem data.Wherein, acquiring unit 4011 is used to obtain user's input after the starting of children special-purpose smart machine
Multi-modal data.
Multi-modal data is transmitted to cloud for children special-purpose smart machine and parsed by the second module 402, is obtained more
The matching result of modal data and problem data.Wherein, transmission unit 4021 is used to multi-modal data being transmitted to cloud.Parsing
Unit 4022 is for parsing multi-modal data.As a result unit 4023 is used to generate the matching knot of multi-modal data and problem data
Fruit.
Third module 403 is used to matching result being back to children special-purpose smart machine.4th module 404 is special for children
Virtual reward multi-modal data is exported to matching result with smart machine client.Wherein, reward unit 4041 is used for according to institute
Matching result is stated, judges whether to need to export virtual reward multi-modal data.Output unit 4042 is more for exporting virtual reward
Modal data.
Fig. 5 shows that the education and entertainment according to an embodiment of the invention based on children special-purpose smart machine combines
The structural block diagram of system.As shown in figure 5, completing multi-modal interaction needs user 501, children special-purpose smart machine 502, cloud
503 and parent end 504 common participation.Wherein, children special-purpose smart machine 502 includes input/output unit 5021, data
Processing unit 5022 and interface unit 5023.The interface that cloud 503 has includes semantic understanding interface 5031, visual identity
Interface 5032, cognition calculate interface 5033 and affection computation interface 5034.Parent end 504 include history check unit 5041 with
And technical ability buys unit 5042.
Education and entertainment combination system provided by the invention based on children special-purpose smart machine includes children special-purpose intelligence
Equipment 502, cloud 503 and parent end 504.Children special-purpose smart machine 502 includes supporting the input and output moulds such as perception, control
The smart machine of block can access internet, such as children-story machine, desk lamp, alarm clock, intelligent sound box, children's plate, children's wrist-watch
And children AI robot etc., have question and answer learning functionality, problem data can be exported to user, receive the multimode of user's input
Multi-modal data is transmitted to cloud and parsed, obtains matching result by state data, the output matching knot in children special-purpose intelligence
The corresponding virtual reward multi-modal data of fruit.
Client in children special-purpose smart machine 502 can be loaded under Android system environment, and children special-purpose is intelligently set
It is standby to can be the Android system children wrist-watch for having 4G communication capacity, Android system children plate, Android system band screen intelligent sound
Case, smart phone, Android tablet computer etc..
Cloud 503 has semantic understanding, visual identity, cognition calculating and affection computation, with decision children special-purpose intelligence
Equipment exports multi-modal data.
The multi-modal data that input/output unit 5021 is used to obtain the multi-modal data of input and output needs to export.
The multi-modal data of input can be the input of user 501, be also possible to surrounding enviroment input.Input/output unit 5021
Example includes the microphone for voice operating, loudspeaker, scanner, camera, sensing control equipment, such as using visible or invisible wave
Long ray, signal, environmental data etc..Multi-modal data can be obtained by above-mentioned input equipment.Multi-modal number
It according to may include one of text, audio, vision and perception data, also may include a variety of, the present invention makes not to this
Limitation.
Data processing unit 5022 is used to handle the data for carrying out generating in multi-modal interaction.Processor used can be
Data processing unit (Central Processing Unit, CPU), can also be other general processors, Digital Signal Processing
Device (Digital Signal Processor, DSP), specific integrated circuit (Application Specific Integrated
Circuit, ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other can
Programmed logic device, discrete gate or transistor logic, discrete hardware components etc..General processor can be microprocessor
Or the processor is also possible to any conventional processor etc., processor is the control centre of terminal, using various interfaces and
The various pieces of the entire terminal of connection.
It include memory in children special-purpose smart machine 502, memory mainly includes storing program area and storage data area,
Wherein, storing program area can application program needed for storage program area, at least one function (such as sound-playing function, figure
As playing function etc.) etc.；Storage data area, which can be stored, uses created data (ratio according to children special-purpose smart machine 502
Such as audio data, browsing record) etc..In addition, memory may include high-speed random access memory, it can also include non-easy
The property lost memory, such as hard disk, memory, plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital
(Secure Digital, SD) card, flash card (Flash Card), at least one disk memory, flush memory device or other
Volatile solid-state part.
Cloud 503 includes semantic understanding interface 5031, visual identity interface 5032, cognition calculating interface 5033 and emotion
Calculate interface 5034.The above interface is communicated with the expansion of interface unit 5023 in children special-purpose smart machine 502.Also,
Cloud 503 also includes and the corresponding semantic understanding logic of semantic understanding interface 5031, view corresponding with visual identity interface 5032
Feel that recognition logic and cognition calculate the corresponding cognition calculating logic of interface 5033 and feelings corresponding with affection computation interface 5034
Feel calculating logic.
Parent end 504 includes that history checks unit 5041 and technical ability purchase unit 5042.Wherein, history checks unit
5041 check instruction for sending historical record to cloud 503, to transfer the history learning number of the user 501 of the storage of cloud 503
According to facilitating the user at parent end that can check the learning process of user 501 at any time.Technical ability purchase unit 5042 can have skill
Interface can be bought, the user at parent end can select the technical ability for needing to buy for user 501, and the technical ability of unlatching can be used for
User 501 obtains more study energy.
As shown in figure 5, each ability interface calls corresponding logical process respectively.The following are the explanations of each interface:
Semantic understanding interface receives the special sound instruction forwarded from interface unit 5023, carries out speech recognition to it
And the natural language processing based on a large amount of corpus.
Visual identity interface, can be for human body, face, scene according to computer vision algorithms make, deep learning algorithm etc.
Carry out video content detection, identification, tracking etc..Image is identified according to scheduled algorithm, the detection knot of quantitative
Fruit.Have image preprocessing function, feature extraction functions, decision making function and concrete application function；
Wherein, image preprocessing function, which can be, carries out basic handling, including color sky to the vision collecting data of acquisition
Between conversion, edge extracting, image transformation and image threshold；
Feature extraction functions can extract the features such as the colour of skin of target, color, texture, movement and coordinate in image and believe
Breath；
Decision making function can be to characteristic information, is distributed to according to certain decision strategy and needs the specific of this feature information
Multi-modal output equipment or multi-modal output application, such as realize Face datection, human limbs identification, motion detection function.
Cognition calculates interface, receives the multi-modal data forwarded from interface unit 5023, and cognition calculates interface 5033 and uses
Data acquisition, identification and study are carried out to handle multi-modal data, to obtain user's portrait, knowledge mapping etc., to multi-modal
Output data carries out Rational Decision.
Affection computation interface receives the multi-modal data forwarded from interface unit 5023, (can using affection computation logic
To be Emotion identification technology) calculate the current emotional state of user.Emotion identification technology is an important set of affection computation
At part, the content of Emotion identification research includes facial expression, voice, behavior, text and physiological signal identification etc., is passed through
The above content may determine that the emotional state of user.Emotion identification technology only can monitor use by vision Emotion identification technology
The emotional state at family can also monitor user in conjunction with by the way of using vision Emotion identification technology and sound Emotion identification technology
Emotional state, and be not limited thereto.
Affection computation interface is to collect human face's table by using image capture device when carrying out vision Emotion identification
Feelings image is then converted into that data can be analyzed, the technologies such as image procossing is recycled to carry out the analysis of expression mood.Understand facial table
Feelings, it usually needs the delicate variation of expression is detected, such as cheek muscle, mouth variation and choose eyebrow etc..
In addition, the education and entertainment combination system provided by the invention based on children special-purpose smart machine can also be with unification
Kind program product, it includes complete one of the education and entertainment combination method and step based on children special-purpose smart machine for executing
Series of instructions.Program product can run computer instruction, and computer instruction includes computer program code, computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..
Program product may include: can carry computer program code any entity or device, recording medium, USB flash disk,
Mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory
Device (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..
It should be noted that the content that program product includes can be according to making laws in jurisdiction and patent practice is wanted
It asks and carries out increase and decrease appropriate, such as do not include electric carrier wave according to legislation and patent practice, program product in certain jurisdictions
Signal and telecommunication signal.
Fig. 6 shows the education and entertainment knot based on children special-purpose smart machine according to another embodiment of the invention
The structural block diagram of collaboration system.It completes multi-modal interaction and needs user 501, children special-purpose smart machine 502, cloud 503 and family
Long end 504.Wherein, children special-purpose smart machine 502 includes signal acquisition device 601, display screen 602, signal output device 603
And central processing unit 604.
Signal acquisition device 601 is used to acquire the signal of user or external environment output.Signal acquisition device 601 can be
The equipment that microphone etc. is capable of collected sound signal is also possible to touch screen etc..Display screen 602 can be with showing problem data, use
Multi-modal data, matching result and the virtual reward of the output multi-modal data of family input.Signal output device 603 is for defeated
Audio and animation data out.Signal output device 603 can be the equipment that power amplifier and loudspeaker etc. can export audio data.In
Central processor 604 can be handled the data generated in multi-modal interactive process.
According to one embodiment of present invention, children special-purpose smart machine 502 supports the input/output modules such as perception, control
Smart machine, such as children-story machine, desk lamp, alarm clock, intelligent sound box, children's plate, children's wrist-watch and children's AI machine
People etc. has question and answer learning functionality, can export problem data to user, the multi-modal data of user's input be received, by multimode
State data are transmitted to cloud and are parsed, and obtain matching result, and it is corresponding virtual that matching result is exported in children special-purpose intelligence
Reward multi-modal data.
Fig. 7 shows the education and entertainment knot based on children special-purpose smart machine according to another embodiment of the invention
Close method flow diagram.
As shown in fig. 7, in step s 701, children special-purpose smart machine 502 is issued to cloud 503 and is requested.Later, in step
In rapid S702, children special-purpose smart machine 502 is constantly in the state for waiting cloud 503 to reply.During waiting, children
Special intelligent equipment 502 can carry out Clocked operation to returned data the time it takes.
In step S703, if the reply data not returned for a long time, for example, being more than scheduled time span
5S, then children special-purpose smart machine 502 can select to carry out local reply, generate local common reply data.Then, in step
In S704, local common response is exported, and voice playing equipment is called to carry out voice broadcasting.
Fig. 8 shows user, children special-purpose smart machine, cloud and parent end according to an embodiment of the invention
Cubic data flow diagram.
In order to realize the multi-modal interaction between children special-purpose smart machine 502 and user 501, user 501, children are needed
Communication connection is set up between special intelligent equipment 502, cloud 503 and parent end 504.This communication connection should be real-time
, it is unobstructed, can guarantee to interact impregnable.
In order to complete to interact, some conditions or premise are needed to have.These conditions or premise include children special-purpose intelligence
Can have client in equipment 502, and children special-purpose smart machine 502 has the hardware facility of perception and control function.
After completing early-stage preparations, children special-purpose smart machine 502 starts to interact with the expansion of user 501, firstly, children special-purpose
Smart machine 102 receives the multi-modal data of user's input.Multi-modal data is corresponding with problem data, problem data be according to
The classes and grades in school information at family, is exported by children special-purpose smart machine 502.Configured with the multi-modal interactive number of reception in smart machine 102
According to relevant device, for receive user 101 transmission multi-modal interaction data.At this point, two sides of expansion communication are that children are special
Direction with smart machine 502 and user 501, data transmitting is to be transmitted to children special-purpose smart machine 502 from user 501.
Then, children special-purpose smart machine 502 transmits multi-modal data to cloud 503.Multi-modal data is that user is directed to
The answer that problem data provides.It may include the data of diversified forms in multi-modal data, for example, can wrap in multi-modal data
Containing text data, voice data, perception data and action data etc..At this point, two sides of expanding data transmitting are children special-purposes
The direction in smart machine 502 and cloud 503, data transmitting is to be transmitted to cloud 503 from children special-purpose smart machine 502.
Then, matching result is transmitted to children special-purpose smart machine 502 in cloud 503.Cloud 503 carries out multi-modal data
Parsing can carry out semantic understanding, visual identity, cognition calculating and affection computation, to obtain multi-modal data and problem number
According to matching result.At this point, two sides of expansion communication are cloud 503 and children special-purpose smart machine 502, the side of data transmitting
To being to be transmitted to children special-purpose smart machine 502 from cloud 503.
Finally, after children's special intelligent equipment 502 receives the matching result of the transmission of cloud 503, children special-purpose intelligence
Equipment 502 can export virtual reward multi-modal data to matching result.At this point, two sides of expansion communication are that children special-purpose is intelligently set
The direction of standby 502 and user 501, data transmitting are to be transmitted to user 501 from children special-purpose smart machine 502.
In addition, parent end 504 can check the historical record of user 501, gone through at this point, parent end 504 is sent to cloud 503
Instruction is checked in Records of the Historian record, and cloud 503 receives after historical record checks instruction, the historical record of calling and obtaining user 501, by user
501 history learning data transmission is checked to parent end 504 for the user at parent end 504.At this point, expansion communication
Two sides are cloud 503 and parent end 504.
To sum up, the education and entertainment combination method provided by the invention based on children special-purpose smart machine provides a kind of youngster
Virgin special intelligent equipment, has question and answer learning functionality, can export problem data to user, receive the multi-modal number of user's input
According to, multi-modal data is transmitted to cloud and is parsed, matching result is obtained, the output matching result pair in children special-purpose intelligence
The virtual reward multi-modal data answered.The present invention can combine children education with entertainment for children, in the time of fragmentation
In, child user forward direction joyful experience is given, excitation child user is learnt, and the usage experience of user is improved.
It should be understood that disclosed embodiment of this invention is not limited to specific structure disclosed herein, processing step
Or material, and the equivalent substitute for these features that those of ordinary skill in the related art are understood should be extended to.It should also manage
Solution, term as used herein is used only for the purpose of describing specific embodiments, and is not intended to limit.
" one embodiment " or " embodiment " mentioned in specification means the special characteristic described in conjunction with the embodiments, structure
Or characteristic is included at least one embodiment of the present invention.Therefore, the phrase " reality that specification various places throughout occurs
Apply example " or " embodiment " the same embodiment might not be referred both to.
While it is disclosed that embodiment content as above but described only to facilitate understanding the present invention and adopting
Embodiment is not intended to limit the invention.Any those skilled in the art to which this invention pertains are not departing from this
Under the premise of the disclosed spirit and scope of invention, any modification and change can be made in the implementing form and in details,
But scope of patent protection of the invention, still should be subject to the scope of the claims as defined in the appended claims.
Claims (10)
1. a kind of education and entertainment combination method based on children special-purpose smart machine, which is characterized in that the method include with
Lower step:
User inputs multi-modal data, the multi-modal data and problem data pair by children special-purpose smart machine client
It answers；
The multi-modal data is transmitted to cloud and parsed by children special-purpose smart machine, is obtained the multi-modal data and is asked
Inscribe the matching result of data；
The matching result is back to the children special-purpose smart machine；
The children special-purpose smart machine client exports virtual reward multi-modal data to the matching result.
2. the method as described in claim 1, which is characterized in that the method further includes: pass through children special-purpose smart machine visitor
The classes and grades in school information of family end acquisition user.
3. method according to claim 2, which is characterized in that the multi-modal data is transmitted to cloud and carries out parsing packet
It includes:
Semanteme parsing, touch action parsing, classes and grades in school information correspond to topic answer parsing.
4. method as claimed in any one of claims 1-3, which is characterized in that further include: it is corresponding by the client
Parent checks at end that history learning records.
5. such as method of any of claims 1-4, which is characterized in that virtual reward multi-modal data passes through such as lower section
Formula is realized:
Under entertainment mode, while exporting the virtual reward multi-modal data, user account increases at least one amusement energy
Amount, the virtual reward multi-modal data include animation mode.
6. method according to any one of claims 1 to 5, which is characterized in that the method also includes:
The identity characteristic information for obtaining active user, judges the user property of active user, determines the class of active user
Not, wherein the classification of user includes: child user.
7. a kind of program product, it includes for executing a series of of such as method and step of any of claims 1-6
Instruction.
8. a kind of education and entertainment coupling apparatus based on children special-purpose smart machine, which is characterized in that described device includes:
First module is used for user by children special-purpose smart machine client and inputs multi-modal data, the multi-modal number
According to corresponding with problem data；
Second module is used to children special-purpose smart machine the multi-modal data is transmitted to cloud parse, and obtains institute
State the matching result of multi-modal data and problem data；
Third module is used to for the matching result to be back to the children special-purpose smart machine；
It is multi-modal to matching result output virtual reward to be used for the children special-purpose smart machine client for 4th module
Data.
9. a kind of children special-purpose smart machine, which is characterized in that for executing such as method of any of claims 1-6
The series of instructions of step.
10. a kind of education and entertainment combination system based on children special-purpose smart machine, which is characterized in that the system includes:
Children special-purpose smart machine as claimed in claim 9；
Cloud has semantic understanding, visual identity, cognition calculating and affection computation, with the intelligence of children special-purpose described in decision
Equipment exports multi-modal data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910503243.XA CN110349461A (en) | 2019-06-11 | 2019-06-11 | Education and entertainment combination method and system based on children special-purpose smart machine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910503243.XA CN110349461A (en) | 2019-06-11 | 2019-06-11 | Education and entertainment combination method and system based on children special-purpose smart machine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110349461A true CN110349461A (en) | 2019-10-18 |
Family
ID=68181866
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910503243.XA Pending CN110349461A (en) | 2019-06-11 | 2019-06-11 | Education and entertainment combination method and system based on children special-purpose smart machine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110349461A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110689781A (en) * | 2019-10-31 | 2020-01-14 | 北京光年无限科技有限公司 | Data processing method and system based on children education |
| CN110874960A (en) * | 2019-10-28 | 2020-03-10 | 北京光年无限科技有限公司 | Man-machine interaction method and device for children education |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090170058A1 (en) * | 1996-05-09 | 2009-07-02 | Walker Jay S | Method and apparatus for educational testing |
| CN102779144A (en) * | 2012-03-20 | 2012-11-14 | 北京捷通华声语音技术有限公司 | Method and device for controlling and inquiring through handwriting |
| CN104346966A (en) * | 2013-08-07 | 2015-02-11 | 郑州学生宝电子科技有限公司 | Family education auxiliary system and method for improving study effects |
| US20150056587A1 (en) * | 2007-06-04 | 2015-02-26 | University Of Utah Research Foundation | Method and system for automating the scoring of task information |
| CN107067849A (en) * | 2017-04-21 | 2017-08-18 | 杭州博世数据网络有限公司 | Parent's end system based on cloud teaching platform |
| CN107945067A (en) * | 2017-11-15 | 2018-04-20 | 广东机电职业技术学院 | A kind of ideological and political theory teaching system |
| CN108320603A (en) * | 2018-02-07 | 2018-07-24 | 上海钦文信息科技有限公司 | A kind of intelligence test and appraisal system and method |
| CN108711124A (en) * | 2018-05-11 | 2018-10-26 | 上海陌桥网络科技有限公司 | Learn measure of supervision, device and educational resource management system |
| CN108735219A (en) * | 2018-05-09 | 2018-11-02 | 深圳市宇恒互动科技开发有限公司 | A kind of voice recognition control method and device |
| CN108804902A (en) * | 2018-06-05 | 2018-11-13 | 成都睿码科技有限责任公司 | A method of the electronics Freehandhand-drawing safety verification based on deep learning model |
| CN108806375A (en) * | 2018-05-09 | 2018-11-13 | 河南工学院 | A kind of interactive teaching method and system based on image recognition |
| CN108959627A (en) * | 2018-07-23 | 2018-12-07 | 北京光年无限科技有限公司 | Question and answer exchange method and system based on intelligent robot |
| CN109102725A (en) * | 2018-09-28 | 2018-12-28 | 江苏派远软件开发有限公司 | A kind of intelligent learning system of guidance |
| CN109272793A (en) * | 2018-11-21 | 2019-01-25 | 合肥虹慧达科技有限公司 | Child interactive reading learning system |
| CN109278051A (en) * | 2018-08-09 | 2019-01-29 | 北京光年无限科技有限公司 | Exchange method and system based on intelligent robot |
| CN109300341A (en) * | 2018-08-30 | 2019-02-01 | 合肥虹慧达科技有限公司 | Interactive early education robot and its exchange method |
| CN109308160A (en) * | 2018-09-18 | 2019-02-05 | 北京达佳互联信息技术有限公司 | Operational order triggering method, device, electronic equipment and storage medium |
| CN109671320A (en) * | 2018-12-12 | 2019-04-23 | 广东小天才科技有限公司 | It is a kind of that exercising method and electronic equipment are calculated quickly based on interactive voice |
| CN109782850A (en) * | 2019-01-04 | 2019-05-21 | 北京灵优智学科技有限公司 | Support the full interactive intelligence intelligent education machine of multiple network access |
-
2019
- 2019-06-11 CN CN201910503243.XA patent/CN110349461A/en active Pending
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090170058A1 (en) * | 1996-05-09 | 2009-07-02 | Walker Jay S | Method and apparatus for educational testing |
| US20150056587A1 (en) * | 2007-06-04 | 2015-02-26 | University Of Utah Research Foundation | Method and system for automating the scoring of task information |
| CN102779144A (en) * | 2012-03-20 | 2012-11-14 | 北京捷通华声语音技术有限公司 | Method and device for controlling and inquiring through handwriting |
| CN104346966A (en) * | 2013-08-07 | 2015-02-11 | 郑州学生宝电子科技有限公司 | Family education auxiliary system and method for improving study effects |
| CN107067849A (en) * | 2017-04-21 | 2017-08-18 | 杭州博世数据网络有限公司 | Parent's end system based on cloud teaching platform |
| CN107945067A (en) * | 2017-11-15 | 2018-04-20 | 广东机电职业技术学院 | A kind of ideological and political theory teaching system |
| CN108320603A (en) * | 2018-02-07 | 2018-07-24 | 上海钦文信息科技有限公司 | A kind of intelligence test and appraisal system and method |
| CN108735219A (en) * | 2018-05-09 | 2018-11-02 | 深圳市宇恒互动科技开发有限公司 | A kind of voice recognition control method and device |
| CN108806375A (en) * | 2018-05-09 | 2018-11-13 | 河南工学院 | A kind of interactive teaching method and system based on image recognition |
| CN108711124A (en) * | 2018-05-11 | 2018-10-26 | 上海陌桥网络科技有限公司 | Learn measure of supervision, device and educational resource management system |
| CN108804902A (en) * | 2018-06-05 | 2018-11-13 | 成都睿码科技有限责任公司 | A method of the electronics Freehandhand-drawing safety verification based on deep learning model |
| CN108959627A (en) * | 2018-07-23 | 2018-12-07 | 北京光年无限科技有限公司 | Question and answer exchange method and system based on intelligent robot |
| CN109278051A (en) * | 2018-08-09 | 2019-01-29 | 北京光年无限科技有限公司 | Exchange method and system based on intelligent robot |
| CN109300341A (en) * | 2018-08-30 | 2019-02-01 | 合肥虹慧达科技有限公司 | Interactive early education robot and its exchange method |
| CN109308160A (en) * | 2018-09-18 | 2019-02-05 | 北京达佳互联信息技术有限公司 | Operational order triggering method, device, electronic equipment and storage medium |
| CN109102725A (en) * | 2018-09-28 | 2018-12-28 | 江苏派远软件开发有限公司 | A kind of intelligent learning system of guidance |
| CN109272793A (en) * | 2018-11-21 | 2019-01-25 | 合肥虹慧达科技有限公司 | Child interactive reading learning system |
| CN109671320A (en) * | 2018-12-12 | 2019-04-23 | 广东小天才科技有限公司 | It is a kind of that exercising method and electronic equipment are calculated quickly based on interactive voice |
| CN109782850A (en) * | 2019-01-04 | 2019-05-21 | 北京灵优智学科技有限公司 | Support the full interactive intelligence intelligent education machine of multiple network access |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110874960A (en) * | 2019-10-28 | 2020-03-10 | 北京光年无限科技有限公司 | Man-machine interaction method and device for children education |
| CN110689781A (en) * | 2019-10-31 | 2020-01-14 | 北京光年无限科技有限公司 | Data processing method and system based on children education |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107944542A (en) | A kind of multi-modal interactive output method and system based on visual human | |
| CN109871450A (en) | Based on the multi-modal exchange method and system for drawing this reading | |
| CN109176535B (en) | Interaction method and system based on intelligent robot | |
| CN106997243B (en) | Speech scene monitoring method and device based on intelligent robot | |
| JP2020511324A (en) | Data processing method and device for child-rearing robot | |
| CN109271018A (en) | Exchange method and system based on visual human's behavioral standard | |
| CN106200886A (en) | A kind of intelligent movable toy manipulated alternately based on language and toy using method | |
| CN106710590A (en) | Voice interaction system with emotional function based on virtual reality environment and method | |
| CN109278051A (en) | Exchange method and system based on intelligent robot | |
| CN107831905A (en) | A kind of virtual image exchange method and system based on line holographic projections equipment | |
| CN109074117A (en) | Built-in storage and cognition insight are felt with the computer-readable cognition based on personal mood made decision for promoting memory | |
| CN108942919A (en) | A kind of exchange method and system based on visual human | |
| CN109324688A (en) | Exchange method and system based on visual human's behavioral standard | |
| CN108052250A (en) | Virtual idol deductive data processing method and system based on multi-modal interaction | |
| CN109343695A (en) | Exchange method and system based on visual human's behavioral standard | |
| CN108460324A (en) | A method of child's mood for identification | |
| CN204650422U (en) | A kind of intelligent movable toy manipulated alternately based on language | |
| CN105912530A (en) | Intelligent robot-oriented information processing method and system | |
| CN109086860A (en) | A kind of exchange method and system based on visual human | |
| CN108416420A (en) | Limbs exchange method based on visual human and system | |
| CN108595012A (en) | Visual interactive method and system based on visual human | |
| CN108037825A (en) | The method and system that a kind of virtual idol technical ability is opened and deduced | |
| CN109032328A (en) | A kind of exchange method and system based on visual human | |
| CN109542389A (en) | Sound effect control method and system for the output of multi-modal story content | |
| CN112749956A (en) | Information processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191018 |