CN108022464A - A kind of identification language describes and shows the learning aids system of corresponding picture - Google Patents

A kind of identification language describes and shows the learning aids system of corresponding picture Download PDF

Info

Publication number
CN108022464A
CN108022464A CN201711309097.4A CN201711309097A CN108022464A CN 108022464 A CN108022464 A CN 108022464A CN 201711309097 A CN201711309097 A CN 201711309097A CN 108022464 A CN108022464 A CN 108022464A
Authority
CN
China
Prior art keywords
picture
things
identification
embedded system
describes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711309097.4A
Other languages
Chinese (zh)
Inventor
葛晓扬
马春东
向彬莹
盖甄迪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DALIAN GAOMA ART DESIGN ENGINEERING Co Ltd
Original Assignee
DALIAN GAOMA ART DESIGN ENGINEERING Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DALIAN GAOMA ART DESIGN ENGINEERING Co Ltd filed Critical DALIAN GAOMA ART DESIGN ENGINEERING Co Ltd
Priority to CN201711309097.4A priority Critical patent/CN108022464A/en
Publication of CN108022464A publication Critical patent/CN108022464A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

Described the invention discloses a kind of identification language and show the learning aids system of corresponding picture, including handheld electronics device, embedded system, voice recognition chip and flash storage chips, wherein, screen, microphone, loudspeaker and button are carried on the handheld electronics device;The embedded system, the screen with the handheld electronics device, microphone, loudspeaker and button are connected respectively;The voice recognition chip is connected in the embedded system;The embedded system is also connected with the flash storage chips, for storing image data.The learning aids system of the present invention can identify the voice description of children in real time, and integrate description content and choose and show described picture, by the contrast to picture can be very clear and intuitive find out the difference of actual effect that different accuracy language describes, establish effective study feedback mechanism.

Description

A kind of identification language describes and shows the learning aids system of corresponding picture
Technical field
The present invention relates to embedded development technology, speech recognition technology, picture Display Technique, directly applies to education religion The fields such as tool, toy, are to be related to a kind of identification language to describe and show the learning aids system of corresponding picture specifically.
Background technology
Current existing teaching aid toy occurs still in the form of books mostly, does not also go out institute according to the description Real-time Feedback of children The teaching aid toy product of description content.
The content of the invention
Present invention aim to address the deficiency of above-mentioned technology, it is therefore an objective to which training children conscientiously observe different with clearly description The ability of things, is described the things by using clear and definite description language, and system can be in real time according to speech recognition The described object picture of existing language, so as to feed back the difference of description and object reality in time, helps children to correct in time.
In order to solve the above technical problems, identify that language describes and shows that the study of corresponding picture is taught the present invention provides a kind of Tool system, including handheld electronics device, embedded system, voice recognition chip and flash storage chips, wherein,
Screen, microphone, loudspeaker and button are carried on the handheld electronics device;
The embedded system, the screen with the handheld electronics device, microphone, loudspeaker and button are connected respectively;
The voice recognition chip is connected in the embedded system;
The embedded system is also connected with the flash storage chips, for storing image data.
Preferably, the embedded system, is further the embedded system of ARM250 kernels.
Preferably, the voice recognition chip, is further XFS5152CE voice recognition chips.
Preferably, the capacity of the flash storage chips is in more than 1GB.
Preferably, comprising the following steps that when in use:
Using some things as description object, the common attribute to the things is set out and describes;According to the group of different descriptors Conjunction relation, correspondence make different pictures respectively;The entitled variable n of things being described is set, various descriptors are set according to order For p1, p2 ... pn, these things names are defined as different numerical value from descriptor, per pictures filename be things name+ The contamination ,+pn.jpg that is named as n+p1+p2+ ... are described, whole pictures that the different combination of all properties is formed all store On the flash storage chips of system;
Default picture:The picture of a things is selected using the button, the picture of the things can be shown to the display On one position, default picture is obtained;
Obtain identification picture:The things is described by language, the microphone reads voice, and the voice recognition chip will identify The numerical value assignment corresponding to descriptor and things name gone out is into variable n and p, and according to n+p1+p2+ ... ,+pn.jpg selections correspond to Picture file be shown on the another location of screen, obtain identification picture;
When identification picture is identical with default picture, loudspeaker sends the right-on voice prompt of description of advance typing;
When voice identifies not successfully, describe unclear or does not show identification with any preset picture name Corresponding matching, display Picture, loudspeaker send the voice prompt do not heard, please redescribed of advance typing.
The technical background of the system is mainly microcontroller embedded exploitation and speech recognition technology.Need to use in the system Embedded development technology and speech recognition technology it is all highly developed.Software aspects, describe that the item of picture is presented by language Mesh is mostly also immature, main reason is that the low syntactic analysis of natural language recognition accuracy rate is complicated, is converted into corresponding picture Even more extremely difficult, a large amount of language for obscuring perception are difficult to quantitative expression, are calculated even with simulative neural network and deep learning Method also tends to be difficult to be competent at.But under in order to cultivate the careful observation of children and precisely describe this purpose of things, it can pass through Regulation identifies particular keywords without regard to the method for grammar for natural language relation to greatly promote the success rate of language identification, And the combined situation of various words of description is all depicted as picture and is stored in advance in system, carried further according to the keyword identified Corresponding picture is taken, so as to reach each concrete function of teaching aid.The invention also can by update picture and database come Content and playing method are expanded, therefore has the larger market vacancy and moral.
Careful observation and accurately language description are to establish the indispensable basic attainment of rationality logical thinking, wherein, Children are allowed to recognize generally to obscure general language description and have very big difference between accurately describing, so as to supervise children to support It is the priority function for designing this kind of teaching aid into the consciousness of accurate description custom.
Compared with prior art, identification language of the present invention describes and shows the learning aids system of corresponding picture, Following effect is reached:
The learning aids system of the present invention can identify the voice description of children in real time, and integrate description content and choose and show institute The picture of description, by contrast to picture can be very clear and intuitive find out actual effect that different accuracy language describes Difference, establishes effective study feedback mechanism.
The present invention uses the screening mode of voice recognition chip combination fixed keyword, without considering that grammar for natural language closes System or various individualized languages custom difference, can greatly promote the success rate of speech recognition, lift development efficiency, reduce and survey Try cost.The result that voice describes is converted to picture and presents and contrast to allow and learns the more efficient of feedback, contrast becomes apparent from.It is logical Picture name is crossed whether to compare description completely correctly without picture recognition analytical technology, is greatly reduced to equipment process performance It is required that reduce manufacture and design cost.Later stage can be constantly expanded in new by updating image content and database information Appearance and playing method, there is huge education and market value.
Brief description of the drawings
Attached drawing described herein is used for providing a further understanding of the present invention, forms the part of the present invention, this hair Bright schematic description and description is used to explain the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is described for identification language and is shown the learning aids system structure diagram of corresponding picture;
Fig. 2 is described for identification language and is shown the learning aids system flow chart of work methods of corresponding picture;
Wherein:1- handheld electronics devices;
2- screens;
3- loudspeakers;
4- microphones;
5- buttons;
6- presets picture;
7- identifies picture.
Embodiment
Some vocabulary has such as been used to censure specific components among specification and claim.Those skilled in the art should It is understood that hardware manufacturer may call same component with different nouns.This specification and claims are not with name The difference of title is used as the mode for distinguishing component, but is used as the criterion of differentiation with the difference of component functionally.Such as logical The "comprising" of piece specification and claim mentioned in is an open language, therefore should be construed to " include but do not limit In "." substantially " refer in receivable error range, those skilled in the art can be described within a certain error range solution Technical problem, basically reaches the technique effect.Specification subsequent descriptions are so described to implement the better embodiment of the present invention Description is for the purpose of illustrating the rule of the present invention, is not limited to the scope of the present invention.Protection scope of the present invention When subject to appended claims institute defender.
The present invention is described in further detail below in conjunction with attached drawing, but it is not as a limitation of the invention.
Embodiment 1:
With reference to Fig. 1, present embodiments provide a kind of identification language and describe and show the learning aids system of corresponding picture, including the palm Upper electronic equipment 1, embedded system, voice recognition chip and flash storage chips, wherein,
Screen 2, microphone 4, loudspeaker 3 and button 5 are carried on the handheld electronics device 1;
The embedded system, the screen 2 with the handheld electronics device 1, microphone 4, loudspeaker 3 and button 5 are connected respectively Connect;
The voice recognition chip is connected in the embedded system;
The embedded system is also connected with the flash storage chips, for storing image data.
The embedded system, is further the embedded system of ARM250 kernels.
The voice recognition chip, is further XFS5152CE voice recognition chips.
The capacity of the flash storage chips is in more than 1GB.
Comprised the following steps that during use:
Using some things as description object, the common attribute to the things is set out and describes;According to the group of different descriptors Conjunction relation, correspondence make different pictures respectively;The entitled variable n of things being described is set, various descriptors are set according to order For p1, p2 ... pn, these things names are defined as different numerical value from descriptor, per pictures filename be things name+ The contamination ,+pn.jpg that is named as n+p1+p2+ ... are described, whole pictures that the different combination of all properties is formed all store On the flash storage chips of system;
Default picture 6:The picture of a things is selected using the button 5, the picture of the things can be shown to the display A position on, obtain default picture 6;
Obtain identification picture 7:The things is described by language, the microphone 4 reads voice, and the voice recognition chip will be known The numerical value assignment corresponding to descriptor and things name not gone out is into variable n and p ,+pn.jpg the selections pair according to n+p1+p2+ ... The picture file answered is shown on the another location of screen 2, obtains identification picture 7;
When identification picture 7 is identical with default picture 6, loudspeaker 3 sends the right-on voice prompt of description of advance typing;
When voice identifies not successfully, describe unclear or does not show identification with any preset picture name Corresponding matching, display Picture 7, loudspeaker 3 send the voice prompt do not heard, please redescribed of advance typing.
Embodiment 2:
The identification language of the present invention describes and shows that the learning aids system of corresponding picture includes following equipment:(1)One carries Screen 2, microphone 4, loudspeaker 3, the handheld electronics device 1 of button 5;(2)ARM250 kernels built in equipment have same etc. The embedded system of rationality energy CPU, screen 2, microphone 4, loudspeaker 3, button 5 are connected with the embedded system;(3)Equipment The voice recognition chip of built-in XFS5152CE or equal disposal abilities, chip are connected in embedded system;Voice recognition chip Also speech recognition IC is, compared with traditional speech chip, the characteristics of voice recognition chip is maximum, is to speech recognition, it Machine can be allowed to understand the voice of the mankind, and various actions can be performed according to order, such as blink, open one's mouth bar(Intelligent baby Baby).In addition, also there is voice recognition chip high-quality, high compression rate to record player function, it can be achieved that human-computer dialogue.(4) Embedded system connects a flash storage chip, more than capacity 1GB, for storing the data such as picture.
Function declaration:(1)Using some things as description object, the common attribute to the things is set out and describes, such as:It is red The school bag of color, both shoulders school bag etc.;(2)According to the syntagmatic of different descriptors, correspondence makes different pictures respectively;(3) The entitled variable n of the things being described is set in a program, and various descriptors are set to p according to order1、p2…pn;(4)These things Name is defined as different numerical value from description vocabulary;(5)Filename per pictures is the combination of " things name+descriptor ", It is named as " n+p1+p2++pn.jpg ", whole pictures that the different combination of all properties is formed are stored in the flash of system On storage chip;(6)The picture of a things is selected after start using button 5, which can be shown to the one of display On a position;(7)Operator describes the things by language, and microphone 4 reads voice, and what pronounciation processing chip will identify that retouches Numerical value assignment corresponding to predicate and things name is into variable n and p;(8)According to n+p1+p2++pn.jpg corresponding picture is selected File is shown on the another location of screen 2;(9)If the picture shown afterwards is identical with the picture being pre-selected, loudspeaker 3 is sent out Go out " describing completely correct for advance typing!" voice prompt;(10)If voice identify or describe not successfully it is unclear, not with appoint What preset picture name Corresponding matching, display do not show new picture, and loudspeaker 3 sends " not hearing, please weigh for advance typing The voice prompt of new description ".
Embodiment 3:
With reference to Fig. 2, on the basis of embodiment 1 and embodiment 2, the present embodiment is Application Example, is comprised the following steps that:
1)Hand-held device switch is opened, a picture is chosen by button 5, picture is shown to the side of display;
2)Children describe the picture with voice, it is desirable to which description content includes the title of things and various pieces, position in the picture Feature;
3)Sound identification module identifies the segment description content of children, and the things name keyword that will identify that and each descriptor Correspondence is assigned to variable n, p to corresponding numerical value respectively1、p2…pn
4)System entitled n+p of selecting file from flash storage chips1+p2++pn.jpg picture, is shown to the another of screen 2 Side;
5)The picture and step 1 are judged by if type sentences)Whether the picture file name of middle selection is identical, the loudspeaker if identical " description is completely correct for 3 promptings!", reacted if differing without prompting, microphone 4 continues the standby voice for receiving new one section and retouches State.
Some preferred embodiments of the present invention have shown and described in described above, but as previously described, it should be understood that the present invention Be not limited to form disclosed herein, be not to be taken as the exclusion to other embodiment, and available for various other combinations, Modification and environment, and above-mentioned teaching or the technology or knowledge of association area can be passed through in the scope of the invention is set forth herein It is modified., then all should be in this hair and changes and modifications made by those skilled in the art do not depart from the spirit and scope of the present invention In the protection domain of bright appended claims.

Claims (5)

1. a kind of identification language describes and shows the learning aids system of corresponding picture, it is characterised in that is set including electric palm Standby, embedded system, voice recognition chip and flash storage chips, wherein,
Screen, microphone, loudspeaker and button are carried on the handheld electronics device;
The embedded system, the screen with the handheld electronics device, microphone, loudspeaker and button are connected respectively;
The voice recognition chip is connected in the embedded system;
The embedded system is also connected with the flash storage chips, for storing image data.
2. identification language according to claim 1 describes and shows the learning aids system of corresponding picture, it is characterised in that The embedded system, is further the embedded system of ARM250 kernels.
3. identification language according to claim 1 describes and shows the learning aids system of corresponding picture, it is characterised in that The voice recognition chip, is further XFS5152CE voice recognition chips.
4. identification language according to claim 1 describes and shows the learning aids system of corresponding picture, it is characterised in that The capacity of the flash storage chips is in more than 1GB.
5. identification language according to claim 1 describes and shows the learning aids system of corresponding picture, it is characterised in that Comprising the following steps that when in use:
Using some things as description object, the common attribute to the things is set out and describes;According to the group of different descriptors Conjunction relation, correspondence make different pictures respectively;The entitled variable n of things being described is set, various descriptors are set according to order For p1、p2…pn, these things names are defined as different numerical value from descriptor, and the filename per pictures is things name+retouch Contamination is stated, is named as n+p1+p2++pn.jpg, whole pictures that the different combination of all properties is formed, which are stored in, is On the flash storage chips of system;
Default picture:The picture of a things is selected using the button, the picture of the things can be shown to the display On one position, default picture is obtained;
Obtain identification picture:The things is described by language, the microphone reads voice, and the voice recognition chip will identify The numerical value assignment corresponding to descriptor and things name gone out is into variable n and p, according to n+p1+p2++pn.jpg select corresponding Picture file is shown on the another location of screen, obtains identification picture;
When identification picture is identical with default picture, loudspeaker sends the right-on voice prompt of description of advance typing;
When voice identifies not successfully, describe unclear or does not show identification with any preset picture name Corresponding matching, display Picture, loudspeaker send the voice prompt do not heard, please redescribed of advance typing.
CN201711309097.4A 2017-12-11 2017-12-11 A kind of identification language describes and shows the learning aids system of corresponding picture Pending CN108022464A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711309097.4A CN108022464A (en) 2017-12-11 2017-12-11 A kind of identification language describes and shows the learning aids system of corresponding picture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711309097.4A CN108022464A (en) 2017-12-11 2017-12-11 A kind of identification language describes and shows the learning aids system of corresponding picture

Publications (1)

Publication Number Publication Date
CN108022464A true CN108022464A (en) 2018-05-11

Family

ID=62072941

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711309097.4A Pending CN108022464A (en) 2017-12-11 2017-12-11 A kind of identification language describes and shows the learning aids system of corresponding picture

Country Status (1)

Country Link
CN (1) CN108022464A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090111075A1 (en) * 2007-10-29 2009-04-30 Sofia Midkiff Devices and related methods for teaching languages to young children
CN101604486A (en) * 2008-06-12 2009-12-16 王涛 Musical instrument playing and practicing method based on speech recognition technology of computer
CN203043559U (en) * 2012-12-27 2013-07-10 安徽科大讯飞信息科技股份有限公司 Intelligent voice recognition interactive toy device capable of being inserted with card
CN203910052U (en) * 2014-05-20 2014-10-29 孙新 Interactive language learning system based on material object
CN105184201A (en) * 2015-10-29 2015-12-23 陕西科技大学 RFID (radio frequency identification) technology based learning machine for early education and interaction of children and learning method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090111075A1 (en) * 2007-10-29 2009-04-30 Sofia Midkiff Devices and related methods for teaching languages to young children
CN101604486A (en) * 2008-06-12 2009-12-16 王涛 Musical instrument playing and practicing method based on speech recognition technology of computer
CN203043559U (en) * 2012-12-27 2013-07-10 安徽科大讯飞信息科技股份有限公司 Intelligent voice recognition interactive toy device capable of being inserted with card
CN203910052U (en) * 2014-05-20 2014-10-29 孙新 Interactive language learning system based on material object
CN105184201A (en) * 2015-10-29 2015-12-23 陕西科技大学 RFID (radio frequency identification) technology based learning machine for early education and interaction of children and learning method thereof

Similar Documents

Publication Publication Date Title
JP7483798B2 (en) Wordflow annotation
CN108000526B (en) Dialogue interaction method and system for intelligent robot
US11511436B2 (en) Robot control method and companion robot
CN104795067B (en) Voice interactive method and device
US10127226B2 (en) Method for dialogue between a machine, such as a humanoid robot, and a human interlocutor utilizing a plurality of dialog variables and a computer program product and humanoid robot for implementing such a method
CN103377568B (en) Multifunctional child somatic sensation educating system
CN107818781A (en) Intelligent interactive method, equipment and storage medium
CN106774970A (en) The method and apparatus being ranked up to the candidate item of input method
CN109410927A (en) Offline order word parses the audio recognition method combined, device and system with cloud
CN107798931A (en) A kind of intelligent children education learning system and method
US10657960B2 (en) Interactive system, terminal, method of controlling dialog, and program for causing computer to function as interactive system
JP7010000B2 (en) Information processing equipment and programs
CN110286764B (en) Multi-modal fusion experiment system and using method thereof
CN109765993A (en) The virtual reality academic environment of customization
CN106847279A (en) Man-machine interaction method based on robot operating system ROS
KR101583984B1 (en) Method for dialog using health information database and apparatus therefor
CN109313249B (en) Audio augmented reality system
CN112463106A (en) Voice interaction method, device and equipment based on intelligent screen and storage medium
CN109877834A (en) Multihead display robot, method and apparatus, display robot and display methods
WO2018033066A1 (en) Robot control method and companion robot
CN109326284A (en) The method, apparatus and storage medium of phonetic search
CN106356056B (en) Audio recognition method and device
CN110910898A (en) Voice information processing method and device
CN108022464A (en) A kind of identification language describes and shows the learning aids system of corresponding picture
US20230196943A1 (en) Narrative text and vocal computer game user interface

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180511

RJ01 Rejection of invention patent application after publication