CN209625781U - Bilingual switching device for child-parent education - Google Patents
Bilingual switching device for child-parent education Download PDFInfo
- Publication number
- CN209625781U CN209625781U CN201821664220.4U CN201821664220U CN209625781U CN 209625781 U CN209625781 U CN 209625781U CN 201821664220 U CN201821664220 U CN 201821664220U CN 209625781 U CN209625781 U CN 209625781U
- Authority
- CN
- China
- Prior art keywords
- cloud
- module
- voice
- target language
- bilingual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Machine Translation (AREA)
Abstract
The utility model relates to the bilingual switching devices for child-parent education, including the terminal device and cloud server mutually communicated, voice input module, bilingual switching executing module are provided on the terminal device, cloud processing module comprising communication unit, voice output module；The cloud server includes the cloud speech recognition module being sequentially electrically connected, cloud semantic understanding translation module, cloud target language voice synthetic module, further includes memory module.The device of the utility model allow will not the parent of target language language bilingual education, such as English, French etc. swimmingly are carried out to child；The language for the person that can identify education and guidance simultaneously translates into target language language, then repeats and listens to child, and being added to picture (as) can be more intuitive, joined the effect of assessment device test child's study.
Description
Technical field
The present invention relates to artificial intelligent voice identification, semantic understanding and speech synthesis solution technical applications, especially use
In the bilingual switching device of child-parent education.
Background technique
In child-parent education, parent is in order to allow child preferably to learn two or more language, and parent is as child-parent education
Guide (user), as teacher, child interacts between three as child-parent education object artificial intelligence device, to
Achieve the purpose that education and training child learns multilingual, needs in multilingual set to artificial intelligence device, according to religion
Trained child's language is educated to need that multilingual is enable mutually to switch.Currently, patent
201711194068.8, a kind of intelligent sound interactive device is disclosed, technical field of voice interaction, including sound are related to
Sound acquisition module, PFGA preprocessing module, intelligent interaction center；PFGA preprocessing module includes end-point detection unit；Endpoint inspection
Unit is surveyed electrically to be electrically connected with sound pretreatment unit, feature extraction unit respectively；Intelligent interaction center includes control unit；Control
Unit processed respectively with storage unit, speech recognition module, semantic understanding module, interaction process module, voice synthetic module, feedback
Module, loudspeaker are electrically electrically connected；The storage unit respectively with speech recognition module, semantic understanding module, interaction process mould
Block is electrically electrically connected；Voice synthetic module is electrically electrically connected with semantic understanding module, interaction process module respectively；The storage is single
Language model library, sound model library, semantic dictionary database, response message library are equipped in first；Acoustic model repository includes HMM model
Database and ANN model database；Language model library includes N-Gram model database and Rule-based model database, benefit
With feedback module to the feedback of identification information, and by control unit to present customers identification information, while controlling change sound
The interactive identification accuracy of interactive device is improved in Matching Model and language model library.But it is cut without providing the bilingual of child-parent education
Change technology.
Summary of the invention
In view of the deficiencies of the prior art, using artificial intelligent voice interaction technique, the bilingual switching people of child-parent education is provided
Work intelligent apparatus interacts parent, artificial intelligence device and child, realizes language learning child-parent education, use of the invention
In the bilingual switching device of child-parent education, characterized by comprising: the terminal device and cloud server mutually communicated,
It is provided on the terminal device
Voice input module, for obtaining externally input original languages voice signal；
Bilingual switching executing module, for selecting or being arranged asking for the cloud target language speech synthesis result that need to switch
It asks；
Cloud processing module comprising communication unit, the cloud processing module by communication unit and cloud server into
Row data exchange, for the original languages voice signal to be sent to cloud server and executes cloud by the cloud server
Speech recognition, the translation of cloud semantic understanding and cloud target language speech synthesis are held, the cloud that the cloud server is sent is received
Hold speech recognition, the translation of cloud semantic understanding and cloud target language speech synthesis result；
Voice output module, the voice signal of the result for exporting cloud target language speech synthesis；
The voice input module is electrically connected bilingual switching executing module, and the bilingual switching executing module is electrically connected cloud
Processing module, the cloud processing module are electrically connected voice output module；
The cloud server include the cloud speech recognition module being sequentially electrically connected, cloud semantic understanding translation module,
Cloud target language voice synthetic module, further includes memory module, the memory module respectively with cloud speech recognition module,
Cloud semantic understanding translation module, the electrical connection of cloud target language voice synthetic module.
Further, the bilingual switching executing module includes target language control unit, for double required for determining
The target language of language switching sends the voice signal to cloud speech recognition module, then carries out the conversion of cloud language text
With cloud target language speech synthesis.
Specifically, the voice output module includes loudspeaker, for providing cloud target language voice with speech form
Composite result.
Optionally, the terminal device connects mutual communication by radio network interface with the cloud server.
Further, the terminal device further includes image display module, the corresponding cloud server further include with
The corresponding image library of the cloud semantic understanding translation result provides cloud image library by image display module with image format
Matching result, and be showed on the image display unit of terminal device；Described image display module and the cloud processing module
Electrical connection carries out data exchange by the communication unit and cloud server.
Further, the terminal device further includes with reading module of testing and assessing, for child-parent education object with reading cloud target
The voice content of languages speech synthesis result is tested and assessed with reading, is obtained by voice input module with reading voice signal, cloud processing
Module is used to be sent to cloud server with reading voice signal for described and executes cloud speech recognition by the cloud server,
According to cloud speech recognition result give with read voice assessment, it is described with read assessment module respectively with voice input module and cloud
Processing module electrical connection.
Specifically, described with reading assessment module includes text semantic extraction method with reading unit of testing and assessing, and is mentioned using text semantic
It follows the example of and carries out with reading to test and assess.
Bilingual switching device for child-parent education of the invention is led in multilingual set to artificial intelligence device
Cross artificial intelligent voice interactive application technology, allow education and guidance person and child-parent education object (child) using the device (teacher) into
Row interacts bilingual switching, and the original languages language of input can repeat to export, form bilingual education environment, come with target language language
Realize that education and training child learns the purpose of multilingual, while the multimedia shows such as picture (as) of arranging in pairs or groups, voice is tested and assessed with reading
Etc. functions allow the more interesting smoothness of bilingual exchange, reinforce the effect of bilingual education and user experience.
In short, the device of the invention dictates voice, translation, voice synthetic technology creatively reasonable combination to reach double
The purpose of language education, and give figure and test and assess with reading.
Specifically, firstly, the device needs to carry out voice dictation function, i.e. recording voice is then converted into as text；It connects
, device can show corresponding picture (as) according to the content and meaning of text, and such as the photo of article, figure, thing are described in movement
The animation of part, the sound etc. of music；Meanwhile device can also translate text, be converted to the text of target language language；So
Afterwards, the text present apparatus voice of target language language can be synthesized pronunciation and read out by device；Finally, device can use voice
Dictation technology is with reading the content of translation and giving with reading voice assessment marking.
The device of the invention allow will not target language language parent swimmingly to child carry out bilingual education, than
Such as English, French etc.；The language for the person that can identify education and guidance simultaneously translates into target language language, then repeats and listens to child, adds
Add picture (as) more intuitive, joined the effect of assessment device test child's study.
Detailed description of the invention
Fig. 1 is the circuit theory schematic diagram of the device of the embodiment of the present invention one；
Fig. 2 is the circuit theory schematic diagram of the device of the embodiment of the present invention two；
Fig. 3 is the circuit theory schematic diagram of the device of the embodiment of the present invention three.
Wherein, 1- terminal device, 101-PC machine, 102- mobile phone, 11- voice input module, the bilingual switching of 12- execute mould
Block, 121- target language control unit, 13- cloud processing module, 131- communication unit, 14- voice output module, 15- is with reading
Assessment module, 16- image display module, 2- cloud server, the cloud 21- speech recognition module, the translation of the cloud 22- semantic understanding
Module, the cloud 23- target language voice synthetic module, 24- memory module are (interior to be equipped with language model library, sound model library, semanteme
Dictionary database, response message library), 25- image library.
Specific embodiment
The invention will be further described with reference to embodiments.
Embodiment one:
As shown in Figure 1, being used for the bilingual switching device of child-parent education, comprising: the terminal device mutually communicated and cloud clothes
Business device, the terminal device are PC machine, install apple windos operating system；
It is provided on the terminal device
Voice input module, it is externally input original for obtaining including the microphone being mounted on the terminal device
Languages voice signal is Chinese speech signal in the present embodiment；
Bilingual switching executing module, for selecting or being arranged asking for the cloud target language speech synthesis result that need to switch
It asks；The voice signal is sent extremely for the target language of bilingual switching required for determining including target language control unit
Cloud speech recognition module selects in the present embodiment or the cloud target language speech synthesis result that need to switch is arranged to be English language
Sound signal；
Cloud processing module comprising communication unit, the cloud processing module by communication unit and cloud server into
Row data exchange is known for the voice signal to be sent to cloud server and execute cloud voice by the cloud server
Not, the translation of cloud semantic understanding and cloud target language speech synthesis receive the cloud voice that the cloud server is sent and know
Not, the translation of cloud semantic understanding and cloud target language speech synthesis result；In the present embodiment, specifically: it is other that voice knows module
The voice of Chinese is converted to Chinese text, Chinese text is translated into English text, speech synthesis by semantic understanding translation module
English text is synthesized the voice of english language by module；
Voice output module, including the loudspeaker being mounted on the terminal device, for exporting cloud target language language
The English voice signal of the result of sound synthesis, there are two loudspeakers for setting in the present embodiment；
The voice input module is electrically connected bilingual switching executing module, and the bilingual switching executing module is electrically connected cloud
Processing module, the cloud processing module are electrically connected voice output module；
The cloud server include the cloud speech recognition module being sequentially electrically connected, cloud semantic understanding translation module,
Cloud target language voice synthetic module, further includes memory module, the memory module respectively with cloud speech recognition module,
Cloud semantic understanding translation module, the electrical connection of cloud target language voice synthetic module, the interior language that is equipped with of the memory module (contain
Original languages language and target language language) model library, sound (containing original languages sound and target language sound) model library, language
Adopted dictionary (containing original languages language and target language language) database, response message library.Wherein the cloud speech recognition (contains
Original languages speech recognition and target language speech recognition) module, cloud semantic understanding translation module and cloud target language language
Sound synthesis module is all made of Baidu's brain or Iflytek speech processes, semantic understanding and Speech Synthesis Algorithm.
The terminal device connects mutual communication by wired network interface with the cloud server.
Embodiment two:
As shown in Fig. 2, be used for child-parent education bilingual switching device, with embodiment one the difference is that: the terminal
Equipment is mobile phone, installs Android operation system；The terminal device and the cloud server are connected by radio network interface
Connect mutual communication；The terminal device further includes with reading module of testing and assessing, for child-parent education object with reading cloud target language language
The voice content of sound composite result with read test and assess, by voice input module obtain with read voice signal, cloud processing module its
In communication unit be used for by it is described with read voice signal be sent to cloud server and by the cloud server execute cloud
Speech recognition, that is, cloud language text converts and receives text conversion results, is converted with reading assessment module according to cloud language text
As a result give testing and assessing with reading voice, it is described to be carried out using text semantic extraction algorithm with reading assessment, such as 5 with reading assessment module
Having 4 words in the text information of word is target word (word met the requirements), accounts for 80%, meeting threshold value, (threshold value is set as being not less than
80%) it requires, assessment is qualified.With read assessment module respectively with voice input module, cloud processing module and voice output module
Electrical connection.The text results for showing " this test passes " on mobile phone screen or loudspeaker are sent out with reading assessment module
The result (sound) of " this test passes ".
Remaining content is the same as embodiment one.
Embodiment three:
As shown in figure 3, be used for child-parent education bilingual switching device, with embodiment two the difference is that: the terminal
Equipment further includes image display module, and the corresponding cloud server further includes and the cloud semantic understanding translation result phase
Corresponding image library provides cloud image library matching result by image display module with image format, and is showed in terminal device
Image display unit on, in the present embodiment be mobile phone display screen；Specifically, the cloud language received according to cloud processing module
Sound identification, cloud semantic understanding translation result (text returned), extract keyword, then show these in the form of a list
The relevant information of keyword, such as keyword are apple (apple), then show the example diagram of apple, the contents such as brief introduction；
Described image display module is electrically connected with the cloud processing module, passes through the communication list of the cloud processing module
Member carries out data exchange with cloud server.
It include the photo of article in described image library, figure, the contents such as animation of event are described in movement.
The device of the present embodiment can show corresponding picture (as), such as article according to the semantic content and meaning of understanding
Photo, movement describes figure, the animation of event, the sound etc. of music, by the comprehensive stimulation to child's eye, ear, brain, by force
Change learning effect.
Claims (6)
1. being used for the bilingual switching device of child-parent education, characterized by comprising: the terminal device and cloud service mutually communicated
Device,
It is provided on the terminal device
Voice input module, for obtaining externally input original languages voice signal；
Bilingual switching executing module, for selecting or being arranged the request for the cloud target language speech synthesis result that need to switch；
Cloud processing module comprising communication unit, the cloud processing module are counted by communication unit and cloud server
According to exchange, for the original languages voice signal to be sent to cloud server and executes cloud language by the cloud server
Sound identification, the translation of cloud semantic understanding and cloud target language speech synthesis, receive the cloud language that the cloud server is sent
Sound identification, the translation of cloud semantic understanding and cloud target language speech synthesis result；
Voice output module, the voice signal of the result for exporting cloud target language speech synthesis；
The voice input module is electrically connected bilingual switching executing module, the bilingual switching executing module electrical connection cloud processing
Module, the cloud processing module are electrically connected voice output module；
The cloud server includes the cloud speech recognition module being sequentially electrically connected, cloud semantic understanding translation module, cloud
Target language voice synthetic module further includes memory module, the memory module respectively with cloud speech recognition module, cloud
Semantic understanding translation module, the electrical connection of cloud target language voice synthetic module；
The bilingual switching executing module includes target language control unit, the target language for bilingual switching required for determining
Kind, the voice signal is sent to cloud speech recognition module.
2. bilingual switching device according to claim 1, it is characterised in that the voice output module includes loudspeaker, is used
In with speech form offer cloud target language speech synthesis result.
3. bilingual switching device according to claim 1, which is characterized in that the terminal device and the cloud server
Mutually communication is connected by radio network interface.
4. bilingual switching device according to claim 1, which is characterized in that the terminal device further includes that image shows mould
Block, the corresponding cloud server further includes image library corresponding with the cloud semantic understanding translation result, by image
Display module provides cloud image library matching result with image format, and is showed on the image display unit of terminal device；Institute
Image display module is stated to be electrically connected with the cloud processing module, by the image library of the communication unit and cloud server into
Row data exchange.
5. bilingual switching device according to claim 1, which is characterized in that the terminal device further includes with reading mould of testing and assessing
Block, for child-parent education object with read cloud target language speech synthesis result voice content with read test and assess, it is defeated by voice
Enter module obtain with read voice signal, cloud processing module be used for by it is described with read voice signal be sent to cloud server and by
The cloud server executes cloud speech recognition, is given according to cloud speech recognition result with reading voice assessment, described with reading
Assessment module is electrically connected with voice input module and cloud processing module respectively.
6. bilingual switching device according to claim 5, which is characterized in that it is described with read assessment module include text semantic
Extraction method is carried out using text semantic extraction method with reading to test and assess with reading unit of testing and assessing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821664220.4U CN209625781U (en) | 2018-10-12 | 2018-10-12 | Bilingual switching device for child-parent education |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201821664220.4U CN209625781U (en) | 2018-10-12 | 2018-10-12 | Bilingual switching device for child-parent education |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN209625781U true CN209625781U (en) | 2019-11-12 |
Family
ID=68442193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201821664220.4U Active CN209625781U (en) | 2018-10-12 | 2018-10-12 | Bilingual switching device for child-parent education |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN209625781U (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109272983A (en) * | 2018-10-12 | 2019-01-25 | 武汉辽疆科技有限公司 | Bilingual switching device for child-parent education |
-
2018
- 2018-10-12 CN CN201821664220.4U patent/CN209625781U/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109272983A (en) * | 2018-10-12 | 2019-01-25 | 武汉辽疆科技有限公司 | Bilingual switching device for child-parent education |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110033659B (en) | Remote teaching interaction method, server, terminal and system | |
| KR102401942B1 (en) | Method and apparatus for evaluating translation quality | |
| US20210233521A1 (en) | Method for speech recognition based on language adaptivity and related apparatus | |
| CN110490213B (en) | Image recognition method, device and storage medium | |
| US20230032385A1 (en) | Speech recognition method and apparatus, device, and storage medium | |
| CN110600033B (en) | Learning condition evaluation method and device, storage medium and electronic equipment | |
| CN107992195A (en) | A kind of processing method of the content of courses, device, server and storage medium | |
| CA3011397A1 (en) | Natural expression processing method, processing and response method, device and system | |
| CN104380375A (en) | Device for extracting information from a dialog | |
| US20240070397A1 (en) | Human-computer interaction method, apparatus and system, electronic device and computer medium | |
| CN109272983A (en) | Bilingual switching device for child-parent education | |
| CN111651497A (en) | User label mining method and device, storage medium and electronic equipment | |
| CN108614851A (en) | Notes content display methods in tutoring system and device | |
| CN110880324A (en) | Voice data processing method and device, storage medium and electronic equipment | |
| CN110444087A (en) | A kind of intelligent language teaching machine device people | |
| KR20130086971A (en) | Question answering system using speech recognition and its application method thereof | |
| CN112232066A (en) | Teaching outline generation method and device, storage medium and electronic equipment | |
| CN110647613A (en) | Courseware construction method, courseware construction device, courseware construction server and storage medium | |
| Dhanjal et al. | An optimized machine translation technique for multi-lingual speech to sign language notation | |
| CN209625781U (en) | Bilingual switching device for child-parent education | |
| CN112165627A (en) | Information processing method, device, storage medium, terminal and system | |
| Bangalore et al. | Balancing data-driven and rule-based approaches in the context of a multimodal conversational system | |
| Cui et al. | Evaluation System of Mobile English Learning Platform by Using Deep Learning Algorithm | |
| Gayathri et al. | Sign language recognition for deaf and dumb people using android environment | |
| CN115222857A (en) | Method, apparatus, electronic device and computer readable medium for generating avatar |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |