CN108877344A - A kind of Multifunctional English learning system based on augmented reality - Google Patents
A kind of Multifunctional English learning system based on augmented reality Download PDFInfo
- Publication number
- CN108877344A CN108877344A CN201810804407.8A CN201810804407A CN108877344A CN 108877344 A CN108877344 A CN 108877344A CN 201810804407 A CN201810804407 A CN 201810804407A CN 108877344 A CN108877344 A CN 108877344A
- Authority
- CN
- China
- Prior art keywords
- image
- data
- english
- module
- english word
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/067—Combinations of audio and projected visual presentation, e.g. film, slides
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
Abstract
The Multifunctional English learning system based on augmented reality that the present invention relates to a kind of, including：AR glasses, image acquisition device, micro projector, acoustical generator, microphone and central controller；The present invention is by AR technical application into English learning system, pass through the Image Acquisition to real world object, the subject image that the image of acquisition is stored with system is compared, the information of current object can be picked out after successful match, then object Chinese name and English word corresponding to the object information are extracted in system memory, and image conversion is carried out, virtual display object is obtained, virtual display object is directly displayed on AR glasses in conjunction with real scene；It is thus achieved that figure and English word are associated with, simultaneously by listening to the pronunciation and oral account Chinese translation of English word, further deepens the memory depth of word, enable the system to complete teaching at any time in any actual scene, the limitation for overcoming existing mode of learning improves the efficiency of study.
Description
Technical field
The present invention relates to English teaching apparatus fields, and in particular to a kind of Multifunctional English based on augmented reality
Learning system.
Background technique
Currently, English study has obtained the attention of more and more people, from the education of the initiation in child's period into work, English
Language study is either in study or in working stage, in occupation of a certain proportion of time.The study in child's period, which is compared, is
System, student have special learning time and space, but for the office worker for wanting education and charging, the item of English study
Part is fairly limited, and work and daily life have occupied the most of the time of life, can not extract special time progress out
Study, this is difficult to adhere to getting off for adult in current allegro life.In addition, not passing through a system
Learning planning, the spare time can be occupied by some non-essential things, to waste the time to study English.
In addition, in learning English, either to Oral Activities, or for literacy, word
Accumulation is all the matter of utmost importance for needing to overcome.Traditional vocabulary memorization method is the concrete meaning and usage for first understanding word,
Then learner's consolidating memory is helped by way of pronunciation mark and spelling.But the efficiency for carrying on the back word in this way is lower,
And need a large amount of time to carry out repetitive memory, while being also weary of psychology because uninteresting memory pattern causes learner to generate, into
One step reduces learning efficiency.For this purpose, some educational institutions provide various Associative mnemonics, such as：Etyma and affix association note
Recall method, clang association mnemonics, the meaning of a word and compare mnemonics and figure Associative mnemonics etc., quickly to improve the note of English word
Recall speed.It is and in above-mentioned many associative memory methods, figure and the English word mode that is mutually related is maximally efficient, it is mesh
The preceding mnemonics most in accordance with the brain operating mode of the mankind, efficiency improves 3-10 times compared with other memory styles.
Currently, the operational mode of figure Associative mnemonics is static graphics to print on books or is broadcast with teaching equipment
The pre-set image put is as teaching reference, it is desirable to provide and specific time and environment are completed to learn, therefore, the application of this method
It is had some limitations in learning process.
Summary of the invention
It is an object of the present invention to solve in the prior art, there is no the English religions for the application of figure Associative mnemonics
System, provides a kind of Multifunctional English learning system based on augmented reality, and system of the invention passes through with enhancing
Reality technology, the material object of reality scene is interrelated with English word, teaching can be completed at any time in any actual scene,
Overcome the limitation of existing mode of learning.
To achieve the above object, a kind of Multifunctional English learning system based on augmented reality provided by the invention,
The system includes：AR glasses, image acquisition device, micro projector, acoustical generator, microphone and central controller；
At least two image acquisition devices are symmetrically arranged on the two sides mirror holder of the AR glasses, the image acquisition device is used
Image in its visual range of acquisition, and the image data of generation is sent to central controller；
The central controller carries out feature extraction to object from image data, by analyzing characteristic
Afterwards to pick out object information, and object Chinese name corresponding to object information and English word are subjected to image conversion, obtained
It obtains and virtually shows object, virtual display object is rendered in conjunction with real scene, and will be after rendering by micro projector
Virtual display object is projected, while the corresponding pronunciation data of English word is sent to acoustical generator, and the sound to receive
Wave electric signal carries out semantic analysis, extracts through parsing English word corresponding to obtained text, then carries out image conversion；It should
Central controller is also used to identify the gesture data of human body from received image data, by analyzing gesture data
After generate corresponding action data, and execute man-machine interactive operation using the action data；
The signal input part of the micro projector is connect with central controller, the projection end of the micro projector with AR
The half-transmitting mirror being arranged on mirror is opposite, the image projection for exporting central controller to half-transmitting mirror；
The signal input part of the acoustical generator is connect with central controller, the pronunciation number for exporting central controller
It is played out according to voice signal is converted into；
The signal input part of the microphone is connect with central controller, for receiving the voice of human body sending, and will
Voice is sent to central controller after being converted into sound wave electric signal.
As a further improvement of the above technical scheme, the image acquisition device carries out image using CCD camera
Acquisition.
As a further improvement of the above technical scheme, the central controller includes：Signal processing module, feature mention
Modulus block, object identification module, knowledge base, image rendering module, pronunciation data delivery module, semantic meaning analysis module and gesture are distinguished
Know module；
The signal processing module is used to receive the picture signal of image acquisition device output, and will be at picture signal
Reason generates the image data identified for characteristic extracting module；
The characteristic extracting module is used to identify the characteristic of object in image data, and by the feature of acquisition
Data are sent to object identification module, and the characteristic includes color, texture, profile and the three-dimensional shape data of object；
The object identification module matches the feature composite sequence stored in characteristic and knowledge base, extracts
Object Chinese name corresponding to matched feature composite sequence, English word and the corresponding pronunciation data of English word；
The semantic meaning analysis module carries out semantic analysis for receiving sound wave electric signal, and to the sound wave electric signal, will
The English word for parsing obtained text and storing in knowledge base is matched, and is extracted matched English word and is sent to figure
As rendering module；
For the knowledge base for storing various feature composite sequences, the feature composite sequence includes the face by object
The feature combination and its corresponding object Chinese name, English word and English that color, texture, profile and three-dimensional shape data form
The corresponding pronunciation data of word；
The image rendering module is used to match the object Chinese name obtained and English word carries out image conversion,
Virtual display object is obtained, and combines the display position of the selected virtual display object in the position of object in real scene, while root
Illumination render is carried out to virtual display object according to the brightness in real scene picture frame；
The pronunciation data delivery module is used to the corresponding pronunciation data of English word being sent to acoustical generator；
The gesture identification module is used to identify the gesture data of human body in image data, and by gesture number
According to generating corresponding action data after being analyzed, and with the operation of action data control central controller.
As a further improvement of the above technical scheme, the signal processing module includes：A/D converter, signal are put
Big device and filter, the signal for exporting image acquisition device successively carry out analog-to-digital conversion, amplification and filtering processing.
As a further improvement of the above technical scheme, the central controller further includes mode of learning selecting module,
Several modes of learning are provided in the mode of learning selecting module, the object for obtaining the matching of object identification module
Chinese name and English word are compared with the mode of learning that user selectes, if there are matching acquisitions in mode of learning
Object Chinese name and English word then export object Chinese name and English word to image rendering module, otherwise not defeated
The object Chinese name and English word that the matching obtains out；
The mode of learning is to combine sequence to all features stored in knowledge base according to different grades of know-how
Column are divided, and are combined into corresponding object Chinese name and English word set.
As a further improvement of the above technical scheme, the knowledge base also store with the associated phonetic symbol of English word,
Example sentence and mind map data；
The object identification module is also used to extract and the associated phonetic symbol of English word, example sentence and mind map data,
And it is sent to image rendering module；
Phonetic symbol, example sentence and the mind map data that the image rendering module is also used to receive carry out image and turn
Change, obtain virtual display object, and combine the display position of the selected virtual display object in the position of object in real scene, simultaneously
Illumination render is carried out to virtual display object according to the brightness in real scene picture frame；
The mind map data be using match obtain English word as core, will all English relevant to its attribute
The associated diagram that literary word constructs.
A kind of Multifunctional English learning system advantage based on augmented reality provided by the invention is：
The present invention into English learning system, by the Image Acquisition to real world object, and will acquire AR technical application
The subject image that is stored with system of image compare, the information of current object can be picked out after successful match, at this time
Object Chinese name, English word corresponding to the object information and the corresponding hair of English word can be extracted in system memory
Sound data, these English words are exactly that learner needs to remember；For this purpose, object Chinese name and English word are carried out image
Conversion obtains virtual display object, and virtual display object is directly displayed on AR glasses in conjunction with real scene；It is thus achieved that
Figure is associated with English word, while the pronunciation by listening to English word, further deepens the memory depth of word, thus
Teaching can be completed at any time in any actual scene, overcome the limitation of existing mode of learning, improved learning efficiency；For
The relevance of knowledge learning is improved, the present invention also passes through voice input system of the microphone by learner of setting, passes through
Central controller carries out semantics recognition, helps learner to obtain it and gives an oral account english vocabulary corresponding to Chinese vocabulary, facilitates study
Person expands memory, further increases learning efficiency, while also meeting the multi-functional demand of learner.
Detailed description of the invention
Fig. 1 is a kind of Multifunctional English learning system structural schematic diagram based on augmented reality provided by the invention；
Fig. 2 is the central controller structural schematic diagram provided in one embodiment of the invention；
Fig. 3 is the central controller structural schematic diagram provided in another embodiment of the present invention；
Fig. 4 is the signal processing module structural schematic diagram provided in the embodiment of the present invention；
Fig. 5 a is the AR eyeglasses-wearing schematic diagram provided in the embodiment of the present invention；
Fig. 5 b is the AR glasses external structure schematic diagram provided in the embodiment of the present invention.
Appended drawing reference
1, AR glasses 2, image acquisition device
3, micro projector 4, half-transmitting mirror
Specific embodiment
With reference to the accompanying drawings and examples to a kind of Multifunctional English based on augmented reality of the present invention
Learning system is described in detail.
As shown in Figure 1, a kind of Multifunctional English learning system based on augmented reality provided by the invention, the system
It specifically includes：AR glasses, image acquisition device, micro projector, acoustical generator, microphone and central controller.
As shown in Figure 5 b, at least two image acquisition devices 2 are symmetrically arranged on the two sides mirror holder of the AR glasses 1, it is described
Image acquisition device 2 be used to acquire image in its visual range, and the image data of generation is sent to central controller；
The central controller carries out feature extraction to object from image data, by analyzing characteristic
Afterwards to pick out object information, and object Chinese name corresponding to object information and English word are subjected to image conversion, obtained
It obtains and virtually shows object, virtual display object is rendered in conjunction with real scene, and will be after rendering by micro projector
Virtual display object is projected, while the corresponding pronunciation data of English word is sent to acoustical generator, and the sound to receive
Wave electric signal carries out semantic analysis, extracts through parsing English word corresponding to obtained text, then carries out image conversion；It should
Central controller is also used to identify the gesture data of human body from received image data, by analyzing gesture data
After generate corresponding action data, and execute man-machine interactive operation using the action data；
The signal input part of the acoustical generator is connect with central controller, the pronunciation number for exporting central controller
It is played out according to voice signal is converted into；
The signal input part of the microphone is connect with central controller, for receiving the voice of human body sending, and will
Voice is sent to central controller after being converted into sound wave electric signal.
The signal input part of the micro projector is connect with central controller, as shown in Figure 5 b, the micro projector 3
The half-transmitting mirror 4 being arranged on projection end and AR glasses 1 is opposite, the image projection for exporting central controller to half-transmitting mirror
On 4, and by half-transmitting mirror 4 will virtual display object reflection to people eye；
The light that the half-transmitting mirror 4 can be such that micro projector 3 projects is reflected, and makes the light of external environment incidence
It is transmitted, so that real scene and virtual objects are realized image co-registration in human eye portion.Wherein, the state of AR glasses is worn
As shown in Figure 5 a.
Frontend experience of the AR technology as current virtual reality technology, has a wide range of applications in various industries.It is one
The concept of kind of image procossing be combined with each other with multi view tool and becomes as a special kind of skill, that is, it has often been said that enhancing it is existing
It is real.The target of this technology is that virtual world is covered in real world and interacted on the screen, is needed on realizing effect
The multimedias such as camera, sensor are merged with scene, augmented reality not only presents the information of real world, but also will
Virtual information shows that two kinds of information are complementary to one another, are superimposed simultaneously.
The present invention into English teaching system, by the Image Acquisition to real world object, and incites somebody to action above-mentioned AR technical application
The subject image that the image of acquisition is stored with system compares, and the information of current object can be picked out after successful match,
Object Chinese name and English word corresponding to the object information, these English words can be extracted in system memory at this time
Exactly learner needs to remember；For this purpose, object Chinese name and English word are carried out image conversion, virtual display pair is obtained
As virtual display object is directly displayed on AR glasses in conjunction with real scene；It is thus achieved that the pass of figure and English word
Connection, while the pronunciation by listening to English word deepen the memory depth of word, further so as in any actual scene
In at any time complete teaching, overcome the limitation of existing mode of learning, improve learning efficiency.
Compared to existing many teaching equipments, English study is carried out using system of the invention, user does not need
Study is absorbed in regular time or place, it is only necessary to wear moveable AR vision glasses, walking in everyday environments is
Image conversion, associated with real world object english knowledge can be observed at any time.At the same time, in conjunction with the perception function of human body gesture
Can, it can be realized man-machine interactive operation, the operation of person's manual control system easy to produce.
In order to improve the relevance of knowledge learning, the present invention also passes through voice typing of the microphone by learner of setting
System carries out semantics recognition by central controller, helps learner to obtain it and gives an oral account english vocabulary corresponding to Chinese vocabulary,
Facilitate learner to expand memory, further increases learning efficiency, while also meeting the multi-functional demand of learner.
In order to realize the intelligent control function of above-mentioned central controller, as shown in Fig. 2, the central controller in the present embodiment
May include：Signal processing module, characteristic extracting module, object identification module, knowledge base, image rendering module, pronunciation data pass
Send module, semantic meaning analysis module and gesture identification module.
The signal processing module is used to receive the picture signal of image acquisition device output, and will be at picture signal
Reason generates the image data identified for characteristic extracting module；
The characteristic extracting module is used to identify the characteristic of object in image data, and by the feature of acquisition
Data are sent to object identification module, and the characteristic includes color, texture, profile and the three-dimensional shape data of object；
The object identification module matches the feature composite sequence stored in characteristic and knowledge base, extracts
Object Chinese name corresponding to matched feature composite sequence, English word and the corresponding pronunciation data of English word；
The semantic meaning analysis module carries out semantic analysis for receiving sound wave electric signal, and to the sound wave electric signal, will
The English word for parsing obtained text and storing in knowledge base is matched, and is extracted matched English word and is sent to figure
As rendering module；
For the knowledge base for storing various feature composite sequences, the feature composite sequence includes the face by object
The feature combination and its corresponding object Chinese name, English word and English that color, texture, profile and three-dimensional shape data form
The corresponding pronunciation data of word；
The image rendering module is used to match the object Chinese name obtained and English word carries out image conversion,
Virtual display object is obtained, and combines the display position of the selected virtual display object in the position of object in real scene, while root
Illumination render is carried out to virtual display object according to the brightness in real scene picture frame；
The pronunciation data delivery module is used to the corresponding pronunciation data of English word being sent to acoustical generator；
The gesture identification module is used to identify the gesture data of human body in image data, and by gesture number
According to generating corresponding action data after being analyzed, and with the operation of action data control central controller.
As shown in figure 3, in another embodiment of the present invention, the central controller may also include mode of learning choosing
Module is selected, is provided with several modes of learning in the mode of learning selecting module, for obtaining the matching of object identification module
The object Chinese name and English word obtained is compared with the mode of learning that user selectes, if there is this in mode of learning
Object Chinese name and English word with acquisition, then export object Chinese name and English word to image rendering module,
Otherwise the object Chinese name and English word of matching acquisition are not exported；
The mode of learning is to combine sequence to all features stored in knowledge base according to different grades of know-how
Column are divided, and are combined into corresponding object Chinese name and English word set.
For different crowds, there can be different learning demands；For this purpose, system of the invention is with different knowledge
English word is divided into multiple set by level；Such as：Can be divided into for student examination meet small English learning, junior English,
Senior High School English, university's Band Four Test, six grades of examinations of university, professional Band Four Test, professional eight grades of examinations, TOEFL, refined thinking
A variety of word finders such as examination, can be divided into for office worker and meet daily communication term, business exchange term, technology specialty term etc.
A variety of word finders.Learner can select corresponding mode of learning according to the grade of itself demand and know-how；It is selected in mode
After fixed, vocabulary present in system meeting output mode not shows the over range vocabulary that matching obtains, realizes individual character
The instructional function of change.
In addition, as shown in figure 4, CCD camera can be used in the image acquisition device in present system is acquired to image.
CCD is the abbreviation of Charge Coupled Device (charge-coupled device), it is a kind of semiconductor imaging device, thus is had
There is high sensitivity, resist that strong light, distortion is small, small in size, the service life is long, anti-vibration；In addition, the present invention with CCD by taking the photograph
As head realization Image Acquisition, the higher clear image of resolution ratio can be obtained, is provided for the subsequent data analysis of central controller
It ensures.
As shown in figure 4, the signal processing module can be by the A/D converter of setting, by its received analog signal
Be converted to the digital signal for characteristic extracting module and gesture identification module identification；Meanwhile in order to reduce the noise jamming of signal,
The detection accuracy of signal is improved, the signal processing module may also include signal amplifier and filter, for adopting image
The signal of storage output is amplified and is filtered.
In addition, the knowledge base is also stored closes with English word in order to further increase the memory effect of english knowledge
Phonetic symbol, example sentence and the mind map data of connection.
For this purpose, the object identification module is also used to extract and the associated phonetic symbol of English word, example sentence and mind map
Data, and it is sent to image rendering module；Phonetic symbol, example sentence and the thinking that the image rendering module is also used to receive are led
Diagram data carries out image conversion, obtains virtual display object, and combines the selected virtual display pair in the position of object in real scene
The display position of elephant, while illumination render is carried out to virtual display object according to the brightness in real scene picture frame.The present invention
System the information of various dimensions is associated with English word, can further deepen understanding of the learner to english knowledge, together
Its vocabulary operational capability of Shi Tigao.
Above-mentioned mind map is called intelligence and leads figure, is the active graphical media of thinking for expressing divergent thinking, it is simply but
Again very effectively.The skill that mind map is laid equal stress on picture and text, the relationship of themes at different levels with being mutually subordinate to and relevant stratal diagram
It shows, the foundation such as subject key words and image, color memory is linked.Mind map sufficiently uses the function of left and right brain,
Using the rule of memory, reading, thinking, people's balanced growth between science and art, the logical AND imagination is assisted, to open
Therefore the unlimited potential of human brain, mind map have the power of human thinking.
In addition, mind map is a kind of method for visualizing thinking.It is understood that radiant thinking is human brain
Thought of nature mode, each enters the data of brain, whether feeling, memory or idea --- including text, number, symbol
Code, fragrance, food, lines, color, image, rhythm, note etc. can become a thinking center, and thus center is outside
Thousands of artis is exhaled, each artis represents a connection with central theme, and each connection can
To become another central theme, then thousands of artis is exhaled outward, show radioactivity stereochemical structure.
The marrow remembered with mind map is, balances the utilization of National People's Congress's brain left brain and right brain, stimulates out in brain
Potential, the information that will be present in brain becomes visual picture and text and is remembered, because of human brain connecing for graph text information
Be higher by nearly a hundred times by memory capability than individual text, wherein need most mass memory no more than English word.
Based on the principle of above-mentioned mind map, the diagram data of leading provided by the present invention for study is to match the English obtained
Literary word is core, the associated diagram that all English words relevant to its attribute are constructed, by the way that mind map, energy is arranged
It is enough to help learner to be extended the knowledge of study while improving memorizing rate.
It should be noted last that the above examples are only used to illustrate the technical scheme of the present invention and are not limiting.Although ginseng
It is described the invention in detail according to embodiment, those skilled in the art should understand that, to technical side of the invention
Case is modified or replaced equivalently, and without departure from the spirit and scope of technical solution of the present invention, should all be covered in the present invention
Scope of the claims in.
Claims (6)
1. a kind of Multifunctional English learning system based on augmented reality, which is characterized in that including：AR glasses, image are adopted
Storage, micro projector, acoustical generator, microphone and central controller；
At least two image acquisition devices (2), the image acquisition device are symmetrically arranged on the two sides mirror holder of the AR glasses (1)
(2) for acquiring the image in its visual range, and the image data of generation is sent to central controller；
The central controller from image data to object carry out feature extraction, by after analyzing characteristic with
Object information is picked out, and object Chinese name corresponding to object information and English word are subjected to image conversion, is obtained empty
Quasi- display object renders virtual display object in conjunction with real scene, and passes through micro projector (3) for the void after rendering
Quasi- display object is projected, while the corresponding pronunciation data of English word is sent to acoustical generator, and the sound wave to receive
Electric signal carries out semantic analysis, extracts through parsing English word corresponding to obtained text, then carries out image conversion；In this
Centre controller is also used to identify the gesture data of human body from received image data, after analyzing gesture data
Corresponding action data is generated, and executes man-machine interactive operation using the action data；
The signal input part of the micro projector (3) is connect with central controller, the projection end of the micro projector (3) and AR
The half-transmitting mirror (4) being arranged on glasses (1) relatively, image projection for exporting central controller to half-transmitting mirror (4)；
The signal input part of the acoustical generator is connect with central controller, and the pronunciation data for exporting central controller turns
Voice signal is changed into play out；
The signal input part of the microphone is connect with central controller, for receiving the voice of human body sending, and by voice
Central controller is sent to after being converted into sound wave electric signal.
2. the Multifunctional English learning system according to claim 1 based on augmented reality, which is characterized in that described
Image acquisition device image is acquired using CCD camera.
3. the Multifunctional English learning system according to claim 1 based on augmented reality, which is characterized in that described
Central controller include：Signal processing module, characteristic extracting module, object identification module, knowledge base, image rendering module,
Pronunciation data delivery module, semantic meaning analysis module and gesture recognize module；
The signal processing module is used to receive the picture signal of image acquisition device output, and picture signal is handled, raw
At the image data identified for characteristic extracting module；
The characteristic extracting module is used to identify the characteristic of object in image data, and by the characteristic of acquisition
It is sent to object identification module, the characteristic includes color, texture, profile and the three-dimensional shape data of object；
The object identification module matches the feature composite sequence stored in characteristic and knowledge base, extracts warp
Object Chinese name corresponding to the feature composite sequence matched, English word and the corresponding pronunciation data of English word；
The semantic meaning analysis module carries out semantic analysis for receiving sound wave electric signal, and to the sound wave electric signal, will parse
Obtained text and the English word stored in knowledge base are matched, and are extracted matched English word and are sent to image wash with watercolours
Contaminate module；
The knowledge base for storing various feature composite sequences, the feature composite sequence include by object color,
The feature combination of texture, profile and three-dimensional shape data composition and its corresponding object Chinese name, English word and English are single
The corresponding pronunciation data of word；
The image rendering module is used to match the object Chinese name obtained and English word carries out image conversion, obtains
Virtual display object, and the display position of the selected virtual display object in the position of object in real scene is combined, while according to true
Brightness in real field scape picture frame carries out illumination render to virtual display object；
The pronunciation data delivery module is used to the corresponding pronunciation data of English word being sent to acoustical generator；
The described gesture identification module is used to identify the gesture data of human body in image data, and by gesture data into
Corresponding action data is generated after row analysis, and with the operation of action data control central controller.
4. the Multifunctional English learning system according to claim 3 based on augmented reality, which is characterized in that described
Signal processing module include：A/D converter, signal amplifier and filter, signal for exporting image acquisition device according to
Secondary progress analog-to-digital conversion, amplification and filtering processing.
5. the Multifunctional English learning system according to claim 3 based on augmented reality, which is characterized in that described
Central controller further include mode of learning selecting module, be provided in the mode of learning selecting module several study mould
Formula, the object Chinese name and English word for obtaining the matching of object identification module are compared with the mode of learning that user selectes
Compared with, if the object Chinese name and English word that obtain in mode of learning there are the matching, by object Chinese name and
English word exports the object Chinese name and English word for otherwise not exporting matching acquisition to image rendering module；
The mode of learning be according to different grades of know-how to all feature composite sequences stored in knowledge base into
Row divides, and is combined into corresponding object Chinese name and English word set.
6. the Multifunctional English learning system according to claim 3 based on augmented reality, which is characterized in that described
Knowledge base also store with the associated phonetic symbol of English word, example sentence and mind map data；
The object identification module is also used to extract and the associated phonetic symbol of English word, example sentence and mind map data, concurrently
It send to image rendering module；
Phonetic symbol, example sentence and the mind map data that the image rendering module is also used to receive carry out image conversion, obtain
It obtains and virtually shows object, and combine the display position of the selected virtual display object in the position of object in real scene, while basis
Brightness in real scene picture frame carries out illumination render to virtual display object；
The mind map data be to match the English word obtained as core, will all English relevant to its attribute it is single
The associated diagram that word constructs.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810804407.8A CN108877344A (en) | 2018-07-20 | 2018-07-20 | A kind of Multifunctional English learning system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810804407.8A CN108877344A (en) | 2018-07-20 | 2018-07-20 | A kind of Multifunctional English learning system based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108877344A true CN108877344A (en) | 2018-11-23 |
Family
ID=64303684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810804407.8A Withdrawn CN108877344A (en) | 2018-07-20 | 2018-07-20 | A kind of Multifunctional English learning system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108877344A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111563514A (en) * | 2020-05-14 | 2020-08-21 | 广东小天才科技有限公司 | Three-dimensional character display method and device, electronic equipment and storage medium |
| CN111583420A (en) * | 2020-05-27 | 2020-08-25 | 上海乂学教育科技有限公司 | Intelligent learning system and method based on augmented reality mode |
| CN112866678A (en) * | 2021-01-04 | 2021-05-28 | 融信信息科技有限公司 | Image recognition system based on AR intelligent glasses |
| CN113794872A (en) * | 2021-09-17 | 2021-12-14 | 融信信息科技有限公司 | Image recognition system based on AR intelligent glasses |
| CN113990128A (en) * | 2021-10-29 | 2022-01-28 | 重庆电子工程职业学院 | AR-based intelligent display system |
Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968915A (en) * | 2012-10-23 | 2013-03-13 | 中国石油化工股份有限公司 | Chemical device training management device, device knowledge base and training management system |
| CN103279734A (en) * | 2013-03-26 | 2013-09-04 | 上海交通大学 | Novel intelligent sign language translation and man-machine interaction system and use method thereof |
| CN103941870A (en) * | 2014-04-21 | 2014-07-23 | 百度在线网络技术（北京）有限公司 | Head-mounted display device |
| CN106489112A (en) * | 2015-03-08 | 2017-03-08 | 苹果公司 | For manipulating equipment, method and the graphic user interface of user interface object using vision and/or touch feedback |
| CN106572254A (en) * | 2016-10-28 | 2017-04-19 | 努比亚技术有限公司 | Gesture interaction device and method |
| CN106648048A (en) * | 2016-09-18 | 2017-05-10 | 三峡大学 | Virtual reality-based foreign language learning method and system |
| CN206249615U (en) * | 2016-06-30 | 2017-06-13 | 吴紫珠 | Instructional device based on VR glasses |
| CN206863995U (en) * | 2017-02-21 | 2018-01-09 | 焦晶晶 | A kind of English study Virtual Reality device |
| CN107608649A (en) * | 2017-11-02 | 2018-01-19 | 泉州创景视迅数字科技有限公司 | A kind of AR augmented realities intelligent image identification displaying content system and application method |
| CN107798932A (en) * | 2017-12-08 | 2018-03-13 | 快创科技（大连）有限公司 | A kind of early education training system based on AR technologies |
| CN207253468U (en) * | 2017-03-23 | 2018-04-20 | 郑州诚优成电子科技有限公司 | Learning type augmented reality eyesight convalescence device |
| CN207408959U (en) * | 2017-11-14 | 2018-05-25 | 幻视互动（北京）科技有限公司 | Mixed reality intelligent glasses with text and language process function |
| CN207425137U (en) * | 2017-08-30 | 2018-05-29 | 湖南安全技术职业学院 | English study training device based on the dialogue of VR real scenes |
| CN108109449A (en) * | 2018-01-29 | 2018-06-01 | 黑龙江工业学院 | A kind of English easy to use and Russian study device |
| CN108198471A (en) * | 2018-02-22 | 2018-06-22 | 韩明泽 | A kind of English Listening Comprehension is given financial aid to students system |
-
2018
- 2018-07-20 CN CN201810804407.8A patent/CN108877344A/en not_active Withdrawn
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968915A (en) * | 2012-10-23 | 2013-03-13 | 中国石油化工股份有限公司 | Chemical device training management device, device knowledge base and training management system |
| CN103279734A (en) * | 2013-03-26 | 2013-09-04 | 上海交通大学 | Novel intelligent sign language translation and man-machine interaction system and use method thereof |
| CN103941870A (en) * | 2014-04-21 | 2014-07-23 | 百度在线网络技术（北京）有限公司 | Head-mounted display device |
| CN106489112A (en) * | 2015-03-08 | 2017-03-08 | 苹果公司 | For manipulating equipment, method and the graphic user interface of user interface object using vision and/or touch feedback |
| CN206249615U (en) * | 2016-06-30 | 2017-06-13 | 吴紫珠 | Instructional device based on VR glasses |
| CN106648048A (en) * | 2016-09-18 | 2017-05-10 | 三峡大学 | Virtual reality-based foreign language learning method and system |
| CN106572254A (en) * | 2016-10-28 | 2017-04-19 | 努比亚技术有限公司 | Gesture interaction device and method |
| CN206863995U (en) * | 2017-02-21 | 2018-01-09 | 焦晶晶 | A kind of English study Virtual Reality device |
| CN207253468U (en) * | 2017-03-23 | 2018-04-20 | 郑州诚优成电子科技有限公司 | Learning type augmented reality eyesight convalescence device |
| CN207425137U (en) * | 2017-08-30 | 2018-05-29 | 湖南安全技术职业学院 | English study training device based on the dialogue of VR real scenes |
| CN107608649A (en) * | 2017-11-02 | 2018-01-19 | 泉州创景视迅数字科技有限公司 | A kind of AR augmented realities intelligent image identification displaying content system and application method |
| CN207408959U (en) * | 2017-11-14 | 2018-05-25 | 幻视互动（北京）科技有限公司 | Mixed reality intelligent glasses with text and language process function |
| CN107798932A (en) * | 2017-12-08 | 2018-03-13 | 快创科技（大连）有限公司 | A kind of early education training system based on AR technologies |
| CN108109449A (en) * | 2018-01-29 | 2018-06-01 | 黑龙江工业学院 | A kind of English easy to use and Russian study device |
| CN108198471A (en) * | 2018-02-22 | 2018-06-22 | 韩明泽 | A kind of English Listening Comprehension is given financial aid to students system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111563514A (en) * | 2020-05-14 | 2020-08-21 | 广东小天才科技有限公司 | Three-dimensional character display method and device, electronic equipment and storage medium |
| CN111563514B (en) * | 2020-05-14 | 2023-12-22 | 广东小天才科技有限公司 | Three-dimensional character display method and device, electronic equipment and storage medium |
| CN111583420A (en) * | 2020-05-27 | 2020-08-25 | 上海乂学教育科技有限公司 | Intelligent learning system and method based on augmented reality mode |
| CN112866678A (en) * | 2021-01-04 | 2021-05-28 | 融信信息科技有限公司 | Image recognition system based on AR intelligent glasses |
| CN113794872A (en) * | 2021-09-17 | 2021-12-14 | 融信信息科技有限公司 | Image recognition system based on AR intelligent glasses |
| CN113990128A (en) * | 2021-10-29 | 2022-01-28 | 重庆电子工程职业学院 | AR-based intelligent display system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108877344A (en) | A kind of Multifunctional English learning system based on augmented reality | |
| CN108877340A (en) | A kind of intelligent English assistant learning system based on augmented reality | |
| WO2022116977A1 (en) | Action driving method and apparatus for target object, and device, storage medium, and computer program product | |
| CN109065055A (en) | Method, storage medium and the device of AR content are generated based on sound | |
| CN108922274A (en) | A kind of English assistant learning system of multifunctional application | |
| CN109614849A (en) | Remote teaching method, apparatus, equipment and storage medium based on bio-identification | |
| CN108665744A (en) | A kind of intelligentized English assistant learning system | |
| CN109885595A (en) | Course recommended method, device, equipment and storage medium based on artificial intelligence | |
| CN109064799A (en) | A kind of Language Training system and method based on virtual reality | |
| CN106408480A (en) | Sinology three-dimensional interactive learning system and method based on augmented reality and speech recognition | |
| CN113835522A (en) | Sign language video generation, translation and customer service method, device and readable medium | |
| Kacorri | Teachable machines for accessibility | |
| CN111327772A (en) | Method, device, equipment and storage medium for automatic voice response processing | |
| CN108777083A (en) | A kind of wear-type English study equipment based on augmented reality | |
| Fernando et al. | Sign language translation approach to sinhalese language | |
| Sonawane et al. | Speech to Indian sign language (ISL) translation system | |
| Sobhan et al. | A communication aid system for deaf and mute using vibrotactile and visual feedback | |
| CN106780680A (en) | Three-dimensional animation generation method, terminal and system based on augmented reality | |
| CN108877311A (en) | A kind of English learning system based on augmented reality | |
| CN117055724A (en) | Generating type teaching resource system in virtual teaching scene and working method thereof | |
| Podder et al. | Design of a sign language transformer to enable the participation of persons with disabilities in remote healthcare systems for ensuring universal healthcare coverage | |
| Dreuw et al. | The signspeak project-bridging the gap between signers and speakers | |
| Dixit et al. | Audio to indian and american sign language converter using machine translation and nlp technique | |
| Putra et al. | Designing translation tool: Between sign language to spoken text on kinect time series data using dynamic time warping | |
| Alfonse et al. | Arabic sign language benchmark database for different heterogeneous sensors |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190311 Address after: 102600 No. 11 Lian Lane, Liyuan Village, Huangcun Town, Daxing District, Beijing Applicant after: Du Hai Address before: 114200 General Village 206, Tengao Town, Haicheng City, Anshan City, Liaoning Province Applicant before: Jing Mingming |
|
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20181123 |