CN108665744A - A kind of intelligentized English assistant learning system - Google Patents
A kind of intelligentized English assistant learning system Download PDFInfo
- Publication number
- CN108665744A CN108665744A CN201810771559.2A CN201810771559A CN108665744A CN 108665744 A CN108665744 A CN 108665744A CN 201810771559 A CN201810771559 A CN 201810771559A CN 108665744 A CN108665744 A CN 108665744A
- Authority
- CN
- China
- Prior art keywords
- data
- english
- image
- module
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The present invention relates to a kind of intelligentized English assistant learning systems, including：Timer, AR glasses (1), image acquisition device (2), micro projector (3), acoustical generator, arrangement of time typing mechanism (5), display (6) and central controller；AR technologies are applied in English learning system by the present invention, pass through the Image Acquisition to real world object, and the subject image that the image of acquisition is stored with system is compared, the information of current object can be picked out after successful match, then object Chinese name and the English word corresponding to the object information are extracted in Installed System Memory, object Chinese name and English word are subjected to image conversion, obtain virtual display object, virtual display object is directly displayed on AR glasses in conjunction with real scene；It is thus achieved that figure and English word are associated with, while the pronunciation by listening to English word, further deepen the memory depth of word, while improving learning efficiency and the effective rate of utilization of time.
Description
Technical field
The present invention relates to English teaching apparatus fields, and in particular to a kind of intelligentized English assistant learning system.
Background technology
Currently, English study has obtained the attention of more and more people, and the education from the initiation to work in child's period, English
Language study is either in study or in working stage, in occupation of a certain proportion of time.The study in child's period, which is compared, is
System, student have special learning time and space, but for the working clan for wanting education and charging, the item of English study
Part is fairly limited, and work and daily life have occupied the most of the time of life, can not extract special time progress out
Study, this is in current allegro life it is difficult to adhere to getting off for adult.In addition, not passing through a system
Learning planning, the spare time can be occupied by some non-essential things, to waste the time to study English.
And people are on weekdays or holiday, can all accumulate more free time, if be not used when causing instead
Between waste；If these free times can be made full use of, the waiting anxiety of people can not only be mitigated, moreover it is possible in chip time
Learn the inconvenience and boredom that avoid the monoblock time to learn to genuine English.And existing English learning system
It is typically completed on computer, TV or mobile phone, vehicle environment can not be suitable for, do not account for especially and how to utilize
The chip time in leisure is learnt, and is not accounted for more and how to be taken into account English study and work, live and mutually merge.
In addition, in learning English, either to Oral Activities, or for literacy, word
Accumulation is all the matter of utmost importance for needing to overcome.Traditional vocabulary memorization method is first to understand the concrete meaning and usage of word,
Then learner's consolidating memory is helped by way of pronunciation mark and spelling.But the less efficient of word is carried on the back in this way,
And a large amount of time is needed to carry out repetitive memory, while being also weary of psychology because uninteresting memory pattern causes learner to generate, into
One step reduces learning efficiency.For this purpose, some educational institutions provide various Associative mnemonics, such as：Etyma and affix association note
Recall method, clang association mnemonics, the meaning of a word and compare mnemonics and figure Associative mnemonics etc., quickly to improve the note of English word
Recall speed.It is and in above-mentioned many associative memory methods, figure and the English word mode that is mutually related is maximally efficient, it is mesh
The preceding mnemonics most in accordance with the brain operating mode of the mankind, efficiency improves 3-10 times compared with other memory styles.
Currently, the operational mode of figure Associative mnemonics is static graphics to be printed on books or is broadcast with teaching equipment
The pre-set image put is as teaching reference, it is desirable to provide and specific time and environment are completed to learn, therefore, the application of this method
It is had some limitations in learning process.
Invention content
It is an object of the present invention to solve that the English religion for the application of figure Associative mnemonics is not present in the prior art
System, provides a kind of intelligentized English assistant learning system, and system of the invention will be showed by using augmented reality
The material object of real field scape is interrelated with English word, can complete teaching at any time in any actual scene, overcome existing
The limitation of habit pattern.
To achieve the above object, the present invention provides a kind of intelligentized English assistant learning system, including：Timer, AR
Glasses, image acquisition device, micro projector, acoustical generator, arrangement of time typing mechanism, display and central controller；
The timer is used for timing, and the triggered time arranges typing mechanism to start when reaching preset timing point；
At least two image acquisition devices are symmetrically arranged on the both sides mirror holder of the AR glasses, the image acquisition device is used
In acquiring the image in its visual range, and the image data of generation is sent to central controller；
The arrangement of time typing mechanism is connect with display, is sent prompt to user by display on startup
Information, and the arrangement of time data that prompt message input is pressed by user are recorded, the prompt message is that request user is defeated
Send the message of arrangement of time data, the arrangement of time data be record user corresponding processing affairs of each period,
Affairs material information；
The signal input part of the central controller is connect with arrangement of time typing mechanism, and number is arranged for receiving time
According to analysis obtains the chip time for English study, drives image acquisition device to carry out Image Acquisition in each section of chip time, so
Feature extraction is carried out to object from the image data that obtains of acquisition afterwards, by after analyzing characteristic to pick out object
Body information, and by corresponding to object information object Chinese name and English word carry out image conversion, obtain virtual display pair
As in conjunction with real scene to virtually showing that object renders, and by micro projector by the virtual display object after rendering
It is projected, while the corresponding pronunciation data of English word is sent to acoustical generator, which is additionally operable to from reception
The gesture data that human body is identified in image data, by generating corresponding action data after analyzing gesture data, and
Man-machine interactive operation is executed using the action data；
The signal input part of the micro projector is connect with central controller, the projection end of the micro projector with AR
The half-transmitting mirror being arranged on mirror is opposite, the image projection for exporting central controller to half-transmitting mirror；
The signal input part of the acoustical generator is connect with central controller, the pronunciation number for exporting central controller
It is played out according to voice signal is converted into.
As a further improvement of the above technical scheme, the image acquisition device carries out image using CCD camera
Acquisition.
As a further improvement of the above technical scheme, the central controller includes：Time analysis module, acquisition are driven
Dynamic model block, signal processing module, characteristic extracting module, object identification module, knowledge base, image rendering module, pronunciation data pass
Module and gesture is sent to recognize module；
The time analysis module be used for receiving time arrangement data, and by corresponding affairs importance of each period with
The importance rate of setting is compared, and extraction is less than the period corresponding to importance rate as chip time；
The acquisition drive module drives image for receiving chip time data when each section of chip time reaches
Collector carries out Image Acquisition；
The signal processing module is used to receive the picture signal of image acquisition device output, and will be at picture signal
Reason generates the image data identified for characteristic extracting module；
The characteristic extracting module is used to identify the characteristic of object in image data, and by the feature of acquisition
Data are sent to object identification module, and the characteristic includes color, texture, profile and the three-dimensional shape data of object；
The object identification module matches characteristic with the feature composite sequence stored in knowledge base, extraction
Object Chinese name, English word corresponding to matched feature composite sequence and the corresponding pronunciation data of English word；
For the knowledge base for storing various feature composite sequences, the feature composite sequence includes the face by object
Feature combination and its corresponding object Chinese name, English word and the English of color, texture, profile and three-dimensional shape data composition
The corresponding pronunciation data of word；
The image rendering module is used to match the object Chinese name obtained and English word carries out image conversion,
Virtual display object is obtained, and combines the display location of the selected virtual display object in the position of object in real scene, while root
According to the brightness in real scene picture frame to virtually showing that object carries out illumination render；
The pronunciation data delivery module is used to the corresponding pronunciation data of English word being sent to acoustical generator；
The gesture identification module is used to identify the gesture data of human body in image data, and by gesture number
According to generating corresponding action data after being analyzed, and the operation of central controller is controlled with action data.
As a further improvement of the above technical scheme, the signal processing module includes：A/D converter, signal are put
Big device and filter, the signal for exporting image acquisition device carry out analog-to-digital conversion, amplify and be filtered successively.
As a further improvement of the above technical scheme, the central controller further includes mode of learning selecting module,
Several modes of learning are provided in the mode of learning selecting module, the object for obtaining the matching of object identification module
Chinese name and English word are compared with the mode of learning that user selectes, if there are matching acquisitions in mode of learning
Object Chinese name and English word then export object Chinese name and English word to image rendering module, otherwise not defeated
Go out the object Chinese name and English word of matching acquisition；
The mode of learning is to combine sequence to all features stored in knowledge base according to different grades of know-how
Row are divided, and are combined into corresponding object Chinese name and English word set.
As a further improvement of the above technical scheme, the knowledge base also store with the associated phonetic symbol of English word,
Example sentence and mind map data；
The object identification module is additionally operable to extraction and the associated phonetic symbol of English word, example sentence and mind map data,
And it is sent to image rendering module；
The image rendering module is additionally operable to the phonetic symbol that will be received, example sentence and mind map data and carries out image turn
Change, obtain virtual display object, and combine the display location of the selected virtual display object in the position of object in real scene, simultaneously
According to the brightness in real scene picture frame to virtually showing that object carries out illumination render；
The mind map data be using match obtain English word as core, will be with the relevant all English of its attribute
The associated diagram that literary word is built.
A kind of intelligentized English assistant learning system advantage provided by the invention is：
AR technologies are applied in English learning system by the present invention, by the Image Acquisition to real world object, and will acquisition
The subject image that is stored with system of image compared, the information of current object can be picked out after successful match, at this time
Object Chinese name, English word and the corresponding hair of English word corresponding to the object information can be extracted in Installed System Memory
Sound data, these English words are exactly that learner needs to remember；For this purpose, object Chinese name and English word are carried out image
Conversion obtains virtual display object, and virtual display object is directly displayed on AR glasses in conjunction with real scene；It is thus achieved that
Figure is associated with English word, while the pronunciation by listening to English word, further deepens the memory depth of word, to
It can complete teaching at any time in any actual scene, overcome the limitation of existing mode of learning, improve learning efficiency；Separately
Outside, this system is analyzed by the daily schedule to people, can be extracted for English study in daily life
Free time so that English learner is capable of the arrangement spare time of oneself of more rationality, reduces unnecessary work to the greatest extent
It is dynamic to arrange, strive for obtaining more effective times to carry out English study, fully improves the effective rate of utilization of time.
Description of the drawings
Fig. 1 is a kind of intelligentized English assistant learning system structural schematic diagram provided by the invention；
Fig. 2 is the English study equipment deadline program operation schematic diagram using the present invention；
Fig. 3 is the central controller structural schematic diagram provided in one embodiment of the invention；
Fig. 4 is the central controller structural schematic diagram provided in another embodiment of the present invention；
Fig. 5 is the signal processing module structural schematic diagram provided in the embodiment of the present invention；
Fig. 6 a are the AR eyeglasses-wearing schematic diagrames provided in the embodiment of the present invention；
Fig. 6 b are the AR glasses external structure schematic diagrams provided in the embodiment of the present invention.
Fig. 7 is the arrangement of time typing mechanism appearance schematic diagram for integrating formula structure provided in the embodiment of the present invention；
Fig. 8 is arrangement of time typing mechanism side view shown in Fig. 7 of the present invention.
Reference numeral
1, AR glasses 2, image acquisition device
3, micro projector 4, half-transmitting mirror
5, arrangement of time typing mechanism 6, display
7, hand strap 8, earphone interface
9, USB interface
Specific implementation mode
It is detailed to a kind of intelligentized English assistant learning system progress of the present invention with reference to the accompanying drawings and examples
It describes in detail bright.
As shown in Figure 1, a kind of intelligentized English assistant learning system provided by the invention, the system specifically include：Meter
When device, AR glasses, image acquisition device, micro projector, acoustical generator, arrangement of time typing mechanism, display and central controller；
The timer is used for timing, and the triggered time arranges typing mechanism (5) to open when reaching preset timing point
It is dynamic；
As shown in Figure 6 b, at least two image acquisition devices 2 are symmetrically arranged on the both sides mirror holder of the AR glasses 1, it is described
Image acquisition device 2 be used to acquire image in its visual range, and the image data of generation is sent to central controller；
As shown in fig. 7, the arrangement of time typing mechanism 5 is connect with display 6, on startup by display 6 to
User sends prompt message, and records the arrangement of time data that prompt message input is pressed by user, the prompt message
It is record user in each period pair to ask the message of user's time of delivery arrangement data, the arrangement of time data
The processing affairs answered, affairs material information；
The signal input part of the central controller is connect with arrangement of time typing mechanism 5, and number is arranged for receiving time
According to, analysis obtains the chip time for English study, drives image acquisition device 2 to carry out Image Acquisition in each section of chip time,
Then feature extraction is carried out to object from the image data that obtains of acquisition, by after analyzing characteristic to pick out
Object information, and by corresponding to object information object Chinese name and English word carry out image conversion, obtain virtual display
Object, in conjunction with real scene to virtually showing that object renders, and by micro projector by after rendering it is virtual display pair
It is sent to acoustical generator as being projected, while by the corresponding pronunciation data of English word, which is additionally operable to from reception
Image data in identify the gesture data of human body, by generating corresponding action data after analyzing gesture data,
And execute man-machine interactive operation using the action data；
The signal input part of the acoustical generator is connect with central controller, the pronunciation number for exporting central controller
It is played out according to voice signal is converted into.
The signal input part of the micro projector is connect with central controller, as shown in Figure 6 b, the micro projector 3
The half-transmitting mirror 4 being arranged on projection end and AR glasses 1 is opposite, the image projection for exporting central controller to half-transmitting mirror
On 4, and show object reflection to the eye of people by virtual by half-transmitting mirror 4；
The light that the half-transmitting mirror 4 can be such that micro projector 3 projects is reflected, and makes the light of external environment incidence
It is transmitted, to which real scene and virtual objects are realized image co-registration in human eye portion.Wherein, the state of AR glasses is worn
As shown in Figure 6 a.
Frontend experience of the AR technologies as current virtual reality technology, has a wide range of applications in industry-by-industry.It is one
The concept of kind of image procossing be combined with each other with multi view tool and becomes as a special kind of skill, that is, it has often been said that enhancing it is existing
It is real.The target of this technology is that virtual world is sleeved on real world on the screen and carries out interaction, is needed on realizing effect
The multimedias such as camera, sensor are merged with scene, augmented reality not only presents the information of real world, but also will
Virtual information shows that two kinds of information are complementary to one another, are superimposed simultaneously.
Above-mentioned AR technologies are applied in English teaching system by the present invention, by the Image Acquisition to real world object, and will
The subject image that the image of acquisition is stored with system is compared, and the information of current object can be picked out after successful match,
Object Chinese name and the English word corresponding to the object information, these English words can be extracted in Installed System Memory at this time
Exactly learner needs to remember；For this purpose, object Chinese name and English word are carried out image conversion, virtual display pair is obtained
As virtual display object is directly displayed on AR glasses in conjunction with real scene；It is thus achieved that the pass of figure and English word
Connection, while the pronunciation by listening to English word further deepen the memory depth of word, so as in any actual scene
In at any time complete teaching, overcome the limitation of existing mode of learning, improve learning efficiency.
Compared to existing many teaching equipments, English study is carried out using the system of the present invention, user need not be
Study is absorbed in regular time or place, it is only necessary to wear moveable AR visions glasses, walking in everyday environments is
Image conversion, associated with real world object english knowledge can be observed at any time.At the same time, in conjunction with the perception work(of human body gesture
Can, it can realize man-machine interactive operation, the operation of person's manual control system easy to produce.
In addition, the present invention English assistant learning system by the daily time service condition of analytic learning person, with determination
The activity schedule of its spare time within the non-sleep period.For office workers, include mainly that working day and weekend/section are false
Two kinds of periods of day.
Non-working time section on weekdays, timer through the invention can set the period of prompt, Mei Geyi
Learner is putd question to by the way of voice prompt or presentation of information within a hour, what a hour before doing, and allows learner
Make their own judgement, learner gives selection and anti-using voice answering or the mode inputted in arrangement of time typing mechanism
Feedback, marks what affairs current slot has done, whether which belongs to necessary event, could be learned using this period
Practise English.It makes after clearly judging, equipment can give record on the period, and whether the period is labeled as to advise
Draw the learning time to English.
In weekend or holiday time section, timer through the invention can equally set the period of prompt, advise
Put question to learner using voice prompt or presentation of information by the way of in fixed interval time, what is doing for the previous period, mark
Remember the importance of the affairs, could be studied English using this period.It makes after clearly judging, equipment can be in the time
Record is given in section, and the period is labeled as the learning time of English whether can be planned for.
As shown in Fig. 2, for the schematic diagram using the equipment of the present invention according to above-mentioned rule realization time planning, shade in figure
Part indicates chip time cooked up, for English study.
The above-mentioned time planning function of being provided using the English study equipment of the present invention so that English learner can be more
It the arrangement spare time of oneself for adding rationality, reduces unnecessary activity schedule to the greatest extent, strives for that obtaining more effective times comes
Carry out English study.
In order to realize the intelligent control function of above-mentioned central controller, as shown in figure 3, the central controller in the present embodiment
It may include：Time analysis module, acquisition drive module, signal processing module, characteristic extracting module, object identification module, knowledge
Library, image rendering module, pronunciation data delivery module and gesture recognize module；
The time analysis module be used for receiving time arrangement data, and by corresponding affairs importance of each period with
The importance rate of setting is compared, and extraction is less than the period corresponding to importance rate as chip time；
The acquisition drive module drives image for receiving chip time data when each section of chip time reaches
Collector carries out Image Acquisition；
The signal processing module is used to receive the picture signal of image acquisition device output, and will be at picture signal
Reason generates the image data identified for characteristic extracting module；
The characteristic extracting module is used to identify the characteristic of object in image data, and by the feature of acquisition
Data are sent to object identification module, and the characteristic includes color, texture, profile and the three-dimensional shape data of object；
The object identification module matches characteristic with the feature composite sequence stored in knowledge base, extraction
Object Chinese name, English word corresponding to matched feature composite sequence and the corresponding pronunciation data of English word；
For the knowledge base for storing various feature composite sequences, the feature composite sequence includes the face by object
Feature combination and its corresponding object Chinese name, English word and the English of color, texture, profile and three-dimensional shape data composition
The corresponding pronunciation data of word；
The image rendering module is used to match the object Chinese name obtained and English word carries out image conversion,
Virtual display object is obtained, and combines the display location of the selected virtual display object in the position of object in real scene, while root
According to the brightness in real scene picture frame to virtually showing that object carries out illumination render；
The pronunciation data delivery module is used to the corresponding pronunciation data of English word being sent to acoustical generator；
The gesture identification module is used to identify the gesture data of human body in image data, and by gesture number
According to generating corresponding action data after being analyzed, and the operation of central controller is controlled with action data.
As shown in figure 4, in another embodiment of the present invention, the central controller may also include mode of learning choosing
Module is selected, several modes of learning are provided in the mode of learning selecting module, for obtaining the matching of object identification module
The object Chinese name and English word obtained is compared with the mode of learning that user selectes, if there is this in mode of learning
Object Chinese name with acquisition and English word then export object Chinese name and English word to image rendering module,
Otherwise the object Chinese name and English word of matching acquisition are not exported；
The mode of learning is to combine sequence to all features stored in knowledge base according to different grades of know-how
Row are divided, and are combined into corresponding object Chinese name and English word set.
For different crowds, there can be different learning demands；For this purpose, the system of the present invention is with different knowledge
English word is divided into multiple set by level；Such as：Can be divided into for student examination meet small English learning, junior English,
Senior High School English, university's Band Four Test, six grades of examinations of university, professional Band Four Test, professional eight grades of examinations, TOEFL, refined thinking
A variety of word finders such as examination, can be divided into for working clan and meet daily communication term, business exchange term, technology specialty term etc.
A variety of word finders.Learner can select corresponding mode of learning according to the grade of the demand and know-how of itself；It is selected in pattern
After fixed, vocabulary present in system meeting output mode not shows the over range vocabulary that matching obtains, realizes individual character
The instructional function of change.
In addition, as shown in figure 4, CCD camera can be used in the image acquisition device in present system is acquired to image.
CCD is the abbreviation of Charge Coupled Device (charge coupling device), it is a kind of semiconductor imaging device, thus is had
There is high sensitivity, resist small, small strong light, distortion, long lifespan, anti-vibration；In addition, the present invention with CCD by taking the photograph
As head realization Image Acquisition, the higher clear image of resolution ratio can be obtained, is provided for the subsequent data analysis of central controller
It ensures.
As shown in figure 5, the signal processing module can be by the A/D converter of setting, the analog signal that is received
Be converted to the digital signal for characteristic extracting module and gesture identification module identification；Meanwhile in order to reduce the noise jamming of signal,
The detection accuracy of signal is improved, the signal processing module may also include signal amplifier and filter, for adopting image
The signal of storage output is amplified and is filtered.
In addition, in order to further increase the memory effect of english knowledge, the knowledge base is also stored closes with English word
Phonetic symbol, example sentence and the mind map data of connection.
For this purpose, the object identification module is additionally operable to extraction and the associated phonetic symbol of English word, example sentence and mind map
Data, and it is sent to image rendering module；The image rendering module is additionally operable to the phonetic symbol that will be received, example sentence and thinking and leads
Diagram data carries out image conversion, obtains virtual display object, and combines the selected virtual display pair in the position of object in real scene
The display location of elephant, while according to the brightness in real scene picture frame to virtually showing that object carries out illumination render.The present invention
System the information of various dimensions is associated with English word, can further deepen understanding of the learner to english knowledge, together
Its vocabulary operational capability of Shi Tigao.
Above-mentioned mind map is called intelligence and leads figure, is the active graphical media of thinking for expressing divergent thinking, it is simply but
Again very effectively.The skill that mind map is laid equal stress on picture and text, the relationship of themes at different levels with being mutually subordinate to and relevant stratal diagram
It shows, the foundation such as subject key words and image, color memory is linked.Mind map fully uses the function of left and right brain,
Using the rule of memory, reading, thinking, people's balanced growth between science and art, the logical AND imagination is assisted, to open
Therefore the unlimited potential of human brain, mind map have the power of human thinking.
In addition, mind map is a kind of method visualizing thinking.It is understood that radiant thinking is human brain
Thought of nature mode, each enters the data of brain, whether feeling, memory or idea --- including word, number, symbol
Code, fragrance, food, lines, color, image, rhythm, note etc. can become a thinking center, and thus center is outside
Thousands of artis is exhaled, each artis represents a connection with central theme, and each connection can
To become another central theme, then thousands of artis is exhaled outward, show radioactivity stereochemical structure.
The marrow remembered with mind map is, balances the utilization of National People's Congress's brain left brain and right brain, stimulates out in brain
Potential, the information that will be present in brain becomes visual picture and text and is remembered, because of human brain connecing for graph text information
Be higher by nearly a hundred times than individual word by memory capability, wherein need most mass memory be no more than English word.
Based on the principle of above-mentioned mind map, the diagram data of leading provided by the present invention for study is to match the English obtained
Literary word is core, the associated diagram that will be built with the relevant all English words of its attribute, by the way that mind map, energy is arranged
It is enough to help learner to be extended the knowledge of study while improving memorizing rate.
In addition, as shown in fig. 7, the arrangement of time typing mechanism 5 can be keyboard-type structure, in order to improve equipment just
The property taken, the arrangement of time typing mechanism 5 are integrated integrated structure with timer (not shown), display 6, and by setting
The hand strap 7 set is sleeved in a manner of wearing wrist-watch in wrist.As shown in figure 8, the equipment designed in this example is also set up in side
There is earphone interface 8, it is convenient to be connect with earphone；It is additionally provided with USB interface 9 simultaneously, so that ready teaching data to be transmitted to
Memory built in equipment, and charge function can be provided, keep equipment more portable and used.The arrangement of time typing mechanism
Wireless transmission method can be used between 5 and central controller (not shown) to connect, brought not to avoid data line transfer mode
Just.
It should be noted last that the above examples are only used to illustrate the technical scheme of the present invention and are not limiting.Although ginseng
It is described the invention in detail according to embodiment, it will be understood by those of ordinary skill in the art that, to the technical side of the present invention
Case is modified or replaced equivalently, and without departure from the spirit and scope of technical solution of the present invention, should all be covered in the present invention
Right in.
Claims (6)
1. a kind of intelligentized English assistant learning system, which is characterized in that including：Timer, AR glasses (1), Image Acquisition
Device (2), micro projector (3), acoustical generator, arrangement of time typing mechanism (5), display (6) and central controller；
The timer is used for timing, and the triggered time arranges typing mechanism (5) to start when reaching preset timing point；
It is symmetrically arranged at least two image acquisition devices (2), the image acquisition device on the both sides mirror holder of the AR glasses (1)
(2) it is used to acquire the image in its visual range, and the image data of generation is sent to central controller；
The arrangement of time typing mechanism (5) is connect with display (6), is sent out on startup to user by display (6)
Prompt message is sent, and records the arrangement of time data for pressing prompt message input by user, the prompt message, which is request, to be made
The message of user's time of delivery arrangement data, the arrangement of time data are record user in the corresponding processing of each period
Affairs, affairs material information；
The signal input part of the central controller is connect with arrangement of time typing mechanism (5), is used for receiving time arrangement data,
Analysis obtains the chip time for English study, drives image acquisition device (2) to carry out Image Acquisition in each section of chip time, so
Feature extraction is carried out to object from the image data that obtains of acquisition afterwards, by after analyzing characteristic to pick out object
Body information, and by corresponding to object information object Chinese name and English word carry out image conversion, obtain virtual display pair
As, in conjunction with real scene to virtually showing that object renders, and by micro projector (3) by after rendering it is virtual display pair
It is sent to acoustical generator as being projected, while by the corresponding pronunciation data of English word, which is additionally operable to from reception
Image data in identify the gesture data of human body, by generating corresponding action data after analyzing gesture data,
And execute man-machine interactive operation using the action data；
The signal input part of the micro projector (3) is connect with central controller, the projection end of the micro projector (3) and AR
The half-transmitting mirror (4) being arranged on glasses (1) relatively, for the image projection that exports central controller to half-transmitting mirror (4)；
The signal input part of the acoustical generator is connect with central controller, and the pronunciation data for exporting central controller turns
Voice signal is changed into play out.
2. intelligentized English assistant learning system according to claim 1, which is characterized in that the image acquisition device
Image is acquired using CCD camera.
3. intelligentized English assistant learning system according to claim 1, which is characterized in that the central controller
Including：Time analysis module, acquisition drive module, signal processing module, characteristic extracting module, object identification module, knowledge base,
Image rendering module, pronunciation data delivery module and gesture recognize module；
The time analysis module is used for receiving time arrangement data, and by corresponding affairs importance of each period and sets
Importance rate be compared, extraction is less than the period corresponding to importance rate as chip time；
The acquisition drive module drives Image Acquisition for receiving chip time data when each section of chip time reaches
Device carries out Image Acquisition；
The signal processing module is used to receive the picture signal of image acquisition device output, and picture signal is handled, raw
At the image data identified for characteristic extracting module；
The characteristic extracting module is used to identify the characteristic of object in image data, and by the characteristic of acquisition
It is sent to object identification module, the characteristic includes color, texture, profile and the three-dimensional shape data of object；
The object identification module matches characteristic with the feature composite sequence stored in knowledge base, extraction warp
The object Chinese name corresponding to feature composite sequence, English word and the corresponding pronunciation data of English word matched；
The knowledge base for storing various feature composite sequences, the feature composite sequence include by object color,
The feature combination of texture, profile and three-dimensional shape data composition and its corresponding object Chinese name, English word and English are single
The corresponding pronunciation data of word；
The image rendering module is used to match the object Chinese name obtained and English word carries out image conversion, obtains
Virtual display object, and the display location of the selected virtual display object in the position of object in real scene is combined, while according to true
Brightness in real field scape picture frame is to virtually showing that object carries out illumination render；
The pronunciation data delivery module is used to the corresponding pronunciation data of English word being sent to acoustical generator；
The described gesture identification module is used to identify the gesture data of human body in image data, and by gesture data into
Corresponding action data is generated after row analysis, and the operation of central controller is controlled with action data.
4. intelligentized English assistant learning system according to claim 3, which is characterized in that the signal processing mould
Block includes：A/D converter, signal amplifier and filter, the signal for exporting image acquisition device carry out modulus and turn successively
It changes, amplify and is filtered.
5. intelligentized English assistant learning system according to claim 3, which is characterized in that the central controller
Further include mode of learning selecting module, several modes of learning are provided in the mode of learning selecting module, is used for object
Body recognizes the object Chinese name that module matching obtains and English word compared with the mode of learning that user selectes, if learning
There are the object Chinese name and English word of matching acquisition in habit pattern, then object Chinese name and English word are exported
To image rendering module, the object Chinese name and English word of matching acquisition are not otherwise exported；
The mode of learning be according to different grades of know-how to all feature composite sequences for being stored in knowledge base into
Row divides, and is combined into corresponding object Chinese name and English word set.
6. intelligentized English assistant learning system according to claim 3, which is characterized in that the knowledge base is also deposited
Storage and the associated phonetic symbol of English word, example sentence and mind map data；
The object identification module is additionally operable to extraction and the associated phonetic symbol of English word, example sentence and mind map data, concurrently
It send to image rendering module；
The image rendering module is additionally operable to the phonetic symbol that will be received, example sentence and mind map data and carries out image conversion, obtains
It obtains and virtually shows object, and combine the display location of the selected virtual display object in the position of object in real scene, while basis
Brightness in real scene picture frame is to virtually showing that object carries out illumination render；
The mind map data be to match the English word obtained as core, will be single with the relevant all English of its attribute
The associated diagram that word is built.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810771559.2A CN108665744A (en) | 2018-07-13 | 2018-07-13 | A kind of intelligentized English assistant learning system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810771559.2A CN108665744A (en) | 2018-07-13 | 2018-07-13 | A kind of intelligentized English assistant learning system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108665744A true CN108665744A (en) | 2018-10-16 |
Family
ID=63789222
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810771559.2A Pending CN108665744A (en) | 2018-07-13 | 2018-07-13 | A kind of intelligentized English assistant learning system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108665744A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109215417A (en) * | 2018-10-24 | 2019-01-15 | 北京实境智慧科技有限公司 | A kind of VR memory system and method |
| CN110716641A (en) * | 2019-08-28 | 2020-01-21 | 北京市商汤科技开发有限公司 | Interaction method, device, equipment and storage medium |
| CN111093032A (en) * | 2019-12-31 | 2020-05-01 | 维沃移动通信有限公司 | Information display method and electronic equipment |
| CN112256898A (en) * | 2020-11-05 | 2021-01-22 | 深圳小象智多分网络科技有限公司 | English word imagination image memory training system |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101604355A (en) * | 2008-06-11 | 2009-12-16 | 联盈资讯股份有限公司 | A kind of learning system and method thereof when broken |
| CN102968915A (en) * | 2012-10-23 | 2013-03-13 | 中国石油化工股份有限公司 | Chemical device training management device, device knowledge base and training management system |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN106104593A (en) * | 2014-02-16 | 2016-11-09 | 美国联合包裹服务公司 | Determine delivery position and time based on the arrangement of time or position of consignee |
| CN106530858A (en) * | 2016-12-30 | 2017-03-22 | 武汉市马里欧网络有限公司 | AR-based Children's English learning system and method |
| CN107037589A (en) * | 2017-03-30 | 2017-08-11 | 河南工学院 | A kind of scene-type foreign languages translation and learning system |
| CN107449440A (en) * | 2016-06-01 | 2017-12-08 | 北京三星通信技术研究有限公司 | The display methods and display device for prompt message of driving a vehicle |
| CN107798932A (en) * | 2017-12-08 | 2018-03-13 | 快创科技（大连）有限公司 | A kind of early education training system based on AR technologies |
| CN107924395A (en) * | 2015-08-24 | 2018-04-17 | 微软技术许可有限责任公司 | Personal translator |
| CN207253468U (en) * | 2017-03-23 | 2018-04-20 | 郑州诚优成电子科技有限公司 | Learning type augmented reality eyesight convalescence device |
| CN108090739A (en) * | 2017-12-19 | 2018-05-29 | 李丹 | Student's Outside Class Studying system for prompting |
| CN108154345A (en) * | 2017-12-26 | 2018-06-12 | 苏州麦迪斯顿医疗科技股份有限公司 | It is a kind of for the arrangement method of event, device, equipment and storage medium |
-
2018
- 2018-07-13 CN CN201810771559.2A patent/CN108665744A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101604355A (en) * | 2008-06-11 | 2009-12-16 | 联盈资讯股份有限公司 | A kind of learning system and method thereof when broken |
| CN102968915A (en) * | 2012-10-23 | 2013-03-13 | 中国石油化工股份有限公司 | Chemical device training management device, device knowledge base and training management system |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN103366610B (en) * | 2013-07-03 | 2015-07-22 | 央数文化(上海)股份有限公司 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN106104593A (en) * | 2014-02-16 | 2016-11-09 | 美国联合包裹服务公司 | Determine delivery position and time based on the arrangement of time or position of consignee |
| CN107924395A (en) * | 2015-08-24 | 2018-04-17 | 微软技术许可有限责任公司 | Personal translator |
| CN107449440A (en) * | 2016-06-01 | 2017-12-08 | 北京三星通信技术研究有限公司 | The display methods and display device for prompt message of driving a vehicle |
| CN106530858A (en) * | 2016-12-30 | 2017-03-22 | 武汉市马里欧网络有限公司 | AR-based Children's English learning system and method |
| CN207253468U (en) * | 2017-03-23 | 2018-04-20 | 郑州诚优成电子科技有限公司 | Learning type augmented reality eyesight convalescence device |
| CN107037589A (en) * | 2017-03-30 | 2017-08-11 | 河南工学院 | A kind of scene-type foreign languages translation and learning system |
| CN107798932A (en) * | 2017-12-08 | 2018-03-13 | 快创科技（大连）有限公司 | A kind of early education training system based on AR technologies |
| CN108090739A (en) * | 2017-12-19 | 2018-05-29 | 李丹 | Student's Outside Class Studying system for prompting |
| CN108154345A (en) * | 2017-12-26 | 2018-06-12 | 苏州麦迪斯顿医疗科技股份有限公司 | It is a kind of for the arrangement method of event, device, equipment and storage medium |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109215417A (en) * | 2018-10-24 | 2019-01-15 | 北京实境智慧科技有限公司 | A kind of VR memory system and method |
| CN110716641A (en) * | 2019-08-28 | 2020-01-21 | 北京市商汤科技开发有限公司 | Interaction method, device, equipment and storage medium |
| WO2021036622A1 (en) * | 2019-08-28 | 2021-03-04 | 北京市商汤科技开发有限公司 | Interaction method, apparatus, and device, and storage medium |
| CN110716641B (en) * | 2019-08-28 | 2021-07-23 | 北京市商汤科技开发有限公司 | Interaction method, device, equipment and storage medium |
| TWI775135B (en) * | 2019-08-28 | 2022-08-21 | 大陸商北京市商湯科技開發有限公司 | Interaction method, apparatus, device and storage medium |
| CN111093032A (en) * | 2019-12-31 | 2020-05-01 | 维沃移动通信有限公司 | Information display method and electronic equipment |
| CN111093032B (en) * | 2019-12-31 | 2021-08-27 | 维沃移动通信有限公司 | Information display method and electronic equipment |
| CN112256898A (en) * | 2020-11-05 | 2021-01-22 | 深圳小象智多分网络科技有限公司 | English word imagination image memory training system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108665744A (en) | A kind of intelligentized English assistant learning system | |
| CN110991381B (en) | Real-time classroom student status analysis and indication reminding system and method based on behavior and voice intelligent recognition | |
| CN108922274A (en) | A kind of English assistant learning system of multifunctional application | |
| CN108877344A (en) | A kind of Multifunctional English learning system based on augmented reality | |
| CN107393357A (en) | Learning device in finger ring | |
| CN108877340A (en) | A kind of intelligent English assistant learning system based on augmented reality | |
| CN106200886A (en) | A kind of intelligent movable toy manipulated alternately based on language and toy using method | |
| CN109637207A (en) | A kind of preschool education interactive teaching device and teaching method | |
| CN108777083A (en) | A kind of wear-type English study equipment based on augmented reality | |
| CN109064799A (en) | A kind of Language Training system and method based on virtual reality | |
| CN107945625A (en) | A kind of pronunciation of English test and evaluation system | |
| CN204650422U (en) | A kind of intelligent movable toy manipulated alternately based on language | |
| Rocchesso | Explorations in sonic interaction design | |
| CN106408480A (en) | Sinology three-dimensional interactive learning system and method based on augmented reality and speech recognition | |
| CN201453284U (en) | Psychological therapy system | |
| CN103745423A (en) | Mouth-shape teaching system and mouth-shape teaching method | |
| CN115525144A (en) | Multi-object interaction equipment based on virtual reality and interaction method thereof | |
| Rudowicz et al. | On Ng's why asians are less creative than westerners | |
| CN206210144U (en) | Gesture language-voice converts cap | |
| CN108877311A (en) | A kind of English learning system based on augmented reality | |
| CN114446109A (en) | Multifunctional interactive massage teaching system | |
| CN110471531A (en) | Multi-modal interactive system and method in virtual reality | |
| CN207851897U (en) | The tutoring system of artificial intelligence based on TensorFlow | |
| CN109064793A (en) | A kind of full subject sage of the past parent based on holographic technique awards and Knowledge interaction intelligent space | |
| CN104010014A (en) | Work learning application robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20190305 Address after: 102600 No. 11 Lian Lane, Liyuan Village, Huangcun Town, Daxing District, Beijing Applicant after: Du Hai Address before: 253000 Jinan Village, Huanghe Ya Town, Decheng District, Dezhou City, Shandong Province Applicant before: Wang Hongdong Applicant before: Wang Jianxun Applicant before: Zhang Yanping |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181016 |
|
| RJ01 | Rejection of invention patent application after publication |