CN107037589A - A kind of scene-type foreign languages translation and learning system - Google Patents
A kind of scene-type foreign languages translation and learning system Download PDFInfo
- Publication number
- CN107037589A CN107037589A CN201710201983.9A CN201710201983A CN107037589A CN 107037589 A CN107037589 A CN 107037589A CN 201710201983 A CN201710201983 A CN 201710201983A CN 107037589 A CN107037589 A CN 107037589A
- Authority
- CN
- China
- Prior art keywords
- information
- foreign language
- user
- server
- node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/10—Electronic devices other than hearing aids
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
Abstract
A kind of scene-type foreign languages translation and learning system, the system include navigation spectacles；The information passed back in real time is translated into by the language that user uses by the translator of server end in real time.The learning system possesses scene Recognition function simultaneously, according to different study scenes, pass different types of foreign language content to be learned back in real time, and be extended according to the text to be learned passed back, user's more foreign language language message related to the text is supplied to, enables to user to make full use of chip time to carry out scene-type foreign language learning.
Description
Technical field
The invention belongs to field of navigation technology, the more particularly to airmanship with foreign language learning functionality.
Background technology
Existing navigation system is mostly that by mobile phone, navigator is completed, using there are many inconvenient places, example
As out of doors as in the street, when user is when unfamiliar local, it is necessary to check the map of display, traffic can be caused to endanger
Danger.In order to solve this problem, navigation spectacles have been developed at present, and these navigation spectacles by navigation information by projecting to mirror
On piece, it is to avoid need frequently to check the traffic hazard that mobile phone or navigator are brought.For example in the prior art：
CN105629515A (navigation spectacles, air navigation aid and navigation system), CN105115491A (a kind of air navigation aid, main equipment and
Slave unit), CN104090383A (intelligent cruise glasses and its control system), US20160078278A1 (has GPS's new
Glasses), US20130342805A1 (multi-functional glasses) etc..But these glasses functions are single, more realize common navigation
Purposes, navigation when only consider distance distance and traffic it is convenient, it is not intended that produce in the process scattered fragment when
Between how to utilize, less relate to how using these times learn foreign language.Meanwhile, in existing navigation, user to language not
It is familiar with, it is difficult to which the information of navigation is mapped with the mark of local language, the use of navigation spectacles is had a greatly reduced quality.Although existing
Also have some be used for translate glasses, but translate after content be directly displayed in glasses, can not accurately cover portion to be translated
Point, influence user's sight.Meanwhile, current glasses only have interpretative function, not foreign language learning function, particularly scene-type foreign language
Learning functionality, more without interactive foreign language learning function, it is impossible to which the chip time of user is used into carry out foreign language learning.
There is the demand for learning language at that time for people going abroad.In trip, the study for foreign language is very important,
But the need for also lacking corresponding product satisfaction so, particularly learn and practical application, the combination such as navigation, then more
It is few.The communication that the Google glass occurred on the market at present lacks with Professional translator is talked with, and results of learning are had a greatly reduced quality.At present
Glasses be also difficult to meet the demand.The fragmentation time that current language learning is difficult by increasingly tailing off is learnt.
In addition, also having some simple foreign language learning systems at present, but it is apart from each other with daily life, can only specially use
To learn, use to cause to user for a long time and be sick of psychology.And these systems do not have any scene-type, interactive
Practise, more study is not dissolved into daily life, makes full use of and does the time of other things in daily life to carry out foreign language
Study.
The content of the invention
In order to solve the above technical problems, the present invention provides a kind of scene foreign language learning system based on glasses,
The system includes lens body；
The lens body includes camera module, data transmission module, image display, loudspeaker, image procossing mould
Block and locating module；
Locating module, obtains user current location, and search in database according to customer location user at present residing for outside
Literary scene mode, data transmission module is sent to by foreign language scene mode；
Camera module, eyes see realtime graphic when shooting user's wearing spectacles, by the real-time figure of shooting
As being transferred to the image processing module；
Image processing module, according to user's foreign language scene mode, interception includes scene necessary information from realtime graphic
Parts of images, while obtaining position coordinates of the parts of images in realtime graphic；
Data transmission module, text formatting foreign language information is identified as by the necessary information in above-mentioned parts of images, and by text
This form foreign language information is sent to server；Foreign language scene mode is sent to server simultaneously；And being capable of the reception server biography
The Chinese information returned, according to the Chinese information searching data storehouse passed back, obtains the additional foreign language study related to the Chinese information
Information, and send Chinese information and above-mentioned position coordinates and additional foreign language learning information to image display；
Server, the other users for once passing through the foreign language scene mode are searched according to the foreign language scene mode received, and
Whether judge the other users is idle condition, if it is, text formatting foreign language information is sent to the other users, so that
So that the foreign language presentation of information is on the glasses of the other users；Above-mentioned foreign language information is translated into Chinese letter by the other users
Breath, server receives the Chinese information and sends it to the data transmission module of user's glasses；
Image display, receives the Chinese information that data transmission module is sent, and according to above-mentioned position coordinates by Chinese
Presentation of information is on the corresponding position of realtime graphic；Show additional foreign language learning information simultaneously.
Above-mentioned learning system, can include：In navigation, the server according to navigation purpose and current location
The advance guidance path stored in relation, search server；The advance guidance path is met：Starting point nodal distance current location
Recently, peripheral node is nearest apart from destination, and including the navigation route information between multiple intermediate nodes and multiple nodes.
Above-mentioned learning system, can include：Important node in the advance guidance path is with foreign language learning money
Material and cause guidance path most short node.
Above-mentioned learning system, can include：User is automatically switched to residing for the node when by the important node
Foreign language scene mode, image display shows the foreign language learning information associated with the node to user.
Above-mentioned learning system, can include：The node include library, market, hospital, railway station, subway station, fly
Airport, restaurant, school, tourist attractions.
Above-mentioned learning system, can include：The foreign language scene mode includes library mode, market pattern, hospital
Pattern, railway station pattern, subway station pattern, aircraft field mode, restaurant's pattern, school's pattern, tourist attractions, hotel's pattern.
Above-mentioned learning system, can include：Under books pattern, necessary information is title, additional foreign language learning information
Foreign language brief introduction or part foreign language content information for book；Under the pattern of market, necessary information is trade name, additional foreign language study letter
Cease the foreign language introduction for commodity and the conventional foreign language dialogue of purchase commodity；Under restaurant's pattern, necessary information is name of the dish, additional foreign language
Learning information is the conventional foreign language dialogue ordered dishes and paid dues；Under hotel's pattern, necessary information is hotel's name, additional foreign language study letter
Foreign language dialogue is commonly used in Xi Wei hotels.
Above-mentioned learning system, can include：The additional foreign language learning information is provided before other users, and is stored
On the server, and by user it is downloaded under wifi environment in glasses.
Above-mentioned learning system, can include：User can be carried out after additional foreign language learning information is received to its mistake
Revision, and upload onto the server.
The present invention also provides a kind of operating method of the scene-type foreign language learning system based on glasses, wherein：
Glasses include camera module, data transmission module, image display, loudspeaker, image processing module and determined
Position module；
User using glasses when being navigated, and locating module obtains user current location, and data transmission module is by user
Send server to the navigation purpose of current location and user's input；
The advance navigation road stored in relation of the server according to navigation purpose with current location, search server
Footpath；The advance guidance path is met：Recently, peripheral node is nearest apart from destination for starting point nodal distance current location, and bag
Include the navigation route information between multiple intermediate nodes and multiple nodes；
User is according to server normal navigation from the starting point node in the advance guidance path of current location arrival；In each section
Point, carries out the display of Chinese information and additional foreign language learning information as follows, learns for user：
(1) locating module obtains user's present node position, and user is searched in database according to user node location
The corresponding foreign language scene mode of current node, data transmission module is sent to by foreign language scene mode；
(2) eyes see realtime graphic when camera module shoots user's wearing spectacles, by the described real-time of shooting
Image transmitting gives the image processing module；Image processing module, according to user's foreign language scene mode, intercepts bag from realtime graphic
The parts of images of the necessary information containing scene, while obtaining position coordinates of the parts of images in realtime graphic；
(3) necessary information in above-mentioned parts of images is identified as text formatting foreign language information by data transmission module, and will
Text formatting foreign language information is sent to server；Foreign language scene mode is sent to server simultaneously；
(4) server searches the other users for once passing through the foreign language scene mode according to the foreign language scene mode received,
And judge whether the other users are idle condition, if it is, text formatting foreign language information is sent to the other users, from
And cause the foreign language presentation of information on the glasses of the other users；Above-mentioned foreign language information is translated into Chinese letter by the other users
Breath, server receives the Chinese information and sends it to the data transmission module of user's glasses；
(5) Chinese information that the enough the reception servers of data transmission module are passed back, according to the Chinese information searching data passed back
Storehouse, obtains the additional foreign language learning information related to the Chinese information, and by Chinese information and above-mentioned position coordinates and add
Foreign language learning information sends image display to；
(6) image display receives the Chinese information that data transmission module is sent, and according to above-mentioned position coordinates by the Chinese
Language presentation of information is on the corresponding position of realtime graphic, while showing additional foreign language learning information, learns for user；
User shows that correspondence Chinese information and additional foreign language learn by each node according to above-mentioned steps (1)-(6)
Information, after reach home node, and finally navigate to destination from peripheral node.
Other users therein can be the special translator set up in server end, and these translators compare
Machine translation of the prior art, using the teaching of the invention it is possible to provide more accurate translation information；Or other users can use to be somebody's turn to do
Other language learners of learning system, these users can experienced identical scene route, therefore can play
Mutual assistance is acted on, and translation is helped the people needed, and because being that these language learners can undergo identical scene route, so carrying
Can be immediately accurate for translation.
Above-mentioned locating module can be GPS module, and its effect is not only to determine the current geographical position of user, heavier
What is wanted is that can go out corresponding foreign language scene mould by user's selection or system Auto-matching according to current geographical position
Formula；It can be selected to be transferred to the text message type of server according to the scene mode.
Glasses have eyeball tracking module, can follow the trail of the rotation of eyeball, according to the current user of Rotation of eyeball position judgment
The content watched attentively.So, user can select the content for needing to translate using watching.
The inventive point of the present invention
(1) human translation is used, more accurately, results of learning are good.It can particularly be carried with carrying out translation study between user
The high learning interest of user.
(2) coordinate of content to be translated is obtained, the content after translation replaces original image content by coordinate, does not influence user
The experience of viewing.The text message after preferential transmission identification, more saves flow simultaneously.
(3) eyeball tracking technology is utilized, corresponding content to be translated can be selected according to user intention without starting.
(4) special scenes are marked, user enters after scene, the translation for the content seen except providing a user
Outside, corresponding foreign language additional content is also provided, user is brought into study scene, foreign language learning is carried out subtlely.
(5) because user frequently uses network in learning process, certain flow can be caused, therefore in order to save stream
Amount, it is proposed that the method for flow is saved using the guidance path for the optimization downloaded in advance.Set between the beginning and end of navigation
Vertical navigation programming route between some predetermined nodes, and these nodes, so required data traffic can be only
Including from starting point to the node nearest from starting point, and from terminal to the navigation programming of the node nearest from terminal.
(6) common the navigation typically distance of a consideration distance or traffic is convenient, can't consider in navigation way
Whether content for foreign language learning is had.And the present invention is then to have prestored many guidance paths in the server, these paths
Including the route on path between each node, and each node.Also, the selection of these nodes has considered routine and led
Boat demand, whether be the foreign language study scene that prestores, if contain foreign language learning information, if can if also especially considering node
To wait chip time to carry out scene-type foreign language study using walking in node.
(7) navigation spectacles can provide translation and learning functionality；When user uses glasses study and work abroad, meeting
There is the requirement of study to local language, and if this demand can go out unavoidably by independent time block progress focusing study
Existing learning interest is little, it is difficult to, can be sufficient using the translation navigation spectacles the problem of real life and study are combined
Using the time of fragmentation, instant learning is carried out to the language that living and studying occurs, learning efficiency is improved, while also by language
Speech study is associated with real daily life.
(8) model selection is provided, this model selection includes various usage scenarios, such as library, traffic station
Different information are fallen in point, street, different mode filtering, only retain various letters useful to user and related to pattern scene
Breath, so substantially increases the specific aim of language learning, also improves information transmission speed to be translated.
(9) picture shot for lens body, text message is only remained by image procossing, while going back creativeness
Proposition also retains position coordinates of the text information in picture for text message, so be passed back after text message translation
When projecting into the visible picture of user to glasses, the translation information directly replaces the foreign language information of original position, makes turning over for picture
Translate practicality higher, make user easier to understand.
(10) translator provides more accurately translation, and these translations are more accurate, it is ensured that the quality of study.
What the offer being currently known was translated also rests on the machine translation stage in database, and its learning quality can not also be with translator's
Human translation is compared.
The inventive point and relevant art effect mentioned in the inventive point not limited to this of the present invention, embodiment are also the present invention's
Unique distinction.
Technique effect
(1) more accurately navigation translation, and can make full use of the fragment in user's navigation procedure can be provided abroad
Time is learnt, and results of learning are good.Compared with tradition exclusively carries out the machine of foreign language learning, it will not be sick of.
(2) requirement shown when fully taking into account navigation to glasses, navigation necessary information is included in the appropriate position of image,
Improve user experience.
(3) it can select to carry out different foreign language learning contents in different scenes, and the foreign language of scene-type can be carried out
Practise, it is better.
(4) fully take into account foreign language learning system and larger flow can be taken when navigation system is combined, therefore propose all
The means for saving flow, can practice every conceivable frugality flow more.
(5) can break through normal navigation with distance, have a good transport service the method navigated, and one kind is provided can be
The navigation learnt foreign languages in navigation procedure using chip time, and anticipate and edit the corresponding foreign language of many navigation nodes
Practise information.
(6) the mutual service between user is made full use of, study enjoyment is improved；Meanwhile, human translation is more accurate.
(7) translation and learning functionality in real time are provided, when elimination user lives abroad, the language into various scenes is feared
Fear sense.
Brief description of the drawings
The block diagram of Fig. 1 embodiment of the present invention 1.
The translator of Fig. 2 embodiment of the present invention 2 selectivity translation schematic diagram predetermined to the information in image.
The schematic diagram of Fig. 3 embodiment of the present invention 3.
The implementation flow of Fig. 4 embodiment of the present invention 3
Embodiment
Reference in accompanying drawing is respectively：1 lens body；11 camera modules；12 data transmission modules；13 images show
Show module；14GPS modules；15 loudspeakers；16 image processing modules；2 servers；3 translators (server end translator or
Other glasses users)；The image that 4 camera modules are shot；4 ' project to the figure on glasses after image procossing and translation
Picture.
As shown in figure 1, a kind of scene foreign language learning system based on navigation spectacles, the guiding systems include lens body 1；
The lens body 1 includes camera module 11, data transmission module 12, image display 14, the and of loudspeaker 15
Image processing module 15, eyes when camera module 11 can shoot user's wearing spectacles see realtime graphic, will clap
The image transmitting taken the photograph is to image processing module 16, and realtime graphic is transferred to data biography by the image processing module 16 after treatment
Data after processing are transferred to the server 2 set up home, wherein translator by defeated module 12, data transmission module 12
Appearance guideboard mark in image only can be translated into Chinese by 3.
Certainly, it is not only that can to set to be translated be the navigation word such as guideboard, that can pass back is such as user
Other words interested, these words contribute to study of the user to local language.For example：(the figure after library is entered
Book shop scene mode), the title of the books shot in camera module 11 in lens body 1 can be transferred back in server 2,
And translated positioned at the Professional translator 3 of server 2 according to the title for the books passed back.(the train when entering railway station
Stand scene mode), the information related to traffic can be transferred back in server 2, and positioned at the Professional translator of server 2
3 are translated according to the related information of the traffic passed back.The above-mentioned selection to being transferred to the information of server 2 can be by user
Manually select, can also be automatically selected by GPS module positioning.For example select：1) navigation pattern：Data transmission module 12
The need for the vocabulary such as navigation-related guideboard are transmitted back to only to facilitate navigation；2) library mode：Data transmission module 12
The transmission data relevant with the title of books, the lookup with convenient use person to the book text of required reading；3) shopping mode：Data
The related information of commodity that the transmission of transport module 12 is gathered when being done shopping to user, such as including trade name, price,
Commodity brief introduction etc.；To be user-friendly for shopping；4) traffic station mode：12 transmission of data transmission module and such as train
Order of classes or grades at school, aircraft order of classes or grades at school, subway, public transport is begun to related information, the need for being user-friendly for traffic.Above-mentioned various patterns
Final election can also be carried out, for example：1) navigation pattern and 4) traffic station mode is used simultaneously, to be more beneficial for the need that user goes on a journey
Will.
The server 2 passes to translated text information the data transmission module 12 of the lens body 1, and the data are passed
Defeated module 12 projects to data message on the eyeglass of user by the image display 13 built in glasses；And institute
The language message for stating the translation of translator 3 is also exported to user by data transmission module 12 by loudspeaker 15；
The lens body 1 of the navigation eye system is also equipped with GPS module 14, and it can determine the geographical position of eyeglass wearer
Put, and positional information is transmitted set up the server 2 home, the server 2 will according to navigation purpose and current location
Relation, the navigation route information stored in search server 2, translator 3 provides artificial user according to guidance path
The Voice Navigation service of setting, the voice messaging of the navigation Service is to be exported by data transmission module 12 by loudspeaker 15 to making
User's；And navigation route information is projected to the eyeglass of user by data transmission module 12 by image display 14
On.
The server 2 includes enquiry module, when there is information transfer to be translated to server 2, can inquire about now
Server 2 whether be in idle condition, searched once by the foreign language scene mode according to the foreign language scene mode that receives
Other users, and judge whether the other users are idle condition, if it is, text formatting foreign language information is sent into this its
He is user, so that the foreign language presentation of information is on the glasses of the other users；The other users turn over above-mentioned foreign language information
Chinese information is translated into, server receives the Chinese information and sends it to the data transmission module of user's glasses；Here its
His user can be the full-time translator at other users or end of server 2 for using the learning system.This is special
Duty translator is occurred as the role of translation Content Service Provider when using the system.
The translation navigation spectacles can provide learning functionality；, can be to working as when user uses glasses study and work abroad
Ground language has the requirement of study, and if this demand occurs unavoidably by independent time block progress focusing study
Practise interest little, it is difficult to the problem of real life and study are combined, can sufficiently be utilized using the translation navigation spectacles
The time of fragmentation, instant learning is carried out to the language that living and studying occurs, learning efficiency is improved, while also by linguistics
Habit is associated with real daily life.For example：User can be configured required to server 2 or data processing module 12 in advance
The vocabulary classification of translation：Vocabulary classification includes：Life term, specialized vocabulary etc.；The difficulty of required translation vocabulary can also be set
Easy degree, such as 4 grades of College English, College English 6, GRE vocabulary etc..If user only requires translation speciality vocabulary, for
The image information that lens body is shot by whole language messages to be translated after export server 2 is passed, and the server 2 is to these
Language message filters out specialized vocabulary and is supplied to translator to be turned over according to the language database in the memory of server
Translate；Or automatic machine translation is carried out by language database；Or language database progress automatic machine translation is first passed through,
Do not have to carry out human translation in the case of corresponding data message；In addition；Translator can be made with the vocabulary that should be translated
Sentence, includes sentence-making by the information of above-mentioned translation and by data transmission information is transferred to lens body 1, by image processing system with
Loudspeaker is exported.
In above-mentioned technical proposal, translated by the way of artificial, it is ensured that the accuracy of translation；In addition using artificial
Man-to-man service, also increases the exclusive service of client's translation and navigation needs；In addition, by the way of human translation simultaneously
And transmission information in real time is combined, the immediate updating to local information can be accomplished, it is to avoid because map rejuvenation not in time causes
Translation and navigational error.In addition, translator 3, when selecting different patterns, can be turned over flexible configuration using different
Translate personnel.For example when selecting library mode, translator is configured to the translator similar to the hobby of user,
The translator can also carry out the guidance of books selection, the tutorial message is passed through in addition to it can be translated to data message
Server 2 is transferred to data processing module 12, then is exported by image processing system and loudspeaker.With convenient use person.
If being translated using using the other users of the learning system, then server 2 is needed by content to be translated
Other users for being now in idle condition are given by the inquiry server transport in server 2.Other users pass through
When image processing system views the content to be translated, translation is answered using selection, then the content of the translation is passed through into glasses
Content after translation is transferred back to server 2 by the voice collection device of Ontology integration, the server 2 by the content after translating again
On the lens body for being transmitted back to the user for needing to translate, to provide translation.
Above-mentioned technical proposal be particular for the translation in the foreign country crowd not yet done to local language and navigation needs, and
Both translation and navigation are combined to realize.For example：12 transmission of data transmission module of lens body 1 are with navigation correlation
The information such as guideboard, as shown in Fig. 2 filter out other information (it is of course also possible to set server, the need for user, thing
First customization needs the information transmitted, for example, can transmit market, hospital, railway station, subway station, the identification information such as airport).This
Sample can accomplish the filtering to garbage, accomplish to save the effect of flow.
Specific method is referred to shown in Fig. 2：The image 4 that camera module is shot includes default of advance user
The guideboard information of transmission：WALLst and WLLIAMst；S11 steps are then performed, i.e., data transmission system 12 is in image
Guideboard information is extracted, and certain those skilled in the art can also extract the other information set according to user, such as business
, hospital, railway station, subway station, the identification information such as airport.The method of the extraction information can be used in image procossing and commonly used
The known method such as threshold decision method to word, digital information is identified；Then black white binarization processing is carried out, with minimum
Data flow records the information to be translated；Data transmission system 12 will also mark the position letter of the information of extraction in the picture simultaneously
Breath.As shown in Figure 2：WALLst location coordinate information is (X1, Y1), WLLIAMst location coordinate information be (X2,
Y2)；More optimizedly, glasses have eyeball tracking module, can follow the trail of the rotation of eyeball, according to Rotation of eyeball position judgment mesh
The content that preceding user is watched attentively.So, user can select the content for needing to translate using watching.For example, for attached
Image in Fig. 2, when user's watching is on WALLst, the turned position of eyeball tracking module capture eyeball, and according to
Pupil center and the position relationship of image 4, extrapolate user's sight and fall in the position (X1, Y1) of image 4, if user eyeball is kept
The time of the position is watched attentively more than 2 seconds, then it is assumed that the region is user's area-of-interest, and data transmission system 12 is to image 4
In the region carry out word, digital information and be identified, and extract the coordinate information in the region.Then perform step S12：Will
Image information is substituted for text message, with the further data volume for reducing transmission；As data processing module execution of step S12
Afterwards, by text information transfer to server 2, server 2 performs step S13：Above-mentioned text message is transferred to translator
Translated；Then perform step S14：Translation result is returned into server after the above-mentioned text message of translator's human translation
2；Then perform step S15：Server 2 is by translated text message returned data processing system 12；Finally perform step
S16, data handling system 12 replaces the content of translation the image information at former coordinate information, finally by image display system
Image after translation is included on the lens body 1 of user, used when being navigated for user.
Certainly, unrestricted choice the need for the above-mentioned redundant information that filters is according to user, user can also select
Do not filter but any information, the content information for being possible to translation on image is all transferred into server is carried out for translator
Translation.
User has been pre-selected after corresponding pattern in such scheme, and the system can also automatic identification model：GPS moulds
Block 14 can be compared according to the information of position location and the position in the map downloaded in advance, to determine which kind of pattern opened.
For example GPS module 14 is positioned at library, then can automatically turn on 2) library mode；When GPS module 14 is positioned at the train station, then
4) traffic station mode can be opened；After current system operating mode is determined, because place is relatively single-minded, such as in library
In, processing of the image processing module 16 to data can be relatively easy, only need to calculate word wheel according to the edge algorithms of shooting image
Exterior feature, and extracted.It will not relate to large-scale image classification and discrimination.But meanwhile, each scene provides additional
Information carries out foreign language learning for user under help.Different scenes have the characteristics of oneself is different, such as in library's scene,
Image processing module 16 is obtained after title, and the title after translation is shown into user as stated above, now shown in glasses
Image other positions, display with the closely related foreign language information of the book, for example for《Letter love》, the Chinese name except showing the book
It is referred to as outer, also scroll English content " the Why you want to tell me that in its part！She told you
that has nothing to do with me.Do you think I'm poor,not good-looking,without
feelingsI will,if god had gifted me with wealth and beauty,I must make you
to leave me as it is now for me to leave you！God did not so.Our spirit is
same,just like you with my grave,will equally by standing in front of god！Why
you want to tell me that！She told you that has nothing to do with me.Do you
think I'm poor,not good-looking,without feelingsI will,if god had gifted me
with wealth and beauty,I must make you to leave me as it is now for me to
leave you！God did not so.Our spirit is same,just like you with my grave,will
equally by standing in front of god！", such user can learn more at any time after the scene is entered
English knowledge, and need not additionally stir the books, it is only necessary to step into the scene, it is possible to continuously carry out outer
Language learns.System can push the sentence of different difficulty according to user's level.Certainly, if user for above-mentioned english sentence not
Understand, sight can be rested on the sentence, so that the content is sent into server, and translator is sent to by server
Correspondence translation and display are carried out, specific method is similar with the translation of following guideboard.
Above-mentioned technical proposal, which extends the use of the translation glasses, particularly the technical program, the ginseng of translator
With there is provided be man-to-man service, ensured the quality of translation service, carried out lifting one anti-simultaneously for content to be translated
Three, artificial sentence-making is provided to vocabulary, has deepened understanding of the user to the vocabulary, it is ensured that learning quality.Mentioned above
Translator can be machine, carry out intelligent translation；Can also be remote service end personnel or other users, when by information
It is transferred to after server, server 2 is passed it to remote service end personnel or used using other of the system
Person, they also can carry out real time translation to the information, and the tutorial message of translation is transferred into data processing by server 2
Module 12, then exported by image processing system and loudspeaker.Especially optimize, it is excellent with reference to above-mentioned different pattern
First recommend interested in the scene and same other users using the system.For example in the pattern of street, when system is automatic
Identification or user A have selected (using the method for the eyeball tracking of above-mentioned introduction) corresponding part figure of guideboard information " WALLst "
The word content transmission is given another user B familiar to the street scene by picture, data transmission system 12.It can such as lead to
The positional information for crossing collection user obtains the user frequently by the street scene, judges that it is familiar with to the scene.Meanwhile,
Obtain the L proficiency of the user, and current state.If user's L proficiency reaches setting value, and is currently in " empty
It is not busy " state, then the text information is pushed to user B, and the content is shown on its glasses, user B is to " WALLst " progress
Translation, server is sent to by the text and/or voice of " Wall Street " by glasses, and is eventually transferred on user A glasses,
And in the position display " Wall Street " of former " WALLst ".But sometimes single word user B is difficult accurately to be translated, now
User B can send the current complete image of user's A glasses with request server.So, can be with for user A, user B
Learn or review corresponding foreign language content.
When particularly user A and user B have identical content of interest, for example user A have selected above-mentioned《Letter love》One book,
And title is sent to user B, additionally the book can be introduced, or carries in addition to carrying out the translation of title by user B
User A is sent to for foreign language content additionally related to the book, and by server.Two such with can should feel emerging per family
The content of interest is exchanged, the common English study for carrying out scene-type.
Also provide in a preferred embodiment, above-mentioned learning system, can include：User is receiving additional foreign language study
After information, its mistake can be revised, and upload onto the server 2.Specially：When user has found to have in the translation
During mistake, correct content can be supplied to server 2, with more new content.
Transmission picture or video is avoided to save flow although being tried one's best using the above method, in order to further save flow or answer
To the occasion of special consumed flow, the present invention proposes the data communication flow for reducing and being produced in GPS navigation, can be with glasses sheet
Being prepared in body system configuration includes the offline map of advance guidance path, and designate the important node in offline map and from
One node reaches the path of another node.Such as market, park, railway station, subway station, airport, hospital, hotel these
The navigation programming information and Voice Navigation information mutually reached between important node；For example, see shown in accompanying drawing 3；Show in accompanying drawing 3
Go out the simplified diagram of a map, the schematic diagram can include avenue (not shown) and important urban node, this
A little urban nodes are respectively node 1,2,3,4,5 ...；Market, hospital, railway station, subway station, airport can specifically be included
Deng.And the navigation programming figure line between these nodes；User performs step S21, navigation programming information when using navigation
It is to be downloaded to user beforehand through server with Voice Navigation information, user can in advance be downloaded by modes such as WIFI
In the memory in lens body, and it can be exported by image display system and loudspeaker, above-mentioned download
Navigation programming information and Voice Navigation under navigational state because not being related to the transmission of data and server, therefore and need not
Spend the flow of user；Step S22 is performed when user needs navigation：The positional information provided according to GPS module 14,
GPS module 14 first determines user's current location information, and the destination information of the positional information and navigation is transferred to server
2, server 2 plans current location to the navigation programming information I of the offline map interior joint 4 nearest from current location, interpreter
The text information that above-mentioned lens body system is transferred to server is carried out character translation by member, while according to leading that server is provided
Navigate planning information I, with reference to camera shoot post processing text information carry out real-time voice report, server 2 by it is above-mentioned these
Data transmission module 12 of the information transfer to lens body 1, is exported by image display 13 and loudspeaker 15；Perform
Step S23：Navigation programming and voice broadcast are provided by the offline map downloaded in advance, by image display 13 and is raised one's voice respectively
Device 15 is exported；Perform step S24：After user is navigate into the node 2 nearest from destination from node 4, according to GPS
The positional information that module 14 is provided, GPS module 14 first determines the positional information of user's present node 2, the information of node location 2 with
And the destination information of navigation is transferred to server 2, the planning present offline map of server 2 interior joint 2 arrives the navigation of destination
The text information that above-mentioned lens body 1 is transferred to server 2 is carried out character translation by planning information II, translator, while root
The navigation programming information II provided according to server 2, carries out real-time voice with reference to the text information that camera 11 shoots post processing and broadcasts
Report, data transmission module 12 of the server 2 by these above-mentioned information transfers to lens body 1 passes through the He of image display 13
Loudspeaker 15 is exported, to complete navigation needs.
Above-mentioned further technical scheme has also reached the purpose for saving flow, and the technical scheme can only be turned over foregoing
The technical scheme for translating the text information being necessary is used in combination, and translator is turned over according to character translation content during combined use
It is also the amendment of the programme path for navigating to node or destination being navigate to from node provided server when translating.Work as discovery
Character translation information and the navigation programming that provides along road information it is serious not to it is corresponding when can find in time and be notified to user and
Provider server is to be modified.It should be noted that when, this amendment be it is very important, although existing navigation mode every
A period of time carries out map upgrading, but can not accomplish the possible cartographic information change of real time correction, and above-mentioned technical proposal reaches
The purpose of real-time manual synchronizing has been arrived, has been the contribution of inventor's creative work.The technical scheme of certain saving GPS navigation flow
The technical scheme that flow can not also be saved with above-mentioned translation is used in combination, and can be used alone the technical scheme.
Therefore, a kind of scene foreign language learning system based on glasses, the system includes lens body；The lens body bag
Camera module, data transmission module, image display, loudspeaker and image processing module are included, camera module can be clapped
Eyes see realtime graphic when taking the photograph user's wearing spectacles, and the realtime graphic of shooting is transferred into the image procossing mould
The realtime graphic is transferred to data transmission module by block, the image processing module after treatment, and data transmission module will be located
Data after reason be transferred to set up home or user the country one belongs to the glasses system server, the server end
Necessary information in image is only translated into the language message that user specifies by translator, and the server is by translated institute
State the data transmission module that the language message that user specifies is transferred to the lens body, the data transmission module is by the number
It is believed that breath is projected on the eyeglass of the lens body by the image display built in the lens body；And the translation
The language message of personnel can also be exported to the user by the loudspeaker；The glasses also include scene selection mode,
According to different scene modes, different types of realtime graphic is transmitted.Wherein described necessary information refers to that user is pre-
The vocabulary to be learned first set, phrase, sentence；The translator is by the vocabulary to be learned, phrase, in sentence translation
Outside language text specified by user, also to the vocabulary to be learned, phrase, sentence is extended, enabled a user to
It is appreciated and understood that the vocabulary to be translated, phrase, the implication of sentence；The vocabulary of the study and to phrase, sentence enters
Information after row extension gives the data transmission module by the server transport；Described necessary information also includes language
Coordinate (X, Y) in image corresponding to text message；After the completion of serving as interpreter, by the seat in the text message and image translated
Mark (X, Y) corresponding；The lens body is also equipped with GPS module, can determine the geographical position of eyeglass wearer, and position is believed
Breath is passed to be stored in the server, relation of the server according to navigation purpose with current location, search server
Guidance path, the translator provides the navigation Service of artificial user's appointed language according to guidance path, and by institute
The navigation Service for stating appointed language is exported to the user by the image display and the loudspeaker.Above-mentioned technical proposal
In, the necessary information in described image refers to navigation guideboard information；Filter out the other information of image.Above-mentioned technical proposal
In, the necessary information in described image refers to market, hospital, railway station, subway station, the identification information such as airport, filters out figure
The other information of picture.In above-mentioned technical proposal, user carries out advance model selection to the necessary information；For different moulds
Formula, the information of the different data transmission module transmission of correspondence.The pattern can be library mode, traffic website mould
Formula.Wherein 1) navigate pattern：The need for data transmission module is only transmitted back to the vocabulary such as navigation-related guideboard to facilitate navigation；
2) library mode：Data transmission module only transmits the data relevant with the title of books, is read with convenient use person to required
Book text lookup；3) shopping mode：It is related that data transmission module only transmits the commodity gathered when being done shopping to user
Information；4) traffic station mode：Data transmission module is only transmitted to be begun to correlation with train order of classes or grades at school, aircraft order of classes or grades at school, subway, public transport
Information.In above-mentioned technical proposal, translator's information to be translated to user is translated, while providing related to information
Advisory information, the advisory information is raised by server transport to data processing module, then by the image display with this
Sound device is exported to the user, convenient use.In above-mentioned technical proposal, the data transmission module is only to server transport text
Word information, while retaining location coordinate information of the text information in the image of shooting.In above-mentioned technical proposal, the data
Transport module is only transmitted:A. the GPS module current location information and the node nearest from user in the offline map downloaded
Positional information；B. the positional information of node nearest from destination in offline map and destination locations information, the node
Refer to important transport node, hospital, market or hotel in offline map.In above-mentioned technical proposal, the data transmission module root
The vocabulary for needing to translate selectively is transmitted according to user's vocabulary level set in advance.Also include translation in above-mentioned technical proposal
Vocabulary translation personnel vocabulary is made sentences, and will sentence-making information return to data transmission system.
It is particularly preferred that navigated using the navigation spectacles, and when carrying out foreign language learning, can also be with following skill
Art scheme is realized：
User can input destination in the terminal (such as mobile phone) or navigation spectacles associated with navigation spectacles, and navigate eye
The locating module (such as GPS) of mirror obtains user current location, and position coordinates is sent into data transmission module.Data transfer
Send server to the navigation purpose that module inputs user current location and user；Server according to navigation purpose and work as
The advance guidance path stored in the relation of front position, search server.Planned according to server path, including navigation programming letter
The advance guidance paths of I--navigation programming route II is ceased, wherein advance guidance path and corresponding offline map download storage in advance
In navigation spectacles system, to save flow.The offline map of advance guidance path, designates the important node in offline map
And the path of another node is reached from a node.Such as market, park, railway station, subway station, airport, hospital, hotel
The navigation programming information and Voice Navigation information mutually reached between these important nodes；For example, see shown in accompanying drawing 3；Accompanying drawing 3
In show the simplified diagram of a map, the schematic diagram can include avenue (not shown) and important city section
Point, these urban nodes are respectively node 1,2,3,4,5 ...；Market can specifically be included, hospital, railway station, subway station flies
Airport etc..And the navigation programming figure line between these nodes；User performs step S21, navigation programming when using navigation
Information and Voice Navigation information are to be downloaded to user beforehand through server, and user can be advance by modes such as WIFI
Download in the memory being arranged in lens body, and can be exported by image display system and loudspeaker, it is above-mentioned
The navigation programming information of download and Voice Navigation under navigational state because not being related to the transmission of data and server, therefore not
Need the flow of cost user；Step S22 is performed when user needs navigation：The position letter provided according to GPS module 14
Breath, GPS module 14 first determines user's current location information, and the destination information of the positional information and navigation is transferred to service
Device 2, server 2 plans current location to the navigation programming information I of the offline map interior joint 4 nearest from current location, translation
The text information that above-mentioned lens body system is transferred to server is carried out character translation by personnel (or other users), while basis
The navigation programming information I that server is provided, real-time voice report, service are carried out with reference to the text information that camera shoots post processing
Data transmission module 12 of the device 2 by these above-mentioned information transfers to lens body 1, passes through image display 13 and loudspeaker 15
Exported (specific method may be referred to accompanying drawing 2 and correspondence word description).Advance guidance path is met：Starting point nodal distance is worked as
Recently, peripheral node is nearest apart from destination for front position, and including the guidance path between multiple intermediate nodes and multiple nodes
Information.To consider each node simultaneously is appearance in the node for belonging to foreign language scene mode labeled in advance, i.e., each node
Some information, be stored with corresponding foreign language learning information in the server.For example some node is library, and it belongs to books
The node of shop pattern, the corresponding foreign language information of the various books in the inside is had stored in server, or once by other users
There is provided.
User is according to server normal navigation from the starting point node in the advance guidance path of current location arrival, such as Fig. 3
In node 4, and according to the guidance path prestored along path reach node 2.Fig. 3 is only schematic diagram, if user
Navigation distance is longer, then it is also possible in the presence of other nodes between node 4 and node 2.
After each node is entered, the display of Chinese information and additional foreign language learning information is carried out as follows,
For user's study：
(1) locating module of navigation spectacles obtains user's present node position, judges whether user reaches predetermined navigation road
Some node in footpath, while searching for the corresponding foreign language scene mould of the current node of user in database according to user node location
Formula, such as node 4 are a libraries, then " library's foreign language scene mode " is sent into data transmission module.Now use
Family has been enter into library, automatically from navigation pattern switching to library mode.
(2) eyes are seen in realtime graphic, such as library when camera module shoots user's wearing spectacles《Jane
Eyre》Strip of paper used for sealing image.The realtime graphic of shooting is transferred to the image processing module；Image processing module, according to
Outdoor text scene mode, " library's foreign language scene mode " for example now, interception includes scene necessity letter from realtime graphic
The parts of images of breath, for example, only include the image of title.It can also be the parts of images that there is word in book envelope.Obtain simultaneously
Take position coordinates (x, y) of the parts of images in realtime graphic；Specifically with intercepting realtime graphic in accompanying drawing 2, word knowledge is carried out
Method for distinguishing is identical.
(3) necessary information in above-mentioned parts of images (is title or author in library mode by data transmission module
Deng) it is identified as text formatting foreign language information " Jane Eyre ", and " Jane Eyre " are sent to clothes by text formatting foreign language information
Business device；" library's foreign language scene mode " is sent to server simultaneously；
(4) server is searched according to " the library's foreign language scene mode " received once passes through the library, should using crossing
The other users B of " library's foreign language scene mode ", and judge whether other users B is idle condition, i.e., whether can help
Help carry out translation.Other users B foreign language test level is can be combined with simultaneously, or all previous translation degree of accuracy carries out user
B selection.If selected after user B, by text formatting foreign language information, " Jane Eyre " and foreign language scene mode are sent to this
Other users B, so that " Jane Eyre " are shown on the other users B glasses foreign language information；Other users B is examined
The scene residing for user is considered for library, and corresponding information, translated., can be with if not can determine that translation content still
User is asked to send real time picture.By above-mentioned foreign language information, " Jane Eyre " translate into Chinese information to other users B《Letter
Love》, server receives the Chinese information《Letter love》And send it to the data transmission module of user's glasses；
(5) Chinese information that the enough the reception servers of data transmission module are passed back《Letter love》, looked into according to the Chinese information passed back
Database is looked for, the additional foreign language learning information related to the Chinese information is obtained, these additional foreign language learning informations can be by taking
Business device is provided, and is that other users once upload and store some contents on the server, can also be by server end interpreter
The special editor of member is formed.For example for《Letter love》, in addition to the Chinese name for showing the book, also scroll its part English
Content " Why you want to tell me that！She told you that has nothing to do with
me.Do you think I'm poor,not good-looking,without feelingsI will,if god had
gifted me with wealth and beauty,I must make you to leave me as it is now for
me to leave you！God did not so.Our spirit is same,just like you with my
grave,will equally by standing in front of god！Why you want to tell me that！
She told you that has nothing to do with me.Do you think I'm poor,not good-
looking,without feelingsI will,if god had gifted me with wealth and beauty,I
must make you to leave me as it is now for me to leave you！God did not so.Our
spirit is same,just like you with my grave,will equally by standing in front
of god！”.Certainly, these contents can also selectively be shown.Or show to information such as the foreign language book reviews of the books.Meanwhile, will
Chinese information《Letter love》Image display is sent to above-mentioned position coordinates (x, y) and additional foreign language learning information.User
After additional foreign language learning information is received, it can be learnt.Simultaneously for unfamiliar content, it can also utilize and be previously mentioned
Method (such as eyeball tracking) selected, and it is sent to server again, seeks server end or other users
Help, translation etc..Meanwhile, if the user find that the additional information provided is wrong, or the necessary information that other users are translated
It is wrong, its mistake can be revised on glasses or connected mobile phone, and upload onto the server.Server according to
After judgement, or after other users judge, decide whether to adopt, be used as one on the node prestored in the server
A little information.
(6) image display receives the Chinese information that data transmission module is sent, and according to above-mentioned position coordinates (x, y)
By Chinese information《Letter love》It is shown on the corresponding position of realtime graphic, replaces《Jane Eyre》, while display adds outer literature
Information is practised, is learnt for user.
User shows that correspondence Chinese information and additional foreign language learn by each node according to above-mentioned steps (1)-(6)
Information, after reach home node, and finally navigate to destination from peripheral node.The corresponding scene mode of each node is different,
For example can be：Library mode, market pattern, hospital's pattern, railway station pattern, subway station pattern, aircraft field mode, restaurant
Pattern, school's pattern, tourist attractions, hotel's pattern etc..Under books pattern, necessary information is title, additional foreign language study letter
Cease the foreign language brief introduction for book or part foreign language content information；Under the pattern of market, necessary information is trade name, additional foreign language study
Information is the foreign language introduction of commodity and the conventional foreign language dialogue of purchase commodity；Under restaurant's pattern, necessary information is name of the dish, adds outer
Literary learning information is the conventional foreign language dialogue ordered dishes and paid dues；Under hotel's pattern, necessary information is hotel's name, additional foreign language study
Information is conventional foreign language dialogue in hotel.After user is navigate into the node 2 nearest from destination from node 4, according to GPS
The positional information that module 14 is provided, GPS module 14 first determines the positional information of user's present node 2, the information of node location 2 with
And the destination information of navigation is transferred to server 2, the planning present offline map of server 2 interior joint 2 arrives the navigation of destination
The text information that above-mentioned lens body 1 is transferred to server 2 is carried out character translation by planning information II, translator, while root
The navigation programming information II provided according to server 2, carries out real-time voice with reference to the text information that camera 11 shoots post processing and broadcasts
Report, data transmission module 12 of the server 2 by these above-mentioned information transfers to lens body 1 passes through the He of image display 13
Loudspeaker 15 is exported, to complete navigation needs.
This method can be provided while navigation, in addition to it can arrive at as soon as possible, moreover it is possible to broken using these
The piece time carries out English study.
Claims (10)
1. a kind of scene-type foreign languages translation and learning system, the system include navigation spectacles body；
The lens body include camera module, data transmission module, image display, loudspeaker, image processing module and
Locating module；
Locating module, obtains user current location, and search in database according to customer location user it is current residing for outer civil division
Scape pattern, data transmission module is sent to by foreign language scene mode；
Camera module, eyes see realtime graphic when shooting user's wearing spectacles, and the realtime graphic of shooting is passed
It is defeated by the image processing module；
Image processing module, according to user's foreign language scene mode, interception includes the part of scene necessary information from realtime graphic
Image, while obtaining position coordinates of the parts of images in realtime graphic；
Data transmission module, text formatting foreign language information is identified as by the necessary information in above-mentioned parts of images, and by text lattice
Formula foreign language information is sent to server；Foreign language scene mode is sent to server simultaneously；And can the reception server pass back
Chinese information, according to the Chinese information searching data storehouse passed back, obtains the additional foreign language learning information related to the Chinese information,
And send Chinese information and above-mentioned position coordinates and additional foreign language learning information to image display；
Server, the other users for once passing through the foreign language scene mode is searched according to the foreign language scene mode received, and judge
Whether the other users are idle condition, if it is, text formatting foreign language information is sent to the other users, so that
The foreign language presentation of information is on the glasses of the other users；Above-mentioned foreign language information is translated into Chinese information by the other users, clothes
Business device receives the Chinese information and sends it to the data transmission module of user's glasses；
Image display, receives the Chinese information that data transmission module is sent, and according to above-mentioned position coordinates by Chinese information
It is shown on the corresponding position of realtime graphic；Show additional foreign language learning information simultaneously.
2. foreign language learning system as claimed in claim 1, it is characterised in that：In navigation, the server is according to navigation mesh
Ground and current location relation, the advance guidance path stored in search server；The advance guidance path is met：Starting point
Recently, peripheral node is nearest apart from destination for nodal distance current location, and including between multiple intermediate nodes and multiple nodes
Navigation route information.
3. foreign language learning system as claimed in claim 2, it is characterised in that：Important node in the advance guidance path is
With foreign language learning data and cause guidance path most short node.
4. foreign language learning system as claimed in claim 3, it is characterised in that：User is when by the important node, automatically
The foreign language scene mode residing for the node is switched to, image display shows the foreign language learning letter associated with the node to user
Breath.
5. the foreign language learning system as described in claim 1-4, it is characterised in that：The node includes library, market, doctor
Institute, railway station, subway station, airport, restaurant, school, tourist attractions.
6. the foreign language learning system as described in claim 1-5, it is characterised in that：The foreign language scene mode includes library's mould
Formula, market pattern, hospital's pattern, railway station pattern, subway station pattern, aircraft field mode, restaurant's pattern, school's pattern, tourism
Sight spot, hotel's pattern.
7. the foreign language learning system as described in claim 1-6, it is characterised in that：Under books pattern, necessary information is title,
Foreign language brief introduction or part foreign language content information of the additional foreign language learning information for book；Under the pattern of market, necessary information is commodity
Name, additional foreign language learning information is the foreign language introduction of commodity and the conventional foreign language dialogue of purchase commodity；Under restaurant's pattern, necessity letter
Cease for name of the dish, additional foreign language learning information is the conventional foreign language dialogue ordered dishes and paid dues；Under hotel's pattern, necessary information is hotel
Name, additional foreign language learning information is conventional foreign language dialogue in hotel.
8. the foreign language learning system as described in claim 1-7, it is characterised in that：The additional foreign language learning information is used by other
There is provided, and stored on the server before family, and be downloaded to by user under wifi environment in glasses.
9. the foreign language learning system as described in claim 1-7, it is characterised in that：User is receiving additional foreign language learning information
Afterwards, its mistake can be revised, and uploaded onto the server.
10. a kind of air navigation aid based on scene-type foreign languages translation and learning system, it is characterised in that：
Glasses include camera module, data transmission module, image display, loudspeaker, image processing module and positioning mould
Block；
User using glasses when being navigated, and locating module obtains user current location, and data transmission module is current by user
Send server to the navigation purpose of position and user's input；
The advance guidance path stored in relation of the server according to navigation purpose with current location, search server；
The advance guidance path is met：Recently, peripheral node is nearest apart from destination for starting point nodal distance current location, and including many
Navigation route information between individual intermediate node and multiple nodes；
User is according to server normal navigation from the starting point node in the advance guidance path of current location arrival；In each node,
The display of Chinese information and additional foreign language learning information is carried out as follows, is learnt for user：
（1）Locating module obtains user's present node position, and it is current to search in database according to user node location user
The corresponding foreign language scene mode of node, data transmission module is sent to by foreign language scene mode；
（2）Eyes see realtime graphic when camera module shoots user's wearing spectacles, by the realtime graphic of shooting
It is transferred to the image processing module；Image processing module, according to user's foreign language scene mode, interception includes field from realtime graphic
The parts of images of scape necessary information, while obtaining position coordinates of the parts of images in realtime graphic；
（3）Necessary information in above-mentioned parts of images is identified as text formatting foreign language information by data transmission module, and by text
Form foreign language information is sent to server；Foreign language scene mode is sent to server simultaneously；
（4）Server searches the other users for once passing through the foreign language scene mode according to the foreign language scene mode received, and sentences
Whether the other users of breaking are idle condition, if it is, text formatting foreign language information is sent to the other users, so that
The foreign language presentation of information is obtained on the glasses of the other users；Above-mentioned foreign language information is translated into Chinese information by the other users,
Server receives the Chinese information and sends it to the data transmission module of user's glasses；
（5）The Chinese information that the enough the reception servers of data transmission module are passed back, according to the Chinese information searching data storehouse passed back, is obtained
To the additional foreign language learning information related to the Chinese information, and by Chinese information and above-mentioned position coordinates and additional foreign language
Learning information sends image display to；
（6）Image display receives the Chinese information that data transmission module is sent, and believes Chinese according to above-mentioned position coordinates
Breath is shown on the corresponding position of realtime graphic, while showing additional foreign language learning information, is learnt for user；
User is by each node according to above-mentioned steps（1）-（6）Display correspondence Chinese information and additional foreign language study letter
Breath, after reach home node, and finally navigate to destination from peripheral node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710201983.9A CN107037589B (en) | 2017-03-30 | 2017-03-30 | A kind of scene-type foreign languages translation and learning system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710201983.9A CN107037589B (en) | 2017-03-30 | 2017-03-30 | A kind of scene-type foreign languages translation and learning system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107037589A true CN107037589A (en) | 2017-08-11 |
| CN107037589B CN107037589B (en) | 2019-12-03 |
Family
ID=59533899
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710201983.9A Active CN107037589B (en) | 2017-03-30 | 2017-03-30 | A kind of scene-type foreign languages translation and learning system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107037589B (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107465910A (en) * | 2017-08-17 | 2017-12-12 | 康佳集团股份有限公司 | A kind of combination AR glasses carry out the method and system of AR information real time propelling movements |
| CN108492819A (en) * | 2018-03-30 | 2018-09-04 | 浙江吉利控股集团有限公司 | Language exercise method, apparatus, intelligent vehicle mounted terminal and storage medium |
| CN108508634A (en) * | 2018-05-22 | 2018-09-07 | 深圳倍易通科技有限公司 | A kind of intelligent sound glasses and its intelligent identification Method |
| CN108665744A (en) * | 2018-07-13 | 2018-10-16 | 王洪冬 | A kind of intelligentized English assistant learning system |
| CN108777083A (en) * | 2018-06-25 | 2018-11-09 | 南阳理工学院 | A kind of wear-type English study equipment based on augmented reality |
| CN108877340A (en) * | 2018-07-13 | 2018-11-23 | 李冬兰 | A kind of intelligent English assistant learning system based on augmented reality |
| CN108922274A (en) * | 2018-07-26 | 2018-11-30 | 朱海峰 | A kind of English assistant learning system of multifunctional application |
| CN108984536A (en) * | 2018-07-02 | 2018-12-11 | 北京分音塔科技有限公司 | Shop identifies translator, method, apparatus and storage medium |
| CN109637236A (en) * | 2018-12-28 | 2019-04-16 | 金子桥 | One kind wearing aiding device and method of giving financial aid to students |
| CN109872264A (en) * | 2018-12-11 | 2019-06-11 | 西南石油大学 | Interactive multilingual cultural experiencing system and its interactive approach |
| CN109871743A (en) * | 2018-12-29 | 2019-06-11 | 口碑(上海)信息技术有限公司 | The localization method and device of text data, storage medium, terminal |
| CN110223547A (en) * | 2019-06-24 | 2019-09-10 | 付金龙 | A kind of language learning translator before stage towards K12 |
| CN111402649A (en) * | 2020-05-18 | 2020-07-10 | 中国人民解放军空军勤务学院 | Wireless foreign language learning device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030030911A1 (en) * | 2001-08-13 | 2003-02-13 | Brooks Michael H. | Flight crew emergency vision system |
| CN201259425Y (en) * | 2008-02-27 | 2009-06-17 | 深圳市莱科电子技术有限公司 | A portable device having learning machine function and satellite positioning and navigation function |
| CN104036270A (en) * | 2014-05-28 | 2014-09-10 | 王月杰 | Instant automatic translation device and method |
-
2017
- 2017-03-30 CN CN201710201983.9A patent/CN107037589B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030030911A1 (en) * | 2001-08-13 | 2003-02-13 | Brooks Michael H. | Flight crew emergency vision system |
| CN201259425Y (en) * | 2008-02-27 | 2009-06-17 | 深圳市莱科电子技术有限公司 | A portable device having learning machine function and satellite positioning and navigation function |
| CN104036270A (en) * | 2014-05-28 | 2014-09-10 | 王月杰 | Instant automatic translation device and method |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107465910A (en) * | 2017-08-17 | 2017-12-12 | 康佳集团股份有限公司 | A kind of combination AR glasses carry out the method and system of AR information real time propelling movements |
| CN108492819B (en) * | 2018-03-30 | 2020-07-07 | 浙江吉利控股集团有限公司 | Language practice method and device, intelligent vehicle-mounted terminal and storage medium |
| CN108492819A (en) * | 2018-03-30 | 2018-09-04 | 浙江吉利控股集团有限公司 | Language exercise method, apparatus, intelligent vehicle mounted terminal and storage medium |
| CN108508634A (en) * | 2018-05-22 | 2018-09-07 | 深圳倍易通科技有限公司 | A kind of intelligent sound glasses and its intelligent identification Method |
| CN108777083A (en) * | 2018-06-25 | 2018-11-09 | 南阳理工学院 | A kind of wear-type English study equipment based on augmented reality |
| CN108984536A (en) * | 2018-07-02 | 2018-12-11 | 北京分音塔科技有限公司 | Shop identifies translator, method, apparatus and storage medium |
| CN108665744A (en) * | 2018-07-13 | 2018-10-16 | 王洪冬 | A kind of intelligentized English assistant learning system |
| CN108877340A (en) * | 2018-07-13 | 2018-11-23 | 李冬兰 | A kind of intelligent English assistant learning system based on augmented reality |
| CN108922274A (en) * | 2018-07-26 | 2018-11-30 | 朱海峰 | A kind of English assistant learning system of multifunctional application |
| CN109872264A (en) * | 2018-12-11 | 2019-06-11 | 西南石油大学 | Interactive multilingual cultural experiencing system and its interactive approach |
| CN109637236A (en) * | 2018-12-28 | 2019-04-16 | 金子桥 | One kind wearing aiding device and method of giving financial aid to students |
| CN109871743A (en) * | 2018-12-29 | 2019-06-11 | 口碑(上海)信息技术有限公司 | The localization method and device of text data, storage medium, terminal |
| CN110223547A (en) * | 2019-06-24 | 2019-09-10 | 付金龙 | A kind of language learning translator before stage towards K12 |
| CN111402649A (en) * | 2020-05-18 | 2020-07-10 | 中国人民解放军空军勤务学院 | Wireless foreign language learning device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107037589B (en) | 2019-12-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107037589B (en) | A kind of scene-type foreign languages translation and learning system | |
| CN109067839B (en) | Method and device for pushing tour guide information and creating scenic spot information database | |
| WO2019105040A1 (en) | Intelligent route navigation method and device, server, mobile terminal, and storage medium | |
| US20150127256A1 (en) | Systems, methods, and software for providing wayfinding orientation and wayfinding data to blind travelers | |
| CN107300970A (en) | Virtual reality exchange method and device | |
| CN103971623A (en) | Tour guide mobile terminal and tour guide method | |
| CN107547359A (en) | Tourist attractions information service system based on LBS Yu AR technologies | |
| JP2014093050A (en) | Image display device, image display method, and computer program | |
| CN104219628B (en) | A kind of blind person's information service method and system based on augmented reality and smart mobile phone | |
| JP2017509065A (en) | Vehicle image capture system using different language translations | |
| CN111161101A (en) | Self-help navigation device and method | |
| KR102552857B1 (en) | Subtitle processing method for language education and apparatus thereof | |
| Chandler et al. | Understanding the requirements of geographical data for blind and partially sighted people to make journeys more independently | |
| CN101620814A (en) | Tour guide and navigation method and tour guide and navigation terminal | |
| KR20190107252A (en) | A System of Providing Theme Travel AI Curation Based on AR through Customization Learning of Virtual Character | |
| KR20210060949A (en) | Travel scheduling service apparatus using big data and user preference analysis | |
| WO2020151256A1 (en) | Intelligent browsing method and system applied to cultural tourism | |
| CN107270907A (en) | Tourist attraction information sharing method, route planning method and information sharing system | |
| CN108462732A (en) | Travelling guidance method and device | |
| JP2016200884A (en) | Sightseeing customer invitation system, sightseeing customer invitation method, database for sightseeing customer invitation, information processor, communication terminal device and control method and control program therefor | |
| US11934449B2 (en) | Method and apparatus for processing map information, and storage medium | |
| CN103942991A (en) | Real-world teaching method and system | |
| JP2016011905A (en) | Guide system, guide method, server, and electronic device | |
| CN102214168B (en) | Query and display system and query and display method for providing example sentence accordant with geographic information | |
| CN110365726B (en) | Communication processing method, device, terminal and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |