CN104123552A - Automatic identification translating glasses - Google Patents
Automatic identification translating glasses Download PDFInfo
- Publication number
- CN104123552A CN104123552A CN201310158875.XA CN201310158875A CN104123552A CN 104123552 A CN104123552 A CN 104123552A CN 201310158875 A CN201310158875 A CN 201310158875A CN 104123552 A CN104123552 A CN 104123552A
- Authority
- CN
- China
- Prior art keywords
- glasses
- translation
- image
- display device
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Machine Translation (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a pair of automatic identification translating glasses. The pair of glasses comprises a glasses body as well as cameras, display devices and processing modules loaded on the eyeglasses body. By adopting the automatic identification translating glasses, a fingertip can be identified automatically, a picture of a preset size taking the coordinate of the fingertip as the center is acquired, character identification and translation processing are performed on the picture, and a translation result is displayed through a micro projector, thereby realizing automatic identification and translation of foreign languages. The pair of automatic identification translating glasses can be operated rapidly by a user, is convenient to carry, is high in translating efficiency, and is particularly suitable to be worn during reading foreign language books, looking at the guideboards in travel, and the like.
Description
Technical field
The present invention relates to a kind of electronic translation product, particularly a kind of translation glasses that can automatically identify.
Background technology
At present, concerning people, the chance of contact foreign language word is more and more.No matter be that travel abroad time is recognized guideboard or orders dishes, or when students ' reading foreign language document, always we can run into the new word that some are ignorant of.In the time that needs are understood or are learnt these words, no longer need to browse the dictionary of voluminous work, and only need use the translation dictionary software in computer or mobile phone, by the word of needs translation or sentence input computer, software can be translated automatically.But in using these softwares, also need the process of an input, simultaneously, the word of input must be maybe can inputting with computor-keyboard of being familiar with of reader, such as reader and do not know how this word is inputted in the situation that, the effect that translation software uses will have been had a greatly reduced quality.
Therefore people need to have such device, can by the character translation in data be directly need languages and show user, there is software engineering researchers invent to go out the device that the picture to taking carries out foreign languages translation, publication number is that the Chinese patent of CN101082956B discloses the device and method that carries out foreign languages translation in a kind of handheld device based on picture, this device comprises camera, image gray processing and enclosed region are supplemented processing module, optical character recognition process module and query translation module, camera successively with image gray processing and enclosed region compensation deals module, optical character recognition process module is connected with query translation module.The method comprises an enclosed region in foreign language Word message picture, the selected picture that shooting need to translate, this enclosed region information is carried out to gray processing processing successively rubs and does and enclosed region is supplemented and processed operation, carries out alphabetic character identification and query translation processing, shows translation result.
Application publication number is that the Chinese patent literature of CN101873415A discloses a kind of cam device and method with interpretative function, this device comprises character inputting device, word identification module and character translation module, character inputting device is the USB camera based on CMOS sensitive chip; Word identification module comprises image-capture unit, image layout analytic unit, characters matching analytic unit and word dictionary, and word identification module and character translation module are arranged in PC host computer, and camera is connected with PC host computer by USB connecting line.
But this kind equipment all needs first to obtain picture, then picture is carried out to entire chapter translation or some word in picture is particularly pointed out after translate, process complexity, and operation time generally needs both hands to carry out, and can be very inconvenient when mountain-climbing or both hands cannot be vacateed out of doors.
Summary of the invention
The invention provides a kind of translation glasses that can automatically identify, solve existing equipment and need to first obtain picture, then picture is carried out to entire chapter translation or some word in picture is particularly pointed out after translate, process complexity, and when operation, generally need both hands to carry out, problem that can be very inconvenient when mountain-climbing or both hands cannot be vacateed out of doors.
The translation glasses that can automatically identify, comprises glasses body and is arranged on camera, display device and the processing module on this glasses body;
While carrying out identification translation automatically, user's hand that processing module is obtained for camera and the image information of hand periphery are handled as follows:
(1) in described image information, determine finger tip coordinate;
(2), taking finger tip coordinate as benchmark, obtain chosen area at described image information according to preset range;
(3) carry out character recognition and translation processing for chosen area, and result is exported to user by display device.
In above execution step, only need to be to pointing out to need with finger the word of translation, the present invention can identify the word that needs translation automatically, and translate and show, in process without again picture being edited and refered in particular to, compared with existing equipment, use is more simple and convenient, and translation speed is faster.
In described step (2), described finger tip coordinate is in hand profile coordinate, apart from hand profile center of gravity coordinate farthest, therefore, can be by identifying hand profile, and by calculating finger tip coordinate.
Preferably, in described step (1), determine that the step of finger tip coordinate comprises:
A) in described image information, obtain each concave vertex on hand profile and this hand profile;
B) opponent's contouring boundary pixel carries out integral and calculating, obtains the center of gravity of hand profile institute enclosing region;
C) calculate the physical distance of described center of gravity to each concave vertex, the coordinate of the concave vertex that physical distance is the longest is as finger tip coordinate.
In order to increase the science and technology sense of the translation glasses that the present invention can identify automatically, utilize fuzzy described image information picture except described chosen area and the image information after fuzzy is replaced to described image information, and replacement process is exported to user by described display device, allow user experience the visual effect that described chosen area is highlighted, can increase the sensory effects of product, improve the science and technology sense of product.
Preferably, in described step (1), also comprise: described image information is exported to user with reference to image by display device as first.
Described step also comprises in (2): the part except chosen area in described image information is carried out to Fuzzy Processing and obtain second with reference to image, and this second is exported to user to replace first with reference to image with reference to image by display device.
For user can be contrasted the word of the needs translation in translation result and described specific region, improve identification, and be more convenient for study and analysis.
Preferably, in described step (3), the outgoing position of translation result in display device and the outgoing position non-overlapping copies of the second chosen area with reference to image.
Described display device can be selected some common on the market image display devices, and for example micro projector is simple in structure, competitively priced, and display effect is stable, and for example liquid crystal display again, can make image show more clear.
Preferably, described display device is micro projector or liquid crystal display.
Beneficial effect of the present invention:
The translation glasses that can automatically identify of the present invention, because it can be by identifying finger tip automatically, obtain the picture of the pre-sizing centered by finger tip coordinate, and picture is carried out to character recognition and translation processing, finally by micro projector, translation result is presented at out, thereby realize automatic Identification foreign language and translated, not only user is swift to operate, easy to carry, and translation efficiency is higher, be particularly suitable at the foreign books of leafing through, out on tours is used while seeing the situations such as guideboard.
Brief description of the drawings
Fig. 1 is the perspective view of glasses of the present invention.
Fig. 2 be camera of the present invention obtain first with reference to image.
Fig. 3 be that in the present invention, Fuzzy Processing obtains second with reference to image.
Fig. 4 be in the present invention, loaded translation result second with reference to image.
Embodiment
As shown in Figure 1, the present embodiment comprises glasses body 4, and is carried in camera 2, micro projector 3 and processing module 1 on glasses body.
In use, obtain image information by camera 2, pass to processing module 1 and carry out image processing and character translation, and the result obtaining is shown to user by micro projector 3.
The present embodiment carries out foreign language when automatically identifying and translating, comprises the following steps:
(1) by camera obtain user's hand and hand periphery first with reference to image;
(2) export to user with reference to image by micro projector 3 by first;
(3) by processing module 1, determine finger tip coordinate 11 first in reference to image, step comprises:
A) utilize the profile detection algorithm in OpenCV can obtain concave vertex and protruding defect, thereby obtain the coordinate (wherein comprising finger tip coordinate 11) of a series of concave vertexs and protruding defect;
B) in the concave vertex obtaining and protruding defect, filter out be on hand profile concave vertex and the coordinate of protruding defect, first in opencv, apply sobel operator and obtain the x direction of each pixel, the gradient of y direction; Obtaining the maximal value of each point gradient, is the direction of greyscale transformation maximum on gradient direction, as long as on this line, and the relatively center neighborhood of a point of gradient image; If in gradient image, central point is greater than the value of two neighborhoods, is marginal point, if be less than the value of neighborhood, is non-marginal point; If gradient is maximal value in neighborhood, and be greater than high threshold value (defining in canny algorithm), determine it is marginal point, then need look for the point that meets low threshold value in neighborhood as center; If neighborhood point meets its maximum of gradients, and be greater than low threshold value (defining in canny algorithm), determine that this neighborhood point is marginal point; And this step of recurrence, filter out the concave vertex of hand profile and the coordinate of protruding defect.Wherein: judge that whether profile is protruding, can use cvCheckContourConvexity function; Obtain the concave vertex of profile, can use cvConvexHull2 function, what return is the sequence that comprises concave vertex; Obtain the protruding defect of profile, can use cvConvexityDefects function; The concave vertex of profile and protruding defect are for describing the profile of object.
C) by the sell barycentric coordinates of contouring institute enclosing region of the integral and calculating of opponent's contouring boundary pixel;
D) calculate the physical distance of center of gravity to each concave vertex, the coordinate of the concave vertex that physical distance is the longest is as finger tip coordinate 11.
(4) centered by finger tip coordinate 11, preset range is 130 × 70 pixel sizes, obtains chosen area 12 first on reference to image;
(5) carry out Fuzzy Processing by first with reference to the part except chosen area 12 in image information and obtain second with reference to image, and this second is exported to user to replace first with reference to image with reference to image by display device.
(6) in processing module 1, chosen area 12 is carried out to character recognition and translation processing, obtain translation result 13.By showing that to user second replaces first with reference to image with reference to image, allow user experience the visual effect that described chosen area 12 is highlighted, can increase the sensory effects of product, improve the science and technology sense of product.
(7) by processing module 1, translation result 13 is loaded into second with reference to image, wherein translation result 13 is positioned at the lower right of chosen area 12, and not overlapping with translation result 13.Can allow user contrast the word of the needs translation in translation result and described specific region, improve identification, and be more convenient for study and analysis.
In the present embodiment, obtain first with reference to image by camera 2, because processing module 1 wherein can be identified finger tip automatically, obtain the chosen area 12 centered by finger tip coordinate first in reference to image, and chosen area 12 is carried out to character recognition and translation processing, finally by micro projector 3, translation result is presented at out, thereby realize automatic Identification foreign language and translated, not only user is swift to operate, easy to carry, and translation efficiency is higher, be particularly suitable at the foreign books of leafing through, out on tours is used while seeing the situations such as guideboard.
Claims (6)
1. the glasses that can automatically identify translation, is characterized in that, comprise glasses body and are arranged on camera, display device and the processing module on this glasses body;
While carrying out identification translation automatically, user's hand that processing module is obtained for camera and the image information of hand periphery are handled as follows:
(1) in described image information, determine finger tip coordinate;
(2), taking finger tip coordinate as benchmark, obtain chosen area at described image information according to preset range;
(3) carry out character recognition and translation processing for chosen area, and result is passed through to display device
Export to user.
2. the glasses that can automatically identify translation as claimed in claim 1, is characterized in that, in described step (1), determine that the step of finger tip coordinate comprises:
A) in described image information, obtain each concave vertex on hand profile and this hand profile;
B) opponent's contouring boundary pixel carries out integral and calculating, obtains the center of gravity of hand profile institute enclosing region;
C) calculate the physical distance of described center of gravity to each concave vertex, the coordinate of the concave vertex that physical distance is the longest is as finger tip coordinate.
3. the glasses that can automatically identify translation as claimed in claim 1, is characterized in that, described step also comprises in (1): described image information is exported to user with reference to image by display device as first.
4. the glasses that can automatically identify translation as claimed in claim 3, it is characterized in that, described step also comprises in (2): the part except chosen area in described image information is carried out to Fuzzy Processing and obtain second with reference to image, and this second is exported to user to replace first with reference to image with reference to image by display device.
5. the glasses that can automatically identify translation as claimed in claim 4, is characterized in that, in described step (3), and the outgoing position of translation result in display device and the outgoing position non-overlapping copies of the second chosen area with reference to image.
6. the glasses that can automatically identify translation as claimed in claim 1, is characterized in that, described display device is micro projector or liquid crystal display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310158875.XA CN104123552B (en) | 2013-04-28 | 2013-04-28 | It is a kind of can be with the translation glasses of automatic identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310158875.XA CN104123552B (en) | 2013-04-28 | 2013-04-28 | It is a kind of can be with the translation glasses of automatic identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104123552A true CN104123552A (en) | 2014-10-29 |
| CN104123552B CN104123552B (en) | 2017-08-22 |
Family
ID=51768957
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310158875.XA Expired - Fee Related CN104123552B (en) | 2013-04-28 | 2013-04-28 | It is a kind of can be with the translation glasses of automatic identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104123552B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117390A (en) * | 2015-08-26 | 2015-12-02 | 广西小草信息产业有限责任公司 | Screen capture-based translation method and system |
| CN107124553A (en) * | 2017-05-27 | 2017-09-01 | 珠海市魅族科技有限公司 | Filming control method and device, computer installation and readable storage medium storing program for executing |
| CN108415558A (en) * | 2018-02-02 | 2018-08-17 | 上海徕尼智能科技有限公司 | Intelligent glasses and intelligent search method |
| CN111428721A (en) * | 2019-01-10 | 2020-07-17 | 北京字节跳动网络技术有限公司 | Method, device and equipment for determining word paraphrases and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838115A (en) * | 2005-03-22 | 2006-09-27 | 富士施乐株式会社 | Translation device, translation method, and storage medium |
| US20100185432A1 (en) * | 2009-01-22 | 2010-07-22 | Voice Muffler Corporation | Headset Wireless Noise Reduced Device for Language Translation |
| CN102693220A (en) * | 2011-03-22 | 2012-09-26 | 吴铭远 | Communication device for multi-language translation system |
| CN102798986A (en) * | 2012-06-13 | 2012-11-28 | 南京物联传感技术有限公司 | Intelligent glasses and working method thereof |
| CN102799318A (en) * | 2012-08-13 | 2012-11-28 | 深圳先进技术研究院 | Human-machine interaction method and system based on binocular stereoscopic vision |
-
2013
- 2013-04-28 CN CN201310158875.XA patent/CN104123552B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1838115A (en) * | 2005-03-22 | 2006-09-27 | 富士施乐株式会社 | Translation device, translation method, and storage medium |
| US20100185432A1 (en) * | 2009-01-22 | 2010-07-22 | Voice Muffler Corporation | Headset Wireless Noise Reduced Device for Language Translation |
| CN102693220A (en) * | 2011-03-22 | 2012-09-26 | 吴铭远 | Communication device for multi-language translation system |
| CN102798986A (en) * | 2012-06-13 | 2012-11-28 | 南京物联传感技术有限公司 | Intelligent glasses and working method thereof |
| CN102799318A (en) * | 2012-08-13 | 2012-11-28 | 深圳先进技术研究院 | Human-machine interaction method and system based on binocular stereoscopic vision |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117390A (en) * | 2015-08-26 | 2015-12-02 | 广西小草信息产业有限责任公司 | Screen capture-based translation method and system |
| CN107124553A (en) * | 2017-05-27 | 2017-09-01 | 珠海市魅族科技有限公司 | Filming control method and device, computer installation and readable storage medium storing program for executing |
| CN108415558A (en) * | 2018-02-02 | 2018-08-17 | 上海徕尼智能科技有限公司 | Intelligent glasses and intelligent search method |
| CN111428721A (en) * | 2019-01-10 | 2020-07-17 | 北京字节跳动网络技术有限公司 | Method, device and equipment for determining word paraphrases and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104123552B (en) | 2017-08-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20240127302A1 (en) | Document optical character recognition | |
| CN110032271B (en) | Contrast adjusting device and method, virtual reality equipment and storage medium | |
| JP7167279B2 (en) | Method for processing multiple decodable indicia | |
| JP6256497B2 (en) | Information processing system, information processing apparatus, control method, and program | |
| US9857971B2 (en) | System and method for receiving user input and program storage medium thereof | |
| Mehrubeoglu et al. | Real-time eye tracking using a smart camera | |
| CN108351828A (en) | Technology for device-independent automatic application test | |
| CN105425967A (en) | Sight tracking and human eye area-of-interest positioning system | |
| CN104123552A (en) | Automatic identification translating glasses | |
| US20190080195A1 (en) | Image recognition method and apparatus, device and non-volatile computer storage medium | |
| Park et al. | Achieving real-time sign language translation using a smartphone's true depth images | |
| CN205563453U (en) | Sight is tracked and people's eye zone location system interested | |
| US9569661B2 (en) | Apparatus and method for neck and shoulder landmark detection | |
| CN111680670B (en) | Cross-mode human head detection method and device | |
| KR102303206B1 (en) | Method and apparatus for recognizing object of image in electronic device | |
| US20150054731A1 (en) | Apparatus and method for providing information by recognizing user's intentions | |
| CN112365607A (en) | Augmented reality AR interaction method, device, equipment and storage medium | |
| CN105308535A (en) | Hands-free assistance | |
| CN111753715B (en) | Method and device for shooting test questions in click-to-read scene, electronic equipment and storage medium | |
| Prakruthi et al. | Application of convolutional neural networks in mobile devices for inferring readings from medical apparatus | |
| EP2733641A2 (en) | Mobile computer configured to read multiple decodable indicia | |
| JP6601480B2 (en) | Information processing system, information processing apparatus, control method, and program | |
| Yang et al. | TapSix: A Palm-Worn Glove with a Low-Cost Camera Sensor that Turns a Tactile Surface into a Six-Key Chorded Keyboard by Detection Finger Taps | |
| JP2013200654A (en) | Display control device, display control method, information display system, and program | |
| CN114115532B (en) | AR labeling method and system based on display content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170822 Termination date: 20190428 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |