AU2012256465B2 - Apparatus for translating written text in real time - Google Patents

Apparatus for translating written text in real time Download PDF

Info

Publication number
AU2012256465B2
AU2012256465B2 AU2012256465A AU2012256465A AU2012256465B2 AU 2012256465 B2 AU2012256465 B2 AU 2012256465B2 AU 2012256465 A AU2012256465 A AU 2012256465A AU 2012256465 A AU2012256465 A AU 2012256465A AU 2012256465 B2 AU2012256465 B2 AU 2012256465B2
Authority
AU
Australia
Prior art keywords
screen
spectacles
text
language
stated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2012256465A
Other versions
AU2012256465A1 (en
Inventor
Per Schaanning
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TRUSTPER AS
Original Assignee
TRUSTPER AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TRUSTPER AS filed Critical TRUSTPER AS
Publication of AU2012256465A1 publication Critical patent/AU2012256465A1/en
Application granted granted Critical
Publication of AU2012256465B2 publication Critical patent/AU2012256465B2/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02CSPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
    • G02C11/00Non-optical adjuncts; Attachment thereof
    • G02C11/10Electronic devices other than hearing aids
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/58Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0149Head-up displays characterised by mechanical features
    • G02B2027/0154Head-up displays characterised by mechanical features with movable elements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Otolaryngology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Machine Translation (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)

Abstract

Apparatus for translating written text from one language to a different language, said apparatus consists of a camera and a screen and are further characterized by that said apparatus can be mounted to a pair of spectacles and can translate text in real time.

Description

1 APPARATUS FOR TRANSLATING WRITTEN TEXT IN REAL TIME Technical Field The present invention regards a device and a method to help people read information in a foreign language, more specifically it regards an apparatus that 5 converts written information from one language to another in real time. Background of the invention Millions of people worldwide travel each year to other countries either for business or for vacation purposes. One of the problems with travels is that all information usually is printed in the language of the respective country. 10 If the individual is not able to understand that language, it is difficult to understand not only signs and boards, but also to read newspapers or other forms of printed or written information. Several solutions are available for automatically converting one language into 15 another. On the internet there are several sites that have a list of languages which they can translate to and from. The problem with these sites is that they are dependent on the internet and that the user has to type, or paste in the information into the page to get it translated. 20 Other solutions is described in e.g. US 2008/0273796 Al where there is shown a camera with the possibility to translate text on a pictures taken by the camera. Further application US 2009/0198486 Al describes a similar solution to the one mentioned above except that the picture is taken with a camera on a mobile phone. 25 Application US 2008/0243473 Al describes a system where a user has a pair of spectacles with an incorporated camera that can take a picture of e.g. a signboard and translate the text on the signboard and display it on the spectacles again in order to make it readable for the user. Alternatively the translated text can be 30 played of as an audio segment. All these solutions are helpful for travelers that do not understand the local language. However all these solutions are made for translating the text on a signboard or similar, which means that they are only suitable to translate a few 2 words or a small sentence at a time. Further they need to use internet to translate the language into another. It is therefore an object of the present invention, as it is stated in the set of claims, to solve the problems mentioned above. It is an additional or alternative object of 5 the present invention to at least provide the public with a useful choice. Summary of the invention In a first aspect, the invention is said to consist in an apparatus for translating written text in real time from one language to a different language, said apparatus is attached to an earpieces of a set of spectacles and comprises a camera, a screen, 10 a computer, further the apparatus is attached using a clip, from this clip it is extended a telescopic arm forwards to the front of the spectacles, to this telescopic arm there is attached a horizontal screen, the screen consists of two parts, one lower part and one upper part, the lower part is the screen where the translated text is displayed, the upper part is a protective cover that is hinged to the top of 15 the lower part, characterized in that a slot is created between the lower part and the upper part, on the top of one side of the lower part of the screen, there is attached a camera that moves along the top of the screen. The term 'comprising' as used in this specification and claims means 'consisting at least in part of'. When interpreting statements in this specification and claims 20 which include the term 'comprising', other features besides the features prefaced by this term in each statement can also be present. Related terms such as 'comprise' and 'comprised' are to be interpreted in similar manner. In another aspect, the invention is said to consist in an apparatus mounted on a pair of spectacles that has the ability to translate text automatically as the user 25 reads a newspaper or other forms of printed information. The image is captured by a camera mounted on the spectacles and the text is translated and shown on a screen mounted in front of the spectacles. The text is captured by the camera and translated in real time into the language of choice and can be read on the screen placed in front of the spectacles. The 30 apparatus can be removed from the spectacles after use. Brief description of the drawings 3 Figure 1 show an embodiment of the present invention where the apparatus is connected to a pair of spectacles. Figure 2 is an image of a part of the apparatus where the user can choose the origin language and the destination language. 5 Figure 3 shows the invention in use when reading a book. Figure 4 shows the invention in use when reading a newspaper Figure 5 shows that the present invention can make use of alternative energy sources in the form of solar cells in order to deliver energy to operate the invention, or to charge a battery. 10 Figure 6 is a perspective drawing of an alternative embodiment of the present invention, here the upper part of the screen is vertical and the lower part of the screen is horizontal. Detailed description Fig. 1 is a perspective view of an embodiment of the present invention. It is shown 15 a pair of spectacles 100. The apparatus is attached to one of the earpieces 101 of the spectacles 100 using a clip 102. From the clip 102 it is extended a telescopic arm 108 forwards to the front of the spectacles 100. This telescopic arm 108 makes it possible to custom fit the reading distance between the translation apparatus and the spectacles 100 and the distance can be adjusted using e.g. an adjustment 20 screw 103 and a hinged joint 107. This telescopic arm 108 can be adjusted not only in and out but also up and down. To this telescopic arm 108 there is attached a horizontal screen spanning the width of the spectacles 100. The screen consists of two parts, one lower part 105 and one upper part 104. The lower part 105 is the screen where the translated text is 25 displayed. The upper part 104 is a protective cover that is hinged to the top of the lower part 105. The upper part 104 can be flipped up and down. The upper part 104 is constructed to protect the lower part 105 when the apparatus is not in use. On the top of one side of the lower part 105 of the screen, there is attached a 30 camera 106 that has the ability to move along the screen 105. This camera 106 records a specific line of text, sends it via a cable to a computer which translates the text into the chosen language. The computer can be part of the apparatus 4 attached to the spectacles 100 or it can be located on another part of the body. This computer has a database with a set of languages it can translate to and from. Figure 2 is a display of the control panel 201, on the computer, that lets' the user 5 choose the origin language and the destination language. Further the control panel can start and stop the translation of the text. Further it is possible to adjust the font size and font type from this panel. Figure 3 shows the present invention in use when reading a book. Here it can be 10 seen that the screen 105 is adjusted in order to fit the individual user. The user places the top of the screen 105 level with the text that is to be translated. Thereafter the camera 106 records the text written on the line that is to be translated. The recorded image is than translated and the text is displayed on the screen 105. 15 The method of using the present invention is to clip on the apparatus to one of the earpieces 108 of the spectacles 100. The user then turns on the apparatus and sets the language to translate from and the language to translate to. Thereafter the user adjusts the height of the screen so that it is in a comfortable reading distance and 20 height. Thereafter the user holds the top of the screen 105 level with the line he or she wants to translate. This is done by adjusting the tilt of the head. The camera 106 than records a specific line, sends it to the computer, which translates it and displays it on the screen 105. When the user has finished reading the line he or she redoes the procedure for the next line and so on until he or she is finished reading. 25 After the user is finished he or she turns off the apparatus and takes it off the earpiece 108 of the spectacle 100. Figure 4 shows an example of the present invention where the protective cover 104 of the screen 105 is raised to its upper position. The protective cover 104 is hinged 30 on each end of the top of the screen 105. The protective cover 104 can rotate freely up and down. Further it is transparent and protects the screen 105 when it is not in use. The protective cover 104 is transparent in order to make it easier to keep track of which line the reader is translating. 35 When the protective cover 104 is raised all the way up, a slot 401 is created between the upper end of the screen 105 and the protective cover 104. Through this slot 401 the user can focus on the line of text that he or she wants to translate.
5 In figure 5 the apparatus is supplied with solar panels 503 in order to supply the apparatus with energy. Here it is shown that a panel 503 can be located on the back side of the screen. Further it can be added additional panels attached to the 5 earpieces 108 of the spectacles 100. It can be attached by either hanging the panels to the earpieces with hooks 502 or by attaching them with a clamp 501. When the apparatus is not in use it can be stored in a casing. 10 Further the text that is translated can either be stored in a short term memory and deleted automatically or it can be stored long term at the users' request. Figure 6 is a perspective view of an alternative embodiment of the present invention. In this embodiment the upper 602 and lower 601 part of the screen can 15 be unhinged from each other in either end. The upper screen 602 can be lifted in to vertical position. This is in order to scan text written vertically. The text is translated and shown on the lower screen 601 which is placed horizontally. Further it could be possible to slide the upper screen 602 back and forth on top of the lower screen 601. This is in order to make the lineup of the upper screen 602 20 compared to the lower screen 601 during translation of text written vertically easier.

Claims (7)

1. Apparatus for translating written text in real time from one language to a different language, said apparatus is attached to an earpieces of a set of spectacles and comprises a camera, a screen, a computer, further the apparatus is attached 5 using a clip, from this clip it is extended a telescopic arm forwards to the front of the spectacles, to this telescopic arm there is attached a horizontal screen, the screen consists of two parts, one lower part and one upper part, the lower part is the screen where the translated text is displayed, the upper part is a protective cover that is hinged to the top of the lower part, wherein a slot is created between 10 the lower part and the upper part, on the top of one side of the lower part of the screen, there is attached a camera that moves along the top of the screen.
2. Apparatus as stated in claim 1 wherein said slot allows the user to focus on the line of text that he or she wants to translate.
3. Apparatus as stated in claim 1 wherein said horizontal screen spans the 15 width of said spectacles.
4. Apparatus as stated in claim 1 wherein said screen can be adjusted horizontally, vertically, distance to spectacles and tilt.
5. Apparatus as stated in claim 1 wherein said apparatus consists of a unit with the ability to choose origin language and destination language and a memory for 20 storage of translated text.
6. Apparatus as stated in claim 1 wherein said apparatus can be solar powered.
7. Apparatus as stated in claim 1 when the apparatus is not in use it can be stored in a casing.
AU2012256465A 2011-05-19 2012-05-21 Apparatus for translating written text in real time Ceased AU2012256465B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
NO20110738 2011-05-19
NO20110738A NO333847B1 (en) 2011-05-19 2011-05-19 language Brille
PCT/NO2012/050094 WO2012158047A1 (en) 2011-05-19 2012-05-21 Apparatus for translating written text in real time

Publications (2)

Publication Number Publication Date
AU2012256465A1 AU2012256465A1 (en) 2013-12-12
AU2012256465B2 true AU2012256465B2 (en) 2015-05-14

Family

ID=46489453

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2012256465A Ceased AU2012256465B2 (en) 2011-05-19 2012-05-21 Apparatus for translating written text in real time

Country Status (4)

Country Link
EP (1) EP2710492A1 (en)
AU (1) AU2012256465B2 (en)
NO (1) NO333847B1 (en)
WO (1) WO2012158047A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9519640B2 (en) * 2012-05-04 2016-12-13 Microsoft Technology Licensing, Llc Intelligent translations in personal see through display
US9019174B2 (en) 2012-10-31 2015-04-28 Microsoft Technology Licensing, Llc Wearable emotion detection and feedback system
CN103294194B (en) * 2013-04-28 2016-12-28 小米科技有限责任公司 A kind of interpretation method based on eye tracking and system
US9239833B2 (en) 2013-11-08 2016-01-19 Google Inc. Presenting translations of text depicted in images
US9547644B2 (en) 2013-11-08 2017-01-17 Google Inc. Presenting translations of text depicted in images
US20170277257A1 (en) * 2016-03-23 2017-09-28 Jeffrey Ota Gaze-based sound selection

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040210444A1 (en) * 2003-04-17 2004-10-21 International Business Machines Corporation System and method for translating languages using portable display device
JP2007280164A (en) * 2006-04-10 2007-10-25 Nikon Corp Electronic dictionary
US20080198324A1 (en) * 2007-01-02 2008-08-21 Fuziak Robert J Eyeglasses having integrated telescoping video camera and video display
US20100141892A1 (en) * 2005-01-10 2010-06-10 Renaud Moliton Display for mounting on a pair of eyeglasses

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6819549B1 (en) * 2002-11-14 2004-11-16 Garmin Ltd. Hinged protective cover for portable electronic device
US8515728B2 (en) 2007-03-29 2013-08-20 Microsoft Corporation Language translation of visual and audio input
US7912289B2 (en) 2007-05-01 2011-03-22 Microsoft Corporation Image text replacement
US20090198486A1 (en) 2008-02-05 2009-08-06 National Tsing Hua University Handheld electronic apparatus with translation function and translation method using the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040210444A1 (en) * 2003-04-17 2004-10-21 International Business Machines Corporation System and method for translating languages using portable display device
US20100141892A1 (en) * 2005-01-10 2010-06-10 Renaud Moliton Display for mounting on a pair of eyeglasses
JP2007280164A (en) * 2006-04-10 2007-10-25 Nikon Corp Electronic dictionary
US20080198324A1 (en) * 2007-01-02 2008-08-21 Fuziak Robert J Eyeglasses having integrated telescoping video camera and video display

Also Published As

Publication number Publication date
WO2012158047A1 (en) 2012-11-22
NO333847B1 (en) 2013-09-30
AU2012256465A1 (en) 2013-12-12
NO20110738A1 (en) 2012-11-20
EP2710492A1 (en) 2014-03-26

Similar Documents

Publication Publication Date Title
AU2012256465B2 (en) Apparatus for translating written text in real time
US7825949B2 (en) Closed circuit video magnification system
CN204066264U (en) A kind of portable self photographing certificates handling all-in-one
US7903878B2 (en) Capturing and presenting text during optical character recognition
CN103763431A (en) Mobile terminal with wearable device and wearable device thereof
US20120290304A1 (en) Electronic Holder for Reading Books
CN104921523A (en) Comprehensive mirror
KR102139046B1 (en) Portable Reading Assistant Apparatus for Visually impaired using smart phone
CN213786546U (en) Scientific and technological information consultation service display device
CN214279613U (en) Cerebral apoplexy screening device
CN209312051U (en) A kind of account management intelligent terminal
CN203692860U (en) Multimedia teaching desk with lecture reflection prompting device
CN108922259B (en) Russian translation teaching interactive two-way teaching aid
CN207123955U (en) A kind of numerical control flash machine
CN205405044U (en) Simple projector
CN201029595Y (en) Vision aids for low-sight persons to read and write
CN212276605U (en) A multimode english teaching device for english teaching
Presley An introduction to access technology for people with ocular albinism
CN205067860U (en) Portable screen amplification device
CN211232500U (en) Desk lamp
CN214098729U (en) Computer-aided multifunctional teaching device
KR101406384B1 (en) Reading desk for connection and separation of display
CN214548047U (en) Portable reading and writing board
CN211529322U (en) Big data experiment comprehensive teaching system device
CN210804883U (en) Graphic frame for Chinese teaching

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired