WO2012158047A1 - Apparatus for translating written text in real time - Google Patents

Apparatus for translating written text in real time Download PDF

Info

Publication number
WO2012158047A1
WO2012158047A1 PCT/NO2012/050094 NO2012050094W WO2012158047A1 WO 2012158047 A1 WO2012158047 A1 WO 2012158047A1 NO 2012050094 W NO2012050094 W NO 2012050094W WO 2012158047 A1 WO2012158047 A1 WO 2012158047A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
stated
spectacles
language
text
Prior art date
Application number
PCT/NO2012/050094
Other languages
French (fr)
Inventor
Per SCAANNING
Original Assignee
Trustper As
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Trustper As filed Critical Trustper As
Priority to AU2012256465A priority Critical patent/AU2012256465B2/en
Priority to EP12733537.0A priority patent/EP2710492A1/en
Publication of WO2012158047A1 publication Critical patent/WO2012158047A1/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02CSPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
    • G02C11/00Non-optical adjuncts; Attachment thereof
    • G02C11/10Electronic devices other than hearing aids
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/40Processing or translation of natural language
    • G06F40/58Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0149Head-up displays characterised by mechanical features
    • G02B2027/0154Head-up displays characterised by mechanical features with movable elements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Definitions

  • the present invention regards a device and a method to help people read information in a foreign language, more specifically it regards an apparatus that converts written information from one language to another in real time.
  • the text is captured by the camera and translated in real time into the language of choice and can be read on the screen placed in front of the spectacles.
  • the apparatus can be removed from the spectacles after use.
  • Figure 1 show an embodiment of the present invention where the apparatus is connected to a pair of spectacles.
  • Figure 2 is an image of a part of the apparatus where the user can choose the origin language and the destination language.
  • Figure 3 shows the invention in use when reading a book.
  • Figure 4 shows the invention in use when reading a newspaper
  • Figure 5 shows that the present invention can make use of alternative energy sources in the form of solar cells in order to deliver energy to operate the invention, or to charge a battery.
  • Figure 6 is a perspective drawing of an alternative embodiment of the present invention, here the upper part of the screen is vertical and the lower part of the screen is horizontal.
  • Fig. 1 is a perspective view of an embodiment of the present invention. It is shown a pair of spectacles 100.
  • the apparatus is attached to one of the earpieces 101 of the spectacles 100 using a clip 102. From the clip 102 it is extended a telescopic arm 108 forwards to the front of the spectacles 100.
  • This telescopic arm 108 makes it possible to custom fit the reading distance between the translation apparatus and the spectacles 100 and the distance can be adjusted using e.g . an adjustment screw 103 and a hinged joint 107.
  • This telescopic arm 108 can be adjusted not only in and out but also up and down.
  • the screen consists of two parts, one lower part 105 and one upper part 104.
  • the lower part 105 is the screen where the translated text, is displayed.
  • the upper part 104 is a protective cover that is hinged to the top of the lower part 105.
  • the upper part 104 can be flipped up and down,
  • the upper part 104 is constructed to protect the lower part 105 when the apparatus is not in use.
  • a camera 106 On the top of one side of the lower part 105 of the screen, there is attached a camera 106 that has the ability to move along the screen 105.
  • This camera 106 records a specific line of text, sends it via a cable to a computer which translates the text into the chosen language.
  • the computer can be part of the apparatus attached to the spectacles 100 or it can be located on another part of the body.
  • This computer has a database with a set of languages it can translate to and from.
  • Figure 2 is a display of the control panel 201, on the computer, that lets' the user choose the origin language and the destination language. Further the control panel can start and stop the translation of the text. Further it is possible to adjust the font size and font type from this panel.
  • Figure 3 shows the present invention in use when reading a book.
  • the screen 105 is adjusted in order to fit the individual user.
  • the user places the top of t he screen 105 level with the text that is to be translated .
  • the camera 106 records the text written on the line that is to be translated.
  • the recorded image is than translated and the text is displayed on the screen 105.
  • the method of using the present invention is to clip on the apparatus to one of the earpieces 108 of the spectacles 100.
  • the user then turns on the apparatus and sets the language to translate from and the language to translate to. Thereafter the user adjusts the height of the screen so that it is in a comfortable reading distance and height. Thereafter the user holds the top of the screen 105 level with the line he or she wants to translate. This is done by adjusting the tilt of the head.
  • the camera 106 than records a specific line, sends it to the computer, which translates it and displays it on the screen 105, When the user has finished reading the line he or she redoes the procedure for the next line and so on until he or she is finished reading.
  • Figure 4 shows an example of the present invention where the protective cover 104 of the screen 105 is raised to its upper position.
  • the protective cover 104 is hinged on each end of the top of the screen 105.
  • the protective cover 104 can rotate freeiy up and down . Further it is transparent and protects the screen 105 when it is not in use.
  • the protective cover 104 is transparent in order to make it easier to keep track of which iine the reader is translating .
  • a slot 401 is created between the upper end of the screen 105 and the protective cover 104. Through this slot 401 the user can focus on the line of text that he or she wants to translate.
  • the apparatus is supplied with solar panels 503 in order to supply the apparatus with energy.
  • a pane! 503 can be located on the back side of the screen. Further it can be added additional panels attached to the earpieces 108 of the spectacles 100. It can be attached by either hanging the panels to the earpieces with hooks 502 or by attaching them with a clamp 501. When the apparatus is not in use it can be stored in a casing .
  • Figure 6 is a perspective view of an alternative embodiment of the present invention.
  • the upper 602 and lower 601 part of the screen can be unhinged from each other in either end .
  • the upper screen 602 can be lifted in to vertical position. This is in order to scan text written vertically.
  • the text is translated and shown on the lower screen 601 which is placed horizontally.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Theoretical Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Otolaryngology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Machine Translation (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)

Abstract

Apparatus for translating written text from one language to a different language, said apparatus consists of a camera and a screen and are further characterized by that said apparatus can be mounted to a pair of spectacles and can translate text in real time.

Description

APPARATUS FOR TIRANSLATINGs WRITTEN TEXT IN REAL TIME
Technical Field
The present invention regards a device and a method to help people read information in a foreign language, more specifically it regards an apparatus that converts written information from one language to another in real time.
Background of the invention
Millions of people worldwide travel each year to other countries either for business or for vacation purposes. One of the problems with travels is that ail information usually is printed in the language of the respective country,
If the individual is not able to understand that language, it is difficult to understand not only signs and boards, but also to read newspapers or other forms of printed or written information.
Several solutions are available for automatically converting one language into another. On the internet there are several sites that have a list of languages which they can translate to and from. The problem with these sites is that they are dependent on the internet and that the user has to type, or paste in the information into the page to get it translated. Other solutions is described in e.g . US 2008/0273796 Al where there is shown a camera with the possibility to translate text on a pictures taken by the camera .
Further application US 2009/0198486 Al describes a similar solution to the one mentioned above except that the picture is taken with a camera on a mobile phone.
Application US 2008/0243473 Al describes a system where a user has a pair of spectacles with an incorporated camera that can take a picture of e.g . a signboard and translate the text on the signboard and display it on the spectacles again in order to make it readable for the user. Alternatively the translated text can be played of as an audio segment.
All these solutions are helpful for travelers that do not understand the local language. However all these solutions are made for translating the text on a signboard or similar, which means that they are only suitable to translate a few words or a small sentence at a time. Further they need to use internet to translate the language into another.
Summary of the invention
It is therefore an object of the present invention, as it is stated in the set of claims, to solve the problems mentioned above.
This is done with an apparatus mounted on a pair of spectacles that has the ability to translate text automatically as the user reads a newspaper or other forms of printed information. The image is captured by a camera mounted on the spectacles and the text is translated and shown on a screen mounted in front of the
spectacles.
The text is captured by the camera and translated in real time into the language of choice and can be read on the screen placed in front of the spectacles. The apparatus can be removed from the spectacles after use.
Brief description of the drawings Figure 1 show an embodiment of the present invention where the apparatus is connected to a pair of spectacles.
Figure 2 is an image of a part of the apparatus where the user can choose the origin language and the destination language.
Figure 3 shows the invention in use when reading a book. Figure 4 shows the invention in use when reading a newspaper
Figure 5 shows that the present invention can make use of alternative energy sources in the form of solar cells in order to deliver energy to operate the invention, or to charge a battery.
Figure 6 is a perspective drawing of an alternative embodiment of the present invention, here the upper part of the screen is vertical and the lower part of the screen is horizontal.
Detailed description
Fig. 1 is a perspective view of an embodiment of the present invention. It is shown a pair of spectacles 100. The apparatus is attached to one of the earpieces 101 of the spectacles 100 using a clip 102. From the clip 102 it is extended a telescopic arm 108 forwards to the front of the spectacles 100. This telescopic arm 108 makes it possible to custom fit the reading distance between the translation apparatus and the spectacles 100 and the distance can be adjusted using e.g . an adjustment screw 103 and a hinged joint 107. This telescopic arm 108 can be adjusted not only in and out but also up and down.
To this telescopic arm 108 there is attached a horizontal screen spanning the width of the spectacles 100. The screen consists of two parts, one lower part 105 and one upper part 104. The lower part 105 is the screen where the translated text, is displayed. The upper part 104 is a protective cover that is hinged to the top of the lower part 105. The upper part 104 can be flipped up and down, The upper part 104 is constructed to protect the lower part 105 when the apparatus is not in use.
On the top of one side of the lower part 105 of the screen, there is attached a camera 106 that has the ability to move along the screen 105. This camera 106 records a specific line of text, sends it via a cable to a computer which translates the text into the chosen language. The computer can be part of the apparatus attached to the spectacles 100 or it can be located on another part of the body. This computer has a database with a set of languages it can translate to and from.
Figure 2 is a display of the control panel 201, on the computer, that lets' the user choose the origin language and the destination language. Further the control panel can start and stop the translation of the text. Further it is possible to adjust the font size and font type from this panel.
Figure 3 shows the present invention in use when reading a book. Here it can be seen that the screen 105 is adjusted in order to fit the individual user. The user places the top of t he screen 105 level with the text that is to be translated .
Thereafter the camera 106 records the text written on the line that is to be translated. The recorded image is than translated and the text is displayed on the screen 105.
The method of using the present invention is to clip on the apparatus to one of the earpieces 108 of the spectacles 100. The user then turns on the apparatus and sets the language to translate from and the language to translate to. Thereafter the user adjusts the height of the screen so that it is in a comfortable reading distance and height. Thereafter the user holds the top of the screen 105 level with the line he or she wants to translate. This is done by adjusting the tilt of the head. The camera 106 than records a specific line, sends it to the computer, which translates it and displays it on the screen 105, When the user has finished reading the line he or she redoes the procedure for the next line and so on until he or she is finished reading.
After the user is finished he or she turns off the apparatus and takes it off the earpiece 108 of the spectacle 100,
Figure 4 shows an example of the present invention where the protective cover 104 of the screen 105 is raised to its upper position. The protective cover 104 is hinged on each end of the top of the screen 105. The protective cover 104 can rotate freeiy up and down . Further it is transparent and protects the screen 105 when it is not in use. The protective cover 104 is transparent in order to make it easier to keep track of which iine the reader is translating . When the protective cover 104 is raised all the way up, a slot 401 is created between the upper end of the screen 105 and the protective cover 104. Through this slot 401 the user can focus on the line of text that he or she wants to translate.
In figure 5 the apparatus is supplied with solar panels 503 in order to supply the apparatus with energy. Here it is shown that a pane! 503 can be located on the back side of the screen. Further it can be added additional panels attached to the earpieces 108 of the spectacles 100. It can be attached by either hanging the panels to the earpieces with hooks 502 or by attaching them with a clamp 501. When the apparatus is not in use it can be stored in a casing .
Further the text that is translated can either be stored in a short term memory and deleted automatically or it can be stored long term at the users' request. Figure 6 is a perspective view of an alternative embodiment of the present invention. In this embodiment the upper 602 and lower 601 part of the screen can be unhinged from each other in either end . The upper screen 602 can be lifted in to vertical position. This is in order to scan text written vertically. The text is translated and shown on the lower screen 601 which is placed horizontally.
Further it could be possible to slide the upper screen 602 back and forth on top of the lower screen 601. This is in order to make the lineup of the upper screen 602 compared to the lower screen 601 during translation of text written vertically easier.

Claims

Claims
Apparatus for translating written text in real time from one language to a different language, said apparatus is attached to an earpieces ( 101 ) of a set of spectacles ( 100) and comprises a camera ( 106), a screen ( 105), a computer and are further c h a r a c t e r i z e d i n that the apparatus is attached using a clip ( 102), from this clip it is extended a telescopic arm ( 108) forwards to the front of the spectacles (100), to this telescopic arm (.1.08) there is attached a horizontal screen, the screen consists of two parts, one lower part. (105) and one upper part ( 104), the lower part ( 105) is the screen where the translated text is displayed, the upper part ( 104) is a protective cover that is hinged to the top of the lower part (105), on the top of one side of the lower part (105) of the screen, there is attached a camera ( 106) that, moves along the screen ( 105).
Apparatus as stated in claim 1 wherein said horizontal screen spans the width of said spectacles ( 100).
Apparatus as stated in claim 1 wherein said screen ( 105) can be adjusted horizontally, vertically, distance to spectacles and tilt.
Apparatus as stated in claim 1 wherein said apparatus consists of a unit with the ability to choose origin language and destination language and a memory for storage of translated text.
Apparatus as stated in claim 1 wherein said apparatus can be solar powered.
Apparatus as stated in claim 1 when the apparatus is not in use it can be stored in a casing .
Apparatus as stated in claim 1 wherein said upper (602) and lower (601) part of the screen can be unhinged in either end .
Apparatus as stated in claim 7 wherein said upper screen (602) can be placed vertically while said lower screen (601) is placed horizontally.
Apparatus as stated in claim 7 wherein said upper screen (602) can be slid back and forth along the top of said lower screen (601) .
PCT/NO2012/050094 2011-05-19 2012-05-21 Apparatus for translating written text in real time WO2012158047A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2012256465A AU2012256465B2 (en) 2011-05-19 2012-05-21 Apparatus for translating written text in real time
EP12733537.0A EP2710492A1 (en) 2011-05-19 2012-05-21 Apparatus for translating written text in real time

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NO20110738 2011-05-19
NO20110738A NO333847B1 (en) 2011-05-19 2011-05-19 language Brille

Publications (1)

Publication Number Publication Date
WO2012158047A1 true WO2012158047A1 (en) 2012-11-22

Family

ID=46489453

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NO2012/050094 WO2012158047A1 (en) 2011-05-19 2012-05-21 Apparatus for translating written text in real time

Country Status (4)

Country Link
EP (1) EP2710492A1 (en)
AU (1) AU2012256465B2 (en)
NO (1) NO333847B1 (en)
WO (1) WO2012158047A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103294194A (en) * 2013-04-28 2013-09-11 北京小米科技有限责任公司 Translation method and system based on eyeball tracking
WO2013166365A1 (en) * 2012-05-04 2013-11-07 Kathryn Stone Perez Intelligent translations in personal see through display
US9019174B2 (en) 2012-10-31 2015-04-28 Microsoft Technology Licensing, Llc Wearable emotion detection and feedback system
US9239833B2 (en) 2013-11-08 2016-01-19 Google Inc. Presenting translations of text depicted in images
US9547644B2 (en) 2013-11-08 2017-01-17 Google Inc. Presenting translations of text depicted in images
WO2017165035A1 (en) * 2016-03-23 2017-09-28 Intel Corporation Gaze-based sound selection

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040210444A1 (en) * 2003-04-17 2004-10-21 International Business Machines Corporation System and method for translating languages using portable display device
US6819549B1 (en) * 2002-11-14 2004-11-16 Garmin Ltd. Hinged protective cover for portable electronic device
JP2007280164A (en) * 2006-04-10 2007-10-25 Nikon Corp Electronic dictionary
US20080198324A1 (en) * 2007-01-02 2008-08-21 Fuziak Robert J Eyeglasses having integrated telescoping video camera and video display
US20080243473A1 (en) 2007-03-29 2008-10-02 Microsoft Corporation Language translation of visual and audio input
US20080273796A1 (en) 2007-05-01 2008-11-06 Microsoft Corporation Image Text Replacement
US20090198486A1 (en) 2008-02-05 2009-08-06 National Tsing Hua University Handheld electronic apparatus with translation function and translation method using the same
US20100141892A1 (en) * 2005-01-10 2010-06-10 Renaud Moliton Display for mounting on a pair of eyeglasses

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6819549B1 (en) * 2002-11-14 2004-11-16 Garmin Ltd. Hinged protective cover for portable electronic device
US20040210444A1 (en) * 2003-04-17 2004-10-21 International Business Machines Corporation System and method for translating languages using portable display device
US20100141892A1 (en) * 2005-01-10 2010-06-10 Renaud Moliton Display for mounting on a pair of eyeglasses
JP2007280164A (en) * 2006-04-10 2007-10-25 Nikon Corp Electronic dictionary
US20080198324A1 (en) * 2007-01-02 2008-08-21 Fuziak Robert J Eyeglasses having integrated telescoping video camera and video display
US20080243473A1 (en) 2007-03-29 2008-10-02 Microsoft Corporation Language translation of visual and audio input
US20080273796A1 (en) 2007-05-01 2008-11-06 Microsoft Corporation Image Text Replacement
US20090198486A1 (en) 2008-02-05 2009-08-06 National Tsing Hua University Handheld electronic apparatus with translation function and translation method using the same

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013166365A1 (en) * 2012-05-04 2013-11-07 Kathryn Stone Perez Intelligent translations in personal see through display
US9519640B2 (en) 2012-05-04 2016-12-13 Microsoft Technology Licensing, Llc Intelligent translations in personal see through display
US9019174B2 (en) 2012-10-31 2015-04-28 Microsoft Technology Licensing, Llc Wearable emotion detection and feedback system
US9508008B2 (en) 2012-10-31 2016-11-29 Microsoft Technology Licensing, Llc Wearable emotion detection and feedback system
US9824698B2 (en) 2012-10-31 2017-11-21 Microsoft Technologies Licensing, LLC Wearable emotion detection and feedback system
CN103294194A (en) * 2013-04-28 2013-09-11 北京小米科技有限责任公司 Translation method and system based on eyeball tracking
US9239833B2 (en) 2013-11-08 2016-01-19 Google Inc. Presenting translations of text depicted in images
US9547644B2 (en) 2013-11-08 2017-01-17 Google Inc. Presenting translations of text depicted in images
US10198439B2 (en) 2013-11-08 2019-02-05 Google Llc Presenting translations of text depicted in images
US10726212B2 (en) 2013-11-08 2020-07-28 Google Llc Presenting translations of text depicted in images
WO2017165035A1 (en) * 2016-03-23 2017-09-28 Intel Corporation Gaze-based sound selection

Also Published As

Publication number Publication date
AU2012256465B2 (en) 2015-05-14
NO333847B1 (en) 2013-09-30
AU2012256465A1 (en) 2013-12-12
NO20110738A1 (en) 2012-11-20
EP2710492A1 (en) 2014-03-26

Similar Documents

Publication Publication Date Title
AU2012256465B2 (en) Apparatus for translating written text in real time
US7825949B2 (en) Closed circuit video magnification system
US20070230748A1 (en) System for capturing and presenting text while maintaining material context during optical character recognition
US7903878B2 (en) Capturing and presenting text during optical character recognition
US20070280534A1 (en) Method for capturing and presenting test using video image capture for optical character recognition
CN103763431A (en) Mobile terminal with wearable device and wearable device thereof
US20120290304A1 (en) Electronic Holder for Reading Books
CN218158856U (en) Double-screen interactive window acceptance terminal
KR102139046B1 (en) Portable Reading Assistant Apparatus for Visually impaired using smart phone
CN214279613U (en) Cerebral apoplexy screening device
CN213786546U (en) Scientific and technological information consultation service display device
CN209312051U (en) A kind of account management intelligent terminal
CN201153273Y (en) Mobile phone capable of enlarging screen
CN108922259B (en) Russian translation teaching interactive two-way teaching aid
CN203775292U (en) Mobile terminal with wearable device and wearable device thereof
CN201029595Y (en) Vision aids for low-sight persons to read and write
CN212276605U (en) A multimode english teaching device for english teaching
CN205405044U (en) Simple projector
CN205067860U (en) Portable screen amplification device
Presley An introduction to access technology for people with ocular albinism
CN212012764U (en) Height-adjustable's automatic page scanning system holds in palm book device
CN214548047U (en) Portable reading and writing board
CN210351303U (en) Bill data scanning input device for accounting specialty convenient to adjust
CN215495010U (en) Remote page turning controller suitable for e-book reading
CN211427520U (en) Scene study show board

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12733537

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2012256465

Country of ref document: AU

Date of ref document: 20120521

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2012733537

Country of ref document: EP