AU1114899A - Voice-output reading system with gesture-based navigation - Google Patents
Voice-output reading system with gesture-based navigation Download PDFInfo
- Publication number
- AU1114899A AU1114899A AU11148/99A AU1114899A AU1114899A AU 1114899 A AU1114899 A AU 1114899A AU 11148/99 A AU11148/99 A AU 11148/99A AU 1114899 A AU1114899 A AU 1114899A AU 1114899 A AU1114899 A AU 1114899A
- Authority
- AU
- Australia
- Prior art keywords
- text
- user
- finger
- image
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000033001 locomotion Effects 0.000 claims description 67
- 238000000034 method Methods 0.000 claims description 64
- 238000003384 imaging method Methods 0.000 claims description 17
- 230000000007 visual effect Effects 0.000 claims description 17
- 239000011521 glass Substances 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 claims description 2
- 230000003993 interaction Effects 0.000 claims 1
- 210000003811 finger Anatomy 0.000 description 198
- 239000000463 material Substances 0.000 description 61
- 238000012015 optical character recognition Methods 0.000 description 35
- 238000005286 illumination Methods 0.000 description 29
- 230000007246 mechanism Effects 0.000 description 19
- 230000008901 benefit Effects 0.000 description 12
- 230000004438 eyesight Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 230000015572 biosynthetic process Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 238000010079 rubber tapping Methods 0.000 description 7
- 238000003786 synthesis reaction Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 210000004247 hand Anatomy 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 230000004397 blinking Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000003708 edge detection Methods 0.000 description 3
- 230000008713 feedback mechanism Effects 0.000 description 3
- 238000002156 mixing Methods 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 210000003813 thumb Anatomy 0.000 description 3
- 230000026683 transduction Effects 0.000 description 3
- 238000010361 transduction Methods 0.000 description 3
- 238000013519 translation Methods 0.000 description 3
- 208000010415 Low Vision Diseases 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 239000004744 fabric Substances 0.000 description 2
- 230000005057 finger movement Effects 0.000 description 2
- 239000012530 fluid Substances 0.000 description 2
- 230000004303 low vision Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 239000004033 plastic Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000002829 reductive effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000007480 spreading Effects 0.000 description 2
- 238000003892 spreading Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 241000282376 Panthera tigris Species 0.000 description 1
- 229920002334 Spandex Polymers 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 210000004905 finger nail Anatomy 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000005304 joining Methods 0.000 description 1
- 201000003723 learning disability Diseases 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 210000000282 nail Anatomy 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000004759 spandex Substances 0.000 description 1
- 239000003381 stabilizer Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
- 208000029257 vision disease Diseases 0.000 description 1
- 230000004393 visual impairment Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/006—Teaching or communicating with blind persons using audible presentation of the information
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/007—Teaching or communicating with blind persons using both tactile and audible presentation of the information
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/008—Teaching or communicating with blind persons using visual presentation of the information for the partially sighted
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/033—Indexing scheme relating to G06F3/033
- G06F2203/0331—Finger worn pointing device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- User Interface Of Digital Computer (AREA)
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US6313597P | 1997-10-22 | 1997-10-22 | |
| US60063135 | 1997-10-22 | ||
| US6871397P | 1997-12-29 | 1997-12-29 | |
| US60068713 | 1997-12-29 | ||
| PCT/US1998/022392 WO1999021122A1 (fr) | 1997-10-22 | 1998-10-22 | Systeme de lecture a sortie vocale avec navigation gestuelle |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| AU1114899A true AU1114899A (en) | 1999-05-10 |
Family
ID=26743083
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU11148/99A Abandoned AU1114899A (en) | 1997-10-22 | 1998-10-22 | Voice-output reading system with gesture-based navigation |
Country Status (4)
| Country | Link |
|---|---|
| EP (1) | EP1050010A1 (fr) |
| AU (1) | AU1114899A (fr) |
| CA (1) | CA2308213A1 (fr) |
| WO (1) | WO1999021122A1 (fr) |
Families Citing this family (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2794560B1 (fr) * | 1999-06-01 | 2001-09-21 | Thomson Csf | Procede d'aide a la lecture notamment pour malvoyant |
| JP2001091218A (ja) * | 1999-09-14 | 2001-04-06 | Mitsubishi Electric Inf Technol Center America Inc | ３次元運動検知装置及び３次元運動検知方法 |
| US6901561B1 (en) * | 1999-10-19 | 2005-05-31 | International Business Machines Corporation | Apparatus and method for using a target based computer vision system for user interaction |
| JP4052498B2 (ja) | 1999-10-29 | 2008-02-27 | 株式会社リコー | 座標入力装置および方法 |
| JP2001184161A (ja) | 1999-12-27 | 2001-07-06 | Ricoh Co Ltd | 情報入力方法、情報入力装置、筆記入力装置、筆記データ管理方法、表示制御方法、携帯型電子筆記装置および記録媒体 |
| WO2001069590A1 (fr) * | 2000-03-17 | 2001-09-20 | Susanna Merenyi | Systeme de lecture de texte vocal en ligne |
| EP1739528B1 (fr) * | 2000-07-05 | 2009-12-23 | Smart Technologies ULC | Méthode pour un système tactile à caméra |
| US6803906B1 (en) | 2000-07-05 | 2004-10-12 | Smart Technologies, Inc. | Passive touch system and method of detecting user input |
| GB2381687B (en) * | 2001-10-31 | 2005-08-24 | Hewlett Packard Co | Assisted reading method and apparatus |
| WO2004036447A1 (fr) * | 2002-10-16 | 2004-04-29 | Electronics And Telecommunications Research Institute | Procede et systeme de transformation adaptative d'un contenu visuel en fonction des symptomes caracteristiques de basse vision et des preferences de presentation d'un utilisateur |
| US6954197B2 (en) | 2002-11-15 | 2005-10-11 | Smart Technologies Inc. | Size/scale and orientation determination of a pointer in a camera-based touch system |
| US7532206B2 (en) | 2003-03-11 | 2009-05-12 | Smart Technologies Ulc | System and method for differentiating between pointers used to contact touch surface |
| US7274356B2 (en) | 2003-10-09 | 2007-09-25 | Smart Technologies Inc. | Apparatus for determining the location of a pointer within a region of interest |
| US7355593B2 (en) | 2004-01-02 | 2008-04-08 | Smart Technologies, Inc. | Pointer tracking across multiple overlapping coordinate input sub-regions defining a generally contiguous input region |
| US7460110B2 (en) | 2004-04-29 | 2008-12-02 | Smart Technologies Ulc | Dual mode touch system |
| US8120596B2 (en) | 2004-05-21 | 2012-02-21 | Smart Technologies Ulc | Tiled touch system |
| KR100724939B1 (ko) * | 2005-06-20 | 2007-06-04 | 삼성전자주식회사 | 카메라부를 이용한 유저 인터페이스 구현 방법 및 이를위한 이동통신단말기 |
| US7697827B2 (en) | 2005-10-17 | 2010-04-13 | Konicek Jeffrey C | User-friendlier interfaces for a camera |
| US9442607B2 (en) | 2006-12-04 | 2016-09-13 | Smart Technologies Inc. | Interactive input system and method |
| US20080167739A1 (en) * | 2007-01-05 | 2008-07-10 | National Taiwan University Of Science And Technology | Autonomous robot for music playing and related method |
| US8094137B2 (en) | 2007-07-23 | 2012-01-10 | Smart Technologies Ulc | System and method of detecting contact on a display |
| US8487881B2 (en) * | 2007-10-17 | 2013-07-16 | Smart Technologies Ulc | Interactive input system, controller therefor and method of controlling an appliance |
| US8902193B2 (en) | 2008-05-09 | 2014-12-02 | Smart Technologies Ulc | Interactive input system and bezel therefor |
| IT1390595B1 (it) * | 2008-07-10 | 2011-09-09 | Universita' Degli Studi Di Brescia | Dispositivo di ausilio nella lettura di un testo stampato |
| US8339378B2 (en) | 2008-11-05 | 2012-12-25 | Smart Technologies Ulc | Interactive input system with multi-angle reflector |
| US8692768B2 (en) | 2009-07-10 | 2014-04-08 | Smart Technologies Ulc | Interactive input system |
| US8577146B2 (en) | 2010-04-09 | 2013-11-05 | Sony Corporation | Methods and devices that use an image-captured pointer for selecting a portion of a captured image |
| NO341403B1 (no) * | 2012-02-27 | 2017-10-30 | Ablecon As | Hjelpemiddelsystem for synshemmede |
| GB2507963A (en) | 2012-11-14 | 2014-05-21 | Renergy Sarl | Controlling a Graphical User Interface |
| DE102014005088A1 (de) * | 2014-04-08 | 2015-10-08 | Köppern Und Eberts Ug (Haftungsbeschränkt) | Lesehilfe und Verfahren zum Helfen des Lesens von Text enthaltenden Dokumenten |
| US20150310767A1 (en) * | 2014-04-24 | 2015-10-29 | Omnivision Technologies, Inc. | Wireless Typoscope |
| FR3061150B1 (fr) * | 2016-12-22 | 2023-05-05 | Thales Sa | Systeme de designation interactif pour vehicule, notamment pour aeronef, comportant un serveur de donnees |
| JP2019067166A (ja) * | 2017-10-02 | 2019-04-25 | 富士ゼロックス株式会社 | 電子機器 |
| CN111027556B (zh) * | 2019-03-11 | 2023-12-22 | 广东小天才科技有限公司 | 一种基于图像预处理的搜题方法及学习设备 |
| CN110032994B (zh) * | 2019-06-10 | 2019-09-20 | 上海肇观电子科技有限公司 | 文字检测方法、阅读辅助设备、电路及介质 |
| KR20220027081A (ko) | 2019-06-10 | 2022-03-07 | 넥스트브이피유 (상하이) 코포레이트 리미티드 | 텍스트 검출 방법, 판독 지원 디바이스 및 매체 |
| KR102373960B1 (ko) * | 2021-09-10 | 2022-03-15 | (주)웅진씽크빅 | 독서 지원 장치 및 이를 이용한 사용자 입력 감지 방법 |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| USD287021S (en) * | 1984-12-26 | 1986-12-02 | Johnson Carlos J | Combined camera and eyeglasses |
| US5168531A (en) * | 1991-06-27 | 1992-12-01 | Digital Equipment Corporation | Real-time recognition of pointing information from video |
| US5325123A (en) * | 1992-04-16 | 1994-06-28 | Bettinardi Edward R | Method and apparatus for variable video magnification |
| JPH07271818A (ja) * | 1994-03-31 | 1995-10-20 | Toshiba Corp | ハイパーメディアシステム |
| US5736978A (en) * | 1995-05-26 | 1998-04-07 | The United States Of America As Represented By The Secretary Of The Air Force | Tactile graphics display |
-
1998
- 1998-10-22 AU AU11148/99A patent/AU1114899A/en not_active Abandoned
- 1998-10-22 EP EP98953891A patent/EP1050010A1/fr not_active Withdrawn
- 1998-10-22 CA CA002308213A patent/CA2308213A1/fr not_active Abandoned
- 1998-10-22 WO PCT/US1998/022392 patent/WO1999021122A1/fr not_active Application Discontinuation
Also Published As
| Publication number | Publication date |
|---|---|
| CA2308213A1 (fr) | 1999-04-29 |
| EP1050010A1 (fr) | 2000-11-08 |
| WO1999021122A1 (fr) | 1999-04-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6115482A (en) | Voice-output reading system with gesture-based navigation | |
| AU1114899A (en) | Voice-output reading system with gesture-based navigation | |
| US10741167B2 (en) | Document mode processing for portable reading machine enabling document navigation | |
| US9626000B2 (en) | Image resizing for optical character recognition in portable reading machine | |
| US7659915B2 (en) | Portable reading device with mode processing | |
| US8036895B2 (en) | Cooperative processing for portable reading machine | |
| US8284999B2 (en) | Text stitching from multiple images | |
| US7627142B2 (en) | Gesture processing with low resolution images with high resolution processing for optical character recognition for a reading machine | |
| US7505056B2 (en) | Mode processing in portable reading machine | |
| US7629989B2 (en) | Reducing processing latency in optical character recognition for portable reading machine | |
| US7325735B2 (en) | Directed reading mode for portable reading machine | |
| US8249309B2 (en) | Image evaluation for reading mode in a reading machine | |
| US8186581B2 (en) | Device and method to assist user in conducting a transaction with a machine | |
| US20150043822A1 (en) | Machine And Method To Assist User In Selecting Clothing | |
| US20060071950A1 (en) | Tilt adjustment for optical character recognition in portable reading machine | |
| EP1756802A2 (fr) | Dispositif de lecture portatif avec traitement modal | |
| AU709833B2 (en) | Tactiley-guided, voice-output reading apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MK4 | Application lapsed section 142(2)(d) - no continuation fee paid for the application |