WO2002027457A2 - Clavier sans fil, fonde sur la vision par ordinateur - Google Patents

Clavier sans fil, fonde sur la vision par ordinateur Download PDF

Info

Publication number
WO2002027457A2
WO2002027457A2 PCT/TR2001/000048 TR0100048W WO0227457A2 WO 2002027457 A2 WO2002027457 A2 WO 2002027457A2 TR 0100048 W TR0100048 W TR 0100048W WO 0227457 A2 WO0227457 A2 WO 0227457A2
Authority
WO
WIPO (PCT)
Prior art keywords
keyboard
computer
key
image
computer vision
Prior art date
Application number
PCT/TR2001/000048
Other languages
English (en)
Other versions
WO2002027457A3 (fr
Inventor
Yasemin Cetin
Original Assignee
Cetin, Ahmet, Enis
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cetin, Ahmet, Enis filed Critical Cetin, Ahmet, Enis
Priority to AU2002214527A priority Critical patent/AU2002214527A1/en
Publication of WO2002027457A2 publication Critical patent/WO2002027457A2/fr
Publication of WO2002027457A3 publication Critical patent/WO2002027457A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G06F3/0426—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking fingers with respect to a virtual keyboard projected or printed on the surface

Definitions

  • the computer vision based keyboard apparatus is invented to enter text, numbers, characters to computers, personal digital assistants, and other devices having microprocessors.
  • the keyboard can be made out of paper, fabric, plastic or polymer having an image of a regular keyboard where the character locations are marked as nonoverlapping regions.
  • the user covers the character or key locations using his/her fingers or a pointer and his/her actions are captured by a camera connected to the computer.
  • the characters covered by fingers or pointers are recognized using computer vision techniques by analyzing the video produced by the camera. Due to this reason the computer vision based keyboard apparatus does neither need an antenna nor a cable connecting the keyboard to the computer.
  • the weight and the size of the keyboard is important. Since the computer vision based keyboard can be made out of any material having an ordinary keyboard image it may be better to use a light and soft or foldable material for the keyboard in mobile computing and communication systems in which the weight and the size of the keyboard is important.
  • the computer vision based full size keyboard made of fabric is foldable and it is lighter than ordinary keyboards. The user may fold this keyboard and put it into his/her pocket or bag when it is not in use.
  • This feature of the invention makes it attractive for text entry to notebook computers, personal digital assistants, mobile telephones, and pagers.
  • Figure 1 the configuration of the computer vision based keyboard is shown. The keyboard is very thin and it is not attached to the computer with a cable. The data entry to the computer is carried out via the camera (1).
  • the keyboard image shown in Figure 1 is of
  • the location of the keys can be selected as in QWERTY style or any other keyboard system as long as the key locations are known by the computer.
  • the regions corresponding to keys can not only have regular shapes such us square, rectangle or circle but also irregular shapes as long as they do not overlap.
  • Uncovered keyboard image can be obtained as soon as the camera is turned on. In this way uncovered key region images for each key is obtained.
  • the camera During the regular mode of operation of the computer vision based keyboard the camera generates a video signal which is essentially a sequence of images. Each image is analyzed and processed one by one. Each image of the video is compared to the keyboard image stored in the computer by correlating each key region with the corresponding region in the processed image. If all the keys are uncovered then the next image of the video is processed. If a key is pressed or covered then the key region image stored in the computer will be different from the corresponding region of the processed image.
  • Correlation method is one of the most widely used image compression method In this method the corresponding pixel values of two images are multiplied and the multiplication results are summed.
  • the cross-correlation coefficient, r, of two images are defined as the number obtained by dividing the above sum by the
  • Euclidian norms of two images If the two images are the same than the cross- correlation coefficient r is simply equal to 1.
  • the coefficient r is calculated for each key region, in other words for each key of the processed image. In this way a matrix of numbers is obtained for each image of the video. If a key region is not covered by a finger then they must be essentially the same as the key region image stored in the image. Due to recording noise and other factors the corresponding pixel values of two images are not equal to each other but very close to each other, and an r value close to 1 is obtained. This means that the current key is not pressed. If all the entries of the matrix are close to 1 then the processed image is skipped as it is assumed that no key is pressed.
  • the two images are different from each other than the r value becomes significantly smaller than one. This means that this key is either pressed or covered by the rest of the finger (to press a key the user not only covers the intended key region but also the key regions below the intended key).
  • the vision based keyboard system in which the camera is placed in front of the keyboard image as shown in Figure 1 selects the covered key as the key closest to the camera.
  • Another widely used image comparison method is based on the LI norm of the difference image which is obtained by subtracting the pixel values of two images from each other, and the absolute values of the differences are summed. If the two images are the same then a value of zero is obtained which is the smallest possible value. In practice, due to noise a number close to zero is obtained for the uncovered key regions.
  • images of the video is processed one by one and the key region images of the stored keyboard image and the current image are compared to each other and a matrix of numbers is obtained.
  • An entry of the matrix close to zero means that the corresponding key is not covered.
  • a number significantly greater than zero means that the corresponding key is covered which means that either this key is either or it is covered by the stem of the finger.
  • the covered key closest to the camera is chosen as the pressed key.
  • the camera may be placed on the keyboard plane as shown in Figure 1. In other words the angle between the keyboard plane and the camera should be small. In an ordinary keyboard the number keys are closest to the camera. In a QWERTY type keyboard the next rows are formed by the keys "Q”, "W”, “E”, “R”, “T”, “Y” etc.
  • Vision based keyboard can be designed with two ore more cameras as well. In this case stereo images are obtained and the image sequences generated by the cameras are processed simultaneously to reduce the amount of false alarms.
  • Each key region in the keyboard may be colored in different colors.
  • the Red, Green, and Blue components of the images generated by the camera can be processed separately, and image comparisons can be carried out in R, G, and B color spaces.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

L'invention concerne un clavier, fondé sur la vision par ordinateur, conçu pour entrer des textes, chiffres, caractères, sur des ordinateurs, blocs-notes électroniques et autres dispositifs comprenant des microprocesseurs. Ce clavier peut être réalisé à partir de papier, plastique, polymère, comportant l'image d'un clavier normal dans lequel les emplacements des caractères sont marqués en tant que régions non chevauchantes. L'utilisateur recouvre le caractère ou les emplacements de caractères à l'aide de ses doigts ou d'un pointeur, cette action étant enregistrée par une caméra reliée à l'ordinateur. Les caractères recouverts par les doigts ou les pointeurs sont reconnus au moyen de techniques de vision par ordinateur, par analyse des images vidéo produites par la caméra. Etant donné cette conception, le clavier fondé sur la vision par ordinateur ne nécessite ni antenne ni câble de connexion le reliant à l'ordinateur.
PCT/TR2001/000048 2000-09-29 2001-09-24 Clavier sans fil, fonde sur la vision par ordinateur WO2002027457A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2002214527A AU2002214527A1 (en) 2000-09-29 2001-09-24 Wireless keyboard

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR200002828A TR200002828A3 (tr) 2000-09-29 2000-09-29 Bilgisayarli Yapay Görmeye Dayali Kablosuz ve Antensiz Klavye Cihazi.
TR2000/02828 2000-09-29

Publications (2)

Publication Number Publication Date
WO2002027457A2 true WO2002027457A2 (fr) 2002-04-04
WO2002027457A3 WO2002027457A3 (fr) 2002-12-27

Family

ID=21622711

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2001/000048 WO2002027457A2 (fr) 2000-09-29 2001-09-24 Clavier sans fil, fonde sur la vision par ordinateur

Country Status (3)

Country Link
AU (1) AU2002214527A1 (fr)
TR (1) TR200002828A3 (fr)
WO (1) WO2002027457A2 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2470073A (en) * 2009-05-08 2010-11-10 Sony Comp Entertainment Europe Interfacing with an entertainment device by video capture
US20140152622A1 (en) * 2012-11-30 2014-06-05 Kabushiki Kaisha Toshiba Information processing apparatus, information processing method, and computer readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0535988A2 (fr) * 1991-10-04 1993-04-07 Sigmax Kabushiki Kaisha Méthode et dispositif d'entrées de données
EP0554492A1 (fr) * 1992-02-07 1993-08-11 International Business Machines Corporation Méthode et dispositif pour l'entrée optique de commandes ou de données
DE29802435U1 (de) * 1998-02-12 1998-05-07 Siemens Nixdorf Inf Syst Anordnung der Projektionsfläche einer virtuellen Eingabeeinheit
WO2000021024A1 (fr) * 1998-10-07 2000-04-13 Intel Corporation Dispositif de saisie utilisant des detecteurs de balayage

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0535988A2 (fr) * 1991-10-04 1993-04-07 Sigmax Kabushiki Kaisha Méthode et dispositif d'entrées de données
EP0554492A1 (fr) * 1992-02-07 1993-08-11 International Business Machines Corporation Méthode et dispositif pour l'entrée optique de commandes ou de données
DE29802435U1 (de) * 1998-02-12 1998-05-07 Siemens Nixdorf Inf Syst Anordnung der Projektionsfläche einer virtuellen Eingabeeinheit
WO2000021024A1 (fr) * 1998-10-07 2000-04-13 Intel Corporation Dispositif de saisie utilisant des detecteurs de balayage

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2470073A (en) * 2009-05-08 2010-11-10 Sony Comp Entertainment Europe Interfacing with an entertainment device by video capture
GB2470073B (en) * 2009-05-08 2011-08-24 Sony Comp Entertainment Europe Entertainment device, system and method
US8970624B2 (en) 2009-05-08 2015-03-03 Sony Computer Entertainment Europe Limited Entertainment device, system, and method
US20140152622A1 (en) * 2012-11-30 2014-06-05 Kabushiki Kaisha Toshiba Information processing apparatus, information processing method, and computer readable storage medium

Also Published As

Publication number Publication date
TR200002828A2 (tr) 2002-05-21
WO2002027457A3 (fr) 2002-12-27
AU2002214527A1 (en) 2002-04-08
TR200002828A3 (tr) 2002-05-21

Similar Documents

Publication Publication Date Title
US9317124B2 (en) Command input by hand gestures captured from camera
US6603462B2 (en) System and method for selecting functions based on a finger feature such as a fingerprint
US8311370B2 (en) Portable terminal and data input method therefor
US9524028B2 (en) Visual language for human computer interfaces
KR100943792B1 (ko) 움직임 패턴 식별 장치 및 방법
US20060110013A1 (en) Apparatus and method for inputting characters using fingerprint identification in portable wireless terminal
US9418285B2 (en) Information processing apparatus and input control method
KR20150026535A (ko) 촬영된 영상을 이용하여 객체를 인식하는 방법 및 컴퓨터 판독 가능한 기록 매체
CN112351185A (zh) 拍照方法和移动终端
CN108958487A (zh) 使用标记区域对视频流的手势预处理
CN108537283A (zh) 一种图像分类方法及卷积神经网络生成方法
CN107918496A (zh) 一种输入纠错方法和装置、一种用于输入纠错的装置
CN108259746B (zh) 一种图像色彩检测方法及移动终端
CN113253908B (zh) 按键功能执行方法、装置、设备及存储介质
US20170293396A1 (en) Information processing apparatus
US6970109B2 (en) Keyboard modification system
CN110944163A (zh) 一种图像处理方法及电子设备
WO2002027457A2 (fr) Clavier sans fil, fonde sur la vision par ordinateur
US20230393649A1 (en) Method and device for inputting information
KR20050014257A (ko) 휴대 단말기의 손금 인식방법
KR100640402B1 (ko) 입력 인터페이스 모드에 따라 전자 터치 인터페이스들을화면과 별도의 영역에 가변적으로 표시할 수 있는 휴대용단말기
KR100686360B1 (ko) 지문 인식 키 패드를 구비한 이동 통신 단말기 및 그 입력방법
CN114615520B (zh) 字幕定位方法、装置、计算机设备及介质
JP2003044203A (ja) 情報処理装置
JP3072517U (ja) 多指入力型かな入力機能を持つ小型無線装置及び多指入力型かな入力機能を持つ携帯型情報機器及び多指入力型かな入力機能を持つ情報入力装置の情報入力部

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PH PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP