WO2011032250A1 - Système de détection d'outils d'écriture passifs multiples flexibles et portables - Google Patents

Système de détection d'outils d'écriture passifs multiples flexibles et portables Download PDF

Info

Publication number
WO2011032250A1
WO2011032250A1 PCT/CA2009/001258 CA2009001258W WO2011032250A1 WO 2011032250 A1 WO2011032250 A1 WO 2011032250A1 CA 2009001258 W CA2009001258 W CA 2009001258W WO 2011032250 A1 WO2011032250 A1 WO 2011032250A1
Authority
WO
WIPO (PCT)
Prior art keywords
writing
light
mirrors
image sensors
label
Prior art date
Application number
PCT/CA2009/001258
Other languages
English (en)
Inventor
David H. Chan
Original Assignee
Chan David H
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chan David H filed Critical Chan David H
Priority to PCT/CA2009/001258 priority Critical patent/WO2011032250A1/fr
Priority to CA2773398A priority patent/CA2773398A1/fr
Publication of WO2011032250A1 publication Critical patent/WO2011032250A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0428—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus

Definitions

  • touch panels are installed in front of display unit to form an interactive
  • Patent #6266051 is a retrofittable system which can be
  • Patent #6917033 use optical marker to identify 'Passive touch' but is a costly
  • Patent #6803906 use CMOS cameras to
  • image sensors which is installed in a case with no. fixed or
  • At least one system can be mounted on
  • monitored area It can be any one side or corner but not fixed to one
  • the image sensors monitor the area through two
  • the system is powered by batteries with charging capability by external power as well as using external power for extended time usage, thus can be a portable or permanent system and can be installed on any surface, for example: white board. Avail, rough Avail, note pad and projector screen etc.
  • the image sensors monitor the writing area through the reflection mirrors and pass the information to processing unit to calculate the location of the writing instniment which can be any passive writing instnunents like finger, pen or a-like. even laser pointer light beam, by simple trigonometry method.
  • the calculated data then can be processed by either the processing unit, other processing unit, personal computer or any internal or external electronics devices to perforin any actions. For example: These data can be sent to projector to update the projected image on screen to synchronize the projected image and the writing with or without personal computer system or other electronics systems.
  • Identify passive writing instnunents like finger for writing and multiple passive writing instnunents writing on the writing area at the same time is always be a huge challenge so far. For example: If the first finger stay on board and the second finger pop in to do zoom in and out function or rotating function are simple and is using by many manufacturers right now. for example: iPlione. But. if the first finger writes some thing at left side of board then left up. then second finger pop in and writes some thing at right side of board, then all the known prior arts cannot identify the second writing is written by first finger or second finger unless by electronics pen method. By using the invented label/object passive method, the said problem vanished and can identify multiple passive writing instnunents at low cost are possible.
  • the label/object is specially designed label/object which helps to identify passive writing instnunents like finger, pen etc. as well as multiple passive writing
  • Patent #6917033 with title 'Passive touch-sensitive optical marker' is a way to identify passive writing instniment by using optical reflector. However, this method is expensive, difficult to manufacture, cannot identify multiple passive writing instnunents and not easy to use in compare with this invention.
  • the image sensors capture images via the reflection mirrors and identify the related angle and then calculate the intersection of two projection lines to locate the writing instniment location by the invented passive identification label/object and further calculate the movement.
  • the image sensors identify the writing object by reading the attached label/object which have different quantity of special shape including strip etc. with different material.
  • the shape or strip give different image in the form of different thermo and/or brightness characteristic to the image sensors because of different temperature coefficient than the label/object body as well as different light reflection factor than the label/object body and writing instniment. These temperature and light reflection differences can be detected easily by image sensing with image sensors.
  • the strips or shapes on the identification label/object can be any ty pe of materials as long as the combination of shape/strip and label/object body have different characteristics to be detected by image sensors. On the other hand, any materials combinations will work as long as can be identified by the image sensors.
  • a subsystem of LEDs array and diffusion filter assembly can be installed with the system to provide additional heat and/or light if necessary.
  • the light source can be any type of light but not limited to LEDs and the filter is used to diffuse the light to form a designed patterned light source as needed.
  • a subsystem of laser pointer and receiver, calibration mirrors with optional image display also mounted with the main system to help to calibrate the system when installation.
  • the invented system is designed to be adjustable and flexible to match with any size writing area as well as to be removable to act as portable system.
  • the invented system is using mirror to capture image and fully utilize the writing area.
  • (8) 'Cannot identify multiple fingers'-The invented system is using specially designed low cost passive identification method to truly identify multiple writing instruments including fingers.
  • the identification method of the invented system is neutral to any writing instruments, thus different writing instruments can be used and identified at same time. For example, a finger, chopstick and a fork can be writing instrument and can be identified and using for writing at the same time.
  • Patent #7236162/6803906 with title 'Passive touch system and method of detecting user input' are using camera to do image identification and is similar to this invention.
  • these 2 patents have similar problems as listed above, the systems
  • This invented system can be installed on top of a game display like LCD panel display, one or more than one players can play the game together by using this detection method without any mix up at all.
  • This invented system can works like a multiple passive player touch screen without any electronics identification method like electronics pen. Further, this system can be used for detail animation evaluation and development purpose too as well as data collection of motion for training purposes.
  • the identification label/object can be put on body of any human, animal etc. and the position of label/object can be tracked precisely without any costly 3D technologies and software.
  • Existing 3D technologies such as 3D camera by "3DV System", a Isreal company, is using "time of fly” concept which is practical and is proved working. But that is very software intensive and costly of both hardware and software as well as system cost. To identify all objects like adult man. adult women, kids, small child, senior person and monkey etc. within different environments will be huge challenge to the image identification software.
  • the identification label/object can be put on all kind of objects at all
  • FIG.1 depicts an invented system which is
  • image sensors including image sensors, mirrors, light shade. IR filters, batteries.
  • electronics board including micro-controller, rod. rod holder, hooks and mirror holder.
  • Fig.2 depicts more detail sample view of the
  • the designed mirror which is special designed curved mirror to cover any angle of view by changing the curved shape of the mirror.
  • the mirror holder is specially designed to have recessed mirror to reduce the effect of ambient light.
  • Fig.5 and Fig.6 depicts details of
  • the writing object is much smaller than the mirror, thus the blocked area (shadow area) created by the writing object is much smaller in compare with the pin hole and regular camera which are installed at the corner. Detection of multiple objects will be much more easier and accurate. Minimum distance is moved away from the corner, thus eliminate the minimum distance limit and fully utilize the monitored area. When the object comes in front of the mirror, the object only blocks part of the mirror and thus the camera still can see the area around the writing instrument also.
  • Fig.10 depicts the details of the
  • label/object which are used to identify writing instruments including finger. Strip or strips are on the label/object to help to be identified, hence
  • any materials can be used as long as the characteristic difference between the strip and label body is good enough for identification by camera or image sensor.
  • FIG.11 depicts the details of the invented
  • Fig.12 depicts the details of the ' Laser
  • Fig.13 depicts the details of the 'LED
  • light sub-system' which includes a LEDs array and a light diffuser which will diffuse the light of LEDs to form a patterned diffused light source to light up the monitored area and writing objects.
  • Fig.14 depicts the concept of the 'Light
  • the special designed surface helps to reflect more light to sideway. means more reflection light to camera or image sensors.
  • Fig.15 depicts the concept of the '3D

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un système, un procédé et un appareil permettant de convertir une écriture sur surface en un signal numérique à des fins de traitement ultérieur. Un objet spécialement conçu qui est un procédé passif très rentable, aide à identifier d'authentiques outils d'écriture passifs multiples écrivant au même moment, et peut fonctionner avec la plupart des outils d'écriture passifs, y compris un doigt humain, un stylo, un bâtonnet, une baguette, un pointeur laser et tout objet semblable à un stylo ainsi que des stylos normaux. Un faisceau lumineux de pointeur laser peut être identifié comme un outil d'écriture et peut fonctionner de façon similaire à une fonction de souris ou une autre fonction. Un système de miroirs à réflexion rend le système flexible et ajustable pour fonctionner avec n'importe quelle zone d'écriture existante de toute taille et peut être un véritable système portable. Un sous-système lumineux supplémentaire améliore l'image capturée dans une condition de lumière ambiante. Un sous-système laser facilite l'installation et la configuration.
PCT/CA2009/001258 2009-09-16 2009-09-16 Système de détection d'outils d'écriture passifs multiples flexibles et portables WO2011032250A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CA2009/001258 WO2011032250A1 (fr) 2009-09-16 2009-09-16 Système de détection d'outils d'écriture passifs multiples flexibles et portables
CA2773398A CA2773398A1 (fr) 2009-09-16 2009-09-16 Systeme de detection d'outils d'ecriture passifs multiples flexibles et portables

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CA2009/001258 WO2011032250A1 (fr) 2009-09-16 2009-09-16 Système de détection d'outils d'écriture passifs multiples flexibles et portables

Publications (1)

Publication Number Publication Date
WO2011032250A1 true WO2011032250A1 (fr) 2011-03-24

Family

ID=43757972

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2009/001258 WO2011032250A1 (fr) 2009-09-16 2009-09-16 Système de détection d'outils d'écriture passifs multiples flexibles et portables

Country Status (2)

Country Link
CA (1) CA2773398A1 (fr)
WO (1) WO2011032250A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014063020A1 (fr) * 2012-10-18 2014-04-24 Chornenky T Eric Appareil et procédé de détermination d'informations spatiales concernant un environnement

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6266051B1 (en) * 1997-02-21 2001-07-24 Electronics For Imaging, Inc. Retrofittable apparatus for converting a substantially planar surface into an electronic data capture device
US6828959B2 (en) * 1999-01-29 2004-12-07 Ricoh Company, Ltd. Method and device for inputting coordinate-position and a display board system
WO2009033265A1 (fr) * 2007-09-14 2009-03-19 Smart Technologies Ulc Système de présentation multimédia interactif portable

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6266051B1 (en) * 1997-02-21 2001-07-24 Electronics For Imaging, Inc. Retrofittable apparatus for converting a substantially planar surface into an electronic data capture device
US6828959B2 (en) * 1999-01-29 2004-12-07 Ricoh Company, Ltd. Method and device for inputting coordinate-position and a display board system
WO2009033265A1 (fr) * 2007-09-14 2009-03-19 Smart Technologies Ulc Système de présentation multimédia interactif portable

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014063020A1 (fr) * 2012-10-18 2014-04-24 Chornenky T Eric Appareil et procédé de détermination d'informations spatiales concernant un environnement

Also Published As

Publication number Publication date
CA2773398A1 (fr) 2011-03-24

Similar Documents

Publication Publication Date Title
US9996197B2 (en) Camera-based multi-touch interaction and illumination system and method
JP5950130B2 (ja) カメラ式マルチタッチ相互作用装置、システム及び方法
Molyneaux et al. Interactive environment-aware handheld projectors for pervasive computing spaces
KR102335132B1 (ko) 하나의 단일 감지 시스템을 이용하는 멀티 모드 제스처 기반의 상호작용 시스템 및 방법
US20110032215A1 (en) Interactive input system and components therefor
US20140375769A1 (en) 3d wearable glove scanner
JP2010509582A (ja) 物体の位置及び定位検出システム
US20160092031A1 (en) Virtual two-dimensional positioning module of input device and virtual device with the same
US8851687B2 (en) Reflecting plate and reflecting frame
JP5466609B2 (ja) 光学式位置検出装置及び再帰性反射板ユニット
Yoo et al. Symmetrisense: Enabling near-surface interactivity on glossy surfaces using a single commodity smartphone
Motamedi Hd touch: multi-touch and object sensing on a high definition lcd tv
US9044995B2 (en) Reflection frame-equipped sheet
WO2010066395A1 (fr) Système de peinture électronique et appareil pour effectuer une entrée dans le système
WO2011032250A1 (fr) Système de détection d'outils d'écriture passifs multiples flexibles et portables
US20110050652A1 (en) Flexible and portable multiple passive writing instruments detection system
CN206193742U (zh) 触控感应器外露型触控区和笔写区一体式电子白板
JP6233941B1 (ja) 非接触式の三次元タッチパネル、非接触式の三次元タッチパネルシステム、非接触式の三次元タッチパネルの制御方法、プログラム及び記録媒体
KR20120114767A (ko) 사물 투척형 게임 디스플레이 시스템 및 그 방법
CN208240003U (zh) 一种可定位的球形展示装置
Kim et al. Thirdlight: Low-cost and high-speed 3d interaction using photosensor markers
KR20140044525A (ko) 모션 센서 카메라를 이용한 터치 스크린 프레임 및 이를 포함하는 디스플레이 시스템
Laberge Visual tracking for human-computer interaction
KR20090018770A (ko) 카메라와 가상 사각형 마크를 이용한 3차원 위치 측정장치
CN109089090A (zh) 投影触控系统及其校正方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09849352

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2773398

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09849352

Country of ref document: EP

Kind code of ref document: A1