CA2773398A1 - Flexible and portable multiple passive writing instruments detection system - Google Patents

Flexible and portable multiple passive writing instruments detection system Download PDF

Info

Publication number
CA2773398A1
CA2773398A1 CA2773398A CA2773398A CA2773398A1 CA 2773398 A1 CA2773398 A1 CA 2773398A1 CA 2773398 A CA2773398 A CA 2773398A CA 2773398 A CA2773398 A CA 2773398A CA 2773398 A1 CA2773398 A1 CA 2773398A1
Authority
CA
Canada
Prior art keywords
label
light
invented
flexible
electronics
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA2773398A
Other languages
French (fr)
Inventor
David H. Chan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2773398A1 publication Critical patent/CA2773398A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0428Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus

Abstract

A system, method and apparatus for converting movement in an area to digital data for processing; a label/object with coded 2nd material which has different temperature coefficient and light reflection factor than the label/object body and writing instrument, is a very cost effective and effective passive method to iden-tify multiple passive writing instruments moving at the same time, and regardless of shape of writing in-struments;
a flexible and detachable reflection mirrors and rods make the system flexible, adjustable and is portable. Light and laser sub-systems provide light and heat to the monitored area and writing instruments plus for easy installation, setup and calibration.

Description

Flexible and portable multiple passive writing instruments detection system Inventor-David H. Chan, Application #PCT/C A2009/001258, Filing Date-Voluntary Amendment Following PCT National Entry (27 Feb 2012) 1. BACKGROUND OF THE INVENTION.
Many inventions of digitize hand writing for many years already, but have many disadvantages. The inven-tions are based on one or more of technologies of "infrared light transmitter and receiver", "Ultrasonic transmitter and receiver", "CMOS image sensor with IR transmitter", "touch screen", "camera" and "electromagnetic". Electronics pen is necessary in most of the cases and cost of large touch screen is high and there are no existing product can truly identify and detect'Multiple passive writing instrument' work-ing at the same time. To explain this more in details, here is an example, one passive writing instrument write on area and the system identified it as a "Red" pen because of pre-programmed to identify the first writing instrument seen as "Red", while the "Red" pen is writing , another writing instrument pop in and writing also, the system identified it as "Blue" pen, now the "Red" pen leave and the "Blue" pen still writ-ing and the system still identified it as "Blue" pen, then the "Blue" pen leave and pop in again and the sys-tem identify it as "Red" pen but not "Blue" because the system has no way to identify it as "Blue" pen and the system is pre-programmed to identify the first writing instrument seen as "Red". Existing multi-touch systems has same problem. More than one method are used in some inventions to make the system to per-form better but still cannot. All the existing products are designed for fixed writing area including white-board. Touch panel is installed in front of video display unit to form an interactive writing device. All the existing methods have some or all disadvantages as follows: (1) High cost (2) Electronics writing instru-ment (3) High cost touch screen for passive writing instrument identification (4) Must use particular writ-ing instruments (5) Cannot truly identify multiple passive writing instruments which are working at the same time (6) Cannot work with existing projector screen (7) NOT flexible and NOT portable. (8) Sensors are installed at corner of writing area and reduced the effective writing area (9) Linear distortion of wide angle lens and pin hole camera. All these disadvantages limit the function of "multiple passive writing in-strument detection", "flexibility", "portability" and "affordability". These limitations drawn forward my new invention.

Flexible and portable multiple passive writing instruments detection system Inventor-David H. Chan, Application #PCT/C A2009/001258, Filing Date-Voluntary Amendment Following PCT National Entry (27 Feb 2012)
2. DETAIL DESCRIPTION OF THE INVENTION.
According to an aspect of an embodiment of the invention, there is provided a method and system includ-ing (1) Mirrors, (2) Battery and charging, (3) Electronics, (4) Rods, (5) Light subsystem, (6) Laser subsys-tem, (7) Label/Object, (8) Transparent reflection layer, to form an invented "flexible and portable multiple passive writing instruments detection system"; the invented system effectively detect multiple passive writ-ing instruments by identify quantity of 2nd material of the invented "label/object" which represent passive writing instrument in method of quantity of 2nd material; no label/object and 2nd material means number 0 (zero), one 2nd material is identified as number 1 (one) and two 2nd material is identified as number 2 (two) and quantity of 2nd material on label/object is to be identified effectively by image sensors based on different temperature coefficient and light reflection factor of the 2nd material against with the label/object body and writing instrument and is an effective detection method of multiple passive writing instrument without using costly electronics writing instrument and the invented "label/object with coded 2nd material"
is in at least one form which is including label, ring, sleeve, dot, strip, bar and line; images are captured via the invented reflection "mirrors" which are installed in front of the image sensors to reflect the image of the passive writing instruments in the monitored area to the image sensors and identify the related angle and then calculate the intersection of two projection lines to locate the location of writing instrument by simple trigonometry method and further calculate the movement of the passive writing instruments; image sensors monitor the writing instruments' movement within the monitored area via invented "mirrors"
which have curved surface in combination of X, Y and Z axis and is an angle amplifier to widen the view-ing angle of image sensor without using wide angle lens which has linearity distortion issue and the in-vented "mirrors" are adjustable and flexible to match with the monitored area and is detachable to form an invented "flexible and portable" system; the system is operated by internal battery which is including dis-posable and rechargeable batteries and the system is self powered system and is "portable detection sys-tem"; the electronics collect image information from the image sensors, process and deliver to other proc-essing unit, personal computer and electronics devices via serial communication which is including wired and wireless communication; "Rods" are used to hold mirrors via mirror holder and is in telescopic form, detachable from the system and has at least one section and the mirror holders are detachable and adjust-able on the rods and is part of the flexible and portable system; the image of the monitored passive writing instrument and area are light up and heat up by the "light and filter subsystem" which provides heat and light to the writing instruments and monitored area and is controlled by the electronics to have steady, pulsed, free running and synchronized operating modes; an invented "laser light with calibration mirrors subsystem" are included and integrated with the system in the form of closed loop system; the laser light sub-system emits light to light sensor via invented mirrors, calibration mirror in form of a closed loop for calibration of the location and position of invented mirrors, image sensors of the system to cover the moni-tored area correctly and easily and work as light and heat source and is controlled by the electronics to have steady, pulsed, free running and synchronized operating modes; transparent reflection layer is integrated with the monitored area and space to reflect light to sideway for detection and light beam reach the surface and hit the bubble shapes and the bubble shapes reflect the light to all directions and to be captured by the image sensors via the invented reflection mirrors and the location of light beam is identified; hooks are used to hold the rods and the system to form an invented "detachable portable system".

Flexible and portable multiple passive writing instruments detection system Inventor-David H. Chan, Application #PCT/CA2009/001258, Filing Date-09/16/2009 Voluntary Amendment Following PCT National Entry (27 Feb 2012)
3. Description Of Drawings Fig.l: depicts an invented system which is including image sensors, mirrors, light shade, IR filters, batteries, electronics board including micro-controller, rod, rod holder, hooks and mirror holder.
Fig.2: depicts more detail sample view of the invented system which is including components in fig. 1.
Specially designed light shade position and shape which has wide angle of looking toward to monitored writing area. The position of IR filters and the holder of rods.
Fig.3: depicts details of the special designed mirror which is special designed curved mirror to cover any angle of view by changing the curved shape of the mirror. The mirror holder is specially designed to have recessed mirror to reduce the effect of ambient light.
Fig.4: depicts details of the relationship between the invented system and writing area to show how the image sensors look at the monitored area and the relationship between the system and the writing object and the trigonometry relationship for writing instrument location calculation.
Fig.5 and Fig.6: depicts details of the disadvantages of pin hole camera or image sensor and regular cam era or image sensor which are installed at the corner or side of writing area.
Both camera have mini mum distance for taking image as well as other disadvantages shown.
Fig.7: depicts details of the disadvantages of pin hole camera and regular camera to be installed at the corner of writing area. These disadvantages are: (1) Difficult to have 90 degrees or larger of "field of view" to cover the whole area. (2) Minimum object distance reduced and limited the effective monitored area. (3) The writing instrument blocked the field of view of camera or image sensor when the object is close to the camera because the pinhole and the lens are small. (4) The object reduced the viewed area very much even not too close to the camera or image sensor because of the size of pinhole and lens are much smaller in compare with the writing instrument as well as a finger.
(5) Linear distortion of wide angle lens as well as pin hole.
Fig.8: depicts details of the difference between the invented system and the camera which is to be installed at the corner of the writing area. The writing object is much smaller than the mirror, thus the blocked area (shadow area) created by the writing object is much smaller in compare with the pin hole and regular camera which are installed at the corner. Detection of multiple objects will be much more easier and accurate. Minimum distance is moved away from the corner, thus eliminate the minimum distance limit and fully utilize the monitored area. When the object comes in front of the mirror, the object only blocks part of the mirror and thus the camera still can see the area around the writing instrument also.
Fig.9: depicts the usage of the invented system with curved surface. The figure showed two invented systems are used, however it can be more than one invented system and depends on the shape of the curved area.
Fig.10: depicts the details of the label/object which are used to identify writing instruments including finger. Strip or strips are on the label/object to help to be identified, hence different writing instruments can be identified as well as different fingers. Any materials can be used as long as the characteristic difference between the strip and label body is good enough for identification by camera or image sensor.
Fig.11: depicts the details of the invented system to works with projection system, computer system, PDA
and other electronics systems via wired and/or wireless communication links.
Fig.12: depicts the details of the' Laser calibration sub-system' which is for system setup purpose. The laser sub-system help to setup and adjust the mirrors to project a correct image to the image sensors.
Fig.13: depicts the details of the 'LED light sub-system' which includes a LEDs array and a light diffuser which will diffuse the light of LEDs to form a patterned diffused light source to light up the monitored area and writing objects.
Fig.14: depicts the concept of the 'Light reflector ' which is using to enhance the laser light beam spot pick up if necessary. The special designed surface helps to reflect more light to sideway, means more reflection light to camera or image sensors.
Fig.15: depicts the concept of the '3D application' detection by using the X, Y, Z axis mirror reflection nature of the invented system.

Claims

4. Claims [1] An invented method and system which includes (1) Mirrors, (2) Battery and charging, (3) Electronics, (4) Rods, (5) Light subsystem, (6) Laser subsystem, (7) Label/Object, (8) Transparent reflection layer, is an invented "flexible and portable multiple passive writing instrument detection system", and is flexible and portable by adjusting the location of invented mirrors which are installed on the rods via mirror holder and the rods are flexible and detachable from the system to form an invented flexible and portable system; the image sensors which are refer to image sensors including color camera, black and white camera, IR camera, CMOS camera, CCD camera, thermo imaging sensor, pixel sensor and capture images via invented mirrors which have curved surface and identify multiple passive writing instruments by identify invented label/object which has 2nd material with different temperature coeffi-cient and light reflection factor than the label/object body and writing instrument; image information is processed by the electronics and deliver to other electronics devices via serial communication; light and filter sub-system and laser light sub-system are integrated with the system to light up and heat up the monitored area, label/object and the passive writing instruments and provide method of easy instal-lation, setup and calibration by closed loop method.

[2] The mirrors of claim 1 has curved surface in combinations of X, Y and Z
axis.

[3] The mirrors of claim 1 is adjustable and detachable from system.

[4] The battery and charging of claim 1 are refer to batteries including disposable and rechargeable Batteries.

[5] The electronics of claim 1 is including at least one processor, at least one battery, at least one storage element, at least one image sensor, at least one wired serial communication and at least one wireless serial communication.

[6] The rods of claim 1 are in telescopic form with at least one section for flexibility in length.

[7] The rods of claim 1 are detachable from the system.

[8] The light sub-system of claim 1 has at least one wave length light source.

[9] The light sub-system of claim 1 has at least one filter to direct and diffuse the light and heat to the monitored area and space.

[10] The light sub-system of claim 1 is controlled by the electronics to have steady, pulsed, free running and synchronized operating modes.

[11] The laser sub-system of claim 1 is a closed loop system which is including at least one laser light source, at least one light sensor and at least one calibration mirror.

[12] The laser sub-system of claim 1 is controlled by the electronics to have steady, pulsed, free running and synchronized modes.

[13] Label/object of claim 1 has 2nd material which has different temperature coefficient and light reflec-tion factor than the label/object body and writing instrument for identification.

[14] Label/object of claim 1 has "quantity coded" 2nd material on the label/object and is to be identified and represent passive writing instrument which has no label/object and 2nd material on it means number 0 (zero), one 2nd material is identified as number 1(one) and two 2nd material is identified as number 2 (two).

[15] Label/object of claim 1 is to be added to writing instrument by at least one method which is including bonding, printing and injection.

[16] Label/object of claim 1 is in at least one form which is including label, ring, sleeve, dot, strip, bar and line.

[17] Label/object of claim 1 is made and fabricated by at least one type of material which is including paper, plastic, fabric and metal.

[18] Label/object of claim 1 is in at least one shape which is including circular, square, diamond, character, company logo, 2D and 3D shape.

[19] The transparent reflection layer of claim 1 is transparent layer with bubbles surface.

[20] The transparent reflection layer of claim 1 has bubbles which are including at least one shape which is including round, diamond, pyramids, prisms, cylinder, cone, flat and sphere shapes.
CA2773398A 2009-09-16 2009-09-16 Flexible and portable multiple passive writing instruments detection system Abandoned CA2773398A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CA2009/001258 WO2011032250A1 (en) 2009-09-16 2009-09-16 Flexible and portable multiple passive writing instruments detection system

Publications (1)

Publication Number Publication Date
CA2773398A1 true CA2773398A1 (en) 2011-03-24

Family

ID=43757972

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2773398A Abandoned CA2773398A1 (en) 2009-09-16 2009-09-16 Flexible and portable multiple passive writing instruments detection system

Country Status (2)

Country Link
CA (1) CA2773398A1 (en)
WO (1) WO2011032250A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014063020A1 (en) * 2012-10-18 2014-04-24 Chornenky T Eric Apparatus and method for determining spatial information about environment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6067080A (en) * 1997-02-21 2000-05-23 Electronics For Imaging Retrofittable apparatus for converting a substantially planar surface into an electronic data capture device
US6335724B1 (en) * 1999-01-29 2002-01-01 Ricoh Company, Ltd. Method and device for inputting coordinate-position and a display board system
US8102377B2 (en) * 2007-09-14 2012-01-24 Smart Technologies Ulc Portable interactive media presentation system

Also Published As

Publication number Publication date
WO2011032250A1 (en) 2011-03-24

Similar Documents

Publication Publication Date Title
US9148573B2 (en) Non-uniform correction illumination pattern
KR101851264B1 (en) System and Method for a Virtual Multi-touch Mouse and Stylus Apparatus
US8339378B2 (en) Interactive input system with multi-angle reflector
EP3007045B1 (en) Method and device for non-contact sensing of reproduced image pointing location
US8890842B2 (en) Eraser for use with optical interactive surface
WO2010122762A1 (en) Optical position detection apparatus
WO2010137277A1 (en) Optical position detection apparatus
KR20100137433A (en) Digital pens and a method for digital recording of information
US8294082B2 (en) Probe with a virtual marker
TWI446249B (en) Optical imaging device
WO2016119906A1 (en) Multi-modal gesture based interactive system and method using one single sensing system
WO2012070950A1 (en) Camera-based multi-touch interaction and illumination system and method
JP2014517361A (en) Camera-type multi-touch interaction device, system and method
WO2012010441A1 (en) Display with coding pattern
US20120069054A1 (en) Electronic display systems having mobile components
TWI511006B (en) Optical imaging system and imaging processing method for optical imaging system
TWI394072B (en) Apparatus for detecting a touching position on a flat display and a method thereof
CA2773398A1 (en) Flexible and portable multiple passive writing instruments detection system
US20110050652A1 (en) Flexible and portable multiple passive writing instruments detection system
JP2004038528A (en) Optical coordinate detecting device
CN101859189B (en) Optical input system and method
KR100861748B1 (en) An infrared light LED mouse system
TW201506741A (en) touchscreen
KR20140044525A (en) Touch screen frame using motion sensor camera and display system including the same
TWI450133B (en) Portable handwriting input apparatus

Legal Events

Date Code Title Description
EEER Examination request
FZDE Discontinued

Effective date: 20150916