US9684415B2 - Optical touch-control system utilizing retro-reflective touch-control device - Google Patents

Optical touch-control system utilizing retro-reflective touch-control device Download PDF

Info

Publication number
US9684415B2
US9684415B2 US14/458,540 US201414458540A US9684415B2 US 9684415 B2 US9684415 B2 US 9684415B2 US 201414458540 A US201414458540 A US 201414458540A US 9684415 B2 US9684415 B2 US 9684415B2
Authority
US
United States
Prior art keywords
touch
cluster
retro
processor
threshold
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US14/458,540
Other versions
US20160018947A1 (en
Inventor
Chien-Hung Lin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Quanta Computer Inc
Original Assignee
Quanta Computer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Quanta Computer Inc filed Critical Quanta Computer Inc
Assigned to QUANTA COMPUTER INC. reassignment QUANTA COMPUTER INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LIN, CHIEN-HUNG
Publication of US20160018947A1 publication Critical patent/US20160018947A1/en
Application granted granted Critical
Publication of US9684415B2 publication Critical patent/US9684415B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus

Definitions

  • the present invention relates to an optical system, and, in particular, to an optical touch-control system capable of determining a touch position by using a retro-reflective touch-control device.
  • an optical touch-control system includes: a display unit; a light source; a retro-reflective touch-control device; at least two image capturing units, configured to capture a plurality of images in front of the display unit, which are generated by the retro-reflective touch-control device reflecting the light emitted from the light source; and a processor, wherein the processor determines whether at least one first cluster is in the images from the image capturing units based on a first threshold, wherein the processor further calculates a touch position of the retro-reflective touch-control device on the display unit based on the at least one first cluster.
  • FIG. 1 is a schematic block diagram of an optical touch-control system in accordance with an embodiment of the invention
  • FIG. 2A is a diagram of the optical touch-control system in accordance with an embodiment of the invention.
  • FIG. 2B is a diagram illustrating the capturing of images by the optical touch-control system 100 in accordance with an embodiment of the invention
  • FIG. 2C is a diagram illustrating capturing images by the optical touch-control system in accordance with an embodiment of the invention.
  • FIG. 2D is a diagram illustrating the calculation of touch positions by the optical touch-control system in accordance with an embodiment of the invention.
  • FIG. 3A is a structure diagram of the retro-reflective touch-control device in accordance with an embodiment of the invention.
  • FIG. 3B is a diagram illustrating the retro-reflective touch-control device being pressed in accordance with the embodiment of FIG. 3A ;
  • FIG. 3C is a structure diagram of the holding portion of the retro-reflective touch-control device in accordance with an embodiment of the invention.
  • FIG. 4A is a diagram illustrating the initial captured images from the reflected light of the retro-reflective touch-control device in accordance with an embodiment of the invention
  • FIG. 4B is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a remote location in accordance with the embodiment of FIG. 4A ;
  • FIG. 4C is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a close location in accordance with the embodiment of FIG. 4A ;
  • FIG. 4D is a diagram of setting a first threshold in the captured images in accordance with an embodiment of the invention.
  • FIG. 4E is a diagram illustrating capturing images by the optical touch-control system in accordance with another embodiment of the invention.
  • FIG. 5 is a flow chart illustrating a touch-control method in accordance with an embodiment of the invention.
  • FIG. 1 is a schematic block diagram of an optical touch-control system in accordance with an embodiment of the invention.
  • the optical touch-control system 100 may comprise at least two image capturing units 110 , at least two light sources 120 , a processor 130 , a retro-reflective touch-control device 140 , and a display unit 150 , wherein each image capturing unit 110 has an associated light source 120 .
  • each image capturing unit 110 and its associated light source 120 can be integrated into a camera module 200 , which can be deployed at a corner or boundary of the display unit 150 , where the display unit 150 may be a TV, display, or monitor without touch-control functionality.
  • each image capturing unit 110 may be an infrared camera, and each light source 120 may be an infrared light source, but the invention is not limited thereto.
  • the retro-reflective touch-control device (e.g. a retro-reflective stylus) 140 is used for the user to tap on a desired touch position on the display unit 150 (i.e. a touch surface), and the retro-reflective touch-control device 140 may comprise a retro-reflector 143 configured to reflect the light from the light sources 120 (e.g. infrared light), so that the image capturing units 110 may detect the reflected light and capture images.
  • the image capturing units 110 may constantly capture images of a touch object on the surface of the display unit 150 .
  • the processor 130 may analyze the captured images from the image capturing units 110 and determine the reflection point (i.e. reflected by the retro-reflector 143 ) and the touch position on the touch surface.
  • FIG. 2A is a diagram of the optical touch-control system in accordance with an embodiment of the invention.
  • the camera module 200 comprising the image capturing unit 110 and the light source 120 is deployed on a boundary or corner of the display unit 150 , and the optical touch-control system 100 is operated on the touch surface 210 which comprises the viewable region of the display unit 150 .
  • FIG. 2B is a diagram illustrating capturing images by the optical touch-control system 100 in accordance with an embodiment of the invention.
  • each image capturing unit 110 may capture images within a capture range, wherein the boundary of the capture range may be the boundary of the display unit 150 .
  • the image capturing unit 110 located at the upper-left corner has a capture range between the boundaries 230 and 240 of the display unit 150 .
  • the processor 130 may determine the position of the reflection point 250 based on the captured images from the image capturing unit 110 , wherein the angle between the boundary 240 of the display unit 150 and the line passing through the reflection point and the image capturing unit 110 is ⁇ , wherein the angle ⁇ may be any angle between the boundaries 230 and 240 .
  • FIG. 2C is a diagram illustrating capturing images by the optical touch-control system in accordance with an embodiment of the invention.
  • the optical touch-control system 100 when the optical touch-control system 100 is being calibrated, there are several calibration points at known angles located on the touch surface 210 , such as calibration points 260 ⁇ 269 , and the touch surface can be divided into ten regions based on different angles.
  • the processor 130 may record the pixel location of each calibration point from the captured images from the image capturing units 110 , and establish an angle information database or a look-up table based on the pixel locations of the calibration points.
  • FIG. 2D is a diagram illustrating calculation for touch positions by the optical touch-control system in accordance with an embodiment of the invention.
  • the upper-left image capturing unit 110 has associated calibration points 261 ⁇ 269 , and the touch surface 210 can be divided into ten regions based on different angles relative to the upper-left image capturing unit 110 .
  • the touch surface 210 can be divided into ten regions based on different angles relative to the upper-right image capturing unit 110 .
  • the processor 130 may determine the region in which the reflection point is located based on the angle information database or the look-up table.
  • the processor 130 may further determine the angles ⁇ L and ⁇ R between the boundary 240 and the lines passing through the upper-left/upper-right image capturing units 110 and the reflection points, respectively. Specifically, if the coordinates of the upper-left image capturing unit 110 are (x 1 , y 1 ), and the coordinates of the upper-right image capturing unit 110 are (x 2 , y 2 ) and the angles between the reflection point and two image capturing units 110 are known, the coordinates (X, Y) of the reflection point can be calculated by using the trigonometric function or simultaneous linear equations.
  • FIG. 3A is a structure diagram of the retro-reflective touch-control device in accordance with an embodiment of the invention.
  • FIG. 3B is a diagram illustrating the retro-reflective touch-device being pressed in accordance with the embodiment of FIG. 3A .
  • the structure of the retro-reflective touch-control device 140 is a pen, which includes a holding portion 141 , a nib portion 142 , and a retro-reflector 143 .
  • the retro-reflector 143 is circularly attached on the nib portion 142
  • the retro-reflector 143 is covered by a circular structure of the holding portion 141 when the retro-reflective touch-control device is not pressed.
  • a spring is deployed in the holding portion 141 .
  • the nib portion 142 of the retro-reflective touch-control device 140 e.g. by pressing on the touch surface
  • a portion of the nib portion 142 may be pushed into the holding portion 141 so that the retro-reflector 143 is exposed, as shown in FIG. 3B .
  • FIG. 3C is a structure diagram of the holding portion of the retro-reflective touch-control device in accordance with an embodiment of the invention.
  • the holding portion 141 of the retro-reflective touch-control device 140 further comprises a rib structure 145 .
  • the retro-reflector 143 When the retro-reflective touch-control device is not pressed, the retro-reflector 143 is covered by the rib structure 145 .
  • the retro-reflector 143 may be exposed at the hollow portion of the rib structure, thereby reflecting the infrared light from the light sources 120 .
  • the reflected light from the retro-reflector 143 may be strong when the retro-reflective touch-control device 140 is close to the image capturing units 110 . Accordingly, a flare or ghost shadows may occur in the captured images, wherein the ghost shadow may result in lower accuracy and serious jitter while performing touch operations.
  • FIG. 4A is a diagram illustrating the initial captured images from the reflected light of retro-reflective touch-control device in accordance with an embodiment of the invention.
  • FIG. 4B is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a remote location in accordance with the embodiment of FIG. 4A .
  • FIG. 4C is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a close location in accordance with the embodiment of FIG. 4A .
  • FIGS. 1 is a diagram illustrating the initial captured images from the reflected light of retro-reflective touch-control device in accordance with an embodiment of the invention.
  • FIG. 4B is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a remote location in accordance with the embodiment of FIG. 4A .
  • FIG. 4C is a diagram illustrating capturing images from the reflected light of the retro-reflective
  • the vertical direction (Y axis) denotes the brightness of pixels
  • the horizontal direction (X axis) denotes the location of pixels, such as the different one-dimensional locations of the points at different angles in FIG. 2C .
  • the retro-reflector is not exposed to reflect the infrared light from the light source 120 .
  • the initial image (i.e. background images) captured by the image capturing units 110 is shown in FIG. 4A , wherein the brightness of each pixel is kept at a fixed approximate value.
  • the retro-reflective touch-control device 140 When the retro-reflective touch-control device 140 is used at a remote location from the image capturing unit 110 , it indicates that the reflection point is far from the image capturing units 110 , and the image captured by the image capturing unit 110 is shown in FIG. 4B , wherein the brightness of a majority of the pixels are kept at a fixed approximate value, and the brightness of the reflection point is much higher than that of other pixels.
  • the retro-reflective touch-control device 140 When the retro-reflective touch-control device 140 is used at a location that is close to the image capturing unit 110 , it indicates that the reflection point is close to the image capturing units 10 , and the image captured by the image capturing unit 110 is shown in FIG.
  • the brightness of a majority of the pixels are kept at a fixed approximate value, and the brightness of the reflection point, the primary shadow, and the ghost shadow is higher than that of other pixels.
  • the brightness of the primary shadow is much higher than that of other pixels, and the brightness of the ghost shadow is slightly higher than that of other pixels except the primary shadow.
  • FIG. 4D is a diagram of setting a first threshold in the captured images in accordance with an embodiment of the invention.
  • the processor 130 may filter out the pixels having brightness values lower than a first threshold (e.g. the dashed line 480 ) in the captured images, thereby eliminating the impact of the ghost shadow and accurately determining the touch position, as shown in FIG. 4D .
  • the processor 130 may determine that the pixels having brightness values higher than the first threshold and the second threshold are the primary shadow, which is regarded as the reflection point (touch point).
  • an image algorithm using two threshold values is provided to eliminate the impact of the ghost shadow, and the principles to set the threshold values are described as follows: (A) the pixel brightness values of the primary shadow with the increment exceed the first threshold when the primary shadow of the retro-reflective touch-control device is at a remote location from the image capturing units 110 ; (B) the pixel brightness values of the primary shadow with the increment exceed the second threshold, and the brightness of pixels of the ghost shadow does not exceed the second threshold; (C) pixel brightness values of both the primary shadow and ghost shadow are not between the first threshold and the second threshold, wherein the second threshold is greater than the first threshold.
  • the processor 130 may determine clusters in the captured images. That is, the processor 130 may retrieve regions having pixel brightness values higher than the reference pixel brightness, and the mechanisms of the image algorithm having two thresholds are described as follows: (A) when there is no cluster in the captured image by using the first threshold and the second threshold, it indicates that the retro-reflective touch-control device does not touch on the touch surface; (B) when there is a cluster by using the first threshold and no cluster by using the second threshold, the processor 130 may calculate the coordinate of the touch point by using the cluster associated with the first threshold; (C) when there are clusters by using both the first threshold and the second threshold, the processor 130 may ignore the clusters associated with the first threshold, and calculate the coordinate of the touch point by using the cluster associated with the second threshold.
  • FIG. 4E is a diagram illustrating capturing images by the optical touch-control system in accordance with another embodiment of the invention.
  • the nib portion 142 of the retro-reflective touch-control device 140 comprises a rib structure
  • the infrared light reflected by the retro-reflector 143 may be segmented into at least two regions.
  • the retro-reflective touch-control device 140 is used at a location that is close to the image capturing units 110 , it becomes easier to observe the aforementioned segmentation. However, it may result in misjudgment of the touch point since the primary shadow is divided into two regions, such as clusters 450 and 460 shown in FIG. 4E .
  • the processor 130 further uses an image integration algorithm.
  • the processor 130 may integrate the clusters 450 and 460 into an integrated cluster 470 , and the touch position is calculated based on the barycenter of the integral of the integrated cluster 470 .
  • the barycenter of the integrated cluster 470 is calculated based on the region between the left-most and the right-most terminals of the integrated cluster 470 .
  • FIG. 5 is a flow chart illustrating a touch-control method in accordance with an embodiment of the invention.
  • the image capturing units 110 constantly capture background images.
  • the processor 130 sets a first threshold and a second threshold based on the pixel brightness values of the background images, such as a method using a fixed ratio or a fixed offset value being used to set the first threshold and the second threshold.
  • the processor 130 determines the status of clusters in the background images based on the first threshold and the second threshold.
  • the processor 130 may calculate the barycenter associated with the first cluster (step S 550 ).
  • the processor 130 may integrate the second clusters into an integrated cluster (step S 570 ), and calculate the barycenter of the integrated cluster (step S 550 ). Otherwise, the processor 130 may calculate the barycenter of the second cluster (step S 550 ).
  • step S 580 the processor 130 may retrieve angle information of the position of the barycenter relative to the image capturing unit 110 in the operating space based on a look-up table. It should be noted that the processor 130 may perform the aforementioned steps to each image capturing unit 110 . In step S 590 , the processor 130 may calculate the touch position based on the angle information associated with each image capturing unit 110 .
  • an optical touch-control system and a touch-control method are provided.
  • the optical touch-control system can be installed externally on the display unit without the touch-control function, such as a TV, display, or monitor. Accordingly, the aforementioned display unit may have an additional touch-control function, thereby increasing convenience for the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Studio Devices (AREA)

Abstract

An optical touch-control system is provided. The optical touch-control system includes: a display unit; a light source; a retro-reflective touch-control device; at least two image capturing units, and a processor. The image capturing units are configured to capture a plurality of images in front of the display unit, which are generated by the retro-reflective touch-control device reflecting the light emitted from the light source. The processor determines whether at least one first cluster is in the images from the image capturing units based on a first threshold. The processor further calculates a touch position of the retro-reflective touch-control device on the display unit based on the at least one first cluster.

Description

CROSS REFERENCE TO RELATED APPLICATIONS
This Application claims priority of Taiwan Patent Application No. 103124206, filed on Jul. 15, 2014, the entirety of which is incorporated by reference herein.
BACKGROUND OF THE INVENTION
Field of the Invention
The present invention relates to an optical system, and, in particular, to an optical touch-control system capable of determining a touch position by using a retro-reflective touch-control device.
Description of the Related Art
With advances in technology, electronic devices having a touch panel, such as a smartphones, smart TVs, laptops, and touch screens, have become more and more popular. However, the electronic devices of some users do not have touch-control functionality, such as conventional LCD/LED TVs or displays. Accordingly, if the users want to perform touch-control functions on their existing electronic devices, they have to buy a new TV or display having touch-control functionality, resulting increased cost to the users.
BRIEF SUMMARY OF THE INVENTION
A detailed description is given in the following embodiments with reference to the accompanying drawings.
In an exemplary embodiment, an optical touch-control system is provided. The optical touch-control system includes: a display unit; a light source; a retro-reflective touch-control device; at least two image capturing units, configured to capture a plurality of images in front of the display unit, which are generated by the retro-reflective touch-control device reflecting the light emitted from the light source; and a processor, wherein the processor determines whether at least one first cluster is in the images from the image capturing units based on a first threshold, wherein the processor further calculates a touch position of the retro-reflective touch-control device on the display unit based on the at least one first cluster.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
FIG. 1 is a schematic block diagram of an optical touch-control system in accordance with an embodiment of the invention;
FIG. 2A is a diagram of the optical touch-control system in accordance with an embodiment of the invention;
FIG. 2B is a diagram illustrating the capturing of images by the optical touch-control system 100 in accordance with an embodiment of the invention;
FIG. 2C is a diagram illustrating capturing images by the optical touch-control system in accordance with an embodiment of the invention;
FIG. 2D is a diagram illustrating the calculation of touch positions by the optical touch-control system in accordance with an embodiment of the invention;
FIG. 3A is a structure diagram of the retro-reflective touch-control device in accordance with an embodiment of the invention;
FIG. 3B is a diagram illustrating the retro-reflective touch-control device being pressed in accordance with the embodiment of FIG. 3A;
FIG. 3C is a structure diagram of the holding portion of the retro-reflective touch-control device in accordance with an embodiment of the invention;
FIG. 4A is a diagram illustrating the initial captured images from the reflected light of the retro-reflective touch-control device in accordance with an embodiment of the invention;
FIG. 4B is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a remote location in accordance with the embodiment of FIG. 4A;
FIG. 4C is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a close location in accordance with the embodiment of FIG. 4A;
FIG. 4D is a diagram of setting a first threshold in the captured images in accordance with an embodiment of the invention;
FIG. 4E is a diagram illustrating capturing images by the optical touch-control system in accordance with another embodiment of the invention; and
FIG. 5 is a flow chart illustrating a touch-control method in accordance with an embodiment of the invention.
 DETAILED DESCRIPTION OF THE INVENTION
The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
FIG. 1 is a schematic block diagram of an optical touch-control system in accordance with an embodiment of the invention. As shown in FIG. 1, the optical touch-control system 100 may comprise at least two image capturing units 110, at least two light sources 120, a processor 130, a retro-reflective touch-control device 140, and a display unit 150, wherein each image capturing unit 110 has an associated light source 120. In an embodiment, each image capturing unit 110 and its associated light source 120 can be integrated into a camera module 200, which can be deployed at a corner or boundary of the display unit 150, where the display unit 150 may be a TV, display, or monitor without touch-control functionality. In an embodiment, each image capturing unit 110 may be an infrared camera, and each light source 120 may be an infrared light source, but the invention is not limited thereto. In an embodiment, the retro-reflective touch-control device (e.g. a retro-reflective stylus) 140 is used for the user to tap on a desired touch position on the display unit 150 (i.e. a touch surface), and the retro-reflective touch-control device 140 may comprise a retro-reflector 143 configured to reflect the light from the light sources 120 (e.g. infrared light), so that the image capturing units 110 may detect the reflected light and capture images. For example, the image capturing units 110 may constantly capture images of a touch object on the surface of the display unit 150. The processor 130 may analyze the captured images from the image capturing units 110 and determine the reflection point (i.e. reflected by the retro-reflector 143) and the touch position on the touch surface.
FIG. 2A is a diagram of the optical touch-control system in accordance with an embodiment of the invention. As shown in FIG. 2A, the camera module 200 comprising the image capturing unit 110 and the light source 120 is deployed on a boundary or corner of the display unit 150, and the optical touch-control system 100 is operated on the touch surface 210 which comprises the viewable region of the display unit 150.
FIG. 2B is a diagram illustrating capturing images by the optical touch-control system 100 in accordance with an embodiment of the invention. In an embodiment, as shown in FIG. 2B, each image capturing unit 110 may capture images within a capture range, wherein the boundary of the capture range may be the boundary of the display unit 150. For example, the image capturing unit 110 located at the upper-left corner has a capture range between the boundaries 230 and 240 of the display unit 150. Specifically, the processor 130 may determine the position of the reflection point 250 based on the captured images from the image capturing unit 110, wherein the angle between the boundary 240 of the display unit 150 and the line passing through the reflection point and the image capturing unit 110 is θ, wherein the angle θ may be any angle between the boundaries 230 and 240.
FIG. 2C is a diagram illustrating capturing images by the optical touch-control system in accordance with an embodiment of the invention. In an embodiment, when the optical touch-control system 100 is being calibrated, there are several calibration points at known angles located on the touch surface 210, such as calibration points 260˜269, and the touch surface can be divided into ten regions based on different angles. For one having ordinary skill in the art, it will be appreciated that the number of calibration points in the aforementioned embodiment is for description, and the invention is not limited thereto, and the number and positions of the calibration points can be adjusted based on practical conditions. The processor 130 may record the pixel location of each calibration point from the captured images from the image capturing units 110, and establish an angle information database or a look-up table based on the pixel locations of the calibration points.
FIG. 2D is a diagram illustrating calculation for touch positions by the optical touch-control system in accordance with an embodiment of the invention. For example, referring to FIG. 2C, the upper-left image capturing unit 110 has associated calibration points 261˜269, and the touch surface 210 can be divided into ten regions based on different angles relative to the upper-left image capturing unit 110. Similarly, the touch surface 210 can be divided into ten regions based on different angles relative to the upper-right image capturing unit 110. When the processor 130 detects the reflection point from the captured images, the processor 130 may determine the region in which the reflection point is located based on the angle information database or the look-up table. The processor 130 may further determine the angles θL and θR between the boundary 240 and the lines passing through the upper-left/upper-right image capturing units 110 and the reflection points, respectively. Specifically, if the coordinates of the upper-left image capturing unit 110 are (x1, y1), and the coordinates of the upper-right image capturing unit 110 are (x2, y2) and the angles between the reflection point and two image capturing units 110 are known, the coordinates (X, Y) of the reflection point can be calculated by using the trigonometric function or simultaneous linear equations.
FIG. 3A is a structure diagram of the retro-reflective touch-control device in accordance with an embodiment of the invention. FIG. 3B is a diagram illustrating the retro-reflective touch-device being pressed in accordance with the embodiment of FIG. 3A. As shown in FIG. 3A, the structure of the retro-reflective touch-control device 140 is a pen, which includes a holding portion 141, a nib portion 142, and a retro-reflector 143. In an embodiment, the retro-reflector 143 is circularly attached on the nib portion 142, and the retro-reflector 143 is covered by a circular structure of the holding portion 141 when the retro-reflective touch-control device is not pressed. For example, a spring is deployed in the holding portion 141. When the user presses the nib portion 142 of the retro-reflective touch-control device 140 (e.g. by pressing on the touch surface), a portion of the nib portion 142 may be pushed into the holding portion 141 so that the retro-reflector 143 is exposed, as shown in FIG. 3B.
FIG. 3C is a structure diagram of the holding portion of the retro-reflective touch-control device in accordance with an embodiment of the invention. As shown in FIG. 3C, the holding portion 141 of the retro-reflective touch-control device 140 further comprises a rib structure 145. When the retro-reflective touch-control device is not pressed, the retro-reflector 143 is covered by the rib structure 145. When the user presses the nib portion 142 of the retro-reflective touch-control device 140, the retro-reflector 143 may be exposed at the hollow portion of the rib structure, thereby reflecting the infrared light from the light sources 120. It should be noted that the reflected light from the retro-reflector 143 may be strong when the retro-reflective touch-control device 140 is close to the image capturing units 110. Accordingly, a flare or ghost shadows may occur in the captured images, wherein the ghost shadow may result in lower accuracy and serious jitter while performing touch operations.
FIG. 4A is a diagram illustrating the initial captured images from the reflected light of retro-reflective touch-control device in accordance with an embodiment of the invention. FIG. 4B is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a remote location in accordance with the embodiment of FIG. 4A. FIG. 4C is a diagram illustrating capturing images from the reflected light of the retro-reflective touch-control device at a close location in accordance with the embodiment of FIG. 4A. In FIGS. 4A˜4C, the vertical direction (Y axis) denotes the brightness of pixels, and the horizontal direction (X axis) denotes the location of pixels, such as the different one-dimensional locations of the points at different angles in FIG. 2C. When the retro-reflective touch-control device 140 is not used, the retro-reflector is not exposed to reflect the infrared light from the light source 120. The initial image (i.e. background images) captured by the image capturing units 110 is shown in FIG. 4A, wherein the brightness of each pixel is kept at a fixed approximate value. When the retro-reflective touch-control device 140 is used at a remote location from the image capturing unit 110, it indicates that the reflection point is far from the image capturing units 110, and the image captured by the image capturing unit 110 is shown in FIG. 4B, wherein the brightness of a majority of the pixels are kept at a fixed approximate value, and the brightness of the reflection point is much higher than that of other pixels. When the retro-reflective touch-control device 140 is used at a location that is close to the image capturing unit 110, it indicates that the reflection point is close to the image capturing units 10, and the image captured by the image capturing unit 110 is shown in FIG. 4C, wherein the brightness of a majority of the pixels are kept at a fixed approximate value, and the brightness of the reflection point, the primary shadow, and the ghost shadow is higher than that of other pixels. In addition, the brightness of the primary shadow is much higher than that of other pixels, and the brightness of the ghost shadow is slightly higher than that of other pixels except the primary shadow.
FIG. 4D is a diagram of setting a first threshold in the captured images in accordance with an embodiment of the invention. In an embodiment, the processor 130 may filter out the pixels having brightness values lower than a first threshold (e.g. the dashed line 480) in the captured images, thereby eliminating the impact of the ghost shadow and accurately determining the touch position, as shown in FIG. 4D. Specifically, the processor 130 may determine that the pixels having brightness values higher than the first threshold and the second threshold are the primary shadow, which is regarded as the reflection point (touch point).
In another embodiment, an image algorithm using two threshold values is provided to eliminate the impact of the ghost shadow, and the principles to set the threshold values are described as follows: (A) the pixel brightness values of the primary shadow with the increment exceed the first threshold when the primary shadow of the retro-reflective touch-control device is at a remote location from the image capturing units 110; (B) the pixel brightness values of the primary shadow with the increment exceed the second threshold, and the brightness of pixels of the ghost shadow does not exceed the second threshold; (C) pixel brightness values of both the primary shadow and ghost shadow are not between the first threshold and the second threshold, wherein the second threshold is greater than the first threshold.
Specifically, the processor 130 may determine clusters in the captured images. That is, the processor 130 may retrieve regions having pixel brightness values higher than the reference pixel brightness, and the mechanisms of the image algorithm having two thresholds are described as follows: (A) when there is no cluster in the captured image by using the first threshold and the second threshold, it indicates that the retro-reflective touch-control device does not touch on the touch surface; (B) when there is a cluster by using the first threshold and no cluster by using the second threshold, the processor 130 may calculate the coordinate of the touch point by using the cluster associated with the first threshold; (C) when there are clusters by using both the first threshold and the second threshold, the processor 130 may ignore the clusters associated with the first threshold, and calculate the coordinate of the touch point by using the cluster associated with the second threshold.
FIG. 4E is a diagram illustrating capturing images by the optical touch-control system in accordance with another embodiment of the invention. In the aforementioned embodiment, since the nib portion 142 of the retro-reflective touch-control device 140 comprises a rib structure, the infrared light reflected by the retro-reflector 143 may be segmented into at least two regions. When the retro-reflective touch-control device 140 is used at a location that is close to the image capturing units 110, it becomes easier to observe the aforementioned segmentation. However, it may result in misjudgment of the touch point since the primary shadow is divided into two regions, such as clusters 450 and 460 shown in FIG. 4E. To solve the aforementioned issue, the processor 130 further uses an image integration algorithm. For example, when the processor 130 determines that there are more than two clusters by using the same threshold (e.g. the second threshold shown as the dashed line 490), the processor 130 may integrate the clusters 450 and 460 into an integrated cluster 470, and the touch position is calculated based on the barycenter of the integral of the integrated cluster 470. In another embodiment, the barycenter of the integrated cluster 470 is calculated based on the region between the left-most and the right-most terminals of the integrated cluster 470.
FIG. 5 is a flow chart illustrating a touch-control method in accordance with an embodiment of the invention. In step S510, the image capturing units 110 constantly capture background images. In step S520, the processor 130 sets a first threshold and a second threshold based on the pixel brightness values of the background images, such as a method using a fixed ratio or a fixed offset value being used to set the first threshold and the second threshold. In step S530, the processor 130 determines the status of clusters in the background images based on the first threshold and the second threshold. When the processor 130 determines that there is no cluster in the background images by using the first threshold and the second threshold, it indicates that the retro-reflective touch-control device 140 does not touch the touch surface, and the processor 130 does not generate any output commands (step S540). When the processor 130 determines that there is only a first cluster in the background image by using the first threshold, the processor 130 may calculate the barycenter associated with the first cluster (step S550). When the processor 130 determines that there are at least one first cluster and at least one second cluster in the background image respectively using the first threshold and the second threshold, the processor 130 merely considers the second cluster (step S555), and the processor 130 further determines whether the number of the at least one second cluster is more than one (step S560). If so, the processor 130 may integrate the second clusters into an integrated cluster (step S570), and calculate the barycenter of the integrated cluster (step S550). Otherwise, the processor 130 may calculate the barycenter of the second cluster (step S550).
In step S580, the processor 130 may retrieve angle information of the position of the barycenter relative to the image capturing unit 110 in the operating space based on a look-up table. It should be noted that the processor 130 may perform the aforementioned steps to each image capturing unit 110. In step S590, the processor 130 may calculate the touch position based on the angle information associated with each image capturing unit 110.
In view of the above, an optical touch-control system and a touch-control method are provided. The optical touch-control system can be installed externally on the display unit without the touch-control function, such as a TV, display, or monitor. Accordingly, the aforementioned display unit may have an additional touch-control function, thereby increasing convenience for the user.
While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. On the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.

Claims (7)

What is claimed is:
1. An optical touch-control system, comprising:
a display unit;
a light source;
a retro-reflective touch-control device comprising a retro-reflector covered by a rib structure;
at least two image capturing units, configured to capture a plurality of images in front of the display unit, which are generated by the retro-reflective touch-control device reflecting the light emitted from the light source, wherein each image capturing unit is an infrared camera; and
a processor, wherein the processor determines whether at least one first cluster is in the images from the image capturing units based on a first threshold,
wherein the processor further calculates a touch position of the retro-reflective touch-control device on the display unit based on the at least one first cluster,
wherein the processor further determines whether at least one second cluster is in the images from the image capturing units based on a second threshold,
wherein when the processor determines that only the first cluster is associated with the first threshold in the images, the processor calculates a barycenter of the first cluster, and
wherein when the processor determines that both there is at least one first cluster associated with the first threshold and at least one second cluster associated with the second threshold, the processor further determines whether the number of the at least one second cluster is more than one,
if so, the processor integrates the at least one second cluster into an integrated cluster, ignoring the at least one first cluster, and calculates the barycenter of the integrated cluster;
if not, the processor calculates the barycenter of the second cluster ignoring the at least one first cluster.
2. The optical touch-control system as claimed in claim 1, wherein the light source is an infrared light source.
3. The optical touch-control system as claimed in claim 1, wherein the processor sets up the first threshold and the second threshold based on a brightness setting of the images, wherein the second threshold is larger than the first threshold.
4. The optical touch-control system as claimed in claim 1, wherein when the processor determines that there is no first cluster and second cluster in the images based on the first threshold and the second threshold, the processor does not generate any output command.
5. The optical touch-control system as claimed in claim 1, wherein the processor retrieves angle information of the barycenter relative to each image capturing unit in an operating space in front of the display unit based on a look-up table.
6. The optical touch-control system as claimed in claim 5, wherein the processor further calculates the touch position based on the angle information relative to each image capturing unit.
7. The optical touch-control system as claimed in claim 1, wherein the retro-reflective touch-control device is a retro-reflective stylus comprising a holding portion, a nib portion, and a retro-reflector, wherein the retro-reflector is attached on the nib portion and is covered by the holding portion, wherein the retro-reflector is exposed to reflect the light emitted from the light source when the user presses the nib portion on the display unit.
US14/458,540 2014-07-15 2014-08-13 Optical touch-control system utilizing retro-reflective touch-control device Active US9684415B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
TW103124206A 2014-07-15
TW103124206A TWI543046B (en) 2014-07-15 2014-07-15 Optical touch-control system
TW103124206 2014-07-15

Publications (2)

Publication Number Publication Date
US20160018947A1 US20160018947A1 (en) 2016-01-21
US9684415B2 true US9684415B2 (en) 2017-06-20

Family

ID=55074590

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/458,540 Active US9684415B2 (en) 2014-07-15 2014-08-13 Optical touch-control system utilizing retro-reflective touch-control device

Country Status (3)

Country Link
US (1) US9684415B2 (en)
CN (1) CN105278760B (en)
TW (1) TWI543046B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230215199A1 (en) * 2020-07-07 2023-07-06 SOCIéTé BIC Writing instrument

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI509474B (en) * 2014-05-01 2015-11-21 Quanta Comp Inc Stylus

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6498602B1 (en) * 1999-11-11 2002-12-24 Newcom, Inc. Optical digitizer with function to recognize kinds of pointing instruments
US20070052692A1 (en) * 2005-09-08 2007-03-08 Gruhlke Russell W Position detection system
US20110234542A1 (en) * 2010-03-26 2011-09-29 Paul Marson Methods and Systems Utilizing Multiple Wavelengths for Position Detection
US20120306820A1 (en) * 2011-06-02 2012-12-06 Uc-Logic Technology Corp. Optical touch device and locating method thereof
CN203276195U (en) 2013-05-30 2013-11-06 硕擎科技股份有限公司 Optical touch system device utilizing optical pen
US20150109258A1 (en) * 2013-10-22 2015-04-23 Wistron Corporation Optical touch system, method of touch detection, and computer program product

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010026693A (en) * 2008-07-17 2010-02-04 Sony Corp Information input device, image display, and stylus pen
TW201037579A (en) * 2009-04-14 2010-10-16 Arima Photovoltaic & Optical Corp Optical input device with multi-touch control
CN101639746B (en) * 2009-07-16 2012-04-18 广东威创视讯科技股份有限公司 Automatic calibration method of touch screen
JP5424475B2 (en) * 2009-10-13 2014-02-26 株式会社ジャパンディスプレイ Information input device, information input method, information input / output device, information input program, and electronic device
US8803846B2 (en) * 2009-12-17 2014-08-12 Lg Display Co., Ltd. Method for detecting touch and optical touch sensing system
TWI521410B (en) * 2010-06-14 2016-02-11 原相科技股份有限公司 Apparatus and method for acquiring object image of a pointer
CN101901087B (en) * 2010-07-27 2013-04-10 广东威创视讯科技股份有限公司 Surface positioning device and method based on linear image sensors
TWI448918B (en) * 2011-09-09 2014-08-11 Pixart Imaging Inc Optical panel touch system
CN103885646B (en) * 2012-12-21 2016-12-28 原相科技股份有限公司 Optical touch-control device and operational approach thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6498602B1 (en) * 1999-11-11 2002-12-24 Newcom, Inc. Optical digitizer with function to recognize kinds of pointing instruments
US20070052692A1 (en) * 2005-09-08 2007-03-08 Gruhlke Russell W Position detection system
US20110234542A1 (en) * 2010-03-26 2011-09-29 Paul Marson Methods and Systems Utilizing Multiple Wavelengths for Position Detection
US20120306820A1 (en) * 2011-06-02 2012-12-06 Uc-Logic Technology Corp. Optical touch device and locating method thereof
CN203276195U (en) 2013-05-30 2013-11-06 硕擎科技股份有限公司 Optical touch system device utilizing optical pen
US20150109258A1 (en) * 2013-10-22 2015-04-23 Wistron Corporation Optical touch system, method of touch detection, and computer program product

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Chinese language office action dated Mar. 2, 2016, issued in application No. TW 103124206.

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230215199A1 (en) * 2020-07-07 2023-07-06 SOCIéTé BIC Writing instrument

Also Published As

Publication number Publication date
TWI543046B (en) 2016-07-21
US20160018947A1 (en) 2016-01-21
CN105278760B (en) 2019-02-15
CN105278760A (en) 2016-01-27
TW201602876A (en) 2016-01-16

Similar Documents

Publication Publication Date Title
US10191594B2 (en) Projection-type video display device
US10585473B2 (en) Visual gestures
US9122354B2 (en) Detecting wave gestures near an illuminated surface
US9886933B2 (en) Brightness adjustment system and method, and mobile terminal
US9632592B1 (en) Gesture recognition from depth and distortion analysis
JP2011028746A (en) Gesture recognition method and touch system incorporating the same
US20120236180A1 (en) Image adjustment method and electronics system using the same
CN104777927A (en) Image type touch control device and control method thereof
JP2012238293A (en) Input device
WO2011047459A1 (en) Touch-input system with selectively reflective bezel
US9684415B2 (en) Optical touch-control system utilizing retro-reflective touch-control device
US20160019424A1 (en) Optical touch-control system
CN104978018B (en) Touch system and touch method
JP4455185B2 (en) Presentation system, control method therefor, program, and storage medium
WO2011096571A1 (en) Input device
US9489077B2 (en) Optical touch panel system, optical sensing module, and operation method thereof
US9946333B2 (en) Interactive image projection
KR20110079969A (en) Display device and control method thereof
KR101065771B1 (en) Touch display system
US20100302207A1 (en) Optical Touch Control Method and Apparatus Thereof
WO2019100547A1 (en) Projection control method, apparatus, projection interaction system, and storage medium
US10698536B2 (en) Method of detecting touch position and touch apparatus thereof
KR102221192B1 (en) Interactive screen device
KR102257766B1 (en) Fingerprint recognition system and method using touchscreen and actuator
KR20100134398A (en) Optical receiver which enables pointing on a screen of a display apparatus by using a moving direction and orientation angle of optical source

Legal Events

Date Code Title Description
AS Assignment

Owner name: QUANTA COMPUTER INC., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIN, CHIEN-HUNG;REEL/FRAME:033525/0391

Effective date: 20140805

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4