WO2005045658A1 - 位置検出装置及び位置検出方法 - Google Patents
位置検出装置及び位置検出方法 Download PDFInfo
- Publication number
- WO2005045658A1 WO2005045658A1 PCT/JP2004/016389 JP2004016389W WO2005045658A1 WO 2005045658 A1 WO2005045658 A1 WO 2005045658A1 JP 2004016389 W JP2004016389 W JP 2004016389W WO 2005045658 A1 WO2005045658 A1 WO 2005045658A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pointer
- window
- detection
- detecting device
- sub
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
Definitions
- the present invention relates to a position detecting device and a position detecting method, and more particularly, to a position detecting method and a position detecting method that uses a sub-sampling function and a window jung function to increase the following speed without deteriorating the position detecting accuracy of a pointer. It relates to a detection device.
- the optical position detection device includes a device using a line image sensor as an image pickup device of the image pickup unit and a device using an area image sensor.
- a line image sensor as an image pickup device of the image pickup unit
- an area image sensor there is one that photographs a predetermined two-point indicator near a detection area and calculates the indicated position based on the principle of triangulation.
- Patent Document 1 A typical position detecting device using a line image sensor is disclosed in Patent Document 1, for example.
- Patent Document 2 there is a device using an area image sensor that captures an image of a detection region from above the detection region, detects a pointer, and calculates the coordinates of the specified position.
- Patent Document 1 US Pat. No. 4,507,557 (FIGS. 1 and 4)
- Patent Document 2 Japanese Patent Application Laid-Open No. 2001-209487
- the frame readout rate of the image sensor is at least 70 frames per second, preferably 100 frames per second.
- the above detection speed is required.
- the frame readout rate is high.
- the area image sensor has a large number of pixels, so its frame readout rate is about 14 frames per second, and about 30 frames at high speed. Therefore, as it is, It cannot be used for applications. It is conceivable to use an image sensor having a small number of pixels in order to increase the frame readout rate.
- an object of the present invention is to provide a position detecting device and a position detecting method in which the following speed is increased without lowering the position detecting accuracy of the pointer.
- a position detecting device includes a sub-sampling means for reading data from a predetermined pixel from all pixels of an imaging element by an intervening IV, A window jug means for reading data of a window defined by an arbitrary size and an arbitrary size in all the pixels.
- the sub-sampling means reads out the entire detection area where the pointer is placed.
- the data force read by the sub-sampling means may also have a detecting means for detecting an approximate pointing position of the pointer.
- the window Jung means reads out data of a window including the approximate indicated position of the pointer from among all the pixels of the image sensor based on the approximate indicated position of the pointer detected by the detecting means. Anything is fine.
- the position of the window may be moved so that the position of the pointer is included in the window, and the pointer may be tracked.
- the sub-sampling means and the window Jung means are repeatedly switched to read data. Also good ⁇ .
- the windowing means can define a plurality of windows and detect a plurality of pointers. If it exists in the area, data of a plurality of windows including the approximate pointing position of each pointer may be read out.
- a light source may be provided near the image sensor, and a retroreflective member may be provided at the tip of the pointer. Further, the pointer may be a finger. Further, a light source may be provided at the tip of the indicator.
- a display device may be provided so that a display screen area of the display device is a detection area where the pointer is placed.
- an operating tool having an image sensor, at least one light source arranged at a predetermined reference position and irradiating the operating tool with light, and a positioning force of the light source viewed from the image sensor included in the operating tool Processing means for calculating the position of the component.
- the imaging element is a CMOS image sensor.
- the position detection method of the present invention in which the pointer placed in the detection area is photographed and the pointing position of the pointer is detected, the total pixel power of the image sensor is reduced by thinning out a predetermined pixel, and the entire detection area is reduced.
- a window jung process for reading out data of a window including the approximate pointing position of the pointer from among all the pixels of the imaging element is provided.
- the sub-sampling process and the window Jung means are repeatedly performed to calculate the pointing position coordinates of each of the pointers. Good.
- the position detection device and the position detection method of the present invention have an advantage that the following speed can be increased without lowering the accuracy of the position detection of the pointer.
- FIG. 1 is a diagram for explaining the outline of the position detecting device according to the first embodiment of the present invention.
- An indicator 2 such as a stylus is placed on the detection area 1 and is moved by a camera 4 provided above the detection area 1. It is something to shoot.
- the display device 6 by combining the display device 6 with the display device 6, the display screen of the display device can be set as the detection area 1 so as to be a touch panel display device.
- the camera 4 has a structure as shown in FIG. That is, the image sensor 41 is a main component, and has an imaging lens 42 for forming an image of the detection area on the image sensor 41.
- the camera 4 is provided with a light source 43. Light emitted from the light source 43 illuminates the entire surface of the detection area 1.
- the indicator 2 is placed in the detection area 1, the light incident on the retroreflective member 3 provided at the tip thereof is reflected back to the incident direction.
- the reflected light is received by the imaging device 41 via the imaging lens 42.
- the pointing position is detected by detecting the reflected light, that is, the position of the brightest part on the image.
- These detections are sent to an electronic computer 5 such as a personal computer connected to the camera 4, where the data is processed.
- an electronic computer 5 such as a personal computer connected to the camera 4, where the data is processed.
- a configuration in which a DSP or the like is provided in the camera and processing is performed therewith may be employed.
- an infrared transmission filter 44 is provided in front of the image sensor 41 to reflect the reflected light emitted from the infrared light emitting diode and reflected by the retroreflective material 3. It is also possible to surely detect. Even if the pointer is a finger, the light hitting the finger is reflected to some extent, so that the pointing position of the finger can be detected. Further, the light source 43 may not be provided on the camera 4 side, and a light source such as an LED may be provided at the tip of the indicator 2 instead of the retroreflective material.
- the image sensor according to the present invention includes a sub-sampling mode for reading out data by thinning out predetermined pixels from all pixels, and a window Jung mode for reading out window data defined by an arbitrary place and an arbitrary size among all the pixels. Is provided.
- the sub-sampling mode is a mode in which data is read by thinning out predetermined pixels when reading the entire detection area where the pointer is placed. Specifically, if sub-sampling is performed from all the pixels by, for example, 1Z4 in the vertical and horizontal directions, respectively, only 1Z16 pixels are read out. Therefore, the frame readout rate is 16 times faster than when reading out all pixels.
- the subsamples are not limited to 1Z4, but 1Z2 and 1Z 8, 1Z 16, etc. may be used.
- the window Jung mode is also called a Window of Interest (WOI) mode.
- pixel data of a portion to be read in the image sensor is defined as a window.
- the window only needs to specify the address of the pixel at the top left of the window and the size of the row and column. That is, by designating the pointer, the height, and the width, it becomes possible to read out only the data of the window defined thereby. For example, if the window size is 1Z4 for all pixels, the frame readout rate is 16 times faster than when reading out all pixels.
- the brightest point that is, the position of the pixel with the highest light receiving intensity is detected.
- This position is the approximate pointing position of the pointer.
- the detection accuracy decreases. For example, when sub-sampling is performed in 1/4, the detection accuracy also drops to 1Z4. Therefore, when the approximate position of the pointer can be detected from the data read in the sub-sampling mode, the mode is switched to the window Jung mode, and the approximate position detected from all the pixels of the image sensor based on this position is included. Define a window and read the data in this window. In the window Jung mode, it is possible to detect the accurate position of the pointer without lowering the detection accuracy. Furthermore, in the window Jung mode, for example, if the size of the window is 1Z4 of all pixels, 224 frames can be read out per second, so that the detection speed is sufficiently high.
- a pen pressure detection function on the detection area surface or the pointer so that it is possible to reliably detect the input to the detection area surface. is there.
- a button such as a click button may be provided, for example, outside the detection area, and the button may be pressed when inputting.
- CMOS image sensor it is preferable to use a CMOS image sensor as the image pickup device! This is because the CMOS image sensor can easily achieve the sub-sampling and windowing of the present invention because of its random access method that can read out a pixel at an arbitrary address in pixel units due to its structure.
- the frame readout rate must be increased to some extent because subsampling can be performed by thinning out vertically transferred data. Is possible.
- the sub-sampling mode is set, and the detection area is photographed (step 301). For example, set to 1Z4 sub-sampling mode. Then, the pixel with the highest received light intensity is detected (step 302), and it is confirmed whether or not the received light intensity of the detected pixel exceeds a predetermined threshold (step 303). This is because light may be detected in addition to the retroreflective material / light source provided at the tip of the pointer. If the threshold value is not exceeded, the flow returns to step 301 to continue subsampling.
- the light receiving intensity of the pixel detected in step 302 exceeds a predetermined threshold, it can be determined that the pointer has been placed in the detection area. Since the detection is performed in the sub-sampling mode, the detection accuracy is too high.
- the position of the pixel exceeding the predetermined threshold is the approximate indicated position of the indicator.
- a window including the approximate pointing position of the pointer is defined from all the pixels of the image sensor, and the data of the window is read (step 304). For example, a 1Z4 size window centered on the approximate pointing position of the pointer is set and read. Then, the pixel having the highest light receiving intensity is detected (step 305).
- the light receiving intensity of the detected pixel is equal to a predetermined threshold. It is checked whether the force exceeds the value (step 306). If the threshold value is exceeded, the center of gravity of the received light intensity of the neighboring pixels including the pixel is obtained, and the position of the center of gravity is set as the designated position of the pointer, and the coordinates of the designated position are output (step 307).
- step 304 the position of the window is moved so that the pointer is always included even when the pointer moves, and the pointer is photographed. Thereafter, steps 304 to 307 are repeated. The handwriting of the pointer is photographed while tracking the pointer.
- step 306 In the window Jung mode of step 307 due to the rapid movement of the pointer, if the pixel having the highest received light intensity is lost in the window Jung mode of step 307, the pixel having the received light intensity exceeding the predetermined threshold value is determined in step 306. Return to step 301 and switch to sub-sampling mode. Thereby, it is determined again whether or not the pointer is present in the detection area. If the pointer is not detected even in the sub-sampling mode, it is understood that the pointer is not present in the detection area. In this case, steps 301 to 303 are repeated to wait for the input of the pointer.
- FIG. 4 is a flowchart for explaining a method of detecting a plurality of pointers.
- Steps 401 to 403 in the sub-sampling mode are basically the same as steps 301 to 303 in the case of one indicator shown in FIG.
- the pixel (C1) having the highest light reception intensity is detected.
- step 404 a pixel (C2) having the highest light receiving intensity is detected in a portion excluding the pixel C1.
- a window including the pixel C1 is defined based on the detected position of the pixel C1, and the data of the window is read out (step 408).
- a pixel is detected (step 409), and it is confirmed whether or not the received light intensity of the detected pixel exceeds a predetermined threshold (step 410) . If the received light intensity exceeds the predetermined threshold, a neighboring pixel including the pixel is detected. The center of gravity of the received light intensity is obtained, and the position of the center of gravity is set as the designated position of the first pointer, and the coordinates of the designated position are output (step 411). This is the same operation as steps 304 to 307 in FIG. If it is determined in step 410 that the force does not exceed the predetermined threshold, the process proceeds to step 412 in which it is determined whether the value input to N is 2 or not.
- step 401 the entire detection area is photographed in the sub-sampling mode, and the movement of the pointer is tracked by repeatedly outputting the pointing position coordinates in the window Jung mode based on this.
- the frame reading rate when reading all pixels is 14 frames per second.
- the frame reading rate when reading all pixels is 14 frames per second.
- the window may be too wide to be the detection area 1Z4, so that by setting this to 1Z8 or the like, a higher frame reading rate can be realized. In this way, even if two or more pointers are input, it is possible to detect sufficiently fast.
- an image sensor capable of defining a plurality of windows is used in the window Jung mode, it is possible to read data from each of the plurality of windows in the window Jung mode without repeating the sub-sampling mode and the windowing mode. is there. In this case, if there is a newly input pointer, it cannot be detected in the window Jung mode. Therefore, it is preferable to perform control to return to the sub-sampling mode at predetermined intervals.
- the position detecting device and the position detecting method of the present invention are not limited to the above-described illustrated examples, and various changes can be made without departing from the scope of the present invention. is there.
- the position of the camera is fixed and the position where the pointer is placed has been described.
- the present invention is not limited to this, and is described in, for example, JP-A-7-302148.
- the operation tool having the image sensor may move, and the reference light source may be fixed. That is, the instruction information is input to a computer or the like according to the position and orientation of the operating tool.
- This can be realized by providing the imaging device of the present invention on the operating tool and arranging a light source for irradiating the operating tool with light at a predetermined reference position.
- the approximate position of the light source may be detected first in the sub-sampling mode, and then the accurate position of the light source may be detected in the window Jung mode.
- an input to an image projected by a projector by an indicator such as a light pen is detected. It is also applicable to such a detection device. Even in this case, first Detecting the approximate position indicated by the light pen in windowing mode, and then detecting the exact position of the light source in windowing mode!
- FIG. 1 is a schematic diagram for explaining an overview of a position detection device of the present invention.
- FIG. 2 is a diagram for explaining a structure of a camera of the position detection device of the present invention.
- FIG. 3 is a flowchart for explaining the flow of position detection by the position detection device of the present invention.
- FIG. 4 is a flowchart for explaining a flow of position detection when two pointers are input in the position detection device of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003-380578 | 2003-11-11 | ||
JP2003380578A JP2005148773A (ja) | 2003-11-11 | 2003-11-11 | 位置検出装置及び位置検出方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005045658A1 true WO2005045658A1 (ja) | 2005-05-19 |
Family
ID=34567242
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2004/016389 WO2005045658A1 (ja) | 2003-11-11 | 2004-11-05 | 位置検出装置及び位置検出方法 |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2005148773A (ja) |
WO (1) | WO2005045658A1 (ja) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4612853B2 (ja) * | 2005-03-29 | 2011-01-12 | キヤノン株式会社 | 指示位置認識装置及びそれを有する情報入力装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6247734A (ja) * | 1985-08-27 | 1987-03-02 | Mitsubishi Electric Corp | 座標入力装置 |
JPH02115920A (ja) * | 1988-10-25 | 1990-04-27 | Nec Corp | 光透過型高速タッチ入力装置 |
JPH05226460A (ja) * | 1992-02-18 | 1993-09-03 | Nec Yamagata Ltd | 画像処理による半導体チップ位置検出方法 |
JPH07200160A (ja) * | 1993-12-28 | 1995-08-04 | Hitachi Ltd | 情報提供装置及び情報表示装置 |
JPH11305935A (ja) * | 1998-04-24 | 1999-11-05 | Image Tec Kk | 位置検出システム |
JP2001056749A (ja) * | 1999-08-19 | 2001-02-27 | Ricoh Co Ltd | 筆記情報入力システム |
-
2003
- 2003-11-11 JP JP2003380578A patent/JP2005148773A/ja active Pending
-
2004
- 2004-11-05 WO PCT/JP2004/016389 patent/WO2005045658A1/ja active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6247734A (ja) * | 1985-08-27 | 1987-03-02 | Mitsubishi Electric Corp | 座標入力装置 |
JPH02115920A (ja) * | 1988-10-25 | 1990-04-27 | Nec Corp | 光透過型高速タッチ入力装置 |
JPH05226460A (ja) * | 1992-02-18 | 1993-09-03 | Nec Yamagata Ltd | 画像処理による半導体チップ位置検出方法 |
JPH07200160A (ja) * | 1993-12-28 | 1995-08-04 | Hitachi Ltd | 情報提供装置及び情報表示装置 |
JPH11305935A (ja) * | 1998-04-24 | 1999-11-05 | Image Tec Kk | 位置検出システム |
JP2001056749A (ja) * | 1999-08-19 | 2001-02-27 | Ricoh Co Ltd | 筆記情報入力システム |
Also Published As
Publication number | Publication date |
---|---|
JP2005148773A (ja) | 2005-06-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8971565B2 (en) | Human interface electronic device | |
JP6153564B2 (ja) | カメラとマーク出力とによるポインティング装置 | |
US20070182725A1 (en) | Capturing Hand Motion | |
TWI446249B (zh) | 光學影像式觸控裝置 | |
US8659577B2 (en) | Touch system and pointer coordinate detection method therefor | |
JP2009505305A (ja) | 自由空間のポインティング及び手書き手段 | |
JP2001184161A (ja) | 情報入力方法、情報入力装置、筆記入力装置、筆記データ管理方法、表示制御方法、携帯型電子筆記装置および記録媒体 | |
TW201510771A (zh) | 指向位置偵測裝置及其方法、程式及電腦可讀取紀錄媒體 | |
US20120319945A1 (en) | System and method for reporting data in a computer vision system | |
JP2005107607A (ja) | 光学式位置検出装置 | |
CN101520700A (zh) | 一种基于摄像头的三维定位触摸装置及其定位方法 | |
JP4054847B2 (ja) | 光デジタイザ | |
WO2012019322A1 (zh) | 利用单目摄像机标定技术的视觉指向型鼠标输入方法、输入系统和输入装置 | |
US8780084B2 (en) | Apparatus for detecting a touching position on a flat panel display and a method thereof | |
WO2011118313A1 (ja) | 座標入力装置及びプログラム | |
WO2018150569A1 (ja) | ジェスチャー認識装置、ジェスチャー認識方法、ジェスチャー認識装置を備えたプロジェクタおよび映像信号供給装置 | |
KR100968205B1 (ko) | 적외선 카메라 방식의 공간 터치 감지 장치, 방법 및스크린 장치 | |
US20070241262A1 (en) | Optical sensing unit for an optical input device | |
US9489077B2 (en) | Optical touch panel system, optical sensing module, and operation method thereof | |
US9785253B2 (en) | Pointing device using camera and outputting mark | |
WO2005045658A1 (ja) | 位置検出装置及び位置検出方法 | |
JP2005346453A (ja) | 画像表示装置 | |
CN103543884B (zh) | 光学触控系统及其触控物区分方法 | |
TW201419087A (zh) | 微體感偵測模組及其微體感偵測方法 | |
Ukita et al. | Wearable Virtual Tablet: Fingertip Drawing Interface Using an Active-Infrared Camera. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
122 | Ep: pct application non-entry in european phase |