JP2016218621A - Coordinate detection system, coordinate detection method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an optical touch panel configured to detect each of a light-emitting pointing device and non-light-emitting pointing means even when both the device and means are used at the same time, to calculate coordinate positions thereof.SOLUTION: A coordinate detection system 1 includes: a display unit 20; a light-emitting pointing device 30 and a non-light-emitting pointing object 40 for pointing a display surface of the display unit 20 to input a character or the like; peripheral light-emitting units 60a-60d arranged around the display unit 20; and detection units 50a-50d for imaging the light emitted from the light-emitting pointing device 30 and the light emitted from the peripheral light-emitting units 60a-60d, as a part of the system. In synchronization with imaging of the detection units, the system controls the peripheral light-emitting units to emit light or not, calculates a coordinate position of the non-light-emitting pointing object from an image captured when the peripheral light-emitting units emit light, and calculates a coordinate position of the light-emitting pointing device from an image captured when the peripheral light-emitting units do not emit light.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a coordinate detection system, a coordinate detection method, and a program for detecting coordinates instructed by a light emitting type indicating device and / or a non-light emitting type indicating means in an optical touch panel.

In recent years, electronic whiteboards (that is, optical touch panels) obtained by digitizing whiteboards used in conference rooms of companies and the like have become widespread.
Some of these electronic whiteboards use a coordinate detection system that detects (calculates) a position designated by a user on a display.

For example, Patent Document 1 describes an optical coordinate input device using such a coordinate detection system.
In this optical coordinate input device, diverging light from a light source type indicating member (light emitting type indicating device) and reflected light from a reflecting type indicating member (for example, a non-emitting type indicating object such as a finger) are used as the upper left corner of the display device. And the incident light detectors installed at the two upper right corners, and the coordinate position of the pointing member is calculated based on the incident angle of the detected incident light.

  In the optical coordinate input device (that is, the coordinate detection system) described in Patent Document 1, one of the light source type indicating member and the reflective type indicating member can be selectively used. However, if both the light source type indicating member and the reflective type indicating member are used at the same time, the light source type indicating member and the reflective type indicating member cannot be detected individually, and the respective coordinate positions cannot be calculated. There is.

  The present invention has been made in view of the above-described conventional problems, and the object thereof is to separately use a light-emitting type indicating device and a non-light-emitting type indicating unit in an optical touch panel. The coordinate position can be calculated.

The present invention detects a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image, and determines a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device. A coordinate detection system for calculation, which is disposed in a peripheral portion of the display device, irradiates light to the display device, and disposed in a peripheral portion of the display device, and emits light from the light emitting type pointing device. An imaging device that images light and light emitted from the irradiation device, a control unit that controls irradiation and non-irradiation by the irradiation device based on an imaging timing of the imaging device, and at the time of irradiation of the irradiation device The coordinate position of the non-light emitting type instruction means is calculated from the captured image captured by the imaging device in FIG. 3, and from the captured image captured by the imaging device at the time of non-irradiation of the irradiation device A coordinate position calculating means for calculating the coordinate position of the serial-emitting indication device, a coordinate detection system having a.
Further, the present invention detects the light emitting type indicating device and the non-light emitting type indicating means existing around the display device for displaying an image, and coordinates the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device. A coordinate detection system for calculating a position, which is disposed in a peripheral portion of the display device, irradiates light to the display device, and is disposed in a peripheral portion of the display device, and emits light from the light emitting type indicating device An imaging device that images the emitted light and the light emitted from the irradiation device, a control unit that controls irradiation and non-irradiation by the irradiation device based on an imaging timing of the imaging device, and Coordinate positions of the light emitting type indicating device and the non-light emitting type indicating means are calculated from a captured image captured by the imaging device at the time of irradiation, and the imaging device at the time of non-irradiation of the irradiation device. A coordinate position calculating unit that calculates a coordinate position of the light emitting type pointing device from a captured image captured from the image, and a coordinate position calculating unit that is calculated from the captured image captured by the imaging device at the time of irradiation of the irradiation device; And a smoothing unit that smoothes the coordinate position of the light emitting type pointing device.

  According to the coordinate detection system of the present invention, even when the light emitting type indicator and the non-light emitting type indicator are used at the same time in the optical touch panel, they can be detected individually and the coordinate position can be calculated. .

It is a system configuration figure of a coordinate detection system concerning Embodiment 1 of the present invention. It is a hardware block diagram of the computer of the coordinate detection system which concerns on Embodiment 1 of this invention. It is the schematic of the light emission type indicating device of the coordinate detection system which concerns on Embodiment 1 of this invention. It is the schematic of the functional block of the computer of the coordinate detection system which concerns on Embodiment 1 of this invention. It is a figure which shows the image acquired by the detection part of the coordinate detection system which concerns on Embodiment 1 of this invention. It is a figure explaining the detection process of the light emission type indicating device and the non-light emitting type indicating object in the coordinate detection system according to the first embodiment of the present invention. It is a figure explaining the detection process of the light emission type indicating device and the non-light emitting type indicating object in the coordinate detection system according to the second embodiment of the present invention. It is a figure explaining the correction process of the error using a digital filter.

Hereinafter, the coordinate detection system 1 as an embodiment of the present invention will be described with reference to the drawings.
(Embodiment 1)
FIG. 1 is a system configuration diagram of a coordinate detection system 1 according to Embodiment 1 of the present invention.
As shown in the figure, the coordinate detection system 1 of FIG. 1 mainly includes a computer 10, a display 20, a light emitting type indicating device 30, a non-light emitting type indicating object 40, a detecting unit 50 (50a to 50d), and a peripheral light emitting unit 60 ( 60a-60d).
In addition, the computer 10, the display 20, the detection part 50, and the peripheral light emission part 60 comprise an optical touch panel.
Further, a PC (Personal Computer) 70 is connected to the computer 10 as an additional element.

  The computer 10 is installed with an application corresponding to coordinate detection and the like, and detects a position drawn (operated) by the user based on an image acquired (captured) by the detection unit 50.

  The display 20 is a display device for displaying characters, figures, and the like input by the user using the light-emitting indicating device 30 and the non-light-emitting indicating object 40 and video data output from the PC 70.

The light emitting type indicating device 30 is a light emitting type device that indicates a position on the display 20.
The light emitting type instruction device 30 includes a light emitting unit, a contact detection unit, and a communication unit.
Details will be described later with reference to FIG.

The non-light emitting type indicating object 40 is a non-light emitting type indicating means for indicating a position on the display 20.
The non-light emitting type pointing object 40 is an arbitrary object such as a human finger or an indicator that does not emit light.

The detection unit 50 (50a to 50d) is installed at each corner of the display 20.
In the first embodiment, four detection units 50 (50a, 50b, 50c, 50d) are installed at each corner of the display 20, but two detection units 50 are installed at one of the upper part and the lower part of the display 20. May be.

The detection unit 50 includes a solid-state image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor, and captures (acquires) an image near the surface of the display 20 as a two-dimensional image. It is an imaging device.
The detection unit 50 includes a device that acquires a one-dimensional image (data) such as a linear image sensor, a position detection device such as a PSD (position sensitive detector), and the like. It is also possible to use a device that automatically detects.
The timing at which the detection unit 50 captures an image is controlled by the computer 10.

The peripheral light emitting unit 60 is an irradiation device, and is disposed in the peripheral part of the display 20 (that is, the upper part 60a, the lower part 60c, and the side parts 60b and 60d).
The peripheral light emitting unit 60 may be attached to the display 20 in a detachable state.
In addition, the timing of irradiation (light emission) in the peripheral light emitting unit 60 is controlled by the computer 10.

In the above configuration, for example, when the user selects “draw line” from the menu screen displayed on the display 20 and draws a figure on the display 20 with the light emitting type instruction device 30, the computer 10 displays the light emitting type instruction. The position where the device 30 is in contact with the display 20 is analyzed in real time, and the coordinate position is calculated (detected) in time series from the analysis result.
Thereafter, the computer 10 controls the coordinate positions calculated in time series to be connected by line segments and displayed on the display 20.

FIG. 1 shows an example in which the user draws the light emitting type pointing device 30 in a triangular shape on the display 20, and in this case, the computer 10 calculates the coordinate positions constituting the triangle in time series and calculates one stroke. Remember as.
Here, the stroke is a set of coordinates of the light emitting type indicating device 30 corresponding to a continuous frame from when the contact of the light emitting type indicating device 30 is detected until the detection ends.

Thereafter, the computer 10 controls to display the drawn triangle on the display 20 based on the generated coordinate position.
In FIG. 1, since video data (that is, video data targeting the sun and mountains) is output from the PC 70, the computer 10 superimposes and displays the video data on the display 20. So that it is controlled.
Moreover, although the case where drawing was performed on the display 20 using the light emitting type pointing device 30 was illustrated in FIG. 1, drawing can also be performed using a non-light emitting type pointing object 40 such as a finger.

FIG. 2 is a hardware configuration diagram of the computer 10 of the coordinate detection system 1 according to the first embodiment of the present invention.
The computer 10 is an information processing apparatus, and as shown in FIG. 2, a CPU (Central Processing Unit) 101 and a ROM (Read Only Memory) are electrically connected via bus lines such as an address bus and a data bus. 102, a random access memory (RAM) 103, a solid state drive (SSD) 104, a capture device 105, a graphics processing unit (GPU) 106, a display controller 107, a detection unit controller 108, and a communication unit 109.

The CPU 101 is a control unit that controls the entire computer 10 and executes, for example, an application stored in the SSD 104.
The ROM 102 is a non-volatile memory and stores a program (IPL (Initial Program Loader) or the like) executed by the CPU 101 at the time of startup.
A RAM 103 is a volatile memory and is used as a work area when the CPU 101 executes an application.
The SSD 104 is a nonvolatile memory that stores applications and various data.

The capture device 105 captures (captures) an image displayed on the display unit by the PC 70 connected to the computer 10.
The GPU 106 is a graphic processor that calculates the pixel value of each pixel of the display 20.
The display controller 107 controls to output (display) an image drawn by the user, an image captured by the capture device 105, and the like on the display 20.

The detection unit controller 108 controls the detection unit 50 (50a to 50d).
The detection unit controller 108 controls, for example, the exposure timing of the photodiode mounted on the detection unit 50.
The communication unit 109 is a communication unit that receives a signal transmitted from the light-emitting instruction device 30 and is connected to the light-emitting instruction device 30 according to a communication standard such as Bluetooth (registered trademark).

FIG. 3 is a schematic diagram of the light emitting type indication device 30 of the coordinate detection system 1 according to the first embodiment of the present invention.
The light emitting type indication device 30 is an indication device (instruction means) such as a light emitting type electronic pen, and includes a light emitting unit 301, a contact detection unit 302, and a communication unit 303.

The light emitting unit 301 is located at the distal end portion of the light emitting type indicating device 30 and emits, for example, infrared light.
The contact detection unit 302 detects (senses) contact (touch) and non-contact (detach) between the tip of the light-emitting type indication device 30 and the display 20.
The contact detection unit 302 generates a touch signal and transmits it to the communication unit when the tip of the light emitting instruction device 30 contacts the display 20.
Further, the contact detection unit 302 generates a detach signal and transmits it to the communication unit 303 when the tip of the light emitting type indication device 30 is separated from the display 20 (that is, when the contact is released).
The communication unit 303 is a communication unit that transmits the touch signal and the detach signal generated by the contact detection unit 302 to the computer 10, and communicates with the computer 10 such as Bluetooth (registered trademark) as described above. Connected by standard.

In addition, although it is good also as a specification which always light-emits (lights) regarding the light emission part 301, it is good also as a specification light-emitted only when a contact is detected in the contact detection part 302. FIG.
In addition, a sensor such as an acceleration sensor for determining the usage state of the user may be mounted on the light emitting type indication device 30, and based on the output of the sensor, for example, the specification may be such that the light emitting unit 301 emits light only during use. .

FIG. 4 is a schematic diagram of functional blocks of the computer 10 of the coordinate detection system 1 according to the first embodiment of the present invention.
As shown in FIG. 4, the computer 10 includes a control unit 111, a coordinate position calculation unit 112, and a drawing unit 113.
4 also shows the display 20, the detection unit 50, and the peripheral light emitting unit 60 that are connected to the computer 10 by wire or wirelessly for convenience of explanation.

The control unit 111 mainly executes control related to reception of an image acquired by the detection unit 50, imaging control in the detection unit 50, and control related to switching between turning on (irradiating) and turning off (non-irradiating) in the peripheral light emitting unit 60. To do.
In addition, the control unit 111 performs control so that the coordinate position calculated by the coordinate position calculation unit 112 is transmitted to the drawing unit 113.

The coordinate position calculation unit 112 calculates the coordinate position of the light emitting type pointing device 30 and / or the non-light emitting type pointing object 40 from the image acquired (captured) by the detection unit 50 (that is, the captured image).
The calculation of the coordinate position is executed by, for example, a known triangulation method.
When the light emitting type pointing device 30 and the non-light emitting type pointing object 40 are captured in the image acquired by the detecting unit 50, the coordinate position calculating unit 112 determines the coordinate position of the light emitting type pointing device 30 and the non-light emitting type pointing device 30. The coordinate position of the pointing object 40 is calculated individually.
Further, in this case, the control unit 111 distinguishes the coordinate position of the light emitting type pointing device 30 and the coordinate position of the non-light emitting type pointing object 40 calculated by the coordinate position calculating unit 112 and transmits them to the drawing unit 113.
The drawing unit 113 generates a drawing image based on the coordinate position of the light emitting type pointing device 30 and / or the non-light emitting type pointing object 40 calculated by the coordinate position calculating unit 112.

Note that the control unit 111, the coordinate position calculation unit 112, and the drawing unit 113 are function implementation means generated by causing the computer 10 of the coordinate detection system 1 to read a program.
This also applies to the smoothing unit implemented in the coordinate position calculation unit 112 of the coordinate detection system 1 according to the second embodiment of the present invention described later.

FIG. 5 is a diagram illustrating an image acquired by the detection unit 50 of the coordinate detection system 1 according to the first embodiment of the present invention.
5A shows an image that is turned on (emitted) in the peripheral light emitting unit 60, and FIG. 5B shows an image that is turned off in the peripheral light emitting unit 60. In FIG. An image of light emitted from the pointing device 30 is indicated by a hatched portion.
5A and 5B, (1) when neither the light-emitting indicating device 30 nor the non-light-emitting indicating object 40 exists (not imaged), (2) only the non-light-emitting indicating object 40 exists. In this case, (3) only the light emitting type indicating device 30 exists, and (4) the case where the light emitting type indicating device 30 and the non-light emitting type indicating object 40 exist.

Here, in the coordinate detection system 1 according to the first embodiment, in the cases of FIGS. 5A (3) and (4), that is, when the peripheral light-emitting unit 60 is turned on, the captured image is light-emitting type. When the pointing device 30 is present, the light emitted from the light emitting unit 301 of the light emitting type pointing device 30 overlaps with the light emitted from the peripheral light emitting unit 60, so that the light emitting type pointing device 30 is made to emit the peripheral light. Detection is performed only from an image captured with the unit 60 turned off.
In addition, the coordinate detection system 1 according to the first embodiment detects the non-light emitting pointing object 40 from an image captured with the peripheral light emitting unit 60 turned on.
Hereinafter, a specific detection process of the coordinate detection system 1 according to the first embodiment will be described with reference to FIG.

FIG. 6 is a view for explaining detection processing of the light emitting type pointing device 30 and the non-light emitting type pointing object 40 in the coordinate detection system 1 according to the first embodiment of the present invention, and the exposure timing (that is, the imaging timing) of the detecting unit 50. FIG. 6 is a timing chart showing the light emission timing of the peripheral light emitting unit 60 and the detection timing of the light emitting type indicating device 30 and the non-light emitting type indicating object 40 in the computer 10.
As shown in FIG. 6, in the coordinate detection system 1 according to the first embodiment, the detection timing of the light emitting type pointing device 30 and the detection timing of the non-light emitting type pointing object 40 are switched at high speed (that is, time division processing is executed). Thus, simultaneous detection of the light emitting type pointing device 30 and the non-light emitting type pointing object 40 is realized.

As shown in FIG. 6, the computer 10 exposes a mounted photodiode (photosensitive element) at a predetermined interval (that is, imaging cycle) in the detection unit 50 (that is, acquires (captures) an image). ) To control.
Further, as shown in FIG. 6, the computer 10 causes the peripheral light emitting unit 60 to emit light at the same timing as the exposure once in the exposure period (ie, two cycles) of the photodiode of the detection unit 50. To control.

The computer 10 executes detection processing (image processing) of the non-light emitting type pointing object 40 on the image acquired when the peripheral light emitting unit 60 emits light (that is, at the time of irradiation) (“lighting” in FIG. 6). Arrow)))), and the detection process of the light emitting type pointing device 30 is executed for the image acquired when the peripheral light emitting unit 60 is turned off (that is, during non-irradiation) (“lighting off (arrow) in FIG. 6”. ) ").
Here, the sampling rate (that is, the frequency of detecting the light emitting type indicating device 30 and the non-light emitting type indicating object 40) is set to about 100 to 120 Hz. This is a frequency necessary and sufficient for the drawing unit 113 to draw a smooth line.
Further, in this case, the frequency (rate) at which the image sensor outputs an image is detected by switching the light emitting type indicating device 30 and the non-light emitting type indicating object 40 alternately as shown in FIG. 120 × 2) Hz.

The detection processing (time division processing) of the light emitting type pointing device 30 and the non-light emitting type pointing object 40 in the coordinate detection system 1 according to the first embodiment has been described above.
However, in this detection process, it is necessary to operate the image sensor at a high speed (that is, a rate (frequency) of about 240 Hz), so that the semiconductor manufacturing technology is miniaturized and the A / D conversion circuit built in the image sensor is high-speed. Is required.
Therefore, in the coordinate detection system 1 according to the second embodiment of the present invention, the image sensor is operated at a lower speed (that is, a rate (frequency) of about 120 Hz), whereby the light emitting type indication device 30 and the non-light emitting type indication are performed. The object 40 is distinguished and detected.

In the coordinate detection system 1 according to the second embodiment, in relation to operating the image sensor at a low speed, the detection processing of the light emitting type indication device 30 is performed only with an image acquired when the peripheral light emitting unit 60 is turned off. Rather, it is also executed from an image acquired when the peripheral light emitting unit 60 is emitting light.
In the coordinate detection system 1 according to the second embodiment, the case shown in FIGS. 5A (3) and (4) described above (that is, the peripheral light emitting unit 60 is turned on and the captured image is displayed). When the light emitting type indicating device 30 exists), after detecting the light emitting type indicating device 30, the coordinate position of the light emitting type indicating device 30 is corrected using a filter.

Hereinafter, a coordinate detection system 1 according to Embodiment 2 of the present invention will be described.
In addition, about Embodiment 2, the description of FIGS. 1 to 4 of Embodiment 1 is used except that a filtering function (that is, a smoothing unit) is implemented in the coordinate position calculation unit 112 of FIG.
Further, the filtering function is realized by, for example, a digital filter, and the digital filter will be described later with reference to FIG.

(Embodiment 2)
FIG. 7 is a diagram for explaining detection processing of the light emitting type pointing device 30 and the non-light emitting type pointing object 40 in the coordinate detection system 1 according to the second embodiment of the present invention.
In FIG. 7, similarly to FIG. 6, the exposure timing in the detection unit 50, the light emission timing of the peripheral light emitting unit 60, and the detection timing of the light emitting type pointing device 30 and the non-light emitting type pointing object 40 in the computer 10 are shown.

As described above, the computer 10 controls the detection unit 50 to expose the photodiodes mounted at a rate (frequency) of 120 Hz, and the peripheral light emitting unit 60 sets the photodiodes of the detection unit 50 to 2 Control is performed so that light is emitted at the same timing as the exposure once during the exposure period (that is, two cycles).
Further, in the second embodiment, as shown in FIG. 7, the detection processing of the light emitting type pointing device 30 and the non-light emitting type pointing object 40 is performed on the image acquired when the peripheral light emitting unit 60 emits light (lights up). Is executed ("lighting (arrow)" in FIG. 7), and the detection process of the light emitting type indicating device 30 is performed on the image acquired when the peripheral light emitting unit 60 is turned off ("lighting off (arrow) in FIG. 7". ) "). That is, in the second embodiment, the detection process of the non-light emitting pointing object 40 is executed at 60 Hz, and the detection process of the light emitting pointing apparatus 30 is executed at 120 Hz, which is the same as the output rate of the image sensor.

  Here, in the coordinate detection system 1 according to the second embodiment, when the detection process of the light emitting type indicating device 30 is executed from the image acquired when the peripheral light emitting unit 60 emits light, the light emitting unit of the light emitting type indicating device 30 is used. Since the light emitted from 301 overlaps the light emitted from the peripheral light emitting unit 60 and an error occurs in the detected coordinate position, the light emitting type indicating device 30 is detected and then corrected using a filter.

FIG. 8 is a diagram for explaining error correction processing using a digital filter.
As described above, since the peripheral light emitting unit 60 emits light at the timing of two exposures of the detection unit 50, in the detection process of the light emission type indicating device 30, as shown in FIG. An error occurs in the coordinate position detected with the frequency of times.
In FIG. 8A, X (t−1), X (t−3), and X (t−5) are shown as points (coordinate positions) where detection errors occur, and these coordinate positions are represented by digital filters. To correct (ie, smooth).

As the digital filter, for example, a moving average filter can be used.
If the two-dimensional coordinate detected at the discrete time t of the detection processing of the light emitting type indicating device 30 is X (t) and the two-dimensional coordinate after the filter is applied is Y (t), the moving average filter is expressed by the following equation: Is done. The moving average filter is known as a kind of low-pass filter, and can smooth fluctuations in time-series data.

FIG. 8B shows the result of correcting the coordinate position where the detection error has occurred using the moving average filter.
By smoothing the error (coordinate position) detected once every two times as shown in FIG. 8A by the moving average filter, the roughness of the line drawn based on the coordinate position is suppressed. (Ie, lines drawn based on coordinate positions can be smoothed).
As the digital filter, an arbitrary FIR (Finite Impulse Response) filter or IIR (Infinite Impulse Response) filter may be employed. It is also possible to use a more advanced filter such as a Kalman filter that uses both position and velocity.

As described above, according to the coordinate detection system of the present invention, even when the light emitting type indicating device and the non-light emitting type indicating means are used simultaneously on the optical touch panel, they are individually detected. The coordinate position can be calculated.
In the above description, the coordinate detection system executes the detection processing of the light emitting type indication device after grasping the light emission timing of the peripheral light emitting unit in advance, but analyzes the image captured by the detection unit, After determining whether or not the peripheral light emitting unit emits light from the image, detection processing of one or both of the light emitting type indicating device and the non-light emitting type indicating unit can be executed based on the determination result. (In other words, it is possible to select and execute a detection process such as a process for detecting only the light emitting type indicating device, a process for detecting only the non-light emitting type indicating means, a process for detecting the light emitting type indicating apparatus and the non-light emitting type means, etc. ).

  DESCRIPTION OF SYMBOLS 1 ... Coordinate detection system, 10 ... Computer, 20 ... Display, 30 ... Light emission type indicating device, 40 ... Non light emission type indicating object, 50 (50a-50d) ... Detection part, 60 (60a-60d) ... Peripheral light emission part, 70: PC (Personal Computer).

JP 2003-316506 A

Claims (8)

Coordinate detection for detecting a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image and calculating a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device A system,
An irradiation device disposed in a peripheral portion of the display device and irradiating the display device with light;
An imaging device that is disposed in a peripheral portion of the display device and captures light emitted from the light emitting type indicator device and light emitted from the irradiation device;
Control means for controlling irradiation and non-irradiation by the irradiation device based on the imaging timing of the imaging device;
The coordinate position of the non-light emitting type instruction means is calculated from a captured image captured by the imaging device during irradiation of the irradiation device, and the light emission from the captured image captured by the imaging device during non-irradiation of the irradiation device. Coordinate position calculating means for calculating the coordinate position of the type indicating device;
A coordinate detection system. Coordinate detection for detecting a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image and calculating a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device A system,
An irradiation device disposed in a peripheral portion of the display device and irradiating the display device with light;
An imaging device that is disposed in a peripheral portion of the display device and captures light emitted from the light emitting type indicator device and light emitted from the irradiation device;
Control means for controlling irradiation and non-irradiation by the irradiation device based on the imaging timing of the imaging device;
Coordinate positions of the light emitting type indicating device and the non-light emitting type indicating means are calculated from a captured image captured by the imaging device at the time of irradiation of the irradiation device, and are captured by the imaging device at the time of non-irradiation of the irradiation device. Coordinate position calculating means for calculating the coordinate position of the light emitting type pointing device from the captured image;
Smoothing means for smoothing the coordinate position of the light emitting type indicating device calculated from the captured image captured by the imaging device at the time of irradiation of the irradiation device by the coordinate position calculating unit;
A coordinate detection system. In the coordinate detection system according to claim 1 or 2,
A coordinate detection system in which the control unit performs control so as to alternately perform irradiation and non-irradiation of the irradiation device in accordance with an imaging timing of the imaging device. The coordinate detection system according to any one of claims 1 to 3,
Based on whether or not the coordinate position calculation means is irradiated with light from the captured image captured by the imaging apparatus, the coordinate position of the light emitting type indicating device and / or the non-light emitting type indicating means Coordinate detection system that calculates Coordinate detection for detecting a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image and calculating a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device A coordinate detection method in a system,
An imaging step of imaging light emitted from the light-emitting indicator device and light emitted from the irradiation device by an imaging device;
In accordance with the timing of imaging in the imaging step by the irradiation device, the irradiation step of alternately irradiating and non-irradiating the display device,
The coordinate position calculation means calculates the coordinate position of the non-light emitting type instruction means from the picked-up image picked up by the image pickup device during irradiation in the irradiation step, and is picked up by the image pickup device during non-irradiation in the irradiation step. A coordinate position calculation step of calculating the coordinate position of the light emitting type pointing device from the captured image;
A coordinate detection method in a coordinate detection system. Coordinate detection for detecting a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image and calculating a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device A coordinate detection method in a system,
An imaging step of imaging light emitted from the light-emitting indicator device and light emitted from the irradiation device by an imaging device;
In accordance with the timing of imaging in the imaging step by the irradiation device, the irradiation step of alternately irradiating and non-irradiating the display device,
The coordinate position of the light emitting type indicating device and the non-light emitting type indicating unit is calculated from the captured image captured by the imaging device at the time of irradiation in the irradiation step by the coordinate position calculating unit, and at the time of non-irradiating in the irradiation step. A coordinate position calculating step of calculating a coordinate position of the light emitting type pointing device from a captured image captured by the imaging device;
A smoothing step of smoothing the coordinate position of the light emitting type indicating device calculated from the captured image captured by the imaging device at the time of irradiation in the irradiation step in the coordinate position calculating step by the smoothing means;
A coordinate detection method in a coordinate detection system. Coordinate detection for detecting a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image and calculating a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device System computer,
Control of irradiation and non-irradiation by the irradiation device based on the imaging timing of the imaging device that images the light emitted from the light emitting type indication device and the light emitted from the irradiation device that irradiates the display device. And a coordinate position of the non-light emitting type instruction unit is calculated from a captured image captured by the imaging device during irradiation of the irradiation device, and is captured by the imaging device during non-irradiation of the irradiation device. A program for functioning as coordinate position calculation means for calculating the coordinate position of the light emitting type pointing device from the captured image. Coordinate detection for detecting a light emitting type indicating device and a non-light emitting type indicating means existing around a display device for displaying an image and calculating a coordinate position of the light emitting type indicating device and the non-light emitting type indicating means with respect to the display device System computer,
Control of irradiation and non-irradiation by the irradiation device based on the imaging timing of the imaging device that images the light emitted from the light emitting type indication device and the light emitted from the irradiation device that irradiates the display device. Control means for performing,
Coordinate positions of the light emitting type indicating device and the non-light emitting type indicating means are calculated from a captured image captured by the imaging device at the time of irradiation of the irradiation device, and are captured by the imaging device at the time of non-irradiation of the irradiation device. A coordinate position calculating unit that calculates a coordinate position of the light emitting type pointing device from the captured image; and the light emitting type calculated from the captured image captured by the imaging device at the time of irradiation of the irradiation device by the coordinate position calculating unit. The program for functioning as a smoothing means which smoothes the coordinate position of a pointing device.

Images