KR102169626B1 - Input system for a computer having function of identifying a input device - Google Patents

Abstract

The present invention relates to a display device that displays an image from a computer, an input device that emits infrared light of a predetermined wavelength when the display device contacts or approaches a display area that displays an image or by a user's manipulation, and a display area of the display device. A computer input system for inputting information into a computer, including a camera device for photographing a camera device, comprising: a synchronization signal generator for generating a synchronization signal for a photographing timing of the camera device, and an input device input from an image captured by the camera device It further includes an input information extraction device for extracting the information.

Description

Computer input system with discrimination function of input devices {INPUT SYSTEM FOR A COMPUTER HAVING FUNCTION OF IDENTIFYING A INPUT DEVICE}

The present invention relates to a computer input system, and more specifically, a computer capable of controlling a computer or discriminating an input device capable of inputting various information by an act of approaching or contacting a display area displaying an image transmitted by a computer. It relates to the input system.

In educational or business sites, it is common to transfer learning content or business content from a computer to a large number of people as an image, and to provide such an image, a large monitor connected to a computer or a display device such as a projector is used.

In the case of using a display device with a touch panel, the user can control the image provided while touching the display or display characters or figures on the display screen to input information into the computer and display the input information again on the display screen. The user can proceed or stop the image using a remote control, etc., but when the image provided by the computer is projected on the screen by a projector or when a display device without screen input function such as a normal LCD monitor is used. It is impossible to interact with the computer, such as controlling the computer from the displayed screen or monitor, or displaying figures or characters on the screen or monitor so that they are input to the computer.

As a technique for resolving such inconvenience, there are a number of prior arts including the invention related to'interactive system, control method of interactive system, and projector' disclosed in International Publication No. WO2014/005456 (Document 1).

According to the configuration and operation of the interactive system as in the invention of Document 1, the projector projects an image input from a computer onto a screen, a light-emitting pen used by a person emits infrared rays on the image projected on the screen, and the camera device The projected image and infrared light from the light-emitting pen are photographed, and the infrared light from the light-emitting pen is extracted from the captured image, and according to the coordinates of the infrared light in the projected image, the user can display or specify a specific image or character with the light-emitting pen. By discriminating that information input has been performed, information is input by the light-emitting pen.

However, in the system in which information is input by the interaction between the light-emitting pen and the projector and the camera including the invention of Document 1, there is a problem that it is difficult to discriminate the infrared light from the light-emitting pen and the infrared light from an external light source. By emitting this infrared light, it is possible to input information only, and there is a problem in that several light-emitting pens that are distinguished from each other cannot be used.

As one solution to this problem, in Patent Application No. 10-2017-0133887, a prior application by the applicant of this application, by using a multi-band pass filter that allows only infrared light and visible light of a specific wavelength band to pass through the camera device, Disclosed is a computer input system having a configuration capable of discriminating infrared light from light of light and infrared light from a light emitting pen as an input device.

However, according to the invention of this patent application, disturbance by external light can be effectively prevented, but a plurality of light emitting pens cannot be used as input devices to be distinguished from each other.

Document 1: International Publication No. WO2014/005456 Document 2: Japanese Laid-Open Patent Publication No. 2015-096963

The present invention is to implement a virtual touch screen as a computer input system. Specifically, it is intended to provide a computer input system for controlling a computer or inputting various types of information by contacting or approaching an input device emitting infrared light to an area where an image provided by the computer is displayed.

In particular, the present invention is to provide a computer input system in which a plurality of input devices emitting infrared light can be distinguished from each other and identified as input devices performing different operations in consideration of the problems of the prior art described above.

In addition, the present invention is to provide a computer input system that does not cause errors without being restricted by external light even in an environment with external light such as lighting or natural light.

In addition, the present invention is to provide a computer input system in which a function such as color selection or writing erase is provided to an input device and the function of such an input device can be recognized.

The above-described problem of the present invention is a display device that displays an image from a computer, an input device that emits infrared light of a predetermined wavelength by contact or proximity of the display device to a display area displaying an image, or by a user's manipulation, And a camera device for photographing a display area of the display device to input information into the computer.

The computer input system of the present invention further comprises a synchronization signal generating device for generating a synchronization signal for a photographing timing of the camera device, and an input information extracting device for extracting input information of the input device from an image captured by the camera device,

The input device receives the synchronization signal from the synchronization signal generator, and blinks the infrared light at a timing according to the synchronization signal, but emits or does not emit infrared light at a predetermined number of timings. The displayed information is displayed, and the information displayed as the binary data includes a predetermined identification code of the corresponding input device,

The input information extraction device extracts image information corresponding to infrared light from the input device from the images captured by the camera device, calculates position information in the coordinate system of the image transmitted to the display device, and is input to the computer through the display device. It is processed as information, but the identification code of the input device is determined by extracting the information displayed as the binary data from the information of the image corresponding to the extracted infrared light.

In the computer input system of the present invention,

A computer displays an image through a display device, and a user approaches or contacts the display device with an input device and performs an operation such as clicking or drawing a line through a specific operation.

The input device generates a signal corresponding to its unique identification code by turning on or off the infrared light in synchronization with the photographing timing of the camera device by the synchronization signal generator.

In addition to the image of the display device, infrared light from the input device is incident on the camera device, and external light having an infrared component such as illumination or sunlight is also incident and photographed. The captured image is analyzed by the input information extraction device, and the input information extraction device extracts infrared light that emits light in specific frames and does not emit light in other frames in synchronization with the shooting timing, and displays it as binary data. It is determined whether or not the extracted infrared light is infrared light from the input device by comparing it with the recorded identification code of the input device.

When it is determined as infrared light from the input device, the position of the infrared light in the image of the display device captured by the camera device is extracted, and the position is determined as input information of the input device, and this input information is transmitted to the computer. .

The computer controls the operation of the computer according to the input information or displays the input information on the display device.

As described above, in the computer input system of the present invention, since the input device generates a signal by lighting/non-lighting the identification number in synchronization with the photographing timing of the camera device, external light other than the infrared light of the input device is distinguished. It does not happen that the input device is not identified by light or that external light is input as input information.

In particular, since the processing of signals represented as binary data from these input devices is performed in a very simple manner and there is no possibility of confusion with external light, information input from the input device is extracted and processed through rapid information processing with a very simple configuration. You can do it.

On the other hand, as an additional feature of the present invention, the input device includes a sensor that detects contact or proximity to the display area, and the input device is different for a state that is not in contact or close to the display area and a state that is not in contact or close to the display area. It can be configured with an identification code.

As another alternative configuration, the input device includes a sensor that detects contact or proximity to the display area, and the information displayed as the binary data includes a case where the input device contacts or is close to the display area and when the input device is not in contact or proximity. It can also be configured to include a signal indicating.

According to this configuration, a state in which information is input by the input device in proximity to or in contact with the display area and a state in which information is not input by being separated from the display area can be clearly distinguished in a simple manner.

As a further feature of the present invention, the input device is provided with a means for selecting a predetermined type of color or an erasing function as a function of the input device, and the information displayed as binary data includes a signal according to a function selected by the input device. It can be composed of.

According to this additional characteristic configuration, colors can be distinguished as information input by the input device, and a function of erasing information input by the input device can be implemented.

In particular, such an additional function can be implemented in a simple manner in which only a function selection means is provided in the input device, and information according to the function selection is added to the information displayed by the input device by emitting/non-emitting infrared light.

1 is a diagram showing a schematic configuration of an image system in which a computer input system according to an embodiment of the present invention is implemented, and elements constituting the image system are conceptually shown.
2 is a sequence chart of signals indicated by a light-emitting pen as an input device.

Hereinafter, specific details for carrying out the present invention will be described with reference to the accompanying drawings.

First, elements constituting a computer input system according to an embodiment of the present invention will be described with reference to FIG. 1.

The computer input system of the present embodiment is a display device comprising a screen 20 and a projector 10 that projects an image on the screen, a user grasps and uses it, and contacts the screen to emit infrared light of a specific wavelength range from its tip. The light pen 30 as an input device, a camera device that is configured to capture a reflected image reflected from the screen 20, and functions as an input information extracting device for extracting input information to the computer displayed by the light pen 30 ( 40) and a computer 50 to which a camera device and a projector are connected.

The projector 10 has a conventional configuration for projecting an image such as a screen of a program executed on the computer 50 or various presentation contents on the screen 20.

The screen 20 is a general screen that is installed on the wall of a lecture room or conference room where the computer input system of the present embodiment is implemented, so that an image can be projected and viewed as needed, but the screen of the present invention is a screen 20 that is separately prepared. ), and it is sufficient if the image is projected and reflected so that people can see the projected image.For example, a wall surface of a building made of a white flat surface can also be used as the screen of the present invention. Is defined to mean an element with a surface that reflects the projected image of the projector.

In addition, the display device of the present invention is not limited to the screen 20 and the projector 10, and may be configured to be connected to the computer 50 like an LCD monitor to display an image of the computer 50.

The camera device 40 is arranged to photograph toward the screen 20. The camera device 40 is a lens mechanism that focuses incident light onto an image pickup element, similar to a conventional camera, and an image pickup element that converts light incident and focused through the lens mechanism into an electric signal, and an electric signal from a CMOS element and a CMOS element. It is configured to include a memory and a processor for processing and storing the image data.

In addition, the camera device 40 includes an image processing module (not shown) that analyzes image data from the imaging device, extracts a signal by infrared light from the light-emitting pen 30, and transmits it to the computer 50 as input information. It is provided as an input information extraction device.

In this embodiment, the image processing module is provided in the camera device 40, but is provided separately from the camera device 50 as a separate device, and after receiving and processing image data by wire or wirelessly from the camera device 40 It may be configured to transmit an input signal from the light-emitting pen 30 to the computer 50 by wire or wirelessly. In addition, the image processing module may be provided in the computer 50 or may be implemented as software running in a general computer 50.

In this embodiment, the light-emitting pen 30 is, for example, a computer 50 such as an operation in which a user conducting a presentation or lecture using an image projected on the screen while being positioned close to the screen switches or stops the image projected on the screen. ) And to display characters or figures on the screen.

An infrared light-emitting element (not shown) that emits infrared light is provided at the tip of the light-emitting pen 30, and a switch is provided on the side to supply power to the infrared light-emitting element. When the switch is turned on, the light-emitting pen 30 Infrared light is emitted from the tip and the emitted infrared light is reflected from the surface of the screen 20.

The camera device 40 captures an image projected from the projector 10 to the screen 20, and an image of infrared light from the light emitting pen reflected from the surface of the screen 20 or directly incident from the light emitting pen 30 is transmitted to the camera. It is included in the image captured by the device 40.

A touch sensor (not shown) is provided at the tip of the light-emitting pen 30 to detect that the user makes contact with the surface of the screen 20, and a function button (not shown) for selecting a function of the light-emitting pen on the side. There are. The functions of the light-emitting pen include black and blue colors and an erasing function, and are configured to switch functions by sequentially pressing the buttons. A button for selecting the writing and erasing function and a button for selecting a color can be provided separately.

On the other hand, the camera device 40 is equipped with an infrared transmission module (not shown) as a synchronization signal generating device, the processor of the camera device transmits a synchronization signal sent to the imaging device through the infrared transmission module, and the light-emitting pen 30 An infrared receiving module (not shown) is provided to receive a synchronization signal from the camera device 40 and is configured to synchronize the emission of infrared light according to the synchronization signal.

The light-emitting pen 30 flashes infrared light in a manner that emits infrared light in certain frames and does not emit infrared light in other frames with respect to consecutive frames of photographing by the camera device 40. The light emission/non-emission of the infrared light of the light-emitting pen 30 is continuously performed while the light-emitting pen 30 is operated with several frames of photographing as one cycle.

In this embodiment, the light-emitting pen 30 emits/non-emits light in a predetermined order, with 48 frames as one cycle.

When the camera device 40 captures an image of the screen 20, an image of the projector 10 projected onto the screen and an image of infrared light of the light-emitting pen 30 are incident on the captured image.

Among the images captured by the camera device 40, the frame of the image captured at the timing when the light-emitting pen 30 emits light includes the image of infrared light from the light-emitting pen, and the frame of the image captured at the timing when the light-emitting pen does not emit light Does not include images of infrared light.

The image captured by the camera device 40 is processed by the image processing module. The image processing module determines image data from the imaging device of the camera device 40 for each frame of photographing.

Each pixel constituting an image of each frame of the input image is read, and an image projected by the projector 10 on the screen and an image of infrared light from the light emitting pen 30 are extracted.

Accordingly, the image processing module of the camera device 40 compares the image projected by the projector 10 and the image of infrared light from the light-emitting pen 30, and the light-emitting pen 30 compares the image projected by the projector 10 You can determine where it is placed.

On the other hand, since the light-emitting pen 30 emits light in a specific frame and does not emit light in other frames for a series of 48 frames of one cycle, the image read by the image processing module is transmitted by infrared light from the light-emitting pen 30. There is a frame in which an image is determined and a frame in which an image of infrared light does not exist.

The image processing module assigns a number of '1' to a frame with an image of infrared light, and a number of '0' to a frame without an image of infrared light, so that information consisting of binary data from a series of frames is given. You will get it.

FIG. 2 is a sequence chart in which a light-emitting pen emits or does not emit light for each frame of a camera shot according to a synchronization signal of a camera, as processed by an image processing module, as binary data of '1' and '0'. It demonstrates with reference to the sequence chart of this figure.

The 48-bit signal forms one data packet in one period, and each bit signal in one data packet is configured to indicate specific information according to its order.

In FIG. 2, two different light-emitting pens (A, B) are used in one computer input system as an example. Each light-emitting pen touches the screen and is spaced apart from the screen to be suspended in the air. Different identification codes are assigned for each.

In addition, it is illustrated that the two functions of the light-emitting pen are selected. For example, the light-emitting pen displays black when there is no function selection, and one function when the function is selected is that the light-emitting pen functions as a red pen. The other function may be set to perform an erasing function.

2 illustrates that the light-emitting pen has two additional functions, a red pen and an erasing pen, but it can be set to have a color other than red or other additional functions.

How the identification code and the additional function of the light-emitting pen are displayed as different binary data in the sequence chart of FIG. 2 will be described.

First, a sequence chart showing the touch state of the light-emitting pen A and the state in which the additional function does not operate will be described.

Of the 48 bits, the odd-numbered bit is basically indicated as 1, the even-numbered bit is indicated as 0, and the even-numbered bit indicated as 0 is converted to 0 or 1 to display an identification code or other necessary information.

The image data captured by the camera according to the lighting/non-lighting of the light-emitting pen is input to the image processing module, and the image processing module generates a modulated signal in which 1s and 0s are alternately repeated, so that infrared light from the light-emitting pen received from the camera is transmitted. In contrast to the signal, the modulated signal of 0 is compared with the signal from the light-emitting pen to extract information.

Bits 1 to 5 correspond to a head indicating the start of a sequence of signals of one packet. All of these bits are marked as 1s to identify the beginning of the signal of one packet and to distinguish it from the signals of the next period.

Next, the 8th, 10th, 12th, 14th, and 16th bits, which are the even-numbered bits out of 8 to 16, are sequentially displayed as 1, 0, 1, 0, 0, thereby indicating the identification code of the light-emitting pen A in the touch state. Show.

The 17th to 44th bits indicate the additional function of the light-emitting pen. Here, the odd-numbered bit is also indicated as 1, and the even-numbered bit is indicated as 0 or 1 to indicate the sign of the selected additional function.

Finally, bits 45 to 48 are used as a signal indicating the end of the packet, and are displayed in the same way as the computer's modulated signal.

When comparing the signal of the touch state of the light-emitting pen A and the signal of the floating state in FIG. 2, in the floating state, the 8th, 10th, 12th, 14th, and 16th bits are sequentially displayed as 0, 1, 0, 0, 0. Since the identification code is displayed, it is distinguished from 1, 0, 1, 0, 0, which are identification codes of the touch state, so that the image processing module determines that the light-emitting pen A is in a floating state.

The information on the infrared light from the light emitting pen that the image processing module receives from the image pickup device of the camera device 40 and processes it includes a series of coordinate information of the infrared light from the light emitting pen for the image from the projector projected on the screen. , When a series of coordinate information of infrared light stays at a point for a predetermined time or longer, the light-emitting pen recognizes that the point has been clicked, and when the series of coordinate information moves from one point to another, the user uses the light-emitting pen. It can be recognized as drawing a line.

However, in such infrared light, the 8th, 10th, 12th, 14th, and 16th bits are sequentially displayed as 0, 1, 0, 0, 0 in the binary data of one period displayed according to emission/non-emission, so that the computer It is determined that the light-emitting pen A is in a floating state, and even when the coordinate information of the light-emitting pen A remains at one point or moves with a certain trajectory, it is not determined by clicking or drawing a line.

On the other hand, if the 8th, 10th, 12th, 14th, and 16th bits are sequentially displayed as 1, 0, 1, 0, 0, the image processing module determines that the light-emitting pen A is operating in the touch state, and the light-emitting pen When the coordinate information of A stays at one point or moves with a certain trajectory, it is determined by clicking or drawing, and it is treated as input information.

On the other hand, in the sequence chart of the light-emitting pen B in FIG. 2, bits 8, 10, 12, 14, and 16 are sequentially displayed as 1, 0, 0, 0, 1 in the touch state, and 0, 1 sequentially in the floating state. , 0, 0, 1, so that the image processing module distinguishes between the touch state and the floating state of the light-emitting fan B, and since all these signals have different identification codes of the light-emitting pen A, the light-emitting pen B is used and the light-emitting pen B The input information from is identified as being input.

In this way, it is possible to identify the light-emitting pen by a series of signals of one packet by lighting/non-lighting the light-emitting pens, and to distinguish between a touch and a floating state.

Although two light-emitting pens are illustrated in FIG. 2, as illustrated, when five bits are used as identification codes, 32 distinct identification codes can be displayed, so that 16 light-emitting pens can be distinguished. .

In addition, when the number of bits used as the identification code is increased or the identification code indicating the light-emitting pen and the signal indicating the touch/floating state are displayed as separate bits, the number of identifiable light-emitting pens can be increased.

In addition, in the environment in which the input system of this embodiment is used, in addition to the infrared light from the light-emitting pen, the screen is incident on the screen, and the external infrared light is also photographed by the camera. It is frequently entered into.

In the prior art, it is determined whether it is infrared light from a light emitting pen through analysis of the form of infrared light, etc., but there are many errors in this determination and a time delay due to image analysis may occur.

However, according to the configuration and operation of the present embodiment, the external infrared light is not flashing in synchronization with the camera, or even if it is a flashing light, it is not synchronized with the timing of the shooting frame of the camera device. Since a series of external infrared light extracted from does not represent a signal displayed by the light emitting pen of the present embodiment, the computer determines the external infrared light without error.

Meanwhile, in this embodiment, the light-emitting pens are configured so that a user can select a red pen or erase function by pressing a function button. For example, when the user presses the function button and selects function 1 shown in FIG. 2, the light-emitting pen turns red, and when a line is drawn by touching the screen with the light-emitting pen, the computer recognizes that the light-emitting pen draws a red line. A red line is recorded as input information, and a red line is displayed on the screen from the projector.

In addition, for example, when the user selects the function 2 shown in FIG. 2 by pressing the function button, the light-emitting pen is converted to an eraser, and when the light-emitting pen touches the screen, the computer recognizes the light-emitting pen as an eraser, and the light-emitting pen touches it. You can erase lines or drawings that have already been displayed in the area.

According to the selection of this function, the light-emitting pen changes the display of signals by lighting/non-lighting, and the change of such signals is displayed as signals of the 17th to 44th bits described above.

Referring to FIG. 2, bits 17 to 44 in the sequence chart are used to indicate a function selection signal, and bits 17 to 22 are signals according to selection of a function button, and each 1 when a function button is not selected. Displayed as ,1,1,1,1, and 1,1,1,0,1 when the function button is selected.

In addition, bits 22, 24, 26, 28, and 30 in the sequence chart of FIG. 2 function as codes to identify the function selected by the light-emitting pen. Looking at the corresponding bit of the light-emitting pen A, function 1 for the red pen is 1 ,1,0,1,1, function 2 related to the eraser is indicated as 1,0,0,1,0. Bits 31 to 44 are idle bits and may be used as a signal indicating selection of a corresponding additional function when an additional function is implemented in the light emitting pen.

Therefore, in the signal in which a packet of one cycle is displayed as 48-bit binary data by the blinking of infrared light from the light-emitting pen A, the image processing module causes the light-emitting pen A to change according to the signals of the 22nd, 24th, 26th, 28th, and 30th bits. It is determined that it is selected as a red pen or an eraser, and a red pen is displayed at corresponding coordinates of the infrared light from the light-emitting pen A, or an erase function is performed on a line segment that has already been marked.

As described above, in the computer input device according to the embodiment of the present invention, the camera device 40 transmits a synchronization signal according to the timing of each frame of photographing, and the light-emitting pen 30 transmits the infrared light at the timing according to the synchronization signal. Emits or does not emit light.

The light-emitting pen 30 acts as a light-emitting/non-emission function so as to continuously transmit a signal composed of 48 bits of binary data, and the signal of one cycle composed of such 48 has a unique characteristic given to each light-emitting pen 30. Information of the identification code is included, the identification code is assigned a separate identification code for a touched state and a floating state on the screen, and a signal indicating whether an additional function of the light-emitting pen 30 is operated.

Each frame of the image captured by the camera device 40 includes or does not include infrared light from the light-emitting pen 30. The image processing module extracts the image of infrared light from the light emitting pen from the image of the image of each frame, and according to whether or not the image of infrared light exists, a signal having a value of 1 if present, and 0 if not present. It is processed as a signal having the value of, analyzes the signal of one continuous cycle, and compares the identification code and additional function code of each light-emitting pen stored in the computer in advance to identify the currently used light-emitting pen and emit light. In addition to determining the state of the pen, that is, whether it is floating or touching, it is possible to determine whether an additional function is operated.

The image processing module treats the operation of the light-emitting pen in front of the screen as input information to the computer based on this determination result, and transmits the input information to the computer 50.

The computer receives input information from the image processing module and performs various operations, and in particular, displays the movement trajectory in the touch state of the light-emitting pen on the image projected on the screen 20 through the projector 10 as a line segment or The displayed line segment can be erased, and this operation is projected on the screen 20 through the projector 10, so that the projector 10 can be viewed together with other images projected on the screen.

On the other hand, in the present embodiment, 48 bits of each signal displayed by emitting/non-emission of infrared light of the light emitting pen are configured to form one cycle, but a signal of one cycle may be configured with arbitrary bits other than 48.

In addition, in the present embodiment, an identification code for identifying the light-emitting pen is indicated by five bits in the front part of the signal of one cycle, and the identification code is assigned a separate identification code for a touch and a floating state for any one light-emitting pen. It is configured to display the additional functions of the light-emitting pen with 5 bits in the rear part.

However, the present invention is not limited to this example, and the identification code of the light-emitting pen may be indicated by a number of bits other than five. In addition, only one identification code may be assigned to each of the light-emitting pens, and the floating state and the touch state may be displayed as separate signals following the signal of the identification code.

In addition, in this embodiment, the light pen is configured to switch the color and eraser functions to one function button, but the light pen has a color selection button and an eraser selection button separately, and the color is displayed from the signal displayed by the light pen. It is also possible to configure a bit area to indicate whether or not to select the eraser and separate bits.

In addition, in this embodiment, a function selection button is provided on the light-emitting pen to select color or eraser function, but a color is designated for each light-emitting pen, and a light-emitting pen for eraser is separately provided. It may be configured to be treated as a light-emitting pen of a specific color or a light-emitting pen with an eraser function.

As described above, one embodiment of the present invention has been described, and the present invention is not limited to the configuration and operation of these embodiments, and various additions, modifications, and modifications are possible within the scope of the claims.

10: projector 20: sprint
30: pen 40: camera device
50: computer

Claims (5)

delete A display device that displays an image from a computer, an input device that emits infrared light of a predetermined wavelength when the display device contacts or approaches a display area that displays an image or by a user's manipulation, and a display area of the display device A computer input system for inputting information into a computer, including a camera device,
Further comprising a synchronization signal generating device for generating a synchronization signal with respect to the photographing timing of the camera device, and an input information extracting device for extracting input information of the input device from the image captured by the camera device,
The input device receives the synchronization signal from the synchronization signal generator, and blinks the infrared light at a timing according to the synchronization signal, but emits or does not emit infrared light at a predetermined number of timings. The displayed information is displayed, and the information displayed as the binary data includes a predetermined identification code of the corresponding input device,
The input information extraction device extracts image information corresponding to infrared light from the input device from the images captured by the camera device, calculates position information in the coordinate system of the image transmitted to the display device, and is input to the computer through the display device. It is processed as information, but by extracting the information represented by the binary data from the information of the image corresponding to the extracted infrared light, the identification code of the input device is determined,
The input device includes a sensor that detects contact or proximity to the display area,
Wherein the input device has different identification codes for a non-contact or non-contact state and a contact or proximity state on the display area.
A display device that displays an image from a computer, an input device that emits infrared light of a predetermined wavelength when the display device contacts or approaches a display area that displays an image or by a user's manipulation, and a display area of the display device A computer input system for inputting information into a computer, including a camera device,
Further comprising a synchronization signal generating device for generating a synchronization signal with respect to the photographing timing of the camera device, and an input information extracting device for extracting input information of the input device from the image captured by the camera device,
The input device receives the synchronization signal from the synchronization signal generator, and blinks the infrared light at a timing according to the synchronization signal, but emits or does not emit infrared light at a predetermined number of timings. The displayed information is displayed, and the information displayed as the binary data includes a predetermined identification code of the corresponding input device,
The input information extraction device extracts image information corresponding to infrared light from the input device from the images captured by the camera device, calculates position information in the coordinate system of the image transmitted to the display device, and is input to the computer through the display device. It is processed as information, but by extracting the information represented by the binary data from the information of the image corresponding to the extracted infrared light, the identification code of the input device is determined,
The input device includes a sensor that detects contact or proximity to the display area,
The information displayed as binary data includes a signal indicating a case where the input device is in contact with or close to the display area and when the input device is not in contact with or not.
A display device that displays an image from a computer, an input device that emits infrared light of a predetermined wavelength when the display device contacts or approaches a display area that displays an image or by a user's manipulation, and a display area of the display device A computer input system for inputting information into a computer, including a camera device,
Further comprising a synchronization signal generating device for generating a synchronization signal with respect to the photographing timing of the camera device, and an input information extracting device for extracting input information of the input device from the image captured by the camera device,
The input device receives the synchronization signal from the synchronization signal generator, and blinks the infrared light at a timing according to the synchronization signal, but emits or does not emit infrared light at a predetermined number of timings. The displayed information is displayed, and the information displayed as the binary data includes a predetermined identification code of the corresponding input device,
The input information extraction device extracts image information corresponding to infrared light from the input device from the images captured by the camera device, calculates position information in the coordinate system of the image transmitted to the display device, and is input to the computer through the display device. It is processed as information, but by extracting the information represented by the binary data from the information of the image corresponding to the extracted infrared light, the identification code of the input device is determined,
The input device is provided with a means for selecting a predetermined type of color or an erasing function as a function of the input device, and the information displayed as binary data includes a signal according to a function selected by the input device.
The method according to any one of claims 2 to 4,
The synchronization signal generating device is provided in the camera device and is provided as an infrared transmission module that flashes infrared light as a synchronization signal for the timing of photographing of the camera.

Images