KR0171847B1 - Radio telemetry coordinate input method and device thereof - Google Patents

Abstract

In the wireless remote coordinate input method provided with a computer, the objects (various menus, sub-menus, control buttons, check boxes, etc.) projected on the projected screen using the computer's screen projection projector are used to display light rays or specific colors in the visible region. The coordinates on the computer monitor corresponding to the point on the screen from the image input device using the two-dimensional image sensor are output through the pointer driver, and the indicated control purpose is selected by the keyboard, mouse, or pen digitizer. Wireless remote coordinate input method characterized in that performing the same function.

Description

Wireless remote coordinate input method and device

1 is a schematic diagram for explanation according to the present invention.

2 is a circuit diagram according to the output of the X, Y coordinates in accordance with the present invention.

3 is an example of installation of a laser pointer driver of FIG.

4 is an enlarged projection image illustrating an embodiment of the present invention.

5 is a diagram illustrating coordinate changes on an actual monitor on a screen screen captured by a CCD sensor.

The present invention relates to a coordinate input device, and more particularly, to a method and apparatus for pointing a computer application screen enlarged and projected onto a screen by using visible light, and outputting coordinates on the pointed screen as coordinate information on an actual computer monitor. will be.

In various conferences and seminars, computer monitor screen projection projectors are increasingly used. At this time, there is a first case in which the presenter directly manipulates the application software of the computer and a second case in which the coordinator operates the software according to the presenter's presentation. The same problem occurs.

In the first case, the eye contact frequency between the presenter and the audience is low, so it is difficult to form a consensus, which makes it difficult for the presenter to grasp the degree of understanding of the audience.

In the second case, it is difficult to accurately match the presenter's presentation contents with the assistant operator's S / W operation, and the presentation time is likely to be delayed. Rapid screen response and explanation is difficult and requires sufficient pre-exercise of presenter and assistant. As an example of this, US Patent No. 5,237, 622 can be described in detail. This is to solve the inconvenience of the input device of the portable computer, and the position of the fan type input device is detected according to the sensitivity difference of each area by detecting light with a two-segment light receiving device. It is to implement a wireless fan digitizer without a tablet as a wireless input device by calculating.

Accordingly, an object of the present invention is to control each of the control object of the application S / W screen that the presenter is enlarged and projected on the screen by using a pointer bar that is commonly used during a meeting or a laser pointer that is often used in recent years to solve the above problems. The present invention provides a method and apparatus for implementing the same functions as operating a S / W by using a keyboard, a mouse, a pen digitizer, or the like, when the control objects are pointed according to a predetermined method.

It is yet another object of the present invention to provide a wireless remote coordinate input device that can be used in computer applications.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram according to the present invention, in which a screen 101 displaying a screen to be enlarged, a computer system 106 for generating a video signal, and a video signal generated from the computer system 106 are projected on an enlarged screen. The projector 104, the laser pointer 102 for generating a pointing signal on the screen 101, and the screen of the projector 104 using a CCD camera to determine which position of the screen the laser pointer is pointing to. It consists of the CCD camera part 103 which outputs in the (x, y) coordinate on a monitor.

In FIG. 1, a video signal made of an application S / W in the computer system 106 is first sent to the screen magnification projection projector 104 and magnified and projected onto the screen 101 (in some cases, may also be simultaneously sent to the monitor). When the projected screen is input to the apparatus of the present invention using a general CCD camera 103, the laser pointer 102 outputs (x, y) coordinates on the monitor to which position the screen 101 is pointing. The output coordinate information is processed in S / W in the same manner as when using a general mouse 107 or a digitizer. That is, when the laser pointer 102 performs on / off in accordance with a predetermined convention from the coordinates on the screen 101 pointed to by the laser pointer 102, the laser pointer driver converts this coordinate information to the coordinate information of the mouse and the mouse. It is converted to button down / enter information and sent to the application S / W. Therefore, when various control objects (various menus, submenus, control buttons, check boxes, etc.) of the application software are pointed with a laser pointer and turned on / off according to a predetermined rule, the corresponding control objects are keyboard 108. In addition, the same effect as that selected by the mouse 107 can be performed to advance the operation of the application software.

FIG. 2 is a circuit diagram for calculating x and y coordinates using the CCD camera 103 of FIG. 1 according to the present invention. The vertical and horizontal clock generators 201 and 202 for generating vertical and horizontal clock signals and the screen 101 are shown in FIG. A CCD image sensor unit 209 for acquiring the makeup of the sensor and sensing the R, G, and B outputs, a comparator 206 for comparing the output of the horizontal R with the output of the reference voltage VS, and the comparator ( Delay circuit 207 for delaying the output of 206 and vertical and horizontal counters 208 and 209 clock-enabled by the output of the comparator 206 and counting the output of the vertical and horizontal clock generators 201 and 202, respectively. And horizontal and vertical shift registers 210 and 211 for shifting the output of the vertical horizontal counters 208 and 209 to generate (x, y) coordinates, and generating output enable signals of the vertical and horizontal shift registers 210 and 211. It consists of an input / output register 212.

That is, the signals from the vertical horizontal clock generators 201 and 202 are branched and input to the horizontal and vertical counters 208 and 29. Since the wavelength of the commonly used laser pointer 102 is 628-680 nm (10 ^-9 m) in red color, the red output (Or) and the variable threshold (Vth) are red output using the level comparator (206). Only when (Or) exceeds the threshold (Vth) is applied as an output enable signal to the vertical, horizontal counters (208, 209) so that the output signal is in a high state. The values output from the vertical and horizontal counters 208 and 209 represent x and y coordinate values, and are transmitted to the horizontal and vertical shift registers 210 and 211 and through the delay of the delay circuit 207 with a slight margin to the transfer time. The vertical and horizontal counters 208 and 209 are cleared by the counter clear signal. Therefore, the output values of the vertical and horizontal shift registers 210 and 211 are generated only when the laser pointer 102 is illuminated on the screen 101. On the other hand, the computer system 106 uses the I / O map addressing or the memory map addressing to read the values of the vertical / horizontal shift registers 210 and 211 for each frame generation period and use them as coordinate signals from the mouse or the digitizer.

Therefore, an example for the practical implementation of the present invention will be described in detail with reference to FIGS. 1 and 2, and by reading the graphic setting values Hm and Vm of the computer system 106 to be used, as shown in FIG. Four 10 × 10 pixel size pushbuttons are displayed in the four corners of the screen, and 30 × 30 pixel size pushbuttons are displayed in the center of the screen. Then, the beam from the laser pointer 102 is positioned at the pushbutton P0, and the laser pointer 102 is turned off / on for more than a predetermined time interval Tg or positioned outside the pushbutton P0 and then again. Position it at P0 (similar to double click time adjustment when using the mouse).

In FIG. 2, the values of the vertical and horizontal shift registers 210 and 211 are read. If the values of the vertical and horizontal shift registers 210 and 211 are not read, the operation of the pushbutton P0 is repeated while lowering the variable threshold Vth, and if the values of the vertical and horizontal shift registers 210 and 211 are read. The above operation is repeated while increasing the variable threshold value Vth, and the threshold value Vth is set to be slightly lower than the maximum value of the threshold value Vth that is read from the vertical / horizontal shift registers 210 and 211. The laser pointer 102 is then directed to the pushbutton P1, and then turned on / off according to a predetermined convention, and the values (x1, y1) of the vertical and horizontal shift registers 210, 211, which are then released, are (0,0). Map to. In a similar manner to the above, the values (x'2, y'2) of the vertical and horizontal shift registers 210 and 211 of P2 are mapped to the vertical and horizontal (Hm, 0), and (x'3, y'3) is ( 0, Vm) and (x'a, y'a) map to (Hm, Vm). The reason for performing the above operation is to prepare for the case where the projector 104 and the screen 102, the screen 101 and the CCD camera 103 are not penetrated exactly in parallel and penetrated.

As above operation, H / W setting and S / W setting of the laser pointer driver are completed, and x'1, x'2, x'3, x'4, y'1, y'2, y '3, y'4, Hm, Vm are passed as parameters to the laser pointer driver S / W. Finally, after installation, the operation performed by the laser pointer driver S / W when actually operating in the application software is as follows.

As can be seen in FIG. 5, when the laser pointer 102 illuminates an arbitrary point P, the coordinate value (x ', y') output from the H / V shift register of FIG. The relationship with the coordinate values (x, y) on the monitor 109 is as shown in Fig. 5 and the following equation.

Therefore, taking the average value, the coordinate value on the monitor 109 becomes as follows.

In the above equation, if you get up to 8 constants C1-C8, you can get the actual coordinates (x, y) on the monitor from the coordinates (x ', y') of the output CCD sensor. Expression of the dog,

From the above equation, C1-C8 can be obtained as follows.

As mentioned above in the installation procedure, x1, x2, x3, x4, y1, y2, y3, y4 and Hm, Vm are already known. Therefore, once C1-C8 is obtained, the coordinates output from the horizontal and vertical shift registers 210 and 211 From the values (x, y), the coordinate values (X, Y) on the monitor 109 of the computer system 106 can be known, and these coordinate values can be obtained using the laser pointer 102 driver S / W as in the case of the mouse driver. use.

The control objects (various menus, submenus, control buttons, check boxes, etc.) of the actual application software have a certain size horizontally (Xs, Ys-Xe, Ye) and coordinate values in the H / W shift registers 210 and 211. When (x, y) is output and (X, Y) obtained by Equation (1) falls within the range of the control object, it can be seen that the laser pointer 102 indicates the control purpose. At this time, if the laser pointer 102 is turned on / off according to a predetermined rule (for example, Off-On within 0.3 seconds in any Control Object range in the On state), the laser pointer drive S / W is selected to control the mouse. By interpreting that a button click or keyboard enter operation has occurred, the information is sent to the application software, and based on this information, the application software performs the corresponding operation, thereby providing the same function as the mouse 107 or the keyboard 108. It is done.

In the above, the principle of the present invention which implements the remote control of the application S / W by pointing the enlarged projected computer screen with the laser pointer 102 was described. However, the illustrations and principles used in the description are only examples for realizing the facts of the present invention, and it is possible to implement the spirit of the present invention in various other modified ways.

For example, it is also possible to use another two-dimensional image sensor such as an imaging tube instead of the CCD camera 103. In addition, the laser pointer may be replaced with a light source having a wavelength other than the wavelength (628-680 nm) described in the principle of operation, using a visible light having good linearity, or a light source that is focused at a specific distance. To implement the idea. In addition, FIG. 1 illustrates an example in which the CCD camera 103 is an independent external interface with the computer system 106 through a serial / port. However, as shown in FIG. 4, a partial mirror is applied to the projection optical system of an existing computer screen magnification projection projector. Alternatively, a beam splitter composed of a prism or the like may be mounted to implement a built-in type.

As described above, the presenter points out the control objects of the application S / W screen enlarged and projected on the screen using a pointer rod commonly used during a meeting or a laser pointer rod which is often used recently. ), It can perform the same function as operating the S / W with the keyboard, mouse, or pen digitizer of the computer, and has the advantage of enabling wireless remote coordinate input from the computer.

Claims (7)

In the wireless remote coordinate input method provided with a computer, the objects (various menus, sub-menus, control buttons, check boxes, etc.) projected on the projected screen using the computer's screen projection projector are used to display light rays or specific colors in the visible region. The coordinates on the computer monitor corresponding to the point on the screen from the image input device using the two-dimensional image sensor are output through the pointer driver, and the indicated control purpose is selected by the keyboard, mouse, or pen digitizer. Wireless remote coordinate input method characterized in that performing the same function. The method of claim 1, wherein the image input uses a value obtained from a CCD camera. The wireless remote coordinate input method according to claim 1, wherein the image input uses information input through an imaging tube. The method of claim 1, wherein the screen instructions are made by a visible light laser pointer. The wireless remote coordinate input method according to claim 1, wherein the screen instruction is made by detecting a state of the indicator rod coated with a specific color (visible or invisible) paint or pigment. A wireless remote coordinate input device having a computer, comprising: a screen 101 for displaying a screen to be enlarged, a computer system 106 for generating a video signal, and a video signal generated from the computer system 106 for a magnified screen. The laser pointer 102 to position the projector on the screen 101, the laser pointer 102 generating a pointing signal on the screen 101, and the screen of the projector 104 using a CCD camera. And a CCD camera unit (103) for outputting whether there is an x, y coordinate on the monitor. 7. The method of claim 6, wherein the x, y coordinate generation using the CCD camera 103 comprises the vertical and horizontal clock generators 201 and 202 for generating vertical and horizontal clock signals, and the makeup of the screen 101 by R, A CCD image sensor unit 209 for sensing G and B outputs, a comparator 206 for comparing the output of the horizontal R with an output of a reference voltage VS, and a delay of the output of the comparator 206 Vertical and horizontal counters 208 and 209 that are clock enabled by the delay circuit 207, the output of the comparator 206, and count the output of the vertical and horizontal clock generators 201 and 202, respectively, and the vertical horizontal counter. Horizontal and vertical shift registers 210 and 211 that generate X and Y coordinates by shifting the outputs of 208 and 209, and input and output registers 212 that generate output enable signals of the vertical and horizontal shift registers 210 and 211. Device.