KR20070003753A - Computer input device utilizing a camera to recognize position and twinkling compare laser pointing image with computer display picture - Google Patents

Abstract

A computer input device for recognizing a position and a twinkling by comparing a laser pointing image with a computer image through a camera is provided to recognize/input the position and the twinkling to a computer by displaying the position with a light pointing device for displaying a pointer to a display device and capturing/comparing the pointer with the computer image. The camera(13) is fixed to a rear side to capture the display monitor(15) and captures the image by using a reference coordinate image marking corners of an initial rectangular. The captured image is recognized as a position correction value of the computer image. A position change of a laser pointer(12) and the twinkling are extracted by comparing the captured image with the computer image and comparing the continuously captured image with the computer image. The position and a command in a computer screen are transferred to the computer(11) by transferring the extracted position value and twinkling.

Description

Computer input device utilizing a camera to recognize position and twinkling compare laser pointing image with computer display picture}

1 is an exemplary view of a computer input device that recognizes a position and flicker by comparing a laser pointed image with a computer image using the camera of the present invention.

2 is a comparison diagram of a computer monitor image and a pointing camera photographed image for the purpose of comparing and understanding the optical pointer of the present invention.

3 is an exemplary pen type pointer displayed directly on the display surface of the present invention.

4 is a diagram illustrating an example of using a reference coordinate image and a reference point of the present invention.

5 is an exemplary view of overlaying a reference point coordinate image on the image for setting the reference coordinate of the present invention

6 is a flowchart illustrating a position of a pointer and a command recognition process in the computer of the present invention.

Figure 7 is a comparison picture between a picture taken pointing to the actual display screen of the present invention and the computer display screen used for shooting

Figure 8 is an illustration of a pointer of a constant diameter printed by combining a specific color and pattern of the present invention

Conventional documents related to the present invention include Korean Patent Publication No. 10-2004-0066776, "Image sensor using remote pointing system having a general infrared remote control communication function" and US Patent No. US6538645, "Computer input system utilizing a camera to sense. point source ".

The technical field to which the present invention belongs is a device that enables input of a position and a command among computer input devices such as a mouse, and has recently been developed from a ball mouse to an optical mouse, a laser mouse, etc., and inputs to a computer by recognizing relative movement in space. There is a gyro pointer.

A computer input device that generates relative xy coordinates by sensing only the movement of a pen-type LED light source with a camera has been exemplified (US Patent No. US6538645). On this relatively large monitor, it is no different from the behavior of an ordinary mouse moving very largely, and it is very difficult to direct or accurately display it on a large-sized projector and display monitors such as LCD and PDP.

When using the projector, LCD, PDP, etc. as a computer monitor, the pointer and input device can operate by directly displaying on the display surface. It must be.

In the case of computer shooting games, when the user shoots with the pointer toward the large screen being displayed, the input device that matches the pointing and input that can accurately display the pointer directly on the large display monitor displays the existing relative coordinates. This may be more convenient than a regular mouse or gyro pointer.

In addition, in the educational environment, the electronic blackboard should be able to draw or display a picture directly on the screen being displayed, and at the same time, it may be conveniently used when instructions and commands are input away.

The technical problem to be achieved by the present invention is to display the position of a single color pointer, such as a laser pointer on a display device such as a projector, LCD, PDP, etc. representing a computer image, the position is displayed, and the image of the computer image and the pointer It is to provide a convenient device such as a mouse that can recognize the position and blink on the computer by comparing the image of the pointer to recognize the image by comparing the image of the pointer to the camera to transfer to the computer.

The configuration of the present invention comprises a monitor display, a pointer light emitting device, a pointer recognition camera, and a computer that can recognize the position and blink of the pointer by comparing the captured image.

As an example of the present invention, in FIG. 1, the projector screen 15 and the projector 14 for projecting a computer image are used as the computer monitor display device, and the image and pointer light emitting device 12 projected on the projector screen at the bottom of the projector are emitted. A pointer recognition camera 13 capable of capturing the pointer 10 together with the display image, and a computer 11 receiving the captured image of the camera and processing the images to recognize the position and the command by comparing the images.

The pointer light emitting device 12 may be a laser pointer of a single color, which is generally used, and the laser pointer may be directly projected and pointed at a certain distance to the computer image projected on the front surface so as to move or blink. And blinking pointer recognition camera 13 is photographed and transmitted to the computer 11 in real time, the computer can determine the position and command input by comparing the real-time captured image with the computer display image.

In Fig. 2, the image transmitted to the computer is a computer (a) image (21) with slightly different points depending on the shooting position and angle, the shooting resolution, the ambient brightness, etc. 11) Through the image comparison operation process 64, the movement of the pointer and flicker are recognized as relative positions and command inputs.

The photographing camera 13 may be located at a location where the computer image can be best captured by a CCD or CMOS electronic camera capable of continuous shooting, and the pointer light emitting device 12 emits light according to the size of the displayed image and the camera resolution. The size of the pointer diameters may vary, and the shape may be another shape easily recognized in a circle.

In the case of the projector 14, since the image is projected a certain distance away, the projector is a good place to shoot the projected image of the projector, and the camera is placed in the projector so that the pointer recognition camera 13 and the projector 14 are located. Can be configured integrally.

In FIG. 3, the pointer light emitting device 12 is a pen-type pointer 31 having a short length in front of the image display 30 close to the image display 30, such as a writing instrument, and a light emitting device such as a switch 33 in front of the pen and a light emitting diode in the back of the pen ( 32), it is recognized as a pointer in front of the video display when viewed with a camera photographing from behind.

As shown in FIG. 4, the monitor display device displays a reference coordinate image 40, which the camera knows the rectangular horizontal and vertical length of the initial monitor, on the monitor display, and each reference point 41, 42, 43, 44 of the first captured square. By initial recognition of the relative horizontal and vertical size of the display monitor, the coordinates of the pointer taken by the camera are converted to the (x, y) coordinates 47 by comparing the length of the horizontal 45 and vertical 46 with the reference point. To recognize the relative position of the input device.

As an example of obtaining relative coordinate values, the photographed image which is tilted from the top to the bottom has a distance between the reference points 42 and 43, the same image on the computer as the distance between the reference points 41 and 44, but the captured image appears distorted and short. As a result, the horizontal length 45 should be calculated and reflected according to the relative position of the vertical length 46. Similarly, when calculating the length of the vertical, the computer can recognize the exact position intended by the computer user.

Therefore, the reference coordinate image 40 can be displayed on the display monitor in a computer so that the relative length can be reflected in real time by changing the size of the input device, and only the initial position of the camera is fixed to store the reference position value to move the camera position. You will continue to know the relative position of the pointer unless you can.

In FIG. 5, the reference coordinate image 50 is overlaid on the computer image image 51 to be displayed 52 or displayed alone to recognize the reference coordinate value by using a camera, and to capture the reference screen as the reference coordinate value. Will be used.

In addition, even if the projected image is projected to another position, when the computer image image is displayed with a pointer in the non-projected reference coordinate space and photographed with a camera, the relative position can be recognized by the computer.

In FIG. 6, the computer generates a reference coordinate image 61a and displays it on the computer display monitor. The computer generates a reference coordinate image 61a and captures it with the pointer photographing camera 63 to recognize the pointer photographing reference coordinate image 62a. Remember the correction value. When the pointer is moved, the image 62 of the pointer-taking camera is compared with the computer image image 61 to perform arithmetic operation 64 to extract the pointer by moving and blinking the pointer, and to input the position change and command back to the computer 60 ( 66) It will be processed.

The computer displays an image image and a pointer-taking camera image as dots of a specific color of the projected laser pointer light source, and compares (64) positions with the captured continuous input image of the pointer-taking camera image 62 to move and blink. Will be identified.

7 shows a picture 70 taken by a camera projecting a computer screen with an actual projector and pointing with a laser pointer, and a computer display screen 71 used for shooting. When pointing with a laser pointer, a red dot 70a is indicated. The larger the diameter of the point is, the easier it is to distinguish the point where the light source is strongly pointed, and the position determination accuracy can be increased. The point projected by the laser pointer is a strong laser light source, which makes a change in the shape of a point of a specific color unlike other places, and the point that is pointed to the image is different from the other point.

The display device of the present invention can be any device capable of displaying a computer screen, such as a projector, LCD, PDP, etc. capable of taking an image. In addition, the pointer light emitting device may be the most common laser pointer, spot lighter, pen type LED, and the like, and moves on the display surface with a pointer 80 having a constant diameter printed by combining a specific color and pattern in FIG. When photographing and inputting basic information to be compared and judged by a computer in advance, it is possible not to emit light but to a printed product without power supply.

The effect of the present invention is directly pointing to the display image using a laser pointer, a light that can be represented by a point, a printed display, and the like, and the position is recognized and expressed on a computer, so that accurate and detailed operation is possible and wirelessly. You can point at a certain distance, switch screens, click, and more.

In addition, even without a monitor screen, it is possible to display a relative position and input a command to a body expression using a light emitting body in a relative space where initial position recognition is performed, and thus it can be widely used for computer education and computer games.

Claims (4)

A display monitor device (15) such as a projector, LCD, PDP, etc., showing a computer image image, a laser pointer (12) that can directly point to the display monitor device image, and a display monitor image, It consists of a camera 13 which can simultaneously shoot the projected laser pointer light source together and transfer it to the computer 11, The camera is fixed to the back of the display monitor where the image can be taken and photographed using the reference coordinate image 40 showing the initial rectangular vertex, and recognized as a position correction value of the computer monitor image of the image to be taken. The photographed camera shot image 21 is compared with the computer monitor image 20 in the computer 11 connected to the camera, and compared with the camera captured image 21 that is continuously captured to perform arithmetic processing 64 to change the position of the laser pointer light source. Computer input device, characterized in that to extract only the blink and transfer the position value and the blink to the computer 11 and transfer the position and command on the computer screen In claim 1, A pen-type pointer (31) that holds a hand directly on the display monitor screen with a pointing device and a switch (33) for blinking in front of the pen with a pen-type pointer (31) that allows the camera to distinguish the display image from the back end. A computer input device having a light emitting device 32 capable of emitting a pointer light source of In claim 1, Pointer (80) printed with a specific size that combines specific colors and patterns with a pointing device. Registers image information on the computer in advance and recognizes it as a pointer instead of a light-emitting pointer that uses power when shooting while moving on the display surface. Computer input device, characterized in that can be used In claim 1, A computer input device, characterized in that the camera 13 for capturing a pointer image is integrally built into the projector 14 for projecting a computer image image.

Images