KR100858138B1 - Control System Using Remote Pointing Device - Google Patents

Abstract

The present invention relates to a control system using a remote pointing device. More particularly, a remote pointing device can be used as a computer input means such as a mouse or a keyboard by giving a control signal to a point indicated by a laser pointer on a display device. A control system using a device. A control system using a remote pointing device according to the present invention includes a display device for displaying input background image information, a camera generating an optical point on the display device, and photographing the background image and the optical point to transmit image information. And a computer for recognizing a laser pointer and image information transmitted from the camera and processing the recognized image information and outputting the image information to the display device, wherein the computer recognizes the transmitted image information and the background image. And image control means for separating the optical point and generating a control signal according to the position of the optical point, and display control means for controlling the display device according to the control signal transmitted from the image recognition means.

 Laser Pointer, Segmentation, Image Capture, Presentation, Beam Projector

Description

Control System Using Remote Pointing Device

1 is a view showing the configuration of a control system using a remote pointing device according to an embodiment of the present invention,

2 is a block diagram of a control system using a remote pointing device according to an embodiment of the present invention;

3 is a view showing that the optical point and the background image is separated by the optical point / background image separator according to an embodiment of the present invention,

4 illustrates a page up / down function of a control system using a remote pointing device according to an embodiment of the present invention;

5 is a view showing a pen function of a control system using a remote pointing device according to an embodiment of the present invention;

6 is a view showing an image object moving function of a control system using a remote pointing device according to an embodiment of the present invention;

7 is a view showing a control system using a remote pointing device according to another embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

100: beam projector 200: laser pointer

200a: camera 400: computer

500: screen 420: image recognition means

430: display control means 424: background image recognizer

433: Video memory

The present invention relates to a control system using a remote pointing device. More particularly, a remote pointing device can be used as a computer input means such as a mouse or a keyboard by giving a control signal to a point indicated by a laser pointer on a display device. A control system using a device.

A display device, also called a display device, is a device that receives and displays an image signal to a user.

In addition, the display device is not only a beam project, a screen, an LCD / PDP display, but also a screen of a movie theater, a television for home use, and a monitor of a video game room.

In general, in order to control the display device, there must be an input device such as a keyboard or a mouse. Therefore, there was a problem that the presenter, in the field of presentation or remote control, cannot proceed without the assistance of an assistant at the time of presentation.

In addition, there is a demand for an input means that allows the user to easily operate the display devices in the field of the beam project, the screen, the LCD / PDP display as well as the screen of a movie theater, the television used in the home, and the monitor of the video game room. come.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and an object of the present invention is to provide a control system that can easily operate various display devices with a laser pointer.

In addition, an object of the present invention is to provide a control system that can maximize the user's ease of use by providing a variety of functions and modes for selecting the function using a variety of color light emitted from the laser pointer.

It is also an object of the present invention to provide a control system capable of quickly and accurately recognizing a background image by recognizing a background image using the background image stored in a video memory of a computer as well as a background image input from a camera. have.

A control system using a remote pointing device according to an embodiment of the present invention for achieving the above object is a display device for displaying the input background image information, a laser pointer for generating an optical point on the display device, the background image And a camera for photographing the optical point and transmitting image information, and a computer for processing the image information transmitted from the camera and outputting the processed image information to the display device, wherein the computer transmits the transmitted image information. Image recognition means for recognizing and separating the background image and the optical point, and generating a control signal according to the position of the optical point; and display control means for controlling the display apparatus according to the control signal transmitted from the image recognition means. Include.

A control system using a remote pointing device according to another embodiment of the present invention for achieving the above object is a display device for displaying input background image information, generating a light point on the display device, the background image and the A laser pointer including a camera for photographing an optical point and transmitting image information, and a computer for processing the image information transmitted from the camera and outputting the processed image information to the display device, wherein the computer is configured to transmit the image information. A display for recognizing image information, separating the background image and the optical point, and generating a control signal according to the position of the optical point, and controlling the display apparatus according to the control signal transmitted from the image recognition means. Control means.

In a preferred embodiment, the display control means includes a video memory for storing the background image, and transmits the background image to the image recognition means.

In a preferred embodiment, the image recognition means includes a background image recognizer for recognizing a background image transmitted from the camera or a background image stored from the video memory.

In an exemplary embodiment, the image recognition means may include: an external image capturer for receiving image information transmitted from the camera, an optical point / background image separator for separating the captured image information into the background image and the optical point; An optical point motion recognizer for recognizing a separated optical point, an optical point matcher for matching the position of the recognized optical point to the background image, a control signal generator for generating a control signal according to the position of the matched optical point, and the And a control output interface for transmitting a control signal to the display control means.

In a preferred embodiment, the display control means comprises a display image capture for transmitting to the background image recognizer for capturing a background image stored in the video memory.

In a preferred embodiment, the optical point matcher multiplies or divides a constant value with the resolution of the camera so that the position of the optical point photographed by the camera matches the resolution of the display device.

In the preferred embodiment, the optical point / background image separator is configured such that the image pixel values R, G, and B at a specific position of the image information are expected to be the image pixel values R ', G', and B 'of the optical point. ) Is divided into a first zone that is greater than or equal to the image pixel value R ″, G ″, B ″ of the background image and a second zone that is the remaining zone except the first zone in the divided image information.

In a preferred embodiment, the control signal generator generates a document slide page up / down control signal of a user program when the optical point occurs once in a certain portion on the display and once again within a predetermined time.

In a preferred embodiment, the control signal generator generates a document slide page up / down control signal of a user program when the optical point is continuously generated for a predetermined time on a portion of the display.

In a preferred embodiment, the light point comprises a plurality of colored lights, the colored lights comprising an input light functioning as an input means such as a mouse or a keyboard and a mode light for selecting the functions of the input light.

In a preferred embodiment, the function of the input light is a page up / down function of a document slide, an underlining or writing pen function, an eraser function for erasing the underlining or character, and an image object for moving an image object on a user program. A moving function, the functions being selected by the optical point generation of the mode light.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

1 is a view showing the configuration of a control system using a remote pointing device according to an embodiment of the present invention.

Referring to FIG. 1, a control system using a remote pointing device according to an embodiment of the present invention includes a beam projector 100, a laser pointer 200, a computer 400, and a screen 500.

In general, a display device is also called a display device and refers to a screen that receives a video signal and shows it to a user. In addition, the display device may be a beam projector, a screen, an LCD / PDP display, as well as a screen of a movie theater, a television for home use, and a monitor of a video game room.

In an embodiment of the present invention, a display device using the beam projector 100 and the screen 500 is assumed, but it is applicable to all the display devices.

The beam projector 100 receives image information from the computer 400 and projects the enlarged image through the lens on the screen 500.

The laser pointer 200 includes a camera 200b therein, is connected to the computer 400 by short-range wireless communication, and includes a laser generation module (not shown) inside and a user operable outside. A button (not shown) is provided. The short range wireless communication is selected from one of a wireless LAN, Wi-Fi, RF communication, and Bluetooth group. However, the laser pointer 200 may be connected to the computer 400 by wire.

In addition, the laser pointer 200 irradiates linear light so that the presenter can easily point the image projected on the screen 500.

In addition, the camera 200b photographs the image projected on the screen 500 and the light point irradiated from the laser pointer 200 at a speed of 30 frames per second and transmits the image to the computer 400.

The computer 400 includes image recognition means and display control means. A detailed description will be given with reference to FIG. 2.

2 is a block diagram of a control system using a remote pointing device according to an embodiment of the present invention.

Referring to FIG. 2, the control system using the remote pointing device according to an embodiment of the present invention further includes an image recognition means 420 and a display control means 430 in the computer 400.

The image recognition means 420 includes an external image capturer 421, an optical point / background image separator 422, a pointing motion recognizer 423, a background image recognizer 424, an optical point matcher 425, and a control command. Generator 420 and control output interface 427.

The display control means 430 includes a display controller 431, a display image capturer 432, a video memory 433, and a control input interface 434.

The external image capturer 421 captures an image transmitted from the camera 200b and transmits the optical point image and the background image to the optical point / background image separator 422.

The optical point / background image separator 422 separates an optical point from a background image of an image transmitted from the camera 200b. This separation process, also called segmentation process, is the process of finding similar characteristics such as brightness, color, texture, or motion of an image and dividing it into areas. That is, the extraction of the region of interest from the background image. A detailed description will be given with reference to FIG. 3.

The pointing motion recognizer 423 recognizes the position or motion of the separated optical point, and the motion such as the position or motion is recognized based on the input pointing motion DB 423a.

For example, various functions, such as a pen function of a pointer, a movement, a click, and an image object movement, may be stored in the pointing operation DB 423a to implement various functions according to the position or movement of the light point.

The background image recognizer 424 recognizes the background image separated by the optical point / background image separator 422. Also, the background image recognizer 424 may recognize a background image transmitted from the display image capturer 432.

The reason for this is that the background image captured and captured from the camera 200b is not easy to apply image recognition to the image captured by the camera 200b when the environment is poor and the screen is not clearly seen. Therefore, the background image is recognized using the background image stored in the video memory 433. This is because the video memory 433 stores the background image to be transmitted to the display device, thereby providing accurate digital image information at all times.

Therefore, the object (image object) of the background image can be recognized quickly and accurately.

The optical point matcher 425 matches a position or an operation of the recognized optical point to the recognized background image.

In addition, the matching process is a process of matching the resolution of the image frame photographed by the camera 200b to the resolution of the display apparatus. The optical point matcher 425 processes the image information by a method of multiplying or dividing a predetermined value so that the resolution of the image information photographed by the camera 200b matches the monitor resolution of the computer 400.

For example, if the resolution of the image information photographed by the camera 200b is 320 × 240 and the monitor resolution of the computer 400 is 1024 × 768, the value of the resolution of the image information photographed by the camera is equal to 3.2. By multiplying (1024/320) and multiplying the y value 240 by 3.2 (768/240), the position value (x ', y') on the screen can be obtained. That is, it can be expressed as Equation 1.

Therefore, it is possible to generate a control command at the correct position of the correct optical point.

The control command generator 426 generates a control signal according to the position or operation of the optical point in the optical point matcher 424 to control the user program displayed on the display device.

The control output interface 424 transmits a control signal output from the control command generator 427 to the control input interface 434 and the display controller 431.

The control input interface 434 outputs the background image information stored in the video memory 433 to the beam projector 100 or the monitor 410 using the control signal transmitted from the control command generator 427. Let's do it.

The display controller 431 controls the display image capturer 432 by a control signal transmitted from the control output interface 427, and the display image capturer 432 has a background in the video memory 433. The image information is captured and transmitted to the background image recognizer 424.

Therefore, when the background image captured by the camera 200b is not clearly seen, the background image captured by the display image capturer 432 may be used to quickly and accurately recognize the background image.

FIG. 3 is a diagram illustrating that an optical point and a background image are separated by an optical point / background image separator according to an embodiment of the present invention.

Referring to FIG. 3, the light point / background image separator 422 separates the light point and the background image. This process, also called a segmentation process, is a process of extracting a pixel having a specific color value defined in a program among the image pixels captured by the camera 200b.

In the first embodiment of the present invention, the specific color value is set to RGB (255, 0, 0) or more and RGB (255, 255, 255) or less. In general, the optical point color of the laser pointer 200 is red (RGB (255,0,0)), but because its brightness is not constant, it is within the range of the color value (RGB (255,255,255)) of the screen 500. Set.

However, the specific color value may be adjusted according to the color of the light point of the laser pointer 200.

In addition, the region having the specific color value greater than RGB (255, 0, 0) and smaller than RGB (255, 255, 255) is defined as the first zone 510 and is defined as the second zone 520 that is an area other than the first zone. It was.

Therefore, the first zone 510 may be expressed as Equation 2.

That is, the color values R, G, and B of the pixel satisfying Equation 2 refer to a position where the laser pointer 200 generates an optical point.

Next, pixels satisfying Equation 2 are treated as black (first region 510), and unsatisfactory pixels (second region 520) are processed as white.

Therefore, the optical point can be recognized accurately and easily.

In addition, the first zone 510 is recognized by the computer 400.

The recognized first zone 510 is matched by the optical point matcher 425 to give a control signal to a specific position of the background image. For example, a signal indicating that the mouse is clicked or a signal indicating that a specific key on the keyboard is pressed is transmitted to transmit an execution message to a program currently running on the computer 400.

In the first embodiment of the present invention, the programming is performed by using a visual key function and a mouse event function of visual C ++.

4 is a diagram illustrating a page up / down function of a control system using a remote pointing device according to an embodiment of the present invention.

Referring to FIG. 4, it can be seen that the program slide page of the user is up / down by the laser pointer 200.

The optical point of the laser pointer 200 includes an input light 210 that functions as a mouse or a keyboard which is an input means of a computer, and a mode light 220 that selects a function of the input light 210.

In the first embodiment of the present invention, the input light 210 is provided with a red laser and the mode light 220 is provided with a green laser.

However, the linear lights may be any color as long as the color can be generated by the laser pointer 200.

When the input light 210 clicks the left part in the center of the screen 500, the program slide is moved to the previous slide 600 of the current slide 600a. In addition, when the input light 210 clicks the right part in the center of the screen 500, the program slide is moved to the next slide 600d of the current slide 600c.

In addition, the click is made of the flashing of the input light (210).

In the first embodiment of the present invention, the point of input light 210 is input to the screen 500 once (500a) and within a predetermined time (500b), the point of the input light 210 is recognized again ( 500c) is implemented to function as a mouse click. In addition, the constant time was set to 0.5 seconds. Therefore, if the point of the input light 210 is not recognized again within 0.5 seconds (500b) after the point recognition 500a of the first input light 210, the first recognized point is initialized. However, the predetermined time may be set differently according to the needs of the user.

In addition to the above click function implementation method, if the point of the input light 210 is pointed for a predetermined time by using a timer function, a method of causing the click function may be possible.

5 is a diagram illustrating a pen function of a control system using a remote pointing device according to an embodiment of the present invention.

Referring to FIG. 5, when the mode light 220 is first pointed 500a on the screen 500 and then the input light 210 is dragged to a predetermined position (500b), the program light 700 and 700a are underlined. 710a is drawn.

In the first embodiment of the present invention, once the mode light 220 is pointed, the input light 210 has a pen function, but may be modified according to a user's needs.

6 is a view showing a video object movement function of the control system using a remote pointing device according to an embodiment of the present invention.

Referring to FIG. 6, when the mode light 220 is twice pointed 500a on the screen 500, the input light 210 is dragged to a predetermined position by pointing to the image object 810 on the program slide (500b). The image object 810 moves to the position 210b where the input light 210 drags.

In the first embodiment of the present invention, when the mode light 220 is pointed twice, the input light 210 functions to move the image object, but it can be modified according to the needs of the user.

7 is a view showing a control system using a remote pointing device according to another embodiment of the present invention.

Hereinafter, the description of the same components as in the first embodiment will be omitted.

Referring to FIG. 7, a laser pointer 200a and a camera 200b are separately provided.

Therefore, even when there is no laser pointer provided with the camera, the camera 200b may be prepared separately for presentation.

As described above, according to the present invention, there is an effect that the user can operate the display device using the laser pointer. Therefore, there is an effect that can proceed efficiently without the assistance of the assistant at the time of presentation, and can play the role of video manipulation function of the television, joystick, button of the video game.

In addition, by using a plurality of color lights irradiated from the laser pointer provides a page up / down function of the document slide, a pen function for underlining or writing letters, and an image object moving function for moving the image object within the computer screen Therefore, there is an effect that the presenter can make the computer operation easier.

In addition, since the background image recognizer can recognize the background image using the background image stored in the video memory, the background image recognizer can quickly and accurately recognize the background image in an environment where it is difficult to input a high quality background image from the camera. have.

Claims (12)

delete delete delete A display device configured to display the input background image information as a background image; A laser pointer generating an optical point on the background image; A camera for capturing the background image and the optical point to transmit image information; And A computer for processing the image information transmitted from the camera and outputting the processed image information to the display device, The computer: a Image recognition means for recognizing the transmitted image information, separating the background image and the optical point, and generating a control signal according to the position of the optical point; And And a video memory configured to store background image information to be input to the display device, and to receive the control signal from the image recognition means to control the display device. The image recognition means: An external image capturer for receiving image information transmitted from the camera; An optical point / background image separator that separates the captured image information into the background image and the optical point; An optical point motion recognizer for recognizing the separated optical point; A background image recognizer for recognizing a background image from image information transmitted from the camera or a background image from background image information stored in the video memory; An optical point matcher for matching the position of the recognized optical point with the background image; A control signal generator for generating a control signal according to the position of the matched optical point; And And a control output interface for transmitting the control signal to the display control means. A display device configured to display the input background image information as a background image; A laser pointer including a camera generating an optical point on the background image, and photographing the background image and the optical point to transmit image information; And A computer for processing the image information transmitted from the camera and outputting the processed image information to the display device, The computer: a Image recognition means for recognizing the transmitted image information, separating the background image and the optical point, and generating a control signal according to the position of the optical point; And And a video memory for storing background image information to be input to the display device, the display control means for receiving a control signal from the image recognition means to control the display device. The image recognition means: An external image capturer for receiving image information transmitted from the camera; An optical point / background image separator that separates the captured image information into the background image and the optical point; An optical point motion recognizer for recognizing the separated optical point; A background image recognizer for recognizing a background image from image information transmitted from the camera or a background image from background image information stored in the video memory; An optical point matcher for matching the position of the recognized optical point with the background image; A control signal generator for generating a control signal according to the position of the matched optical point; And And a control output interface for transmitting the control signal to the display control means. The method according to claim 4 or 5, The display control means includes a display image capturer for transmitting to the background image recognizer for capturing the background image stored in the video memory. The method according to claim 4 or 5, And the optical point matcher multiplies or divides a predetermined value with the resolution of the camera so that the position of the optical point photographed by the camera is matched with the resolution of the display device. The method according to claim 4 or 5, The optical point / background image separator may have an image pixel value (R, G, B) of a specific position of the image information equal to or greater than an expected image pixel value (R ', G', B ') of the optical point. And a first zone having an image pixel value of R " (R ", G ", B &quot;) and a second zone, excluding the first zone. The method according to claim 4 or 5, The control signal generator generates a document slide page up / down control signal of a user program when the optical point occurs once in a predetermined portion on the display and once again within a predetermined time. system. The method according to claim 4 or 5, And the control signal generator generates a document slide page up / down control signal of a user program when the optical point is continuously generated at a predetermined portion on the display. The method according to claim 4 or 5, The optical point includes a plurality of color lights, wherein the color lights comprise an input light functioning as an input means such as a mouse or a keyboard, and a mode light for selecting functions of the input light. Control system. The method of claim 11, The function of the input light is: Page up / down of document slides; Underlining and writing pen functions; An eraser function for erasing the underline or letter; And And a video object moving function for moving the video object on the user program, wherein the functions are selected by generating an optical point of the mode light.

Images