KR20070095179A - Pointing input device, method, and system using the image pattern - Google Patents

Abstract

A device, a method and a system for pointing using an image pattern are provided to supply motion of a mouse pointer displayed in a display area according to motions of a point indicated by a pointing device, so that a user can simply control a graphic object selected by the mouse pointer. An image receiver(210) captures an image pattern, which is displayed in a display region of a perceived size and is a reference for the scope of the display region, and senses the scope of the image pattern. A coordinate extractor(220) extracts coordinates of a location pointed at in the display region based on a center of the sensed scope of the image pattern. A transmitter(240) transmits the extracted coordinates to a pointer control device which controls a mouse pointer displayed in the display region.

Description

Pointing input device, method, and system using the image pattern

1 is a conceptual diagram illustrating the movement of a pointer and a graphic object according to an embodiment of the present invention.

2 is a block diagram illustrating a pointing input device according to an embodiment of the present invention.

3 illustrates various types of image patterns according to an exemplary embodiment of the present invention.

4 is a block diagram illustrating a pointer control device according to an embodiment of the present invention.

5 is a block diagram illustrating an image pattern generator according to an exemplary embodiment of the present invention.

6 is a flowchart illustrating an operation of a pointing input device according to an embodiment of the present invention.

7 is a flowchart illustrating an operation of a pointer control device according to an embodiment of the present invention.

8 is a flowchart illustrating an operation of an image pattern generator according to an exemplary embodiment of the present invention.

9 is a diagram illustrating a concept of performing a pointing input using a plurality of pointing input devices.

<Explanation of symbols on main parts of the drawings>

210: image receiving unit 220: coordinate extracting unit

230: button portion 240: transmission portion

The present invention relates to a pointing input device, a pointer control device, an image pattern generating device, a pointing input method, a pointer control method, and an image pattern generating method, and more particularly, a display according to a movement of a pointing point indicated by a pointing input device. The present invention relates to a pointing input device, a pointer control device, an image pattern generator, a pointing input method, a pointer control method, and an image pattern generation method for providing a movement of a mouse pointer existing in an area.

A direct pointing input device is a location of a pointer displayed on a screen of a display device by extracting a display area of a display device, such as a digital TV, and detecting a location within a screen with respect to a point currently being pointed therefrom. Refers to an input device that can control.

The direct pointing input device uses the direct mapping method in which the pointer is displayed at the point pointed by the user, so that the position of the pointer is faster and easier than that of the relative mapping method such as a mouse and a keypad. It can be operated and has the advantage of controlling the position of the pointer remotely.

Korean Patent Laid-Open Publication No. 2004-025992 discloses a general laser pointer by determining a position of a mouse laser pointer by reflecting a composite image of a laser image projected from a projector onto a screen and a laser image projected from a laser pointer through a screen. Disclosed is a mouse laser pointer positioning device and method for performing a role as well as a mouse. However, since the position of the mouse laser pointer is determined using the position of the laser image in the combined image after comparing the image formed on the screen included in the composite image with the computer, a large amount of computation for image comparison may occur.

Accordingly, there is a need for the emergence of an improved invention that can control or efficiently select the movement of a graphic object present in the display area to correspond to the pointer movement of the pointing input device.

An object of the present invention is to provide a movement of a mouse pointer displayed in a display area and to select an object according to a movement of a pointing point indicated by a pointing input device.

Another object of the present invention is to allow a plurality of mouse pointers to be simultaneously controlled by a plurality of pointing input devices, thereby selecting a plurality of objects.

The objects of the present invention are not limited to the above-mentioned objects, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, a pointing input device according to an embodiment of the present invention comprises an image receiver for capturing a predetermined image pattern displayed on a display area of a recognized size and detecting a range of the image pattern; A coordinate extractor for extracting the coordinates of the point point in the display area with respect to the center of the and a transmitting unit for transmitting the extracted coordinates.

An apparatus for controlling a pointer according to an embodiment of the present invention includes a receiver for receiving relative coordinates of at least one or more mouse pointers displayed on a display area, a coordinate determination unit for determining absolute coordinates of the mouse pointer with reference to the relative coordinates; It includes a pointer operation unit for moving the mouse pointer in the absolute coordinates.

An image pattern generator according to an exemplary embodiment of the present invention includes an image pattern generator that generates a predetermined image pattern as a reference for a range of a display area, and an image pattern output unit that outputs the image pattern.

A pointing input method according to an embodiment of the present invention comprises the steps of (a) capturing a predetermined image pattern displayed on a display area of a recognized size; (b) detecting a range of the image pattern; ) Extracting coordinates of a point point within the display area with respect to the center of the image pattern, and (d) transmitting the extracted coordinates.

According to an embodiment of the present invention, a pointer control method includes receiving relative coordinates of at least one or more mouse pointers displayed on a display area, determining absolute coordinates of the mouse pointer with reference to the relative coordinates, and the absolute coordinates. Moving the mouse pointer to coordinates.

An image pattern generating method according to an embodiment of the present invention includes generating a predetermined image pattern as a reference for a range of a display area and outputting the image pattern.

A pointing input system according to an exemplary embodiment of the present invention generates an image pattern generating device which is displayed on a display area of a recognized size and serves as a reference for a range of the display area, and outputs the image pattern on the display area. ; And a pointing input device that detects the image pattern and extracts coordinates of a pointed point within the display area.

The pointing input system according to an embodiment of the present invention detects a predetermined image pattern that is displayed on a display area of a recognized size and is a reference to a range of the display area, and determines the coordinates of the point that is pointed in the display area. A pointing input device for extracting; And a pointer control device that receives coordinates of at least one mouse pointer from the pointing input device and controls the mouse pointer.

A pointing input system according to an exemplary embodiment of the present invention generates an image pattern generating device which is displayed on a display area of a recognized size and serves as a reference for a range of the display area, and outputs the predetermined image pattern on the display area. ; A pointing input device which detects the image pattern and extracts coordinates of a pointed point within the display area; And a pointer control device that receives coordinates of at least one mouse pointer from the pointing input device and controls the mouse pointer.

Specific details of other embodiments are included in the detailed description and the drawings.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims. Like reference numerals refer to like elements throughout.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram illustrating a movement of a pointer and a graphic object according to an embodiment of the present invention. The system for providing a movement of the graphic object 120 according to the movement of the pointer 130 includes a pointing input device 200 and a pointer. The control device 400, the projector 900, and the display device 100 are configured to be included.

The pointer control device 400 may allow the pointing input device 200 to determine the range of the display area 110, the image patterns 111, 112, 113, and 114, the graphic object 120, and the mouse pointer 130. ) To create

Here, as the pointer control device 400, a personal computer in which a central processing unit is embedded may be used. Accordingly, the user controls the movement of the mouse pointer 130 using the mouse 590 connected to the pointer control device 400, and drag-and-drop using a button included in the mouse 590. Drop) to control the movement of the graphic object 120.

The user may point to a predetermined point of the display area 110 using the pointing input device 200. In this case, the pointing input device 200 may be configured to display the image patterns 111, 112, 113, and 114 of the display area 110. ) To recognize the point point.

Here, the pointing input device 200 may determine the range of the image patterns 111, 112, 113, and 114 by analyzing the displayed image patterns 111, 112, 113, and 114. Coordinates of the points pointed on the area 110 may be extracted. In addition, the pointing input device 200 may extract the actual coordinates of the pointed point on the actual display area 110 using the actual size of the display area 110.

The pointer control device 400 and the pointing input device 200 communicate with each other in a wireless or wired manner, and the pointing input device 200 transmits coordinates of the pointing point extracted by the pointer control device 400 to the pointer control device 400. Accordingly, the pointer control device 400 converts the received coordinates into the coordinates of the actual display area. At this time, when a control signal by a button provided in the pointing input device 200 is transmitted to the pointer control device 400, the pointer control device 400 generates a button down event of the mouse 590. And drag-and-drop on the graphical object 120.

For example, when the graphic object 120 exists at the point pointed by the pointing input device 200 and the user moves the position of the pointing point while selecting a button provided in the pointing input device 200, the pointing point The input device 200 analyzes the displayed image patterns 111, 112, 113, and 114 to determine a range thereof, and then extracts coordinates of the pointed point on the recognized display area of the pointed point. Then, the extracted coordinates and the control signal by the selected button are transmitted to the pointer control device 400. That is, the coordinates of the moving point and the control signal of the button are continuously transmitted.

Accordingly, the pointer control device 400 generates a mouse button selection event as the control signal is received, and converts the received coordinates into actual coordinates of the mouse pointer 130. In general, when the mouse pointer 130 is moved while the left mouse button selection event is generated in the case of a Windows operating system of Microsoft and a Mac operating system of a Macintosh. As described above, the pointer control device 400 moves the mouse pointer 130 to coordinates converted into actual coordinates to perform dragging on the graphic object 120.

Here, the movement of the graphic object 120 is taken as an example, but this is merely illustrative, and as a control signal by the relative coordinates and buttons of the mouse pointer 130 is transmitted to the pointer control device 400, drawing and object selection ( It is a matter of course that an operation such as selecting some icons while a plurality of icons are displayed may be performed.

Images of the graphic object 120 and the mouse pointer 130 generated by the pointer control device 400 are transmitted to the projector 900, and the projector 900 outputs the received image. That is, it outputs a projection screen for the received image. In addition, the projector 900 may be provided with an image pattern generator 500, which generates the image patterns 111, 112, 113, and 114 implemented by visible light, infrared rays, or ultraviolet rays. To print.

The display apparatus 100 displays projection screens such as the graphic object 120 and the mouse pointer 130 output from the projector 900, and displays the image pattern output from the image pattern generator 500. In this case, when the projection screen is output by the projector 900, the display apparatus 100 may be replaced with a screen to reflect the incident light.

Meanwhile, the display apparatus 100 may be implemented by a projection method. In this case, the image pattern generator 500 may be inserted into the display apparatus 100. That is, the image pattern generator 500 inserted in the display apparatus 100 transmits the image patterns 111, 112, 113, and 114 through the projection screen, thereby causing the image pattern 111 to be moved by the pointing input apparatus 200. , 112, 113, 114).

2 is a block diagram illustrating a pointing input device according to an exemplary embodiment of the present invention, wherein the pointing input device 200 includes an image receiver 210, a coordinate extractor 220, a button 230, and a transmitter 240. It is configured to include.

The image receiver 210 detects a range of image patterns by capturing an image pattern displayed on a display area of a recognized size. To this end, the image receiver 210 may include a camera unit 211 and an area detector 212.

The camera unit 211 serves to capture the image pattern displayed on the display area of the recognized size. As described above, the image pattern may be implemented by visible light, infrared light, or ultraviolet light. Accordingly, when the image pattern is implemented as visible light, the camera unit 211 may capture the image pattern by performing a role of a general digital camera. On the other hand, when the image pattern is infrared or ultraviolet light, the camera unit 211 may capture the image pattern by acting as an infrared camera or an ultraviolet camera.

The area detector 212 detects a range of an image pattern. For example, when a plurality of partial images constituting the image pattern are arranged in the display area, the area detector 212 may detect the range of the image pattern by using the arrangement of the partial images. After detecting the range of the image pattern, the area detector 212 may detect the center coordinates of the image pattern.

The coordinate extractor 220 extracts coordinates of a pointed point within the display area based on the center of the image pattern. That is, the coordinate extractor 220 extracts the distance between the center of the image pattern and the point point, and the coordinates extracted by the coordinate extractor 220 actually correspond to the size of the actual image pattern and the size of the recognized image pattern. It may be a coordinate according to a ratio. For example, if the size of the actual image pattern is 10 x 10, the size of the recognized image pattern is 30 x 30, and the coordinates of the points pointed to the center of the image pattern are (20, 15), the coordinate extractor Coordinates extracted by 220 are (20x (10/30), 15x (10/30), that is, (6.67, 5).

The extracted coordinates are coordinates calculated based on the center of the image pattern, and the coordinate extractor 220 may extract the coordinates of the pointed point on the actual display area using the actual size of the display area. For example, under the above conditions, if the actual size of the display area is 100 x 100, and the image pattern is located at the center of the display area, the actual coordinates of the point point are (50 + 6.67, 50 + 5), that is, ( 56.67, 55).

The coordinates extracted by the coordinate extractor 220 may correspond to the coordinates of the mouse pointer displayed on the display area. That is, the pointer control device 400 receiving the extracted coordinates may position the mouse pointer at the corresponding coordinates.

The button unit 230 receives a user command for generating a button down event of the mouse pointer displayed on the display area. That is, the user may select a button (hereinafter, referred to as a first button) provided in the button unit 230 to move a graphic object, select an icon, or draw a picture.

In addition, the pointing input device 200 may be provided with an optical transmitter (not shown) that emits light to a point where the pointing input device 200 is provided. The button unit 230 may include a button for emitting light by the optical transmitter (not shown) Hereinafter referred to as a second button). That is, the user may recognize the pointed point by reflecting light from the pointed point using the second button, and move the displayed graphic object using the first button.

The transmitter 240 transmits at least one of the control signal generated by the first button and the coordinates extracted by the coordinate extractor 220 to the pointer control device 400. As the communication method between the transmitter 240 and the pointer control device 400, wired communication methods such as Ethernet, USB, IEEE 1394, serial communication, and parallel communication may be used, and infrared communication, Bluetooth, Wireless communication schemes such as home RF and wireless LAN can be used.

3 illustrates various types of image patterns according to an exemplary embodiment of the present invention.

The image patterns 310, 320, 330, and 340 may be implemented in various shapes as shown in FIG. 3. That is, the image patterns 310 and 320 including the plurality of partial images may be implemented, or one image pattern having a rectangular shape 330 or a grid shape 340 may be implemented.

Here, when the image pattern is displayed through the display device, the graphic object to be visually delivered to the actual user may be covered by the image pattern. For this purpose, the image pattern may be implemented by infrared rays or ultraviolet rays. .

4 is a block diagram illustrating a pointer control device according to an exemplary embodiment of the present invention, wherein the pointer control device 400 includes an image pattern output unit 410, a coordinate determination unit 420, a controller 430, and a receiver 440. , An event generator 450, a pointer operation unit 460, and an output unit 470.

The image pattern output unit 410 outputs an image pattern. That is, as shown in FIG. 3, an image pattern including a plurality of partial images may be generated, and an image pattern having a square or grid shape may be generated, and the image pattern output unit 410 is illustrated in FIG. 1. To serve as the image pattern generating device 500. On the other hand, the image pattern may be implemented by a separate image pattern generator 500, not the image pattern output unit 410 provided in the pointer control device 400.

Here, the size of the actual display area and the size of the image pattern are transmitted to the pointing input device 200 so that the pointing input device 200 can detect the coordinates of the point pointed on the display area. The image pattern output by the image pattern output unit 410 may be implemented as visible light, infrared light, or ultraviolet light.

The receiver 440 serves to receive relative coordinates of at least one or more mouse pointers displayed on the display area. Here, the relative coordinates mean the coordinates of the mouse pointer centered on the image pattern. In addition, the receiver 440 serves to receive a control signal for generating a button selection event of the mouse pointer. That is, the receiver 440 receives a control signal or coordinates by communicating with the pointing input device 200. The communication method between the receiver 440 and the pointing input device 200 is Ethernet, USB, IEEE 1394, serial communication ( Wired communication methods such as serial communication and parallel communication may be used, and wireless communication methods such as infrared communication, Bluetooth, home RF, and wireless LAN may be used.

The coordinate determiner 420 determines the absolute coordinates of the mouse pointer with reference to the relative coordinates of the mouse pointer received through the receiver 440. For example, if the center of the image pattern is centered on the display area, the size of the display area is 800 x 600, and the relative coordinates received are (20, 10), the absolute coordinate of the mouse pointer is (800 + 200, 600 + 10), that is, (820, 610).

Here, the relative coordinates of the received mouse pointer may be plural. In this case, the coordinate determination unit 420 may determine the plurality of relative coordinates as absolute coordinates, respectively.

In addition, the receiver 440 may receive the absolute coordinates of the mouse pointer from the pointing input device 200 that knows the actual size of the display area. In this case, the coordinate determiner 420 may not perform a task.

The event generator 450 generates a button down event of a mouse when a control signal is received. Here, the button selection event of the mouse is generated to move a graphic object, to draw a picture, or to select an icon, and the mouse is generated to move the graphic object in an operating system such as a Microsoft Windows or a Macintosh Mac. Contains a button event.

Therefore, the event generated by the event generator 450 is not limited to the button selection event of the mouse, but includes all events required to perform the movement of the graphic object.

As the event is generated by the event generator 450, and the absolute coordinates of the mouse pointer are determined by the coordinate determiner 420, the pointer operating unit 460 moves the mouse pointer to the absolute determined by the coordinate determiner 420. Move to coordinates.

The output unit 470 outputs an image of a graphic object and the like, and outputs an image of a mouse pointer. The output image may be directly transmitted to the projection display device 100 for display or may be transferred to the projector 900 and displayed on the screen of the projector 900.

The controller 430 may include an image pattern output unit 410, a coordinate determiner 420, a receiver 440, an event generator 450, a pointer operator 460, an outputter 470, and a pointer controller 400. Perform overall control of).

The controller 430 may determine whether a control signal is received through the receiver 440. When the control signal is received, the controller 430 causes the event generator 450 to generate a selection event of a mouse button, and the coordinate determiner 420. Let us extract the absolute coordinates of the mouse pointer.

That is, when a control signal is not received, the controller 430 may cause the event generator 450 not to generate a mouse button selection event, and allow the coordinate determiner 420 to extract absolute coordinates of the mouse pointer. You can prevent the work done.

FIG. 5 is a diagram illustrating an image pattern generator according to an exemplary embodiment of the present invention, and the image pattern generator 500 includes an image pattern generator 510 and an image pattern output unit 520.

The image pattern generator 510 serves to generate a predetermined image pattern which is a reference for the range of the display area. As described above, the image pattern may be implemented by visible light, infrared light, or ultraviolet light.

The image pattern output unit 520 outputs an image pattern generated by the image pattern generator 510. The image pattern may be output on the display area using a grid having various geometric shapes. Since the various geometric shapes have been described above with reference to FIG. 3, detailed descriptions thereof will be omitted.

The image pattern generator 500 may be inserted into the projector 900 and operated, or may be operated separately. In addition, when the display apparatus 100 is a projection method, the image pattern generator 500 may be provided inside the display apparatus 100 to output an image pattern.

6 is a flowchart illustrating an operation of a pointing input device according to an embodiment of the present invention.

The camera unit 211 of the pointing input device 200 first captures an image pattern displayed on the recognized display area (S610). Here, the image pattern may be implemented as visible light, infrared rays, or ultraviolet rays. Accordingly, the camera unit 211 may capture the image pattern by acting as a digital camera, an infrared camera, or an ultraviolet camera.

The captured image pattern is transferred to the area detector 212, and the area detector 212 detects a range of the received image pattern (S620).

The range of the image pattern detected by the area detector 212 is transmitted to the coordinate extractor 220, and the coordinate extractor 220 extracts the coordinates of the point point in the display area based on the center of the image pattern. (S630).

At this time, the button unit 230 receives a user command for generating a button selection event of the mouse pointer displayed on the display area (S640). As a user command is input, a control signal corresponding thereto is generated, and the generated control signal is transmitted to the transmitter 240.

The transmitter 240 transmits at least one of the control signal generated by the button unit 230 and the coordinates of the pointed point extracted by the coordinate extractor 220 to the pointer controller 400 (S650).

In response to receiving the relative coordinates of the point, the pointer control device 400 moves the mouse pointer to the absolute coordinates corresponding to the relative coordinates, and moves the graphic object or draws the picture according to the control signal. Select an object such as an icon.

7 is a flowchart illustrating an operation of a pointer control device according to an embodiment of the present invention.

In order to move the mouse pointer, the image pattern output unit 410 of the pointer control device 400 first outputs an image pattern (S710).

The image pattern may be implemented as visible light, infrared rays, or ultraviolet rays. The image pattern output unit 410 may output the image pattern using a general digital image output means, an infrared image output means, or an ultraviolet image output means.

Here, when the image pattern is output through a separate device, the image pattern output unit 410 may not output the image pattern.

The receiver 440 receives relative coordinates of at least one or more mouse pointers displayed on the display area (S720). The relative coordinates are transmitted to the coordinate determination unit 420. Accordingly, the coordinate determination unit 420 determines the absolute coordinates of the mouse pointer using the received relative coordinates (S730). The determined absolute coordinates are transmitted to the pointer operating unit 460, and the pointer operating unit moves the mouse pointer to absolute coordinates (S740).

At this time, the controller 430 checks whether a control signal is received through the receiver 440 (S750). Thus, when the control signal is received, the controller 430 transmits an event generation signal to the event generator 450, and accordingly, the event generator 450 generates a button selection event of the mouse (S760).

As the button selection event of the mouse occurs and the absolute position of the mouse pointer is determined, the output unit 470 outputs an image such as a graphic object (S770). That is, the output unit 470 outputs an image such as a moving graphic object or a selected icon or picture among a plurality of icons.

8 is a flowchart illustrating an operation of an image pattern generator according to an exemplary embodiment of the present invention.

First, the image pattern generator 510 of the image pattern generator 500 generates a predetermined image pattern as a reference for the range of the display area (S810). The generated image pattern is transferred to the image pattern output unit 520, and the image pattern output unit 520 outputs the received image pattern (S820). Here, the image pattern may be implemented by visible light, infrared light or ultraviolet light.

Meanwhile, according to an embodiment of the present invention, even when a plurality of users simultaneously point to various places of the display area using a plurality of pointing input devices, the pointing position of each user may be determined. This will be described with reference to FIGS. 9 to 11.

9 is a diagram illustrating a concept of performing a pointing input using a plurality of pointing input devices. In FIG. 9, it can be seen that a plurality of users are pointing to the screen 910 using a plurality of pointing input devices 200_1, 200_2, 200_3, and 200_n. In this case, the position of the pointing point can be detected by setting a plurality of referencing marks on the display area to which each pointing input device 200_1, 200_2, 200_3, 200_n points.

10 is a diagram illustrating a plurality of reference marks projected on the display area. The reference mark may use a mark such as a one-dimensional or two-dimensional barcode. Referring to FIG. 10, it can be seen that two-dimensional barcodes having different shapes are projected as reference marks according to the position of the screen. If four reference marks 1011 to 1014 are located closest to the center 1015 of the detection area 1010 captured by a camera (eg, an infrared camera) attached to a specific pointing input device. As a result, the coordinates of the point that the pointing input device 200 is pointing can be detected accurately. A detailed implementation example will be described with reference to FIG. 11.

FIG. 11 is a diagram illustrating a process of detecting a pointing point by using two pointing input devices. Referring to FIG. 11, when the first user and the second user simultaneously point the screen, an area 1110 detected by the pointing input device of the first user and an area 1120 detected by the pointing input device of the second user Since different), different reference marks are used to detect the coordinates of the pointing point. That is, the pointing input device of the first user detects the coordinates of his pointing point by using the four reference marks 1111, 1112, 1113, and 1114 that are most closely located based on their pointing center 1115. In addition, the pointing input device of the second user may also independently coordinate the coordinates of his or her pointing point using the four reference marks 1121, 1122, 1123, and 1124, which exist closest to each other, based on their pointing center 1125. Will be detected. Therefore, no matter how many users are pointing at the same time, they will all be able to detect the correct pointing point.

Meanwhile, according to another embodiment of the present invention, even when a part of the display area is covered by another user or object, the coordinates of the pointing point can be detected effectively. This will be described with reference to FIGS. 12 to 15.

12 is a diagram illustrating a case in which a part of the display area is blocked by another user, and FIG. 13 is an enlarged view of the same.

As described above in the embodiment of pointing in a multi-user environment, different types of reference marks are projected depending on the position of the display area. If the screen of the four reference marks is hidden as shown in FIG. 13 on a screen captured by a camera (for example, an infrared camera) attached to a specific pointing input device, the coordinates of the pointing point cannot be detected. In this case, the camera (not shown) attached to the pointing input device or the image pattern generator 500 directly zooms in to generate a new image pattern, or zooms out. The coordinates of the pointing point may be extracted through the newly included reference mark. This process will be described in detail with reference to FIGS. 14 to 15.

14 is a diagram illustrating a process of detecting a location of a pointing point by using a zoom-out function. Referring to FIG. 14, when the camera (not shown) included in the pointing input device 200 detects the first detection area 1410 and is blocked by another user, the camera zooms out. The second detection area 1420 is detected by extending the photographing range by performing out). In this case, it can be seen that the pointing center 1415 of the pointing input device 200 does not change before and after zooming out. The four reference marks 1421 to 1424 which are closest to the pointing center 1415 may be recognized in the wider second detection area 1420, and the point to which the pointing input device 200 is pointing is used. You can get the coordinates of.

FIG. 15 is a diagram illustrating a process of detecting a location of a pointing point by using a zoom-in function. Referring to FIG. 15, when the camera (not shown) included in the pointing input device 200 detects the first detection area 1510 and is blocked by another user, the camera zooms in. The second detection area 1520 is detected by reducing the photographing range by performing in). In this case, it can be seen that the pointing center 1525 of the pointing input device 200 does not change with the zoom in back and forth. However, in the case of the zoom-in, a reference point 1531 having fine intervals is projected together on the screen in addition to the existing reference marks projected on the screen to replace the reference marks blocked by other users. Since the interval between the existing reference marks is predefined, when one or more reference marks photographed by the camera by the zoom in enter the second detection area 1520 (two 1521 and 1522 in FIG. 15). ), It is possible to accurately determine the coordinates of the pointing point based on the reference marks 1521 and 1522. At this time, the camera can be zoomed in again to improve the accuracy of the coordinates of the pointing point.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. I can understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

According to the pointing input device, the pointer control device, the image pattern generating device, the pointing input method, the pointer control method, and the image pattern generating method of the present invention as described above, there are one or more of the following effects.

First, there is an advantage that the user can easily control the graphic object selected by the mouse pointer by providing the movement of the mouse pointer displayed in the display area according to the movement of the pointing point indicated by the pointing input device.

Second, a plurality of mouse pointers are simultaneously controlled by a plurality of pointing input devices, thereby allowing a plurality of users to control selected graphic objects using different mouse pointers.

Claims (50)

An image receiver configured to detect a range of the image pattern by capturing a predetermined image pattern that is displayed on a display area having a recognized size and is a reference to the range of the display area; A coordinate extractor configured to extract coordinates of a point pointed within the display area based on the center of the detected image pattern range; And And a transmitter for transmitting the extracted coordinates to a pointer control device that controls a mouse pointer displayed on the display area. The method of claim 1, The video receiver, A pointing input device for capturing the image pattern implemented in visible light, infrared light or ultraviolet light. The method of claim 1, The coordinate extraction unit, And applying the extracted coordinates to the actual size of the display area to extract the coordinates of the pointed point on the actual display area. The method of claim 1, The coordinate is, A pointing input device corresponding to the coordinates of the mouse pointer. The method of claim 1, And a button unit configured to receive a user command for generating a button down event for operating the mouse pointer. The method of claim 5, The transmitting unit, A pointing input device for transmitting a control signal for the user command to the pointer control device. A receiver configured to receive relative coordinates of at least one or more mouse pointers displayed on the display area; A coordinate determination unit that determines absolute coordinates of the mouse pointer with reference to the relative coordinates; And And a pointer operation unit which moves the mouse pointer using the absolute coordinates. The method of claim 7, wherein The receiving unit, Pointer control device for receiving a control signal for generating a button selection event for operating the mouse pointer. The method of claim 8, And an event generator for generating the button selection event. The method of claim 7, wherein And a video pattern output unit configured to output a predetermined video pattern as a reference for the range of the display area at a predetermined position on the display area. The method of claim 10, The image pattern is a pointer control device implemented in visible light, infrared light or ultraviolet light. An image pattern generation unit generating a predetermined image pattern as a reference for a range of the display area; And And an image pattern output unit configured to output the image pattern on a display area. The method of claim 12, The image pattern generating device is implemented with visible light, infrared light or ultraviolet light. The method of claim 12, The image pattern output unit, And outputting the image pattern on the display area using a grid having a predetermined geometric shape. (a) capturing a predetermined image pattern displayed on a display area of a recognized size; (b) detecting a range of the image pattern; (c) extracting coordinates of a pointed point within the display area based on the center of the image pattern; And and (d) transmitting the extracted coordinates. The method of claim 15, In step (a), And capturing the image pattern implemented in visible light, infrared light, or ultraviolet light. The method of claim 15, In step (c), And extracting the coordinates of the pointed point on the actual display area by applying the extracted coordinates to the actual size of the display area. The method of claim 15, And the coordinates correspond to the coordinates of the mouse pointer displayed on the display area. The method of claim 15, And receiving a user command for generating a button selection event of the mouse pointer displayed on the display area. The method of claim 19, And transmitting a control signal for the user command. Receiving relative coordinates of at least one or more mouse pointers displayed on the display area; Determining absolute coordinates of the mouse pointer with reference to the relative coordinates; And Moving the mouse pointer to the absolute coordinates. The method of claim 21, And receiving a control signal for generating a button selection event of the mouse pointer. The method of claim 21, And generating the button selection event. The method of claim 21, And outputting a predetermined image pattern serving as a reference for the range of the display area at a predetermined position on the display area. The method of claim 24, The image pattern is a pointer control method implemented by visible light, infrared light or ultraviolet light. Generating a predetermined image pattern as a reference for a range of the display area; And And outputting the image pattern. The method of claim 26, The image pattern is a method of generating an image pattern implemented in visible light, infrared light or ultraviolet light. An image pattern generating device which is displayed on a display area having a recognized size and generates a predetermined image pattern which is a reference to a range of the display area and outputs the predetermined image pattern on the display area; And And a pointing input device that detects the image pattern and extracts coordinates of a pointed point within the display area. The method of claim 28, The pointing input device, An image receiver configured to capture the image pattern and detect a range of the image pattern; A coordinate extractor configured to extract the coordinates based on the center of the range of the detected image pattern; And a transmitter for transmitting the extracted coordinates to a pointer control device that controls a mouse pointer displayed on the display area. The method of claim 29, The video receiver, A pointing input system for capturing the image pattern implemented in visible light, infrared light or ultraviolet light. The method of claim 29, The coordinate extraction unit, And apply the extracted coordinates to the actual size of the display area to extract the coordinates of the pointed point on the actual display area. The method of claim 29, The coordinate is, A pointing input system corresponding to the coordinates of the mouse pointer. The method of claim 29, And a button unit configured to receive a user command for generating a button down event for operating the mouse pointer. The method of claim 33, The transmitting unit, And a control signal for the user command to the pointer control device. The method of claim 29, The image pattern generator, And a projector input to receive an image generated by the pointer control device and to project the image on the display area. The method of claim 28, The image pattern generator, A pointing input system for outputting the image pattern on the display area using a grid having a predetermined geometric shape. A pointing input device which is displayed on a display area having a recognized size and detects a predetermined image pattern which is a reference to a range of the display area and extracts coordinates of a point pointed in the display area; And And a pointer control device that receives coordinates of at least one mouse pointer from the pointing input device and controls the mouse pointer. The method of claim 37, The pointing input device, An image receiver configured to capture the image pattern and detect a range of the image pattern; A coordinate extractor configured to extract the coordinates based on the center of the range of the detected image pattern; And a transmitter for transmitting the extracted coordinates to a pointer control device that controls a mouse pointer displayed on the display area. The method of claim 38, The video receiver, A pointing input system for capturing the image pattern implemented in visible light, infrared light or ultraviolet light. The method of claim 38, The coordinate extraction unit, And apply the extracted coordinates to the actual size of the display area to extract the coordinates of the pointed point on the actual display area. The method of claim 38, The coordinate is, A pointing input system corresponding to the coordinates of the mouse pointer. The method of claim 38, And a button unit configured to receive a user command for generating a button down event for operating the mouse pointer. The method of claim 42, wherein The transmitting unit, And a control signal for the user command to the pointer control device. The method of claim 37, wherein The image pattern generator, A pointing input system for outputting the image pattern on the display area using a grid having a predetermined geometric shape. The method of claim 37, The pointer control device, A receiver configured to receive relative coordinates of at least one or more mouse pointers displayed on the display area; A coordinate determination unit that determines absolute coordinates of the mouse pointer with reference to the relative coordinates; And a pointer operating unit which moves the mouse pointer using the absolute coordinates. The method of claim 45, The receiving unit, Pointer control device for receiving a control signal for generating a button selection event for operating the mouse pointer. The method of claim 46, And an event generator for generating the button selection event. The method of claim 45, And a video pattern output unit configured to output a predetermined video pattern as a reference for the range of the display area at a predetermined position on the display area. The method of claim 48, The image pattern is a pointer control device implemented in visible light, infrared light or ultraviolet light. An image pattern generating device which is displayed on a display area having a recognized size and generates a predetermined image pattern which is a reference to a range of the display area and outputs the predetermined image pattern on the display area; A pointing input device which detects the image pattern and extracts coordinates of a pointed point within the display area; And And a pointer control device that receives coordinates of at least one mouse pointer from the pointing input device and controls the mouse pointer.

Images