KR20110014023A - Display apparatus and method for using with pointing device thereof - Google Patents

Abstract

PURPOSE: A display device using a pointing device and a method thereof are provided to input pointing information based on a light source of the pointing device, thereby preventing malfunction due to an unnecessary touch of an object. CONSTITUTION: A light source(132) of a pointing device provides pointing information to a flat panel display surface(110). The first sensor(120) is arranged in the first edge of the flat panel display surface and performs photographing in the first diagonal direction to obtain the first image data including the pointing information. The second sensor(122) is arranged in the second edge adjacent to the first edge and performs photographing in the second diagonal direction to obtain the second image data including the pointing information. A controller receives the image data and calculates a coordinate value of the pointing information by a triangulation method.

Description

Display device for use with pointing device and method thereof {DISPLAY APPARATUS AND METHOD FOR USING WITH POINTING DEVICE THEREOF}

The present invention relates to a display device, and more particularly, to a display device and a method for use with a pointing device having a light source in order to prevent a malfunction in a touch method.

Currently, display devices are gradually becoming larger due to the development of liquid crystal display panels and plasma display panels. Such display devices are thinner and lighter than large screens, making them easy to install. Due to these advantages, the display device is used in various fields, for example, industrial, educational, promotional, and advertising.

Among the display devices, there is a touch type display device, that is, a touch panel, which can be simply processed without using a separate input device.

The touch panel should have the same resolution as that of the display device. Therefore, whenever the resolution of the display device is changed or the position of the display screen is changed, the resolution of the touch panel must also be changed. For this purpose, in general, whenever the resolution of the display device is changed or the position of the display screen is changed, the touch panel must perform a calibration operation as an initial operation on the display screen.

The touch panel provides pointing information using an object, for example, a user's hand or a touch pen, to select an item such as a menu or an icon from the output image. That is, an object such as a user's hand or a touch pen must directly contact the display surface. When the user touches the display screen with the user's hand, discomfort may occur due to hygiene, fever on the display screen, and finger pain depending on the number of times of use.

In addition, when inputting the pointing information by the touch method, contact by a bug, sleeve, etc., in addition to a hand or a touch pen may occur. Due to such unnecessary contact, the display device may malfunction.

It is an object of the present invention to provide a display device and method thereof for use with a pointing device having a light source.

Another object of the present invention is to provide a touch type display device and a method thereof for preventing malfunction due to unnecessary contact.

Still another object of the present invention is to provide a display device and a method thereof, which are easy to install and implement.

In order to achieve the above objects, the display device of the present invention has one feature for use with a pointing device having a light source. Such a display device can prevent the malfunction due to unnecessary touch and can input the pointing information by the touch method.

The display device of the present invention according to this aspect has a flat display surface having a defined plane coordinate system for providing pointing information for use with the pointing device. The pointing device has a light source for providing pointing information on the flat panel display surface. The flat panel display surface is provided with first and second sensors on at least two adjacent corners thereof. The first sensor is disposed on the first edge side of the flat panel display surface, is installed on a first straight line parallel to the first diagonal line of the flat panel display surface, and is picked up in the first diagonal direction parallel to the flat panel display surface. To obtain first image data including the pointing information. The second sensor is disposed on the side of the second corner adjacent to the first corner, is installed on a second straight line parallel to the second diagonal of the flat panel display surface, and the second diagonal line is horizontal to the flat panel display surface. Direction to obtain second image data including the pointing information. The display apparatus includes a control unit that receives the first and second image data from the first and second sensors and calculates coordinate values of the flat panel display surface with respect to the pointing information by triangulation.

In one embodiment, the pointing device; The light source contacts the flat panel display surface to provide the pointing information. Or the pointing device; The first and second sensors may be spaced apart from the flat panel display surface by a predetermined distance within a detectable range of the light emitted from the light source to provide the pointing information.

In another embodiment, the first and second sensors are each provided as image sensors. Here, the first sensor acquires the first image data for the pointing information located on a third straight line parallel to the first diagonal line. The second sensor acquires the second image data with respect to the pointing information intersecting the third straight line and positioned on a fourth straight line parallel to the second diagonal line.

In another embodiment, the control unit; The first image data is received from the first sensor. The control unit calculates a ratio of the first and second distances divided by the pointing information located on the third straight line. At the same time, the control unit receives the second image data from the second sensor. The controller calculates a ratio of third and fourth distances divided by the pointing information located on the fourth straight line. The controller calculates the coordinate value using the ratio of the first to fourth distances.

In another embodiment, each of the first and second sensors further includes a filter for transmitting light by the light source and blocking light by a light source different from the light source.

In another embodiment, the control unit includes a filtering algorithm that receives the first and second image data from the first and second sensors and filters the filter to detect the pointing information.

According to another feature of the invention, there is provided a processing method of a display device for use with a pointing device having a light source. According to this method, it is possible to prevent malfunction caused by contact by an object other than the light source.

The processing method according to this aspect initializes and corrects coordinate values for a defined flat panel display surface. When the pointing information is provided from the light source, image data for the pointing information positioned on two straight lines parallel to and intersecting with each diagonal of the flat panel display surface is obtained. Subsequently, a coordinate value for the pointing information is calculated by triangulation using a ratio of distances at which the straight lines are separated from the image data by the pointing information.

In one embodiment, the initializing and correcting; Coordinate values for a plurality of positions located on the flat panel display surface are set corresponding to the size and resolution of the flat panel display surface, and the coordinate values are corrected to coincide with the flat panel display surface.

In another embodiment, acquiring the image data; It is disposed on the first edge side of the flat panel display surface, is provided on a first straight line parallel to the first diagonal line of the flat panel display surface, and is imaged in the first diagonal direction parallel to the flat panel display surface. Acquire first image data including the pointing information located on a third straight line parallel to one diagonal line. At the same time, it is disposed on the side of the second corner adjacent to the first corner, is installed on a second straight line parallel to the second diagonal of the flat panel display surface, and is imaged in the second diagonal direction parallel to the flat panel display surface. And second image data including the pointing information intersecting the third straight line and positioned on a fourth straight line parallel to the second diagonal line.

In yet another embodiment, calculating the coordinate value; A first and second distance divided by the pointing information located on the third straight line from each of the first and second image data, and divided by the pointing information located on the fourth straight line. The coordinate values are calculated by triangulation using respective ratios for the third and fourth distances.

In another embodiment, the processing method; And filtering to detect the pointing information from the first and second image data.

In another embodiment, the pointing information is provided by contact of the light source to the flat panel display surface. Alternatively, the pointing information is provided by emitting light spaced apart from the flat panel display surface within a range in which the first and second sensors can acquire the image data horizontally on the flat panel display surface.

As described above, the display device of the present invention can be used in conjunction with a pointing device having a light source to input the pointing information, thereby preventing malfunction caused by unnecessary contact by other objects.

In addition, the display apparatus of the present invention provides image sensors at at least two corners to detect the pointing information provided in a contact and non-contact manner from a light source, thereby facilitating the implementation of the display apparatus used with the pointing apparatus.

The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be interpreted as being limited by the embodiments described below. This embodiment is provided to more completely explain the present invention to those skilled in the art. Therefore, the shapes and the like of the components in the drawings are exaggerated in order to emphasize a clearer explanation.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to FIGS. 1 to 8.

1 is a perspective view showing the configuration of a display device according to an embodiment of the present invention.

Referring to FIG. 1, the display apparatus 100 of the present invention is a display apparatus having a large screen for educational, industrial, and promotional purposes, and inputs pointing information 134 using a light source 132. . To this end, the display apparatus 100 is used together with the pointing device 130 having the light source 132. The pointing device 130 provides the pointing information 134 to the display device 100 in a contact and non-contact manner using the light source 132. In addition, the display apparatus 100 is connected to the computer apparatus 200 through a cable 104, receives image information (not shown) from the computer apparatus 200, and outputs the image information to the flat panel display surface 110. The image information is provided with a graphical user interface (GUI) that can use the pointing information 134.

The display apparatus 100 includes at least two frames 102, a flat panel display surface 110 provided inside the frame 102, and at least two edges disposed at an edge of the flat panel display surface 110 to detect the pointing information 134. Sensors 120 and 122.

The frame 102 is generally rectangular in shape and is provided along the edge of the flat display surface 110, and the flat display surface 110 is located therein. The flat display surface 110 is provided in front of the display apparatus 100 and is provided flat so that the sensors 120 and 122 sense the pointing information 134 in a horizontal direction.

The flat panel display surface 110 is provided in a rectangular shape. That is, the flat panel display surface 110 has four corners 112 to 118. The flat panel display surface 110 has a display area for outputting image information. First and second sensors 120 and 122 are disposed outside the corners 112 and 114 adjacent to each other among the four corners 112 to 118 adjacent to the display area. Here, the first and second sensors 120 and 122 are installed at both corners of the upper surface of the flat panel display surface 110, but the neighboring one of the lower and both sides of the flat panel display surface 110 is disposed. First and second sensors 120 and 122 may be installed at edges 114, 116 or 116, 118 or 112, 118.

The first and second sensors 120 and 122 are provided as image sensors (or line sensors) which acquire image data by capturing in the diagonal direction of the flat panel display surface 110, respectively. The first and second sensors 120 and 122 may be photographed horizontally with the flat panel display surface 110, and may be configured to photograph at least an entire area of the flat panel display surface 110. The first and second sensors 120 and 122 obtain image data including the pointing information 134, respectively. In this case, the image data is an image of a straight line including the pointing information 134.

The pointing device 130 provides at least one button on one side so as to always generate light from the light source 132 using the button, or is provided to blink at a specific frequency by the button. Accordingly, the first and second sensors 120 and 122 may detect the pointing information 134 generated from the light source 132 in response to the characteristics of the light source 132.

As illustrated in FIG. 2A, the pointing device 130 provides the pointing information 134 in a touch manner by contacting the light source 132 with the flat panel display surface 110. In addition, in the pointing device 130, as shown in FIG. 2B, the light source 132 is spaced apart from the flat panel display surface 110 by a predetermined interval, and light is irradiated from the light source 132 to the flat panel display surface 110 so that the non-contact method is used. Provides the pointing information 134 '. In this case, the light source 132 has a straightness like a laser beam and irradiates the light focused on the flat panel display surface 110. The distance D between the light source 132 and the flat panel display surface 110 is within a range in which the first and second sensors 120 and 122 may acquire image data in a horizontal direction along the flat panel display surface 110. .

Specifically, FIG. 3 is a diagram illustrating a configuration for detecting coordinates of pointing information on a flat panel display surface according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the flat panel display surface 110 may include first to fourth corners 112 to 118. For example, a first sensor 120 is installed at the first corner 112, and a second sensor 122 is installed at the second corner 114 adjacent to the first corner 112. In addition, each of the first and second sensors 120 and 122 may be provided at a position capable of imaging in different diagonal directions of the flat panel display surface 110. The flat display surface 110 uses one of the first to fourth edges 112 to 118 as an origin of a planar coordinate system, that is, an X-Y coordinate system. Here, the fourth edge 118 is the origin of the planar coordinate system of the flat display surface 110.

The first sensor 120 is installed at the first edge 112 of the flat panel display surface 110 or adjacent to the first edge 112. The first sensor 120 is disposed on the first straight line 140a parallel to the first diagonal line 140 to capture image data in the direction of the first diagonal line 140 to obtain image data. The second sensor 122 is installed at the second corner 114 of the flat panel display surface 110 or adjacent to the second corner 114. The second sensor 122 is disposed on a second straight line 142a parallel to the second diagonal line 142 to capture image data in the direction of the second diagonal line 142. Here, the first straight line 140a is the imaging direction of the first sensor 120, and the second straight line 142a is the imaging direction of the second sensor 122. The first diagonal line 140 is a straight line connecting the second and fourth edges 114 and 118, and the second diagonal line 142 is a straight line following the first and third edges 112 and 116. The first diagonal line 140 is parallel to the first straight line 140a on which the first sensor 120 is disposed, and the second diagonal line 142 is parallel to the second straight line 142a on which the second sensor 122 is disposed. Parallel

Accordingly, the first sensor 120 acquires image data (150 in FIG. 4) by capturing the area between the second and fourth corners 114 and 118, that is, in the direction of the first diagonal line 140, to obtain the first sensor ( 120 acquires image data (152 of FIG. 5) by imaging in an area between the first and third corners 112 and 116, that is, in the direction of the second diagonal line 142.

In this case, when the pointing information 134 is provided on the flat panel display surface 110 from the pointing device 130, the first and second diagonal lines 140 may be formed by the first and second sensors 120 and 122, respectively. 142 Acquires image data 150 and 152 with respect to the direction to recognize the location of the pointing information 134. This means that no matter where the pointing information 134 is located on the flat display surface 110, the pointing information 134 is recognized as being present on the first diagonal line 140 when viewed from the first sensor 120. From the sensor 122 it is recognized that it exists on the second diagonal 142. For example, if the pointing information 134 is actually located at the intersection of the third straight line 140b parallel to the first diagonal line 140 and the fourth straight line 142b parallel to the second diagonal line 142, the pointing information is pointed at. Each of the third and fourth straight lines 140b and 142b including the information 134 is divided into distances a to d on both the left and right sides by the pointing information 134.

When the first sensor 120 captures the third straight line 140b including the pointing information 134, the first sensor 120 actually stores the image data 150 about the first diagonal line 140 parallel to the third straight line 140a. You get it. In addition, when the second sensor 122 captures the fourth straight line 142b including the pointing information 134, the image data 152 of the second diagonal line 142 is substantially parallel to the fourth straight line 142b. Will be obtained. That is, the first straight line 140a, the first diagonal line 140, and the third straight line 140b are parallel to each other, and the second straight line 142a, the second diagonal line 142, and the fourth straight line 142b are parallel to each other. Do. In fact, the intersection of the third and fourth straight lines 140b and 142b means one pixel according to the resolution of the flat panel display surface 110. Therefore, by calculating the coordinate values for the intersections, the coordinate values (X1, Y1) of the pointing information 134 located at this pixel can be calculated.

That is, as shown in FIG. 4, the image data 150 on the third straight line 140b including the pointing information 134 from the first sensor 120 is divided into left and right sides by the pointing information 134. has (a, b) In addition, as illustrated in FIG. 5, the image data 152 on the fourth straight line 142b including the pointing information 134 from the second sensor 122 is divided into two sides left and right by the pointing information 134. And fourth distances c and d.

The first sensor 120 detects the pointing information 134 by obtaining the image data 150 for the first diagonal 140, and the first diagonal 140 is separated on both sides by the pointing information 134. Recognize the ratio of distances a and b. In this case, the first sensor 120 may not recognize the distance c to the third straight line 140b. Therefore, the second sensor 122 acquires the image data 152 for the second diagonal 142 to detect the pointing information 134, and the second diagonal 142 is separated on both sides by the pointing information 134. The ratio of the calculated distances c and d is calculated.

Accordingly, the display apparatus 100 of the present invention may include various pieces of information obtained by an initialization and calibration operation on the flat panel display surface 110, for example, coordinate values of the first to fourth corners 112 to 118. And the distances a, b, c, and d, together with the size and resolution of the flat panel display surface 110, the distances of the diagonals 140 and 142, and the positional information of the first and second sensors 120 and 122. The coordinate values (X1, Y1) of the pointing information 134 are calculated using the ratio using the ratio. Triangulation is well known to those skilled in the art, and thus detailed description thereof will be omitted.

6 is a block diagram illustrating a configuration of the display apparatus illustrated in FIG. 1.

Referring to FIG. 6, the display apparatus 100 includes image data DATA1 and DATA2 in which the first and second sensors 120 and 122 are photographed in the directions of the first and second diagonal lines LINE1 and LINE2 140 and 142. The pointing information 134 is recognized from the loops 150 and 152.

According to one embodiment, each of the first and second sensors 120, 122 includes a filter 124, a lens 126, and an image sensor (or line sensor) 128, as shown in FIG. 7. It is modularized to include. The filter 124 may cause malfunctions due to light generated by its own surface of the flat panel display surface 110, light irradiated from the light source 132 of the pointing device 130, and diffusely reflected by the flat panel display surface 110. To prevent this, light of a specific wavelength generated from the light source 132 is transmitted to the lens 126, and the other light is blocked. The lens 126 is provided to adjust image focus for each line to obtain accurate image data. The image sensor 128 has an image capturing range from the first edge 112 or the second edge 114 of the flat panel display surface 110 to the third edge 116 or the fourth edge 118. The image sensor 128 provides the acquired image data DATA1 and DATA2 150, 152 to the control unit 106.

The controller 106 is provided as a controller, a control unit, a programmable logic controller (PLC), etc. in the display apparatus 100. The controller 106 is connected to the computer device 200 through the interface unit 108, receives image information from the computer device 200, and outputs the image information to the flat panel display surface 110. The controller 106 controls the pointing information 134 to be displayed on the image information output on the flat panel display surface 110.

To this end, when the pointing information 134 is input from the light source 132, the controller 106 controls the first and second sensors 120 and 122 to control the first and second diagonal lines LINE1 and LINE2 140. Image data (DATA1, DATA2) (150, 152) is obtained by imaging in the direction 142, and controls to detect the position of the pointing information 134 from the acquired image data (DATA1, DATA2) (150, 152) . The controller 106 receives image data DATA1 and DATA2 150 and 152 from the first and second sensors 120 and 122, and includes first to fourth divided into left and right sides by the pointing information 134. Recognize the distances a to d and calculate the ratio of these distances a, b and c, d, respectively. In addition, the controller 106 may include a filtering algorithm (not shown) in an internal memory (not shown). In this case, the controller 106 receives image data DATA1 and DATA2 150 and 152 obtained from the first and second sensors 120 and 122, and uses unnecessary values (eg, illuminometer values, etc.) by a filtering algorithm. ), The pointing information 134 included in the image data DATA1 and DATA2 150 and 152 can be clearly detected.

Accordingly, the controller 106 may determine the size and resolution of the flat panel display surface 110, position information of the first to fourth corners 112 to 118 and the center, the distance of the diagonals 140 and 142, and the first and second sensors. The coordinate values (X1, Y1) of the pointing information 134 are calculated by triangulation using the ratios of the distances a, b, c, and d together with the position information of (120, 122).

8 is a flowchart showing the processing procedure of the display apparatus according to the present invention.

Referring to FIG. 8, in operation S160, the display apparatus 100 according to an embodiment of the present invention first displays coordinate values of at least four corners 112 to 118 and a center position corresponding to the size, resolution, and the like of the flat panel display surface 110. Handles initialization and calibration tasks that you set up. That is, the plane coordinate system is defined by initializing and calibrating a coordinate value of the flat display surface 110. For example, the initialization and calibration operation may be performed by setting the origin coordinates of the flat display surface 110, setting the coordinates of the positions and centers of the corners 112 to 118, the size of the flat display surface 110, and the diagonal line 140, And setting coordinate values of the pixels according to the distance and resolution change of 142. Such initialization and calibration operations will be apparent to those skilled in the art, and thus detailed descriptions thereof will be omitted.

If the pointing information 134 is input from the light source 132 of the pointing device 130 to the flat panel display surface 110 in step S170, the procedure proceeds to step S180.

That is, the image data 150 and 152 including the pointing information 134 by imaging the first and second diagonal directions 140 and 142 by the first and second sensors 120 and 122, respectively, in step S180. And the position of the pointing information 134 from the image data 150 and 152.

Subsequently, in step S190, the controller 106 receives the image data DATA1 and DATA2 150 and 152 from the first and second sensors 120 and 122, and the two straight lines 140b and 142b according to the pointing information 134. Recognizing the left and right distance (a ~ d) of each of the) to calculate the ratio of each distance (a, b and c, d). The control unit 106 includes a location of the first and second sensors 120 and 122, a planar coordinate system set by the initialization and calibration operations according to the size and resolution of the flat display surface 110, and the pointing information 134. The coordinate values X1 and Y1 of the pointing information 134 are calculated by triangulation using the ratios of the distances a, b, c and d of the two straight lines 140b and 142b.

In the above, although the configuration and operation of the display device according to the present invention are illustrated according to the detailed description and the drawings, this is merely described by way of example, and various changes and modifications can be made without departing from the technical spirit of the present invention. Do.

1 is a perspective view showing the configuration of a display device according to an embodiment of the present invention;

2A and 2B are cross-sectional views for explaining a configuration of providing pointing information from a light source of the pointing device shown in FIG. 1 to a flat panel display surface;

FIG. 3 is a diagram showing a configuration of a flat panel display surface of the display device shown in FIG. 1; FIG.

4 and 5 show the configuration of the image data obtained by the first and second sensors shown in FIG. 3;

6 is a block diagram showing a configuration of the display device shown in FIG. 1;

7 is a block diagram showing the configuration of the first sensor and the second sensor shown in FIG. 6; And

8 is a flowchart showing the processing procedure of the display device according to the present invention.

Explanation of symbols on the main parts of the drawings

100: display device 110: flat display surface

112 to 118: corner 120, 122: sensor

130: pointing device 132: light source

134: pointing information 140, 142: diagonal

Claims (12)

In the display device: A flat display surface having a defined planar coordinate system; A pointing device having a light source for providing pointing information on the flat panel display surface; The pointing information is disposed on a first edge side of the flat panel display surface, is installed on a first straight line parallel to the first diagonal line of the flat panel display surface, and is imaged in the first diagonal direction parallel to the flat panel display surface. A first sensor for acquiring first image data including; It is disposed on the side of the second corner adjacent to the first corner, and is provided on a second straight line parallel to the second diagonal of the flat panel display surface, and is imaged in the second diagonal direction horizontally to the flat panel display surface. A second sensor for obtaining second image data including pointing information; And a control unit which receives the first and second image data from the first and second sensors and calculates a coordinate value of the flat panel display surface with respect to the pointing information by triangulation. . The method of claim 1, The pointing device comprises; The light source contacts the flat panel display surface or the first and second sensors are spaced apart from the flat panel display surface by a predetermined distance within a range in which light emitted by the light source can be detected to provide the pointing information. Display device. The method according to claim 1 or 2, The first and second sensors are each provided as image sensors; The first sensor acquires the first image data for the pointing information located on a third straight line parallel to the first diagonal line; And the second sensor acquires the second image data with respect to the pointing information intersecting the third straight line and positioned on a fourth straight line parallel to the second diagonal line. The method of claim 3, wherein The control unit; Receiving the first image data from the first sensor, the second image data from the second sensor at the same time as the ratio of the first and second distance divided by the pointing information located on the third straight line And calculating the coordinate value by using a ratio of third and fourth distances divided by the pointing information located on the fourth straight line. The method of claim 4, wherein Each of the first and second sensors may further include a filter for transmitting light by the light source and blocking light by a light source different from the light source. The method of claim 5, And the control unit includes a filtering algorithm that receives the first and second image data from the first and second sensors and filters the filter to detect the pointing information. In the processing method of a display device for use with a pointing device having a light source: Initialize and correct coordinate values for a defined flat panel display surface; If pointing information is provided from a light source, obtaining image data for the pointing information located on two straight lines parallel to and intersecting each diagonal of the flat panel display surface; next And a coordinate value for the pointing information is calculated by triangulation using a ratio of distances at which the straight lines are respectively separated from the image data by the pointing information. The method of claim 7, wherein The initializing and correcting; And setting coordinate values for a plurality of positions positioned on the flat panel display surface corresponding to the size and resolution of the flat panel display surface, and correcting the coordinate values to match the flat panel display surface. Treatment method. The method of claim 8, Acquiring the image data; It is disposed on the first edge side of the flat panel display surface, is provided on a first straight line parallel to the first diagonal line of the flat panel display surface, and is imaged in the first diagonal direction parallel to the flat panel display surface. Obtain first image data comprising the pointing information located on a third straight line parallel to one diagonal line; At the same time, it is disposed on the side of the second corner adjacent to the first corner, is installed on a second straight line parallel to the second diagonal of the flat panel display surface, and is imaged in the second diagonal direction horizontally on the flat panel display surface. And obtaining second image data including the pointing information intersecting the third straight line and positioned on a fourth straight line parallel to the second diagonal line. The method of claim 9, Calculating the coordinate value; A first and second distance divided by the pointing information located on the third straight line from each of the first and second image data, and divided by the pointing information located on the fourth straight line. And calculating the coordinate values by triangulation using respective ratios with respect to the third and fourth distances. The method of claim 10, The treatment method is; And filtering to detect the pointing information from the first and second image data. The method according to any one of claims 8 to 11, The pointing information emits light while being spaced apart from the flat panel display surface within a range in which the light source contacts the flat panel display surface or the first and second sensors can acquire the image data horizontally on the flat panel display surface. Processing method of display device.

Images