KR20090061213A - Complementary metal oxide semiconductor, source of light using the touch coordinates preception method and the touch screen system - Google Patents

Abstract

A method for recognizing touch coordinates by using a photographing device and light source and a touch screen system using the same are provided to improve the coordinate detection speed and accuracy by using a simple touch detection algorithm. The distance ratio among 3 light sources located at an image obtained from an arbitrary photographing device is calculated. The point of an arbitrary object which is close or adjacent to a plane is recognized. The distance ratio between the recognized point and light sources located at the both ends is calculated. By multiplying video images obtained by each photographing device by the distance ratios, the first and second virtual ratios are calculated.

Description

Touch Coordinate Recognition Method Using Imaging Device and Light Source and Touch Screen System Using Them {COMPLEMENTARY METAL OXIDE SEMICONDUCTOR, SOURCE OF LIGHT USING THE TOUCH COORDINATES PRECEPTION METHOD AND THE TOUCH SCREEN SYSTEM}

The present invention relates to a screen touch sensing and touch coordinate recognition method for realizing a touch screen, and in particular, a different structure such as a display panel (including a CRT, LCD, PDP, and a rear projection beam projector) and a front projection beam projector using a roll screen. It can be applied to all display devices having display and display system in common, and standardizes the control program for detecting the touch position of the screen.The standard control program enables touch detection of all touch screens without changing the control program. A touch coordinate recognition method using an image pickup device and a light source, and an image acquisition means such as an image pickup device and a light source in a peripheral area of the display to obtain an image of the display area as a cross-sectional shape of an infrared image and virtualize the touch position. display A touch screen system according to a touch coordinate recognition method using an image sensor and a light source for recognizing touch coordinates in an area and loading a program of a corresponding position based on the same.

In general, a touch screen is a generic term for a device that inputs a character or a figure displayed on a screen by using a finger or the like, and its structure detects a touch and generates a signal according to the touch panel. It consists of a controller that controls signals, connects to a PC main body, sends and receives data, and various software required for the system.

Although the above-mentioned touch screen is not very accurate, it does not need a keyboard and is easy to operate, so it is widely used in automatic cash dispensers or reverse information retrieval machines, and is used in hospitals and laboratories for diagnosis, patient monitoring, prescription management, and medical records. It is also used for the education of children and the disabled.

In addition, it can be applied to unmanned ticket release systems and management systems, and in recent years, the demand and scope are gradually increasing.

Conventional techniques used to implement touch panels rely on overlaying electro-sensitive glass or glasses on the screen, a disadvantage of which is the vandalism and other factors. The potential is not suitable for outdoor displays and is very expensive when used for large screens.

Alternatively, at least one of the sides of the screen has a light emitter, such as an LED or similar device, and on the opposite side of the screen, a light-sensitive element is used to block occlusion of the light emitted by the particular LED ( A method of detecting hand interaction by occlusion, a disadvantage of this method is the requirement to provide at least one of an LED or a photosensitive array outside of the glass in front of the screen, which is responsible for vandalism. Exposed.

Similarly, laser-scan and Doppler radars can be installed on the front side of the screen to determine user interaction, which has similar drawbacks.

Another technique for use in windshields uses a microphone and sound triangulation to determine when the user knocks on the glass. A potential disadvantage of this method is that the sensor must be placed in direct contact with the window, wired up to the sensor, and also requires a hard surface, such as glass, especially in soft plastic rear-projected screens. Not suitable for use

Alternatively, the camera can be used to detect user interaction with the translucent image. If the camera is placed on the same side of the user, conventional computer vision gesture recognition techniques can be used to detect the interaction.

In this situation, however, it is not only difficult to install the camera in a proper position, but the problem of possible vandalism is an obvious disadvantage.

It is desirable to place the camera on the back side of the translucent surface so that the camera can be easily protected from vandalism. However, in such a situation, the user's image captured by the camera may be extremely blurred, thereby making it impossible to use conventional motion recognition technology, the camera and projector must be equipped with an IR filter, and the infrared illumination is also need.

An important drawback of this method is that it cannot be used in situations where the translucent screen is exposed to a significant amount of ambient infrared light, such as when the screen front window is exposed to direct sunlight.

Touch screen technology using an existing image sensor such as the above-described camera is a technology that has attracted considerable attention in recent years due to the advantage that it is easy to be applied to a display device such as a large screen or a beam projection. In this case, two or more image sensors are generally used. Acquires an image of a finger or a pen, compares / analyzes the acquired image with a background image, recognizes an object, calculates an angle to each image sensor and the region of interest of the object, and Triangulation is applied to the angle to detect coordinates on the screen.

At this time, as described above, in order to recognize the touch coordinates, the algorithm must be changed according to the size of the screen, and the use of a very complicated algorithm for comparing / analyzing the acquired image with the background image has caused a problem in that its effectiveness is deteriorated.

An object of the present invention for solving the above problems relates to a screen touch sensing and touch coordinate recognition method for realizing a touch screen and a touch screen using the same, in particular, including a display panel (CRT, LCD, PDP, etc.) and a rear projection beam projector And control panel for detecting the touch position of the screen can be standardized for all display devices with different structures and display methods such as front projection type beam projector using roll screen. The present invention provides a touch coordinate recognition method using an image pickup device and a light source and a touch screen using the same to enable touch detection of all touch screens without changing the control program.

에 의해 가상좌표를 산출하는 제 5과정을 포함하는 데 있다.The touch coordinate recognition method using the image pickup device and the light source according to the present invention for achieving the above object is a rectangular plane having a horizontal width (W) and a vertical width (H), and any one of the plane A first process including two imaging devices each provided at one vertex in common with the sides, and four light sources each provided at each vertex of the plane; A second step of calculating a ratio of distances from light sources positioned at the extreme ends of light sources positioned on an image acquired by an image pickup device to light sources existing therebetween; If it is determined that there is a touch point by any object in contact with or in proximity to the plane, from the light source positioned at the extreme end of the light sources positioned on the image acquired by the image pickup device to the touch point existing therebetween. Calculating a distance ratio; A fourth process of calculating a first virtual ratio ha and a second virtual ratio hb by multiplying the distance ratios calculated in the second process and the third process from the image image acquired for each image pickup device; And the first virtual ratio ha, the second virtual ratio hb, and the horizontal width W and the vertical width H of the plane calculated through the fourth process.

It includes a fifth process of calculating the virtual coordinate by the.

An additional feature of the method for recognizing touch coordinates using an image pickup device and a light source according to the present invention for achieving the above object is that the center line of the image pickup device is parallel to the plane and included in the plane in the first step. There is.

As another additional feature of the touch coordinate recognition method using the image pickup device and the light source according to the present invention for achieving the above object, the second process is located at one end of the light source of both ends acquired in the case of the first image pickup device A first step of calculating a distance ratio from a light source located at the other end to a light source existing between both ends based on the distance from the light source to the light source existing between both ends; In the case of the second image pickup device, the distance ratio from the light source located at one end to the light source existing at both ends is calculated based on the distance from the light source positioned at the other end to the light source existing at both ends among the acquired light sources at both ends. The second step is to include.

As another additional feature of the method for recognizing touch coordinates using the image pickup device and the light source according to the present invention for achieving the above object, the third process is performed at the other end of the light sources of both ends acquired in the case of the first image pickup device. A first step of calculating a distance ratio from a light source positioned at one end to a touch point existing between both ends, based on a distance from the light source positioned between the touch points existing between both ends; In the case of the second image pickup device, the ratio of the distances from the light sources positioned at the other end to the touch points existing at both ends, based on the distance from the light sources positioned at one end to the touch points existing at both ends, among the acquired light sources at both ends. It includes a second step of calculating the.

In another aspect of the present invention, there is provided a touch coordinate recognition method using an image sensor and a light source according to the present invention. The fourth process includes the data calculated in the first step of the second process and the first method. A first step of calculating a first virtual ratio ha by multiplying the data calculated in the first step of three processes; And a second step of calculating a second virtual ratio hb by multiplying the data calculated in the second step of the second process and the data calculated in the second step of the third process.

The present invention also provides a touch screen system having a display area having an arbitrary area, a plurality of image pickup devices and light sources:

By processing the image image acquired in one-to-one correspondence to two or more image pickup devices positioned at the corners of the display area, the ratio of the distance between the signal and the light source and the distance between the touch object and the light source according to the recognition of any touch object in contact with the display area. Two or more image data processing modules for calculating and outputting a distance ratio;

A virtual ratio calculation module for receiving a distance ratio between light sources calculated by the image data processing module and distance ratio data between a touch object and a light source and calculating a virtual ratio for the touch object;

A virtual coordinate calculation module for receiving a virtual ratio calculated by the virtual ratio calculation module and calculating a virtual coordinate for a touch object;

A touch object operation that receives a signal according to whether or not the touch object is output from the image data processing modules and determines whether a real touch object exists, and separately outputs an operation (click, double click, drag, etc.) of the touch object. Detection recognition module; And

And a touch screen operating module configured to receive data output from the touch target motion detection recognition module and the virtual coordinate calculation module and load a program corresponding to a region determined to be touch among the images displayed on the display area to display corresponding information. The present invention provides a touch screen system using a touch coordinate recognition method using an image pickup device and a light source.

As expected effects due to the above-described features of the present invention, the larger the screen size is expected to lower the manufacturing cost and maintenance cost (by image sensor reliability), and compares / analyzes the existing image sensor image to detect the target coordinates. Compared with the conventional system, since only an infrared image is detected and a simple touch detection algorithm is used, the coordinate detection speed and accuracy are expected to be improved.

In addition, since the virtual coordinate is used, it is expected that the touch detection control program can be commonly standardized regardless of the display device having the panel type display unit or the display device having the roll type display unit.

The above object and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view illustrating a configuration of a touch screen to which a touch coordinate recognition method is applied in a touch screen using an image pickup device and a light source according to the present invention, wherein an image is displayed on a screen (a display unit of a display generally used and utilized) 100) and two imaging devices for triangulation measurement at both ends of one side of the screen 100 (in this case, the imaging device includes any camera or camcorder capable of step and video recording). Infrared camera or image sensor) (IS1, IS2); And reference light sources RL1 to RL4 positioned near each vertex of the screen 100 to recognize an arbitrary reference point.

In addition, the above-described trigonometric method is not known conventional triangulation method, it is noted that the measuring method according to the present invention is to be applied in advance.

1 shows a minimum configuration to which the present invention is applied. The reference light sources RL1 to RL4 use a light source for irradiating infrared rays, and the imaging devices IS1 and IS2 are also used. It is most desirable to use an image sensor that picks up an infrared image.

In this case, the focuses of the two imaging devices IS1 and IS2 are parallel to the image display surface of the screen 100 and are present on the image display surface.

The touch coordinate recognition method according to the present invention using the above-described device configuration will be described in detail below.

First, a data generation process for recognizing a coordinate value of a touch point by using an image image acquired for each image pickup device will be described. An image acquired by the first image pickup device IS1 is shown in FIG. 2. As it is.

Referring to FIG. 3 attached to the meanings of the variables A1, B1, a1, and b2 displayed in the acquired image shown in FIG. 2, the first imaging device IS1 is based on the installation angle θ. An arbitrary virtual screen V100a having the same installation angle and diagonal angle as the first imaging device IS1 may be defined.

In this case, the virtual screen V100a has the same horizontal width as the horizontal width W of the actual screen 100, and the vertical width H1 may be defined as in Equation 1 below.

Looking at the proof process of Equation 1 briefly, the triangle AGC and the triangle FGB is similar to each other because the three angles are the same, and therefore the ratio of the corresponding sides of the similar triangle is the same, so the relation of H: H1 = B1: A1 is established. In summary, this is summarized as in Equation 1 above.

In this case, when an arbitrary position on the screen 100 is touched by the user as shown in the accompanying drawings, as shown in the accompanying FIG. 2, the touched image is captured on the first image pickup device IS1 in the same manner. The points P (x, y) and any point on the vertical line referred to by reference numeral I1 are all expressed as one.

At this time, the relationship between the variables A1 and B1 necessary for the above-described mathematical relation 1 is also shown in FIG. 2.

Therefore, in FIG. 3, the distance h1 to the point I1 at which the touch target point P (x, y) is formed on the vertical line of the virtual rectangle is summarized as in Equation 2 below.

Looking at the proof process of Equation 2 briefly, the triangle BJG1 and the triangle BAC is similar to each other because the three angles are the same, and therefore the ratio of the corresponding sides of the similar triangle is the same, so the relationship of W: H1 = b1 ': g1 is established. If this is arranged, it is arranged as in Equation 3 below.

In addition, triangle AJG 1 and triangle ABI 1 are also similar to each other, so the ratio of the corresponding sides of similar triangles is the same, so that the relation of W: h1 = a1 ': g1 is established and summarized as in Equation 4 below. It is cleaned up.

In this case, when the equal sign is formed based on the common variable in Equation 3 and Equation 4, and this is arranged based on the variable h1, Equation 2 is arranged.

Through the above-described process, the correlation between the touch target point P (x, y) and the first image pickup device IS1 on the virtual screen V100a based on the acquired image of the first image pickup device IS1 is attached. 2 and 3, the touch target point P (x, y) and the second photographing image are subjected to the arithmetic operation through the second imaging device IS2 illustrated in FIG. 1. An association relationship on the virtual screen V100b based on the device IS2 will be described with reference to FIGS. 4 and 5.

As shown in FIG. 5, from the standpoint of the second imaging device IS2, an arbitrary virtual screen V100b having the same installation angle and diagonal angle as the installation angle δ on the basis of the installation angle δ. ) Can be defined.

In this case, the virtual screen V100b has the same horizontal width as the horizontal width W of the actual screen 100, and the vertical width H2 may be defined as in Equation 5 below.

Since the proof process of Equation 5 is the same as the proof process of Equation 1 described above, it is omitted.

In this case, when an arbitrary position on the screen 100 is touched by the user as illustrated in the accompanying drawings, as shown in the accompanying FIG. 4, the acquired image of the second imaging device IS2 is identical. The touched point P (x, y) and any point on the vertical line referred to by reference numeral I2 are all expressed as one.

At this time, the relationship between the variables A2 and B2 necessary for the above Equation 5 is also shown in FIG.

Therefore, in FIG. 5, the distance h2 to the point I2 where the touch target point P (x, y) is formed on the vertical line of the virtual rectangle is summarized as in Equation 6 below.

Since the proof process of Equation 6 is also the same as the proof process of Equation 2 described above, it will be omitted.

Hereinafter, in the accompanying drawings, a diagram illustrating an image acquired by the image pickup device illustrated in FIGS. 2 and 4 will be described by taking a conceptual image as an example instead of a phase inverted image that is substantially obtained to facilitate explanation. Make sure you do it.

The above-described drawings illustrated in FIGS. 3 and 5 are collectively displayed in a single diagram, and arranged in relation to the touch point, as shown in FIG. 6.

Referring to the x-coordinate of the touch point P (x, y) in the accompanying Figure 6, the triangle AKP and triangle ABI1 in Figure 6 is similar, so the proportional expression as shown in Equation 7 below.

In addition, in FIG. 6, since triangle BKP and triangle BAI2 are similar, a proportional expression such as Equation 8 below holds.

Therefore, since Equation 7 and Equation 8 have an equal sign, they can be arranged as shown in Equation 9 below.

Since the x coordinate of the touch point P (x, y) is calculated through the above-described process, the y coordinate can be defined as shown in Equation 10 below by calculating the y coordinate through the same process as the calculation process of the x coordinate.

Accordingly, it can be seen that the x and y coordinates of the touch points P (x, y) are determined by the vertical widths h1 and h2 of the virtual screens V100a and V100b in common.

In this case, since the values of the variables h1 and h2 obtained from the virtual screens V100a and V100b are not substantially recognizable, the variables A1, A2, B1, B2, and a1 detectable in FIG. 2 and FIG. , a2, b1, and b2 should be replaced with Equation 2, which defines the variable h1, and Equation 6, which defines the variable h2.

Therefore, let's first arrange the variable h1 into a variable that can be calculated.

In order to clean up the variable H1 that is not recognizable in Equation 2 defining the variable h1, Equation 1 is arranged as in Equation 11 below.

Since the variable H in Equation 11 is not data obtained from the acquired images shown in FIGS. 2 and 4, the data are obtained by passing them to the opposite side of the equal sign and defining them as the new first virtual ratio ha. It is arranged together.

 Equation 6 defining the variable h2 in the above-described manner is summarized and defined as the second virtual ratio hb.

Therefore, substituting Equation 12 and Equation 13 into Equation 9 representing the x coordinate of the touch point P (x, y) and arranging the X coordinate as shown in Equation 14 below, and the touch point P (x, y) Substituting Equation 12 and Equation 13 into Equation 10 representing the y coordinate of), the y coordinate is arranged as in Equation 15 below.

Therefore, the equations related to the virtual coordinates Pa (x / W and y / H) of the touch points P (x, y) are summarized as in Equation 16 below.

Therefore, since the virtual coordinate Pa (x / W, y / H) is a relative position on the actual touch screen, the touch position is displayed without a separate conversion process.

In the above-described embodiment, the light source of the touch screen to which the present invention is applied is used as a reference point for detecting coordinates in the screen by applying a trigonometric method, and may use an object having an identifiable color or an identifiable shape and distinguishing it from an external light source. In order to control the light source at a specific frequency.

The error can be corrected by actually touching a specific point of the actual display to correct the error between the virtual coordinate and the actual coordinate, and as shown in FIG. If the processing is duplicated through the IS3) or the fourth image pickup device IS4, the error is further reduced.

On the other hand, the actual screen size (W, H) can be provided by a value that can be set by the user. For example, if the user inputs the value of the actual screen size (W, H) to the driver, The virtual coordinate value can be detected by, for example, the touch coordinate (x, y) is obtained by multiplying the size (W, H) by the virtual coordinates (x / W, y / H). The touch position on the actual screen can be detected.

The display device employing the touch screen according to the present invention using the touch coordinate recognition method using the image pickup device and the light source is as shown in FIG. 7, and the detailed configuration for operating the touch screen is shown in FIG. 8. As shown.

Referring to the configuration of the touch screen system according to the present invention shown in FIG. 8, a first image acquisition module 201 including a screen image pickup device of a display panel and acquiring an image image in a predetermined time unit or in real time continuously. ), And a first process of calculating and outputting a distance ratio between a signal and a light source and a distance between a touch object and a reference light source according to whether or not the touch object is recognized by performing data processing on the image image acquired by the first image acquisition module 201. A second image acquisition module 202 including an image data processing module 210, an image pickup device and acquiring an image image in a predetermined predetermined time unit or in real time, and acquired by the second image acquisition module 202. Image data is processed to calculate the distance ratio between the signal and the light source and the distance between the touch object and the reference light source according to whether the touch object is recognized or not. The first image data processing module 220 outputs the distance ratio between the light source calculated by the first image data processing module 210 and the distance between the touch object and the reference light source. The touch object receives the distance ratio between the first virtual ratio calculation module 230 for calculating the virtual ratio and the light source calculated by the second image data processing module 220 and the distance between the touch target and the reference light source. A second virtual ratio calculation module 240 for calculating a second virtual ratio for the first virtual ratio calculation module 240 and the first virtual ratio calculation module 240 and a second virtual ratio calculation module 240 A virtual coordinate calculation module 260 that receives a second virtual ratio to calculate a virtual coordinate for the touch object, and a signal according to whether or not the touch object is output from the image data processing modules 210 and 220. The real touch target is zone A touch target motion detection recognition module 270 for distinguishing and outputting an operation (click, double click, drag, etc.) of the touch object, and the touch target motion detection recognition module 270 and the virtual coordinate calculation module 260. ) To the touch screen operating module 290 to load a program corresponding to an area determined to be touched among the images displayed on the screen 100 by receiving the data output from the screen 100 and to display the corresponding information through the screen 100. It is composed.

Among the configurations of the touch screen system according to the present invention configured as described above, the configuration of the image data processing module, which is referred to by reference numerals 210 and 220, is the same, and the detailed configuration thereof is shown by the first image data processing module 210 shown in FIG. Let's look into the criteria.

The configuration includes: an acquisition image filtering module 211 that receives an image image acquired by the first image acquisition module 201 after powering up and acquires and outputs only an image of a light source and a touch object through an operation such as filtering; A reference light source recognition module 212 for extracting a position of a reference light source from the filtered image image output from the acquired image filtering module 211 and recognizing it, and the position data of the reference light source in the reference light source recognition module 212 A touch for calculating and outputting a center position of an object excluding a light source from the filtered image image output from the light source distance ratio calculating module 213 and the acquired image filtering module 211 based on the distance ratio between the light sources based on Location data of the reference light source output from the object recognition module 214, and the reference light source recognition module 212 and exit from the touch object recognition module 214 The touch target distance ratio calculation module 215 is configured to receive a center position of an output target and calculate a distance ratio between a specific reference light source and the target.

In this case, the reference light source recognition module 212 recognizes light sources existing at both ends of the image as the reference light source, and at the same time, sets a specific reference light source as the distance calculation reference light source. In addition, the touch target distance ratio calculation module 215 calculates a distance ratio between targets based on the distance calculation reference light source set by the reference light source recognition module 212.

In addition, the configuration of the touch object motion detection recognition module referred to by reference numeral 270 in the configuration of FIG. 8 is largely based on the image of the touch object received from the first image data processing module 210. Corresponding to the change according to the movement of the touch object based on the first detection target position conversion recognition module 270A corresponding to the change according to the touch object and the image of the touch object received from the second image data processing module 220. Distinguish the touch object operation (click, double click, drag, etc.) by receiving the change data output from the second detection target position conversion recognition module 270B and the detection target position conversion recognition module 270A, 270B. By the touch target motion recognition module 270C.

In this case, the first detection target position conversion recognition module 270A and the second detection target position conversion recognition module 270B have the same configuration, and the detailed configuration of the first detection target position conversion recognition module 270A is identical. For example, the FIFO type buffer outputs a delayed predetermined time by receiving an image image in which the center position of the touch object output from the touch object recognition module 214 of the first image data processing module 210 is recognized. 271, a current touch target image storage module 272 for receiving and temporarily storing an image image output from the touch object recognition module 214, and receiving and temporarily storing an image image output from the buffer 271. The conventional touch target image storage module 273 and a subtractor 274 which subtracts and outputs the video image output from the touch target image storage modules 272 and 273.

The above-described configuration of the touch screen system according to the present invention may be implemented by hardware or software. The example illustrated in FIG. 8 is represented by hardware to facilitate the description of the operation, and the present invention is not limited thereto. It is not known in advance.

The operation of the touch screen system according to the present invention configured as described above will be described.

As shown in FIG. 7, the screen 100 on which an arbitrary image is displayed is exposed on one side of the housing, whose front surface is referred to by the reference number H, and the imaging devices IS1 and IS2 are connected to the housing H. FIG. ) And the lenses of the imaging devices IS1 and IS2 and the reference light sources RL1 to RL4 are exposed to the contact surface of the housing H and the screen 100.

In this case, the lens center lines of the imaging devices IS1 and IS2 are parallel to the image display surface of the screen 100 and included in the image display surface of the screen 100.

In addition, it is assumed that the first image pickup device IS1 is included in the first image acquisition module 201 and the second image pickup device IS2 is included in the second image acquisition module 202.

When the power is supplied, the image image acquired by the first image acquisition module 201 is provided to the acquisition image filtering module 211, and the acquisition image filtering module 211 filters the input image image to obtain image data above a predetermined threshold. Only print out.

In the filtered image image output from the acquired image filtering module 211, the reference light source recognition module 212 extracts and recognizes the position of the reference light source on the corresponding image, and outputs it from the reference light source recognition module 212. The light source distance ratio calculation module 213 calculates the distance ratio between the light sources based on the position data of the reference light source.

The operation of the above-described reference light source recognition module 212 and the light source distance ratio calculation module 213 is preferably limited to operating within a predetermined time when the power is supplied, thereby reducing the data throughput, and during the entire system operation, the reference light source data Allow a certain period of time for calibration.

In addition, the touch object recognition module 214 calculates and outputs the center position of the object excluding the light source from the filtered image image output from the acquired image filtering module 211, and in the touch object distance ratio calculation module 215. The position data of the reference light source output from the reference light source recognition module 212 and the center position of the target output from the touch target recognition module 214 are inputted, and the ratio of the distance between the specific reference light source and the target is set to the ratio of each position value. Will be calculated by

At the same time as the operation of the first image data processing module 210 as described above, the second image data processing module 220 performs the same operation based on the image image acquired by the second image acquisition module 202. do.

The output data of the touch target distance ratio calculating module 215 and the light source distance ratio calculating module 213 among the output data of the first image data processing module 210 described above are input to the first virtual ratio 230. Equation 12 calculates the first virtual ratio for the touch object. At the same time as the operation of the first virtual ratio calculation module 230 as described above, the second virtual ratio calculation module 240 performs the same operation based on the data acquired by the second image data processing module 220. do.

The output data of the first virtual ratio calculation module 230 and the output data of the second virtual ratio calculation module 240 are input to the virtual coordinate calculation module 260, and the virtual data for the touch object is expressed by Equation 16 above. Will yield the coordinates.

Thereafter, the virtual coordinates output from the virtual coordinate calculation module 260 are provided to the touch screen operating module 290.

At this time, a signal according to whether or not the touch object is output from the touch object recognition module of the image data processing modules 210 and 220 is provided to the touch object motion detection recognition module 270, and the touch object motion detection recognition module ( In operation 270, it is determined whether a touch object exists and the operation (click, double click, drag, etc.) of the touch object is classified and provided to the touch screen operating module 290.

Accordingly, the touch screen operation module 290 receives data output from the touch target motion detection recognition module 270 and the virtual coordinate calculation module 260 and inputs the data to the area determined to be touched among the images displayed on the screen 100. The corresponding program is loaded to display the corresponding information through the screen 100.

On the other hand, according to the present invention, even if the image sensor is installed on an arbitrary angle by presenting a simple touch position detection algorithm using the reference point and the image split ratio, the touch position can be easily detected if the reference light source is included in the image. When the size of the touch screen is changed while maintaining the rectangular shape, that is, when the horizontal or vertical direction or the horizontal and vertical direction is changed, but the rectangular shape is maintained, the reference point is used regardless of the area of the touch screen. Of course, the detection of the virtual coordinates may be possible.

In addition, in addition to the reference light source applied in the present invention, the light source can be further added to facilitate the touch position detection, and, of course, when the number of image sensors is added, the detection speed and resolution of the coordinates detected by the present invention, and the multi-touch point. Can be detected relatively quickly and accurately.

Here, the added light source and the reference light source may be turned on (ON) only or only the additional light source (ON) by a separate control, it may be combined to control the on / off.

Meanwhile, as illustrated in FIG. 9, the light guide plate 200 having a plurality of light sources L may be provided as an outer circumferential surface of the touch screen 100. The light guide plate 200 may be interlocked by a touch position detected by the above algorithm. It may be possible to implement the sharpness of the displayed image.

Here, the plurality of light sources L may be provided at the side surface of the light guide plate 200 or at the rear side of the light guide plate 200 to use the screen 100 to scatter light from the light source L. By virtue of irradiation to the side), the sharpness of the displayed image can be realized.

While the invention has been shown and described in connection with specific embodiments thereof, it is well known in the art that various modifications and changes can be made without departing from the spirit and scope of the invention as indicated by the claims. Anyone who owns it can easily find out.

1 is an exemplary view showing a configuration example of a touch screen to which a touch coordinate recognition method is applied in a touch screen using an image pickup device and a light source according to the present invention;

FIG. 2 is an exemplary view of a video image acquired by the first imaging device of FIG. 1. FIG.

FIG. 3 is an exemplary diagram for describing the meaning of each variable illustrated in FIG. 2 in proportional relation between actual coordinates and virtual coordinates.

4 is an exemplary view of a video image acquired by the second image pickup device of FIG. 1.

FIG. 5 is an exemplary diagram for describing the meaning of each variable illustrated in FIG. 4 in proportional relation between actual coordinates and virtual coordinates.

6 is an exemplary diagram showing the proportional relationship shown in FIGS. 3 and 4 collectively as one;

7 is an exemplary view of a display device employing a touch screen according to the present invention having a housing provided on the touch screen of FIG.

8 is an exemplary block diagram of a touch screen system according to the present invention.

FIG. 9 is a view showing an exemplary view of a light guide plate having a separate light source as a display area of a touch screen according to the present invention; FIG.

Claims (12)

Two or more imaging devices each provided at a rectangular plane having a horizontal width W and a vertical width H, one at a vertex in common sharing any one side of the plane, and one at each vertex of the plane. A first process having four light sources provided; A second step of calculating a distance ratio between three light sources positioned on an image acquired by any of the image pickup devices provided through the first step; A third step of recognizing a point of an arbitrary object in contact with or near the plane and calculating a distance ratio between the recognized point and a light source positioned at the extreme end of the light sources positioned on the acquired image; A fourth process of calculating a first virtual ratio ha and a second virtual ratio hb by multiplying the distance ratios calculated in the second process and the third process from the image image acquired for each image pickup device; And Equation based on the first virtual ratio ha, the second virtual ratio hb, and the horizontal width W and the vertical width H of the plane calculated through the fourth process.

And a fifth process of calculating touch coordinates at the touch coordinates, wherein the touch position is detected using a reference point and an image split ratio irrespective of the area of the plane. The method of claim 1, In the first step, the center line of the image pickup device is parallel to the plane and the touch coordinate recognition method using the image pickup device and the light source, characterized in that included in the plane. The method of claim 1, In the first step, the imaging angle or the installation angle of the imaging device assumes an arbitrary angle when all the light sources on the plane enter the acquired image, so that only the reference light source is included in the image even when the imaging device is installed at an arbitrary angle. Touch coordinate detection method using an image pickup device and a light source characterized in that the touch angle can be detected if included, so as to automatically correct the installation angle. The method of claim 1, In the second process, in the case of the first imaging device, the light source located at the other end to the light source located at the other end based on the distance from the light source positioned at one end to the light source existing at both ends, Calculating a distance ratio of the first step; In the case of the second image pickup device, the distance ratio from the light source located at one end to the light source existing at both ends is calculated based on the distance from the light source positioned at the other end to the light source existing at both ends among the acquired light sources at both ends. Touch coordinate recognition method using an image pickup device and a light source, characterized in that it comprises a second step. The method of claim 1, In the third process, in the case of the first image pickup device, a touch existing between the light sources positioned at one end of the light sources positioned at the other end and the touch points existing at both ends of the light sources at the other end of the acquired light sources of both ends is detected. Calculating a distance ratio to a point; In the case of the second imaging device, the ratio of the distance from the light source positioned at the other end to the touch point existing between the both ends, based on the distance from the light source positioned at one end to the touch point existing at both ends, among the acquired light sources at both ends. Touch coordinate recognition method using an image pickup device and a light source, characterized in that it comprises a second step of calculating a. The method according to claim 1 or 4 or 5, The fourth process includes: a first step of calculating a first virtual ratio ha by multiplying the data calculated in the first step of the second process with the data calculated in the first step of the third process; And a second step of calculating a second virtual ratio hb by multiplying the data calculated in the second step of the second step and the data calculated in the second step of the third step. Touch coordinate recognition method using the. In a touch screen system having a display area having an arbitrary area and a plurality of imaging devices and light sources: By processing the image image acquired in one-to-one correspondence to two or more image pickup devices positioned at the corners of the display area, the ratio of the distance between the signal and the light source and the distance between the touch object and the light source according to the recognition of any touch object in contact with the display area. Two or more image data processing modules for calculating and outputting a distance ratio; A virtual ratio calculation module that receives a distance ratio between light sources calculated by the image data module and distance ratio data between a touch target and a light source and calculates a virtual ratio for the touch target; A virtual coordinate calculation module for receiving a virtual ratio calculated by the virtual ratio calculation module and calculating a virtual coordinate for a touch object; A touch object operation that receives a signal according to whether or not the touch object is output from the image data processing modules and determines whether a real touch object exists, and separately outputs an operation (click, double click, drag, etc.) of the touch object. Detection recognition module; And And a touch screen operating module configured to receive data output from the touch target motion detection recognition module and the virtual coordinate calculation module and load a program corresponding to a region determined to be touch among the images displayed on the display area to display corresponding information. Touch screen system using a touch coordinate recognition method using an image pickup device and a light source. The method of claim 7, wherein And a center line of the image pickup device is parallel to a plane of the display area and included in the plane. The method of claim 7, wherein And an imaging angle of the imaging device or an installation angle of the imaging device to take an arbitrary angle when all of the light sources on the plane enter the acquired image. The method of claim 7, wherein The image data processing module includes: an acquisition image filtering module configured to receive an image image acquired by the first image acquisition module after power supply and to acquire and output only an image of a light source and a touch object through an operation such as filtering; A reference light source recognition module for extracting and recognizing a position of a reference light source from the filtered image image output from the acquired image filtering module; A light source distance ratio calculating module configured to calculate a distance ratio between light sources based on the position data of the reference light source in the reference light source recognition module; A touch object recognition module configured to calculate and output a center position of an object excluding a light source from the filtered image image output from the acquired image filtering module; And And a touch target distance ratio calculation module configured to receive position data of a reference light source output from the reference light source recognition module and a center position of the target output from the touch target recognition module and calculate a distance ratio between a specific reference light source and the target. Touch screen system using a touch coordinate recognition method using an image pickup device and a light source. The method of claim 7, wherein The imaging device is a touch screen system using a touch coordinate recognition method using an imaging device and a light source, characterized in that using an infrared camera or an image sensor. The method of claim 7, wherein A touch screen system using a touch coordinate recognition method using an image pickup device and a light source, the light guide plate having a plurality of light sources formed on one side selected from the side or the back as an outer peripheral surface of the display area of the touch screen.

Images