KR101922386B1 - Image display device identifying touch location using infrared rays - Google Patents

Abstract

The present invention relates to an image display apparatus for identifying a contact position by using infrared rays, and more particularly, to an image display apparatus for identifying a contact position by using infrared rays which detects infrared rays scattered in a sensing means on a screen by a camera, identifies coordinates of an area in which the infrared rays are scattered to check whether the coordinates match coordinates of a target object, and displays a score calculated according to a match rate. According to the present invention, when implementing functions of a game, description data, a virtual keyboard, and the like displayed by image transmission of a projector on a screen, an accurate position of the sensing means can be identified, and the game and data description can be performed by using a relatively simple system.

Description

TECHNICAL FIELD [0001] The present invention relates to an image output apparatus for confirming a contact position using infrared rays,

The present invention relates to an image output apparatus for confirming a contact position using infrared rays, and more particularly to an image output apparatus for detecting an infrared ray scattered by a sensing means on a screen by a camera, And confirms whether or not the coordinates of the object to be displayed in the image coincide with the coordinates of the object to be displayed in the image, and confirms the contact position by using infrared rays for displaying a score or a result according to the degree of coincidence.

Recently, with the rapid development of software and semiconductor technology and information processing technology, various information devices such as mobile phones, computers, and tablets are becoming more and more multifunctional. In addition, information storage and communication Is also growing in importance.

Conventionally, a method of inputting data to an information device is performed by pressing an input key, but in recent years, a data input method using the touch screen has been increasingly used for the information device.

In general, a touch screen is an input device that replaces an input key, a keyboard, and a mouse. The touch screen is mounted on a screen, and then touches the screen directly with a hand, a stylus pen, or the like to input data It is a device that can.

The touch screen is an intuitive device that is suitable for portable input devices and can be widely used in computer simulation applications, office automation applications, educational applications, and game applications.

In such an input device, a user senses a point of contact with a hand or a pen electrically and confirms input information.

In recent years, an apparatus for confirming input information through a virtual keyboard or an image displayed on a screen by a hand or other sensing means and processing a video signal is also disclosed.

1 is a schematic diagram of a projection keyboard system constructed in accordance with a prior art embodiment;

Referring to Figure 1, a projection subsystem 100 including a solid state light source for illuminating a spatial light modulator according to the prior art includes an image 102 of a keyboard on a projection surface 104, which is a fixed surface, such as a desk, ).

The illumination subsystem 106, which includes a solid state light source, projects light into a radial illumination pattern 108 and extends to a plane that is generally parallel to the projection surface 104. The radial illumination pattern 108 generally has a very narrow spread in a direction normal to the projection surface 104. The radial illumination pattern 108 is located very close to the projection surface 104.

Light is projected or reflected when light of a radial illumination pattern 108 is projected onto a data entry object 110, such as a person's finger, stylus, or other tool. Light is scattered or reflected when the data entry object 110 is brought into close contact with the keyboard 102 formed on the projection surface 104.

The detection subsystem 112 using the solid state imaging sensor receives light scattered or reflected from the data entry object 110. The received light is mapped onto the imaging sensor with respect to the representation of the keyboard to associate the location of the data entry object 110 sensed by the detection subsystem 112 with the key location 113 on the keyboard 102. [

Thus, the position of the sensed data entry object 110 indicates which key of the keyboard 102 is touching.

However, in such a device, it is necessary to project light from one side to find the degree of reflection from the hand, and to find an accurate position through image analysis. However, since the image displayed on the screen and the light for confirming the position overlap, have.

Especially, when the input position must be confirmed while projecting the image using the projector on a large screen, it is necessary to reduce errors caused by light interference.

KR 10-2003-0072591 A KR 10-2012-0066814 A

According to an aspect of the present invention, there is provided an infrared ray scattering apparatus for detecting infrared rays scattered by a hand or other sensing means moving on a screen by an infrared filter, And the position of the sensing means can be confirmed by calculating the coordinates of the position of the sensing means.

In addition, it is possible to confirm the position of the sensing means by analyzing the image taken by the camera equipped with the infrared filter, and to combine the images that visually display the infrared scattering effect at the position of the sensing means through the projector, And to provide a video output device for confirming the position.

And an object of the present invention is to provide a video output device for confirming a contact position by using infrared rays so that the infrared ray emitting portion is radially arranged on the screen so that the infrared rays are uniformly irradiated onto the entire screen,

It is also possible to check the position of the sensing means by means of infrared scattering, to calculate the score of the game, or to perform the operation of the input button virtually displayed on the screen, And an output device.

According to an aspect of the present invention, there is provided a method for detecting infrared rays scattered by a sensing unit on a screen, An infrared ray emitting unit 202 installed on one side of the screen and irradiating infrared rays onto the screen in a direction parallel to the plane of the screen; A camera 204 for photographing the screen; An infrared ray filter (208) mounted on the camera (204) and passing infrared rays scattered by the sensing means (10); A projector 206 for transmitting an image to be displayed on the screen; A background image transmitting unit 210 for storing data on a background image to be displayed on the screen and transmitting a signal for the background image to the projector 206; A coordinate confirming unit 212 for detecting the scattering of infrared rays generated by the sensing means 10 moving on the screen and confirming a coordinate value of the position of the sensing means 10; A result processing unit 214 for confirming the information inputted by the user according to the contents detected by the coordinate confirming unit 212, and calculating and storing the result; A background image output from the background image sending unit 210 and a scattered image using an infrared scattering effect generated around the sensing means 10 are combined to transmit a signal for the composite image to the projector 206 And an image synthesizing unit 216. FIG.

The result processing unit 214 includes a sensing means region 11 determined by the position of the sensing means 10 and a target object region 21 determined by the position of the target object 20 included in the background image. And a score or a grade is determined according to the degree of overlapping areas.

According to the present invention, in implementing functions of a game, description data, a virtual keyboard, etc., displayed by projecting a video image of a projector on a screen, the accurate position of the sensing means can be confirmed, And so on.

1 is a schematic diagram of a projection keyboard system constructed in accordance with an embodiment of the prior art;
2 is a conceptual diagram illustrating the configuration of a video output apparatus according to an embodiment of the present invention;
3 is a view showing a video output device in front of a screen;
4 is a view of a video output device on the side of the screen.
5 is a block diagram showing an internal configuration of a video output apparatus;
6 is a conceptual diagram showing a state in which an object is displayed in a video.
7 is a conceptual diagram showing a method of confirming the coordinate value of the sensing means using infrared rays scattered around the sensing means.
8 is a conceptual diagram illustrating a method of calculating the degree of correspondence by comparing the coordinate values of the sensing means and the object.
9 is a conceptual view showing a method of displaying a scattering region as an image around the sensing means.

Hereinafter, a video output apparatus for confirming a contact position using infrared rays (hereinafter referred to as a video output apparatus) according to an embodiment of the present invention will be described with reference to the drawings.

2 is a conceptual view showing a configuration of a video output apparatus according to an embodiment of the present invention, FIG. 3 is a view showing a video output apparatus in front of a screen, FIG. 4 is a view showing a video output apparatus on the side of a screen, Is a block diagram showing the internal configuration of the video output apparatus.

The video output apparatus 200 of the present invention is a device that allows a user to input information while directly touching an image with a sensing means such as a hand or a pointer while displaying an image on a screen, a blackboard, an office wall, In the present invention, for the sake of convenience of explanation, a device for determining the position while touching the screen, such as a hand or a pointer, is referred to as a sensing means.

An infrared ray emitting portion 202 is provided on one side of a screen on which an image is displayed. The infrared ray emitting portion 202 is provided on the same plane as the plane of the screen and irradiates infrared rays in a direction parallel to the plane of the screen. The infrared ray emitting unit 202 is installed at either the top or bottom of the screen, or the left or right side of the screen. Since it is often the case that the user inputs information with both hands in front of a screen on which a relatively large image is displayed, it is most preferable to irradiate the screen from the top to the bottom in parallel with the screen to prevent the infrared rays from being blocked or interfered with.

At least one head for irradiating infrared rays is installed in the infrared ray emitting portion 202 in a radial shape. Normally, one head irradiates infrared rays having a radiation angle of about 60 to 90 degrees, and has an output enough to reach an effective distance of about 10 m or so. It is possible to completely cover the screen having a width of several meters by using the infrared ray emitting portion 202 provided with a plurality of heads having a radiation angle of 60 to 90 degrees.

Although the infrared ray is an electromagnetic wave having a wavelength of about 700 nm to 1200 nm, it is preferable to use infrared rays of a relatively short wavelength band in consideration of the unit price of the component and the type of usable sensor. In the present invention, infrared rays having a wavelength band of 808 nm are set to be used.

A camera 204 and a projector 206 are installed on the upper side of the screen.

The camera 204 photographs the image displayed on the screen and the sensing means 10 moving on the screen, and converts it into a video signal. The infrared ray filter 208 used in the present invention includes an infrared ray filter 208 mounted on the camera 204 to detect electromagnetic waves in the infrared region so as to detect infrared rays scattered around the sensing means 10 moving on the screen. Means a device that converts to light. By attaching the infrared filter 208 to the camera 204 for shooting a general visible light, the camera 204 can capture infrared scattering that could not be seen with the naked eye. A band-pass filter that blocks light in the visible light region or the ultraviolet region and passes only the light in the infrared region may be applied. It is preferable that the infrared filter 208 detects only infrared rays scattered randomly around the sensing means 10, and the infrared rays emitted from the infrared ray emitting portion 202 are cut off or partially passed through in the linear direction. do.

The projector 206 transmits an image to be displayed on the screen. The image to be displayed by the projector 206 includes various kinds of games, a virtual keyboard, document data, and the like. The projector 206 can be applied to any device that outputs and displays a video signal stored in the video output device 200 on a large screen.

The main body of the video output apparatus 200 is formed of a separate body from an external apparatus such as an infrared ray emitting unit 202, a camera 204 and a projector 206 and is connected to an external apparatus through a wired / . Since the communication means between the external device and the main body can be applied to the conventional technology, it will not be described in detail in the present invention.

The video output apparatus 200 includes a background video transmission unit 210. The background image transmitting unit 210 stores data on the background image to be displayed on the screen and transmits a signal to the projector 206 on the background image. As described above, the background image means an image included in a program in which a user inputs information by using the sensing means 10, such as a game or document data.

The coordinate confirming unit 212 is means for detecting information (coordinate value) about the position of the sensing unit 10 by sensing scattering of infrared rays generated by the sensing unit 10. [ It is possible to confirm the information input contents of the user by checking the position of the sensing means 10 in the screen area where the background image is displayed. The operation contents of the coordinate confirming unit 212 will be described later.

The result processing unit 214 confirms the position of the sensing means 10 according to the sensing information of the coordinate confirming unit 212, and then confirms the information inputted by the user, and converts the result into a function execution or a score . When the game is played using the video output apparatus 200, the result (score, achievement, etc.) of the game is calculated and stored.

The image synthesizing unit 216 synthesizes the background image output from the background image output unit 210 and the scattered images using the infrared scattering effect generated around the sensing unit 10 so that they are simultaneously displayed on one screen.

Infrared rays irradiated from the infrared ray emitting portion 202 are not visible to human eyes. Therefore, since the infrared rays scattered by the sensing means 10 can not be confirmed by the human eye, the user proceeding to the game may not feel the change of the position of his / her hand or the progress of the game.

The camera 204 equipped with the infrared filter 208 photographs the scattering region 12 formed around the sensing means 10. The image combining unit 216 combines the scattering region 12 with the background image and outputs the resultant image together through the projector 206. When the user moves the sensing means 10 on the screen, the user views the original background image and the scattered image synthesized through the image synthesizer 216 and output. When viewing an image on a screen, a background image and an image with a scattering effect applied around the sensing means 10 on which the user is moving overlap each other, so that the user is directly scattered around the sensing means 10 on which the user is currently moving I feel like. Therefore, when a predetermined condition is satisfied while moving the sensing means 10 used by the user, a relatively bright region is displayed around the sensing means 10, and the result of the game according to the movement of the sensing means 10 can be visually confirmed.

6 is a conceptual diagram showing a state in which an object is displayed in a video.

A background image transmitted from the projector 206 is displayed on the screen. In FIG. 6, the game is illustrated as an example, but it is assumed that the game is intended to capture an object (target) displayed on the image. The user touches the position at which the object 20 is displayed by the sensing means 10 to catch the object 20 whose size and position change on the screen.

When the user touches the screen with the sensing means 10, the camera 204 senses the infrared scattering occurring around the sensing means 10. Then, as shown in FIG. 7, coordinate values of the region where infrared rays are scattered are obtained.

7 is a conceptual diagram illustrating a method of confirming the coordinate values of the sensing means using infrared rays scattered around the sensing means. The infrared ray emitted from the infrared ray emitting portion 202 is scattered while bombarding the sensing means 10 and the camera 204 equipped with the infrared ray filter 208 displays the scattered state do.

The coordinate confirmation unit 212 confirms the position of the region where the infrared rays are scattered and converts the coordinates into numerical coordinate values. The region where the infrared rays are scattered will generally be indicated by irregularly shaped faces. The coordinate confirming unit 212 may use the center value of the scattered region as a reference or all the positions belonging to the frozen region as a reference in order to determine the coordinate value of the scattered region of the infrared rays.

When the number of the sensing means 10 is two or more, scattering can be performed in each sensing means 10, and the camera 204 senses all the scattering of infrared rays, so that a multi-touch function can be realized.

The result processing unit 214 digitizes and stores the result of the user's action using the coordinate values of the scattered region.

8 is a conceptual diagram illustrating a method of calculating the degree of correspondence by comparing the coordinate values of the sensing means and the object.

8, a sensing means region 11 determined by the position of the sensing means 10 and a target object region 21 determined by the position of the object 20 are simultaneously displayed. The sensing means region 11 is positioned and sized according to the position coordinate value of the sensing means 10 calculated by the coordinate confirming unit 212 from the infrared scattering. The position and size of the target object area 21 are determined from the coordinate value data of the object 20 included in the video signal output from the background video transmitting unit 210.

The result processing unit 214 compares the positions of the sensing means region 11 and the object object region 21, identifies overlapping portions, and determines the score, grade, etc. of the game according to the result. If the detection means region 11 and the target object region 21 partially overlap each other according to the content of the game, the score may be reduced or the score may be reduced only when the detection means region 11 overlaps the predetermined ratio or more.

In the case of a shooting game such as hunting or ballooning, a score is obtained when a moving target is touched while touching a moving target. The object 10 to be moved at a high speed is detected on the virtual screen by the sensing means 10, If you touch it, it will be considered successful. In some cases, the score may be different depending on the ratio of the area where the sensing means region 11 and the object object region 21 overlap.

The image combining unit 216 combines the infrared image with the background image to visually display the scattered region.

FIG. 9 is a conceptual diagram showing a method of displaying a scattering region around an image sensing means. FIG.

As described above, the infrared ray emitting unit 202 emits infrared rays that can not be seen by human eyes, and the scattering by the sensing means 10 can not be seen. In the present invention, the position of the sensing means 10 is identified as a coordinate value, and the output of the image is controlled so that the scattering region 12 is displayed at coordinates where the sensing means 10 is located. Then, as shown in FIG. 9, the user can visually observe the scattering area 12 whose brightness or color is changed around the sensing means 10 on which the user is moving.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, As will be understood by those skilled in the art. Therefore, it should be understood that the above-described embodiments are to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than the foregoing description, It is intended that all changes and modifications derived from the equivalent concept be included within the scope of the present invention.

10: sensing means 11: sensing means region
12: scattering area 20: object
21: Target object area 200: Video output device
202: infrared ray emitting unit 204: camera
206: Projector 208: Infrared filter
210: background video transmitting unit 212: coordinate confirmation unit
214: Result processing unit 216:

Claims (2)

An image output apparatus for irradiating infrared rays from one side of a screen on which an image is displayed and detecting the position of the sensing means (10) by sensing infrared rays scattered by the sensing means (10) on the screen,
An infrared light emitting unit 202 installed on one side of the screen and irradiating infrared light onto the screen in a direction parallel to the plane of the screen;
A camera 204 for photographing the screen;
An infrared ray filter (208) mounted on the camera (204) and passing infrared rays scattered by the sensing means (10);
A projector 206 for transmitting an image to be displayed on the screen;
A background image transmitting unit 210 for storing data on a background image to be displayed on the screen and transmitting a signal for the background image to the projector 206;
A coordinate confirming unit 212 for detecting the scattering of infrared rays generated by the sensing means 10 moving on the screen and confirming a coordinate value of the position of the sensing means 10;
A result processing unit 214 for confirming the information inputted by the user according to the contents detected by the coordinate confirming unit 212, and calculating and storing the result;
A background image output from the background image sending unit 210 and a scattered image using an infrared scattering effect generated around the sensing means 10 are combined to transmit a signal for the composite image to the projector 206 And a video synthesizing unit (216), which confirms the contact position using infrared rays. The method according to claim 1,
The result processing unit 214
The detection means region 11 determined by the position of the sensing means 10 and the position of the target object region 21 determined by the position of the target object 20 included in the background image are compared with each other, And a score or a grade is determined according to the degree of the region.

Images