KR101926819B1 - Pointing device using three dimensional virtual button - Google Patents

Abstract

The pointing device includes: a button display layer having a plurality of buttons displayed; An illumination layer positioned below the button indicator layer and including a plurality of light emitting devices capable of emitting light; A stereoscopic filter layer positioned above the button display layer and capable of separating images of the left and right eyes; And a pointing layer positioned above the stereoscopic filter layer to obtain a pointing position of a user, wherein the pointing layer comprises at least one infrared light emitting element; And at least one infrared sensor.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a pointing device using a three-

The present invention relates to a pointing device using a three-dimensional virtual button.

Since the automobile button or the unmanned kiosk button is often damaged by frequent pressing, such a mechanical button is required to switch to a three-dimensional non-eye contactless button having a beautiful appearance.

In addition, when the infectious diseases such as mers were prevalent, the non - contact type would be preferred by the three - dimensional virtual button rather than the contact button. Therefore, it is expected that the demand will increase from the hygienic point of view.

In addition, in the conventional touch panel method, the password is easily exposed by a secret camera installed on the cash dispenser or the like, but the 3D virtual button is different from the three-dimensional stereoscopic image seen in the eyes by the camera, And the necessity for banking and the like is greatly increased.

In addition, it is expected that virtual buttons will be more efficient in occupations where liquids are often buried in the hands, which will create demand for occupational devices.

The three-dimensional stereoscopic stereoscopic technique is a method in which a non-stereoscopic stereoscopic filter such as a lenticular lens or a parallel barrier is overlaid on the image so that the left and right images can be displayed on both sides of the user, Technology is developing.

There is also an attempt to realize stereoscopic button screens by superimposing a non-eye stereoscopic effect filter on a liquid crystal display. In this case, the liquid crystal display performs the function of mixing the stereoscopic image filter with the right and left images in an intersecting manner. When the button is pressed, the liquid crystal can be replaced with a screen containing the depressed state of the button. However, it is expected that it is difficult to use a button set having a liquid crystal display as a low-cost type.

In addition, a technical problem in the case of embodying the button in the non-eyeglasses stereoscopic display is that the problem of specifying the position of the finger pointed in the non-contact manner on the stereoscopic screen and the problem of pointing the button are differentiated It is to be given. The problem that the pointed button should be displayed differently from the unpointed button is disclosed in Japanese Laid-Open Patent Publication No. 2011-108152 (3-dimensional input display device, June 26, 2011) It is possible to dynamically transmit a screen containing pressed buttons and non-pressed buttons when the non-eye stereoscopic vision is implemented on the display. However, in this case, as described above, a dynamic image delivery device such as a liquid crystal display is necessarily required.

The problem of specifying the position of a pointed finger in a stereoscopic screen is not a practical solution so far, considering the characteristic that it should be implemented at a low cost in a narrow space of a button. To date, most of the proposed methods combine infrared ray lamp and infrared camera. The main purpose of this study is to analyze the reflected light intensity change of pointed fingertip by inputting projected two - dimensional infrared image into infrared camera. Japanese Patent Laid-Open Publication No. 2011-108152 proposes only that the problem of specifying the pointing position of the finger can be solved by capturing the reflected light of the finger by the infrared light emitted from the sensor. Did not do it.

For reference, in the international patent application WO2014 / 030902A1 (INPUT METHOD AND APPARATUS OF PORTABLE DEVICE, Feb. 27, 2014), a palm-shaped screen has been proposed.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a pointing device using a three-dimensional virtual button capable of minimizing a mechanical failure by a non-contact button method.

It is another object of the present invention to provide a pointing device using a three-dimensional virtual button which can observe an image of a button only by a user by means of three-dimensional stereoscopic vision and can prevent exposure of button information by a camera. .

It is another object of the present invention to provide a pointing device using a three-dimensional virtual button that can be implemented at a low cost by a simple structure without a dynamic image sending device such as a liquid crystal display.

According to another aspect of the present invention, there is provided a pointing device comprising: a button display layer having a plurality of buttons; An illumination layer positioned below the button indicator layer and including a plurality of light emitting devices capable of emitting light; A stereoscopic filter layer positioned above the button display layer and capable of separating images of the left and right eyes; And a pointing layer positioned above the stereoscopic filter layer to obtain a user's pointing position.

Specifically, the pointing layer comprises at least one infrared light emitting element; At least one infrared sensor; An infrared ray transmission filter disposed inside the at least one infrared ray emitting device and the at least one infrared ray sensor; And a horizontal polarization filter disposed inside the at least one infrared ray emitting device and the at least one infrared ray sensor.

In addition, the pointing device of the present invention may further include an illumination partition wall layer formed below the button display layer and separating a plurality of illumination devices.

Further, the pointing device of the present invention learns a pointing position of a finger by using a neural network, and the neural network uses an infrared ray value detected by the at least one infrared ray sensor as an input value, As the output value.

Preferably, the illumination layer is disposed at a position corresponding to the position of the plurality of buttons displayed on the button display layer, and when the user points the button, the illumination device corresponding to the position of the button A button that has been pointed can be displayed to the user.

In addition, the button display layer may be displayed by intersecting the left eye image and the right eye image, which are divided into respective viewpoints of the left eye and the right eye.

According to the pointing device using the three-dimensional virtual button of the present invention, the mechanical failure can be minimized by the non-contact button method. In addition, according to the present invention, only a user can observe an image of a button by three-dimensional stereoscopic vision, thereby preventing exposure of the button information by the camera. Also, according to the present invention, it is possible to realize a pointing device using a three-dimensional virtual button button at a low cost by a simple structure without a dynamic image sending device such as a liquid crystal display.

1 is an exploded perspective view of a pointing device using a three-dimensional virtual button according to a preferred embodiment of the present invention.
2 is an enlarged cross-sectional view of the pointing layer;
Fig. 3 is an explanatory view showing the synthesis of left eye and right eye images by the button display layer and the filter layer; Fig.
4 is an explanatory diagram of a learning method by the control unit of the control board;

Hereinafter, a pointing device using a three-dimensional virtual button according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

It should be understood that the following embodiments of the present invention are only for embodying the present invention and do not limit or limit the scope of the present invention. It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

1 is an exploded perspective view of a pointing device 100 using a three-dimensional virtual button according to a preferred embodiment of the present invention.

1, the pointing device 100 using a three-dimensional virtual button according to a preferred embodiment of the present invention includes a pointing layer 10, a protective layer 20, a stereoscopic filter layer 30, A display layer 40, an illumination barrier layer 50, an illumination layer 60, and a control board 70.

The pointing layer 10 is preferably located on top of the protective layer 20 and the stereoscopic filter layer 30 and preferably includes at least one infrared ray emitting element 11 and at least one infrared ray sensor 12.

That is, the pointing layer 10 is a portion for obtaining the pointing position of the finger in three dimensions, and is preferably located at the top of the pointing device 100 of the present invention. The pointing layer 10 is composed of at least one infrared ray emitting element 11 and at least one infrared ray sensor 12 as an infrared ray receiving element to calculate the three-dimensional position of the finger. As the infrared light emitting element 11, a low-cost infrared lamp can be used.

In the present invention, the position of the pointing layer 10 can be calculated by calculating the integrated value of the amount of light emitted from the infrared light emitting element 11 and the total amount of infrared light for each infrared sensor 12 as the light receiving element. The specific position calculation principle in the present invention will be described later. In addition, the height of the pointing layer 10 for three-dimensional positioning is very limited so that only two-dimensional coordinates of the finger can be checked. The position of the finger can be calculated when the finger enters the pointing layer 10 and enters the three-dimensional region of the pointing layer 10.

The infrared ray emitting element 11 and the infrared ray sensor 12 are fixedly mounted on a support 15 provided on the periphery of the pointing layer 10, Are arranged in an intersection.

Figure 2 shows an enlarged cross-sectional view of the pointing layer 10.

2, the pointing layer 10 of the present invention preferably includes a horizontal polarization filter 13 and an infrared ray transmission filter 14. [

The horizontal polarization filter 13 and the infrared ray transmission filter 14 are respectively located inside at least one infrared ray emitting element 11 and at least one infrared ray sensor 12, 13). ≪ / RTI >

In the case where an apparatus using an infrared sensor 12 other than an infrared camera is used in an indoor or outdoor environment as in the present invention, interference between sunlight and other lamps may be a problem. In the present invention, the horizontal polarizing filter 13 and the infrared ray transmitting filter 14 are attached to the pointing layer 10 on which the infrared ray sensor 12 and the infrared ray emitting element 11 are disposed, It is possible to block infrared interference light as much as possible.

That is, under the general visible light or the sunlight, a large amount of external interference infrared light is input to the infrared sensor 12. In the pointing layer 10 of the present invention, the blinds are arranged in the horizontal direction, and the horizontally polarized light filter 13, which transmits only light input in the horizontal direction, is combined with the infrared ray transmitting filter 14, By arranging the infrared light emitting element 11 and the at least one infrared ray sensor 12, the interference infrared rays can be minimized.

The protective layer 20 serves to protect the stereoscopic effect filter layer 30, and may be formed using a transparent protective film or a protective plate.

In order to recognize the three dimensions, the images viewed from the respective viewpoints of the left and right sides should be input. To this end, the stereoscopic effect filter layer 30 is positioned above the button display layer 40 and serves to separate the left eye image and the right eye image for three-dimensional stereoscopic viewing.

The stereoscopic effect filter layer 30 may be implemented using a parallax barrier or a lenticular lens system in order to realize a three-dimensional image by glasses. Specifically, the stereoscopic viewing filter layer 30 is preferably a lenticular filter.

That is, according to the present invention, images formed by alternating left and right lines are matched to the shape of a lenticular lens designed to separate left and right lines one by one so that left and right images are separately outputted.

The button display layer (40) is characterized in that a plurality of buttons (41) are displayed.

It is preferable that the portion of the button display layer 40 on which the button 41 is displayed is translucent. That is, when the illumination device 61 of the illumination layer 60 emits light, the user can confirm whether or not the illumination device 61 of the illumination layer 60 emits light through the translucent button 41. The method of displaying at least one button on the button display layer 40 may be implemented by printing the button 41 on a glass plate or a plastic plate.

Fig. 3 is an explanatory view of the synthesis of the left eye and right eye images by the button display layer 40 and the stereoscopic effect filter layer 30. Fig.

3, at least one button 41 displayed on the button display layer 40 is divided into respective viewpoints of the left eye and right eye, and the left eye image and the right eye image are displayed in an intersecting manner.

That is, at least one button 41 produces a three-dimensional image of the button 41 in a three-dimensional graphic, divides the three-dimensional image into the right and left eyes, and mixes the left and right images one by one. The images formed by the intersections of left and right lines are matched to the filter shape of the stereoscopic filter layer 30 designed to separate left and right lines one by one so that left and right images are separately outputted.

The illumination partition wall layer 50 is formed in a lattice shape on the upper side of the illumination layer 60, i.e., below the button indication layer 40, and serves to separate a plurality of illumination devices 61. That is, the light emitted from each of the illumination devices 61 can display only the background of the corresponding button 41 by the illumination partition wall layer 50.

The illumination layer 60 preferably includes a plurality of illumination devices 61 located below the button display layer 40 and capable of emitting light. As the illumination device 61 of the illumination layer 60, various illumination elements including light emitting diodes and / or laser diodes can be used.

The illumination layer 60 serves to recognize the pointing portion by allowing the pointed button 41 to display a different color from the pointed-out button 41. [ That is, the control unit of the control board 70 controls the operation of the illumination layer 60 using the position data obtained in the pointing layer 10, so that the illumination device 61 at the position corresponding to the corresponding button 41 So as to confirm the depressed button 41 by letting it emit light.

Alternatively, all the illumination devices 61 included in the illumination layer 60 are always illuminated, and when the button 41 is pointed, the illumination device 61 at the position corresponding to the button 41 does not emit light You may.

In addition, all the lighting devices 61 included in the illumination layer 60 emit light in the color 'A' at all times, and when the button 41 is pointed, the lighting device 60 at the position corresponding to the button 41 61 may be made to emit light in the color "B".

That is, the illumination layer 60 is characterized in that the illumination device 61 is disposed at each position corresponding to the position of the plurality of buttons 41 displayed on the button display layer 40. The user can display the pointed button 41 by using the lighting device 61 corresponding to the position of the corresponding button 41 when the user points the button 41. [

The control board 70 of the present invention serves as a control unit and controls the infrared light emitting element 11 to emit light and calculates the amount of light received from the infrared sensor 12 at this time, . To this end, the control unit generates a control signal for controlling the operation of the infrared light emitting element 11, the infrared sensor 12, and the lighting device 61.

Specifically, the control unit calculates the three-dimensional position of the finger from the infrared light emitted from the plurality of infrared light emitting elements 11 to a value obtained by the plurality of infrared sensors 12.

Fig. 4 is an explanatory diagram of a learning method by the control unit of the control board 70. Fig. For reference, the control unit may be configured to include a processor such as a CPU.

The calculation of the three-dimensional position of the finger by the control unit uses the learning function of the neural network. Specifically, by learning the infrared input value and the two-dimensional pointing position of the finger for each infrared sensor 12, do. The neural network may be composed of an input layer, an intermediate layer, and an output layer. The infrared brightness value inputted from each infrared sensor 12 is learned in the neural network, and the pointing position of the finger is obtained. And informs the user that the value has been input by lighting the belonging light.

That is, in the present invention, the pointing position of the finger is learned by using the neural network, and the neural network uses the infrared ray detected by at least one infrared ray sensor 12 as an input value, It is preferable to use each button 41 as an output value.

According to the pointing device 100 using the three-dimensional virtual button of the present invention as described above, the virtual button set is displayed on the three-dimensional space using the non-eye stereoscopic representation technology and the pointing position read It can be seen that the position of the finger on the three-dimensional plane is read through the pointing layer 10 as the device to check the on / off state of the virtual button 41 and to indicate that the corresponding button 41 has been pressed.

The pointing device 100 in the form of a small universal button like the present invention has two problems to be solved, one to be able to utilize in a narrow space, and the other to be able to configure the hardware for implementation at a low cost . To this end, in the case of the pointing position specifying method of the present invention, a plurality of infrared ray emitting devices 11 and infrared ray sensors 12 such as infrared lamps other than a camera type for analyzing reflected light of a finger are arranged. The infrared rays emitted from the infrared lamps for each position are detected by an infrared sensor 12 which is two-dimensionally dispersed and arranged. The infrared intensity input from the plurality of sensors is converted into a finger pointing position by the pre-learned neural network. The principle of this is that the sensors arranged in the direction of blocking the light have relatively weak light receiving sensitivity even though they have interference light, which is learned by the neural network.

In addition, when a device using an infrared sensor 12 other than an infrared camera is used in an indoor or outdoor environment as in the present invention, interference between sunlight and other lamps becomes a problem. In order to minimize the influence of the interference light, a horizontal polarization filter 13 and an infrared filter are attached to the panel surface on which the infrared ray emitting element 11 and the infrared ray sensor 12 are disposed, So that interference light can be blocked as much as possible. In addition, interference lights that are not filtered out are treated by preliminary learning of various environments by neural networks. In the case of a button intended to be used indoors or outdoors, since the difference in the sunlight infrared ray varies depending on the morning, the day, the night, and the weather, the installation place is limited unless the adaptive learning method by the neural network is used There is a need. The pre-learning by the neural network makes it possible to acquire pointing taking into account the irregular changes in the amount of infrared rays of sunlight and other lighting devices depending on time and weather.

The pointing device 100 according to the present invention can be configured to be inexpensive and miniaturized hardware to use the infrared light emitting element 11 and the infrared sensor 12 and can be used for a small general purpose button and a large number of infrared sensors 12 ) Are arranged two-dimensionally and each input is connected to an input node of a neural network, so that a formula suitable for a factory, outdoor, or the like can be provided by prior learning.

As described above, according to the pointing device 100 using the three-dimensional virtual button of the present invention, the mechanical failure can be minimized by the non-contact button method. In addition, according to the present invention, only a user can observe an image of a button by three-dimensional stereoscopic vision, thereby preventing exposure of the button information by the camera. In addition, according to the present invention, it is understood that the pointing device 100 using a three-dimensional virtual button can be implemented at a low cost by a simple structure without a dynamic image sending device such as a liquid crystal display.

100: Pointing device
10: pointing layer 20: protective layer
30: stereoscopic effect filter layer 40: button display layer
50: light barrier layer 60: illumination layer
70: control board
11: Infrared ray emitting element 12: Infrared ray sensor
13: Horizontal polarization filter 14: Infrared transmission filter
15: support 41: button
61: Lighting device

Claims (8)

A button display layer displaying a plurality of buttons;
An illumination layer positioned below the button indicator layer and including a plurality of light emitting devices capable of emitting light;
A stereoscopic filter layer positioned above the button display layer and capable of separating images of the left and right eyes; And
And a pointing layer positioned above the stereoscopic filter layer to obtain a user's pointing position,
Wherein the pointing layer comprises:
A plurality of infrared light emitting elements; A plurality of infrared sensors; An infrared ray transmission filter disposed inside the plurality of infrared ray emitting devices and the plurality of infrared ray sensors; And a horizontal polarization filter positioned inside the plurality of infrared light emitting devices and the plurality of infrared sensors and transmitting only light input in the horizontal direction,
Wherein the plurality of infrared light emitting elements and the plurality of infrared sensors are fixedly mounted on a support, wherein the plurality of infrared light emitting elements and the plurality of infrared sensors are alternately arranged along four sides using the support,
And the infrared transmitting filter is located inside the horizontal polarizing filter. delete delete The method according to claim 1,
The pointing device comprises:
Further comprising an illumination barrier layer formed below the button indicator layer to separate the plurality of illumination devices. The method according to claim 1,
The pointing device comprises:
A pointing position of a finger is learned using a neural network,
The neural network includes:
Wherein an infrared ray value detected by the at least one infrared ray sensor is used as an input value and each button displayed on the button display layer is used as an output value. The method according to claim 1,
Wherein the illumination layer
Wherein the lighting device is disposed at a position corresponding to a position of the plurality of buttons displayed on the button display layer. The method according to claim 6,
Wherein the illumination layer
Wherein when the user has pointed the button, the button pointed by the lighting device corresponding to the position of the button can be displayed to the user. The method according to claim 1,
The button display layer
Eye image and the right-eye image, which are divided into the left eye and the right eye, are displayed in an intersecting manner.

Images