KR101335394B1 - Screen touch apparatus at long range using 3D position of eyes and pointy object - Google Patents

Abstract

The present invention relates to a point screen object that can control a screen in a three-dimensional space and a remote screen touch device using three-dimensional position information of an eye. In particular, an actual command input in a three-dimensional space using a point object and its It is possible to accurately distinguish external meaningless movements, to prevent malfunctions, and to receive various movements as commands so that users can input various commands, and pointy objects and three-dimensional position information of the eyes that can be distinguished from each other. It relates to a long-screen touch device used.

Description

Screen touch apparatus at long range using 3D position of eyes and pointy object}

The present invention can accurately distinguish between actual commands input in a three-dimensional space and other meaningless movements using a pointy object to prevent malfunctions. It is about.

In addition, the present invention can be used as a low-resolution pointing device, as well as a long distance using the three-dimensional position information of the eye and the pointy object that can receive a variety of movements as a command so that the user can input a variety of commands and distinguish from each other It relates to a screen touch device.

Recently, as the performance of computing devices mounted on personal / business PCs, game console devices, and smart phones has improved, user interfaces (UIs) have been gradually developed, among them, by analyzing movements in three-dimensional space. A remote screen touch device using a pointy object and three-dimensional position information of the eye that recognizes this as a unique command is also provided.

For example, in Korean Patent No. 374346, 'Method for tracking the position and direction of the head using images', the system that can control the mutual interface between human and computer using gaze and intentional blinking is more practically applied. It provides a way to track head movements.

In addition, Korean Laid-Open Patent No. 2009-93220 'Spatial Touch Screen Using Infrared Camera' recognizes a user's hand motion as 3D data and compares the hand motion data according to a preset system operation based on the user's hand motion. It provides a way to do it.

In addition, in Korean Patent Application Publication No. 2011-37053, "Control Method of 3D Spatial Touch Input Device Using Image Sensor," an output screen controller analyzes an image taken by the image sensor, and a user controls the user's hand or indicator rod. It provides the output screen control signal performed by using

However, in the conventional technologies as described above, although the command input by the user in the three-dimensional space is analyzed and reflected on the screen screen, it is impossible to accurately distinguish the case where the actual user moves to input the command and other meaningless movements. There was a problem that the command is not received.

In addition, the commands that can be input by the user are relatively simple, such as adjusting the volume according to the movement of the finger from one side to the other side, adjusting the play position of the video, and turning the bookshelf, and have not provided more various commands. It was more serious as it could not accurately distinguish meaningless movements.

The present invention has been proposed to solve the above-described problems. A pointy object capable of accurately distinguishing an actual command input from a three-dimensional space and other meaningless movements using a pointy object can prevent malfunction. To provide a remote screen touch device using three-dimensional location information of the eye.

In addition, the present invention can be used as a low-resolution pointing device, as well as a long distance using the three-dimensional position information of the eye and the pointy object that can receive a variety of movements as a command so that the user can input a variety of commands and distinguish from each other To provide a screen touch device.

To this end, the three-dimensional spatial touch device according to the present invention includes an image processing unit for receiving a signal of the user image captured by the image acquisition device installed on the screen; A coordinate calculation unit configured to calculate a current position of a user's eye and a pointy object's end in three-dimensional coordinates from the signal-processed user's image; A gesture analyzer configured to analyze a user's gesture by analyzing coordinates of a screen located on an extension line of a connection line having two points of the user's eyes and the point of the point object, the coordinates of which are calculated; And a controller for converting and analyzing the analyzed gesture into a control command through a user input device, wherein the gesture analyzer comprises a three-dimensional space when the Z-axis displacement of the pointy object is greater than the X-axis displacement or the Y-axis displacement. The screen is analyzed by selecting and activating the current screen by clicking on the screen, and analyzing the movement by the X-axis displacement or the Y-axis displacement as an execution command.

In this case, when the gesture analyzing unit returns to the Z-axis direction by the Z-axis displacement, it is preferable to analyze that the screen is clicked.

In addition, the gesture analyzer may analyze that the grab for drag and drop is selected when the Z-axis displacement of the pointy object moves to be greater than the X-axis displacement or the Y-axis displacement, and then stops for a predetermined time.

The gesture analyzer may be provided with a plurality of gestures of the point object defining the grabs for the click and drag and drop, and if any one of the gestures is made, the gesture analyzer may analyze the click or grab.

The gesture analyzer divides the usable area into a plurality of sub availability areas based on the X axis and the Y axis, and two point objects recognized as the point object are located in the same unit Z axis area within the sub availability area. When entering, it is desirable to analyze the grab for drag and drop.

The gesture analyzer may move the grabbed object when two point objects recognized as the point objects move from the sub availability area to another sub availability area, and the two point objects may be moved to the other sub availability area. In the case where it is located in different unit Z-axis regions, it is preferable to analyze that the grab is released.

Also, the gesture analyzer may not recognize a gesture of the pointy object outside the available area as an input.

In addition, the gesture analyzer recognizes a plurality of available areas, each of which is a vertex of the eyes of a plurality of users, it is preferable to analyze all of the pointy objects moving in each of the available areas as input without distinguishing the user.

The gesture analyzer may recognize a user's finger and an object as a pointy object, but the object may be recognized as a pointy object when the length of the object is longer than three times longer than the width and the length of the object is 5 cm or more. Do.

In addition, the end point of the pointy object may be recognized as a point located at the highest point in the Y axis direction and at the lowest point in the Z axis direction in the available area.

The end point of the pointy object is preferably calculated by giving a weight of 15% to 25% to the Y-axis position data of the pointy object located in the available area.

The gesture analyzer may further include a left edge portion of the screen, a right edge portion of the screen, and an upper edge or lower edge portion of the screen corresponding to a length of 10% to 20% of the length of the X axis of the screen. It is preferable to assign each of the edge recognition regions to any one of them.

In addition, the gesture analyzer analyzes the right object when the pointy object enters from the left outside of the screen and sequentially passes through the left edge recognition area and the right edge recognition area, and the point object is from the right outside of the screen. For example, when the right edge recognition region and the left edge recognition region pass sequentially, it is preferable to analyze the left movement.

In addition, the gesture analyzer may analyze the pointy object as moving downward when the pointy object enters from the outside of the screen and passes through the bottom edge recognition area, and the pointy object enters from the bottom outside of the screen to analyze the upper edge recognition area. If it passes, it is preferable to analyze by upward movement.

According to the far screen touch apparatus using the three-dimensional position information of the point object and the eye according to the present invention as described above, the click is recognized based on the Z-axis movement, which is very unlikely to be meaningless. To be entered as a command.

Therefore, the point object can be accurately distinguished from the actual command input in the three-dimensional space and other meaningless movements, thereby preventing malfunction.

In addition, it can be used as a low-resolution pointing device, and it is possible to define and provide various commands than before, and at the same time, it is possible to accurately distinguish meaningless motion from actual commands as described above. Allows you to enter a command.

1 illustrates an example in which a far screen touch device using a pointy object and three-dimensional position information of an eye according to the present invention is applied.
2 is a block diagram illustrating a far screen touch device using three-dimensional position information of a pointy object and an eye according to the present invention.
3 is a diagram illustrating an X-axis and a Y-axis of a long-screen touch device using three-dimensional position information of a pointy object and an eye according to the present invention.
4 is a diagram illustrating an available area of a remote screen touch device using the pointy object and the 3D position information of the eye according to the present invention.
5 is a diagram illustrating a coordinate setting method of a far screen touch device using three-point location information of a pointy object and an eye according to the present invention.
6 is a diagram illustrating a click method of a remote screen touch device using three-point location information of a pointy object and an eye according to the present invention.
FIG. 7 defines commands recognizable in a far screen touch device using a pointy object and three-dimensional position information of an eye according to the present invention.
FIG. 8 is a diagram illustrating a sub-available area for drag and drop of a long screen touch device using a pointy object and three-dimensional position information of an eye according to the present invention.
FIG. 9 is a diagram illustrating a command input method using an edge recognition area of a far screen touch device using a pointy object and three-dimensional position information of an eye according to the present invention.

Hereinafter, a remote screen touch device using the pointy object and the 3D position information of the eye according to an exemplary embodiment of the present invention will be described in detail.

In the present invention, a pointy object means a pointed object including a user's finger, and the present invention is illustrated by illustrating a user's finger for convenience of description, but is not limited thereto.

In the following description, a user command in a three-dimensional space is input using a computer and an image acquisition apparatus installed in the computer. However, the present invention is not limited thereto, and it will be apparent that the present invention can be applied to various terminal devices such as a smart phone as long as it has an image acquisition device and a computing function.

First, as shown in FIG. 1 as an example, as a configuration to which the present invention can be applied, a monitor 110 that provides a screen 111 so that a screen is displayed, and is attached to or adjacent to an edge portion of the monitor 110. Computer body 140 having the installed image acquisition device (120, 130) and the remote screen touch device using the three-dimensional position information of the eye and the point object of the present invention.

The monitor 110 provides a screen 111 of the present invention, which will be described below. Here, the monitor 110 is taken as an example because the present invention is applied to a computer system. It includes a display device of a smart phone (not shown), a white board for projecting an image (or a white screen), a home or business television, and various other image display devices.

Although only one image acquisition device (120, 130) can implement the present invention, as shown, two or more may be provided with a plurality of three or more, if provided with a plurality of user movements By simultaneously capturing and providing each image, it is possible to analyze three-dimensional space touch commands more precisely.

For example, when the image acquisition apparatuses 120 and 130 are provided with a time of flight (TOF) camera 121 and a web cam 130 of Kinect 120, which are motion sensing input devices for the XBOX video game console of MS ™, respectively, The TOF camera 121 may provide a resolution of 640 × 480, and the RGB cam of the web cam 130 may provide a 1280 × 720 high resolution. Therefore, using both of them enables more accurate image acquisition.

The computer main body 140 is equipped with a remote screen touch device using the three-dimensional position information of the eye and the point object of the present invention therein.

As shown in FIG. 2, the far screen touch device using the pointy object and three-dimensional position information of the eye of the present invention uses the I / O interface 141a to capture an image captured by the image acquisition apparatuses 120 and 130. The image processing unit 141 receives and receives a signal and a coordinate calculation unit 142 calculates a current position of a user's eyes and a pointy object from the signal processed image as 3D coordinates, respectively.

In addition, the gesture analyzer 143 analyzes the user's gestures by analyzing the coordinates of the screen 111 located on the extension line of the eye and the point object in real time, the setting memory 144 that stores various setting information, and the analysis. And a controller 145 for converting the executed gesture into a control command through a user input device (keyboard or mouse) and executing the same.

In the above description, the image processor 141, the coordinate calculator 142, the gesture analyzer 143, and the controller 145 are distinguished from each other and have a unique role. It will be apparent that with development all treatments in either of these configurations are possible.

Meanwhile, according to the present invention having the above-described configuration, after setting the available area 111a as shown in FIGS. 3 and 4, the movement of the pointy object (that is, the gesture) performed in the set available area 111a is performed. ) Is obtained by the image acquisition apparatuses 120 and 130, the coordinates are calculated by the coordinate calculator 142, and the motions of which the coordinates are converted are analyzed for each action defined by the gesture analyzer 143.

To this end, the usable area 111a is defined as a quadrangular pyramid-shaped area having the screen 111 as the base and a vertex of the user's eye e spaced apart from the screen 111 in the Z-axis direction. Therefore, since the vertex is also changed when the position of the user's eye e changes, the available area 111a is also changed in real time as defined.

However, when the image acquisition apparatuses 120 and 130 are spaced apart upward from the upper edge of the screen 111, the upper edge of the screen 111 and the relative position of the image acquisition apparatuses 120 and 130 or the screen 111 The absolute distance from the upper edge to the image acquisition apparatuses 120 and 130 should be input and automatically corrected based on a mismatch between the positions of the screen 111 and the image acquisition apparatuses 120 and 130.

In addition, the eye (e) can be set to either the left eye or the right eye, and the setting environment is stored in the setting memory 144 to set the available area 111a based on the set eye (e) and set the setting memory. Save to 144.

In general, it is convenient to set the right-handed to the right eye, and the left-handed to the left eye is convenient for inputting three-dimensional space commands, so the user sets an environment suitable for him.

In addition, in order to define the usable area 111a and convert the position, for example, the X-axis length of the screen 111 constituting the bottom side is defined by the number of pixels on the X-axis, and the Y-axis length of the screen 111 is A vertex defined by the number of pixels on the Y axis and having the bottom side of the screen 111 defined by the X and Y axes is defined as a unit distance (for example, 1 cm unit) using a resolution that can be distinguished through the image acquisition apparatuses 120 and 130. It is defined as the distance from the screen 111 to the eye (e) spaced in the Z-axis direction, the coordinate calculation unit 142 calculates the coordinates based on this.

However, when the user's eye (e) is not directly detected, the eye (e) is approximately tracked (or predicted) using an average position of the photographed face (F).

In addition, the gesture analyzer 143 recognizes a plurality of available areas 111a having the vertices of the eyes e of the plurality of users, respectively, but a point object moving in each of the available areas 111a does not distinguish a user. Analyze all as input without.

In other words, each user is assigned an available area (111a), even if one person moves his own pointy object within the available area (111a) assigned to others by smoothly recognizes this as a command, such as games that require cooperation or help smoothly Make it work.

At the same time, it is preferable that three usable spaces 111a can be simultaneously inputted by three users by three users. At the same time, when too many users are recognized and each of the available spaces 111a is allocated, an image signal and coordinates are allocated. And excessive resources are allocated to the signal processing for the analysis of the gesture, if too few can not play a multi-access game.

In addition, the pointy object is based on the user's finger, but if the user is holding a ballpoint pen or a bar, such objects can be recognized as a pointy object. To this end, the object is set to be recognized as a pointy object only when the vertical length is three times longer than the horizontal length and the length is 5 cm or more.

Of course, even in this case, as described above, the movement of the X-axis displacement or the Y-axis displacement of the pointy object is only performed when the screen is activated because the Z-axis displacement is larger than the X-axis displacement or the Y-axis displacement of the pointy object. To be recognized as a command.

Also, it recognizes the end point of a finger or the end point of an object among the pointy objects and recognizes it as spatial coordinates as one point, and when several pointy objects are detected, each pointy object is used for 3D space command. Recognize it as a pointy object. Of course, depending on the configuration, various applications are possible, such as using only the recognized point object as many as the set number of the recognized point objects.

Accordingly, the coordinate calculation unit 142 calculates the coordinates of the user's eye e and the coordinates of the pointy object, respectively, and an extension line extending from a line connecting these two points to the screen 111 meets the screen 111. The point is a starting point, and when the starting point where the extension line meets the screen 111 changes as the point object moves, it is continuously analyzed to recognize the movement of the point object.

As described above, there are various methods for finding the end point coordinates of the pointy object in three-dimensional space, but the following pseudo code can be used as an example.

[Doctor code]

// Pseudo Code

// within Active Region

if (isMax ((Pixel.Y * 1.2) + (-1 * Pixel.Z)))

{

      PointyObject_Point = Pixel;

}

// ---------------------------------

That is, as shown in FIG. 5, the end point of the user's finger used as the point object in the usable area 110a is Y-axis direction (from the bottom of the screen to the top) in comparison with other fingers (folded fingers) and the like. It is located at the highest point with respect to, and at the lowest point with respect to the Z-axis direction (direction from the screen to the eye).

This is because when the end point of the finger used as the point object is positioned to face the screen 111 when the 3D command is input, the above two conditions are naturally satisfied due to the structure of the finger.

However, it is not possible to completely exclude the case where the end point of the finger is in a position that does not satisfy both of the above conditions, and this situation is in the Y-axis direction than when the end point of the finger is not at the lowest point in the Z-axis direction. There are fewer cases where there is no top point.

Therefore, in the case of giving a weight of 15% to 25% to the Y-axis position data, and an example of giving a weight of 20% as an example, the operation process is applied by applying '(Pixel.Y * 1.2)' to the pseudo code as described above. The coordinates of the fingertips are reduced and more reliably analyzed, and the coordinates analyzed in this way also determine clicks, grabs, and releases.

On the other hand, in the far-screen touch device using the three-point position information of the eye and the pointy object of the present invention having the configuration as described above, the gesture analysis unit 143 is the Z-axis displacement or Y-axis displacement of the pointy object If it is larger than the axial displacement, the screen 111 is clicked in the three-dimensional space, and the current screen is selected and activated.

For example, when a finger is moved as shown in Fig. 6A, the X-axis movement shown by the solid line has the X-axis displacement shown by the dotted line, and the Y-axis movement shown by the solid line is Y indicated by the dotted line. It has an axial displacement, where the Z-axis displacement is small in either case compared to the X-axis displacement or the Y-axis displacement.

In this case, the command is ignored without being input by simply analyzing meaningless movements instead of clicking and activating the screen 111 with a finger to remotely input a 3D space command. This is because, in a real or unconscious state, the possibility of moving the finger left and right is very high, but the possibility of moving the finger toward the screen 111 is very small.

Therefore, the present invention recognizes the click on the basis of Z-axis movement, which is very unlikely to have meaningless movement, and then receives the X-axis and Y-axis movements as commands, and thus, the actual commands and other meaningless movements input in three-dimensional space. Can be correctly distinguished to prevent malfunction.

On the other hand, when the Z-axis displacement is larger than the X-axis displacement or the Y-axis displacement as shown in (b) of FIG. 6, it is recognized as being clicked (or triggered), and the X-axis of the next input point object according to the setting environment And / or receive Y-axis movement as a command, or receive X-axis and / or Y-axis movement of the input point object within a predetermined time.

Furthermore, if the screen 111 is analyzed as being clicked only when it is moved by the Z-axis displacement and then returned to the Z-axis direction as described above, the click and the meaningless movement may be more surely distinguished.

However, the depth sensor of the Kinect 120 mentioned as an example of the image acquisition apparatuses 120 and 130 operates at 11 bits, and the Z-axis resolution is about 1 cm, so in this case, at least 1.5 in consideration of some error. The criterion may be changed according to the performance of the image acquisition apparatuses 120 and 130, such as a recognition only by clicking when there is a Z-axis displacement of more than Cm.

Next, as shown in FIG. 7, the present invention defines a plurality of gestures of a pointy object for a click and a gesture of a pointy object for a grap used during drag and drop. If any one of the gestures is detected by the gesture analyzer 143 as a click or grab.

For example, as shown in 'C1' of FIG. 7 corresponding to the click group, the finger is retracted to move away from the screen 111 and then moved forward again again, or the finger is moved back to move away from the screen 111 as 'C2'. If you move forward small again afterwards, or move forward largely in that state without retreating your finger like 'C3', or do a slight damping motion after your finger retreats like 'C4'. Any one of them is recognized as a click without any discrimination between them.

In addition, as shown by 'g1' of FIG. 7 corresponding to the grab group, the finger is slightly retracted away from the screen 111, and then moved forward again greatly (the displacement is different from 'C1'), or as in 'g2'. Grab the finger without any discrimination, as long as the finger is retracted slightly and then forward again slightly, or if the finger is moved forward, such as 'g3', and the state is maintained (ie, stopped) for a set time. To be recognized.

In addition, as shown in 'r1' of FIG. 7, the release is defined as holding the finger slightly from the front to the rear and holding the state for a while. A release is conveniently defined as one unified operation so that it can perform the same release operation under any conditions.

However, a time duration for the above operation may be set to about 500 ms in case of a click operation and about 300 ms in grab and release, but may be overridden in the future if necessary. In addition, it may be desirable to be able to redefine the amount of displacement of the finger backwards and forwards through the test.

Next, the grab operation of the present invention can be performed with one finger (or object), which is a point object, as described above, but with two fingers such as using a thumb and index finger, or a point of object You can also mix objects with your fingers.

To this end, the present invention divides the usable area 111a into a plurality of sub availability areas 111b based on the X-axis and the Y-axis, as shown in FIG. 8, and two point objects are located within the sub-availability area 111b. In the same unit Z-axis area, the gesture analysis unit 143 analyzes the grab for drag and drop.

In addition, since an icon or the like displayed on the screen 111 should be able to be moved to another position after grabbing, the gesture analyzer 143 may indicate that two pointy objects are different in one sub-available region 111b. Moving to the sub-available region 111b moves the grabbed object in synchronization with it.

Also, by grabbing and moving an icon or the like, two pointy objects move to the other sub-available region 111b, and in this state, the two pointy objects move away from each other and are located in different unit Z-axis regions. In this case, the drag and drop ends by analyzing the grab released.

However, the present invention recognizes the grab points as long as the two point objects are located in the same sub-availability region 111b. Therefore, the two point objects may be separated from each other, and the two point objects may be separated from each other. A touch will also be recognized as a grab, for example if you draw a round circle with the thumb and index fingertips touching each other.

As described above, the present invention enables to receive a three-dimensional space command for various types of clicks and grabs or releases, and prevents misoperation by precisely distinguishing the user's meaningless movement from the actual command, and is convenient for the user. Provide an environment.

However, in addition to the above commands, it should be able to receive three-dimensional spatial commands that are simple but essential for executing various contents such as video players, voice players, digital books, and presentations. It should be able to distinguish precisely.

To this end, the gesture analyzer 143 of the present invention may include a region corresponding to the length of 10% to 20% of the length of the X-axis of the screen 111 and the left edge portion of the screen 111 and the screen 111. Each of the right edge portion and the lower edge of the screen 111 is allocated as an edge recognition area. Although not shown, the upper edge of the screen 111 may be allocated as an edge recognition area in the same manner as the lower edge of the screen 111.

For example, as shown in FIG. 9A, an area corresponding to 15% of the length of the X-axis length (that is, the horizontal length) of the screen 111 is disposed at the left edge, the right edge, the upper edge, and the lower edge. It allocates and uses it as a left edge recognition area, a right edge recognition area, an upper edge recognition area, and a lower edge recognition area, respectively.

Therefore, as illustrated in FIG. 9B, when the pointy object passes through the left edge recognition area and the right edge recognition area sequentially after entering from the left outside of the screen 111, the gesture analyzer 143 moves to the right. The controller 145 executes a command corresponding thereto.

The execution command would be to move the video frame backward if the video player is currently running and the play button is clicked, or to the next page if it is an e-book.

On the contrary, if the pointy object enters from the right outside of the screen 111 and passes through the right edge recognition region and the left edge recognition region in sequence, the gesture analyzer 143 analyzes the left movement and the controller 145 corresponds to the left edge recognition region. Run the command.

In addition, similarly to the above, the gesture analyzer 143 analyzes the downward movement when the pointy object enters from the outside of the upper side of the screen 111 and passes through the lower edge recognition area, and the controller 145 executes a corresponding command. do.

In contrast, the gesture analyzer 143 analyzes the upper object when the pointy object enters from the lower outside of the screen 111 and passes through the upper edge recognition area, and the controller 145 executes a corresponding command.

If the music player is running and the sound button is clicked in the same manner as in FIG. 9 (c) or the like, the volume up / down movement command will be increased or decreased. Of course, if the sound button is inactive because it is not clicked, it may be to select a song of the upper list or a song of the lower list.

As described above, the present invention processes the gesture of the pointy object analyzed by the gesture analyzer 143 as a three-dimensional space command, and the controller 145 uses the user input through the keyboard 146 or the mouse 147. The screen to be recognized and displayed on the screen 111 (that is, execution of various contents) is controlled by mapping 1: 1.

The specific embodiments of the present invention have been described above. It is to be understood, however, that the scope and spirit of the present invention is not limited to these specific embodiments, and that various modifications and changes may be made without departing from the spirit of the present invention. If you have, you will understand.

Therefore, it should be understood that the above-described embodiments are provided so that those skilled in the art can fully understand the scope of the present invention. Therefore, it should be understood that the embodiments are to be considered in all respects as illustrative and not restrictive, The invention is only defined by the scope of the claims.

110: monitor 111: screen
111a: Availability Zone 111b: Sub Availability Zone
120, 130: image acquisition device 140: computer main body
141: image processor 141a: I / O interface
142: coordinate calculation unit 143: gesture analysis unit
144: setting memory 145: control unit
146: keyboard 147: mouse

Claims (14)

In providing a three-dimensional touch input of the user's gesture that is performed in an available area having the vertex of the user's eye spaced apart from the screen in the Z-axis direction and the Y-axis of the screen,
An image processing unit which receives and processes an image of a user captured by an image acquisition device installed on the screen;
A coordinate calculation unit configured to calculate a current position of a user's eye and a pointy object's end in three-dimensional coordinates from the signal-processed user's image;
A gesture analyzer configured to analyze a user's gesture by analyzing coordinates of a screen located on an extension line of a connection line having two points of the user's eyes and the point of the point object, the coordinates of which are calculated; And
And a controller for converting and executing the analyzed gesture into a control command through a user input device.
If the Z-axis displacement of the pointy object is greater than the X-axis displacement or the Y-axis displacement, the gesture analysis unit analyzes that the current screen is selected and activated by clicking the screen in three-dimensional space, and the X-axis displacement or the Y-axis displacement Analyze as many movement commands as
The gesture analysis unit recognizes a user's finger and an object as a pointy object, and the object is recognized as a pointy object when the length of the object is longer than three times longer than the width and the length of the object is 5 cm or more.
An end point of the pointy object is determined by finding a point that is the highest point in the Y-axis direction and the lowest point in the Z-axis direction in the available area of the entire pointy object.
An end point of the pointy object is calculated by giving a weight of 15% to 25% to the Y-axis position data among the Y-axis position data and the Z-axis position data of the entire pointy object located in the available area. Far screen touch device using a three-point location information of the eye and the point object. The method of claim 1,
And the gesture analyzer analyzes that the screen is clicked upon returning back to the Z-axis direction by the Z-axis displacement. 3. The method of claim 1,
The gesture analyzer analyzes that the grab for drag and drop is selected when the Z-axis displacement of the pointy object moves to be greater than the X-axis displacement or the Y-axis displacement, and then stops for a predetermined time. Remote screen touch device using three-dimensional location information of objects and eyes. The method of claim 1,
The point object has a plurality of gestures for the click, the gesture analysis unit recognizes as a click when any one of the gestures,
There are a plurality of gestures of the pointy object defining a grab for drag and drop, and the gesture analyzer recognizes the grab when one of the gestures is made. Remote screen touch device using information. The method of claim 1,
The bottom side (ie, screen) of the usable area consists of a plurality of sub-available areas where the bottom side of the available area is divided into a plurality of zones,
When the gesture analyzer enters a unit Z-axis region (in which the unit Z-axis region means a predetermined section in the Z-axis direction having a set unit length), both of the two pointy objects recognized as the pointy objects are dragged and dropped. Far screen touch device using the three-dimensional position information of the eye and the pointy object, characterized in that the grab for drop analysis. The method of claim 5,
The gesture analyzer may move the grabbed object when two point objects recognized as the point objects move from the sub available area to another sub available area, and one of the two point objects is the unit Z axis. A far-point touch device using three-dimensional position information of a pointy object and an eye, characterized in that the grab is released when released from the area. The method of claim 1,
And the gesture analyzer does not recognize the gesture of the pointy object outside the available area as an input. 3. The method of claim 1,
The gesture analyzer recognizes a plurality of available areas each of which the eyes of the plurality of users are as vertices, and the point object moving in each of the available areas is analyzed as input without distinguishing the user. And remote screen touch device using 3D location information of eyes. delete delete delete The method of claim 1,
The gesture analyzer assigns an area corresponding to a length of 10% to 20% of the length of the X axis of the screen as an edge recognition area to the left edge of the screen, and 10% to 20% of the length of the X axis of the screen. An area corresponding to the length of% is assigned to the right edge portion of the screen as an edge recognition area, and an area corresponding to the length of 10% to 20% of the length of the X axis of the screen is the upper edge or the lower edge of the screen. A far screen touch device using three-dimensional position information of a pointy object and an eye, wherein an edge recognition area is assigned to one of the parts. The method of claim 12,
The gesture analyzer may analyze the movement of the pointy object when the pointy object enters from the outside of the left side of the screen and sequentially passes through the left edge recognition area and the right edge recognition area. And a three-dimensional position information of a pointy object and an eye, wherein the pointy object is analyzed by moving leftward when the right edge recognition area and the left edge recognition area are sequentially passed from the right outside. The method of claim 12,
The gesture analyzer may analyze the pointy object as a lower movement of the pointy object when the pointy object enters from the outside of the screen and passes through the lower edge recognition area, and the pointy object may enter from the bottom outside of the screen. And a three-dimensional position information of the eye and the eye of the eye, characterized in that the analysis is performed by moving upward of the pointy object when passing through the recognition region.

Images