TW201508545A - Gesture recognition method and interacting system - Google Patents

Abstract

A gesture recognition method and an interacting system are disclosed. The interacting system comprises a display, an image capturing device, and a data processing device. The image capturing device captures user images. The data processing device analyzes the user images to find out three dimensional space hand locations, and analyzes a hand track according to the three dimensional space hand locations. The data processing device determines whether the hand track conforms to a polygon track, and the hand track's continuous time is longer than a time threshold. The display is unlocked when the hand track conforms to a polygon track, and the hand track's continuous time is longer than a time threshold.

Description

Gesture recognition method and interactive system

The invention relates to an identification method, and in particular to a gesture recognition method and an interactive system.

When operating on computer systems, computers/video games, information appliances, etc., users need to use the human-machine interface to issue commands to computer systems, computer/video games, information appliances, etc., and obtain computer systems through human-machine interfaces. The results of executions of products such as computers/video games and information appliances. With the advancement of technology, the communication modes between users and computer systems, computer/video games, and information appliances have become more diverse. In other words, the user information that the human-machine interface can receive is no longer limited to commands generated by the keyboard or mouse.

Regardless of the mouse, keyboard, touch panel or remote control, the control of electronic products always emphasizes the convenience and functionality of use. In recent years, due to the improvement of the image detection type human-machine interface technology, the non-contact gesture control interface has arisen, but no matter how the technology evolves, the human-centered product design concept remains unchanged. In other words, whether the gesture manipulation interface is intuitive or convenient will affect the consumers' important factors in accepting the product.

The invention relates to a gesture recognition method and an interactive system.

According to the present invention, a gesture recognition method is proposed. Gesture recognition The method comprises: capturing user images; analyzing to find the position of the hand in the three-dimensional space; analyzing the hand trajectory according to the position of the hand in the three-dimensional space; determining whether the hand trajectory conforms to the polygonal trajectory and continuing the threshold value for a time; The trajectory conforms to the polygon trajectory and continues over the time threshold to unlock the display.

According to the invention, an interactive system is proposed. Interactive system including display Display, image capture device and data processing device. The image capture device captures the user image. The data processing device analyzes the user image to find the position of the hand in the three-dimensional space, and analyzes the hand trajectory according to the position of the hand in the three-dimensional space. The data processing device determines whether the hand trajectory conforms to the polygon trajectory and continues for a time threshold. The display is unlocked when the hand trajectory conforms to the polygonal trajectory and continues over the time threshold.

In order to better understand the above and other aspects of the present invention, the preferred embodiments are described below, and in conjunction with the drawings, the detailed description is as follows:

1‧‧‧Interactive system

3‧‧‧Users

11‧‧‧ Display

12‧‧‧Image capture device

13‧‧‧Data processing device

21~25, 231~236‧‧‧ steps

31‧‧‧3D space hand position

111‧‧‧User graphical interface

111a‧‧‧Mouse cursor

111b‧‧‧ graphics

112‧‧‧First user graphical interface

113‧‧‧Second user graphical interface

P1‧‧‧ first position

P2‧‧‧ second position

P3‧‧‧ third position

V1‧‧‧first vector

V2‧‧‧Second Vector

Θ‧‧‧ angle

Figure 1 is a schematic diagram showing an interactive system in accordance with a first embodiment.

FIG. 2 is a flow chart showing a gesture recognition method according to the first embodiment.

Figure 3 is a partial schematic view of a hand trajectory.

Figure 4 is a flow chart showing the details of step 23.

Figure 5 is a first schematic diagram showing the display before and after unlocking.

Figure 6 is a second schematic diagram showing the display before and after unlocking.

Figure 7 is a third schematic diagram showing the display before and after unlocking.

Figure 8 is a fourth schematic diagram showing the display before and after unlocking.

First embodiment

Please refer to FIG. 1 and FIG. 2 simultaneously. FIG. 1 is a schematic diagram showing an interactive system according to the first embodiment, and FIG. 2 is a flow chart showing a gesture recognition method according to the first embodiment. The interactive system 1 includes a display 11, an image capturing device 12, and a data processing device 13, and the data processing device 13 is, for example, a computer. The gesture recognition method is applicable to the interactive system 1 and includes steps 21 to 25. As shown in step 21, the image capturing device 12 continuously captures a plurality of user images for a period of time. Next, as shown in step 22, the data processing device 13 analyzes the user image to find the three-dimensional space hand position 31 of the user 3. Following the step 23, the data processing device 13 analyzes one of the hand trajectories of the user 3 based on the three-dimensional hand position 31. Then, as shown in step 24, the data processing device 13 determines whether the hand trajectory conforms to the polygon trajectory and continues for a time threshold. Next, as shown in step 25, the display 11 is unlocked when the hand trajectory conforms to the polygonal trajectory and continues over the time threshold. After the display 11 is unlocked, the user can further gain control of the interactive system 1.

Since the data processing device 13 is based on the three-dimensional space hand position 31 To analyze the hand trajectory of the user 3, rather than the two-dimensional space hand position. Therefore, the interactive system 1 can avoid false triggering caused by other similar parts or unintended actions. In addition, the polygon trajectory is not only simple, intuitive and easy for the user, but also has a high recognition accuracy and a low false positive rate. Moreover, the polygon track is easily separated from other dynamic objects, is not easily triggered by people or noises moving back and forth, and can effectively shorten the action time of the user to activate the interactive system 1. Moreover, the data processing device 13 further regards the duration of the hand trajectory as a restriction condition, so that the user 3 can be filtered to cause false triggering due to unintentional rapid movement.

Please refer to Figure 1, Figure 3 and Figure 4 at the same time. Figure 3 shows a system A partial schematic diagram of the hand trajectory, and FIG. 4 is a detailed flow chart of the step 23. For convenience of explanation, the three-dimensional hand portion is illustrated in the first position P1, the second position P2, and the third position P3 in FIG. The aforementioned step 23 further includes steps 231 to 236. As shown in step 231, the data processing device 13 calculates the first vector V1 and the second vector V2 based on the first position P1, the second position P2, and the third position P3 of the three-dimensional hand position. Next, as shown in step 232, the data processing device 13 calculates an angle θ between the first vector V1 and the second vector V2.

Next, as shown in step 233, the data processing device 13 determines the angle θ Whether it is greater than the first angle threshold T1 and less than the second angle threshold T2. The first angle threshold T1 and the second angle threshold T2 are greater than 0 degrees and less than 180 degrees. For example, the first angle threshold T1 is 1 degree and the second angle threshold T2 is 179 degrees. When the first angle threshold T1 < the angle θ < the second angle threshold T2, step 234 is performed. As step 234 As shown, the data processing device 13 increments by one count.

Conversely, when the angle θ is not between the first angle threshold T1 and the second angle Between the thresholds T2, step 235 is performed. As shown in step 235, the data processing device 13 determines whether the included angle θ is greater than the third angle threshold T3 and less than the fourth angle threshold T4. When the third angle threshold T3 < angle θ < fourth angle threshold T4, step 236 is performed. The third angle threshold T3 and the fourth angle threshold T4 are greater than 180 degrees and less than 360 degrees. For example, the third angle threshold T3 is 181 degrees and the fourth angle threshold T4 is 359 degrees. As shown in step 236, the data processing device 13 decrements the count. Conversely, when the angle θ is not between the third angle threshold T3 and the fourth angle threshold T4, the detailed flow of step 23 is ended.

By analogy, the data processing device 13 is based on the subsequent three-dimensional space hand The position of the part can be correspondingly incremented or decremented. When the count amount is greater than an upper limit value, the data processing device 13 determines that the hand trajectory is a clockwise trajectory. In contrast, when the count amount is less than the lower limit value, the data processing device 13 determines that the hand trajectory is a counterclockwise trajectory.

Please refer to Figure 5, which is shown in Figure 5 before and after unlocking the display. The first schematic. The user graphical interface 111 is not displayed until the display 11 is unlocked. When the display 11 is unlocked via the aforementioned gesture recognition method, the user graphical interface 111 is displayed. Please refer to FIG. 6 , which illustrates a second schematic diagram of the display before and after unlocking. The user graphical interface 111 is not displayed until the display 11 is unlocked. After the display 11 is unlocked by the gesture recognition method, the user graphic interface 111 is displayed, and the user graphic interface 111 may further include a mouse cursor. 111a. Please refer to FIG. 7 , which illustrates a third schematic diagram of the display before and after unlocking. The user graphical interface 111 is not displayed until the display 11 is unlocked. After the display 11 is unlocked by the gesture recognition method, the user graphic interface 111 is displayed, and the graphic interface 111b may be further included in the user graphic interface 111.

Second embodiment

Please refer to FIG. 8. FIG. 8 is a fourth schematic diagram showing the display before and after unlocking. The second embodiment is mainly different from the first embodiment. The display 11 of the second embodiment displays the first user graphic interface 112 before unlocking, and displays the second user graphic interface 113 after unlocking. The first user graphical interface 112 is different from the second user graphical interface 113.

The gesture recognition method and interactive system described in the above embodiments can avoid false triggering of the interactive system by the three-dimensional hand position. In addition, recognizing the unlocking gesture by the polygon trajectory not only helps to improve the user's operation convenience, but also improves the recognition accuracy and reduces the false positive rate. Furthermore, by using the duration of the hand trajectory as a constraint, the user can be further filtered to cause false triggering due to unintentional rapid action.

In conclusion, the present invention has been disclosed in the above preferred embodiments, and is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

21~25‧‧‧Steps

Claims (18)

A gesture recognition method includes: capturing a plurality of user images; analyzing the user images to find a plurality of three-dimensional space hand positions; analyzing a hand trajectory according to the three-dimensional space hand positions; determining the hand trajectory Whether a polygon trajectory is met and continues for a time threshold; and a display is unlocked when the hand trajectory conforms to the polygon trajectory and continues for the time threshold. The gesture recognition method of claim 1, wherein the step of analyzing the hand trajectory comprises: calculating a first position, a second position, and a third position according to one of the three-dimensional space hand positions a vector and a second vector; calculating an angle between the first vector and the second vector; determining whether the angle is greater than a first angle threshold and less than a second angle threshold; when the angle is greater than the first angle The threshold is less than the second angle threshold, incrementing a count; determining whether the angle is greater than a third angle threshold and less than a fourth angle threshold; and when the angle is greater than the third angle threshold and less than the threshold The fourth angle threshold is decremented by the count. The gesture recognition method of claim 2, wherein in the judging step of the hand trajectory, when the count amount is greater than an upper limit value, the hand trajectory is determined to be a clockwise trajectory. The gesture recognition method according to claim 2, wherein in the judging step of the hand trajectory, when the count amount is less than a lower limit value, the hand trajectory is determined to be a counterclockwise trajectory. The gesture recognition method of claim 2, wherein the first angle threshold and the second angle threshold are greater than 0 degrees and less than 180 degrees, and the third angle threshold and the fourth angle threshold are greater than 180 degrees and less than 360 degrees. The gesture recognition method of claim 1, wherein the display does not display a user graphical interface before unlocking, and the display displays the user graphical interface after unlocking. The gesture recognition method of claim 6, wherein the user graphical interface comprises a mouse cursor. The gesture recognition method of claim 6, wherein the user graphical interface comprises a graphic. The gesture recognition method of claim 1, wherein the display displays a first user graphical interface before the display is unlocked, and after the display is unlocked, the display displays a second user graphical interface, the first The two user graphical interface is different from the first user graphical interface. An interactive system comprising: a display; An image capturing device for capturing a plurality of user images; and a data processing device for analyzing the user images to find a plurality of three-dimensional space hand positions, and according to the three-dimensional space hand positions A hand trajectory is analyzed, and the data processing device determines whether the hand trajectory conforms to a polygon trajectory and continues for a time threshold. When the hand trajectory conforms to the polygon trajectory and continues for the time threshold, the display is unlocked. The interactive system of claim 10, wherein the data processing device calculates a first vector and a second according to the first position, the second position, and the third position of the three-dimensional hand position a vector, and calculating an angle between the first vector and the second vector, the data processing device determining whether the angle is greater than a first angle threshold and less than a second angle threshold, and when the angle is greater than the first angle The threshold value is less than the second angle threshold value, and is incremented by a count amount, and the data processing device determines whether the angle is greater than a third angle threshold and less than a fourth angle threshold, and when the angle is greater than the third angle valve The value is less than the fourth angle threshold, and the count is decremented. The interactive system of claim 11, wherein when the count is greater than an upper limit, the data processing device determines that the hand trajectory is a clockwise trajectory. The interactive system of claim 11, wherein in the determining step of the hand track, when the counting amount is less than a lower limit, the data processing device determines that the hand track is a counterclockwise turning track. Such as the interactive system described in claim 11 of the patent scope, wherein the first corner The threshold value and the second angle threshold are greater than 0 degrees and less than 180 degrees, and the third angle threshold and the fourth angle threshold are greater than 180 degrees and less than 360 degrees. The interactive system of claim 10, wherein the display does not display a user graphical interface before unlocking, and the display displays the graphical interface of the user after unlocking. The interactive system of claim 15, wherein the user graphical interface comprises a mouse cursor. The interactive system of claim 15, wherein the user graphical interface comprises a graphic. The interactive system of claim 10, wherein the display displays a first user graphical interface before the display is unlocked, and after the display is unlocked, the display displays a second user graphical interface, the second The user graphical interface is different from the first user graphical interface.