TW201504929A - Electronic apparatus and gesture control method thereof - Google Patents

Abstract

An electronic device and a gesture control method thereof are provided. The method is adapted to the electronic device having a touch display and the gesture control method includes following steps. First, a first touch and a second touch performed on the touch display are detected. According to the surface areas of the first touch and the second touch, the first touch and the second touch are differentiated between a touch area performed on the touch display by a palm and a touch point performed on the touch display by a touch input apparatus. Whether a corresponding position relationship of the touch area and the touch point on the touch display is match to a gesture of palm holding the touch input apparatus is determined. When it is match to the gesture, a function is executed.

Description

Electronic device and gesture control method thereof

The present invention relates to an electronic device and a gesture control method thereof, and more particularly to a gesture control method for operating an electronic device using a touch input device and an electronic device thereof.

In order to cope with the busy life rhythm of modern people, a variety of consumer electronic devices that do not occupy space and are convenient to carry are also innovated. Taking personal digital assistants, personal digital assistant mobile phones, and smart phones as examples, it not only has the functions of traditional communication devices, but also enables users to write documents and send and receive through their built-in operating systems. E-mail, browse the web or do instant messaging.

Due to the increasing dependence of humans on consumer electronic devices, many products have been converted from traditional keyboards or mice to using touch screens as input devices for the convenience, volume, and humanization. Because the touch screen can provide visual feedback directly, most of them can make the user feel more convenient when operating. As far as the touch input interface is concerned, most of the current users use the contact or sensing behavior generated between the finger or the stylus and the touch screen to operate, so that the electronic device can utilize the coordinates of the touch point to change or touch. Increase or decrease the number of touch points, The user's touch gesture is defined, and the corresponding operation function is further performed according to the touch gesture.

In other words, in order to allow the user to more intuitively utilize various touch gestures to manipulate the electronic device, after the electronic device finds the plurality of touch points, the electronic device determines, according to the change of the touch points, which touch gesture is the touch gesture. In order to open the corresponding operational functions accordingly. For example, touch gestures derived from multi-touch technology can intuitively turn on various operational functions, thus giving users a more intuitive and convenient operating experience. In order to provide a more intuitive and convenient way to help the user operate the electronic device with various touch gestures, how to analyze the user's touch gestures to enable the electronic device to perform the corresponding functions is an important issue.

In view of the above, the present invention provides an electronic device and a gesture control method thereof, which can determine a gesture of a user holding a touch input device to improve the convenience of the touch operation.

The present invention provides a gesture control method suitable for an electronic device having a touch screen, and the gesture control method includes the following steps. First, the first touch and the second touch applied to the touch screen are detected. Distinguishing the first touch and the second touch from the touch block on the touch screen by the palm and the touch screen on the touch screen according to the area of the first touch and the second touch Touch point. It is determined whether the relative positional relationship between the touch block and the touch point on the touch screen conforms to the gesture of holding the touch input device by the palm. When the gesture is met, a function is performed.

The invention provides an electronic device having a touch screen. The electronic device includes a touch detection module, a touch recognition module, a determination module, and a function execution module. The touch detection module detects the first touch and the second touch applied to the touch screen. The touch recognition module distinguishes the first touch and the second touch from the touch block on the touch screen by the palm and the touch input device according to the area of the first touch and the second touch Touch the touch point on the screen. The determining module determines whether the relative positional relationship between the touch block and the touch point on the touch screen conforms to the gesture of holding the touch input device by the palm. When the gesture is met, the function execution module performs the function.

Based on the above, the electronic device and the gesture control method thereof of the present invention distinguish the touch block applied by the palm on the touch screen and touched by the touch input device by the touch detected by the touch screen. Control the touch point on the screen. Then, according to the generated touch information of the touch block and the touch point, it is determined whether the user's hand is a gesture of holding a touch input device, and further activates the relative function. In this way, the variability of the user to operate the electronic device by using various gestures can be increased, so that the user can manipulate the electronic device in a more intuitive and simple manner, and the convenience of the touch electronic device is increased.

The above described features and advantages of the invention will be apparent from the following description.

100‧‧‧Electronic devices

110‧‧‧Touch detection module

130‧‧‧Touch identification module

150‧‧‧Judgement module

170‧‧‧ function execution module

180‧‧‧ touch screen

32‧‧‧Touch input device

31‧‧‧ palm

31R, 51R‧‧‧ reference point

32A, 51A‧‧‧ touching blocks

32P, 51P‧‧‧ touch contacts

Q‧‧‧Connected

S201~S204‧‧‧ steps of a gesture control method in an embodiment of the present invention

S401~S410‧‧‧ steps of a gesture control method in an embodiment of the present invention

FIG. 1A is a block diagram of an electronic device according to an embodiment of the invention.

FIG. 1B is a schematic diagram of an electronic device according to an embodiment of the invention.

2 is a flow chart of a gesture control method according to an embodiment of the invention.

FIG. 3A is an application context diagram of a gesture control method according to an embodiment of the invention.

FIG. 3B is a schematic diagram of a touch contact and a touch block according to an embodiment of the invention.

FIG. 4 is a flowchart of a gesture control method according to another embodiment of the present invention.

FIG. 5A is a schematic diagram of a gesture control method according to an embodiment of the invention.

FIG. 5B is a schematic diagram of a gesture control method according to an embodiment of the invention.

Generally, when the user touches the electronic device with the touch input device pen, the palm and the touch input device touch the touch screen, and respectively form different touch regions on the touch screen. . According to the present invention, the touch detected by the touch screen determines whether the user holds the touch input device with a normal gesture to further infer that the user is planning to use the touch input device to the electronic device. The device performs a touch operation. Thereby, the electronic device can recognize the touch operation generated by the palm and the touch input device on the touch screen, and further perform relative operations. The function should be to increase the convenience of using the electronic device. In order to clarify the content of the present invention, the following examples are given as examples in which the present invention can be implemented.

FIG. 1A is a block diagram of an electronic device according to an embodiment of the invention. FIG. 1B is a schematic diagram of an electronic device according to an embodiment of the invention. Referring to FIG. 1A and FIG. 1B , the electronic device 100 of the embodiment has, for example, a notebook computer, a tablet PC, a personal digital assistant (PDA), a smart phone, an e-book, a game machine, etc. The electronic device of the touch screen is not limited by the present invention. The electronic device 100 of the present embodiment includes a touch detection module 110, a touch recognition module 130, a determination module 150, and a function execution module 170. The modules are, for example, hardware devices composed of logic circuit components. The gesture control method of the embodiment may be executed; the modules may also be stored in a storage medium of the electronic device, and may be loaded into a processor of the electronic device to perform the gesture control method of the embodiment. Set limits.

In addition, the electronic device 100 has a touch screen 180 for receiving a touch. The touch screen is a display device with integrated touch panel, which can provide display and input functions at the same time. The display device is, for example, a liquid crystal display (LCD), a Light-Emitting Diode (LED) display, a Field Emission Display (FED), or other types of displays, and the touch panel The type is, for example, a resistive touch screen or a capacitive touch screen, and the present invention is not limited thereto.

2 is a flow chart of a gesture control method according to an embodiment of the invention. Referring to FIG. 1 and FIG. 2 simultaneously, the method of this embodiment is applicable to the above electronic The detailed process of the method of this embodiment will be described below with reference to the components of the electronic device 100 of FIG.

First, in step S201, the touch detection module 110 detects the first touch and the second touch applied to the touch screen 180. Generally, when the user uses the touch input device to control the electronic device 100, the user's hand holds the touch input device in a writing posture, and the hand is placed on or placed on the touch screen 180. In order to achieve the purpose of the touch operation electronic device 100. Therefore, when the user controls the electronic device 100 by using the touch input device, the user's palm and the touch input device touch the touch screen 180. In contrast, the touch detection module 110 detects the first touch and the second touch respectively generated by the palm and the touch input device.

In step S202, the touch recognition module 130 distinguishes the first touch and the second touch as the touch block applied by the palm to the touch screen 180 according to the areas of the first touch and the second touch. The touch point is applied to the touch point on the touch screen 180 by the touch input device. In short, since the touch formed by the touch input device forms a small area of the touch contact on the touch screen 180, the touch formed by the palm is compared with the touch formed by the touch input device. A large touch area is formed on the touch screen 180. Therefore, the touch recognition module 130 can distinguish the touch block applied by the palm on the touch screen 180 and the touch point of the touch input device on the touch screen 180 according to the touched area.

Then, in step S203, the determining module 150 determines whether the relative positional relationship between the touch block and the touch point on the touch screen conforms to the gesture of holding the touch input device by the palm. Further, the determining module 150 can be based on the touch block and the touch The touch information of the point, for example, the coordinate position and the like, further obtain the relative positional relationship between the touch block and the touch point on the touch screen 180. Then, the determining module 150 can determine whether the touch gesture of the user meets the gesture of holding the touch input device by the palm according to the relative positional relationship between the touch block and the touch point on the touch screen 180. Specifically, when the user's hand holds the touch input device in a normal writing posture, the touch input device forms a specific relative relationship between the touch point formed by the touch input device and the touch region formed by the palm. For example, since the configuration of the human hand and the posture of holding the touch input device generally have a specific rule, the distance between the touch contact and the touch area should be within a predetermined range.

Finally, in step S204, the function execution module 170 performs a function when the gesture is met. That is, when the determining module 150 determines that the user's hand is a gesture of holding the touch input device based on the touch contact and the touch block, the function execution module 170 performs a preset. Features. The preset function can be determined by the user's setting, so that the flexibility and convenience of the gesture control method of the embodiment are further increased. For example, this gesture can be used as a gesture to wake up the electronic device. When the electronic device in the standby state receives the control gesture that the user holds the stylus in a normal hand posture and is placed on the touch screen, the user intends to operate the electronic device by using the touch input device, and thus the electronic device Will be converted directly into a working state.

FIG. 3A is an application context diagram of a gesture control method according to an embodiment of the invention. FIG. 3B is a schematic diagram of a touch contact and a touch block according to an embodiment of the invention. Please refer to FIG. 3A and FIG. 3B at the same time, when the user uses touch input When the device is inserted into the device, the user's hand holds the touch input device 32, and the palm 32 is placed above the touch screen 180. As shown in FIG. 3B , the touch input device 32 is touched on the touch screen 180 as the touch contact 32P, and the touch of the palm 32 on the touch screen 180 is the touch block 32A. . As shown in FIGS. 3A and 3B, based on the rules of the human hand configuration and the writing posture, the relative positional relationship between the touch contact 32P and the touch block 32A should have a special rule. The following describes an embodiment to describe in detail how the electronic device of the present invention determines whether the user's operation gesture conforms to the gesture of holding the touch device according to the information of the touch contact and the touch block.

FIG. 4 is a flowchart of a gesture control method according to another embodiment of the present invention. Referring to FIG. 1 , FIG. 3 and FIG. 4 , the method of the present embodiment is applicable to the electronic device 100 of FIG. 1 and the application scenario shown in FIG. 3 , and the following describes the gestures in conjunction with the components in the electronic device 100 and FIG. 3 . The detailed steps of the control method are as follows: First, in step S401, the touch detection module 110 detects the first touch and the second touch applied to the touch screen 180. Specifically, the two touches formed by the user's gesture of holding the touch input device 32 are the touch contact 32P and the touch block 32A, respectively. In step 402, the touch recognition module 130 distinguishes the first touch and the second touch as the touch block applied by the palm 31 to the touch screen 180 according to the areas of the first touch and the second touch. 32A and a touch point 32P applied to the touch screen 180 by the touch input device 32. The above steps S401 to S402 are the same as or similar to the steps S201 to S202 in the foregoing embodiment, and thus the details thereof are not described herein again.

Next, in step S403, the determining module 150 further calculates the block area of the touch block 32A in detail. In step S404, the determining module 150 determines the touch. Whether the size of the block area of the block 32A matches the gesture of the palm 31 holding the touch input device 32. Due to the rules of the human hand construction, the contact area formed by the palm 31 placed on the touch screen 180 should be within a specific range. In a simple manner, the judging module 150 uses the common sense of holding the pen and the palm to touch the screen area to determine whether the touch operation received by the electronic device 100 is issued by the user by the operation gesture of holding the touch input device 32. Touch operation. If the block of the touch block 32A is not within a predetermined area, the touch block 32A is not caused by the user's palm contacting the touch screen 180. Therefore, in step S408, the determination module 150 determines that the touch block 32A does not conform to the gesture of the palm 31 holding the touch input device 32.

On the other hand, if the block of the touch block 32A is within the preset area, the representative touch block 32A should be formed by the user's palm 31 contacting the touch screen 180. It should be noted that the preset area range for judging the size of the area may be obtained by counting the average contact area of the screen in which the majority of the individual hands touch the screen, and may be adjusted according to the actual application, and the present invention does not limit this. . In the present embodiment, in addition to calculating the area of the touch block, the angular relationship between the touch contact 32P and the touch block 32A will be further calculated. Therefore, in step S405, the determination module 150 calculates the connection between the reference point 32R and the touch point 32P by using the highest point of the touch block 32A in the axial direction Y of the touch screen 180 as the reference point 32R. The angle θ between the line and the other axis direction X of the touch screen 180.

As shown in FIG. 3B, in the present embodiment, the axial direction Y is a direction parallel to one edge of the touch screen 180, and the axial direction X is a direction of the vertical axis direction Y. It should be particularly noted that although in this embodiment the two axial directions are as shown in FIG. 3A, However, it is not intended to limit the invention, and may be adjusted according to different angle calculation methods. The block edge of the touch block 32A has a highest point 32R in the axial direction Y, and an angle θ is formed between the line between the highest point 32R and the touch point 32P and the axial direction X. In step S406, the determining module 150 determines whether the included angle θ is within a predetermined range. By determining whether the included angle θ is within the preset range, it can be further known whether the touch operation of forming the touch contact 32P and the touch block 32A is a gesture operation in which the user normally holds the touch input device 32. In this way, by using the landing coordinates of the touch input device 32 and the contact information of the touch screen 180 with the palm 31, it can be determined whether the user's operation gesture is a normal handwriting posture of the handheld pen. It should be noted that the preset range for determining the angle may be obtained by counting the average value of the screen touched by the majority of the individual hand, and may be adjusted according to the actual application, which is not limited by the present invention.

Further, when the angle θ is not within the preset range, in step S409, the determining module 150 determines that the relative positional relationship between the touch block 32A and the touch point 32P on the touch screen 180 does not conform to the palm 31. The gesture of holding the touch input device 32 is held. When the angle of the angle θ is within the preset range, in step S407, the determining module 150 determines that the relative positional relationship between the touch block 32A and the touch point 32P on the touch screen 180 conforms to the grip 31 of the palm 31. The gesture of device 32. Finally, in step S410, the function execution module 170 performs a function when the gesture is met.

However, the implementation of the present invention is not limited to the above description, and the contents of the above embodiments may be changed as appropriate for actual needs. For example, in another embodiment of the present invention, the electronic device may also only pass through the analysis between the touch block and the touch contact. The angle relationship is used to determine the user's control gesture. In addition, in another embodiment of the present invention, the electronic device may first determine whether the gesture is met by the angle relationship between the touch block and the touch contact, and further whether the area of the touch block is used. Comply with gestures.

In addition, it is worth mentioning that, based on the specific common rules of the human hand structure and the writing posture, the electronic device 100 can further determine the relative relationship between the user and the electronic device 100 through the related position information of the touch contact 32P and the touch block 32A. position. Therefore, when the electronic device 100 determines that the user's control gesture is a gesture of holding the touch input device 32, the electronic device 100 may further adjust the screen according to the relevant position information of the touch contact 32P and the touch block 32A. The turn. In an embodiment of the present invention, the function activation module 170 can adjust the display direction of the screen displayed on the touch screen 180 according to the coordinate position of the touch point 32P and the coordinate position of the reference point 32R, wherein the display direction includes straight Toward and horizontal. In general, most of today's electronic devices are provided with an acceleration sensor (G-sensor) for detecting the manner in which the user holds the electronic device and adjusting the display direction of the screen. However, the acceleration sensor cannot be applied to the state in which the electronic device is placed flat, so when the electronic device is in a flat state, the electronic device cannot correctly adjust the display direction. However, according to the gesture control method of the present invention, the electronic device can know which position of the electronic device is located according to the touch information of the gesture, and adjust the display screen to the correct direction according to the touch information of the gesture. .

It should be noted that the display direction of the adjustment screen is only one embodiment of the function startup function of the function activation module 170 of the present invention. For example, users will take advantage of The touch input device controls the electronic device, usually because the user attempts to use a touch input device to operate a text input related or drawing related application. Therefore, when the user's control gesture conforms to the gesture of holding the touch device, the function activation module 170 can directly execute an application to be designed, so that the operation of the electronic device can be more convenient and fast. The following describes an implementation example in which the electronic device activates the corresponding function after the user's control gesture conforms to various conditions.

FIG. 5A is a schematic diagram of an example of a gesture control method according to an embodiment of the invention. Referring to FIG. 5A, when the user uses the touch input device to control the electronic device 100, the touch input device is applied to the touch screen 180 as a touch contact 51P, and the palm is applied to the touch screen 180. The touch is the touch block 51A, and the touch block 51A has a reference point 51R on the edge. As shown in FIG. 5A, after the related information of the touch contact 51P and the touch block 51A is determined according to various gesture conditions, the electronic device 100 adjusts the touch screen 180 according to the coordinate position of the touch point 32P and the reference point 32R. The screen display direction is displayed horizontally. For example, by using the coordinate position of the touch point 32P and the reference point 32R, a vector of the connection Q between the two points can be obtained, and the electronic device can further adjust the touch screen 180 according to the vector direction of the connection Q. The screen shows the direction. Moreover, based on the user's self-setting or the preset setting of the electronic device 100 at the time of shipment, the electronic device 100 directly launches an application related to the memo, so that the user can quickly record important matters or reminders by using the touch input device. .

On the other hand, FIG. 5B is a schematic diagram showing an example of a gesture control method according to an embodiment of the invention. Please refer to FIG. 5B, when the user uses the touch input device When the electronic device 100 is operated, the touch input device is touched on the touch screen 180 as the touch contact 51P, and the touch applied by the palm to the touch screen 180 is the touch block 51A, and the touch area Block 51A has a reference point 51R on its edge. As shown in FIG. 5B, after the related information of the touch contact 51P and the touch block 51A is determined according to various gesture conditions, the electronic device 100 adjusts the touch screen 180 according to the coordinate position of the touch point 32P and the reference point 32R. The screen display direction is straight. Then, the electronic device 100 directly launches an application for editing an email, so that the user can quickly transmit the edit of the email by using the touch input device. As described above, the control gesture of holding the touch input device can be used as a trigger condition for waking up the electronic device 100. Similarly, the control gesture of the touch input device can also be used as a trigger condition for unlocking the electronic device 100, which is not limited by the present invention.

It is worth mentioning that the implementation of a function in the gesture control method of the present invention may be performed only as a single function as described above, including transitioning from a suspended state to an active state, unlocking an electronic device or Execute preset applications, etc., or you can perform these functions sequentially or simultaneously. For example, for an electronic device in a standby state, after detecting that the user's control gesture conforms to the gesture of holding a touch input device, the electronic device first directly converts from the standby state to the working state. Then, the electronic device adjusts the display orientation of the screen according to the touch information, and simultaneously executes an application program set by the user, so that the user can manipulate the electronic device in a more convenient manner.

In summary, the electronic device and the gesture control method thereof of the present invention are applied to the touch screen by the touch panel of the touch screen and the touch input device by the palm of the hand. The touch information of the touch point determines whether the user's hand is a natural gesture for holding a touch input device, and further activates the relative function. In this way, while the acceleration sensor is inoperable, the electronic device can correctly adjust the direction of the screen according to the touch information of the palm and the touch input device. It can be seen that the gesture control method of the present invention allows the user to manipulate the electronic device in a more intuitive and simple manner, thereby improving the convenience of operating the touch-type electronic device.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

S201~S204‧‧‧Steps

Claims (10)

A gesture control method is applicable to an electronic device having a touch screen, the gesture control method comprising: detecting a first touch and a second touch applied to the touch screen; according to the first touch Touching the area of the second touch, distinguishing the first touch and the second touch from a touch block applied by the palm of the hand to the touch screen and being applied to the touch by a touch input device Controlling a touch point on the screen; determining whether a relative positional relationship between the touch block and the touch point on the touch screen conforms to a gesture of the palm holding the touch input device; and when the Perform a function when gestures. The gesture control method of claim 1, wherein determining whether the relative positional relationship between the touch block and the touch point on the touch screen conforms to the palm holding the touch input device The step of gesturing includes: using a highest point of the touch block in an axis direction of the touch screen as a reference point, calculating a connection between the reference point and the touch point and the touch screen An angle between another axial direction; when the angle is within a predetermined range, determining that the relative positional relationship between the touch block and the touch point on the touch screen is consistent with the palm grip The gesture of the touch input device; and determining that the relative positional relationship between the touch block and the touch point on the touch screen does not conform to the palm grip when the angle is not within a predetermined range. The gesture of the touch input device. The gesture control method of claim 1, further comprising: calculating a block area of the touch block, and determining whether the size of the block area meets the grip of the palm holding the touch input device gesture. The gesture control method according to claim 1, wherein the step of performing the function comprises: adjusting a screen displayed on the touch screen according to a coordinate position of the touch point and a coordinate position of a reference point; A display direction, wherein the display direction includes a straight direction and a lateral direction. The gesture control method of claim 1, wherein the function comprises converting from a suspended state to an active state, unlocking the electronic device, or executing an preset application. An electronic device comprising: a touch detection module for detecting a first touch and a second touch applied to a touch screen; a touch recognition module, according to the first touch and the The area of the second touch distinguishes the first touch and the second touch as a touch block applied by the palm of the hand to the touch screen and applied to the touch screen by a touch input device a touch point; a judging module determining whether a relative positional relationship between the touch block and the touch point on the touch screen conforms to a gesture of the palm holding the touch input device; and The function execution module performs a function when the gesture is met. The electronic device of claim 6, wherein the determining module The method further includes: using a highest point of the touch block in the direction of one axis of the touch screen as a reference point, calculating a connection between the reference point and the touch point and another one of the touch screens An angle between the axial directions, when the angle is within a predetermined range, determining that the relative positional relationship between the touch block and the touch point on the touch screen is consistent with the palm holding the touch input The gesture of the device, and when the angle is not within a predetermined range, determining that the relative positional relationship between the touch block and the touch point on the touch screen does not conform to the palm holding the touch input The gesture of the device. The electronic device of claim 6, wherein the determining module further comprises calculating a block area of the touch block, and determining whether the size of the block area conforms to the palm holding the touch input. The gesture of the device. The electronic device of claim 6, wherein the function execution module further comprises: adjusting a picture displayed on the touch screen according to a coordinate position of the touch point and a coordinate position of a reference point; The display direction, wherein the display direction includes straight direction and lateral direction. The electronic device of claim 6, wherein the function comprises converting from a suspended state to an active state, unlocking the electronic device, or executing an preset application.