TWI524262B - Control method of electronic apparatus - Google Patents

Description

Electronic device control method

The present invention relates to contactless gesture control, and more particularly to a method of controlling an electronic device based on trajectory information of at least one non-contact object in a non-contact gesture operation area of an electronic device.

The touch-type electronic device provides a convenient control mode for the user. However, when the user holds other items (for example, documents or drinks) and cannot directly touch the electronic device, or the hand is stained with dirt, it is not convenient to touch the electronic device. Controlling the electronic device by touching it may increase the inconvenience of the user. For example, when a user watches an e-book displayed on a tablet while eating French fries, the user does not want to flip through the e-book with greasy fingers.

Therefore, how to provide a user with a sense of intuition without directly touching the control method of the electronic device is an urgent problem to be solved today.

In view of the above, it is an object of the present invention to provide a method of controlling an electronic device in accordance with trajectory information of at least one non-contact object in a non-contact gesture operation area of an electronic device.

According to an embodiment of the present invention, a method of controlling an electronic device is disclosed. The electronic device has a non-contact gesture operation area, and the control method includes the steps of: identifying the object type of the at least one non-contact object located in the non-contact gesture operation area among the plurality of different object types; determining the The number of non-contact objects in each of the object types of the at least one non-contact object; detecting a trajectory information of the at least one non-contact object in the non-contact gesture operation area; according to the at least one non- Identifying the at least one non-contact object by the type of the object to which the object belongs, the number of non-contact objects of each object type among the object types to which the at least one non-contact object belongs, and the trajectory information of the at least one non-contact object Corresponding to one of the non-contact gestures; and causing the electronic device to perform a specific function according to the non-contact gesture.

According to another embodiment of the present invention, a method of controlling an electronic device is further disclosed. The electronic device has a non-contact gesture operation area, and the control method includes the steps of: identifying the number of non-contact objects of the at least one non-contact object located in the non-contact gesture operation area; detecting the at least one non- And trajectory information of the contact object in the non-contact gesture operation area; identifying the at least one non-contact according to the number of non-contact objects of the at least one non-contact object and the trajectory information of the at least one non-contact object One of the non-contact gestures corresponding to the object; and causing the electronic device to perform a specific function according to the non-contact gesture.

In summary, the control method of the electronic device provided by the present invention not only provides a non-contact human-computer interaction mode, but also satisfies the requirement of the user to perform multiple and intuitive non-contact gestures. Therefore, the non-contact control method provided by the present invention can be combined with (or substituted for) existing contact control methods (for example, operating an electronic device with a mouse or a touch panel), and applied to various operating systems (for example, a Windows operating system). Or in the Android operating system).

In order to provide an intuitive and friendly non-contact human-computer interaction mechanism, the non-contact control method provided by the present invention can not only determine the trajectory information of the non-contact object in the non-contact gesture operation area of the electronic device (for example, having an object) Position and time information), and can identify the type of the object to which the non-contact object belongs and the number of objects identified by the identified object type, and then define the corresponding non-contact gesture according to the related information of the non-contact object ( That is, a hovering gesture that is not in contact with the electronic device) to cause the electronic device to perform a corresponding function. For convenience of description, the following is a description of a multimedia playback device with detectable contactless gestures. However, the non-contact manipulation mechanism provided by the present invention is also applicable to other electronic devices that can detect contactless gestures.

Please refer to FIG. 1 , which is a schematic diagram of an embodiment of an electronic device of the present invention. The electronic device 100 is implemented by a multimedia playback device (for example, an image player) having a non-contact gesture operation area WR to detect non-contact objects located around the electronic device 100. In this embodiment, the periphery of the electronic device 100 defines a space coordinate system, and can include a display surface 102 and an optical sensing module 110. The optical sensing module 110 can be disposed on the periphery of the display surface 102 ( Or the frame of the electronic device 100) to provide a non-contact gesture operation area WR in front of the display surface 102 (facing the user). The optical sensing module 110 can obtain the position information of the reflector in the space coordinate system by using a reflection signal from the reflector (located in the non-contact gesture operation area WR), thereby identifying the depth information of the reflector. And trajectory information, in which different types of reflectors (eg, finger tips and palms) may have different depth information maps (image contours). In addition, for convenience of explanation, the normal vector direction of the display surface 102 is defined as the Z-axis direction. It will be appreciated by those skilled in the art that this is not intended to be a limitation of the invention.

The optical sensing module 110 can further have other sensing functions. For example, the optical sensing module 110 can be implemented as an integrated sensing module for image sensing, ambient light sensing (including ambient color sensing, ambient color temperature sensing), proximity sensing, and temperature sensing. Features such as measurement, object position detection, depth information and/or gesture recognition are integrated into it. Therefore, the optical sensing module 110 can detect the three-dimensional image information of the non-contact object (for example, the user's hand) located around the electronic device 100, and can output the three-dimensional image information of the non-contact object to the image processing of the back end. The system (not shown in Figure 1) is for further processing.

Please refer to FIG. 2 , which is a functional block diagram showing an implementation example of the image processing system of the electronic device 100 shown in FIG. 1 . In this implementation example, the optical sensing module 110 can include, but is not limited to, a lens 112 and a sensing device 114 (which can have an integrated sensing function). The image processing system 130 is coupled to the optical sensing module 110 and can include a digital image processor 132, an image compressor 134, and a transmission interface 136 (eg, a parallel interface or a series of columns). A serial interface and a storage device 138 (eg, storing a complete image frame). Taking the image of the user's hand as an example, the lens 112 can collect and transmit the light reflected by the hand to the sensing device 114, and the sensing device 114 can generate the three-dimensional image information according to the received optical signal to the image processing system. 130. Since the skilled artisan should be aware of the operational details of the image information generated by the sensing device 210 via the digital image processor 132, the image compressor 134, the transmission interface 136, and the storage device 138, further explanation regarding the image processing system 130 is provided. This will not be repeated.

Since the optical sensing module provided by the present invention can detect the depth information and the trajectory information of the non-contact object located around the electronic device, the corresponding non-contact can be identified according to the type, number and motion trajectory of the non-contact object. Gestures, which in turn cause the electronic device to perform the corresponding function. For example, please refer to Figures 1 and 3 together. FIG. 3 is a schematic diagram showing an embodiment of controlling the electronic device 100 shown in FIG. 1 according to the present invention. In this embodiment, the user's single fingertip is moved over the display surface 102 (or the optical sensing module 110) for more than a predetermined distance, and then away from the display surface, for a predetermined time (eg, 0.5 seconds). 102 (or optical sensing module 110). For the optical sensing module 110, the optical sensing module 110 can recognize that the reflector located in the non-contact gesture operation area WR is the single fingertip (single non-contact object), and can be based on the reflector The change in reflected energy detects that the single fingertip completes the approaching and moving away from the display surface 102 within the predetermined time (eg, detecting a coordinate change in the Z-axis direction of the single fingertip). In addition, the optical sensing module 110 can recognize a click gesture according to the object type (finger tip) of the reflector, the number of objects (1), and the trajectory information (complete round-trip motion within a predetermined time), and The click gesture causes the electronic device 100 to open or select a particular item on the display surface 102. It can be seen that the non-contact click gesture shown in FIG. 3 operates like a click of a left mouse button to select/open a specific item, thereby providing an intuitive and convenient control experience for the user.

The above method for controlling a specific function of the electronic device 100 can be summarized as FIG. 4, which is a flowchart of an embodiment of a control method of the electronic device of the present invention. If substantially the same result is achieved, the steps do not have to be performed in the order shown in Figure 4. For example, the steps shown in Figure 4 do not have to be performed continuously, and other steps can be inserted therein. For the convenience of explanation, please refer to Figure 4 together with Figure 3. The control method shown in Fig. 4 can be summarized as follows.

Step 400: Start.

Step 410: Identify at least one non-contact object located in the non-contact gesture operation area WR of the electronic device 100, belonging to an object category belonging to a plurality of different object types (for example, a finger tip and a palm). In the embodiment shown in FIG. 3, it can be recognized that the object type to which the at least one non-contact object belongs is a finger tip.

Step 420: Determine the number of non-contact objects (for example, the number of finger tips) of each object type among the object types to which the at least one non-contact object belongs.

Step 430: Detect a track information of the at least one non-contact object in the contactless gesture operation area WR. For example, in the embodiment shown in FIG. 3, the at least one non-contact object can be detected to move toward the display surface 102 (or the optical sensing module 110) for more than a predetermined distance within a predetermined time. Then, away from the display surface 102 (or the optical sensing module 110).

Step 440: According to the type of the object to which the at least one non-contact object belongs, the number of non-contact objects of each object type among the object types to which the at least one non-contact object belongs, and the trajectory information of the at least one non-contact object, A non-contact gesture (eg, a one-click gesture) corresponding to the at least one non-contact object is identified.

Step 450: The electronic device 100 is caused to perform a specific function (for example, an item selection or an item opening function) according to the non-contact gesture.

The control method provided by the present invention can recognize/recognize which one or which of the plurality of different object types belong to the at least one non-contact object located in the non-contact gesture operation area WR ( Step 410), according to the detected non-contact object type, number and trajectory information to identify the non-contact gesture corresponding to the non-contact object, thereby allowing the user to manipulate with intuitive and diverse non-contact gestures Electronic device. In order to further understand the technical features of the present invention, a plurality of embodiments for controlling electronic devices by non-contact gestures are exemplified below, but this is not intended to be a limitation of the present invention. As long as the non-contact gesture is recognized based on the type, number, and trajectory information of the non-contact object, design-related changes fall within the scope of the present invention in accordance with the spirit of the present invention.

Please refer to Figure 5 together with Figure 1. Figure 5 is a schematic diagram of another embodiment of the control electronics of the present invention. In this embodiment, the optical sensing module 110 recognizes that at least one non-contact object among the non-contact gesture operation regions WR has only one specific object belonging to a specific object category. More specifically, the optical sensing module 110 detects only a single finger tip (steps 410 and 420 shown in FIG. 4), wherein the single fingertip located at an initial position stays at the initial position more than one. A predetermined time (for example, 1 second) (step 430 shown in Fig. 4). For example, during the predetermined time, if the difference between the coordinate position of the single fingertip in the space coordinate system defined by the electronic device 100 and the initial position is less than a predetermined distance, the single fingertip may be It is considered to stay in this initial position. Next, the optical sensing module 110 can recognize a stop gesture according to the above information (the single fingertip stays at the initial position for more than the predetermined time) (step 440 shown in FIG. 4), and according to the stay The gesture causes the electronic device 100 to open the detailed information of the specific item or to open a specific function table (step 450 shown in FIG. 4), just like a right click operation.

Please refer to Figure 6 together with Figure 1. Figure 6 is a schematic view of another embodiment of the control electronics of the present invention. In this embodiment, the optical sensing module 110 recognizes only a single fingertip among the non-contact gesture operation regions WR. When the single fingertip approaches the edge of the contactless gesture operating area WR, a corresponding scrolling event can be triggered. For example, when the optical sensing module 110 detects that the single fingertip moves to the right side area RA or the left side area LA of the non-contact gesture operation area WR, the electronic device 100 performs a picture scrolling function (like Scroll the mouse wheel to scroll the display so that the user can view the right or left content of the current screen.

Please refer to Figure 7 together with Figure 1. Figure 7 is a schematic diagram of another embodiment of the control electronics of the present invention. In this embodiment, the optical sensing module 110 recognizes that at least one non-contact object among the non-contact gesture operation regions WR has only two specific objects belonging to a specific object category. More specifically, the optical sensing module 110 detects only two finger tips (each at an initial position P ₁₁ and an initial position P ₁₂ ). The optical sensing module 110 can further detect whether the two finger tips respectively stay at the initial position P ₁₁ and the initial position P _{12 for} more than a predetermined time (for example, 1 second). When the two finger tips respectively stay at the initial position P ₁₁ and the initial position P ₁₂ exceed the predetermined time, the optical sensing module 110 can then detect a relative distance ΔP ₁ between the two finger tips. In an implementation example, when the two finger tips are away from each other (the relative distance ΔP _{1 is} increased), the optical sensing module 110 can recognize a zoom-in gesture, and accordingly, the electronic device 100 performs a screen zoom function correspondingly. In another implementation example, when the two finger tips are close to each other (the relative distance ΔP _{1 is} decreased), the optical sensing module 110 can recognize a zoom-out gesture, and accordingly, the electronic device 100 performs a screen correspondingly. Zoom out.

Since the control method provided by the present invention can recognize the non-contact gesture based on the type, number, and trajectory information of the non-contact object, the same type of non-contact gesture (for example, the zoom gesture) can also be made of different object types and objects. The combination of number and trajectory information is used to define it. Please refer to Figure 8 together with Figure 1. Figure 8 is a schematic illustration of another embodiment of a control electronics device of the present invention. In this embodiment, the optical sensing module 110 recognizes that at least one non-contact object in the non-contact gesture operation area WR includes at least three first type objects and one second type object. More specifically, the optical sensing module 110 recognizes that at least three or more finger tips and one palm are included in the non-contact gesture operation area WR. The optical sensing module 110 can further detect whether the palm located in an initial position stays at the initial position for more than a predetermined time (for example, 1 second). When the palm rests in the initial position for more than the predetermined time (ie, the electronic device 100 enters the zoom mode), the optical sensing module 110 can then detect a relative distance between the palm and the display surface 102 (eg, Detecting Measure the Z-axis coordinate of the palm). In an implementation example, when the palm is away from the display surface 102 (the relative distance is increased), the optical sensing module 110 can recognize a zoom-out gesture, and accordingly, the electronic device 100 performs a screen reduction function correspondingly; In another implementation example, when the palm is close to the display surface 102 (the relative distance is reduced), the optical sensing module 110 can recognize a zoom-in gesture and accordingly cause the electronic device 100 to perform a screen zoom function.

The control method provided by the present invention can further define a corresponding non-contact gesture based on different operation modes. Please refer to Figure 9 together with Figure 1. Figure 9 is a schematic view of another embodiment of the control electronics of the present invention. In this embodiment, in the case that the electronic device 100 executes an item selection instruction, the optical sensing module 110 recognizes that at least one non-contact object among the non-contact gesture operation areas WR has only two specific objects belonging to a specific one. The type of object. More specifically, the optical sensing module 110 detects only two finger tips. The optical sensing module 110 can further detect the movement trajectory of the two finger tips parallel to the display surface 102. When the movement trajectories of the two finger tips parallel to the display surface 102 are identical to each other, the optical sensing module 110 can recognize a drag gesture and accordingly cause the electronic device 100 to perform an item drag function correspondingly. For example, when the two finger tips move up, down, left or right at the same time, the selected items can also be moved according to the movement trajectory of the two finger tips (as with the mouse to drag the selected item). ).

Please refer to Figure 10 together with Figure 1. Figure 10 is a schematic illustration of another embodiment of a control electronics device of the present invention. In this embodiment, the optical sensing module 110 recognizes that at least one non-contact object in the non-contact gesture operation area WR includes at least three first type objects and one second type object. More specifically, the optical sensing module 110 recognizes that at least three or more finger tips and one palm are included in the non-contact gesture operation area WR. The optical sensing module 110 can further recognize a grab gesture by detecting whether the at least three finger tips are close to the palm. For example, the optical sensing module 110 can detect whether a relative distance between the at least three finger tips and the palm is reduced by more than a predetermined distance within a predetermined time (for example, 0.5 seconds), wherein When the relative distance between the at least three finger tips and the palm is reduced beyond the predetermined distance within the predetermined time, the optical sensing module 110 can recognize a grab gesture. For the determination of the above relative distance, refer to the following description.

Please refer to Figure 10 and Figure 11 together. Fig. 11 is a schematic view showing a practical example of the relative distance between the finger tip and the palm shown in Fig. 10. In this implementation example, the optical sensing module 110 can recognize a plurality of finger tips respectively located at a plurality of initial positions P ₂₁ -P ₂₃ and a palm located at the initial position P ₂₀ . For each fingertip, the optical sensing module 110 can detect an object distance ∆P _A /∆P _B /∆P _C between each finger tip and the palm, and determine the object distance ∆P _A /∆ Whether P _B /∆P _C is reduced by more than a predetermined distance within a predetermined time (for example, 0.5 seconds). The optical sensing module 110 can determine the plurality of finger tips and the palm of the hand when the distance between each of the plurality of objects ∆P _A ∆ ∆P _C decreases by more than the predetermined distance within the predetermined time. The relative distance between the two is reduced by more than the predetermined distance within the predetermined time. In other words, when each of the plurality of object distances ∆P _A ∆ ∆P _C decreases by more than the predetermined distance within the predetermined time, the optical sensing module 110 determines that the user operates the non- The contact gesture is a grab gesture.

In a design change, the optical sensing module 110 can also determine whether the non-contact gesture operated by the user is the scratch according to the total distance of the plurality of object distances AP _A ∆ ∆P _C within the predetermined time. Take a gesture. For example, the optical sensing module 110 may add a plurality of object distances ∆P _A ∆ ∆P _C as the relative distance between the plurality of finger tips and the palm. In short, as long as it can be judged that at least three or more finger tips are approaching the palm, design-related changes fall within the scope of the present invention.

In addition, when the optical sensing module 110 recognizes a grab gesture, the optical sensing module 110 can cause the electronic device 100 to perform a call shortcut menu function according to the grab gesture, just like a finger on the touch screen. The edge of the touch screen moves toward the center of the touch screen.

When detecting that at least two non-contact objects in the non-contact gesture operation area belong to a specific object type, the control method provided by the present invention may further cause the electronic device according to the connection between the at least two non-contact objects. Perform a rotation function. Please refer to Figure 12 and Figure 13 together with Figure 1. Fig. 12 is a schematic view showing another embodiment of the control electronic device of the present invention, and Fig. 13 is a view showing the position of the plurality of finger tips shown in Fig. 12. In this embodiment, the optical sensing module 110 recognizes that a plurality of non-contact objects in the non-contact gesture operation area WR belong to a specific object type. More specifically, the optical sensing module 110 recognizes that the non-contact gesture operation area WR includes five finger tips, which are respectively located at a plurality of initial positions P ₃₁ to P ₃₅ . The optical sensing module 110 can form a connection L _A by using the initial positions P ₃₁ and P ₃₅ corresponding to the two finger tips which are the farthest from each other among the five finger tips, and can detect the connection line L _A An angle θ ₁ between a reference line (ie, the horizontal line L ₁ ), wherein the optical sensing module 110 recognizes a rotation gesture when the angle θ _{1 is} greater than a specific angle (eg, 10 degrees) (ie, the user triggers a rotation event).

When the optical sensing module 110 recognizes a rotation gesture, the optical sensing module 110 can cause the electronic device 100 to perform an item rotation function or a picture rotation function according to the rotation gesture, wherein the direction of the rotation can be performed by the finger tip. The direction of rotation is determined, and/or the angle of rotation is determined by the angle between the line of the finger tip and the reference line (eg, the angle θ ₁ ).

Please note that the above is for illustrative purposes only and is not intended to be a limitation of the invention. In an implementation example, the optical sensing module 110 may also form the connection line L _A according to the projection points of the initial positions P ₃₁ and P ₃₅ on the display surface 102 , in other words, in the normal vector direction of the display surface 102 . In the Z-axis direction, in the case where the display surface 102 (or the reference plane parallel to the display surface 102) is defined as an XY plane, the optical sensing module 110 can be connected to the XY plane according to the initial positions P ₃₁ and P ₃₅ . The angle between the reference line and the reference line on the XY plane is used to determine whether the user triggers a rotation event.

In another implementation example, the optical sensing module 110 can still identify at least two non-contact objects in the non-contact gesture operation area WR belonging to a specific object type (for example, a fingertip). The positions of the two non-contact objects which are farthest apart from each other in the non-contact object form a line, and the angle between the line and a reference line is used to determine whether a rotation triggering event occurs.

In addition, the above reference line is not limited to the horizontal line L ₁ and can be designed according to actual needs. Please refer to Figure 14 and Figure 15 together with Figure 1. Fig. 14 is a schematic view showing another embodiment of the control electronic device of the present invention, and Fig. 15 is a view showing the position of the plurality of finger tips shown in Fig. 14. In this embodiment, the optical sensing module 110 recognizes that at least one non-contact object among the non-contact gesture operation regions WR has only two specific objects belonging to a specific object category. More specifically, the optical sensing module 110 detects only two finger tips (each located at an initial position P ₄₁ and an initial position P ₄₂ ). The optical sensing module 110 can then detect whether the two finger tips respectively stay at the initial position P ₄₁ and the initial position P _{42 for} more than a predetermined time. When the two finger tips respectively stay at the initial position P ₄₁ and the initial position P ₄₂ exceed the predetermined time, the optical sensing module 110 may form a connection between the initial position P ₄₁ and the initial position P ₄₂ . Line L ₂ (for example, a line projected on the XY plane) serves as a reference line. When the user's hand rotates (that is, the two finger tips move to the initial position P ₄₃ and the initial position P _{44 respectively} ; as indicated by the dotted hand), the optical sensing module 110 can detect the connection L. Whether an angle θ ₂ between _B (for example, a line projected on the XY plane) and the line L ₂ (reference line) is greater than a specific angle (for example, 10 degrees) is used to determine whether a rotation trigger event has occurred. It is to be noted that the definition of the reference line shown in Fig. 15 is also applicable to the embodiment of at least three finger tips (for example, the embodiment shown in Fig. 12).

It is to be noted that although the embodiments shown in FIGS. 3 to 15 have a finger tip and a palm as an example of the object type, the present invention is not limited thereto. As long as the non-contact gesture is recognized based on the type, number, and trajectory information of the non-contact object, design-related changes fall within the scope of the present invention in accordance with the spirit of the present invention.

In addition, the control method of the electronic device provided by the present invention can also identify the non-contact gesture based on the number of non-contact objects and the trajectory information without identifying the type of the object to which the non-contact object belongs, and thereby cause the electronic device to execute Corresponding function. Taking the image sensing module 110 as an example, the optical sensing module 110 can directly detect and identify the at least one non-contact object belonging to the non-contact object operating area WR, and directly detect and identify the at least one non-contact object. The number of non-contact objects. More specifically, the optical sensing module 110 can detect that only the two finger tips (two non-contact objects located at the initial position P ₁₁ and the initial position P ₁₂ respectively) are included in the non-contact gesture operation area WR. And when the two finger tips respectively stay at the initial position P ₁₁ and the initial position P _{12 for} more than a predetermined time, a relative distance between the two finger tips is detected, thereby determining whether the user performs a zoom gesture. Similarly, the control means of the electronic device shown in Figures 3, 5, 6, 9, 12, and 14 may also eliminate the need to identify the type of object to which the non-contact object belongs.

In short, in the case where it is not necessary to identify the type of the object to which the non-contact object belongs (or the non-contact object is regarded as the same object type), the control method of the electronic device provided by the present invention can be simply summarized into FIG. Figure 16 is a flow chart showing another embodiment of the control method of the electronic device of the present invention. If substantially the same result is achieved, the steps do not have to be performed in the order shown in Figure 16. For example, the steps shown in Figure 4 do not have to be performed continuously, and other steps can be inserted therein. The control method shown in Fig. 16 can be summarized as follows.

Step 1600: Start.

Step 1620: Identify the number of non-contact objects (for example, the number of finger tips) of at least one non-contact object located in a non-contact gesture operation area.

Step 1630: Detect a track information of the at least one non-contact object in the non-contact gesture operation area.

Step 1640: Identify a non-contact gesture corresponding to the at least one non-contact object according to the number of the non-contact objects and the trajectory information of the at least one non-contact object.

Step 1650: The electronic device is caused to perform a specific function according to the non-contact gesture.

Since the skilled artisan will understand the details of each step shown in FIG. 16 after reading the related descriptions of FIGS. 1 to 15, the further description will not be repeated here.

In summary, the control method of the electronic device provided by the present invention not only provides a non-contact human-computer interaction mode, but also satisfies the requirement of the user to perform multiple and intuitive non-contact gestures. Therefore, the non-contact control method provided by the present invention can be combined with (or substituted for) existing contact control methods (for example, operating an electronic device with a mouse or a touch panel), and applied to various operating systems (for example, a Windows operating system). Or in the Android operating system). The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

100‧‧‧Electronic devices
102‧‧‧ display surface
110‧‧‧Optical sensing module
112‧‧‧ lens
114‧‧‧Sensing device
130‧‧‧Image Processing System
132‧‧‧Digital Image Processor
134‧‧‧Image Compressor
136‧‧‧Transport interface
138‧‧‧ storage device
400, 410, 420, 430, 440, 450, 1600, 1620, 1630, 1640, 1650‧ ‧ steps
WR‧‧‧ Non-contact gesture operation area
P ₁₁ , P ₁₂ , P ₂₀ ～ P ₂₃ , P ₃₁ ～ P ₃₅ , P ₄₁ ～ P ₄₄ ‧ ‧ ‧ initial position ΔP ₁ ‧ ‧ relative distance ∆P _A , ∆P _B , ∆P _C ‧‧‧ objects distance
L _A , L _B , L ₂ ‧‧‧ connection
L ₁ ‧‧‧ horizontal line θ ₁ , θ ₂ ‧‧‧ angle

1 is a schematic view of an embodiment of an electronic device of the present invention. FIG. 2 is a functional block diagram showing an implementation example of the image processing system of the electronic device shown in FIG. 1. FIG. 3 is a schematic diagram showing an embodiment of the electronic device shown in FIG. 1 controlled by the present invention. 4 is a flow chart showing an embodiment of a control method of an electronic device of the present invention. Figure 5 is a schematic diagram of another embodiment of the control electronics of the present invention. Figure 6 is a schematic view of another embodiment of the control electronics of the present invention. Figure 7 is a schematic diagram of another embodiment of the control electronics of the present invention. Figure 8 is a schematic illustration of another embodiment of a control electronics device of the present invention. Figure 9 is a schematic view of another embodiment of the control electronics of the present invention. Figure 10 is a schematic illustration of another embodiment of a control electronics device of the present invention. Fig. 11 is a schematic view showing a practical example of the relative distance between the finger tip and the palm shown in Fig. 10. Figure 12 is a schematic view of another embodiment of the control electronics of the present invention. Figure 13 is a schematic view showing the position of a plurality of finger tips shown in Fig. 12. Figure 14 is a schematic illustration of another embodiment of a control electronics device of the present invention. Fig. 15 is a view showing the position of a plurality of finger tips shown in Fig. 14. Figure 16 is a flow chart showing another embodiment of the control method of the electronic device of the present invention.

400, 410, 420, 430, 440, 450 ‧ ‧ steps

Claims (20)

A control method for an electronic device, the electronic device having a non-contact gesture operation area, the control method comprising: identifying at least one non-contact object located in the non-contact gesture operation area among a plurality of different object types The object type; determining the number of non-contact objects of each object type among the object types to which the at least one non-contact object belongs; detecting a track information of the at least one non-contact object in the non-contact gesture operation area; Identifying the number of non-contact objects of each object type and the trajectory information of the at least one non-contact object according to the type of the object to which the at least one non-contact object belongs, the object type of the at least one non-contact object, and the trajectory information of the at least one non-contact object a non-contact gesture corresponding to the at least one non-contact object; and causing the electronic device to perform a specific function according to the non-contact gesture. The control method of claim 1, wherein when only two specific objects of the at least one non-contact object belong to a specific object type, detecting the at least one non-contact object in the non-contact gesture operation area The step of the trajectory information includes: detecting whether the two specific objects located at a first initial position and a second initial position respectively stay at the first initial position and the second initial position for more than a predetermined time; And detecting a relative distance between the two specific objects when the two specific objects respectively stay at the first initial position and the second initial position exceeds the predetermined time; wherein the non-contact gesture is increased when the relative distance increases Is a zoom gesture; and when the relative distance is reduced, the non-contact gesture is a zoom out gesture. The control method of claim 1, wherein the electronic device has a display surface; and detecting the at least one when the at least one non-contact object comprises at least three first type objects and a second type object The step of the trajectory information of the non-contact object in the non-contact gesture operation area includes: detecting whether the second type object located at an initial position stays at the initial position for more than a predetermined time; and when the second type object Detecting a relative distance between the second type of object and the display surface when the initial position exceeds the predetermined time; wherein when the relative distance is increased, the non-contact gesture is a zoom-out gesture; and when the When the relative distance is reduced, the non-contact gesture is a zoom-in gesture. The control method of claim 1, wherein the electronic device has a display surface; when the electronic device executes an item selection instruction, and only two of the at least one non-contact object belong to a specific one The detecting the trajectory information of the at least one non-contact object in the non-contact gesture operation area includes: detecting a movement trajectory of the two specific objects parallel to the display surface; wherein when the two specific objects are When the movement trajectories parallel to the display surface are identical to each other, the non-contact gesture is a drag gesture. The control method of claim 1, wherein the electronic device has a display surface; and when it is determined that the at least one non-contact object comprises at least three first type objects and a second type object, detecting the The step of the at least one non-contact object in the non-contact gesture operation area includes: detecting whether a relative distance between the at least three first type object and the second type object is reduced within a predetermined time And exceeding a predetermined distance; wherein the non-contact gesture is a grab gesture when the relative distance between the at least three first type object and the second type object is reduced by the predetermined distance within the predetermined time. The control method of claim 5, wherein the step of detecting whether the relative distance between the at least three first type object and the second type object is reduced by the predetermined distance within the predetermined time comprises: For each first type of object: detecting an object distance between each of the first type of object and the second type of object; and determining whether the object distance is reduced by the predetermined distance within the predetermined time; wherein each of the first Determining that the relative distance between the at least three first type object and the second type object is determined when the object distance between the type object and the second type object is reduced by the predetermined distance within the predetermined time The predetermined distance is reduced within the predetermined time. The control method of claim 5, wherein the step of detecting whether the relative distance between the at least three first type object and the second type object is reduced by the predetermined distance within the predetermined time comprises: Detecting an object distance between each of the first type of object and the second type of object; and adding each object distance between the first type of object and the second type of object as the at least three The relative distance between a type of article and the second type of article. The control method of claim 5, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform a call shortcut menu function according to the grab gesture. The control method of claim 1, wherein when at least two specific objects of the at least one non-contact object belong to a specific object type, detecting the at least one non-contact object in the non-contact gesture operation area The step of the trajectory information includes: forming a first connection by using corresponding positions of the at least two specific objects that are farthest apart from each other; and detecting the first connection and the reference line An angle between the two; wherein the non-contact gesture is a rotation gesture when the angle is greater than a specific angle. The control method of claim 9, wherein when only two of the at least one non-contact object belong to the specific object category, detecting the at least one non-contact object in the non-contact gesture operation area The step of the trajectory information includes: detecting whether the two specific objects located at a first initial position and a second initial position respectively stay at the first initial position and the second initial position for more than a predetermined time; And a second connection formed between the first initial position and the second initial position when the two specific objects respectively stay at the first initial position and the second initial position exceed the predetermined time As this reference line. The control method according to claim 2, 4 or 9, wherein each specific object is a finger tip. The control method of claim 3, wherein each of the first type of objects is a finger tip and the second type of object is a palm. A control method for an electronic device, the electronic device having a non-contact gesture operation area, the control method comprising: identifying a number of non-contact objects of at least one non-contact object located in the non-contact gesture operation area; Detecting a track information of the at least one non-contact object in the non-contact gesture operation area; identifying the number of non-contact objects and the track information of the at least one non-contact object according to the at least one non-contact object a non-contact gesture corresponding to the at least one non-contact object; and causing the electronic device to perform a specific function according to the non-contact gesture. The control method of claim 13, wherein when the at least one non-contact object includes only two non-contact objects, detecting the trajectory information of the at least one non-contact object in the non-contact gesture operation area The step of detecting: detecting whether the two non-contact objects located at a first initial position and a second initial position respectively stay at the first initial position and the second initial position exceed a predetermined time; and when the two non- Detecting a relative distance between the two non-contact objects when the contact object stays at the first initial position and the second initial position exceeds the predetermined time; wherein when the relative distance increases, the non-contact gesture is one A zoom gesture; and when the relative distance decreases, the non-contact gesture is a zoom out gesture. The control method of claim 2, 3 or 14, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform correspondingly according to the zoom-out gesture or the zoom-in gesture One screen reduction function or one screen enlargement function. The control method of claim 13, wherein the electronic device has a display surface; and when the electronic device executes an item selection instruction, and the at least one non-contact object only includes two non-contact objects, the detection The step of the at least one non-contact object in the non-contact gesture operation area includes: detecting a movement trajectory of the two non-contact objects parallel to the display surface; wherein when the two non-contact objects are parallel to the display When the movement trajectories of the faces are identical to each other, the non-contact gesture is a drag gesture. The control method of claim 4, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform an item drag function correspondingly according to the drag gesture. The control method of claim 13, wherein when the at least one non-contact object comprises at least two non-contact objects, detecting the trajectory information of the at least one non-contact object in the non-contact gesture operation area The step of: forming a first connection by using corresponding positions of the two non-contact objects that are farthest apart from each other among the at least two non-contact objects; and detecting a first connection between the first connection and the reference line An angle; wherein the non-contact gesture is a rotation gesture when the angle is greater than a specific angle. The control method of claim 18, wherein when the at least one non-contact object includes only two non-contact objects, detecting the trajectory information of the at least one non-contact object in the non-contact gesture operation area The step of detecting: detecting whether the two non-contact objects located at a first initial position and a second initial position respectively stay at the first initial position and the second initial position exceed a predetermined time; and when the two non- When the contact object respectively stays at the first initial position and the second initial position exceeds the predetermined time, a second connection formed between the first initial position and the second initial position is used as the reference line . The control method of claim 9 or 18, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform an item rotation function or a corresponding one according to the rotation gesture Picture rotation function.