TWI512544B - Control method for electronic apparatus - Google Patents

Description

Electronic device control method

The present invention relates to a non-contact control mechanism, and more particularly to a method of controlling an electronic device based on the position of an object that is not in contact with the electronic device in space.

The touch-sensitive electronic device provides the user with an intuitive and convenient manner of control. However, when the user holds other items (for example, documents or drinks) and cannot directly touch the electronic device, or the hand is stained with dirt, it is not convenient to touch the electronic device. In the case of a device, the manipulation of the electronic device by means of touch increases the inconvenience of the user. For example, when a user watches an e-book displayed on a tablet while eating French fries, the user does not want to flip through the e-book with greasy fingers.

Therefore, an innovative touch mechanism is needed to solve the above problems.

In view of the above, it is an object of the present invention to provide a method for controlling an electronic device based on a position of an object that is not in contact with an electronic device in space to solve the above problem.

According to an embodiment of the present invention, a method of controlling an electronic device is disclosed. The control method includes the steps of: generating a plurality of detection signals to a non-contact object located around the electronic device; receiving a plurality of reflection signals generated by the non-contact object reflecting the plurality of detection signals, respectively, and generating a plurality of reflection signals a detection result; performing a calculation process on the plurality of detection results to calculate a trajectory information of the non-contact object around the electronic device; identifying a non-contact gesture corresponding to the non-contact object according to the trajectory information; The non-contact gesture to cause the electron The device performs a specific function.

The control method for the electronic device of the present invention provides a non-contact human-computer interaction mode, which can increase the convenience of controlling the electronic device, and can also be matched with the touch-type touch operation to satisfy the elastic control mode and the intuitive control experience.

100‧‧‧Electronic devices

102‧‧‧ Display screen

210, 220, 230, 240, 250‧ ‧ steps

IL1, IL2, IL3‧‧‧ Infrared light-emitting diode

IS1, IS2, IS3‧‧‧ Infrared Sensor

OB‧‧‧ objects

I1, I2, I3‧‧‧ infrared light signals

R1, R2, R3‧‧‧ reflection signals

P1, P2, P3, P _A , P _C , P _D , P _E , P _H , P _H ', P _H ”, P _M , P _N , P _P , P _Q , P _R , D1, D2‧‧ position

AP‧‧‧Program shortcut

F1‧‧‧Focus frame

F2, F4‧‧‧ select symbols

F3‧‧‧Selection box

VB‧‧ virtual button

A‧‧‧ areas to be inquired

M‧‧‧ landmark

S‧‧‧Specific range

1 is a schematic diagram of an embodiment of an electronic device capable of detecting the position of a surrounding non-contact object according to the present invention.

2 is a flow chart of an embodiment of a method of controlling an electronic device of the present invention.

FIG. 3 is a schematic diagram showing a first implementation example in which one of the specific functions performed by the electronic device shown in FIG. 1 is controlled by contactless touch.

FIG. 4 is a schematic diagram showing an example of the correspondence between the position of the non-contact object coordinates and the time corresponding to the non-contact click gesture of the present invention.

FIG. 5 is a schematic diagram of a second implementation example in which one of the specific functions performed by the electronic device shown in FIG. 1 is controlled by contactless touch.

FIG. 6 is a schematic diagram showing a third implementation example in which one of the specific functions performed by the electronic device shown in FIG. 1 is controlled by contactless touch.

FIG. 7 is a schematic diagram showing a fourth implementation example in which one of the specific functions performed by the electronic device shown in FIG. 1 is controlled by contactless touch.

FIG. 8 is a schematic diagram showing an example of the correspondence between the position of the non-contact object coordinates and the time corresponding to the non-contact double-click gesture of the present invention.

FIG. 9 is a schematic diagram showing a fifth example of performing a specific function of the electronic device shown in FIG. 1 by contactless touch.

FIG. 10 is a schematic diagram showing an example of the correspondence between the position of the non-contact object coordinates and the time corresponding to the non-contact drag gesture of the present invention.

In order to provide a non-contact human-computer interaction mode, the present invention utilizes an electronic device that can determine the trajectory information of a suspended object (for example, information having the position and time of the object), and defines the phase according to the trajectory information of the suspended object. A corresponding hovering gesture (ie, a non-contact gesture that is not in contact with the electronic device) is used to implement a non-contact intuitive manipulation mechanism. For convenience of explanation, the following is an example of an electronic device that obtains trajectory information according to the reflected signal of the suspended object. However, as long as any electronic device capable of determining the trajectory information of the suspended object is used, according to the trajectory of the suspended object The information to define the implementation of the corresponding hovering gestures is in accordance with the inventive spirit of the present invention.

Please refer to Figure 1 and Figure 2 together. 1 is a schematic diagram of an embodiment of an electronic device capable of detecting a position of a non-contact object, and FIG. 2 is an embodiment of a control method of an electronic device according to the present invention. The flowchart, in which the control method shown in FIG. 2 is applicable to the electronic device 100 shown in FIG. In this embodiment, the electronic device 100 is implemented by a portable device (for example, a smart phone or a tablet) (but the invention is not limited thereto), and may include a display screen 102 and a plurality of illuminations. The component (in this embodiment, implemented by a plurality of infrared light-emitting diodes (IR LEDs) IL1 to IL3), a plurality of sensing elements (in this embodiment, A plurality of infrared sensors IS1~IS3 are implemented) and a processing unit (not shown in FIG. 1).

In step 210 and step 220, each of the infrared light emitting diodes can be used to generate a detection signal (ie, emit an infrared light signal) to a non-contact object located around the electronic device 100 (in this embodiment, it is used by Each of the infrared sensors is configured to receive a reflected signal generated by the finger OB reflecting the detection signal, and accordingly generate a detection result to the processing unit to obtain the finger OB. Track information.

In this embodiment, in order to facilitate the operation of obtaining the trajectory information of the finger OB, the periphery of the electronic device 100 defines a predefined space coordinate system, wherein the predefined space coordinate system includes a plurality of infrared sensors IS1~IS3. One of the reference planes is defined (i.e., display screen 102). In addition, the plurality of infrared light-emitting diodes IL1 to IL3 can be disposed adjacent to the plurality of infrared sensors IS1 to IS3, respectively, so that the infrared light-emitting diode IL1 and the infrared sensor IS1 can be regarded as having the same Position P1 (0, 0, 0), the infrared light-emitting diode IL2 and the infrared sensor IS2 are regarded as having the same position P2 (X ₀ , ₀ , 0), and the infrared light-emitting diode IL3 and the infrared sense The detector IS3 is considered to have the same position P3 (0, Y ₀ , 0).

A plurality of infrared light-emitting diodes IL1 to IL3 can be activated in turn, wherein only one infrared light-emitting diode is enabled at a time. While each of the infrared light emitting diodes is enabled, an adjacent infrared sensor is also enabled to receive the infrared light signal reflected by the finger OB, and when an infrared light emitting diode is disabled, Adjacent infrared sensors are also disabled, thus ensuring that the reflected signals received by the infrared sensors correspond to the adjacent infrared light-emitting diodes. For example, the infrared light emitting diode IL1 emits the infrared light signal I1 to the finger OB, and the infrared sensor IS1 receives the reflected signal R1 generated by the finger OB reflecting the infrared light signal I1, and generates a first detection result ( For example, the current sensor IS2; similarly, the infrared sensor IS2 receives the reflected signal R2 generated by the finger OB reflecting the infrared light signal I2, and generates a second detection result (for example, a current signal), and an infrared sensor. The IS3 receives the reflected signal R3 generated by the finger OB reflecting the infrared light signal I3, and generates a third detection result (for example, a current signal).

In step 230, the processing unit included in the electronic device 100 may perform an operation process on the first detection result, the second detection result, and the third detection result to calculate the non-contact finger OB on the electronic device. A trajectory of information for 100 weeks. For example, the processing unit may respectively obtain the reflected energy corresponding to the reflected signals R1 R R3 according to the first, second, and third detection results, and according to the correspondence between the reflected energy and the energy transmission distance, The distance between each infrared sensor and the finger OB is obtained. Next, the processing unit can perform arithmetic processing according to the position of each infrared sensor (or each infrared light emitting diode) and the distance between each infrared sensor and the finger OB to calculate the finger OB. A plurality of coordinate positions corresponding to the different time points in the predefined space coordinate system (for example, the position P _H (X _H , Y _H , Z _H ) shown in FIG. 1) as the trajectory information of the finger OB .

Since the electronic device 100 can determine the position of the finger OB, the electronic device 100 can track the movement trajectory of the finger OB over time. In step 240, the processing unit can identify a corresponding one of the non-contact gestures according to the trajectory information of the finger OB. In this embodiment, the processing unit can determine at least one of a moving direction and a moving distance of the finger OB in the predefined space coordinate system according to the correspondence between the position coordinates of the finger OB and the time. And according to the non-contact gesture corresponding to the movement trajectory of the finger OB.

For example, when the processing unit determines that two adjacent time points are present, the finger OB is moved from the position P _H (X _H , Y _H , Z _H ) to the position P _H '(X _H +k, Y _H , In the case of Z _H ), the non-contact gesture corresponding to the trajectory information of the finger OB can be recognized as a pan gesture. That is, since the motion vector of the finger OB in the predefined space coordinate system is (k, 0, 0) (parallel to the display screen 102), the track information of the finger OB can be recognized as left to right. Panning gesture. In a design change, if the finger OB has a slight vertical offset during the translational motion, the finger OB movement vector is (k, 0, Δz), however, as long as Δz is less than a predetermined offset (also That is, the moving direction of the finger OB is still substantially parallel to the display screen 102), and the processing unit can still recognize the trajectory information of the finger OB as a panning gesture. In another design change, the distance k of the finger OB translation needs to be greater than a predetermined distance, and the processing unit recognizes the trajectory information of the finger OB as the panning gesture.

In step 250, the processing unit may cause the electronic device 100 to perform a specific function according to the recognized non-contact gesture. For example, a program shortcut AP for starting the photographing function is displayed on the display screen 102, wherein the position of the program shortcut AP on the electronic device 100 can be expressed as P _A (X _A , Y _A , 0). When the finger OB moves within the sensing range of the electronic device 100 (for example, the finger OB moves in the space directly above the display screen 102), the processing unit can start tracking the movement trajectory of the finger OB (for example, the display screen 102 can display and The cursor corresponding to the movement trajectory of the finger OB). When the processing unit detects that the finger OB stays above the program shortcut AP (for example, (X _A , Y _A , Z _H )) for more than a predetermined time (that is, the time when the finger OB is in a stationary state exceeds the predetermined time) The processing unit can recognize a stop gesture and cause the electronic device 100 to activate the photographing function. That is to say, the user does not need to touch the shortcut AP of the display screen 102 to cause the electronic device 100 to activate the photographing function.

Please note that the above is for illustrative purposes only and is not intended to be a limitation of the invention. In a practical example, the processing unit may also directly obtain a motion vector of the finger OB according to the correspondence between the coordinate position of the finger OB and the time, thereby identifying the corresponding non-contact gesture. In another implementation example, the processing unit may also generate a moving trajectory image according to the obtained trajectory information of the finger OB, thereby performing identification of the non-contact gesture on the moving trajectory image. In another implementation example, the display screen 102 can also be a touch panel, that is, the user can simultaneously control the electronic device 100 in a contact and non-contact manner. In addition, the infrared light emitting diodes and the corresponding infrared sensors do not have to be adjacent to each other. Furthermore, the number of the infrared light emitting diodes may not be equal to the number of the infrared sensors. For example, as long as the plurality of infrared light emitting diodes IL1 to IL3 are still enabled to transmit signals, only the setting is performed. An infrared sensor is also possible in the electronic device 100. In addition, the specific functions performed according to the non-contact trajectory information triggered by the finger OB can have a variety of states.

Please refer to FIG. 3 , which is a schematic diagram of a first implementation example in which the electronic device 100 shown in FIG. 1 performs a specific function by using a touchless touch. In this implementation example, the electronic device 100 (eg, a smart phone, tablet, or camera) operates in a camera mode. When the finger OB moves into the sensing range of the electronic device 100 (for example, the finger OB moves in the space directly above the display screen 102, and the distance between the finger OB and the display screen 102 is not greater than a predetermined sensing distance), The processing unit can start tracking the movement trajectory of the finger OB. For example, the display screen 102 can display a focus frame F1 corresponding to the movement track of the finger OB, wherein the focus frame F1 can move along with the movement track of the finger OB above the display screen 102, that is, the focus frame The position of F1 on the display screen 102 is substantially perpendicular to the position of the finger OB in the predefined space coordinate system above the display screen 102. When the finger OB stays at a specific position above the display screen 102 (for example, the position P _H (X _H , Y _H , Z _H )) for more than a predetermined time, the face image of the focus frame F1 staying on the display screen 102 exceeds the The predetermined time may cause the electronic device 100 to perform the air separation focusing function.

In addition, the electronic device 100 can also perform a function of triggering a photo by space. For example, after the user causes the electronic device 100 to perform the air-to-air focus with the pause gesture, the user can click on the display screen 102 to cause the electronic device 100 to perform the photographing function. Please refer to Figure 3 and Figure 4 together. Figure 4 is a schematic diagram showing an example of the correspondence between the position of the non-contact object coordinates and the time corresponding to the non-contact click gesture of the present invention. In this embodiment, the finger OB is at a time point t ₁ from a specific position (ie, the position P _H (X _H , Y _H , Z _H )) toward and substantially perpendicular to the moving direction of the display screen 102. Moving over a predetermined distance d _S to reach position P _H ′′ (X _H , Y _H , Z _{H —} d ₁ ), and then moving beyond a predetermined distance d _R away from and substantially perpendicular to the direction of movement of display screen 102 (eg At time t ₂ ) and at time t _{3 to} reach position P _K (X _H , Y _H , Z _H -d ₂ ), wherein the time difference between time point t ₂ and time point t ₁ is less than a predetermined time Δt _S. The processing unit can recognize a one-click gesture (that is, the finger OB clicks on the face image) according to the trajectory information of the finger OB, and causes the electronic device 100 to capture the image on the display screen 102. In this implementation example (but the invention is not limited thereto), the predetermined distance d _R may be less than the predetermined distance d _S .

In an implementation example, the processing unit can determine whether the displacement of the finger OB exceeds a predetermined distance d _S /d _R according to the reflected energy of the reflected signal. For example, assume that the reflected energy corresponding to the finger OB at a first position (eg, the position P _H (X _H , Y _H , Z _H )) is a first amount of inductance, when the finger OB moves toward the display screen 102 to a second position (eg, position P _H "(X _H , Y _H , Z _H -d ₁ )) such that the corresponding energy of the finger OB (eg, a second amount of inductance) and the first amount of inductance When the difference between the sensing amounts is greater than a predetermined ratio of the first sensing amount, the processing unit can determine that the displacement of the finger OB is greater than a predetermined distance (eg, a predetermined distance d _S ). Similarly, when the finger OB is displayed away from the distance When the moving direction of the screen 102 moves (for example, from the position P _H "(X _H , Y _H , Z _H -d ₁ ) to the position P _K (X _H , Y _H , Z _H -d ₂ )), the process The unit may also determine from another predetermined ratio whether the finger OB has moved more than another predetermined distance. For example, the processing unit can determine the amount of the finger OB at the position P _H "(X _H , Y _H , Z _H -d ₁ ) and the finger OB at the position P _K (X _H , Y _H , Z _H - The difference between the inductive quantities of d ₂ ) is greater than the amount of induction corresponding to the finger OB at the position P _H ” (X _H , Y _H , Z _{H —} d ₁ ) multiplied by the other predetermined ratio, thereby determining the finger The OB moves beyond the predetermined distance d _R . It should be noted that the predetermined ratio and the other predetermined ratio may be set according to actual design requirements, and the two may be the same or different.

As can be seen from the above, since the user can perform the focus focusing on the photographing environment (for example, rain or insufficient light) without touching the electronic device 100, and the photo device can be triggered without touching the electronic device 100, the photograph can be triggered. Avoid shaking the electronic device 100 due to manual focus and manual triggering of the photograph, and it is also possible to avoid touching the display screen 102 with a sticky hand.

Please refer to FIG. 5 , which is a schematic diagram of a second implementation example in which the electronic device 100 shown in FIG. 1 performs a specific function by using contactless touch. In this implementation example, the electronic device 100 operates in a photographing mode. Similarly, when the finger OB is within the sensing range of the mobile electronic device 100, a display corresponding to the movement trajectory of the finger OB can be displayed on the display screen 102. A symbol (or marquee) F2 is selected, wherein the selection symbol F2 can be moved as the finger OB moves along the display screen 102. When the selection symbol F2 points to a specific object (for example, a virtual button VB) on the display screen 102, the user can click on the virtual button VB to trigger the function of taking a photo.

It should be noted that when the electronic device 100 has a long-distance sensing capability, the photographer can enter the mirror at the same time based on the above-mentioned mechanism for taking photos. In a practical example, the infrared light emission energy of the plurality of infrared light-emitting diodes IL1 to IL3 shown in FIG. 1 can be increased, so that the corresponding infrared sensors IS1~IS3 can receive reflections from distant objects ( For example, a reflection signal of a finger of a photographer who is several meters away from the electronic device 100, and then gesture recognition of the trajectory information of the remote object. In another implementation example, the number of infrared light-emitting diodes shown in FIG. 1 may be increased without increasing the emission energy of the infrared light-emitting diode. For example, the infrared rays shown in FIG. 1 The number of infrared light-emitting diodes corresponding to the sensor can be increased to three, so that the reflected signals received by the infrared sensors are from the infrared light emitted by the corresponding three infrared light-emitting diodes. The signal, therefore, the reflected energy received by each of the infrared sensors is not reduced because the non-contact objects are far apart. In another implementation example, the detection time of the reflected signals received by the infrared sensors shown in FIG. 1 (for example, increasing the integration time) can be increased, and the purpose of sensing the distant objects can also be achieved.

Please refer to FIG. 6 , which is a schematic diagram of a third implementation example in which the electronic device 100 shown in FIG. 1 performs a specific function by using a touchless touch. In this implementation example, the electronic device 100 operates in a map query mode. Similarly, when the finger OB is within the sensing range of the mobile electronic device 100, a selection frame (or selection symbol) F3 corresponding to the movement trajectory of the finger OB may be displayed on the display screen 102, wherein the selection frame F3 may follow The finger OB moves while displaying the movement trajectory above the screen 102. When the selection box F3 is moved to the area A to be inquired on the display screen 102 (that is, the finger OB is moved above the area A to be inquired), the user can take the finger OB. The function of zooming in on the screen is triggered close to the display screen 102 (or closer to the display screen 102 than a predetermined distance). More specifically, when the processing unit of the electronic device 100 determines that the moving direction of the finger OB is moving toward and substantially perpendicular to the moving direction of the display screen 102 by more than the predetermined distance (ie, the finger OB is close to the display screen 102), The processing unit can recognize the trajectory information of the finger OB as a proximity gesture, thereby causing the electronic device 100 to enlarge the image of the area A to be queried.

In addition, when the user wants to change other areas, the user may first move the finger OB away from the display screen 102 (or away from the display screen 102 by more than the predetermined distance) to return to the screen before the enlargement, and then perform subsequent operations. In other words, when the processing unit determines that the finger OB moves away from the moving direction of the display screen 102 by more than the predetermined distance (ie, the finger OB is away from the display screen 102), the processing unit can display the trajectory information of the finger OB. The recognition is a remote gesture, which in turn causes the electronic device 100 to reduce the display of the currently displayed screen of the screen 102.

In this implementation example, the user's hand or finger does not need to touch the display screen 102. Therefore, during the process of zooming the screen, there is no possibility that the information in the screen is blocked by the hand. In addition, when the user wants to click on a landmark M located in the area A to be queried to obtain related information, since the display icon of the landmark M is too small, the user may accidentally touch the icon near the landmark M, The user may first perform the aforementioned approaching gesture to enlarge the display screen of the area A to be queried, and then select the landmark M correctly (for example, click with a floating click).

Please refer to FIG. 7 , which is a schematic diagram of a fourth implementation example in which the electronic device 100 shown in FIG. 1 performs a specific function by using contactless touch. In this implementation example, the electronic device 100 operates in an e-book reading mode. When the user finishes reading the page (for example, page 1 "P.1") and wants to continue reading the next page, the user can take the finger OB into the sensing range of the mobile electronic device 100, and the electronic device 100 applies the aforementioned panning gesture (eg, the finger OB moves from left to right over a predetermined distance substantially parallel to the direction of movement of the display screen 102), electronic The book will turn from left to right, and the speed of turning the page can be determined according to the speed at which the finger OB moves. For example, the speed of the fast, medium, and slow wave can be used to determine whether the page turning of the e-book is continuous. Page, multiple pages, one page. In addition, when the e-book is in continuous page turning (for example, by a quick swipe gesture), the display screen 102 can be directly touched by the finger OB to stop page turning.

In addition, when the user wants to stop page turning, the display screen 102 can be double-clicked in a floating manner to cause the electronic device 100 to perform the stop page turning function. Please refer to Figure 7 and Figure 8 together. Figure 8 is a schematic diagram showing an example of the correspondence between the coordinates of the non-contact object coordinates and the time corresponding to the non-contact double-click gesture of the present invention. In this embodiment, the finger OB is at a time point t ₁ from a specific position (ie, the position P _M (X _M , Y _M , Z _M )) is oriented toward and substantially perpendicular to the moving direction of the display screen 102. Moving over a predetermined distance d _S to the position P _N (X _M , Y _M , Z _M -d _A ), then moving over a predetermined distance d _R away from the direction of movement that is substantially perpendicular to the display screen 102 (eg, At time t ₂ ) and at time t _{3 to} reach position P _P (X _M , Y _M , Z _M -d _B ), next, again from position P _P (X _H , Y _H , Z _H -d _B ) moving in a direction of movement that is oriented toward and substantially perpendicular to the display screen 102, moving over a predetermined distance d _P to reach a position P _Q (X _M , Y _M , Z _M -d _C ), followed by being remote and substantially perpendicular to the display The moving direction of the screen 102 moves over a predetermined distance d _Q (for example, at time point t ₄ ) and arrives at a position P _R (X _M , Y _M , Z _M -d _D ) at a time point t ₅ , where the time point t The time difference between ₄ and time point t ₁ is less than a predetermined time Δt _D . The processing unit of the electronic device 100 can recognize a double tap gesture according to the track information of the finger OB (that is, the finger OB double-clicks the display screen 102), and causes the electronic device 100 to perform the stop page turning function. It should be noted that a plurality of predetermined distances d _S , d _R , d _P , d _Q may be set according to actual needs. For example, the predetermined distance d _P may be equal to the predetermined distance d _S or may not be equal to the predetermined distance d _{S .} . In addition, the processing unit can also determine whether the displacement of the finger OB exceeds a predetermined distance d _S /d _R /d _P /d _Q according to the reflected energy of the reflected signal.

It should be noted that the correspondence between the above non-contact gestures and the specific functions performed by the electronic device is for illustrative purposes only and is not intended to be a limitation of the present invention. For example, as shown in Figure 3. The function of the air separation focus can also be triggered by other non-contact gestures (for example, close to gestures, away gestures, one-click gestures and double-click gestures), and the photos shown in FIG. 3/5 are separated. The function can also be triggered by other non-contact gestures (eg, one of a dwell gesture, a close gesture, a far away gesture, and a double tap gesture), and the screen magnification function shown in FIG. 6 can also be made by other non-contact gestures (eg, staying Triggering, away from gestures, one-click gestures and one-click gestures to trigger, the screen reduction function shown in Figure 6 can also be made by other non-contact gestures (eg, dwell gestures, close gestures, click gestures, and double tap gestures) One of them) to trigger, and/or the stop page turning function shown in FIG. 7 can also be triggered by other non-contact gestures (eg, one of a dwell gesture, a close gesture, a far away gesture, and a click gesture). .

According to the trajectory information of the non-contact object, a continuous gesture composed of a plurality of non-contact gestures can also be recognized, and the electronic device is caused to perform a corresponding function. Please refer to Figure 9 and Figure 10 together. FIG. 9 is a schematic diagram showing a fifth implementation example in which the electronic device 100 shown in FIG. 1 performs a specific function by non-contact touch, and FIG. 10 corresponds to the non-contact drag gesture of the present invention. A schematic diagram of a practical example of the correspondence between the position of the non-contact object coordinates and time. In this implementation example, the electronic device 100 operates in a file editing mode, and the user can select a specific range of files displayed on the display screen 102 by using a continuous gesture consisting of a drag gesture and a pause gesture. . Similarly, when the finger OB is within the sensing range of the mobile electronic device 100, a selected symbol F4 corresponding to the moving trajectory of the finger OB may be displayed on the display screen 102, wherein the selected symbol F4 may be displayed on the screen with the finger OB The movement track above 102 moves.

As can be seen from FIGS. 9 and 10, at time t ₁ , the user's finger is first oriented and substantially vertical by a first specific position (ie, position P _C (X _C , Y _C , Z _C )). After the display screen 102 moves, it moves over a first predetermined time Δt _A over a first predetermined distance r ₀ and reaches a second specific position at a time point t ₂ (ie, the position P _D (X _C , Y) _C , Z _C +r)). Next, the finger OB stays at the position P _D (X _C , Y _C , Z _C +r) for more than a second predetermined time Δt _B and starts to stay at the position P _D (X _C , Y _C , Z _C +r) within a third predetermined time Δt _C calculated, the position P _D (X _C , Y _C , Z _C +r) is moved substantially parallel to the moving direction of the display screen 102 (ie, the time point t ₂ '), and moving over a second predetermined distance and arriving at a third specific position (i.e., position P _E (X _C +p, Y _C +q, Z _C +r)) at time point t ₃ . The processing unit of the electronic device 100 can recognize a drag gesture according to the trajectory information of the finger OB, and cause the electronic device 100 to select a specific range S of the file displayed on the display screen 102. Next, the user can complete the range selection operation at the time point t ₃ by using the aforementioned stop gesture (not shown in FIG. 9). Note that, corresponding to the movement trajectory of the finger OB described above, the selection symbol F4 is moved from the position D1 on the display screen 102 to the position D2 at the time point t ₂ '. In addition, the predetermined distance r ₀ may be set to a predetermined ratio of the distance between the first specific position and the display screen 102 (ie, Z _C ).

In this implementation example, the starting point of the specific range S is the position D1, which corresponds to the position P _D (X _C , Y _C , Z _C +r) of the finger OB moving toward the display screen 102 and staying, and the specific range S The end point is the position D2, which corresponds to the position P _E (X _C +p, Y _C +q, Z _C +r) where the last finger OB stays, wherein the specific range S is the connection formed by the above start point and end point. The corresponding range of lines. For example, the specific range S may be defined as a rectangular range corresponding to the above-mentioned starting point and ending point as diagonal lines. In a design change, the position D1 and the position D2 may be the same row or the same column in the file, and therefore, the selected specific range may correspond to the connection formed by the above starting point and the ending point.

In a design change, the processing unit of the electronic device 100 can also complete the range selection and the operation of copying the specific range S according to the above-mentioned staying gesture. In other words, the processing unit of the electronic device 100 can perform the continuous gesture of dragging and then staying according to the above-mentioned first dragging and then staying. The electronic device 100 is caused to perform a function of selecting and copying a specific range S. In another design change, the continuous gesture of dragging and then staying may be replaced by a continuous gesture composed of two non-contact gestures, wherein the time interval between two consecutive non-contact gestures is less than a predetermined time, for example. The above-mentioned continuous gesture of dragging and then staying can also be replaced by a continuous gesture of dragging first, then moving away, dragging first, then clicking. Or a continuous gesture of clicking and then panning.

In yet another design change, the user can also perform a one-click gesture, a pan gesture, and a continuous gesture composed of a specific gesture to enable the above range selection and/or copy a specific range of operations, wherein the click gesture is The time interval between the pan gestures is less than a predetermined time, and the time interval of the pan gesture and the particular gesture is less than another predetermined time. In other words, the combination of a click gesture and a pan gesture can be substituted for the drag gesture shown in FIG. 9 above. In addition, the specific gesture described above may be one of a far away gesture, a stop gesture, and a one-click gesture.

210, 220, 230, 240, 250‧ ‧ steps

Claims (19)

A method for controlling an electronic device includes: generating a plurality of detection signals to a non-contact object located around the electronic device; and receiving a plurality of reflection signals respectively generated by the non-contact object reflecting the plurality of detection signals, and Generating a plurality of detection results; performing a calculation process on the plurality of detection results to calculate a trajectory information of the non-contact object around the electronic device; and identifying a non-contact gesture corresponding to the non-contact object according to the trajectory information; And causing the electronic device to perform a specific function according to the non-contact gesture; wherein the electronic device is peripherally corresponding to a predefined space coordinate system, and the plurality of detection results are processed to calculate the non-contact object The step of the trajectory information around the electronic device includes: performing arithmetic processing on the plurality of detection results to calculate a plurality of coordinate positions corresponding to the non-contact objects in the predefined space coordinate system at different time points, As the trajectory information, wherein the predefined space coordinate system An XYZ three-dimensional coordinate system, and track information indicating a three-dimensional coordinate system information. The control method of claim 1, wherein the step of identifying the non-contact gesture corresponding to the non-contact object according to the trajectory information comprises: determining the non-correlation according to a correspondence between the plurality of coordinate positions and time Contacting the object in at least one of a moving direction and a moving distance in the predefined space coordinate system. The control method of claim 2, wherein the non-contact gesture is a stop gesture when it is determined that the non-contact object is in a stationary state for more than a predetermined time. The control method of claim 3, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform a focus function correspondingly according to the pause gesture. The control method of claim 2, wherein the electronic device defines a reference surface in the predefined space coordinate system, and when it is determined that the non-contact object moves in a direction parallel to the movement of the reference surface The non-contact gesture is a pan gesture when a predetermined distance is reached. The control method of claim 2, wherein the electronic device defines a reference plane in the predefined space coordinate system, and when determining that the non-contact object is oriented and perpendicular to the reference plane When the movement exceeds a predetermined distance, the non-contact gesture is a close gesture. The control method of claim 6, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform an amplification function according to the proximity gesture. The control method of claim 2, wherein the electronic device defines a reference plane in the predefined space coordinate system, and when determining that the non-contact object moves away from and perpendicular to the reference plane When the movement exceeds a predetermined distance, the non-contact gesture is a distant gesture. The control method of claim 8, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform a reduction function according to the remote gesture. The control method of claim 2, wherein the electronic device defines a reference plane in the predefined space coordinate system; and when the non-contact object is determined to be within a first predetermined time The specific position moves in a moving direction toward and perpendicular to the reference surface by more than a first predetermined distance to a second specific position, stays at the second specific position for more than a second predetermined time, and begins to stay at the second specific The non-contact gesture is a drag gesture when the third predetermined time from the position moves from the second specific position in a moving direction parallel to the reference plane by more than a second predetermined distance. The control method of claim 2, wherein the electronic device defines a reference surface in the predefined space coordinate system; and when it is determined that the non-contact object is within a predetermined time, according to a specific position The non-contact gesture is a one-click gesture when the sequence moves more than a first predetermined distance toward and in a direction perpendicular to the direction of movement of the reference plane, and moves away from and perpendicular to a direction of movement of the reference plane by more than a second predetermined distance. The control method of claim 11, wherein the first predetermined distance is greater than the second predetermined distance. The control method of claim 11, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform a photographing function according to the click gesture. The control method of claim 2, wherein the electronic device defines a reference surface in the predefined space coordinate system; and when it is determined that the non-contact object is within a predetermined time, according to a specific position Moving in a direction of movement toward and perpendicular to the reference plane by more than a first predetermined distance, moving away from and perpendicular to a direction of movement of the reference plane by a second predetermined distance to face and perpendicular to the direction of movement of the reference plane Move more than a third predetermined distance, far The non-contact gesture is a double tap gesture when moving away from the direction of movement of the reference plane by a fourth predetermined distance. The control method of claim 14, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform a stop page turning function according to the double tap gesture. The control method of claim 6, wherein the step of causing the electronic device to perform the specific function according to the non-contact gesture comprises: causing the electronic device to perform a page turning function correspondingly according to the panning gesture. The control method of claim 1, wherein when the non-contact gesture is a continuous gesture consisting of a one-click gesture, a pan gesture, and a pause gesture, the specific function performed by the electronic device is Select a specific range or select and copy that particular range. The control method of claim 1, wherein the electronic device defines a reference plane in the predefined space coordinate system, and performs arithmetic processing on the plurality of detection results to calculate that the non-contact object is The step of the plurality of coordinate positions corresponding to the plurality of coordinate positions in the predefined space coordinate system as the track information includes: obtaining a corresponding plurality of sensing quantities according to the plurality of detection results, to calculate And a plurality of specific positions corresponding to the non-contact objects at different time points in a direction perpendicular to the reference surface, wherein the plurality of specific positions are the plurality of coordinate positions; and determining that the non-contact object is located at a first position Whether a first sensing amount corresponding to the specific position and a sensing amount difference between the second sensing quantity corresponding to the second specific position of the non-contact object is greater than a predetermined ratio of the first sensing quantity; The trajectory information further indicates that a moving distance between the non-contact object moving from the first specific position to the second specific position is greater than a predetermined distance when the sensing amount difference is greater than the predetermined ratio of the first sensing amount. . The control method of claim 5, 6, 8, 10, 11, 14, or 18, wherein the reference surface is a display screen or a touch panel of the electronic device.