CN113574496A - Method for recognizing gesture for operating terminal device and terminal device - Google Patents
Method for recognizing gesture for operating terminal device and terminal device Download PDFInfo
- Publication number
- CN113574496A CN113574496A CN201980094034.2A CN201980094034A CN113574496A CN 113574496 A CN113574496 A CN 113574496A CN 201980094034 A CN201980094034 A CN 201980094034A CN 113574496 A CN113574496 A CN 113574496A
- Authority
- CN
- China
- Prior art keywords
- hand gesture
- electromagnetic wave
- module
- sensing
- terminal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 238000012545 processing Methods 0.000 claims abstract description 154
- 230000006698 induction Effects 0.000 claims abstract description 114
- 230000005540 biological transmission Effects 0.000 claims description 22
- 230000001939 inductive effect Effects 0.000 abstract description 4
- 230000015654 memory Effects 0.000 description 23
- 238000010586 diagram Methods 0.000 description 18
- 238000004590 computer program Methods 0.000 description 16
- 230000008859 change Effects 0.000 description 14
- 230000008569 process Effects 0.000 description 11
- 230000033001 locomotion Effects 0.000 description 9
- 238000001514 detection method Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 8
- 230000001360 synchronised effect Effects 0.000 description 7
- 230000004044 response Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008447 perception Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000149 penetrating effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application relates to a method for recognizing a gesture for operating a terminal device and the terminal device. The terminal device includes: the first group of sensing modules are used for acquiring a first electromagnetic wave signal influenced by a left-hand gesture by sensing the waveform of an electromagnetic wave; the second group of induction modules are used for acquiring a second electromagnetic wave signal influenced by the gesture of the right hand by inducing the waveform of the electromagnetic wave, and the second group of induction modules and the first group of induction modules are respectively positioned at two opposite ends of the terminal equipment; at least one recognition processing module for recognizing the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal; and the application layer is used for receiving the left-hand gesture and the right-hand gesture and executing the operation corresponding to the left-hand gesture and the right-hand gesture. According to the method for recognizing the gesture of the operation terminal device and the terminal device, the gesture recognition of both hands can be realized.
Description
The present application relates to the field of gesture recognition, and in particular, to a method for recognizing a gesture of an operating terminal device and a terminal device.
In the industry's existing research, the way people interact with machines in the past is undergoing unprecedented changes. The earliest original man-machine interaction mode comprises the following steps: handle + button, mouse + keyboard, to the touch screens currently in common use, the human-machine interaction is undergoing unprecedented changes.
Currently, the industry is studying on air-spaced sensing, wherein technologies of air-spaced sensing include millimeter wave sensing, Ultra Wide Band (UWB) sensing, and camera sensing, and sensing methods based on electromagnetic waves (such as millimeter wave sensing) are important research directions. It has the advantages of no need of direct-view diameter, strong penetrating power and the like.
In addition, the electromagnetic wave can also greatly improve the wireless network rate, especially the millimeter wave which can be applied to the next generation wireless communication technology. For example, Institute of Electrical and Electronics Engineers (IEEE) 802.11ad operating in the 60GHz band supports data transmission rates up to 6.7Gbps, while its evolved standard IEEE 802.11ay will provide data transmission rates of 20 Gbps. Millimeter wave radios are therefore expected to bring wireless network access into the multi-switched bandwidth (multi-Gbps) era. Therefore, in the expected future, the millimeter wave radio module will be widely installed on a mobile phone, a wearable device, a smart hardware device or a wider internet of things device, and becomes a mainstream communication technology.
For example, miniature radar can be used to monitor gesture movements in the air, and the specially designed radar sensor uses millimeter wave technology, which can track high-speed movements with sub-millimeter accuracy. However, how to combine the mobile phone with the terminal is not described in the prior art, especially for a game scene of the mobile phone, tracking and recognition of double gestures are generally required to be supported, and how to implement the method is also a problem that needs to be solved at present.
Disclosure of Invention
The embodiment of the application provides a method for recognizing a gesture of an operation terminal device and the terminal device, and double-hand gesture recognition can be achieved.
In a first aspect, a terminal device is provided, which includes: the first group of sensing modules are used for acquiring a first electromagnetic wave signal influenced by a left hand gesture by sensing the waveform of an electromagnetic wave, and each first group of sensing modules comprises at least one sensing module; the second group of sensing modules are used for acquiring a second electromagnetic wave signal influenced by the right hand gesture by sensing the waveform of the electromagnetic wave, and each second group of sensing modules comprises at least one sensing module; the second group of induction modules and the first group of induction modules are respectively positioned at two opposite ends of the terminal equipment; at least one recognition processing module for recognizing the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal; and the application layer is used for receiving the left-hand gesture and the right-hand gesture which are recognized by the at least one recognition processing module and executing the operation corresponding to the left-hand gesture and the right-hand gesture.
In a second aspect, a method for recognizing a gesture of operating a terminal device is provided, where the terminal device includes a first group of sensing modules and a second group of sensing modules, the first group of sensing modules and the second group of sensing modules respectively include at least one sensing module, and the second group of sensing modules and the first group of sensing modules are respectively located at two opposite ends of the terminal device, the method includes: sensing the waveform of the electromagnetic wave through the first group of sensing modules, and acquiring a first electromagnetic wave signal influenced by a left-hand gesture; sensing the waveform of the electromagnetic wave through the second group of sensing modules to obtain a second electromagnetic wave signal influenced by the gesture of the right hand; and recognizing the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal, and executing the operation corresponding to the left hand gesture and the right hand gesture.
In a third aspect, a terminal device is provided, configured to perform the method in the second aspect or each implementation manner thereof. In particular, the terminal device comprises functional modules for performing the methods of the second aspect or its implementations.
In a fourth aspect, a terminal device is provided that includes a processor and a memory. The memory is used for storing a computer program, and the processor is used for calling and running the computer program stored in the memory to execute the method of the second aspect or each implementation manner thereof.
In a fifth aspect, a chip is provided for implementing the method of the second aspect or its implementation manners. Specifically, the chip includes: a processor for calling and running the computer program from the memory so that the device on which the chip is installed performs the method of the second aspect or its implementations.
In a sixth aspect, a computer-readable storage medium is provided for storing a computer program, which causes a computer to execute the method of the second aspect or its implementations.
In a seventh aspect, a computer program product is provided, which includes computer program instructions for causing a computer to execute the method of the second aspect or its implementation modes.
In an eighth aspect, there is provided a computer program which, when run on a computer, causes the computer to perform the method of the second aspect or its implementations.
Through the technical scheme, be provided with two sets of at least response modules on terminal equipment, be used for the response respectively and receive the electromagnetic wave signal that the left hand gesture influences and change and receive the electromagnetic wave signal that the right hand gesture influences and change, for example, can set up four response modules on terminal equipment's four sides or four angles, no matter terminal equipment is horizontal screen or perpendicular screen like this, the response module that all can have to correspond is used for acquireing the electromagnetic wave signal after receiving left hand gesture and right hand gesture influences respectively, and carry out gesture recognition through the recognition processing module, thereby realize the discernment of both hands gesture, that is to say, realized such as the both hands discernment in the recreation scene and combined operation.
Fig. 1 is a schematic block diagram of a terminal device provided in an embodiment of the present application.
Fig. 2 is a schematic diagram of a user using a landscape terminal device according to an embodiment of the present application.
Fig. 3 is a schematic block diagram of a terminal device provided with two identification processing modules according to an embodiment of the present application.
Fig. 4 is a schematic block diagram of a terminal device provided with an identification processing module according to an embodiment of the present application.
Fig. 5 is a schematic diagram illustrating that the sensing modules are arranged on four sides of the terminal device of the landscape screen according to the embodiment of the present application.
Fig. 6 is a schematic diagram illustrating that the sensing modules are arranged on four sides of the terminal device of the vertical screen according to the embodiment of the present application.
Fig. 7 is a schematic diagram illustrating that sensing modules are arranged at four corners of a terminal device of a cross screen according to an embodiment of the present application.
Fig. 8 is a schematic diagram illustrating that sensing modules are arranged at four corners of a terminal device of a vertical screen according to an embodiment of the present application.
Fig. 9 is another schematic block diagram of a terminal device provided with two identification processing modules according to an embodiment of the present application.
Fig. 10 is still another schematic block diagram of a terminal device provided with two identification processing modules according to an embodiment of the present application.
Fig. 11 is another schematic block diagram of a terminal device provided with an identification processing module according to an embodiment of the present application.
Fig. 12 is a schematic flowchart of a method for recognizing a gesture for operating a terminal device according to an embodiment of the present application.
Technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application mainly relates to millimeter wave perception technology, and the millimeter wave perception technology has unique advantages and can provide more intelligent, convenient and interesting product experience. The method can identify actions without a screen, has wider identification range, is hardly influenced by light, a heat radiation source and the like, and can measure the real distance. The system can be well represented in the aspects of distance perception, gesture detection, proximity detection, people number detection, distance measurement, existence detection and the like.
According to the characteristic that millimeter wave distance perception is accurate, the arrival angle (AoA) and the distance (range) from a target object to a chip can be accurately obtained, and after background noise processing and sudden abnormal noise point processing, the position of the target object on a two-dimensional plane can be calculated, so that positioning tracking is achieved.
In the aspect of gesture recognition, people find that the motion trends of hands have own commonality every time the same gesture is made, so that the millimeter wave recognition technology can recognize the same action of different users.
For example, currently, target object detection equipped with Radio Frequency Identification (RFID) tags can reach centimeter-level positioning, and the technical means used is an interferometric technique. The phase hologram is generated by measuring the relative phases of a plurality of RFID receivers, the potential position of an object can be mapped on the phases, and the positioning tracking is further realized through the change of the phases. Because the RFID label must be assembled on the detected object in the scheme, the application scene is tedious and can not meet the requirement of daily use.
For another example, a miniature radar can be used to monitor the gesture motion in the air, and the specially designed radar sensor adopts the millimeter wave technology, and can track the high-speed motion with sub-millimeter accuracy. However, how to combine the mobile phone with the terminal is not described in the prior art, especially for a game scene of the mobile phone, tracking and recognition of double gestures are generally required to be supported, and how to implement the method is also a problem that needs to be solved at present.
Therefore, the embodiment of the application provides a terminal device, which can realize double-gesture recognition by reasonably arranging the electromagnetic wave induction module.
Fig. 1 is a schematic flowchart of a terminal device 100 according to an embodiment of the present application. As shown in fig. 1, the terminal device 100 includes: a first group of sensing modules 110, a second group of sensing modules 120, at least one recognition processing module 130, and an application layer 140.
Wherein the first group of sensing modules 110 is configured to: acquiring a first electromagnetic wave signal influenced by a left-hand gesture by sensing the waveform of an electromagnetic wave; the second set of sensing modules 120 is configured to: and acquiring a second electromagnetic wave signal influenced by the right hand gesture by sensing the waveform of the electromagnetic wave. Specifically, the first group of sensing modules 110 may include at least one sensing module, and the number of the first group of sensing modules 110 in the terminal device 100 may be one or more groups; the second set of inductive modules 120 may also include at least one inductive module, and the number of the second set of inductive modules 110 in the terminal device 100 may also be one or more.
It should be understood that the sensing module in the embodiment of the present application may be an electromagnetic wave sensor, or may also be a radio frequency chip, so as to sense an electromagnetic wave signal, that is, each of the first group of sensing modules 110 and the second group of sensing modules 120 may implement an electromagnetic wave sensing function, for example, the sensing module may be a millimeter wave sensing module, and is configured to sense a millimeter wave. Specifically, the sensing module included in the terminal device 100 may also be used to transmit an electromagnetic wave signal, that is, for any one of the first sensing module group 110 and the second sensing module group 120, the sensing module may be used to transmit an electromagnetic wave signal and to sense a change in the electromagnetic wave signal. The sensing module sends an electromagnetic wave signal, and when no gesture exists, the sensing module senses that the sent electromagnetic wave signal cannot be sensed or the electromagnetic wave signal sensed by the sensing module is similar to the sent electromagnetic wave signal; when a gesture exists, the electromagnetic wave signals sent out can change under the influence of the gesture, and the induction module acquires the electromagnetic wave signals influenced by the gesture through the change of the waveform of the induction electromagnetic waves. For example, in the embodiment of the present application, the acquiring, by the sensing module, the electromagnetic wave signal after being affected by the gesture refers to: for the initial electromagnetic wave signal emitted, the sensing module may sense a change of the initial electromagnetic wave signal caused by the gesture and acquire the electromagnetic wave signal with the change.
For example, for the sensing modules in the first group of sensing modules 110 to emit electromagnetic wave signals, when a gesture exists, for example, a gesture of a left-handed stroke, is affected by the gesture, the waveform of the emitted electromagnetic wave signals changes, and when the first group of sensing modules 110 sense the change, the electromagnetic wave signals that change due to the effect of the left-handed gesture are acquired as the first electromagnetic wave signals. For another example, for the sensing modules in the second group of sensing modules 120 to send out the electromagnetic wave signal, when the right hand gestures, the waveform of the sent out electromagnetic wave signal changes due to the gesture, and when the second group of sensing modules 120 senses the change, the electromagnetic wave signal that changes due to the gesture of the right hand is obtained as the second electromagnetic wave signal.
It should be understood that the sensing module of the embodiment of the present application may be used for sending electromagnetic wave signals, and the sensing module may be independent from the transmission module for data transmission function in the terminal device 100, or both may be the same module. Specifically, if any sensing module in the embodiment of the present application multiplexes a transmission module for service data transmission in the terminal device 100, that is, the sensing module and the transmission module belong to the same module, the transmission module or the sensing module does not send and acquire an electromagnetic wave signal for gesture recognition when there is service data transmission, but only sends an electromagnetic wave signal when there is no need for service data transmission, and acquires an electromagnetic wave signal that changes due to the influence of a gesture to perform gesture recognition. Or, if the change of the electromagnetic wave signal caused by the sensing module sensing the gesture conflicts with the transmission of the service data by the transmission module, the corresponding service data transmission time can be emptied for gesture recognition.
For example, any one of the sensing modules in the terminal device 100 may be configured to: the change of the electromagnetic wave signal caused by the left hand gesture and/or the right hand gesture is acquired at a first time. Specifically, the first set of sensing modules 110 may be configured to: a third electromagnetic wave signal is sent at a first time, and the third electromagnetic wave signal is used to obtain the first electromagnetic wave signal, that is, the third electromagnetic wave signal is used as a detection signal, when a gesture affects the third electromagnetic wave signal, the third electromagnetic wave signal changes, and the first group of sensing modules 110 obtains the changed electromagnetic wave signal as the first electromagnetic wave signal. Similarly, the second set of sense modules 120 may be configured to: a fourth electromagnetic wave signal is sent at the first time, where the fourth electromagnetic wave signal is used to obtain the second electromagnetic wave signal, that is, the fourth electromagnetic wave signal can also be used as a detection signal, and when there is a gesture influence, the fourth electromagnetic wave signal changes, and the second group of sensing modules 120 obtains the changed electromagnetic wave signal as the second electromagnetic wave signal. Optionally, any one of the sensing modules in the terminal device 100 may further be configured to: and transmitting the service data at a second time, wherein the first time and the second time do not overlap. Therefore, the induction module can not only transmit service data, but also induce electromagnetic wave signal changes to perform gesture recognition, and the two do not conflict with each other and do not influence each other.
On the contrary, if the transmission module for transmitting the service data and the sensing module for recognizing the gesture do not belong to the same module, the corresponding interface is needed to transmit the electromagnetic wave signal needing gesture recognition to the transmission module; or the time for transmitting the data by the transmission module is transmitted to the induction module for the gesture recognition process through the corresponding interface, so that the induction module is ensured to send electromagnetic wave signals only when the data transmission is not necessary, the gesture recognition is carried out, and the interference between the electromagnetic wave signals and the gesture recognition is avoided; if the two conflict, the corresponding data transmission time can be emptied.
For example, any one of the sensing modules in the terminal device 100 may be configured to: the change of the electromagnetic wave signal caused by the left hand gesture and/or the right hand gesture is acquired at a first time. Specifically, the first set of sensing modules 110 may be configured to: sending a third electromagnetic wave signal at a first time, wherein the third electromagnetic wave signal is used for acquiring the first electromagnetic wave signal; similarly, the second set of sense modules 120 may be configured to: and sending a fourth electromagnetic wave signal at the first time, wherein the fourth electromagnetic wave signal is used for acquiring the second electromagnetic wave signal. And the transmission module in the terminal device 100 is configured to: and transmitting the service data at a second time, wherein the first time and the second time do not overlap. The transmission module may send a second time to the sensing module, so that the sensing module determines the first time according to the second time.
Optionally, when a plurality of sensing modules are included in the first sensing module group 110 or the second sensing module group 120, each sensing module may work alone or in combination, and the embodiment of the present application is not limited thereto.
It should be understood that the second set of sensing modules 110 and the first set of sensing modules 120 in the terminal device 100 are respectively located at two opposite ends of the terminal device 100. Alternatively, if the terminal device 100 is square and each side is equal, the first sensing module group 110 and the second sensing module group 120 may be disposed at any two opposite ends of the terminal device 100.
However, as shown in fig. 2, assuming that the terminal device 100 is a mobile phone, the terminal device 100 is generally rectangular, i.e. a non-square rectangle; in addition, considering several application scenarios commonly used by the mobile phone, such as a game scenario, as shown in fig. 2, the mobile phone is generally placed across the screen, and both hands usually hold the left end and the right end of the mobile phone respectively. Therefore, as shown in fig. 1, assuming that the terminal device 100 is placed in a landscape mode, the first sensing module group 110 and the second sensing module group 120 may be respectively located at the left end and the right end of the terminal device 100, so that the left-hand and right-hand operations can be conveniently recognized. Similarly, assuming that the terminal device 100 is placed in a vertical screen, the first group of sensing modules 110 and the second group of sensing modules 120 may also be disposed at the left and right ends of the terminal device 100 placed in a vertical screen, and the positions of the upper and lower ends are corresponding to the positions of the horizontal screen when placed in a horizontal screen, which is not limited to this embodiment of the present invention.
In addition, in fig. 1, the first and second sensing modules 110 and 120 are rectangular and are disposed at the middle position of each end of the terminal device 100, but the first and second sensing modules 110 and 120 may have other shapes and may be disposed at any position of each end. For example, the first and second sensing modules 110 and 120 may include a plurality of sensing modules, which may be uniformly distributed at each end, for example, the sensing modules included in the first sensing module 110 may be uniformly or non-uniformly distributed at several positions from top to bottom of the entire left end of the terminal device 100, and the sensing modules included in the second sensing module 120 may be uniformly or non-uniformly distributed at several positions from top to bottom of the entire right end of the terminal device 100. For another example, in consideration of the sensing effect, the position of the sensing module included in the first sensing module group 110 and the position of the sensing module included in the second sensing module group 120 may be symmetrical to each other with respect to a center line of the terminal device 100, but the embodiment of the present application is not limited thereto.
In the terminal device 100, after acquiring the first electromagnetic wave signal through the first sensing module 110 and acquiring the second electromagnetic wave signal through the second sensing module 120, the at least one identification processing module 130 may be configured to: and recognizing the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal. Specifically, the at least one identification processing module 130 may be located at any position in the terminal device 100, and the position shown in fig. 1 is only one possibility.
Alternatively, any one of the at least one recognition processing module 130 in the embodiment of the present application may be an independent module, that is, the recognition processing module 130 is configured to be used only for the two-hand gesture recognition process. Alternatively, the arbitrary identification processing module may be multiplexed with a processor of some other purpose in the terminal device 100, or be located in a processor, for example, the identification processing module may be located in a Modem (Modem) in the terminal device 100, and the Modem may include a plurality of identification processing modules.
It should be understood that the left-hand gesture or the right-hand gesture that can be recognized in the embodiments of the present application may include a plurality of types, for example, may include at least one of the following: slide up, slide down, slide left, slide right, click, double click, circle, and multiple simultaneous clicks. In addition, the left-hand gesture and the right-hand gesture in the embodiment of the present application may be the same or different, and may be combined arbitrarily, which is not limited to this embodiment of the present application.
In the terminal device 100, the application layer 140 is configured to: receiving the left-hand gesture and the right-hand gesture recognized by the at least one recognition processing module 130, and performing an operation corresponding to the left-hand gesture and the right-hand gesture. Specifically, the application layer 140 may be located at any position in the terminal device 100, and the position shown in fig. 1 is only one possibility.
Optionally, the electromagnetic wave in the embodiment of the present application may be a millimeter wave, or may also be other electromagnetic waves; correspondingly, the electromagnetic wave signal in the embodiment of the present application may be a millimeter wave radio signal, or may also be another electromagnetic wave signal, but the embodiment of the present application is not limited thereto.
It should be understood that at least one recognition processing module 130 of the embodiment of the present application may be provided as one or more in consideration of the processing manner of different signals and the interaction manner of the recognition processing module with the application layer. For convenience of explanation, the following description will be given by taking one and two identification processing modules as examples, respectively, in conjunction with fig. 3 and 4.
Fig. 3 shows a schematic diagram of two recognition processing modules provided in the embodiment of the present application. As shown in fig. 3, in contrast to fig. 1, the at least one recognition processing module 130 of the terminal device 100 includes a first recognition processing module 131 and a second recognition processing module 132.
Specifically, the first recognition processing module 131 is configured to recognize the left-hand gesture according to the first electromagnetic wave signal acquired by the first sensing module 110, and transmit the left-hand gesture to the application layer 140. The second recognition processing module 132 is configured to recognize the right-hand gesture according to the second electromagnetic wave signal acquired by the second sensing module 120, and transmit the right-hand gesture to the application layer 140. The application layer 140 is configured to receive and combine the left-hand gesture recognized by the first recognition processing module 131 and the right-hand gesture recognized by the second recognition processing module 132, and perform an operation corresponding to the combined left-hand gesture and right-hand gesture.
For example, the first recognition processing module 131 recognizes that the left-hand gesture is an upward sliding gesture according to the received first electromagnetic wave signal acquired by the first group sensing module 110; the second identification processing module 132 identifies the right-hand gesture as sliding back or forth, that is, sliding from left to right, according to the received second electromagnetic wave signal acquired by the second group of sensing modules 120; and the application layer 140 receives the two gestures of the left-hand upward sliding and the right-hand rightward sliding, combines the two gestures, and generates an operation corresponding to the combined gesture. Assuming that a game scene is currently performed, and two gestures, namely, a left-hand up sliding gesture and a right-hand right sliding gesture, are performed simultaneously to indicate that a game character is operated to jump from left to right, after receiving two actions recognized by the first recognition processing module 131 and the second recognition processing module 132, the application layer 140 combines the two actions and determines that the two-hand gesture is performed to jump from left to right, and then the application layer 140 may control the terminal device 100 to perform a corresponding operation, that is, control a corresponding game character to perform a jump from left to right.
Fig. 4 shows a schematic diagram of an identification processing module provided in the embodiment of the present application. As shown in fig. 4, in contrast to fig. 1, the at least one recognition processing module 130 of the terminal device 100 may include a third recognition processing module 133.
Specifically, the third recognition processing module 133 is configured to recognize the left-hand gesture according to the first electromagnetic wave signal acquired by the first group sensing module 110, recognize the right-hand gesture according to the second electromagnetic wave signal acquired by the second group sensing module 120, combine the left-hand gesture and the right-hand gesture, and send the combined left-hand gesture and right-hand gesture to the application layer 140. The application layer 140 is configured to receive the left-hand gesture and the right-hand gesture combined by the third recognition processing module 133, and perform an operation corresponding to the combined left-hand gesture and right-hand gesture.
For example, the third recognition processing module 133 recognizes that the left-hand gesture is an upward sliding gesture according to the received first electromagnetic wave signal acquired by the first group sensing module 110; moreover, according to the received second electromagnetic wave signal acquired by the second group of sensing modules 120, it is recognized that the right-hand gesture is a sliding movement in a forward or backward direction, that is, a sliding movement from left to right; the third recognition processing module 133 combines the recognized two gestures of the left-hand upward sliding and the right-hand rightward sliding. Assuming that the current game scene is a game scene, and the two gestures of sliding left hand upwards and sliding right hand downwards simultaneously indicate that the user operates the game character to jump from left to right, the third recognition processing module 133 combines the two recognized gestures of sliding left hand upwards and sliding right hand downwards, and the combined gesture is a jump from left to right. Correspondingly, the application layer 140 receives the merged gesture to perform the corresponding operation, that is, the application layer 140 receives the merged gesture as a jump from left to right, and then the application layer 140 can control the terminal device 100 to perform the corresponding operation, that is, control the corresponding game character to perform the jump from left to right.
The above description is respectively made for the scenarios in which different numbers of recognition processing modules are set. Considering terminal equipment such as cell-phones in practical application, there are two directions of horizontal screen and perpendicular screen usually, consequently, it is comparatively suitable at four sides or four corners with the response module setting, can make the signal of response module more accurate detection both hands like this to the gesture of discernment both hands. The terminal device 100 according to the embodiment of the present application will be described below by way of example in conjunction with different arrangements of the sensing module.
Alternatively, as a first embodiment, the motion recognition of different hands is considered, which may be performed by different sensing modules, and fig. 5 and fig. 6 show schematic diagrams of the terminal device 200 according to the embodiment of the present application. As shown in fig. 5 and 6, the terminal device 200 may include four sensing modules respectively located at four sides of the rectangular terminal device 200, the four sensing modules including: a first sensing module 201, a second sensing module 202, a third sensing module 203 and a fourth sensing module 204.
It should be understood that the terminal device 200 corresponds to the terminal device 100, and four sensing modules in the terminal device 200 are one possible arrangement of two sets of sensing modules included in the terminal device 100. In contrast to terminal device 100, terminal device 200 can be seen to include two first set of sensing modules 110 and two second set of sensing modules 120.
As shown in fig. 5, the terminal device 200 is disposed in a landscape manner, and for convenience of distinction, the landscape direction of the terminal device 200 shown in fig. 5 is referred to as a first direction of the terminal device 200. Specifically, when the terminal device 200 is placed in the first direction, the first sensing module group of the terminal device 200 includes the first sensing module 201, that is, the first sensing module 201 corresponds to the first sensing module group 110 included in the terminal device 100; the second sensing module group of the terminal device 200 includes the second sensing module 202, that is, the second sensing module 202 corresponds to the second sensing module group 120 included in the terminal device 100.
Specifically, the terminal device 200 is placed in a first direction, and the first sensing module 201 is configured to obtain a first electromagnetic wave signal after being affected by a left-hand gesture; in contrast, the second sensing module 202 is used to obtain the second electromagnetic wave signal after being influenced by the right hand.
It should be understood that when the terminal device 200 is placed in the first direction in the embodiment of the present application, the terminal device 200 is in the landscape state, and the landscape state includes rotating the upright terminal device 200 counterclockwise and may also include rotating the upright terminal device 200 clockwise. That is, as shown in fig. 5, when the terminal device 200 is placed in the first direction, the first sensing module 201 may correspond to the upper end of the terminal device 200 when the terminal device is placed, and the second sensing module 202 corresponds to the lower end of the terminal device 200 when the terminal device is placed; alternatively, the second sensing module 202 may correspond to the upper end of the terminal device 200 when the terminal device 200 is placed, and the first sensing module 201 corresponds to the lower end of the terminal device 200 when the terminal device 200 is placed. No matter which direction the transverse screen is, the first sensing module 201 in the embodiment of the present application is represented as a sensing module located on the left, and the second sensing module 202 is represented as a sensing module located on the right, and accordingly, the first sensing module 201 is configured to detect electromagnetic wave signals of the left hand, and the second sensing module 202 is configured to detect electromagnetic wave signals of the right hand.
As shown in fig. 6, the terminal device 200 is vertically disposed, and for convenience of distinction, the vertical screen direction of the terminal device 200 shown in fig. 6 is referred to as the second direction of the terminal device 200, and then the first direction of the terminal device 200 is perpendicular to the second direction, or approximately perpendicular to the second direction. Specifically, when the terminal device 200 is placed in the second direction, the first group of sensing modules includes the third sensing module 203, that is, the third sensing module 203 corresponds to another first group of sensing modules 110 included in the terminal device 100; the second sensing module group of the terminal device 200 includes the fourth sensing module 204, that is, the fourth sensing module 204 corresponds to another second sensing module group 120 included in the terminal device 100.
Specifically, the terminal device 200 is placed in the second direction, and the third sensing module 203 is configured to obtain the first electromagnetic wave signal after being affected by the left-hand gesture; in contrast, the fourth sensing module 204 is used for acquiring the second electromagnetic wave signal after being affected by the right-hand gesture.
Similar to the first direction, the terminal device 200 is placed in the second direction to indicate that the terminal device 200 is in the vertical screen state, and the vertical screen state may include the terminal device 200 being placed in the right direction and the terminal device 200 being placed in the upside down direction. No matter which direction the vertical screen is, the third sensing module 203 of the embodiment of the present application represents a sensing module located on the left, and the fourth sensing module 204 represents a sensing module located on the right, and accordingly, the third sensing module 203 is configured to detect the electromagnetic wave signal of the left hand, and the fourth sensing module 204 is configured to detect the electromagnetic wave signal of the right hand. That is, the numbering sequence of the four sensing modules in fig. 5 and 6 is only one possibility, and other sequences are also possible, and the embodiment of the present application is not limited thereto.
Optionally, the terminal device 200 may further include an orientation sensor, and the orientation sensor may be configured to: it is identified whether the terminal device 200 is placed in the first direction or the second direction. The direction sensor may be a sensor carried by the terminal device, and is used to identify whether the terminal device is currently in a landscape screen state or a portrait screen state, for example, the direction sensor may be a gyroscope, and the embodiment of the present application is not limited thereto.
Alternatively, four sensing modules are disposed on four sides of the terminal device 200, and the position of each sensing module can be adjusted according to practical applications, and fig. 5 and 6 are only one possibility. For example, the four sensing modules of the terminal device 200 in fig. 5 and 6 may be respectively located at the center of four sides of the rectangular terminal device 200, but the four sensing modules may also be located at four non-center positions. In addition, each sensing module in fig. 5 and 6 is located at one side of the terminal device 200, but each sensing module may be located at other positions near each side. For example, the first sensing module 201 is located at the leftmost edge on the left side in fig. 5, but the first sensing module 201 may also be located close to the left edge, that is, the left side of the first sensing module 201 may be located at a certain distance from the leftmost edge of the terminal device, and the embodiment of the present application is not limited thereto.
In this embodiment of the application, when the four sensing modules are disposed on the four sides of the terminal device 200, the identification processing module and the application layer may be disposed differently when the terminal device 200 is in different directions.
Alternatively, corresponding to the case shown in fig. 3, the at least one recognition processing module in the terminal device 200 may include a first recognition processing module and a second recognition processing module. Specifically, when the terminal device 200 is placed in the first direction, for example, as shown in fig. 5, the first group of sensing modules 110 in fig. 3 includes a first sensing module 201, where the first sensing module 201 is configured to obtain a first electromagnetic wave signal after being affected by a left-hand gesture, and transmit the first electromagnetic wave signal to the first recognition processing module 131; the first identification processing module 131 is configured to identify the left-hand gesture according to the first electromagnetic wave signal acquired by the first sensing module 201, and send the left-hand gesture to the application layer 140. Similarly, the second sensing module 120 in fig. 3 includes a second sensing module 202, where the second sensing module 202 is configured to acquire a second electromagnetic wave signal after being affected by the right-hand gesture, and transmit the second electromagnetic wave signal to the second recognition processing module 132; the second recognition processing module 132 is configured to recognize the right-hand gesture according to the second electromagnetic wave signal acquired by the second sensing module 202, and send the right-hand gesture to the application layer 140. The application layer 140 is configured to receive and merge a left-hand gesture and a right-hand gesture, and perform an operation corresponding to the merged left-hand gesture and right-hand gesture.
Or, when the terminal device is placed in the second direction, for example, as shown in fig. 6, the first group of sensing modules 110 in fig. 3 includes a third sensing module 203, where the third sensing module 203 is configured to obtain the first electromagnetic wave signal after being affected by the left-hand gesture, and transmit the first electromagnetic wave signal to the first recognition processing module 131; the first recognition processing module 131 is configured to recognize the left-hand gesture according to the first electromagnetic wave signal acquired by the third sensing module 203, and send the left-hand gesture to the application layer 140. Similarly, the second sensing module group 120 in fig. 3 includes a fourth sensing module 204, and the fourth sensing module 204 is configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture, and transmit the second electromagnetic wave signal to the second recognition processing module 132; the second recognition processing module 131 is configured to recognize the right hand gesture according to the second electromagnetic wave signal acquired by the fourth sensing module 204, and send the right hand gesture to the application layer 140. The application layer 140 is configured to receive and combine the left-hand gesture and the right-hand gesture, and perform an operation corresponding to the left-hand gesture and the right-hand gesture.
Alternatively, the at least one identification processing module in the terminal device 200 may further include a third identification processing module corresponding to the case shown in fig. 4. Specifically, when the terminal device 200 is placed in the first direction, for example, as shown in fig. 5, the first group sensing module 110 in fig. 4 includes a first sensing module 201, and the first sensing module 201 is configured to acquire a first electromagnetic wave signal affected by a left hand gesture, and transmit the first electromagnetic wave signal to the third recognition processing module 133, so that the third recognition processing module 133 recognizes the left hand gesture according to the first electromagnetic wave signal acquired by the first sensing module 201. Similarly, the second sensing module 120 in fig. 4 includes a second sensing module 202, and the second sensing module 202 is configured to acquire a second electromagnetic wave signal after being affected by the right-hand gesture and transmit the second electromagnetic wave signal to the third recognition processing module 133, so that the third recognition processing module 133 recognizes the right-hand gesture according to the second electromagnetic wave signal acquired by the second sensing module. The third recognition processing module 133 recognizes the left-hand gesture and the right-hand gesture, combines the left-hand gesture and the right-hand gesture, and sends the combined left-hand gesture and right-hand gesture to the application layer 140. The application layer 140 is configured to receive the combined left-hand gesture and right-hand gesture, and perform an operation corresponding to the combined left-hand gesture and right-hand gesture.
Or, when the terminal device is placed in the second direction, that is, as shown in fig. 6, the first group of sensing modules 110 in fig. 4 includes a third sensing module 203, where the third sensing module 203 is configured to acquire a first electromagnetic wave signal affected by a left-hand gesture, and transmit the first electromagnetic wave signal to the third recognition processing module 133, so that the third recognition processing module 133 recognizes the left-hand gesture according to the first electromagnetic wave signal acquired by the first sensing module 201. Similarly, the second sensing module 120 in fig. 4 includes a fourth sensing module 204, and the fourth sensing module 204 is configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture and transmit the second electromagnetic wave signal to the third recognition processing module 133. The third recognition processing module 133 recognizes the left-hand gesture and the right-hand gesture, combines the left-hand gesture and the right-hand gesture, and sends the combined left-hand gesture and right-hand gesture to the application layer 140. The application layer 140 is configured to receive the combined left-hand gesture and right-hand gesture, and perform an operation corresponding to the combined left-hand gesture and right-hand gesture.
It should be understood that, when the terminal device 200 is placed in the first direction or the second direction, the four sensing modules correspond to the first sensing module 110 and the second sensing module 120 in fig. 3 and fig. 4, respectively, according to the above description, and therefore, the terminal device 200 is suitable for the description of the parts of fig. 3 and fig. 4 of the terminal device 100, and is not repeated herein for brevity.
Alternatively, as a second embodiment, considering the motion recognition of each hand, which can be performed by a plurality of sensing modules, fig. 7 and 8 show schematic diagrams of a terminal device 300 according to an embodiment of the present application. As shown in fig. 7 and 8, the terminal device 300 may include four sensing modules, which are respectively located at four corners of the rectangular terminal device, and the four sensing modules include: a first sensing module 301, a second sensing module 302, a third sensing module 303 and a fourth sensing module 304.
It should be understood that the terminal device 300 corresponds to the terminal device 100, and four sensing modules in the terminal device 300 are one possible arrangement of two sets of sensing modules included in the terminal device 100. In contrast to the terminal device 100, the terminal device 300 can be regarded as including a first group of sensing modules 110 and a second group of sensing modules 120, but when the terminal device 300 is located at different directions, the sensing modules included in the first group of sensing modules 110 or the second group of sensing modules 120 are different.
Specifically, as shown in fig. 7, as with the placement direction of the terminal device 200 of fig. 5, when the terminal device 300 is placed in the first direction, it means that the terminal device 300 is in the landscape state. When the terminal device 300 is placed in the first direction, the first group of sensing modules includes the first sensing module 301 and the second sensing module 302 that are adjacent to each other, that is, the first sensing module 301 and the second sensing module 302 correspond to the first group of sensing modules 110 included in the terminal device 100; the second sensing module group includes the third sensing module 303 and the fourth sensing module 304 which are adjacent to each other, that is, the third sensing module 303 and the fourth sensing module 304 correspond to the second sensing module group 120 included in the terminal device 100.
Specifically, the terminal device 300 is placed in a first direction, and the first sensing module 301 and the second sensing module 302 are configured to obtain a first electromagnetic wave signal after being affected by a left-hand gesture, for example, the first sensing module 301 obtains an electromagnetic wave signal after being affected by the left-hand gesture, and the second sensing module 302 also obtains an electromagnetic wave signal after being affected by the left-hand gesture, where the first electromagnetic wave signal includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the second sensing module 302; in contrast, the third sensing module 303 and the fourth sensing module 304 are configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture, for example, the third sensing module 303 acquires the electromagnetic wave signal after being affected by the right-hand gesture, and the fourth sensing module 304 acquires the electromagnetic wave signal after being affected by the right-hand gesture, so that the second electromagnetic wave signal includes the electromagnetic wave signal acquired by the third sensing module 303 and the electromagnetic wave signal acquired by the fourth sensing module 304.
It should be understood that when the terminal device 300 is placed in the first direction in the embodiment of the present application, the terminal device 300 is in the landscape state, and the landscape state includes rotating the upright terminal device 300 counterclockwise and may also include rotating the upright terminal device 300 clockwise. No matter which direction the cross screen is, the first sensing module 301 and the second sensing module 302 of the present embodiment represent two sensing modules located at the left corner, the third sensing module 303 and the fourth sensing module 304 represent two sensing modules located at the right corner, and accordingly, the first sensing module 301 and the second sensing module 302 are configured to detect electromagnetic wave signals of the left hand, and the third sensing module 303 and the fourth sensing module 304 are configured to detect electromagnetic wave signals of the right hand.
As shown in fig. 8, as with the placement direction of the terminal device 200 of fig. 6, when the terminal device 300 is placed in a second direction, which is perpendicular or approximately perpendicular to the first direction, the terminal device 300 is in a portrait state. When the terminal device 300 is placed in the second direction, the first group of sensing modules of the terminal device 300 includes the second sensing module 302 and the fourth sensing module 304, that is, the second sensing module 302 and the fourth sensing module 304 correspond to the first group of sensing modules 110 included in the terminal device 100; the second sensing module set of the terminal device 300 includes the first sensing module 301 and the third sensing module 304, that is, the first sensing module 301 and the third sensing module 304 correspond to the second sensing module set 120 included in the terminal device 100.
Specifically, the terminal device 300 is placed in the second direction, and the second sensing module 302 and the fourth sensing module 304 are used to acquire the first electromagnetic wave signal after being affected by the left-hand gesture, for example, the second sensing module 302 acquires the electromagnetic wave signal after being affected by the left-hand gesture, and the fourth sensing module 304 acquires the electromagnetic wave signal after being affected by the left-hand gesture, so that the first electromagnetic wave signal includes the electromagnetic wave signal acquired by the second sensing module 302 and the electromagnetic wave signal acquired by the fourth sensing module 304; in contrast, the first sensing module 301 and the third sensing module 303 are configured to obtain the second electromagnetic wave signal after being affected by the right-hand gesture, for example, the first sensing module 301 obtains the electromagnetic wave signal after being affected by the right-hand gesture, and the third sensing module 303 obtains the electromagnetic wave signal after being affected by the right-hand gesture, and the second electromagnetic wave signal includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the third sensing module 303.
Similar to the first direction, the terminal device 300 placed according to the second direction indicates that the terminal device 300 is in a vertical screen state, and the vertical screen state may include placing the terminal device 300 right side or placing the terminal device 300 upside down. No matter which direction the vertical screen is, the second sensing module 302 and the fourth sensing module 304 of the embodiment of the present application represent two sensing modules located at the left corner, the first sensing module 301 and the third sensing module 303 represent two sensing modules located at the right corner, and accordingly, the second sensing module 302 and the fourth sensing module 304 are configured to detect the electromagnetic wave signal of the left hand, and the first sensing module 301 and the third sensing module 303 are configured to detect the electromagnetic wave signal of the right hand. That is, the numbering sequence of the four sensing modules in fig. 7 and 8 is only one possibility, and other sequences are also possible, and the embodiment of the present application is not limited thereto.
Optionally, the terminal device 300 may further include an orientation sensor, and the orientation sensor may be configured to: it is identified whether the terminal device 300 is placed in the first direction or the second direction. The direction sensor may be a sensor carried by the terminal device, and is used to identify whether the terminal device is currently in a landscape screen state or a portrait screen state, for example, the direction sensor may be a gyroscope, and the embodiment of the present application is not limited thereto.
Alternatively, four sensing modules are disposed at four corners of the terminal device 300, and the position of each sensing module can be adjusted according to practical applications, and fig. 7 and 8 are only one possibility. For example, each of the sensing modules in fig. 7 and 8 is rectangular and is located at one corner of the terminal device 300, and each of the sensing modules has one corner coinciding with one corner of the corresponding terminal device 300, but each of the sensing modules may have no other shape and be located at other positions near each corner. For example, the first sensing module 301 is located at one corner of the terminal device in fig. 7 and 8, and two edges of the first sensing module 301 coincide with two edges of the terminal device 300, but the first sensing module 301 may also be located close to one corner of the terminal device 300, that is, an edge of the first sensing module 301 may be located at a certain distance from an edge of the terminal device 300, and the corner does not coincide with the corner, and the embodiment of the present application is not limited thereto.
In this embodiment of the application, when the four sensing modules are disposed at four corners of the terminal device 300, when the terminal device 300 is in different directions, the recognition processing module and the application layer may also be disposed differently.
Alternatively, the at least one recognition processing module in the terminal device 300 includes a first recognition processing module and a second recognition processing module, corresponding to the case shown in fig. 3. Specifically, when the terminal device 300 is placed in the first direction, for example, as shown in fig. 7, the first group sensing module 110 in fig. 3 includes a first sensing module 301 and a second sensing module 302, that is, fig. 9 shows a schematic block diagram of the respective modules when the terminal device 300 is placed in the first direction, and as shown in fig. 9, the first sensing module 301 and the second sensing module 302 are configured to obtain the first electromagnetic wave signal after being affected by the left-hand gesture and transmit the first electromagnetic wave signal to the first recognition processing module 131. For example, the first sensing module 301 is configured to sense and acquire an electromagnetic wave signal affected by a left-hand gesture, and transmit the electromagnetic wave signal to the first recognition processing module 131; the second sensing module 302 is used for sensing and acquiring the electromagnetic wave signal affected by the left-hand gesture, and transmitting the electromagnetic wave signal to the first recognition processing module 131. That is to say, the first electromagnetic wave signal obtained by the first recognition processing module 131 after being affected by the left-hand gesture includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the second sensing module 301. The first recognition processing module 131 is configured to recognize the left-hand gesture according to the acquired first electromagnetic wave signal, and then transmit the recognized left-hand gesture to the application layer 140.
Similarly, the second sensing module group 120 in fig. 3 includes a third sensing module 303 and a fourth sensing module 304, that is, as shown in fig. 9, the third sensing module 303 and the fourth sensing module 304 are configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture and transmit the second electromagnetic wave signal to the second recognition processing module 132. For example, the third sensing module 303 is configured to sense and acquire an electromagnetic wave signal after being affected by the right-hand gesture, and transmit the electromagnetic wave signal to the second recognition processing module 132; the fourth sensing module 304 is used for sensing and acquiring the electromagnetic wave signal after being affected by the right hand gesture, and transmitting the electromagnetic wave signal to the second recognition processing module 132. That is, the second electromagnetic wave signal obtained by the second recognition processing module 132 after being affected by the right-hand gesture includes the electromagnetic wave signal obtained by the third sensing module 303 and the electromagnetic wave signal obtained by the fourth sensing module 304. The second recognition processing module 132 is configured to recognize the right-hand gesture according to the acquired second electromagnetic wave signal, and then transmit the recognized right-hand gesture to the application layer 140. The application layer 140 merges the received left-hand gesture and the right-hand gesture, and performs an operation corresponding to the merged left-hand gesture and right-hand gesture.
Alternatively, when the terminal device 300 is placed in the second direction, for example, as shown in fig. 8, the first group sensing module 110 in fig. 3 includes a second sensing module 302 and a fourth sensing module 304, that is, fig. 10 shows a schematic block diagram of each module when the terminal device 300 is placed in the second direction, and as shown in fig. 10, the second sensing module 302 and the fourth sensing module 304 are configured to obtain the first electromagnetic wave signal after being affected by the left-hand gesture and transmit the first electromagnetic wave signal to the first recognition processing module 131. For example, the second sensing module 302 is configured to sense and acquire an electromagnetic wave signal affected by a left-hand gesture, and transmit the electromagnetic wave signal to the first recognition processing module 131; the fourth sensing module 304 is used for sensing and acquiring the electromagnetic wave signal after being influenced by the left-hand gesture, and transmitting the electromagnetic wave signal to the first recognition processing module 131. That is, the first electromagnetic wave signal obtained by the first recognition processing module 131 after being affected by the left-hand gesture includes the electromagnetic wave signal obtained by the second sensing module 302 and the electromagnetic wave signal obtained by the fourth sensing module 304. The first recognition processing module 131 is configured to recognize the left-hand gesture according to the acquired first electromagnetic wave signal, and then transmit the recognized left-hand gesture to the application layer 140.
Similarly, the second sensing module group 120 in fig. 3 includes a first sensing module 301 and a third sensing module 303, that is, as shown in fig. 10, the first sensing module 301 and the third sensing module 303 are configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture and transmit the second electromagnetic wave signal to the second recognition processing module 132. For example, the first sensing module 303 is configured to sense and acquire an electromagnetic wave signal affected by a right-hand gesture, and transmit the electromagnetic wave signal to the second recognition processing module 132; the third sensing module 303 is used for sensing and acquiring the electromagnetic wave signal after being influenced by the right hand gesture, and transmitting the electromagnetic wave signal to the second recognition processing module 132. That is, the second electromagnetic wave signal obtained by the second recognition processing module 132 after being affected by the right-hand gesture includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the third sensing module 303. The second recognition processing module 132 is configured to recognize the right-hand gesture according to the acquired second electromagnetic wave signal, and then transmit the recognized right-hand gesture to the application layer 140. The application layer 140 merges the received left-hand gesture and the right-hand gesture, and performs an operation corresponding to the left-hand gesture and the right-hand gesture.
Alternatively, the at least one recognition processing module of the terminal device 300 includes a third recognition processing module, corresponding to the case shown in fig. 4. Specifically, when the terminal device 300 is placed in the first direction, for example, as shown in fig. 7, the first group sensing module 110 in fig. 4 includes a first sensing module 301 and a second sensing module 302, and the first sensing module 301 and the second sensing module 302 are configured to acquire the first electromagnetic wave signal after being affected by the left-hand gesture and transmit the first electromagnetic wave signal to the third recognition processing module 133. For example, the first sensing module 301 is configured to sense and acquire an electromagnetic wave signal affected by a left hand gesture, and transmit the electromagnetic wave signal to the third recognition processing module 133; the second sensing module 302 is also used for sensing and acquiring the electromagnetic wave signal after being affected by the left-hand gesture, and transmitting the electromagnetic wave signal to the third recognition processing module 133. That is to say, the electromagnetic wave signals acquired by the third recognition processing module 133 after being affected by the left-hand gesture include the electromagnetic wave signals acquired by the first sensing module 301 and the electromagnetic wave signals acquired by the second sensing module 302.
Similarly, the second sensing module group 120 in fig. 4 includes a third sensing module 303 and a fourth sensing module 304, and the third sensing module 303 and the fourth sensing module 304 are configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture and transmit the second electromagnetic wave signal to the third recognition processing module 133. For example, the third sensing module 303 is configured to sense and acquire an electromagnetic wave signal affected by the right-hand gesture, and transmit the electromagnetic wave signal to the third recognition processing module 133; the fourth sensing module 304 is used for sensing and acquiring the electromagnetic wave signal affected by the right hand gesture, and transmitting the electromagnetic wave signal to the third recognition processing module 133. That is, the second electromagnetic wave signal obtained by the third recognition processing module 133 after being affected by the right-hand gesture includes the electromagnetic wave signal obtained by the third sensing module 303 and the electromagnetic wave signal obtained by the fourth sensing module 304.
Corresponding to fig. 4, fig. 11 shows a schematic block diagram of each module when the terminal device 300 is placed in the first direction, as shown in fig. 11, the electromagnetic wave signals acquired by the four sensing modules are all transmitted to the third recognition processing module 133, and the third recognition processing module 133 can determine whether the electromagnetic wave signals acquired by each module correspond to a left hand gesture or a right hand gesture according to the current direction of the terminal device 300. For example, when the terminal device 300 is placed in the first direction, the third recognition processing module 133 is configured to recognize the left-hand gesture according to the first electromagnetic wave signals acquired by the first sensing module 301 and the second sensing module 302, recognize the right-hand gesture according to the second electromagnetic wave signals acquired by the third sensing module 303 and the fourth sensing module 304, combine the left-hand gesture and the right-hand gesture, and send the combined gesture to the application layer 140. The application layer 140 receives the combined left-hand gesture and right-hand gesture, and performs an operation corresponding to the combined left-hand gesture and right-hand gesture.
Or, when the terminal device 300 is placed in the second direction, for example, as shown in fig. 8, the first group sensing module 110 in fig. 4 includes a second sensing module 302 and a fourth sensing module 304, and the second sensing module 302 and the fourth sensing module 304 are configured to obtain the first electromagnetic wave signal after being affected by the left-hand gesture and transmit the first electromagnetic wave signal to the third recognition processing module 133. For example, the second sensing module 302 is configured to sense and acquire an electromagnetic wave signal affected by the left hand gesture, and transmit the electromagnetic wave signal to the third recognition processing module 133; the fourth sensing module 304 is used for sensing and acquiring the electromagnetic wave signal after being affected by the left-hand gesture, and transmitting the electromagnetic wave signal to the third recognition processing module 133. That is, the first electromagnetic wave signal obtained by the third recognition processing module 133 after being affected by the left-hand gesture includes the electromagnetic wave signal obtained by the second sensing module 302 and the electromagnetic wave signal obtained by the fourth sensing module 304.
Similarly, the second sensing module group 120 in fig. 4 includes a first sensing module 301 and a third sensing module 303, and the first sensing module 301 and the third sensing module 303 are configured to acquire the second electromagnetic wave signal after being affected by the right-hand gesture and transmit the second electromagnetic wave signal to the third recognition processing module 133. For example, the first sensing module 303 is configured to sense and acquire an electromagnetic wave signal affected by a right-hand gesture, and transmit the electromagnetic wave signal to the third recognition processing module 133; the third sensing module 303 is used for sensing and acquiring the electromagnetic wave signal affected by the right hand gesture, and transmitting the electromagnetic wave signal to the third recognition processing module 133. That is, the second electromagnetic wave signal obtained by the third recognition processing module 133 after being affected by the right-hand gesture includes the electromagnetic wave signal obtained by the first sensing module 301 and the electromagnetic wave signal obtained by the third sensing module 303.
Corresponding to fig. 4, as shown in fig. 11, the electromagnetic wave signals acquired by the four sensing modules are all transmitted to the third recognition processing module 133, and the third recognition processing module 133 can determine whether the electromagnetic wave signals acquired by each module correspond to a left hand gesture or a right hand gesture according to the current direction of the terminal 300. For example, when the terminal device 300 is placed in the second direction, the third recognition processing module 133 recognizes the left-hand gesture according to the first electromagnetic wave signals acquired by the second sensing module 302 and the fourth sensing module 304, recognizes the right-hand gesture according to the second electromagnetic wave signals acquired by the first sensing module 301 and the third sensing module 303, combines the left-hand gesture and the right-hand gesture, and sends the combined left-hand gesture and right-hand gesture to the application layer 140. The application layer 140 receives the combined left-hand gesture and right-hand gesture, and performs an operation corresponding to the combined left-hand gesture and right-hand gesture.
It should be understood that, when the terminal device 300 is placed in the first direction or the second direction, the four sensing modules correspond to the first sensing module 110 and the second sensing module 120 in fig. 3 and fig. 4, respectively, according to the above description, and therefore, the terminal device 300 is suitable for the description related to the parts of fig. 3 and fig. 4 of the terminal device 100, and is not repeated herein for brevity.
It should be understood that in the second embodiment, for any one of the first identification processing module 131, the second identification processing module 132 and the third identification processing module 133, the electromagnetic wave signals of the plurality of sensing modules need to be processed. Specifically, when the any one identification processing module processes the electromagnetic wave signals of the plurality of sensing modules, any one of the following manners may be adopted: selecting the recognition result with the maximum probability as the recognition result of the corresponding recognition processing module; the results of the multiple sensing modules are processed, such as performing an arithmetic average or a weighted average, to obtain the recognition result, but the embodiment of the present application is not limited thereto.
Therefore, the terminal device of the embodiment of the application is provided with at least two groups of sensing modules, which are respectively used for sensing the electromagnetic wave signals after being influenced by the left-hand gesture and the electromagnetic wave signals after being influenced by the right-hand gesture, for example, four sensing modules can be arranged according to the first embodiment and the second embodiment, so that no matter the terminal device is a horizontal screen or a vertical screen, the corresponding sensing modules are respectively used for acquiring the electromagnetic wave signals after being influenced by the left-hand gesture and the right-hand gesture, and gesture recognition is performed through the recognition processing module, so that recognition of the two-hand gesture is realized, and the two-hand recognition and the combined operation in a game scene are realized.
The embodiment of the present application is described in detail from the perspective of the terminal device in the foregoing with reference to fig. 1 to 11, and a method for recognizing a gesture for operating the terminal device in the embodiment of the present application will be described below with reference to fig. 12.
Fig. 12 shows a schematic flow chart of a method 400 of recognizing a gesture of operating a terminal device according to an embodiment of the application. The method 400 may be performed by a terminal device, where the terminal device includes a first group of sensing modules and a second group of sensing modules, the first group of sensing modules and the second group of sensing modules respectively include at least one sensing module, and the second group of sensing modules and the first group of sensing modules are respectively located at two opposite ends of the terminal device. For example, the terminal device may refer to any one of the terminal devices 100, 200, and 300 described in fig. 1 to 11.
Specifically, as shown in fig. 12, the method 400 includes: s410, sensing the waveform of the electromagnetic wave through the first group of sensing modules, and acquiring a first electromagnetic wave signal influenced by a left-hand gesture; s420, sensing the waveform of the electromagnetic wave through the second group of sensing modules, and acquiring a second electromagnetic wave signal influenced by the right hand gesture; s430, recognizing the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal, and executing operations corresponding to the left hand gesture and the right hand gesture.
Optionally, as an embodiment, the terminal device includes four sensing modules, where the four sensing modules are respectively located on four sides of the rectangular terminal device, and the four sensing modules include: the device comprises a first induction module, a second induction module, a third induction module and a fourth induction module; when the terminal equipment is placed in a first direction, the first group of sensing modules comprises the first sensing module, and the second group of sensing modules comprises the second sensing module; when the terminal equipment is placed in a second direction, the first group of induction modules comprise the third induction module; the second group of sensing modules comprises the fourth sensing module; the first direction is perpendicular to the second direction.
Optionally, as an embodiment, the four sensing modules are respectively located at the center positions of four sides of the rectangular terminal device.
Optionally, as an embodiment, the recognizing the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal includes: if the terminal equipment is placed in the first direction, the left-hand gesture is recognized according to the first electromagnetic wave signal acquired through the first induction module; recognizing the right hand gesture according to the second electromagnetic wave signal acquired by the second sensing module; if the terminal equipment is placed in the second direction, the left-hand gesture is recognized according to the first electromagnetic wave signal acquired through the third induction module; and recognizing the right hand gesture according to the second electromagnetic wave signal acquired by the fourth sensing module.
Optionally, as an embodiment, the terminal device includes four sensing modules, the four sensing modules are respectively located at four corners of the rectangular terminal device, and the four sensing modules include: the device comprises a first induction module, a second induction module, a third induction module and a fourth induction module; when the terminal equipment is placed in a first direction, the first group of induction modules comprise the first induction module and the second induction module which are adjacent, and the second group of induction modules comprise the third induction module and the fourth induction module which are adjacent; when the terminal equipment is placed in a second direction, the first group of induction modules comprise the second induction module and the fourth induction module; the second group of sensing modules comprises the first sensing module and the third sensing module; the first direction is perpendicular to the second direction.
Optionally, as an embodiment, the recognizing the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal includes: if the terminal equipment is placed in the first direction, the left-hand gesture is recognized according to the first electromagnetic wave signals acquired by the first induction module and the second induction module; recognizing the right hand gesture according to the second electromagnetic wave signals acquired by the third induction module and the fourth induction module; if the terminal device is placed in the second direction, the left-hand gesture is recognized according to the first electromagnetic wave signals acquired by the second induction module and the fourth induction module; and recognizing the right hand gesture according to the second electromagnetic wave signals acquired by the first induction module and the third induction module.
Optionally, as an embodiment, the method further includes: and determining that the terminal equipment is placed according to the first direction or the second direction through a direction sensor in the terminal equipment.
Optionally, as an embodiment, the electromagnetic wave signal is a millimeter wave radio signal.
Optionally, as an embodiment, the method 40 further includes: sending third electromagnetic wave information through the first group of induction modules at a first time, wherein the third electromagnetic wave signal is used for acquiring the first electromagnetic wave signal; and sending fourth electromagnetic wave information through the second group of induction modules at the first time, wherein the fourth electromagnetic wave signal is used for acquiring the second electromagnetic wave signal.
Optionally, as an embodiment, the method 400 further includes: and transmitting the service data at a second time, wherein the first time and the second time do not overlap.
Optionally, as an embodiment, the transmitting the service data at the second time includes: and transmitting the service data through the first group of sensing modules and/or the second group of sensing modules at the second time.
Therefore, according to the method for recognizing the gesture of the operation terminal device in the embodiment of the application, at least two groups of sensing modules are arranged on the terminal device and are respectively used for sensing the electromagnetic wave signals affected by the left-hand gesture and the electromagnetic wave signals affected by the right-hand gesture, for example, four sensing modules can be arranged on four sides or four corners of the terminal device, so that no matter the terminal device is a horizontal screen or a vertical screen, the corresponding sensing modules are respectively used for acquiring the electromagnetic wave signals affected by the left-hand gesture and the right-hand gesture, the corresponding gesture can be recognized according to the electromagnetic wave signals, and then the operation corresponding to the gesture is executed, so that the recognition of the two-hand gesture can be realized, and the two-hand recognition and the combined operation in a game scene can be realized.
It should be understood that, in the various embodiments of the present application, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
In addition, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
It should be understood that the processor of the embodiments of the present application may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method embodiments may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, or discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
It will be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of example, but not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous DRAM, SDRAM), Double Data Rate Synchronous Dynamic random access memory (DDR SDRAM), Enhanced Synchronous SDRAM (ESDRAM), Synchronous link SDRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
It should be understood that the above memories are exemplary but not limiting illustrations, for example, the memories in the embodiments of the present application may also be Static Random Access Memory (SRAM), dynamic random access memory (dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (enhanced SDRAM, ESDRAM), Synchronous Link DRAM (SLDRAM), Direct Rambus RAM (DR RAM), and the like. That is, the memory in the embodiments of the present application is intended to comprise, without being limited to, these and any other suitable types of memory.
The embodiment of the application also provides a computer readable storage medium for storing the computer program.
Optionally, the computer-readable storage medium may be applied to the mobile terminal/terminal device in the embodiment of the present application, and the computer program enables the computer to execute the corresponding process implemented by the mobile terminal/terminal device in each method in the embodiment of the present application, which is not described herein again for brevity.
Embodiments of the present application also provide a computer program product comprising computer program instructions.
Optionally, the computer program product may be applied to the mobile terminal/terminal device in the embodiment of the present application, and the computer program instructions enable the computer to execute the corresponding processes implemented by the mobile terminal/terminal device in the methods in the embodiment of the present application, which are not described herein again for brevity.
The embodiment of the application also provides a computer program.
Optionally, the computer program may be applied to the mobile terminal/terminal device in the embodiment of the present application, and when the computer program runs on a computer, the computer is enabled to execute the corresponding process implemented by the mobile terminal/terminal device in each method in the embodiment of the present application, which is not described herein again for brevity.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (25)
- A terminal device, comprising:the first group of sensing modules are used for acquiring a first electromagnetic wave signal influenced by a left hand gesture by sensing the waveform of an electromagnetic wave, and each first group of sensing modules comprises at least one sensing module;the second group of sensing modules are used for acquiring a second electromagnetic wave signal influenced by the gesture of the right hand by sensing the waveform of the electromagnetic wave, and each second group of sensing modules comprises at least one sensing module;the second group of induction modules and the first group of induction modules are respectively positioned at two opposite ends of the terminal equipment;at least one recognition processing module for recognizing the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal;and the application layer is used for receiving the left-hand gesture and the right-hand gesture which are identified by the at least one identification processing module and executing the operation corresponding to the left-hand gesture and the right-hand gesture.
- The terminal device according to claim 1, wherein the terminal device comprises four sensing modules, the four sensing modules are respectively located on four sides of the rectangular terminal device, and the four sensing modules comprise: the device comprises a first induction module, a second induction module, a third induction module and a fourth induction module;when the terminal equipment is placed in a first direction, the first group of induction modules comprise the first induction module, and the second group of induction modules comprise the second induction module;when the terminal equipment is placed in a second direction, the first group of induction modules comprise the third induction module; the second group of sensing modules comprises the fourth sensing module;the first direction is perpendicular to the second direction.
- The terminal device of claim 2, wherein the four sensing modules are respectively located at the center of four sides of the rectangular terminal device.
- The terminal device according to claim 2 or 3, wherein the at least one identification processing module comprises a first identification processing module and a second identification processing module,when the terminal device is placed in the first direction, the first recognition processing module is used for recognizing the left-hand gesture according to the first electromagnetic wave signal acquired by the first induction module; the second identification processing module is used for identifying the right hand gesture according to the second electromagnetic wave signal acquired by the second induction module; the application layer is used for receiving and merging the left-hand gesture recognized by the first recognition processing module and the right-hand gesture recognized by the second recognition processing module, and executing operation corresponding to the merged left-hand gesture and right-hand gesture;when the terminal device is placed in the second direction, the first recognition processing module is used for recognizing the left-hand gesture according to the first electromagnetic wave signal acquired by the third induction module; the second identification processing module is used for identifying the right hand gesture according to the second electromagnetic wave signal acquired by the fourth induction module; the application layer is used for receiving and combining the left-hand gesture recognized by the first recognition processing module and the right-hand gesture recognized by the second recognition processing module, and executing operation corresponding to the left-hand gesture and the right-hand gesture.
- The terminal device according to claim 2 or 3, wherein the at least one identification processing module comprises a third identification processing module,when the terminal device is placed in the first direction, the third recognition processing module is used for recognizing the left-hand gesture according to the first electromagnetic wave signal acquired by the first sensing module, recognizing the right-hand gesture according to the second electromagnetic wave signal acquired by the second sensing module, and combining the left-hand gesture and the right-hand gesture; the application layer is used for receiving the combined left-hand gesture and the combined right-hand gesture and executing the operation corresponding to the combined left-hand gesture and the combined right-hand gesture;when the terminal device is placed in the second direction, the third recognition processing module is configured to recognize the left-hand gesture according to the first electromagnetic wave signal acquired by the third sensing module, recognize the right-hand gesture according to the second electromagnetic wave signal acquired by the fourth sensing module, and combine the left-hand gesture and the right-hand gesture; and the application layer is used for receiving the combined left-hand gesture and the right-hand gesture and executing the operation corresponding to the combined left-hand gesture and the combined right-hand gesture.
- The terminal device of claim 1, wherein the terminal device comprises four sensing modules, the four sensing modules are respectively located at four corners of the rectangular terminal device, and the four sensing modules comprise: the device comprises a first induction module, a second induction module, a third induction module and a fourth induction module;when the terminal equipment is placed in a first direction, the first group of induction modules comprise the first induction module and the second induction module which are adjacent, and the second group of induction modules comprise the third induction module and the fourth induction module which are adjacent;when the terminal equipment is placed in a second direction, the first group of induction modules comprise the second induction module and the fourth induction module; the second group of sensing modules comprises the first sensing module and the third sensing module;the first direction is perpendicular to the second direction.
- The terminal device of claim 6, wherein the at least one identity processing module comprises a first identity processing module and a second identity processing module,when the terminal device is placed in the first direction, the first recognition processing module is used for recognizing the left-hand gesture according to the first electromagnetic wave signals acquired by the first induction module and the second induction module; the second identification processing module is used for identifying the right hand gesture according to the second electromagnetic wave signals acquired by the third induction module and the fourth induction module; the application layer is used for receiving and merging the left-hand gesture and the right-hand gesture identified by the identification processing module, and executing operation corresponding to the merged left-hand gesture and right-hand gesture;when the terminal device is placed in the second direction, the first recognition processing module is used for recognizing the left-hand gesture according to the first electromagnetic wave signals acquired by the second induction module and the fourth induction module; the second identification processing module is used for identifying the right hand gesture according to the second electromagnetic wave signals acquired by the first induction module and the third induction module; the application layer is used for receiving and combining the left-hand gesture and the right-hand gesture identified by the identification processing module, and executing operation corresponding to the left-hand gesture and the right-hand gesture.
- The terminal device of claim 6, wherein the at least one identity processing module comprises a third identity processing module,when the terminal device is placed in the first direction, the third recognition processing module is configured to recognize the left-hand gesture according to the first electromagnetic wave signals acquired by the first sensing module and the second sensing module, recognize the right-hand gesture according to the second electromagnetic wave signals acquired by the third sensing module and the fourth sensing module, and combine the left-hand gesture and the right-hand gesture; the application layer is used for receiving the combined left-hand gesture and the combined right-hand gesture and executing the operation corresponding to the combined left-hand gesture and the combined right-hand gesture;when the terminal device is placed in the second direction, the third recognition processing module is configured to recognize the left-hand gesture according to the first electromagnetic wave signals acquired by the second sensing module and the fourth sensing module, recognize the right-hand gesture according to the second electromagnetic wave signals acquired by the first sensing module and the third sensing module, and combine the left-hand gesture and the right-hand gesture; and the application layer is used for receiving the combined left-hand gesture and the right-hand gesture and executing the operation corresponding to the combined left-hand gesture and the combined right-hand gesture.
- The terminal device according to any one of claims 2 to 8, wherein the terminal device further comprises:and the direction sensor is used for identifying that the terminal equipment is placed according to the first direction or the second direction.
- The terminal device according to any one of claims 1 to 9, characterized in that the electromagnetic wave signal is a millimeter wave radio signal.
- The terminal device of any one of claims 1 to 10, wherein the first set of sensing modules is further configured to:sending a third electromagnetic wave signal at a first time, wherein the third electromagnetic wave signal is used for acquiring the first electromagnetic wave signal;the second set of sensing modules is further configured to:and sending a fourth electromagnetic wave signal at the first time, wherein the fourth electromagnetic wave signal is used for acquiring the second electromagnetic wave signal.
- The terminal device of claim 11, wherein the first set of sensing modules and/or the second set of sensing modules are further configured to:transmitting traffic data at a second time, wherein the first time and the second time do not overlap.
- The terminal device of claim 11,the terminal device further includes:and the transmission module is used for transmitting the service data at a second time, and the first time and the second time are not overlapped.
- The terminal device of claim 13, wherein the transmission module is further configured to:sending the second time to the first group of sensing modules and/or the second group of sensing modules;the first set of sensing modules and/or the second set of sensing modules are configured to:and determining the first time according to the second time.
- A method for recognizing gestures of operating a terminal device, the terminal device comprising a first group of sensing modules and a second group of sensing modules, the first group of sensing modules and the second group of sensing modules respectively comprising at least one sensing module, the second group of sensing modules and the first group of sensing modules being respectively located at two opposite ends of the terminal device, the method comprising:sensing the waveform of the electromagnetic wave through the first group of sensing modules, and acquiring a first electromagnetic wave signal influenced by a left-hand gesture;sensing the waveform of the electromagnetic wave through the second group of sensing modules to obtain a second electromagnetic wave signal influenced by the gesture of the right hand;and recognizing the left hand gesture and the right hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal, and executing the operation corresponding to the left hand gesture and the right hand gesture.
- The method of claim 15, wherein the terminal device comprises four sensing modules, and wherein the four sensing modules are respectively located on four sides of the rectangular terminal device, and wherein the four sensing modules comprise: the device comprises a first induction module, a second induction module, a third induction module and a fourth induction module;when the terminal equipment is placed in a first direction, the first group of induction modules comprise the first induction module, and the second group of induction modules comprise the second induction module;when the terminal equipment is placed in a second direction, the first group of induction modules comprise the third induction module; the second group of sensing modules comprises the fourth sensing module;the first direction is perpendicular to the second direction.
- The method of claim 16, wherein the four sensing modules are respectively located at the center of four sides of the rectangular terminal device.
- The method according to claim 16 or 17, wherein the identifying the left-hand gesture and the right-hand gesture according to the first electromagnetic wave signal and the second electromagnetic wave signal comprises:if the terminal equipment is placed in the first direction, recognizing the left-hand gesture according to the first electromagnetic wave signal acquired through the first induction module; recognizing the right hand gesture according to the second electromagnetic wave signal acquired by the second sensing module;if the terminal equipment is placed in the second direction, recognizing the left-hand gesture according to the first electromagnetic wave signal acquired through the third induction module; and recognizing the right hand gesture according to the second electromagnetic wave signal acquired by the fourth sensing module.
- The method of claim 15, wherein the terminal device comprises four sensing modules, the four sensing modules are respectively located at four corners of the rectangular terminal device, and the four sensing modules comprise: the device comprises a first induction module, a second induction module, a third induction module and a fourth induction module;when the terminal equipment is placed in a first direction, the first group of induction modules comprise the first induction module and the second induction module which are adjacent, and the second group of induction modules comprise the third induction module and the fourth induction module which are adjacent;when the terminal equipment is placed in a second direction, the first group of induction modules comprise the second induction module and the fourth induction module; the second group of sensing modules comprises the first sensing module and the third sensing module;the first direction is perpendicular to the second direction.
- The method of claim 19, wherein said identifying the left-hand gesture and the right-hand gesture based on the first electromagnetic wave signal and the second electromagnetic wave signal comprises:if the terminal equipment is placed in the first direction, recognizing the left-hand gesture according to the first electromagnetic wave signals acquired by the first induction module and the second induction module; recognizing the right hand gesture according to the second electromagnetic wave signals acquired by the third induction module and the fourth induction module;if the terminal equipment is placed in the second direction, recognizing the left-hand gesture according to the first electromagnetic wave signals acquired by the second induction module and the fourth induction module; and recognizing the right hand gesture according to the second electromagnetic wave signals acquired by the first induction module and the third induction module.
- The method according to any one of claims 16 to 20, further comprising:and determining that the terminal equipment is placed according to the first direction or the second direction through a direction sensor in the terminal equipment.
- The method according to any one of claims 15 to 21, wherein the electromagnetic wave signal is a millimeter wave radio signal.
- The method according to any one of claims 15 to 22, further comprising:sending third electromagnetic wave information through the first group of induction modules at a first time, wherein the third electromagnetic wave signal is used for acquiring the first electromagnetic wave signal;and sending fourth electromagnetic wave information through the second group of induction modules at the first time, wherein the fourth electromagnetic wave signal is used for acquiring the second electromagnetic wave signal.
- The method of claim 23, further comprising:and transmitting the service data at a second time, wherein the first time and the second time do not overlap.
- The method of claim 24, wherein transmitting traffic data at the second time comprises:and transmitting the service data through the first group of sensing modules and/or the second group of sensing modules at the second time.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/095893 WO2021007733A1 (en) | 2019-07-12 | 2019-07-12 | Method for recognizing gesture for operating terminal device, and terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113574496A true CN113574496A (en) | 2021-10-29 |
Family
ID=74210130
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980094034.2A Pending CN113574496A (en) | 2019-07-12 | 2019-07-12 | Method for recognizing gesture for operating terminal device and terminal device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113574496A (en) |
| WO (1) | WO2021007733A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113838437A (en) * | 2021-09-10 | 2021-12-24 | 青岛海信移动通信技术股份有限公司 | Method, terminal device and medium for adjusting screen brightness |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902219A (en) * | 2014-03-12 | 2014-07-02 | 上海天奕达电子科技有限公司 | Terminal device and gesture detection method of terminal device |
| CN106487987A (en) * | 2015-08-25 | 2017-03-08 | 中兴通讯股份有限公司 | A kind of control method of terminal unit and terminal unit |
| CN106484271A (en) * | 2016-09-20 | 2017-03-08 | 努比亚技术有限公司 | A kind of device, method and mobile terminal controlling mobile terminal based on user gesture |
| CN106648068A (en) * | 2016-11-11 | 2017-05-10 | 哈尔滨工业大学深圳研究生院 | Method for recognizing three-dimensional dynamic gesture by two hands |
| US20180024640A1 (en) * | 2016-07-22 | 2018-01-25 | Lg Electronics Inc. | Electronic device and method for controlling the same |
| CN109857245A (en) * | 2017-11-30 | 2019-06-07 | 腾讯科技（深圳）有限公司 | A kind of gesture identification method and terminal |
-
2019
- 2019-07-12 CN CN201980094034.2A patent/CN113574496A/en active Pending
- 2019-07-12 WO PCT/CN2019/095893 patent/WO2021007733A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103902219A (en) * | 2014-03-12 | 2014-07-02 | 上海天奕达电子科技有限公司 | Terminal device and gesture detection method of terminal device |
| CN106487987A (en) * | 2015-08-25 | 2017-03-08 | 中兴通讯股份有限公司 | A kind of control method of terminal unit and terminal unit |
| US20180024640A1 (en) * | 2016-07-22 | 2018-01-25 | Lg Electronics Inc. | Electronic device and method for controlling the same |
| CN106484271A (en) * | 2016-09-20 | 2017-03-08 | 努比亚技术有限公司 | A kind of device, method and mobile terminal controlling mobile terminal based on user gesture |
| CN106648068A (en) * | 2016-11-11 | 2017-05-10 | 哈尔滨工业大学深圳研究生院 | Method for recognizing three-dimensional dynamic gesture by two hands |
| CN109857245A (en) * | 2017-11-30 | 2019-06-07 | 腾讯科技（深圳）有限公司 | A kind of gesture identification method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021007733A1 (en) | 2021-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20150026646A1 (en) | User interface apparatus based on hand gesture and method providing the same | |
| CN107636893B (en) | Multi-antenna communication system configured to detect objects | |
| CN110741385B (en) | Gesture recognition method and device, and positioning tracking method and device | |
| US9681268B2 (en) | Mobile device position detection | |
| CN108958490B (en) | Electronic device, gesture recognition method thereof and computer-readable storage medium | |
| Shangguan et al. | Leveraging electromagnetic polarization in a two-antenna whiteboard in the air | |
| KR20140123900A (en) | Gesture recognition apparatus, gesture recognition method, electronic decive, control program and recording medium | |
| CN108351981B (en) | Non-rotationally symmetric short-range wireless tag | |
| Xie et al. | Multi-touch in the air: Concurrent micromovement recognition using RF signals | |
| US9430039B2 (en) | Apparatus for controlling virtual mouse based on hand motion and method thereof | |
| WO2019062243A1 (en) | Identification method and apparatus for touch operation, and electronic device | |
| US20160104037A1 (en) | Method and device for generating motion signature on the basis of motion signature information | |
| Zhang et al. | Reactor: Real-time and accurate contactless gesture recognition with RFID | |
| Ding et al. | RFnet: Automatic gesture recognition and human identification using time series RFID signals | |
| CN109029252B (en) | Object detection method, object detection device, storage medium, and electronic apparatus | |
| Liang et al. | E3DinSAR: 3-D localization of RFID-tagged objects based on interference synthetic apertures | |
| Wang et al. | HMO: Ordering RFID tags with static devices in mobile environments | |
| CN110738185B (en) | Form object identification method, form object identification device and storage medium | |
| Zhang et al. | Real-time and accurate gesture recognition with commercial RFID devices | |
| CN113574496A (en) | Method for recognizing gesture for operating terminal device and terminal device | |
| Chawla et al. | An accurate real-time RFID-based location system | |
| US9396408B2 (en) | Techniques for improving stereo block matching with the pyramid method | |
| CN109032354B (en) | Electronic device, gesture recognition method thereof and computer-readable storage medium | |
| Hu et al. | Could or could not of Grid-Loc: Grid BLE structure for indoor localisation system using machine learning | |
| Zi et al. | Wi-Fi imaging based segmentation and recognition of continuous activity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |