WO2020093278A1 - Multi-antenna based gesture recognition method and device - Google Patents

Multi-antenna based gesture recognition method and device Download PDF

Info

Publication number
WO2020093278A1
WO2020093278A1 PCT/CN2018/114391 CN2018114391W WO2020093278A1 WO 2020093278 A1 WO2020093278 A1 WO 2020093278A1 CN 2018114391 W CN2018114391 W CN 2018114391W WO 2020093278 A1 WO2020093278 A1 WO 2020093278A1
Authority
WO
WIPO (PCT)
Prior art keywords
antenna
moment
terminal
parameter
fluctuation value
Prior art date
Application number
PCT/CN2018/114391
Other languages
French (fr)
Chinese (zh)
Inventor
杜帅乐
潘光胜
刘鹏举
张广煜
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2018/114391 priority Critical patent/WO2020093278A1/en
Priority to CN201880097583.0A priority patent/CN112689812B/en
Publication of WO2020093278A1 publication Critical patent/WO2020093278A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present application relates to the field of wireless communication technology, and in particular, to a gesture recognition method and device based on multiple antennas.
  • the interaction between users and electronic devices has also evolved from simple interactions using peripherals such as remote controllers, mice, and keyboards to using voice interactions. , Somatosensory interaction, eye movement interaction and gesture interaction, etc.
  • the gesture interaction mode is more natural and convenient, and has a great demand in many application scenarios.
  • gestures can cause reflection, diffraction, and multipath of wireless signals. Therefore, different gesture types can be recognized based on changes in wireless signals received by electronic devices to implement gesture interaction.
  • gesture recognition based on wireless signals mainly collects antenna signal data through a single antenna for model training to obtain various gesture models, and then extracts features related to human movement speed from the collected antenna signal data during gesture recognition. The trained gesture model recognizes the gesture.
  • the present application provides a multi-antenna-based gesture recognition method and device for improving the recognition efficiency and applicability of gesture recognition based on wireless signals.
  • a multi-antenna-based gesture recognition method is provided, which is applied to a terminal including a first antenna and a second antenna, where the positions of the first antenna and the second antenna are different.
  • the method includes: acquiring At a moment, the first moment is obtained when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold; the second moment when the second antenna is acquired, the second moment is when the fluctuation value of the antenna parameter of the second antenna is greater than the Obtained when setting the threshold, the second moment is later than the first moment; the target gesture is determined according to the positions of the first moment, the second moment, the first antenna, and the second antenna.
  • the terminal does not need to perform complex pattern recognition and other processing on the antenna parameters of the antenna, and the target gesture can be recognized only according to the time when the antenna parameters of different antennas fluctuate and the position of the antenna, thereby improving the efficiency of gesture recognition,
  • the power consumption of the terminal is also reduced; in addition, the method is not affected by the direction of the incoming wave of the wireless signal, so the applicability of gesture recognition is also improved.
  • the first antenna and the second antenna are located on different sides of the terminal screen, for example, the horizontal positions of the first antenna and the second antenna projected in the plane where the terminal screen is located are different, or vertical Different, or different horizontal and vertical positions.
  • the terminal can recognize more gestures with fewer antennas.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold for the first time, that is, the moment when the fluctuation of the antenna parameter of the first antenna starts;
  • the second moment It is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the first time, that is, the moment when the fluctuation of the antenna parameter of the second antenna starts.
  • the antenna parameters of the antenna closer to the user's hand will fluctuate earlier, and the antenna parameters of the antenna farther from the user's hand will fluctuate later. The above can easily and effectively determine the user's hand according to the moment when the fluctuation starts The sequence through different antennas.
  • the first moment is the moment when the antenna parameter of the first antenna has the largest fluctuation value, that is, the moment when the antenna parameter of the first antenna has the largest fluctuation;
  • the second moment is the second antenna
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold for the last time, that is, the moment when the fluctuation of the antenna parameter of the first antenna ends;
  • the second moment It is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the last time, that is, the moment when the fluctuation of the antenna parameter of the second antenna ends.
  • the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, channel quality Indication CQI, packet reception rate PRR, packet loss rate PLR, signal to interference ratio SIR, signal to interference plus noise ratio SINR, or channel sounding reference signal SRS.
  • channel state information CSI amplitude CSI phase
  • received signal strength indicator RSSI signal-to-noise ratio SNR
  • channel quality Indication CQI channel quality Indication
  • packet reception rate PRR packet loss rate PLR
  • signal to interference ratio SIR signal to interference plus noise ratio SINR
  • SINR channel sounding reference signal
  • the antenna parameter includes at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
  • a terminal in a second aspect, includes a first antenna and a second antenna. The positions of the first antenna and the second antenna are different.
  • the device includes: an acquiring unit for acquiring a first moment, the first moment is at Acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold; the acquisition unit is also used to acquire the second moment, which is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, The second moment is later than the first moment; the determining unit is used to determine the target gesture according to the positions of the first moment, the second moment, the first antenna, and the second antenna.
  • the first antenna and the second antenna are located on different sides of the terminal screen, for example, the horizontal positions of the first antenna and the second antenna projected in the plane where the terminal screen is located are different, or vertical Different, or different horizontal and vertical positions.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the first time; the second moment is the fluctuation period of the antenna parameter of the second antenna is greater than the preset value for the first time Set the threshold time.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is the largest; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is the largest.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the last time; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset Set the threshold time.
  • the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, channel quality indicator CQI , Packet reception rate PRR, packet loss rate PLR, signal-to-interference ratio SIR, signal-to-interference plus noise ratio SINR, or channel sounding reference signal SRS.
  • the antenna parameter includes at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
  • a terminal in a third aspect, includes: a processor, a first antenna, and a second antenna, where the positions of the first antenna and the second antenna are different; wherein, the processor is configured to: acquire the first moment.
  • the first moment is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold; the second moment is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, The second moment is later than the first moment; the target gesture is determined according to the positions of the first moment, the second moment, the first antenna and the second antenna.
  • the first antenna and the second antenna are located on different sides of the terminal screen, for example, the horizontal positions of the first antenna and the second antenna projected in the plane where the terminal screen is located Different, or different in vertical, or different in horizontal position and vertical position.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold for the first time; the second moment is the fluctuation period of the antenna parameter of the second antenna is greater than the first time Set the threshold time.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is the largest; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is the largest.
  • the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the last time; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset Set the threshold time.
  • the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, channel quality indicator CQI , Packet reception rate PRR, packet loss rate PLR, signal-to-interference ratio SIR, signal-to-interference plus noise ratio SINR, or channel sounding reference signal SRS.
  • the antenna parameter includes at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
  • a computer-readable storage medium in which instructions are stored, and when the instructions run on a terminal having at least two antennas in different positions, the terminal is caused to perform the first aspect described above Or a multi-antenna based gesture recognition method provided by any possible implementation manner of the first aspect.
  • a computer program product which, when the computer program product runs on a terminal having at least two antennas at different positions, causes the terminal to perform the first aspect or any possible implementation manner of the first aspect Provided multi-antenna based gesture recognition method.
  • any terminal, computer storage medium, or computer program product based on the multi-antenna gesture recognition method provided above is used to perform the corresponding method provided above, and therefore, the beneficial effects that it can achieve With reference to the beneficial effects in the corresponding methods provided above, they are not repeated here.
  • FIG. 1 is a schematic structural diagram 1 of a terminal provided by an embodiment of the present application.
  • FIG. 1A is a schematic diagram of an interface for setting a floating gesture provided by an embodiment of the present application
  • FIG. 1B is a schematic diagram of an interface for unlocking using a floating gesture provided by an embodiment of the present application
  • 1C is a schematic diagram of an interface for receiving a call using a floating gesture provided by an embodiment of the present application
  • 1D is a schematic diagram of an interface for switching songs using floating gestures provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a gesture recognition method based on multiple antennas provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram 1 of at least two antennas provided by an embodiment of the present application.
  • FIG. 4 is a second schematic diagram of distribution of at least two antennas provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of an antenna parameter fluctuation provided by an embodiment of the present application.
  • FIG. 6 is a third schematic diagram of distribution of at least two antennas provided by an embodiment of the present application.
  • FIG. 7 is a schematic diagram 4 of at least two antennas provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a gesture provided by an embodiment of the present application.
  • FIG. 9 is a schematic diagram 5 of distribution of at least two antennas provided by an embodiment of the present application.
  • FIG. 10 is a schematic diagram of a target gesture provided by an embodiment of the present application.
  • FIG. 11 is a second schematic structural diagram of a terminal according to an embodiment of the present application.
  • At least one refers to one or more, and “multiple” refers to two or more.
  • And / or describes the relationship of the related objects, indicating that there can be three relationships, for example, A and / or B, which can mean: A exists alone, A and B exist at the same time, B exists alone, where A, B can be singular or plural.
  • At least one of the following or a similar expression refers to any combination of these items, including any combination of a single item or a plurality of items.
  • At least one (a) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c may be single or multiple.
  • the character "/" generally indicates that the related object is a "or" relationship.
  • Embodiments of the present application provide a gesture recognition method based on multiple antennas, which can be applied to a terminal configured with at least two antennas and at least two antennas have different positions.
  • the present application can be used to improve recognition of gesture recognition based on wireless signals Efficiency and suitability.
  • the basic principle of wireless signal-based gesture recognition is that before the user makes the target gesture, when the wireless signal received by the terminal ’s antenna is relatively stable, for example, it only fluctuates within a small range; when there is a moving object near the terminal ( For example, when the user makes a target gesture, different postures, speeds, and angles of the object will cause differences in the reflection, refraction, and diffraction of the wireless signal in space, which will affect the wireless signal received by the antenna.
  • the gesture recognition method obtains the moment when the wireless channel information of at least two antennas fluctuates when the wireless channel information of at least two antennas fluctuates, based on the moment when the wireless channel information of different antennas fluctuates.
  • the sequence of and the positions of at least two antennas determine the trajectory of the target gesture, and then recognize the target gesture.
  • the embodiments of the present application also provide a gesture recognition method, by acquiring the moment when the antenna state information of at least two antennas fluctuates when the antenna state information of at least two antennas fluctuates, based on the fluctuation of the antenna state information of different antennas. The time sequence and the position of at least two antennas determine the movement trajectory of the target gesture, and then recognize the target gesture.
  • the fluctuation in the embodiment of the present application may refer to that the antenna parameters have rules up or down at a reference value (for example, the reference value may represent the average value of the antenna parameters over a period of time when not affected by the target gesture) or Irregular jumps.
  • the reference value may represent the average value of the antenna parameters over a period of time when not affected by the target gesture
  • Irregular jumps Irregular jumps.
  • the terminal may not be able to detect it due to insufficient detection accuracy; or, when the terminal detects a fluctuation within a small range, the terminal does not respond to the fluctuation or considers that there is no fluctuation, Therefore, the terminal does not execute the method provided in the embodiments of the present application. Therefore, the fluctuation of the antenna parameter in the embodiment of the present application may refer to the fluctuation of the antenna parameter caused by the target gesture, that is, the fluctuation of the antenna parameter in a larger range, for example, when the fluctuation value is greater than a preset threshold That is to say that the antenna parameters fluctuate.
  • methods for evaluating "fluctuation” include, but are not limited to: variance, standard deviation, extreme value, derivative, rate of change, absolute error, probability distribution, anomaly detection, etc., as well as training for machine learning and other methods for identifying "fluctuation” "Training model, etc., this embodiment of the present application will not be described in detail.
  • the terminal described in the embodiment of the present application may be various devices configured with at least two antennas.
  • the terminal may be a mobile phone, a tablet computer, a computer, a notebook computer, a video camera, a camera, a wearable device (such as a smart watch, etc.), an in-vehicle device, an ultra-mobile personal computer (Ultra-mobile Personal Computer, UMPC), a netbook, a cellular Telephone, personal digital assistant (Personal Digital Assistant, PDA), etc.
  • the terminal is a mobile phone as an example.
  • the mobile phone includes: an RF circuit 101, a memory 102, a processor 103, a sensor component 104, a multimedia component 105, a power component 106, and an input / output interface 107.
  • the RF circuit 101 can be used for receiving and sending signals during receiving and sending information or during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 103 and the uplink data is sent to the base station.
  • the RF circuit 101 includes, but is not limited to, at least two antennas, amplifiers, transceivers, couplers, low noise amplifiers (LNA), duplexers, and the like.
  • the RF circuit 101 can also communicate with other devices through wireless communication.
  • the memory 102 can be used to store data, software programs, and modules; mainly including a storage program area and a storage data area, wherein the storage program area can store an operating system and application programs required for at least one function, such as a sound playback function, an image playback function, etc. ;
  • the storage data area can store data created according to the use of the mobile phone, such as audio data, image data, phone book, etc.
  • the mobile phone may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
  • the processor 103 is the control center of the mobile phone, and uses various interfaces and lines to connect various parts of the entire device, by running or executing the software programs and / or modules stored in the memory 102, and calling the data stored in the memory 102, Perform various functions and process data of the mobile phone to monitor the mobile phone as a whole.
  • the processor 103 may include one or more processing units, for example, the processor 103 may integrate an application processor (Application Processor, AP) and a baseband processor (modem), an operating system, a user interface, and an application program of a mobile phone Can be processed on the AP, and communication functions can be processed on the baseband processor. It can be understood that, as described above, the baseband processor may not be integrated into the processor 103.
  • the sensor component 104 includes one or more sensors, which are used to provide various aspects of status assessment for the mobile phone.
  • the sensor component 104 may include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor or a temperature sensor, and the sensor component 103 can detect the acceleration / deceleration, orientation, on / off status of the mobile phone, and the relative positioning of the component, or The temperature of the phone changes, etc.
  • the sensor assembly 104 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the multimedia component 105 provides a screen of an output interface between the mobile phone and the user.
  • the screen may be a touch panel, and when the screen is a touch panel, the screen may be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or sliding action, but also detect the duration and pressure related to the touch or sliding operation.
  • the multimedia component 105 further includes at least one camera.
  • the multimedia component 105 includes a front camera and / or a rear camera. When the mobile phone is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data.
  • Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the power component 106 is used to provide power for various components of the mobile phone.
  • the power component 106 may include a power management system, one or more power sources, and other components associated with the generation, management, and distribution of power by the mobile phone.
  • the input / output interface 107 provides an interface between the processor 103 and a peripheral interface module, for example, the peripheral interface module may be a keyboard, a mouse, and so on.
  • the mobile phone may further include an audio component and a communication module, for example, the audio component includes a microphone and a speaker, etc.
  • the communication module may include a wireless fidelity (WiFi) module, a Bluetooth module, and short-range wireless communication (near One or more of a field communication (NFC) module, a global navigation system (GNSS) module or a frequency modulation (FM) module, and the embodiments of the present application will not repeat them here.
  • WiFi wireless fidelity
  • Bluetooth Bluetooth
  • short-range wireless communication near One or more of a field communication (NFC) module, a global navigation system (GNSS) module or a frequency modulation (FM) module
  • FM frequency modulation
  • At least two antennas in the embodiments of the present application may include the antenna corresponding to the radio frequency circuit, the antenna corresponding to the WiFi module, the antenna corresponding to the Bluetooth module, and the antenna corresponding to the NFC module.
  • at least two antennas may be separately installed, or may be integrated (for example, a cellular antenna), etc.
  • the embodiment of the present application does not limit the specific form of the antenna.
  • the method provided by the embodiments of the present application can be applied to various application scenarios of the terminal.
  • the role of the target gesture recognized by the method provided by the present application and the gesture directly made by the user on the touch screen or the gesture command input through other input devices The effect of etc. can have the same effect.
  • the target gesture made by the user may be a floating gesture made near the terminal (for example, within a range of 3-5 cm above the screen of the terminal, etc.); or a gesture made directly by the user on the touch screen with his hand,
  • the terminal can recognize the gestures directly made by the user on the touch screen through the method provided in this application; or the gestures made directly on the touch screen by the user wearing a protective suit, for example, when the user When wearing gloves, the user can directly make gestures on the touch screen without taking off and taking off.
  • the terminal can recognize the gestures made by the user through the method provided in the present application.
  • the user can configure in the setting options of the terminal.
  • the terminal has “floating gestures” in the setting options.
  • the interface shown in (b) of FIG. 1A is displayed.
  • the "open” option is used to turn on the floating gesture
  • the "off” option is used to turn off the floating gesture.
  • the terminal can recognize the floating gesture made by the user and perform the corresponding according to the specific floating gesture Instructions.
  • FIG. 1B when the terminal is in the lock screen state (as (a) in FIG.
  • the user may make a floating gesture of swiping to the right on the screen of the terminal (as in FIG. 1B) (b)), then the terminal can recognize the gesture of swiping right by the method provided in this application, and then unlock and display the main interface of the terminal for the user (as shown in (c) in FIG. 1B).
  • the terminal is in an incoming call state (as shown in (a) in FIG.
  • the user may make a floating gesture of swiping right on the screen of the terminal (as shown in ( b) as shown), the terminal can recognize the gesture of swiping right by the method provided in this application, and then connect the phone to the user and display the call interface (as shown in (c) in FIG. 1C), of course the user You can also make a floating gesture of swiping left on the screen of the terminal to hang up the phone.
  • FIG. 1D when the user uses the terminal to listen to music (as shown in (a) in FIG. 1D), the user may make a floating gesture of swiping left on the screen of the terminal (as in FIG.
  • the swipe left identified by the method provided by this application can be used to play the previous song, and then the terminal switches the user to the previous song for playback (as shown in (c) in FIG. 1D) ),
  • the user can also make a floating gesture of swiping right on the screen of the terminal to switch to the next song, or make a floating gesture of sliding up on the screen of the terminal to increase the volume, or on the terminal A floating gesture of sliding down at the top of the screen is made to reduce the volume, etc., and the embodiments of the present application will not be illustrated one by one here.
  • the user uses the address book of the terminal, the user can make a gesture of swiping up or down, etc.
  • the terminal can be used to display the previous page for the user when the target gesture is recognized as swiping upward by the method provided in this application
  • the address book can be used to display the next page of address book for the user when the target gesture is swiped down; or, when the user uses the terminal to scroll through the album, the user can make a gesture of swiping left or right, etc.
  • the terminal can be used to display the next picture for the user when the target gesture is swiped to the right by the method provided in this application, and can be used to display the previous picture for the user if the target gesture is swiped to the left.
  • FIG. 2 is a schematic flowchart of a gesture recognition method based on multiple antennas provided by an embodiment of the present application.
  • the method may be implemented in the terminal shown in FIG. 1. Referring to FIG. 2, the method may include the following steps.
  • the terminal acquires the first moment, which is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold, and the second moment when the second antenna is acquired, the second moment is at the second antenna When the fluctuation value of the antenna parameter is greater than the preset threshold, the second moment is later than the first moment.
  • the terminal includes at least two antennas.
  • the at least two antennas include at least a first antenna and a second antenna.
  • Each antenna can be used to receive a wireless signal.
  • the following uses at least two antennas as an example for description.
  • the different positions of the at least two antennas may mean that the positions of the at least two antennas on the terminal are different; optionally, among the at least two antennas, the first antenna and the second antenna are not on the same side of the terminal screen. For example, when projecting at least two antennas on the plane where the screen of the terminal is located, the projection positions of at least two antennas in the plane are different.
  • the plane is represented by a two-dimensional space (x-axis and y-axis)
  • at least two antennas The projections of the antennas in this plane correspond to different values on the x-axis, or different values on the y-axis, or different values on the x-axis and y-axis.
  • the plane where the terminal screen is located in FIGS. 3 and 4 is For example, the projection plane, the x-axis in the horizontal direction, and the y-axis in the vertical direction, T represents the top of the terminal, B represents the bottom of the terminal, L represents the left side of the terminal, and R represents the right side of the terminal.
  • T represents the top of the terminal
  • B represents the bottom of the terminal
  • L represents the left side of the terminal
  • R represents the right side of the terminal.
  • antenna 3 is set at the bottom of the terminal (that is, the values on the x-axis and the y-axis are different from those of the antenna 1 and the antenna 2) as shown in (a) or (b) in FIG. 4 ) As shown.
  • the antenna parameters may be parameters in wireless channel information and / or antenna state information parameters.
  • the wireless channel information is used to reflect the state of the wireless signal, which can be calculated according to the wireless signal received by the antenna;
  • the antenna state information is used to reflect the working state of the antenna, which can be measured according to the working state of the antenna.
  • the wireless signal received by the terminal ’s antenna may be relatively stable, such as fluctuating only within a small range, so the wireless channel information calculated based on the wireless signal is also relatively Stable; when the user makes a target gesture near the terminal, at least two antennas of the terminal will be affected by the gesture, that is, the wireless signals received by the at least two antennas will fluctuate, such as in a large range Fluctuation, so that the wireless channel information calculated based on the fluctuated wireless signal will also fluctuate.
  • the antenna state information before the user makes the target gesture, the working state of the antenna measured by the terminal is relatively stable; when the user makes the target gesture near the terminal, the working state of the antenna is affected by the hand. Fluctuations, such as the impedance characteristics of the antenna, will be affected by the hand and change, and then the measured impedance characteristics will fluctuate.
  • the antenna parameters of at least two antennas of the terminal will be affected by the gesture, That is, the wireless channel information or the antenna status information of at least two antennas may fluctuate, so that the terminal can obtain the moment when the antenna parameters of the at least two antennas fluctuate.
  • the terminal may detect the antenna parameters of at least two antennas, and when the antenna parameters of the at least two antennas fluctuate, the terminal obtains the time information sequence corresponding to the antenna parameters of the at least two antennas (that is, the antennas corresponding to different times) Parameter), and the time when the antenna parameter of each antenna fluctuates is extracted from the time information sequence.
  • the moment may be the moment when the fluctuation starts, that is, the moment when the fluctuation value of the antenna parameter is greater than a preset threshold for the first time (for example, the difference between the antenna parameter value at this moment and the antenna parameter value at one or more previous moments is the same Is less than the preset threshold, and the difference between the antenna parameter value at one or more later moments is greater than the preset threshold); or the moment when the fluctuation ends, that is, the moment when the fluctuation value of the antenna parameter last exceeds the preset threshold (for example, the The difference between the antenna parameter value at that moment and the antenna parameter value at one or more later moments is less than the preset threshold), or the moment when the fluctuation is greatest, that is, the moment when the antenna parameter fluctuates most (for example, the antenna parameter value at that moment and the previous The difference between the antenna parameter values at one or more moments is the largest, and the difference between the antenna parameter values at the latter one or more moments is also the largest), etc., which is not specifically limited in the embodiments of the present application.
  • the wireless channel information may be reflected by one or more parameters. Therefore, in this embodiment of the present application, the time of the fluctuation may be obtained from at least one of the following parameters included in the wireless channel information: channel state information (Channel Status, Information (CSI) amplitude, CSI phase, Received Signal Strength Indicator (Received Signal Strength Indicator, RSSI), Signal to Noise Ratio (Signal Noise, Ratio, SNR), Channel Quality Indicator (Channel Quality Indicator, CQI), packet reception rate (Packet Reception Rate, PRR), packet loss rate (Packet Loss Rate, PLR), signal to interference ratio (Signal to Interference Ratio, SIR), signal interference to noise ratio (Signal to Interference plus Noise Rate, SINR), or channel detection Reference signal (SoundingReferenceSignal, SRS).
  • channel state information Channel State information
  • CSI Channel Status, Information
  • RSSI Received Signal Strength Indicator
  • RSSI Signal to Noise Ratio
  • SNR Channel Quality In
  • the antenna state information can also be reflected by one or more parameters. Therefore, in the embodiments of the present application, the above-mentioned fluctuation time can be obtained from at least one of the following parameters included in the antenna state information: impedance characteristic, direction pattern, Correlation system, or channel calibration value.
  • the terminal obtains the time information sequence of the CSI fluctuations of antenna 1 and antenna 2 as shown in (a) in FIG. 5, the acquired antenna 1 and The time information sequence of the RSSI fluctuation of the antenna 2 is as shown in (b) of FIG. 5, in FIG. 5, ANT1 represents antenna 1 and ANT2 represents antenna 2.
  • the CSI of ANT1 is about 0.72s (slightly lower than 200) and the previous few.
  • the difference between the values at each moment is less than 20, and the difference from the values at the next few moments is greater than 20 (that is, the moment when the fluctuation starts is 0.72s), which continues to fluctuate between 0.72s and 1.25s, and is 1.05s
  • the difference between the value of time (about 210) and the value of the previous moment and the next moment is the largest (that is, the moment with the greatest fluctuation is 1.05s), the value at 1.25s (about 220) and the value of the following moments
  • the difference is less than 20 (that is, the moment when the fluctuation ends is 1.25s).
  • the difference between ANT2's CSI value at about 0.64s (slightly greater than 100) and the values at the previous moments are both greater than 20, and the difference from the values at the later moments are greater than 20 (that is, the moment when the fluctuation starts is 0.64s ), Continuously fluctuating up and down between 0.64s and 1.25s, and the difference between the value at 0.95s (approximately 230) and the value at the previous and next moments is the largest (that is, the maximum fluctuation is 0.95s), at The difference between the value at 1.25s (approximately 150) and the values at the following moments is less than 20 (that is, the moment when the fluctuation ends is 1.25s). Therefore, as shown in (a) of FIG.
  • the time at which ANT1 fluctuation starts is 0.72s later than the time at which ANT2 fluctuation starts 0.64s; the time when ANT1 maximum fluctuation is 1.05s is later than the time at which ANT2 maximum fluctuation 0.95s.
  • the difference between the ANT2 RSSI amplitude at about 0.72 (approximately -36dB) and the values at the previous moments are both less than 2dB, and the difference from the values at the following moments are greater than 2dB (that is, the moment when the fluctuation starts is 0.72 s), continuously fluctuating between 0.72s and 1.12s, and the difference between the amplitude at 1.08s (about -36dB) and the amplitude at the previous moment and the latter moment is the largest (that is, the moment when the fluctuation is the largest is 1.08s), the difference between the amplitude at 1.12s (approximately -38dB) and the amplitude at the following moments is less than 2dB (that is, the moment when the fluctuation ends is 1.12s).
  • the time when the ANT1 fluctuation starts is 1.04s later than the time when the ANT2 fluctuation starts 0.72s; the time when the ANT1 maximum fluctuation is 1.12s later than the time when the ANT2 maximum fluctuation is 1.08s; ANT1 The time of the end of the fluctuation 1.20s is later than the time of the end of the fluctuation of ANT2 1.12s.
  • the terminal may also perform some preprocessing on its waveform, such as data conversion and noise reduction.
  • the data conversion may refer to processing the original data, for example, the original CSI information is a complex number, which is converted into amplitude or phase information, etc .
  • noise reduction methods may include sliding window averaging, filtering, wavelet decomposition noise reduction, multidimensional data One or more of the principal component analysis and so on, thereby reducing the impact of noise, making it easier for the terminal to detect fluctuations.
  • S202 Determine the target gesture according to the first moment, the second moment, the positions of the first antenna and the second antenna.
  • the sequence of moments when the antenna parameters of the two antennas fluctuate can determine the sequence of at least two antennas affected by the target gesture, and then the sliding trajectory of the target gesture can be determined according to the positions of the at least two antennas, and then the target gesture can be determined .
  • the types of gestures that can be recognized by the multi-antenna-based gesture recognition method provided by the embodiments of the present application are related to the number and position of at least two antennas, and several possible implementation manners are described in detail below.
  • At least two antennas include antenna 1 and antenna 2, and antenna 1 and antenna 2 are located on the left and right sides of the terminal, respectively. If the antenna 1 and the antenna 2 have the same height, such as the antenna 1 and the antenna 2 shown in (a) in FIG.
  • the gestures that can be recognized may include: swiping left and swiping right; if the antenna 1 and antenna 2 are not Contours, such as antenna 1 and antenna 2 shown in (b) or (c) in Figure 3 above, the gestures that can be recognized can include: swiping left and swiping right; or the distance between antenna 1 and antenna 2 When it is relatively far away, for example, the antenna 1 is close to the top of the terminal and the antenna 2 is close to the bottom of the terminal, the gesture recognition can include: sliding down and sliding up. For example, in the example described in FIG. 5 above, the positions of the antenna 1 and the antenna 2 are as shown in (b) of FIG.
  • the antenna 2 fluctuates first, and the antenna 1 fluctuates later.
  • the gestures recognized by this method include swiping left and swiping right, it can be determined that the swiping direction of the target gesture is from left to right, thus determining that the target gesture is swiping left
  • the gestures recognized by the method are defined to include downward sliding and upward sliding, it can be determined that the sliding direction of the target gesture is from bottom to top, thereby determining that the target gesture is sliding upward.
  • At least two antennas include antenna 1 and antenna 2, and antenna 1 and antenna 2 are located at the top and bottom of the terminal, respectively. If antenna 1 and antenna 2 have the same height, such as antenna 1 and antenna 2 shown in (a) of FIG. 6, the gestures recognized by this method may include: sliding down and sliding up; if antenna 1 and antenna 2 are not Contours, such as antenna 1 and antenna 2 shown in (b) or (c) in FIG.
  • the gestures recognized by this method may also include: sliding down and sliding up; or, between antenna 1 and antenna 2
  • the gestures recognized by the method may include: swiping left and swiping right.
  • antenna 1 and antenna 2 may also be located on the left and bottom, left and top, right and top of the terminal, respectively. Or right and bottom.
  • gestures that can be recognized by the method include: swiping left and swiping right, or swiping down and swiping up, and this application is implemented Examples will not repeat them here.
  • gestures that can be recognized include swiping left and swiping right
  • other gestures similar to left to right may also be determined as swiping right, such as , As shown in (a) of FIG. 8, slide from bottom left to top right, top left to bottom right, arc slide from left to right, wave slide from left to right, zigzag slide from left to right, first Swipe up and back to the right, or down and then right, etc .; other gestures similar to right to left are also determined to be swiped to the left, for example, as shown in (b) of FIG.
  • At least two antennas include antenna 1, antenna 2 and antenna 3, and antenna 1, antenna 2 and antenna 3 may be respectively disposed on different sides of the terminal.
  • the antenna 1 is provided on the right side of the terminal
  • the antenna 2 is provided on the left side of the terminal
  • the antenna 3 is provided on the bottom of the terminal
  • the method Recognizable gestures may include: swiping left, swiping right, swiping down, and swiping up.
  • the target gesture can be determined to be swiping to the right, when the sequence of t1, t2 and t3 is t1-t3-t2, the target gesture can be determined to be swiping to the left, when t1, t2 and t3 It can be determined that the target gesture is sliding downward when the sequence of t1-t2-t3 is t, and when the sequence of t1, t2 and t3 is t3-t2-t1.
  • antenna 1, antenna 2 and antenna 3 may also be located on the terminal ’s Top, left and bottom, or on the right, top and bottom, or on the left, top and right.
  • the gesture recognition method may include: swiping left, swiping right, swiping down, and swiping up.
  • the target gesture may also be recognized by the following method: the terminal acquires different antennas in different The fluctuation intensity curve corresponding to the antenna parameter at the time; for the antenna with the greatest fluctuation intensity at the same time, the terminal can determine that the target gesture is closest to the antenna at the moment; according to the change trend of the fluctuation intensity curve corresponding to each antenna parameter
  • the relative movement direction of the gesture and the antenna for example, when the fluctuation intensity corresponding to the antenna parameter of an antenna continuously increases within a certain period of time, it can indicate that the target gesture gradually approaches the antenna during the period of time, when the antenna ’s
  • the fluctuation intensity corresponding to the antenna parameter continuously decreases in a certain period of time it can indicate that the target gesture gradually moves away from the antenna in this period of time); according to the position of the antenna with the largest fluctuation intensity corresponding to different moments, and the target gesture and each The relative movement direction of the antenna in different
  • the gestures recognized by this method may include multiple types, such as non-combined sliding and combined sliding.
  • Non-combined sliding may include: sliding to the left, sliding to the right, sliding down, sliding up, sliding from the lower left to the upper right, sliding from the upper left to the lower right, sliding from the upper right to the lower left, sliding from the lower right to the upper left, etc.
  • the combined slide can include: first up then right, first down then right, first up then left, first down then left, first left then up, first right then up, first Swipe down to the left, slide right to back, S-slide, O-slide, etc.
  • At least two antennas include 4 antennas (ie, antenna 1 to antenna 4), and the positions of the four antennas are as shown in (a) of FIG. 10, that is, antenna 1 and antenna 2 are located on the left side of the terminal, And antenna 1 is near the top, antenna 2 is near the bottom, antenna 3 and antenna 4 are on the right side of the terminal, and antenna 3 is near the bottom and antenna 4 is near the bottom.
  • antenna 1 and antenna 2 are located on the left side of the terminal
  • antenna 1 is near the top
  • antenna 2 is near the bottom
  • antenna 3 and antenna 4 are on the right side of the terminal
  • antenna 3 is near the bottom and antenna 4 is near the bottom.
  • the terminal can acquire that the fluctuation intensity of the antenna parameter of the antenna 2 is the largest at the beginning, and after a period of time It gradually decreases within, so that it can be determined that the target gesture starts to slide from the position of the antenna 2 and gradually away from the antenna 2; secondly, the fluctuation intensity of the antenna parameters of the antenna 1 and the antenna 3 gradually increases and then gradually decreases after a period of time, so that Determine that the position of the target gesture from the antenna 1 and the antenna 3 is far and near, and then from near and far, so that the target gesture can be determined from the position of the antenna 2 toward the middle position of the antenna 1 and the antenna 3 and gradually away; finally, The fluctuation intensity of the antenna parameters of the antenna 4 gradually acquired by the terminal and finally reached the maximum, so that the terminal can determine that the target gesture finally stops at the position of the antenna 4, so that the target gesture can be determined from the lower left to the upper right according to the sliding trajectory slide.
  • the terminal can acquire that the fluctuation intensity of the antenna parameter of antenna 1 is the largest at the beginning. After a period of time, it gradually decreases, so that it can be determined that the target gesture starts to slide from the position of the antenna 1 and gradually away from the antenna 1; secondly, the fluctuation intensity of the antenna parameter of the antenna 2 gradually increases to reach a maximum after a period of time, and then gradually changes Small, so it can be determined that the target gesture gradually approaches antenna 2 and then gradually away from antenna 2, so that it can be determined that the target gesture slides from the position of antenna 1 to the position of antenna 2 and then away from antenna 2; finally, the terminal acquires the antenna The fluctuation intensity of the antenna parameter of 3 gradually increases, and finally reaches the maximum, so that the terminal can determine that the target gesture finally stops at the position of the antenna 3, that is, the target gesture moves away from the antenna 2 and slides toward the antenna 3, so that the sliding trajectory can be determined
  • the target gesture is
  • the terminal can determine the sequence in which the target gesture passes each antenna during the movement according to the sequence of the moment when the antenna parameters of at least two antennas fluctuate, and then combine the positions of at least two antennas, Determine the movement trajectory of the target gesture to recognize the target gesture; or, combining the sequence of the moment when the antenna parameters of at least two antennas fluctuate and the fluctuation trend corresponding to the antenna parameters of each antenna, determine that the target gesture passes through The order of the two antennas, and finally combining the positions of at least two antennas to determine the movement trajectory of the target gesture, thereby recognizing the target gesture.
  • this method does not require complex pattern recognition, thereby improving the efficiency of gesture recognition and reducing the power consumption of the terminal; in addition, this method is not affected by the direction of the incoming wave of the wireless signal, so To a certain extent, the applicability of gesture recognition has been improved.
  • the above-mentioned terminal or the like includes a hardware structure and / or a software module corresponding to each function.
  • the embodiments of the present invention can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed by hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present invention.
  • each function module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules may be implemented in the form of hardware or software function modules. It should be noted that the division of the modules in the embodiments of the present invention is schematic, and is only a division of logical functions. In actual implementation, there may be another division manner.
  • the terminal includes: at least two antennas 1101, an acquisition unit 1102, and a determination unit 1103, and at least two antennas 1101 include a first antenna and a second antenna. Among them, at least two antennas 1101 are used to receive wireless signals; an acquisition unit 1102 is used to support the terminal to perform S201 in the above method embodiments, and / or other processes used in the technology described herein; a determination unit 1103 is used to support The terminal executes S202 in the above method embodiments, and / or other processes used in the technology described herein.
  • the above terminal includes but is not limited to the above listed unit modules.
  • the above terminal may further include a storage unit, which is used to store the program code and data of the terminal.
  • the specific functions that can be achieved by the above functional units also include but are not limited to the functions corresponding to the method steps described in the above examples.
  • the other units of the above terminal please refer to the detailed description of the corresponding method steps. Examples are not repeated here.
  • the acquisition unit 1102 and the determination unit 1103 may be the processor 103 in the terminal shown in FIG. 1, the storage unit may be the memory 102 in the terminal shown in FIG. 1, and at least two antennas 1101 may be integrated in In the RF circuit 101 in the terminal shown in FIG. 1 described above.
  • the processor 103 may be used by the terminal to execute S201-S202 in the above method embodiments, and / or other processes of the technology described herein; the memory 102 may be used to store the program code of the terminal and Data; RF circuit 101 can be used to support the terminal to receive wireless signals.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are only schematic.
  • the division of the modules or units is only a division of logical functions.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above integrated unit may be implemented in the form of hardware or software functional unit.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium.
  • the technical solutions of the embodiments of the present application may essentially be part of or contribute to the existing technology, or all or part of the technical solutions may be embodied in the form of software products, which are stored in a storage medium
  • several instructions are included to enable the terminal to perform all or part of the steps of the methods described in the embodiments of the present application.
  • the foregoing storage media include various media that can store program codes, such as a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

The present application provides a multi-antenna based gesture recognition method and device, for improving the recognition efficiency and applicability of wireless signal-based gesture recognition. The method is applied to a terminal comprising a first antenna and a second antenna, and the positions of the first antenna and the second antenna are different. Said method comprises: acquiring a first time, the first time being acquired when a fluctuation value of an antenna parameter of a first antenna is greater than a preset threshold; acquiring a second time of a second antenna, the second time being acquired when a fluctuation value of an antenna parameter of the second antenna is greater than the preset threshold, the second time being later than the first time; and according to the first time, the second time, the positions of the first antenna and the second antenna, determining a target gesture.

Description

一种基于多天线的手势识别方法及装置Gesture recognition method and device based on multiple antennas 技术领域Technical field
本申请涉及无线通信技术领域,尤其涉及一种基于多天线的手势识别方法及装置。The present application relates to the field of wireless communication technology, and in particular, to a gesture recognition method and device based on multiple antennas.
背景技术Background technique
随着电子设备的种类、数量越来越多,普及程度越来越广泛,用户与电子设备的交互方式也从利用遥控器、鼠标、键盘等外设进行的简单交互方式,发展到了利用语音交互、体感交互、眼动交互和手势交互等多样化的交互方式。其中,手势交互方式由于比较自然方便,在很多应用场景中具有很大的需求。With the increasing number and types of electronic devices and the increasing popularity, the interaction between users and electronic devices has also evolved from simple interactions using peripherals such as remote controllers, mice, and keyboards to using voice interactions. , Somatosensory interaction, eye movement interaction and gesture interaction, etc. Among them, the gesture interaction mode is more natural and convenient, and has a great demand in many application scenarios.
在无线通信技术领域,手势会导致无线信号发生反射、衍射、以及多径等,因此可以基于电子设备接收到的无线信号的变化来识别不同的手势类型,以实现手势交互。目前,基于无线信号的手势识别主要是通过单天线采集天线信号数据进行模型训练得到各种手势模型,之后在进行手势识别时从采集到天线信号数据中提取出与人体运动速度相关的特征,通过训练得到的手势模型识别出手势。In the field of wireless communication technology, gestures can cause reflection, diffraction, and multipath of wireless signals. Therefore, different gesture types can be recognized based on changes in wireless signals received by electronic devices to implement gesture interaction. At present, gesture recognition based on wireless signals mainly collects antenna signal data through a single antenna for model training to obtain various gesture models, and then extracts features related to human movement speed from the collected antenna signal data during gesture recognition. The trained gesture model recognizes the gesture.
但是,在上述方法中,当无线信号的来波方向与天线的角度不同时,同一手势产生的波形波动会有所不同,从而提取出的与人体运动速度相关的特征也会有所不同,进而会造成手势识别存在一定的局限性。However, in the above method, when the direction of the arrival of the wireless signal is different from the angle of the antenna, the waveform fluctuations generated by the same gesture will be different, so the extracted features related to the speed of the human body will also be different. It will cause some limitations in gesture recognition.
发明内容Summary of the invention
本申请提供一种基于多天线的手势识别方法及装置,用于提高基于无线信号的手势识别的识别效率和适用性。The present application provides a multi-antenna-based gesture recognition method and device for improving the recognition efficiency and applicability of gesture recognition based on wireless signals.
为达到上述目的,本申请的实施例采用如下技术方案:To achieve the above purpose, the embodiments of the present application adopt the following technical solutions:
第一方面,提供一种基于多天线的手势识别方法,应用于包括第一天线和第二天线的终端中,所述第一天线和所述第二天线的位置不同,该方法包括:获取第一时刻,第一时刻是在第一天线的天线参数的波动值大于预设阈值时获取的;获取第二天线的第二时刻,第二时刻是在第二天线的天线参数的波动值大于预设阈值时获取的,第二时刻晚于第一时刻;根据第一时刻、第二时刻、第一天线和第二天线的位置,确定目标手势。即确定目标手势经过或靠近不同天线的顺序,确定目标手势的运动轨迹,从而识别出目标手势。上述技术方案中,该终端无需对天线的天线参数进行复杂的模式识别等处理,仅根据不同天线的天线参数发生波动的时刻和天线的位置即可识别目标手势,从而提高了手势识别的效率,也降低该终端的功耗;此外,该方法不受无线信号的来波方向的影响,因此也提高了手势识别的适用性。In a first aspect, a multi-antenna-based gesture recognition method is provided, which is applied to a terminal including a first antenna and a second antenna, where the positions of the first antenna and the second antenna are different. The method includes: acquiring At a moment, the first moment is obtained when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold; the second moment when the second antenna is acquired, the second moment is when the fluctuation value of the antenna parameter of the second antenna is greater than the Obtained when setting the threshold, the second moment is later than the first moment; the target gesture is determined according to the positions of the first moment, the second moment, the first antenna, and the second antenna. That is, the order in which the target gesture passes or approaches different antennas is determined, and the movement trajectory of the target gesture is determined, thereby identifying the target gesture. In the above technical solution, the terminal does not need to perform complex pattern recognition and other processing on the antenna parameters of the antenna, and the target gesture can be recognized only according to the time when the antenna parameters of different antennas fluctuate and the position of the antenna, thereby improving the efficiency of gesture recognition, The power consumption of the terminal is also reduced; in addition, the method is not affected by the direction of the incoming wave of the wireless signal, so the applicability of gesture recognition is also improved.
在第一方面的一种可能的实现方式中,第一天线和第二天线位于终端屏幕的不同侧,比如,第一天线和第二天线在终端屏幕所在平面内投影的水平位置不同、或者垂直不同、或者水平位置和垂直位置均不同。上述可能的实现方式中,通过合理的设置第一天线和第二天线的位置,使得该终端能够利用较少的天线识别出更多的手势。In a possible implementation manner of the first aspect, the first antenna and the second antenna are located on different sides of the terminal screen, for example, the horizontal positions of the first antenna and the second antenna projected in the plane where the terminal screen is located are different, or vertical Different, or different horizontal and vertical positions. In the foregoing possible implementation manner, by reasonably setting the positions of the first antenna and the second antenna, the terminal can recognize more gestures with fewer antennas.
在第一方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值 首次大于预设阈值的时刻,即第一天线的天线参数的波动开始的时刻;第二时刻是第二天线的天线参数的波动值首次大于预设阈值的时刻,即第二天线的天线参数的波动开始的时刻。上述可能的实现方式中,距离用户手越近的天线的天线参数越早产生波动,距离用户手越远的天线的天线参数越晚产生波动,上述根据波动开始的时刻能够简单有效地确定用户手经过不同天线的先后顺序。In a possible implementation manner of the first aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold for the first time, that is, the moment when the fluctuation of the antenna parameter of the first antenna starts; the second moment It is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the first time, that is, the moment when the fluctuation of the antenna parameter of the second antenna starts. In the above possible implementation manner, the antenna parameters of the antenna closer to the user's hand will fluctuate earlier, and the antenna parameters of the antenna farther from the user's hand will fluctuate later. The above can easily and effectively determine the user's hand according to the moment when the fluctuation starts The sequence through different antennas.
在第一方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值最大的时刻,即第一天线的天线参数的波动最大的时刻;第二时刻是第二天线的天线参数的波动值最大的时刻,即第二天线的天线参数的波动最大的时刻。上述可能的实现方式中,距离用户手越近的天线的天线参数的波动值越大,距离用户手越远的天线的天线参数的波动值越小,上述波动最大的时刻能够简单有效地确定用户手经过不同天线的先后顺序。In a possible implementation manner of the first aspect, the first moment is the moment when the antenna parameter of the first antenna has the largest fluctuation value, that is, the moment when the antenna parameter of the first antenna has the largest fluctuation; the second moment is the second antenna The moment when the fluctuation value of the antenna parameter of the antenna is the largest, that is, the moment when the fluctuation of the antenna parameter of the second antenna is the largest. In the above possible implementation manner, the larger the fluctuation value of the antenna parameter of the antenna closer to the user's hand, the smaller the fluctuation value of the antenna parameter of the antenna farther from the user's hand, and the user can easily and effectively determine the user at the time of the maximum fluctuation The order in which hands pass through different antennas.
在第一方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值末次大于预设阈值的时刻,即第一天线的天线参数的波动结束的时刻;第二时刻是第二天线的天线参数的波动值末次大于预设阈值的时刻,即第二天线的天线参数的波动结束的时刻。上述可能的实现方式中,距离用户手越近的天线的天线参数越早产生波动,距离用户手越远的天线的天线参数越晚产生波动,上述根据波动结束的时刻能够简单有效地确定用户手经过不同天线的先后顺序。In a possible implementation manner of the first aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold for the last time, that is, the moment when the fluctuation of the antenna parameter of the first antenna ends; the second moment It is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the last time, that is, the moment when the fluctuation of the antenna parameter of the second antenna ends. In the above possible implementation manner, the antenna parameters of the antenna closer to the user's hand will fluctuate earlier, and the antenna parameters of the antenna farther from the user's hand will fluctuate later. The above can easily and effectively determine the user's hand according to the time when the fluctuation ends The sequence through different antennas.
在第一方面的一种可能的实现方式中,所述天线参数包括以下参数中的至少一项:信道状态信息CSI的幅度、CSI的相位、接收信号强度指示RSSI、信噪比SNR、信道质量指示CQI、分组接收率PRR、分组丢失率PLR、信号干扰比SIR、信号干扰加噪声比SINR、或者信道探测参考信号SRS。上述可能的实现方式中,能够提高该终端根据第一天线和第二天线的天线参数识别目标手势的多样性和灵活性。In a possible implementation manner of the first aspect, the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, channel quality Indication CQI, packet reception rate PRR, packet loss rate PLR, signal to interference ratio SIR, signal to interference plus noise ratio SINR, or channel sounding reference signal SRS. In the foregoing possible implementation manners, the diversity and flexibility of the terminal to recognize the target gesture according to the antenna parameters of the first antenna and the second antenna can be improved.
在第一方面的一种可能的实现方式中,所述天线参数包括以下参数中的至少一项:阻抗特性、方向图、相关性系统、或者通道校准值。上述可能的实现方式中,能够提高该终端根据第一天线和第二天线的天线参数识别目标手势的多样性和灵活性。In a possible implementation manner of the first aspect, the antenna parameter includes at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value. In the foregoing possible implementation manners, the diversity and flexibility of the terminal to recognize the target gesture according to the antenna parameters of the first antenna and the second antenna can be improved.
第二方面、提供一种终端,该终端包括第一天线和第二天线,第一天线和第二天线的位置不同,该装置包括:获取单元,用于获取第一时刻,第一时刻是在第一天线的天线参数的波动值大于预设阈值时获取的;获取单元,还用于获取第二时刻,第二时刻是在第二天线的天线参数的波动值大于预设阈值时获取的,第二时刻晚于第一时刻;确定单元,用于根据第一时刻、第二时刻、第一天线和第二天线的位置,确定目标手势。In a second aspect, a terminal is provided. The terminal includes a first antenna and a second antenna. The positions of the first antenna and the second antenna are different. The device includes: an acquiring unit for acquiring a first moment, the first moment is at Acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold; the acquisition unit is also used to acquire the second moment, which is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, The second moment is later than the first moment; the determining unit is used to determine the target gesture according to the positions of the first moment, the second moment, the first antenna, and the second antenna.
在第二方面的一种可能的实现方式中,第一天线和第二天线位于终端屏幕的不同侧,比如,第一天线和第二天线在终端屏幕所在平面内投影的水平位置不同、或者垂直不同、或者水平位置和垂直位置均不同。In a possible implementation manner of the second aspect, the first antenna and the second antenna are located on different sides of the terminal screen, for example, the horizontal positions of the first antenna and the second antenna projected in the plane where the terminal screen is located are different, or vertical Different, or different horizontal and vertical positions.
在第二方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值首次大于预设阈值的时刻;第二时刻是第二天线的天线参数的波动值首次大于预设阈值的时刻。In a possible implementation manner of the second aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the first time; the second moment is the fluctuation period of the antenna parameter of the second antenna is greater than the preset value for the first time Set the threshold time.
在第二方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值最大的时刻;第二时刻是第二天线的天线参数的波动值最大的时刻。In a possible implementation manner of the second aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is the largest; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is the largest.
在第二方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值末次大于预设阈值的时刻;第二时刻是第二天线的天线参数的波动值末次大于预设阈值的时刻。In a possible implementation manner of the second aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the last time; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset Set the threshold time.
在第二方面的一种可能的实现方式中,天线参数包括以下参数中的至少一项:信道状态信息CSI的幅度、CSI的相位、接收信号强度指示RSSI、信噪比SNR、信道质量指示CQI、分组接收率PRR、分组丢失率PLR、信号干扰比SIR、信号干扰加噪声比SINR、或者信道探测参考信号SRS。In a possible implementation manner of the second aspect, the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, channel quality indicator CQI , Packet reception rate PRR, packet loss rate PLR, signal-to-interference ratio SIR, signal-to-interference plus noise ratio SINR, or channel sounding reference signal SRS.
在第二方面的一种可能的实现方式中,天线参数包括以下参数中的至少一项:阻抗特性、方向图、相关性系统、或者通道校准值。In a possible implementation manner of the second aspect, the antenna parameter includes at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
第三方面,提供一种终端,该终端包括:处理器、第一天线和第二天线,第一天线和第二天线的位置不同;其中,该处理器被配置为:获取第一时刻。第一时刻是在第一天线的天线参数的波动值大于预设阈值时获取的;获取第二时刻,第二时刻是在第二天线的天线参数的波动值大于预设阈值时获取的,第二时刻晚于第一时刻;根据第一时刻、第二时刻、第一天线和第二天线的位置,确定目标手势。In a third aspect, a terminal is provided. The terminal includes: a processor, a first antenna, and a second antenna, where the positions of the first antenna and the second antenna are different; wherein, the processor is configured to: acquire the first moment. The first moment is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold; the second moment is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, The second moment is later than the first moment; the target gesture is determined according to the positions of the first moment, the second moment, the first antenna and the second antenna.
在第三方面的一种可能的实现方式中,第一天线和所述第二天线位于所述终端屏幕的不同侧,比如,第一天线和第二天线在终端屏幕所在平面内投影的水平位置不同、或者垂直不同、或者水平位置和垂直位置均不同。In a possible implementation manner of the third aspect, the first antenna and the second antenna are located on different sides of the terminal screen, for example, the horizontal positions of the first antenna and the second antenna projected in the plane where the terminal screen is located Different, or different in vertical, or different in horizontal position and vertical position.
在第三方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值首次大于预设阈值的时刻;第二时刻是第二天线的天线参数的波动值首次大于预设阈值的时刻。In a possible implementation manner of the third aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold for the first time; the second moment is the fluctuation period of the antenna parameter of the second antenna is greater than the first time Set the threshold time.
在第三方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值最大的时刻;第二时刻是第二天线的天线参数的波动值最大的时刻。In a possible implementation manner of the third aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is the largest; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is the largest.
在第三方面的一种可能的实现方式中,第一时刻是第一天线的天线参数的波动值末次大于预设阈值的时刻;第二时刻是第二天线的天线参数的波动值末次大于预设阈值的时刻。In a possible implementation manner of the third aspect, the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the last time; the second moment is the moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset Set the threshold time.
在第三方面的一种可能的实现方式中,天线参数包括以下参数中的至少一项:信道状态信息CSI的幅度、CSI的相位、接收信号强度指示RSSI、信噪比SNR、信道质量指示CQI、分组接收率PRR、分组丢失率PLR、信号干扰比SIR、信号干扰加噪声比SINR、或者信道探测参考信号SRS。In a possible implementation manner of the third aspect, the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, channel quality indicator CQI , Packet reception rate PRR, packet loss rate PLR, signal-to-interference ratio SIR, signal-to-interference plus noise ratio SINR, or channel sounding reference signal SRS.
在第三方面的一种可能的实现方式中,天线参数包括以下参数中的至少一项:阻抗特性、方向图、相关性系统、或者通道校准值。In a possible implementation manner of the third aspect, the antenna parameter includes at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
第四方面,提供一种计算机可读存储介质,计算机可读存储介质中存储有指令,当所述指令在具有不同位置的至少两个天线的终端上运行时,使得该终端执行上述第一方面或者第一方面的任一种可能的实现方式所提供的基于多天线的手势识别方法。According to a fourth aspect, a computer-readable storage medium is provided, in which instructions are stored, and when the instructions run on a terminal having at least two antennas in different positions, the terminal is caused to perform the first aspect described above Or a multi-antenna based gesture recognition method provided by any possible implementation manner of the first aspect.
第五方面,提供一种计算机程序产品,当计算机程序产品在具有不同位置的至少两个天线的终端上运行时,使得该终端执行上述第一方面或者第一方面的任一种可能的实现方式所提供的基于多天线的手势识别方法。According to a fifth aspect, there is provided a computer program product which, when the computer program product runs on a terminal having at least two antennas at different positions, causes the terminal to perform the first aspect or any possible implementation manner of the first aspect Provided multi-antenna based gesture recognition method.
可以理解地,上述提供的任一种基于多天线的手势识别方法的终端、计算机存储介质或者计算机程序产品均用于执行上文所提供的对应的方法,因此,其所能达到的 有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。Understandably, any terminal, computer storage medium, or computer program product based on the multi-antenna gesture recognition method provided above is used to perform the corresponding method provided above, and therefore, the beneficial effects that it can achieve With reference to the beneficial effects in the corresponding methods provided above, they are not repeated here.
附图说明BRIEF DESCRIPTION
图1为本申请实施例提供的一种终端的结构示意图一;1 is a schematic structural diagram 1 of a terminal provided by an embodiment of the present application;
图1A为本申请实施例提供的一种设置悬浮手势的界面示意图;1A is a schematic diagram of an interface for setting a floating gesture provided by an embodiment of the present application;
图1B为本申请实施例提供的一种使用悬浮手势解锁的界面示意图;FIG. 1B is a schematic diagram of an interface for unlocking using a floating gesture provided by an embodiment of the present application;
图1C为本申请实施例提供的一种使用悬浮手势接听电话的界面示意图;1C is a schematic diagram of an interface for receiving a call using a floating gesture provided by an embodiment of the present application;
图1D为本申请实施例提供的一种使用悬浮手势切换歌曲的界面示意图;1D is a schematic diagram of an interface for switching songs using floating gestures provided by an embodiment of the present application;
图2为本申请实施例提供的一种基于多天线的手势识别方法的流程示意图;2 is a schematic flowchart of a gesture recognition method based on multiple antennas provided by an embodiment of the present application;
图3为本申请实施例提供的一种至少两个天线的分布示意图一;FIG. 3 is a schematic diagram 1 of at least two antennas provided by an embodiment of the present application;
图4为本申请实施例提供的一种至少两个天线的分布示意图二;4 is a second schematic diagram of distribution of at least two antennas provided by an embodiment of the present application;
图5为本申请实施例提供的一种天线参数的波动示意图;FIG. 5 is a schematic diagram of an antenna parameter fluctuation provided by an embodiment of the present application;
图6为本申请实施例提供的一种至少两个天线的分布示意图三;6 is a third schematic diagram of distribution of at least two antennas provided by an embodiment of the present application;
图7为本申请实施例提供的一种至少两个天线的分布示意图四;7 is a schematic diagram 4 of at least two antennas provided by an embodiment of the present application;
图8为本申请实施例提供的一种手势的示意图;8 is a schematic diagram of a gesture provided by an embodiment of the present application;
图9为本申请实施例提供的一种至少两个天线的分布示意图五;9 is a schematic diagram 5 of distribution of at least two antennas provided by an embodiment of the present application;
图10为本申请实施例提供的一种目标手势的示意图;10 is a schematic diagram of a target gesture provided by an embodiment of the present application;
图11为本申请实施例提供的一种终端的结构示意图二。11 is a second schematic structural diagram of a terminal according to an embodiment of the present application.
具体实施方式detailed description
本申请中,“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,a-b,a-c,b-c或a-b-c,其中a、b和c可以是单个,也可以是多个。字符“/”一般表示前后关联对象是一种“或”的关系。In this application, "at least one" refers to one or more, and "multiple" refers to two or more. "And / or" describes the relationship of the related objects, indicating that there can be three relationships, for example, A and / or B, which can mean: A exists alone, A and B exist at the same time, B exists alone, where A, B can be singular or plural. "At least one of the following" or a similar expression refers to any combination of these items, including any combination of a single item or a plurality of items. For example, at least one (a) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c may be single or multiple. The character "/" generally indicates that the related object is a "or" relationship.
需要说明的是,本申请中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其他实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。It should be noted that in the present application, the words "exemplary" or "for example" are used as examples, illustrations or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as more preferred or advantageous than other embodiments or design. Rather, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific manner.
本申请实施例提供一种基于多天线的手势识别方法,可以应用于配置有至少两个天线的终端中,且至少两个天线的位置不同,本申请可用于提高基于无线信号的手势识别的识别效率和适用性。基于无线信号的手势识别的基本原理在于:在用户作出目标手势之前,当终端的天线接收到的无线信号相对比较平稳,比如仅在一个很小的范围内波动;当终端附近存在运动的物体(比如用户作出目标手势)时,物体不同的姿态、速度和角度等会导致空间中无线信号的反射、折射、衍射的不同,进而影响天线接收的无线信号发生变化,比如在手靠近终端的天线时会造成无线信号的遮挡或反射,从而导致天线接收到的无线信号的质量变差,当手不断运动时,会导致无线信号的质量出现较大范围内的不规则波动等。这里的无线信号可以通过无线信道信息来反映。基于此,本申请实施例提供的手势识别方法,通过在至少两个天线的无线信道信息出 现波动时,获取至少两个天线的无线信道信息波动的时刻,基于不同天线的无线信道信息波动的时刻的先后顺序、以及至少两个天线的位置,确定目标手势的运动轨迹,进而识别出该目标手势。Embodiments of the present application provide a gesture recognition method based on multiple antennas, which can be applied to a terminal configured with at least two antennas and at least two antennas have different positions. The present application can be used to improve recognition of gesture recognition based on wireless signals Efficiency and suitability. The basic principle of wireless signal-based gesture recognition is that before the user makes the target gesture, when the wireless signal received by the terminal ’s antenna is relatively stable, for example, it only fluctuates within a small range; when there is a moving object near the terminal ( For example, when the user makes a target gesture, different postures, speeds, and angles of the object will cause differences in the reflection, refraction, and diffraction of the wireless signal in space, which will affect the wireless signal received by the antenna. It will cause the occlusion or reflection of the wireless signal, which will result in the deterioration of the quality of the wireless signal received by the antenna. When the hand keeps moving, it will cause the quality of the wireless signal to fluctuate in a large range and so on. The wireless signal here can be reflected by the wireless channel information. Based on this, the gesture recognition method provided by the embodiment of the present application obtains the moment when the wireless channel information of at least two antennas fluctuates when the wireless channel information of at least two antennas fluctuates, based on the moment when the wireless channel information of different antennas fluctuates The sequence of and the positions of at least two antennas determine the trajectory of the target gesture, and then recognize the target gesture.
另外,由于物体的运动,还会导致天线的工作状态发生变化,比如当手靠近终端时会导致天线周围的阻抗特性改变,当手不断运动时,会导致天线的阻抗特性出现不规则波动等,从而导致测量得到天线状态也会出现不规则波动。因此,本申请实施例还提供一种手势识别方法,通过在至少两个天线的天线状态信息出现波动时,获取至少两个天线的天线状态信息波动的时刻,基于不同天线的天线状态信息波动的时刻的先后顺序、以及至少两个天线的位置,确定目标手势的运动轨迹,进而识别出该目标手势。In addition, due to the movement of the object, the working state of the antenna will also change. For example, when the hand is close to the terminal, the impedance characteristics around the antenna will change. When the hand continues to move, it will cause irregular fluctuations in the impedance characteristics of the antenna. As a result, the measured antenna state will also fluctuate irregularly. Therefore, the embodiments of the present application also provide a gesture recognition method, by acquiring the moment when the antenna state information of at least two antennas fluctuates when the antenna state information of at least two antennas fluctuates, based on the fluctuation of the antenna state information of different antennas The time sequence and the position of at least two antennas determine the movement trajectory of the target gesture, and then recognize the target gesture.
需要说明的是,本申请实施例中的波动可以是指天线参数在一个基准值(比如,该基准值可以表示天线参数在未受到目标手势影响时在一段时间内的平均值)上下有规则或者无规则的跳变。相比于目标手势引起的天线参数的波动,该终端中器件的热噪声引起的天线参数的波动仅是一个很小范围内的无规则波动。对于该很小范围内的波动,该终端可能由于检测精确度不足而无法检测到;或者,当该终端检测到一个很小范围内的波动时,该终端不响应该波动或认为未出现波动,从而该终端不执行本申请实施例所提供的方法。因此,本申请实施例中的所述天线参数出现波动可以是指由目标手势引起的天线参数的波动,即天线参数在一个较大范围内的波动,比如,当波动值大于一个预设阈值时即认为所述天线参数出现波动。另外,评估“波动”的方法包括但不限于:方差、标准差、极值、导数、变化率、绝对误差、概率分布、异常检测等,以及通过机器学习等方法训练得到的用于识别“波动”的训练模型等,本申请实施例对此不作详细描述。It should be noted that the fluctuation in the embodiment of the present application may refer to that the antenna parameters have rules up or down at a reference value (for example, the reference value may represent the average value of the antenna parameters over a period of time when not affected by the target gesture) or Irregular jumps. Compared with the fluctuation of the antenna parameter caused by the target gesture, the fluctuation of the antenna parameter caused by the thermal noise of the device in the terminal is only a random fluctuation within a small range. For the fluctuation within a very small range, the terminal may not be able to detect it due to insufficient detection accuracy; or, when the terminal detects a fluctuation within a small range, the terminal does not respond to the fluctuation or considers that there is no fluctuation, Therefore, the terminal does not execute the method provided in the embodiments of the present application. Therefore, the fluctuation of the antenna parameter in the embodiment of the present application may refer to the fluctuation of the antenna parameter caused by the target gesture, that is, the fluctuation of the antenna parameter in a larger range, for example, when the fluctuation value is greater than a preset threshold That is to say that the antenna parameters fluctuate. In addition, methods for evaluating "fluctuation" include, but are not limited to: variance, standard deviation, extreme value, derivative, rate of change, absolute error, probability distribution, anomaly detection, etc., as well as training for machine learning and other methods for identifying "fluctuation" "Training model, etc., this embodiment of the present application will not be described in detail.
本申请实施例所述的终端可以为配置有至少两个天线的各种设备。例如,该终端可以为手机、平板电脑、计算机、笔记本电脑、摄像机、照相机、可穿戴设备(例如智能手表等)、车载设备、超级移动个人计算机(Ultra-mobile Personal Computer,UMPC)、上网本、蜂窝电话、以及个人数字助理(Personal Digital Assistant,PDA)等。为方便描述,本申请中将上面提到的设备统称为终端。如图1所示,以该终端为手机为例进行说明,该手机包括:RF电路101、存储器102、处理器103、传感器组件104、多媒体组件105、电源组件106以及输入\输出接口107。The terminal described in the embodiment of the present application may be various devices configured with at least two antennas. For example, the terminal may be a mobile phone, a tablet computer, a computer, a notebook computer, a video camera, a camera, a wearable device (such as a smart watch, etc.), an in-vehicle device, an ultra-mobile personal computer (Ultra-mobile Personal Computer, UMPC), a netbook, a cellular Telephone, personal digital assistant (Personal Digital Assistant, PDA), etc. For convenience of description, the above-mentioned devices are collectively referred to as terminals in this application. As shown in FIG. 1, the terminal is a mobile phone as an example. The mobile phone includes: an RF circuit 101, a memory 102, a processor 103, a sensor component 104, a multimedia component 105, a power component 106, and an input / output interface 107.
下面结合图1对该手机的各个构成部件进行具体的介绍:The following describes each component of the mobile phone in detail with reference to FIG. 1:
RF电路101可用于收发信息或通话过程中,信号的接收和发送,特别地,将基站的下行信息接收后,给处理器103处理,以及将上行的数据发送给基站。通常,RF电路101包括但不限于至少两个天线、放大器、收发信机、耦合器、低噪声放大器(low noise amplifier,LNA)、双工器等。此外,RF电路101还可以通过无线通信与其他设备通信。The RF circuit 101 can be used for receiving and sending signals during receiving and sending information or during a call. In particular, after receiving the downlink information of the base station, it is processed by the processor 103 and the uplink data is sent to the base station. Generally, the RF circuit 101 includes, but is not limited to, at least two antennas, amplifiers, transceivers, couplers, low noise amplifiers (LNA), duplexers, and the like. In addition, the RF circuit 101 can also communicate with other devices through wireless communication.
存储器102可用于存储数据、软件程序以及模块;主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序,比如声音播放功能、图像播放功能等;存储数据区可存储根据该手机的使用所创建的数据,比如音频数据、图像数据、电话本等。此外,该手机可以包括高速随机存取存储器,还 可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 102 can be used to store data, software programs, and modules; mainly including a storage program area and a storage data area, wherein the storage program area can store an operating system and application programs required for at least one function, such as a sound playback function, an image playback function, etc. ; The storage data area can store data created according to the use of the mobile phone, such as audio data, image data, phone book, etc. In addition, the mobile phone may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
处理器103是该手机的控制中心,利用各种接口和线路连接整个设备的各个部分,通过运行或执行存储在存储器102内的软件程序和/或模块,以及调用存储在存储器102内的数据,执行该手机的各种功能和处理数据,从而对该手机进行整体监控。可选地,处理器103可包括一个或多个处理单元,比如,处理器103可集成应用处理器(Application Processor,AP)和基带处理器(modem),手机的操作系统、用户界面和应用程序等可以在AP上运行处理,通信功能可以在基带处理器上处理。可以理解的是,上述,基带处理器也可以不集成到处理器103中。The processor 103 is the control center of the mobile phone, and uses various interfaces and lines to connect various parts of the entire device, by running or executing the software programs and / or modules stored in the memory 102, and calling the data stored in the memory 102, Perform various functions and process data of the mobile phone to monitor the mobile phone as a whole. Optionally, the processor 103 may include one or more processing units, for example, the processor 103 may integrate an application processor (Application Processor, AP) and a baseband processor (modem), an operating system, a user interface, and an application program of a mobile phone Can be processed on the AP, and communication functions can be processed on the baseband processor. It can be understood that, as described above, the baseband processor may not be integrated into the processor 103.
传感器组件104包括一个或多个传感器,用于为该手机提供各个方面的状态评估。其中,传感器组件104可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传感器,通过传感器组件103可以检测到该手机的加速/减速、方位、打开/关闭状态,组件的相对定位,或该手机的温度变化等。此外,传感器组件104还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。The sensor component 104 includes one or more sensors, which are used to provide various aspects of status assessment for the mobile phone. The sensor component 104 may include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor or a temperature sensor, and the sensor component 103 can detect the acceleration / deceleration, orientation, on / off status of the mobile phone, and the relative positioning of the component, or The temperature of the phone changes, etc. In addition, the sensor assembly 104 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
多媒体组件105在该手机和用户之间的提供一个输出接口的屏幕,该屏幕可以为触摸面板,且当该屏幕为触摸面板时,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。此外,多媒体组件105还包括至少一个摄像头,比如,多媒体组件105包括一个前置摄像头和/或后置摄像头。当该手机处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。The multimedia component 105 provides a screen of an output interface between the mobile phone and the user. The screen may be a touch panel, and when the screen is a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundary of the touch or sliding action, but also detect the duration and pressure related to the touch or sliding operation. In addition, the multimedia component 105 further includes at least one camera. For example, the multimedia component 105 includes a front camera and / or a rear camera. When the mobile phone is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
电源组件106用于为该手机的各个组件提供电源,电源组件106可以包括电源管理系统,一个或多个电源,及其他与该手机生成、管理和分配电力相关联的组件。输入\输出接口107为处理器103和外围接口模块之间提供接口,比如,外围接口模块可以键盘、鼠标等。The power component 106 is used to provide power for various components of the mobile phone. The power component 106 may include a power management system, one or more power sources, and other components associated with the generation, management, and distribution of power by the mobile phone. The input / output interface 107 provides an interface between the processor 103 and a peripheral interface module, for example, the peripheral interface module may be a keyboard, a mouse, and so on.
尽管未示出,该手机还可以包括音频组件和通信模块等,比如音频组件包括麦克风和扬声器等,通信模块可以包括无线保真(wireless fidelity,WiFi)模块、蓝牙模块、近距离无线通信(near field communication,NFC)模块、全球卫星导航系统(global navigation satellite system,GNSS)模块或调频(frequency modulation,FM)模块中的一种或多种,本申请实施例在此不再赘述。本领域技术人员可以理解,图1中示出的手机结构并不构成对手机的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Although not shown, the mobile phone may further include an audio component and a communication module, for example, the audio component includes a microphone and a speaker, etc. The communication module may include a wireless fidelity (WiFi) module, a Bluetooth module, and short-range wireless communication (near One or more of a field communication (NFC) module, a global navigation system (GNSS) module or a frequency modulation (FM) module, and the embodiments of the present application will not repeat them here. Those skilled in the art may understand that the structure of the mobile phone shown in FIG. 1 does not constitute a limitation on the mobile phone, and may include more or less components than those shown in the figure, or a combination of certain components, or a different arrangement of components.
需要说明的是,本申请实施例中的至少两个天线可以包括上述射频电路对应的天线、WiFi模块对应的天线、蓝牙模块对应的天线、NFC模块对应的天线等。此外,至少两个天线可以是分别独立设置的,也可以是集成设置的(比如,蜂窝天线)等,本申请实施例对天线的具体形态不作限定。It should be noted that at least two antennas in the embodiments of the present application may include the antenna corresponding to the radio frequency circuit, the antenna corresponding to the WiFi module, the antenna corresponding to the Bluetooth module, and the antenna corresponding to the NFC module. In addition, at least two antennas may be separately installed, or may be integrated (for example, a cellular antenna), etc. The embodiment of the present application does not limit the specific form of the antenna.
本申请实施例提供的方法可适用于该终端的各种应用场景中,通过本申请提供的 方法识别出的目标手势的作用与用户直接在触摸屏上作出的手势或者通过其他输入设备输入的手势命令等的作用可以有相同的效果。本申请实施例中用户作出的目标手势可以是在该终端附近(比如,距离该终端的屏幕上方3-5cm的范围等)作出的悬浮手势;或者是用户使用手直接在触摸屏上作出的手势,比如,当该终端的触摸屏损坏时,该终端可通过本申请提供的方法识别出用户直接在触摸屏作出的手势;或者是用户戴着防护套具等直接在触摸屏上作出的手势,比如,当用户带有手套时,用户无需摘卸可直接在触摸屏上作出的手势,该终端可通过本申请提供的方法识别出用户作出的手势。The method provided by the embodiments of the present application can be applied to various application scenarios of the terminal. The role of the target gesture recognized by the method provided by the present application and the gesture directly made by the user on the touch screen or the gesture command input through other input devices The effect of etc. can have the same effect. In this embodiment of the present application, the target gesture made by the user may be a floating gesture made near the terminal (for example, within a range of 3-5 cm above the screen of the terminal, etc.); or a gesture made directly by the user on the touch screen with his hand, For example, when the touch screen of the terminal is damaged, the terminal can recognize the gestures directly made by the user on the touch screen through the method provided in this application; or the gestures made directly on the touch screen by the user wearing a protective suit, for example, when the user When wearing gloves, the user can directly make gestures on the touch screen without taking off and taking off. The terminal can recognize the gestures made by the user through the method provided in the present application.
其中,用户在使用悬浮手势时,用户可以在该终端的设置选项中进行配置。比如,如图1A中的(a)所示,该终端的设置选项中有“悬浮手势”,用户在选择“悬浮手势”的选项之后,显示如图1A中的(b)所示的界面,其中“开启”选项用于开启悬浮手势,“关闭”选项用于关闭悬浮手势,则当用户选择“开启”选项后,该终端即可识别用户作出的悬浮手势,并根据具体的悬浮手势执行对应的指令。示例性的,如图1B所示,当该终端处于锁屏状态(如图1B中的(a))时,用户可在该终端的屏幕上方作出向右滑动的悬浮手势(如图1B中的(b)所示),则该终端可通过本申请提供的方法识别出的向右滑动的手势,进而为用户解锁显示该终端的主界面(如图1B中的(c)所示)。或者,如图1C所示,当该终端处于来电状态(如图1C中的(a)所示)时,用户可在该终端的屏幕上方作出向右滑动的悬浮手势(如图1C中的(b)所示),则该终端可通过本申请提供的方法识别出的向右滑动的手势,进而为用户接通电话并显示通话界面(如图1C中的(c)所示),当然用户也可在该终端的屏幕上方作出向左滑动的悬浮手势以挂断电话。或者,如图1D所示,当用户使用该终端听音乐(如图1D中的(a)所示)时,用户可在该终端的屏幕上方作出向左滑动的悬浮手势(如图1D中的(b)所示),通过本申请提供的方法识别出的向左滑动可用于播放上一首歌曲,进而该终端为用户切换至上一首歌曲进行播放(如图1D中的(c)所示),当然用户也可在该终端的屏幕上方作出向右滑动的悬浮手势以切换至下一首歌曲,或者在该终端的屏幕上方作出向上滑动的悬浮手势以增大音量,或者在该终端的屏幕上方作出向下滑动的悬浮手势以减小音量等,本申请实施例在此不再一一画图示意。类似的,当用户使用该终端的通讯录时,用户可作出向上滑动或向下滑动的手势等,该终端通过本申请提供的方法识别出目标手势为向上滑动时可用于为用户显示上一页通讯录,若识别出目标手势为向下滑动时可用于为用户显示下一页通讯录;或者,当用户使用该终端翻看相册时,用户可作出向左滑动或向右滑动的手势等,该终端通过本申请提供的方法识别出目标手势为向右滑动时可用于为用户显示下一张图片,若识别出目标手势为向左滑动时可用于为用户显示上一张图片。Among them, when the user uses the hovering gesture, the user can configure in the setting options of the terminal. For example, as shown in (a) of FIG. 1A, the terminal has “floating gestures” in the setting options. After the user selects the option of “floating gestures”, the interface shown in (b) of FIG. 1A is displayed. Among them, the "open" option is used to turn on the floating gesture, and the "off" option is used to turn off the floating gesture. When the user selects the "on" option, the terminal can recognize the floating gesture made by the user and perform the corresponding according to the specific floating gesture Instructions. Exemplarily, as shown in FIG. 1B, when the terminal is in the lock screen state (as (a) in FIG. 1B), the user may make a floating gesture of swiping to the right on the screen of the terminal (as in FIG. 1B) (b)), then the terminal can recognize the gesture of swiping right by the method provided in this application, and then unlock and display the main interface of the terminal for the user (as shown in (c) in FIG. 1B). Or, as shown in FIG. 1C, when the terminal is in an incoming call state (as shown in (a) in FIG. 1C), the user may make a floating gesture of swiping right on the screen of the terminal (as shown in ( b) as shown), the terminal can recognize the gesture of swiping right by the method provided in this application, and then connect the phone to the user and display the call interface (as shown in (c) in FIG. 1C), of course the user You can also make a floating gesture of swiping left on the screen of the terminal to hang up the phone. Or, as shown in FIG. 1D, when the user uses the terminal to listen to music (as shown in (a) in FIG. 1D), the user may make a floating gesture of swiping left on the screen of the terminal (as in FIG. 1D) (b)), the swipe left identified by the method provided by this application can be used to play the previous song, and then the terminal switches the user to the previous song for playback (as shown in (c) in FIG. 1D) ), Of course, the user can also make a floating gesture of swiping right on the screen of the terminal to switch to the next song, or make a floating gesture of sliding up on the screen of the terminal to increase the volume, or on the terminal A floating gesture of sliding down at the top of the screen is made to reduce the volume, etc., and the embodiments of the present application will not be illustrated one by one here. Similarly, when the user uses the address book of the terminal, the user can make a gesture of swiping up or down, etc. The terminal can be used to display the previous page for the user when the target gesture is recognized as swiping upward by the method provided in this application The address book can be used to display the next page of address book for the user when the target gesture is swiped down; or, when the user uses the terminal to scroll through the album, the user can make a gesture of swiping left or right, etc. The terminal can be used to display the next picture for the user when the target gesture is swiped to the right by the method provided in this application, and can be used to display the previous picture for the user if the target gesture is swiped to the left.
图2为本申请实施例提供的一种基于多天线的手势识别方法的流程示意图,该方法可以在上述图1所示的终端中实现。参见图2,该方法可以包括以下几个步骤。FIG. 2 is a schematic flowchart of a gesture recognition method based on multiple antennas provided by an embodiment of the present application. The method may be implemented in the terminal shown in FIG. 1. Referring to FIG. 2, the method may include the following steps.
S201:该终端获取第一时刻,第一时刻是在第一天线的天线参数的波动值大于预设阈值时获取的,以及获取第二天线的第二时刻,第二时刻是在第二天线的天线参数的波动值大于预设阈值时获取的,第二时刻晚于第一时刻。S201: The terminal acquires the first moment, which is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold, and the second moment when the second antenna is acquired, the second moment is at the second antenna When the fluctuation value of the antenna parameter is greater than the preset threshold, the second moment is later than the first moment.
其中,该终端包括至少两个天线,至少两个天线至少包括第一天线和第二天线, 每个天线都可用于接收无线信号,下面以至少两个天线为例进行说明。至少两个天线的位置不同可以是指至少两个天线在该终端上的位置不同;可选的,至少两个天线中存在第一天线和第二天线不在该终端屏幕的同一侧。比如,将至少两个天线投影在该终端的屏幕所在的平面时,至少两个天线在该平面内的投影位置不同,若该平面通过二维空间(x轴和y轴)表示,则至少两个天线在该平面内的投影对应在x轴上的值不同、或者在y轴上的值不同、或者在x轴上的值和y轴上的值均不同。The terminal includes at least two antennas. The at least two antennas include at least a first antenna and a second antenna. Each antenna can be used to receive a wireless signal. The following uses at least two antennas as an example for description. The different positions of the at least two antennas may mean that the positions of the at least two antennas on the terminal are different; optionally, among the at least two antennas, the first antenna and the second antenna are not on the same side of the terminal screen. For example, when projecting at least two antennas on the plane where the screen of the terminal is located, the projection positions of at least two antennas in the plane are different. If the plane is represented by a two-dimensional space (x-axis and y-axis), then at least two antennas The projections of the antennas in this plane correspond to different values on the x-axis, or different values on the y-axis, or different values on the x-axis and y-axis.
示例性的,以图3和图4所示的至少两个天线为例对至少两个天线的数量和每个天线的位置进行举例说明,图3和图4中以该终端屏幕所在的平面为投影面、水平方向为x轴、垂直方向为y轴为例,T表示该终端的顶部,B表示该终端的底部,L表示该终端的左侧,R表示该终端的右侧。图3中的(a)~(c)所示,以至少两个天线包括两个天线(天线1和天线2)为例,当天线1和天线2分别设置于终端的左侧和右侧、且天线1和天线2的投影对应在y轴上的值相同时如图3中的(a)所示,当天线1和天线2的投影对应在y轴上的值不同时如图3中的(b)或者(c)所示。图4中以至少两个天线包括三个天线(天线1、天线2和天线3)为例,当天线1和天线2分别设置于终端的左侧和右侧、且天线1和天线2的投影对应在y轴上的值不同,天线3设置于终端的底部(即在x轴的值和y轴上的值与天线1和天线2均不同)时如图4中的(a)或(b)所示。Exemplarily, taking the at least two antennas shown in FIGS. 3 and 4 as an example to illustrate the number of at least two antennas and the position of each antenna, the plane where the terminal screen is located in FIGS. 3 and 4 is For example, the projection plane, the x-axis in the horizontal direction, and the y-axis in the vertical direction, T represents the top of the terminal, B represents the bottom of the terminal, L represents the left side of the terminal, and R represents the right side of the terminal. As shown in (a) to (c) of FIG. 3, taking at least two antennas including two antennas (antenna 1 and antenna 2) as an example, when antenna 1 and antenna 2 are respectively disposed on the left and right sides of the terminal, When the projection values of antenna 1 and antenna 2 correspond to the same value on the y-axis, as shown in (a) in FIG. 3, when the projection values of antenna 1 and antenna 2 correspond to different values on the y-axis, as shown in FIG. 3 (b) or (c). In FIG. 4, taking at least two antennas including three antennas (antenna 1, antenna 2 and antenna 3) as an example, when antenna 1 and antenna 2 are respectively disposed on the left and right sides of the terminal, and the projection of antenna 1 and antenna 2 Corresponding to different values on the y-axis, the antenna 3 is set at the bottom of the terminal (that is, the values on the x-axis and the y-axis are different from those of the antenna 1 and the antenna 2) as shown in (a) or (b) in FIG. 4 ) As shown.
另外,该天线参数可以为无线信道信息中的参数和/或者天线状态信息参数。无线信道信息用于反映无线信号的状态,可以根据天线接收的无线信号计算出来;天线状态信息用于反映天线的工作状态,可以根据天线的工作状态测量得到的。对于无线信道信息,在用户作出目标手势之前,该终端的天线接收到的无线信号可能相对比较平稳,比如仅在一个很小的范围内波动,从而基于该无线信号计算得到的无线信道信息也相对稳定;当用户在该终端的附近作出目标手势时,该终端的至少两个天线会受到该手势的影响,即至少两个天线接收到的无线信号会产生波动,比如在一个较大的范围内波动,从而根据波动后的无线信号计算得到的无线信道信息也会产生波动。同理,对于天线状态信息,在用户作出目标手势之前,该终端测量得到的天线的工作状态也相对稳定;当用户在该终端的附近作出目标手势时,天线的工作状态会受到手的影响而产生波动,比如天线的阻抗特性等会受到手的影响而产生变化,进而测量得到的阻抗特性会产生波动。In addition, the antenna parameters may be parameters in wireless channel information and / or antenna state information parameters. The wireless channel information is used to reflect the state of the wireless signal, which can be calculated according to the wireless signal received by the antenna; the antenna state information is used to reflect the working state of the antenna, which can be measured according to the working state of the antenna. For wireless channel information, before the user makes the target gesture, the wireless signal received by the terminal ’s antenna may be relatively stable, such as fluctuating only within a small range, so the wireless channel information calculated based on the wireless signal is also relatively Stable; when the user makes a target gesture near the terminal, at least two antennas of the terminal will be affected by the gesture, that is, the wireless signals received by the at least two antennas will fluctuate, such as in a large range Fluctuation, so that the wireless channel information calculated based on the fluctuated wireless signal will also fluctuate. Similarly, for the antenna state information, before the user makes the target gesture, the working state of the antenna measured by the terminal is relatively stable; when the user makes the target gesture near the terminal, the working state of the antenna is affected by the hand. Fluctuations, such as the impedance characteristics of the antenna, will be affected by the hand and change, and then the measured impedance characteristics will fluctuate.
具体的,当用户在该终端的附近作出目标手势(该目标手势可以是悬浮手势或者是直接作用在触摸屏上的手势)时,该终端的至少两个天线的天线参数会受到该手势的影响,即至少两个天线的无线信道信息或者天线状态信息会产生波动,从而该终端可以获取至少两个天线的天线参数波动的时刻。Specifically, when the user makes a target gesture near the terminal (the target gesture may be a hovering gesture or a gesture directly acting on the touch screen), the antenna parameters of at least two antennas of the terminal will be affected by the gesture, That is, the wireless channel information or the antenna status information of at least two antennas may fluctuate, so that the terminal can obtain the moment when the antenna parameters of the at least two antennas fluctuate.
可选的,该终端可以检测至少两个天线的天线参数,当至少两个天线的天线参数产生波动时,该终端获取至少两个天线的天线参数对应的时间信息序列(即不同时刻对应的天线参数),并所述时间信息序列中提取出每个天线的天线参数波动的时刻。可选的,该时刻可以是波动开始时的时刻,即天线参数的波动值首次大于预设阈值的时刻(比如,该时刻的天线参数值与前面一个或者多个时刻的天线参数值之差均小于预设阈值,与后面一个或者多个时刻的天线参数值之差均大于预设阈值);或者是波 动结束时的时刻,即天线参数的波动值末次大于预设阈值的时刻(比如,该时刻的天线参数值与后面一个或者多个时刻的天线参数值之差均小于预设阈值)、或者波动最大的时刻,即天线参数的波动最大的时刻(比如,该时刻的天线参数值与前面一个或者多个时刻的天线参数值之差最大,与后一个或者多个时刻的天线参数值之差也最大)等,本申请实施例对此不作具体限定。Optionally, the terminal may detect the antenna parameters of at least two antennas, and when the antenna parameters of the at least two antennas fluctuate, the terminal obtains the time information sequence corresponding to the antenna parameters of the at least two antennas (that is, the antennas corresponding to different times) Parameter), and the time when the antenna parameter of each antenna fluctuates is extracted from the time information sequence. Optionally, the moment may be the moment when the fluctuation starts, that is, the moment when the fluctuation value of the antenna parameter is greater than a preset threshold for the first time (for example, the difference between the antenna parameter value at this moment and the antenna parameter value at one or more previous moments is the same Is less than the preset threshold, and the difference between the antenna parameter value at one or more later moments is greater than the preset threshold); or the moment when the fluctuation ends, that is, the moment when the fluctuation value of the antenna parameter last exceeds the preset threshold (for example, the The difference between the antenna parameter value at that moment and the antenna parameter value at one or more later moments is less than the preset threshold), or the moment when the fluctuation is greatest, that is, the moment when the antenna parameter fluctuates most (for example, the antenna parameter value at that moment and the previous The difference between the antenna parameter values at one or more moments is the largest, and the difference between the antenna parameter values at the latter one or more moments is also the largest), etc., which is not specifically limited in the embodiments of the present application.
在实际应用中,无线信道信息可以通过一个或者多个参数来反映,因此,本申请实施例中可以从无线信道信息包括的以下参数中的至少一项获取上述波动的时刻:信道状态信息(Channel Status Information,CSI)的幅度、CSI的相位、接收信号强度指示(Received Signal Strength Indicator,RSSI)、信噪比(Signal Noise Ratio,SNR)、信道质量指示(Channel Quality Indicator,CQI)、分组接收率(Packet Reception Rate,PRR)、分组丢失率(Packet Loss Rate,PLR)、信号干扰比(Signal to Interference Ratio,SIR)、信号干扰加噪声比(Signal to Interference plus Noise Ratio,SINR)、或者信道探测参考信号(Sounding Reference Signal,SRS)。类似的,天线状态信息也可以通过一个或者多个参数来反映,因此,本申请实施例中可以从天线状态信息包括的以下参数中的至少一项获取上述波动的时刻:阻抗特性、方向图、相关性系统、或者通道校准值。In practical applications, the wireless channel information may be reflected by one or more parameters. Therefore, in this embodiment of the present application, the time of the fluctuation may be obtained from at least one of the following parameters included in the wireless channel information: channel state information (Channel Status, Information (CSI) amplitude, CSI phase, Received Signal Strength Indicator (Received Signal Strength Indicator, RSSI), Signal to Noise Ratio (Signal Noise, Ratio, SNR), Channel Quality Indicator (Channel Quality Indicator, CQI), packet reception rate (Packet Reception Rate, PRR), packet loss rate (Packet Loss Rate, PLR), signal to interference ratio (Signal to Interference Ratio, SIR), signal interference to noise ratio (Signal to Interference plus Noise Rate, SINR), or channel detection Reference signal (SoundingReferenceSignal, SRS). Similarly, the antenna state information can also be reflected by one or more parameters. Therefore, in the embodiments of the present application, the above-mentioned fluctuation time can be obtained from at least one of the following parameters included in the antenna state information: impedance characteristic, direction pattern, Correlation system, or channel calibration value.
示例性的,以至少两个天线包括天线1和天线2、且天线1和天线2的位置如图3中的(b)所示为例。当该无线信道信息包括CSI或者RSSI、且用户作出某一手势时,终端获取到天线1和天线2的CSI波动的时间信息序列如图5中的(a)所示,获取到的天线1和天线2的RSSI波动的时间信息序列如图5中的(b)所示,图5中以ANT1表示天线1,ANT2表示天线2。Exemplarily, taking at least two antennas including antenna 1 and antenna 2, and the positions of antenna 1 and antenna 2 as shown in (b) in FIG. 3 as an example. When the wireless channel information includes CSI or RSSI, and the user makes a certain gesture, the terminal obtains the time information sequence of the CSI fluctuations of antenna 1 and antenna 2 as shown in (a) in FIG. 5, the acquired antenna 1 and The time information sequence of the RSSI fluctuation of the antenna 2 is as shown in (b) of FIG. 5, in FIG. 5, ANT1 represents antenna 1 and ANT2 represents antenna 2.
对于图5中的(a),若以CSI(是一种系数)的值变化大于阈值20确定为其出现波动,则ANT1的CSI大约在0.72s时的值(略低于200)与前面几个时刻的值之差均小于20、且与后面几个时刻的值之差均大于20(即波动开始的时刻为0.72s),在0.72s至1.25s之间持续上下波动,且在1.05s时的值(约为210)与前一时刻和后一时刻的值之差最大(即波动最大的时刻为1.05s),在1.25s时的值(约为220)与后面几个时刻的值之差均小于20(即波动结束的时刻为1.25s)。ANT2的CSI大约在0.64s时的值(略大于100)与前面几个时刻的值之差均大于20、且与后面几个时刻的值之差均大于20(即开始波动的时刻为0.64s),在0.64s至1.25s之间持续上下波动,且在0.95s时的值(约为230)与前一时刻和后一时刻的值之差最大(即波动最大时刻为0.95s),在1.25s时的值(约为150)与后面几个时刻的值之差均小于20(即波动结束的时刻为1.25s)。因此,根据上述图5中的(a)所示,可知ANT1波动开始的时刻0.72s晚于ANT2波动开始的时刻0.64s;ANT1波动最大的时刻1.05s晚于ANT2波动最大的时刻0.95s。For (a) in Figure 5, if the change in CSI (which is a coefficient) is greater than the threshold 20 and it is determined that there is fluctuation, then the CSI of ANT1 is about 0.72s (slightly lower than 200) and the previous few. The difference between the values at each moment is less than 20, and the difference from the values at the next few moments is greater than 20 (that is, the moment when the fluctuation starts is 0.72s), which continues to fluctuate between 0.72s and 1.25s, and is 1.05s The difference between the value of time (about 210) and the value of the previous moment and the next moment is the largest (that is, the moment with the greatest fluctuation is 1.05s), the value at 1.25s (about 220) and the value of the following moments The difference is less than 20 (that is, the moment when the fluctuation ends is 1.25s). The difference between ANT2's CSI value at about 0.64s (slightly greater than 100) and the values at the previous moments are both greater than 20, and the difference from the values at the later moments are greater than 20 (that is, the moment when the fluctuation starts is 0.64s ), Continuously fluctuating up and down between 0.64s and 1.25s, and the difference between the value at 0.95s (approximately 230) and the value at the previous and next moments is the largest (that is, the maximum fluctuation is 0.95s), at The difference between the value at 1.25s (approximately 150) and the values at the following moments is less than 20 (that is, the moment when the fluctuation ends is 1.25s). Therefore, as shown in (a) of FIG. 5 above, it can be seen that the time at which ANT1 fluctuation starts is 0.72s later than the time at which ANT2 fluctuation starts 0.64s; the time when ANT1 maximum fluctuation is 1.05s is later than the time at which ANT2 maximum fluctuation 0.95s.
对于图5中的(b),若以RSSI的幅值变化大于阈值2dB确定为其出现波动,则ANT1的RSSI大约在1.04s时的幅值(约为-33dB)与前面几个时刻的值之差均小于2dB、且与后面几个时刻的值之差均大于2dB(即开始波动的时刻为1.04s),在1.04s至1.20s之间持续上下波动,且在1.12s时的幅值(约为-37dB)与前一时刻和后一时刻的幅值之差最大(即波动最大时刻为1.12s),在1.20s时的幅值(约为-39dB)与后 面几个时刻的幅值之差均小于2dB(即波动结束的时刻为1.20s)。ANT2的RSSI大约在0.72时的幅值(约为-36dB)与前面几个时刻的值之差均小于2dB、且与后面几个时刻的值之差均大于2dB(即波动开始的时刻为0.72s),在0.72s至1.12s之间持续上下波动,且在1.08s时的幅值(约为-36dB)与前一时刻和后一时刻的幅值之差最大(即波动最大的时刻为1.08s),在1.12s时的幅值(约为-38dB)与后面几个时刻的幅值之差均小于2dB(即波动结束的时刻为1.12s)。因此,根据上述图5中的(b)所示,可知ANT1波动开始的时刻1.04s晚于ANT2波动开始的时刻0.72s;ANT1波动最大的时刻1.12s晚于ANT2波动最大的时刻1.08s;ANT1波动结束的时刻1.20s晚于ANT2波动结束的时刻1.12s。For (b) in Figure 5, if the RSSI amplitude change is greater than the threshold 2dB is determined to be a fluctuation, then the amplitude of the ANT1 RSSI is about 1.04s (about -33dB) and the value of the previous moments The difference is less than 2dB, and the difference with the value of the next few moments is greater than 2dB (that is, the moment when the fluctuation starts is 1.04s), which continuously fluctuates between 1.04s and 1.20s, and the amplitude at 1.12s (Approximately -37dB) and the amplitude difference between the previous moment and the next moment is the largest (that is, the maximum fluctuation time is 1.12s), the amplitude at 1.20s (about -39dB) and the amplitude of the following moments The difference between the values is less than 2dB (that is, the moment when the fluctuation ends is 1.20s). The difference between the ANT2 RSSI amplitude at about 0.72 (approximately -36dB) and the values at the previous moments are both less than 2dB, and the difference from the values at the following moments are greater than 2dB (that is, the moment when the fluctuation starts is 0.72 s), continuously fluctuating between 0.72s and 1.12s, and the difference between the amplitude at 1.08s (about -36dB) and the amplitude at the previous moment and the latter moment is the largest (that is, the moment when the fluctuation is the largest is 1.08s), the difference between the amplitude at 1.12s (approximately -38dB) and the amplitude at the following moments is less than 2dB (that is, the moment when the fluctuation ends is 1.12s). Therefore, according to (b) in FIG. 5 above, it can be seen that the time when the ANT1 fluctuation starts is 1.04s later than the time when the ANT2 fluctuation starts 0.72s; the time when the ANT1 maximum fluctuation is 1.12s later than the time when the ANT2 maximum fluctuation is 1.08s; ANT1 The time of the end of the fluctuation 1.20s is later than the time of the end of the fluctuation of ANT2 1.12s.
进一步地,该终端在获取上述无线信道信息或者无线信道信息波动的时刻之前,该终端还可以对其波形进行一些预处理,比如,数据转换和降噪等。该数据转换可以是指对原始数据进行加工,例如原始的CSI信息是一个复数,将其转换为幅度或相位信息等;降噪的方法可以包括滑窗平均、滤波、小波分解降噪、多维数据的主成分分析等中的一个或者多个,进而减小噪声的影响,使得该终端能够更容易检测波动。Further, before the terminal acquires the above wireless channel information or the moment when the wireless channel information fluctuates, the terminal may also perform some preprocessing on its waveform, such as data conversion and noise reduction. The data conversion may refer to processing the original data, for example, the original CSI information is a complex number, which is converted into amplitude or phase information, etc .; noise reduction methods may include sliding window averaging, filtering, wavelet decomposition noise reduction, multidimensional data One or more of the principal component analysis and so on, thereby reducing the impact of noise, making it easier for the terminal to detect fluctuations.
S202:根据第一时刻、第二时刻、第一天线和第二天线的位置,确定目标手势。S202: Determine the target gesture according to the first moment, the second moment, the positions of the first antenna and the second antenna.
由于目标手势滑动过程中,手距离某一天线越近时,则对该天线的天线参数影响越大,手距离某一天线越远时,则对该天线的天线参数影响越小,因此根据至少两个天线的天线参数波动的时刻的先后顺序,可以确定受到目标手势的影响的至少两个天线的先后顺序,从而再根据至少两个天线的位置可以确定目标手势的滑动轨迹,进而确定目标手势。During the sliding of the target gesture, the closer the hand is to an antenna, the greater the influence on the antenna parameters of the antenna, and the farther the hand is from an antenna, the smaller the influence on the antenna parameters of the antenna, so according to at least The sequence of moments when the antenna parameters of the two antennas fluctuate can determine the sequence of at least two antennas affected by the target gesture, and then the sliding trajectory of the target gesture can be determined according to the positions of the at least two antennas, and then the target gesture can be determined .
本申请实施例提供的基于多天线的手势识别方法能够识别的手势的种类与至少两个天线的数量和位置有关,下面分别对几种可能的实现方式进行详细说明。The types of gestures that can be recognized by the multi-antenna-based gesture recognition method provided by the embodiments of the present application are related to the number and position of at least two antennas, and several possible implementation manners are described in detail below.
在一种可能的实现方式中,至少两个天线包括天线1和天线2,且天线1和天线2分别位于该终端的左侧和右侧。若天线1和天线2等高,比如上述图3中的(a)所示的天线1和天线2,则能够识别的手势可以包括:向左滑动、向右滑动;若天线1和天线2不等高,比如上述图3中的(b)或者(c)所示的天线1和天线2,则能够识别的手势可以包括:向左滑动和向右滑动;或者在天线1和天线2的距离相对较远时,比如,天线1靠近该终端的顶部,天线2靠近该终端的底部,则能够识别手势可以包括:向下滑动和向上滑动。比如,在上述图5所述的示例中,天线1和天线2的位置如图3中的(b)所示,图5所示的天线1和天线2的天线参数波动的时刻的先后顺序是天线2先波动、天线1后波动,若定义该方法能够识别的手势包括向左滑动和向右滑动,则可以确定目标手势的滑动方向是从左至右,从而确定该目标手势为向左滑动;若定义该方法能够识别的手势包括向下滑动和向上滑动,则可以确定目标手势的滑动方向是从下至上,从而确定该目标手势为向上滑动。In a possible implementation manner, at least two antennas include antenna 1 and antenna 2, and antenna 1 and antenna 2 are located on the left and right sides of the terminal, respectively. If the antenna 1 and the antenna 2 have the same height, such as the antenna 1 and the antenna 2 shown in (a) in FIG. 3 above, the gestures that can be recognized may include: swiping left and swiping right; if the antenna 1 and antenna 2 are not Contours, such as antenna 1 and antenna 2 shown in (b) or (c) in Figure 3 above, the gestures that can be recognized can include: swiping left and swiping right; or the distance between antenna 1 and antenna 2 When it is relatively far away, for example, the antenna 1 is close to the top of the terminal and the antenna 2 is close to the bottom of the terminal, the gesture recognition can include: sliding down and sliding up. For example, in the example described in FIG. 5 above, the positions of the antenna 1 and the antenna 2 are as shown in (b) of FIG. 3, and the order of the moments when the antenna parameters of the antenna 1 and the antenna 2 shown in FIG. 5 fluctuate is The antenna 2 fluctuates first, and the antenna 1 fluctuates later. If the gestures recognized by this method include swiping left and swiping right, it can be determined that the swiping direction of the target gesture is from left to right, thus determining that the target gesture is swiping left If the gestures recognized by the method are defined to include downward sliding and upward sliding, it can be determined that the sliding direction of the target gesture is from bottom to top, thereby determining that the target gesture is sliding upward.
在一种可能的实现方式中,至少两个天线包括天线1和天线2,且天线1和天线2分别位于该终端的顶部和底部。若天线1和天线2等高,比如图6中的(a)所示的天线1和天线2,则该方法能够识别的手势可以包括:向下滑动和向上滑动;若天线1和天线2不等高,比如图6中的(b)或者(c)所示的天线1和天线2,则该方法能够识别的手势也可以包括:向下滑动和向上滑动;或者,在天线1和天线2的距离相 对较远时,比如,天线1靠近该终端的右侧,天线2靠近该终端的左侧,则该方法能够识别的手势可以包括:向左滑动和向右滑动。In a possible implementation manner, at least two antennas include antenna 1 and antenna 2, and antenna 1 and antenna 2 are located at the top and bottom of the terminal, respectively. If antenna 1 and antenna 2 have the same height, such as antenna 1 and antenna 2 shown in (a) of FIG. 6, the gestures recognized by this method may include: sliding down and sliding up; if antenna 1 and antenna 2 are not Contours, such as antenna 1 and antenna 2 shown in (b) or (c) in FIG. 6, the gestures recognized by this method may also include: sliding down and sliding up; or, between antenna 1 and antenna 2 When the distance is relatively long, for example, antenna 1 is close to the right side of the terminal and antenna 2 is close to the left side of the terminal, the gestures recognized by the method may include: swiping left and swiping right.
可选的,如图7所示,当至少两个天线包括天线1和天线2时,天线1和天线2也可以分别位于该终端的左侧和底部、左侧和顶部、右侧和顶部、或者右侧和底部。通过合理地设置图7所示的天线1和天线2之间的距离,也可以使该方法能够识别的手势包括:向左滑动和向右滑动,或者包括向下滑动和向上滑动,本申请实施例对此不再赘述。Optionally, as shown in FIG. 7, when at least two antennas include antenna 1 and antenna 2, antenna 1 and antenna 2 may also be located on the left and bottom, left and top, right and top of the terminal, respectively. Or right and bottom. By reasonably setting the distance between the antenna 1 and the antenna 2 shown in FIG. 7, gestures that can be recognized by the method include: swiping left and swiping right, or swiping down and swiping up, and this application is implemented Examples will not repeat them here.
需要说明的是,在上述两种可能的实现方式中,若定义能够识别的手势包括向左滑动和向右滑动,则可以将类似于从左至右的其他手势也确定为向右滑动,比如,如图8中的(a)所示的从左下至右上滑动、从左上至右下滑动、从左至右弧形滑动、从左至右波浪形滑动、从左至右锯齿形滑动、先向上后向右滑动、或者先向下后向右滑动等;将类似于从右至左的其他手势也确定为向左滑动,比如,如图8中的(b)所示的从右上至左下滑动、从右下至左上滑动、从右至左弧形滑动、从右至左波浪形滑动、从右至左锯齿形滑动、先向上后向左滑动、或者先向下后向左滑动等。同理,若定义能够识别的手势包括向下滑动和向上滑动,则可以将类似于从上至下的其他手势也确定为向下滑动,降类似于从下至上的其他手势也确定为向上滑动,具体的其他手势与上述类似于从左至右的其他手势、或者类似于从右至左的其他手势相似,本申请实施例对此不再赘述。It should be noted that, in the above two possible implementation manners, if the gestures that can be recognized include swiping left and swiping right, other gestures similar to left to right may also be determined as swiping right, such as , As shown in (a) of FIG. 8, slide from bottom left to top right, top left to bottom right, arc slide from left to right, wave slide from left to right, zigzag slide from left to right, first Swipe up and back to the right, or down and then right, etc .; other gestures similar to right to left are also determined to be swiped to the left, for example, as shown in (b) of FIG. 8 from top right to bottom left Slide, slide from bottom right to top left, slide from right to left arc, slide from right to left wavy, slide from right to left zigzag, slide up first and then left, or slide down first and then left. Similarly, if the defined recognizable gestures include swiping down and swiping up, other gestures similar to top to bottom can also be determined to slide down, and other gestures similar to bottom to top can also be determined to slide up. The specific other gestures are similar to the above-mentioned other gestures from left to right, or similar to the other gestures from right to left, which will not be repeated in the embodiments of the present application.
在一种可能的实现方式中,至少两个天线包括天线1、天线2和天线3,且天线1、天线2和天线3可以分别设置在该终端的不同侧。比如,如上述图4中的(a)或(b)所示,天线1设置在该终端的右侧、天线2设置在该终端的左侧,天线3设置在该终端的底部,则该方法能够识别的手势可以包括:向左滑动、向右滑动、向下滑动和向上滑动。示例性的,以图4中(a)所示的天线位置为例,假设获取到的天线1至天线3的天线参数对应的波动时刻分别为t1、t2和t3,则当t1、t2和t3的先后顺序为t2-t3-t1时可以确定目标手势为向右滑动,当t1、t2和t3的先后顺序为t1-t3-t2时可以确定目标手势为向左滑动,当t1、t2和t3的先后顺序为t1-t2-t3时可以确定目标手势为向下滑动,当t1、t2和t3的先后顺序为t3-t2-t1时可以确定目标手势为向上滑动。In a possible implementation manner, at least two antennas include antenna 1, antenna 2 and antenna 3, and antenna 1, antenna 2 and antenna 3 may be respectively disposed on different sides of the terminal. For example, as shown in (a) or (b) of FIG. 4 above, the antenna 1 is provided on the right side of the terminal, the antenna 2 is provided on the left side of the terminal, and the antenna 3 is provided on the bottom of the terminal, then the method Recognizable gestures may include: swiping left, swiping right, swiping down, and swiping up. Exemplarily, taking the antenna position shown in (a) of FIG. 4 as an example, assuming that the acquired antenna parameters of antenna 1 to antenna 3 correspond to fluctuation times of t1, t2, and t3, respectively, when t1, t2, and t3 When the sequence of t2-t3-t1 is t2, the target gesture can be determined to be swiping to the right, when the sequence of t1, t2 and t3 is t1-t3-t2, the target gesture can be determined to be swiping to the left, when t1, t2 and t3 It can be determined that the target gesture is sliding downward when the sequence of t1-t2-t3 is t, and when the sequence of t1, t2 and t3 is t3-t2-t1.
可选的,如图9中的(a)至(c)所示,当至少两个天线包括天线1、天线2和天线3时,天线1、天线2和天线3也可以分别位于该终端的顶部、左侧和底部,或者位于右侧、顶部和底部,或者位于左侧、顶部和右侧。当天线1、天线2和天线3的位置如图9所示时,则该方法能够识别手势可以包括:向左滑动、向右滑动、向下滑动和向上滑动。Optionally, as shown in (a) to (c) in FIG. 9, when at least two antennas include antenna 1, antenna 2 and antenna 3, antenna 1, antenna 2 and antenna 3 may also be located on the terminal ’s Top, left and bottom, or on the right, top and bottom, or on the left, top and right. When the positions of the antenna 1, the antenna 2 and the antenna 3 are as shown in FIG. 9, the gesture recognition method may include: swiping left, swiping right, swiping down, and swiping up.
在一种可能的实现方式中,当至少两个天线包括的天线数量为三个或者三个以上、且天线的位置均不同时,还可以通过以下方法识别目标手势:该终端获取不同天线在不同时刻时的天线参数对应的波动强度曲线;对于同一时刻波动强度最大的天线,该终端可以确定目标手势此刻最靠近该天线;根据每个天线的天线参数对应的波动强度曲线的变化趋势,确定目标手势与该天线的相对运动方向(比如,当一个天线的天线参数对应的波动强度在某一时间段内不断变大时,可以表明目标手势在该时间段内逐渐靠近该天线,当一个天线的天线参数对应的波动强度在某一时间段内不断减小时, 可以表明目标手势在该时间段内逐渐远离该天线);根据不同时刻对应的波动强度最大的天线的位置,以及目标手势与每个天线在不同时间段内的相对运动方向,确定目标手势的滑动轨迹,进而确定目标手势。In a possible implementation manner, when the number of antennas included in at least two antennas is three or more, and the positions of the antennas are different, the target gesture may also be recognized by the following method: the terminal acquires different antennas in different The fluctuation intensity curve corresponding to the antenna parameter at the time; for the antenna with the greatest fluctuation intensity at the same time, the terminal can determine that the target gesture is closest to the antenna at the moment; according to the change trend of the fluctuation intensity curve corresponding to each antenna parameter The relative movement direction of the gesture and the antenna (for example, when the fluctuation intensity corresponding to the antenna parameter of an antenna continuously increases within a certain period of time, it can indicate that the target gesture gradually approaches the antenna during the period of time, when the antenna ’s When the fluctuation intensity corresponding to the antenna parameter continuously decreases in a certain period of time, it can indicate that the target gesture gradually moves away from the antenna in this period of time); according to the position of the antenna with the largest fluctuation intensity corresponding to different moments, and the target gesture and each The relative movement direction of the antenna in different time periods to determine the target hand The sliding track, thus determines a target gesture.
在这种情况下,该方法能够识别的手势可以包括多种,比如非组合滑动和组合滑动等。非组合滑动可以包括:向左滑动、向右滑动、向下滑动、向上滑动、从左下至右上滑动、从左上至右下滑动、从右上至左下滑动、以及从右下至左上滑动等。组合滑动可以包括:先向上后向右滑动、先向下后向右滑动、先向上后向左滑动、先向下后向左滑动、先向左后向上滑动、先向右后向上滑动、先向左后向下滑动、先向右后向下滑动、S型滑动、O型滑动等。In this case, the gestures recognized by this method may include multiple types, such as non-combined sliding and combined sliding. Non-combined sliding may include: sliding to the left, sliding to the right, sliding down, sliding up, sliding from the lower left to the upper right, sliding from the upper left to the lower right, sliding from the upper right to the lower left, sliding from the lower right to the upper left, etc. The combined slide can include: first up then right, first down then right, first up then left, first down then left, first left then up, first right then up, first Swipe down to the left, slide right to back, S-slide, O-slide, etc.
示例性的,至少两个天线包括4个天线(即天线1至天线4),4个天线的位置如图10中的(a)所示,即天线1和天线2位于该终端的左侧,且天线1靠近顶部、天线2靠近底部,天线3和天线4位于该终端的右侧,且天线3靠近底部、天线4靠近底部。比如,当目标手势为从左下至右上滑动(即如图10中的(b)所示)时,该终端可以获取到天线2的天线参数的波动强度在最开始是最大的,在之后一段时间内逐渐减小,从而可以确定目标手势从天线2的位置开始滑动,并逐渐远离天线2;其次,天线1和天线3的天线参数的波动强度逐渐变大一段时间之后又逐渐变小,从而可以确定目标手势距离天线1和天线3的位置是由远及近、再由近及远,从而可以确定目标手势由天线2的位置向天线1和天线3的中间位置靠近之后并逐渐远离;最后,该终端获取到天线4的天线参数的波动强度逐渐增大,且最后达到最大,从而该终端可以确定目标手势最后停在天线4的位置,从而根据该滑动轨迹可以确定目标手势为从左下至右上滑动。再比如,当目标手势为先向下后向右滑动(即如图10中的(c)所示)时,该终端可以获取到天线1的天线参数的波动强度在最开始是最大的,在之后一段时间内逐渐减小,从而可以确定目标手势从天线1的位置开始滑动,并逐渐远离天线1;其次,天线2的天线参数的波动强度逐渐变大一段时间后达到最大,之后又逐渐变小,从而可以确定目标手势逐渐靠近天线2,之后又逐渐远离天线2,从而可以确定目标手势由天线1的位置向天线的2的位置滑动,之后又远离天线2;最后,该终端获取到天线3的天线参数的波动强度逐渐增大,且最后达到最大,从而该终端可以确定目标手势最后停在天线3的位置,即目标手势远离天线2并向天线3滑动,从而根据该滑动轨迹可以确定目标手势为先向下后向右滑动。Exemplarily, at least two antennas include 4 antennas (ie, antenna 1 to antenna 4), and the positions of the four antennas are as shown in (a) of FIG. 10, that is, antenna 1 and antenna 2 are located on the left side of the terminal, And antenna 1 is near the top, antenna 2 is near the bottom, antenna 3 and antenna 4 are on the right side of the terminal, and antenna 3 is near the bottom and antenna 4 is near the bottom. For example, when the target gesture is swiping from the lower left to the upper right (as shown in (b) in FIG. 10), the terminal can acquire that the fluctuation intensity of the antenna parameter of the antenna 2 is the largest at the beginning, and after a period of time It gradually decreases within, so that it can be determined that the target gesture starts to slide from the position of the antenna 2 and gradually away from the antenna 2; secondly, the fluctuation intensity of the antenna parameters of the antenna 1 and the antenna 3 gradually increases and then gradually decreases after a period of time, so that Determine that the position of the target gesture from the antenna 1 and the antenna 3 is far and near, and then from near and far, so that the target gesture can be determined from the position of the antenna 2 toward the middle position of the antenna 1 and the antenna 3 and gradually away; finally, The fluctuation intensity of the antenna parameters of the antenna 4 gradually acquired by the terminal and finally reached the maximum, so that the terminal can determine that the target gesture finally stops at the position of the antenna 4, so that the target gesture can be determined from the lower left to the upper right according to the sliding trajectory slide. As another example, when the target gesture is to swipe down and then to the right (as shown in (c) in FIG. 10), the terminal can acquire that the fluctuation intensity of the antenna parameter of antenna 1 is the largest at the beginning. After a period of time, it gradually decreases, so that it can be determined that the target gesture starts to slide from the position of the antenna 1 and gradually away from the antenna 1; secondly, the fluctuation intensity of the antenna parameter of the antenna 2 gradually increases to reach a maximum after a period of time, and then gradually changes Small, so it can be determined that the target gesture gradually approaches antenna 2 and then gradually away from antenna 2, so that it can be determined that the target gesture slides from the position of antenna 1 to the position of antenna 2 and then away from antenna 2; finally, the terminal acquires the antenna The fluctuation intensity of the antenna parameter of 3 gradually increases, and finally reaches the maximum, so that the terminal can determine that the target gesture finally stops at the position of the antenna 3, that is, the target gesture moves away from the antenna 2 and slides toward the antenna 3, so that the sliding trajectory can be determined The target gesture is to swipe down and then to the right.
在本申请实施例中,该终端能够根据至少两个天线的天线参数波动的时刻的先后顺序,确定目标手势在运动过程中经过每个天线的先后顺序,进而再结合至少两个天线的位置,确定目标手势的运动轨迹,从而识别出目标手势;或者,结合至少两个天线的天线参数波动的时刻的先后顺序和每个天线的天线参数对应的波动趋势,确定目标手势在运动过程中经过每个天线的先后顺序,最后再结合至少两个天线的位置,确定目标手势的运动轨迹,从而识别出目标手势。因此,该方法与现有技术相比,无需进行复杂的模式识别,从而提高了手势识别的效率,也降低该终端的功耗;此外,该方法不受无线信号的来波方向的影响,因此在一定程度上提高了手势识别的适用性。In the embodiment of the present application, the terminal can determine the sequence in which the target gesture passes each antenna during the movement according to the sequence of the moment when the antenna parameters of at least two antennas fluctuate, and then combine the positions of at least two antennas, Determine the movement trajectory of the target gesture to recognize the target gesture; or, combining the sequence of the moment when the antenna parameters of at least two antennas fluctuate and the fluctuation trend corresponding to the antenna parameters of each antenna, determine that the target gesture passes through The order of the two antennas, and finally combining the positions of at least two antennas to determine the movement trajectory of the target gesture, thereby recognizing the target gesture. Therefore, compared with the prior art, this method does not require complex pattern recognition, thereby improving the efficiency of gesture recognition and reducing the power consumption of the terminal; in addition, this method is not affected by the direction of the incoming wave of the wireless signal, so To a certain extent, the applicability of gesture recognition has been improved.
可以理解的是,上述终端等为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施 例描述的各示例的单元及算法步骤,本发明实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明实施例的范围。It can be understood that, in order to realize the above-mentioned functions, the above-mentioned terminal or the like includes a hardware structure and / or a software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the exemplary units and algorithm steps described in the embodiments disclosed herein, the embodiments of the present invention can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed by hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of the present invention.
本申请实施例可以根据上述方法示例对上述终端等进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本发明实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。In the embodiments of the present application, the above-mentioned terminals and the like may be divided into function modules according to the above method examples. For example, each function module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above integrated modules may be implemented in the form of hardware or software function modules. It should be noted that the division of the modules in the embodiments of the present invention is schematic, and is only a division of logical functions. In actual implementation, there may be another division manner.
在采用对应各个功能划分各个功能模块的情况下,本申请提供一种终端。如图11所示,该终端包括:至少两个天线1101、获取单元1102和确定单元1103,至少两个天线1101包括第一天线和第二天线。其中,至少两个天线1101用于接收无线信号;获取单元1102用于支持该终端执行上述方法实施例中的S201,和/或用于本文所描述的技术的其它过程;确定单元1103用于支持该终端执行上述方法实施例中的S202,和/或用于本文所描述的技术的其它过程。In the case of dividing each functional module corresponding to each function, this application provides a terminal. As shown in FIG. 11, the terminal includes: at least two antennas 1101, an acquisition unit 1102, and a determination unit 1103, and at least two antennas 1101 include a first antenna and a second antenna. Among them, at least two antennas 1101 are used to receive wireless signals; an acquisition unit 1102 is used to support the terminal to perform S201 in the above method embodiments, and / or other processes used in the technology described herein; a determination unit 1103 is used to support The terminal executes S202 in the above method embodiments, and / or other processes used in the technology described herein.
当然,上述终端包括但不限于上述所列举的单元模块,例如,上述终端还可以包括存储单元,存储单元用于存储该终端的程序代码和数据。并且,上述功能单元的具体所能够实现的功能也包括但不限于上述实例所述的方法步骤对应的功能,上述终端的其他单元的详细描述可以参考其所对应方法步骤的详细描述,本申请实施例这里不再赘述。Of course, the above terminal includes but is not limited to the above listed unit modules. For example, the above terminal may further include a storage unit, which is used to store the program code and data of the terminal. In addition, the specific functions that can be achieved by the above functional units also include but are not limited to the functions corresponding to the method steps described in the above examples. For the detailed description of the other units of the above terminal, please refer to the detailed description of the corresponding method steps. Examples are not repeated here.
在硬件实现上,上述获取单元1102和确定单元1103可以为图1所示的终端中的处理器103,存储单元可以为图1所示的终端中的存储器102,至少两个天线1101可以集成在上述图1所示的终端中的RF电路101中。在本申请实施例中,处理器103可用于该终端执行上述方法实施例中的S201-S202,和/或用于本文所描述的技术的其它过程;存储器102可用于存储该终端的程序代码和数据;RF电路101可用于支持该终端接收无线信号。In terms of hardware implementation, the acquisition unit 1102 and the determination unit 1103 may be the processor 103 in the terminal shown in FIG. 1, the storage unit may be the memory 102 in the terminal shown in FIG. 1, and at least two antennas 1101 may be integrated in In the RF circuit 101 in the terminal shown in FIG. 1 described above. In the embodiment of the present application, the processor 103 may be used by the terminal to execute S201-S202 in the above method embodiments, and / or other processes of the technology described herein; the memory 102 may be used to store the program code of the terminal and Data; RF circuit 101 can be used to support the terminal to receive wireless signals.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a division of logical functions. In actual implementation, there may be other divisions, for example, multiple units or components may be The combination can either be integrated into another device, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or software functional unit.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得终端执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a readable storage medium. Based on such an understanding, the technical solutions of the embodiments of the present application may essentially be part of or contribute to the existing technology, or all or part of the technical solutions may be embodied in the form of software products, which are stored in a storage medium In it, several instructions are included to enable the terminal to perform all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage media include various media that can store program codes, such as a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。The above is only the specific implementation of this application, but the scope of protection of this application is not limited to this, any changes or replacements within the technical scope disclosed in this application should be covered within the scope of protection of this application . Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (20)

  1. 一种基于多天线的手势识别方法,其特征在于,应用于包括第一天线和第二天线的终端中,所述第一天线和所述第二天线的位置不同,所述方法包括:A gesture recognition method based on multiple antennas is characterized in that it is applied to a terminal including a first antenna and a second antenna, where the positions of the first antenna and the second antenna are different, and the method includes:
    获取第一时刻,所述第一时刻是在所述第一天线的天线参数的波动值大于预设阈值时获取的;Acquiring a first moment, which is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold;
    获取所述第二天线的第二时刻,所述第二时刻是在所述第二天线的天线参数的波动值大于所述预设阈值时获取的,所述第二时刻晚于所述第一时刻;Acquiring the second moment of the second antenna, the second moment is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, and the second moment is later than the first time;
    根据所述第一时刻、所述第二时刻、所述第一天线和所述第二天线的位置,确定目标手势。The target gesture is determined according to the first moment, the second moment, the positions of the first antenna and the second antenna.
  2. 根据权利要求1所述的方法,其特征在于,所述第一天线和所述第二天线位于所述终端屏幕的不同侧。The method according to claim 1, wherein the first antenna and the second antenna are located on different sides of the terminal screen.
  3. 根据权利要求1或2所述的方法,其特征在于,所述第一时刻是所述第一天线的天线参数的波动值首次大于所述预设阈值的时刻;所述第二时刻是所述第二天线的天线参数的波动值首次大于所述预设阈值的时刻。The method according to claim 1 or 2, wherein the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the first time; the second moment is the The moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the first time.
  4. 根据权利要求1或2所述的方法,其特征在于,所述第一时刻是所述第一天线的天线参数的波动值最大的时刻;所述第二时刻是所述第二天线的天线参数的波动值最大的时刻。The method according to claim 1 or 2, wherein the first time is the time when the fluctuation value of the antenna parameter of the first antenna is the largest; the second time is the antenna parameter of the second antenna The moment when the fluctuation value is the largest.
  5. 根据权利要求1或2所述的方法,其特征在于,所述第一时刻是所述第一天线的天线参数的波动值末次大于所述预设阈值的时刻;所述第二时刻是所述第二天线的天线参数的波动值末次大于所述预设阈值的时刻。The method according to claim 1 or 2, wherein the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the last time; the second moment is the The moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the last time.
  6. 根据权利要求1-5任一项所述的方法,其特征在于,所述天线参数包括以下参数中的至少一项:信道状态信息CSI的幅度、CSI的相位、接收信号强度指示RSSI、信噪比SNR、信道质量指示CQI、分组接收率PRR、分组丢失率PLR、信号干扰比SIR、信号干扰加噪声比SINR、或者信道探测参考信号SRS。The method according to any one of claims 1 to 5, wherein the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal noise Ratio SNR, channel quality indicator CQI, packet reception rate PRR, packet loss rate PLR, signal to interference ratio SIR, signal to interference plus noise ratio SINR, or channel sounding reference signal SRS.
  7. 根据权利要求1-6任一项所述的方法,其特征在于,所述天线参数还包括以下参数中的至少一项:阻抗特性、方向图、相关性系统、或者通道校准值。The method according to any one of claims 1-6, wherein the antenna parameters further include at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
  8. 一种终端,其特征在于,所述终端包括第一天线和第二天线,所述第一天线和所述第二天线的位置不同,所述终端包括:A terminal is characterized in that the terminal includes a first antenna and a second antenna, and the positions of the first antenna and the second antenna are different. The terminal includes:
    获取单元,用于获取第一时刻,所述第一时刻是在所述第一天线的天线参数的波动值大于预设阈值时获取的;An acquiring unit, configured to acquire a first moment, which is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold;
    所述获取单元,还用于获取第二时刻,所述第二时刻是在所述第二天线的天线参数的波动值大于所述预设阈值时获取的,所述第二时刻晚于所述第一时刻;The acquiring unit is further configured to acquire a second moment, which is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, and the second moment is later than the The first moment
    确定单元,用于根据所述第一时刻、所述第二时刻、所述第一天线和所述第二天线的位置,确定目标手势。The determining unit is configured to determine a target gesture according to the first moment, the second moment, the positions of the first antenna and the second antenna.
  9. 根据权利要求8所述的终端,其特征在于,所述第一天线和所述第二天线位于所述终端屏幕的不同侧。The terminal according to claim 8, wherein the first antenna and the second antenna are located on different sides of the terminal screen.
  10. 根据权利要求8或9所述的终端,其特征在于,所述第一时刻是所述第一天线的天线参数的波动值首次大于所述预设阈值的时刻;所述第二时刻是所述第二天线 的天线参数的波动值首次大于所述预设阈值的时刻。The terminal according to claim 8 or 9, wherein the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the first time; the second moment is the The moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the first time.
  11. 根据权利要求8或9所述的终端,其特征在于,所述第一时刻是所述第一天线的天线参数的波动值最大的时刻;所述第二时刻是所述第二天线的天线参数的波动值最大的时刻。The terminal according to claim 8 or 9, wherein the first time is the time when the fluctuation value of the antenna parameter of the first antenna is the largest; the second time is the antenna parameter of the second antenna The moment when the fluctuation value is the largest.
  12. 根据权利要求8或9所述的终端,其特征在于,所述第一时刻是所述第一天线的天线参数的波动值末次大于所述预设阈值的时刻;所述第二时刻是所述第二天线的天线参数的波动值末次大于所述预设阈值的时刻。The terminal according to claim 8 or 9, wherein the first moment is the moment when the fluctuation value of the antenna parameter of the first antenna is greater than the preset threshold for the last time; the second moment is the The moment when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold for the last time.
  13. 根据权利要求8-12任一项所述的终端,其特征在于,所述天线参数包括以下参数中的至少一项:信道状态信息CSI的幅度、CSI的相位、接收信号强度指示RSSI、信噪比SNR、信道质量指示CQI、分组接收率PRR、分组丢失率PLR、信号干扰比SIR、信号干扰加噪声比SINR、或者信道探测参考信号SRS。The terminal according to any one of claims 8 to 12, wherein the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, and signal to noise Ratio SNR, channel quality indicator CQI, packet reception rate PRR, packet loss rate PLR, signal to interference ratio SIR, signal to interference plus noise ratio SINR, or channel sounding reference signal SRS.
  14. 根据权利要求8-13任一项所述的终端,其特征在于,所述天线参数还包括以下参数中的至少一项:阻抗特性、方向图、相关性系统、或者通道校准值。The terminal according to any one of claims 8 to 13, wherein the antenna parameters further include at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
  15. 一种终端,其特征在于,所述终端包括:处理器、第一天线和第二天线,所述第一天线和所述第二天线的位置不同;其中,所述处理器被配置为:A terminal is characterized in that the terminal includes: a processor, a first antenna, and a second antenna, where the positions of the first antenna and the second antenna are different; wherein, the processor is configured to:
    获取第一时刻,所述第一时刻是在所述第一天线的天线参数的波动值大于预设阈值时获取的;Acquiring a first moment, which is acquired when the fluctuation value of the antenna parameter of the first antenna is greater than a preset threshold;
    获取第二时刻,所述第二时刻是在所述第二天线的天线参数的波动值大于所述预设阈值时获取的,所述第二时刻晚于所述第一时刻;Acquiring a second moment, which is acquired when the fluctuation value of the antenna parameter of the second antenna is greater than the preset threshold, and the second moment is later than the first moment;
    根据所述第一时刻、所述第二时刻、所述第一天线和所述第二天线的位置,确定目标手势。The target gesture is determined according to the first moment, the second moment, the positions of the first antenna and the second antenna.
  16. 根据权利要求15所述的终端,其特征在于,所述第一天线和所述第二天线位于所述终端屏幕的不同侧。The terminal according to claim 15, wherein the first antenna and the second antenna are located on different sides of the terminal screen.
  17. 根据权利要求15或16所述的终端,其特征在于,所述天线参数包括以下参数中的至少一项:信道状态信息CSI的幅度、CSI的相位、接收信号强度指示RSSI、信噪比SNR、信道质量指示CQI、分组接收率PRR、分组丢失率PLR、信号干扰比SIR、信号干扰加噪声比SINR、或者信道探测参考信号SRS。The terminal according to claim 15 or 16, wherein the antenna parameters include at least one of the following parameters: channel state information CSI amplitude, CSI phase, received signal strength indicator RSSI, signal-to-noise ratio SNR, Channel quality indicator CQI, packet reception rate PRR, packet loss rate PLR, signal-to-interference ratio SIR, signal-to-interference plus noise ratio SINR, or channel sounding reference signal SRS.
  18. 根据权利要求15-17任一项所述的终端,其特征在于,所述天线参数还包括以下参数中的至少一项:阻抗特性、方向图、相关性系统、或者通道校准值。The terminal according to any one of claims 15 to 17, wherein the antenna parameters further include at least one of the following parameters: impedance characteristic, pattern, correlation system, or channel calibration value.
  19. 一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,其特征在于,当所述指令在具有不同位置的至少两个天线的终端上运行时,使得所述终端执行上述权利要求1-7任一项所提供的基于多天线的手势识别方法。A computer-readable storage medium having instructions stored therein, characterized in that when the instructions run on a terminal having at least two antennas at different positions, the terminal is allowed to execute the above rights The multi-antenna based gesture recognition method provided in any one of claims 1-7 is required.
  20. 一种计算机程序产品,其特征在于,当所述计算机程序产品在具有不同位置的至少两个天线的终端上运行时,使得所述终端执行上述权利要求1-7任一项所提供的基于多天线的手势识别方法。A computer program product, characterized in that when the computer program product runs on a terminal having at least two antennas at different positions, the terminal is caused to perform the multi-based Antenna gesture recognition method.
PCT/CN2018/114391 2018-11-07 2018-11-07 Multi-antenna based gesture recognition method and device WO2020093278A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/114391 WO2020093278A1 (en) 2018-11-07 2018-11-07 Multi-antenna based gesture recognition method and device
CN201880097583.0A CN112689812B (en) 2018-11-07 2018-11-07 Gesture recognition method and device based on multiple antennas

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/114391 WO2020093278A1 (en) 2018-11-07 2018-11-07 Multi-antenna based gesture recognition method and device

Publications (1)

Publication Number Publication Date
WO2020093278A1 true WO2020093278A1 (en) 2020-05-14

Family

ID=70610781

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/114391 WO2020093278A1 (en) 2018-11-07 2018-11-07 Multi-antenna based gesture recognition method and device

Country Status (2)

Country Link
CN (1) CN112689812B (en)
WO (1) WO2020093278A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112540717A (en) * 2020-12-11 2021-03-23 维沃移动通信有限公司 Touch control method, device and storage medium
CN112765550A (en) * 2021-01-20 2021-05-07 重庆邮电大学 Target behavior segmentation method based on Wi-Fi channel state information
CN113900507A (en) * 2020-07-06 2022-01-07 华为技术有限公司 Gesture recognition method and device
US20230176243A1 (en) * 2021-12-07 2023-06-08 Microsoft Technology Licensing, Llc Rf antenna scanning for human movement classification

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012087308A1 (en) * 2010-12-22 2012-06-28 Intel Corporation Touch sensor gesture recognition for operation of mobile devices
CN103793059A (en) * 2014-02-14 2014-05-14 浙江大学 Gesture recovery and recognition method based on time domain Doppler effect
WO2015024121A1 (en) * 2013-08-23 2015-02-26 Blackberry Limited Contact-free interaction with an electronic device
CN105260010A (en) * 2014-07-17 2016-01-20 中兴通讯股份有限公司 Method for determining gesture track, and electronic equipment
CN108387940A (en) * 2018-01-24 2018-08-10 西北工业大学 A kind of detecting indoor article movement detection method based on Wi-Fi wireless awares

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014165476A1 (en) * 2013-04-01 2014-10-09 Gollakota Shyamnath Devices, systems, and methods for detecting gestures using wireless communication signals
KR20150006235A (en) * 2013-07-08 2015-01-16 삼성전자주식회사 Apparatus providing combined ui component and control method thereof
US20170131395A1 (en) * 2014-06-25 2017-05-11 University Of Washington Devices, systems, and methods for detecting gestures using multiple antennas and/or reflections of signals transmitted by the detecting device
CN104615244A (en) * 2015-01-23 2015-05-13 深圳大学 Automatic gesture recognizing method and system
US10338686B2 (en) * 2016-03-31 2019-07-02 Disney Enterprises, Inc. Control system using aesthetically guided gesture recognition

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012087308A1 (en) * 2010-12-22 2012-06-28 Intel Corporation Touch sensor gesture recognition for operation of mobile devices
WO2015024121A1 (en) * 2013-08-23 2015-02-26 Blackberry Limited Contact-free interaction with an electronic device
CN103793059A (en) * 2014-02-14 2014-05-14 浙江大学 Gesture recovery and recognition method based on time domain Doppler effect
CN105260010A (en) * 2014-07-17 2016-01-20 中兴通讯股份有限公司 Method for determining gesture track, and electronic equipment
CN108387940A (en) * 2018-01-24 2018-08-10 西北工业大学 A kind of detecting indoor article movement detection method based on Wi-Fi wireless awares

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900507A (en) * 2020-07-06 2022-01-07 华为技术有限公司 Gesture recognition method and device
CN112540717A (en) * 2020-12-11 2021-03-23 维沃移动通信有限公司 Touch control method, device and storage medium
CN112540717B (en) * 2020-12-11 2022-05-31 维沃移动通信有限公司 Touch method, device and storage medium
CN112765550A (en) * 2021-01-20 2021-05-07 重庆邮电大学 Target behavior segmentation method based on Wi-Fi channel state information
CN112765550B (en) * 2021-01-20 2024-05-07 济南杰睿信息科技有限公司 Target behavior segmentation method based on Wi-Fi channel state information
US20230176243A1 (en) * 2021-12-07 2023-06-08 Microsoft Technology Licensing, Llc Rf antenna scanning for human movement classification
WO2023107165A1 (en) * 2021-12-07 2023-06-15 Microsoft Technology Licensing, Llc. Rf antenna scanning for human movement classification
US11914093B2 (en) 2021-12-07 2024-02-27 Microsoft Technology Licensing, Llc RF antenna scanning for human movement classification

Also Published As

Publication number Publication date
CN112689812A (en) 2021-04-20
CN112689812B (en) 2023-04-11

Similar Documents

Publication Publication Date Title
WO2020093278A1 (en) Multi-antenna based gesture recognition method and device
CN107636893B (en) Multi-antenna communication system configured to detect objects
CN109218535B (en) Method and device for intelligently adjusting volume, storage medium and terminal
KR102072016B1 (en) Electro device comprising antenna and method for controlling thereof
CN105939421A (en) Terminal parameter adjusting device and method
CN110035149B (en) Multi-antenna optimization method and mobile terminal
CN106899320B (en) A kind of method, system, mobile terminal and storage device reducing SAR value
CN107613128B (en) Volume adjusting method, terminal and computer readable storage medium
US11751008B2 (en) Angle of arrival capability in electronic devices
CN109617587B (en) Antenna selection method, terminal and storage medium
CN109450477A (en) The signal acceptance method of antenna structure and electronic equipment, device, electronic equipment
CN114501119B (en) Interactive display method, device, electronic equipment, system and storage medium
CN114710585A (en) Photographing method and terminal
US20180239438A1 (en) Gesture recognition method and apparatus
CN109088973B (en) Antenna control method and device and mobile terminal
KR20160139377A (en) Watch-type mobile terminal operating method thereof
CN110517677B (en) Speech processing system, method, apparatus, speech recognition system, and storage medium
US11841447B2 (en) 3D angle of arrival capability in electronic devices with adaptability via memory augmentation
US20220039059A1 (en) Angle of arrival determination in electronic devices with fused decision from motion
CN107592132B (en) Antenna switching method, multi-antenna terminal and computer readable storage medium
CN108540659B (en) Method, terminal and computer readable storage medium for reducing TDD noise influence
CN114521015B (en) Positioning method, positioning device, storage medium and electronic equipment
CN105873142A (en) Base station direction guiding device and method
CN107483094B (en) Antenna switching control method, multi-antenna terminal and computer readable storage medium
CN105120512B (en) A kind of method and apparatus that signal receives

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18939392

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18939392

Country of ref document: EP

Kind code of ref document: A1