WO2021147428A1

WO2021147428A1 - Gesture recognition method and apparatus, terminal device, and computer storage medium

Info

Publication number: WO2021147428A1
Application number: PCT/CN2020/124480
Authority: WO
Inventors: 张翼; 冉立新; 张广煜; 王辉
Original assignee: 华为技术有限公司
Priority date: 2020-01-21
Filing date: 2020-10-28
Publication date: 2021-07-29
Also published as: CN113220112A; CN113220112B

Abstract

The present application is applicable to the wireless technical field. Provided are a gesture recognition method and apparatus, a terminal device, and a computer storage medium. In the gesture recognition method of the present application, a terminal device determines, from among existing wireless paths, a first preset number of wireless paths to be radar transmission paths, and a second preset number of wireless paths to be radar reception paths, so that a radar sensor is constructed by means of multiplexing the existing wireless paths in the terminal device, without the need to add a new radar sensor to the terminal device, such that no extra layout and wiring burden is imposed on a radio frequency front end of the terminal device, and the hardware costs, power consumption and volume of the terminal device are not increased, thereby solving the problem of increasing the hardware costs, power consumption and volume of a terminal device due to relatively heavy layout and wiring burden on a radio frequency front end of the terminal device brought about by the layout of a radar sensor in the terminal device when gesture recognition is carried out using a radar at present.

Description

Gesture recognition method, device, terminal equipment and computer storage medium

This application claims the priority of the Chinese patent application filed with the State Intellectual Property Office on January 21, 2020, the application number is 202010073476.3, and the application name is "gesture recognition method, device, terminal equipment and computer storage medium", and all of its contents are approved The reference is incorporated in this application.

Technical field

This application belongs to the field of wireless technology, and in particular relates to a gesture recognition method, device, terminal device, and computer storage medium.

Background technique

Gesture recognition refers to the entire process of terminal devices tracking human gestures, recognizing their meanings, and converting them into semantically meaningful commands. In current terminal devices, gesture content can be captured through contact sensors or non-contact sensors.

Radar is a non-contact sensor that can sense when there is a certain distance from the sensing target. This sensing is non-contact. For the sensing target, this non-contact sensing is always better than close contact. The perception of the skin surface is more comfortable and convenient.

However, the current various terminal devices are developing in the direction of lightweight and miniaturization, and the content space of the terminal devices is limited. If a radar sensor is added to the narrow and crowded space of the terminal device to realize the gesture recognition function, it will bring a greater layout and wiring burden to the radio frequency front end of the terminal device, and increase the hardware cost, power consumption and volume of the terminal device.

Summary of the invention

The embodiments of the present application provide a gesture recognition method, device, terminal device, and computer storage medium, which can solve the problem that when radar is used for gesture recognition, the layout of the radar sensor in the terminal device will bring greater impact to the radio frequency front end of the terminal device. The burden of layout and wiring increases the hardware cost, power consumption and volume of terminal equipment.

The first aspect of the embodiments of the present application provides a gesture recognition method, including:

When the gesture recognition instruction is detected, the first preset number of wireless paths are determined as radar transmission paths, and the second preset number of wireless paths are determined as radar receiving paths, where the wireless paths include Bluetooth wireless paths and wifi wireless paths. At least one of the licensed band auxiliary access wireless channels, the radar transmitting channel and the radar receiving channel are wireless channels with the same working frequency band;

Perform a gesture recognition operation through the radar transmission path and the radar reception path in the first time period, and perform a wireless communication operation through at least one of the radar transmission path and the radar reception path in the second time period .

It should be noted that the terminal device is usually provided with multiple wireless channels, and the above-mentioned wireless channels may include one or more of Bluetooth wireless channels, wifi wireless channels, and permitted band-assisted access wireless channels.

When constructing a radar sensor system, the terminal device can determine the first preset number of wireless paths from the existing wireless paths as the radar transmitting path, and determine the second preset number of wireless paths as the radar receiving channel, without adding new ones. In the case of a radar sensor, multiplex the wireless path in the terminal device to construct a radar sensor system. The above-mentioned radar transmitting path and radar receiving path should be wireless paths with the same working frequency band.

Since the terminal device constructs a radar sensor system by multiplexing the existing wireless path of the terminal device, the above-mentioned radar transmitting path and radar receiving path can perform gesture recognition operations in the first time period, and perform wireless communication operations in the second time period , Which can realize the gesture recognition function without affecting the wireless communication function of the terminal device.

The foregoing construction of the radar sensor system by multiplexing the existing wireless channels of the terminal equipment will not cause additional layout and wiring burdens on the radio frequency front end of the terminal equipment, will not increase any hardware costs, and will not affect the power consumption and volume of the terminal equipment.

In a possible implementation manner of the first aspect, the performing a gesture recognition operation through the radar transmitting path and the radar receiving path in the first time period includes:

Performing a radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data;

Perform gesture recognition processing on the radar scan data to obtain a gesture recognition result.

It should be noted that when the terminal device performs the gesture recognition operation through the radar transmitting path and the radar receiving path, it first performs the radar scanning operation through the radar transmitting path and the radar receiving path to obtain the radar scan data.

Then the terminal device performs gesture recognition processing on the radar scan data to obtain the gesture recognition result. The algorithm of gesture recognition processing can be selected according to the actual situation. For example, in a radar sensor system with a single-input multiple-output architecture, you can choose to use phase linear demodulation technology for gesture recognition.

In a possible implementation manner of the first aspect, the performing a wireless communication operation through at least one of the radar transmitting path and the radar receiving path in the second time period includes:

In the second time period, a Bluetooth communication operation or a wifi communication operation or a permitted band-assisted access operation corresponding to the at least one wireless path is performed through at least one of the radar transmission path and the radar reception path.

It should be noted that the terminal device can perform wireless communication operations corresponding to the channel type of the wireless channel through the wireless channel.

For example, when the above-mentioned wireless channel is a Bluetooth wireless channel, the terminal device can perform Bluetooth communication operations through the Bluetooth wireless channel; when the above-mentioned wireless channel is a wifi wireless channel, the terminal device can perform wifi communication operations through the wifi wireless channel; when the above-mentioned wireless channel When assisting in accessing the wireless channel for the licensed band, the terminal device can perform the assisted access operation of the licensed band by accessing the wireless channel by the licensed band.

In a possible implementation manner of the first aspect, the determining a first preset number of wireless channels as radar transmitting paths and determining a second preset number of wireless channels as radar receiving paths includes:

Obtain the working frequency band of each wireless channel;

Use wireless channels that have the same operating frequency band and have not been called as target wireless channels, determine a first preset number of target wireless channels from the target wireless channels as radar transmission channels, and determine a second predetermined number from the target wireless channels. Set a number of target wireless channels as radar receiving channels.

It should be noted that when the terminal device selects the radar transmitting path and the radar receiving path, the wireless path that has not been called can be selected as the radar transmitting path or the radar receiving path, thereby reducing the impact of multiplexing the wireless path on the wireless communication function of the terminal device .

In another possible implementation manner of the first aspect, the determining the first preset number of wireless channels as the radar transmission path and the second preset number of wireless channels as the radar receiving path includes:

Obtain the channel performance parameters of each wireless channel;

According to the channel performance parameters of each wireless channel, determine a third preset number of wireless channels with the best channel performance parameters and having the same working frequency band as the target wireless channel;

A first preset number of target wireless paths are determined from the target wireless paths as radar transmission paths, and a second preset number of target wireless paths are determined from the target wireless paths as radar receiving paths.

It should be noted that when the terminal device selects the radar transmitting path and the radar receiving path, the wireless path with better path performance parameters can also be selected as the radar transmitting path or the radar receiving path, thereby improving the accuracy of the gesture recognition result.

In a possible implementation of the first aspect, the gesture recognition operation is performed through the radar transmitting path and the radar receiving path in the first time period, and the gesture recognition operation is performed through the radar transmitting path and the radar in the second time period. Performing wireless communication operations on at least one of the radar receiving paths includes:

Acquiring a radar scanning period and a scanning time period within the radar scanning period;

In the scanning time period in each radar scanning period, the gesture recognition operation is performed through the radar transmission path and the radar receiving path, and in the non-scanning time period in each radar scanning period, the At least one of the radar transmitting path and the radar receiving path performs a wireless communication operation.

It should be noted that in order to reduce the impact of multiplexing wireless channels on the wireless communication function of the terminal device, a radar scan period can be set.

A scanning period and a non-scanning period are set in the radar scanning period. During the scanning period of the radar scanning cycle, the terminal device can perform gesture recognition operations through the radar transmitting path and the radar receiving path. During the non-scanning period of the radar scanning period, the terminal device can perform wireless communication operations through at least one of the radar transmitting path and the radar receiving path.

Since gesture motion is a low-frequency motion, when performing gesture recognition, the radar scan frequency can usually be less than 10 Hz, that is, the radar scan period is usually greater than 100 milliseconds, and each radar scan takes a few microseconds. Therefore, the scan time The segment accounts for a very small proportion of the radar scanning period, and the multiplexing of the wireless channels in the wireless communication module by time division multiplexing has minimal impact on the wireless communication function of the wireless communication module.

In a possible implementation manner of the first aspect, the performing a radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data includes:

In the first time period, the radar transmission path is controlled to transmit electromagnetic signals, and the radar reception path is controlled to receive echo signals, and the echo signals are processed by analog-to-digital conversion to obtain radar scan data, where: The echo signal is a signal reflected by the electromagnetic signal after touching an object.

It should be noted that when the terminal device performs gesture recognition operations through the radar transmitting path and the radar receiving path, it can control the radar transmitting path to transmit electromagnetic signals and the radar receiving path to receive echo signals.

The above-mentioned echo signal is a signal emitted after the electromagnetic signal touches an object. The echo signal is processed by analog-to-digital conversion to obtain radar scan data.

In a possible implementation manner of the first aspect, the controlling the radar transmission path to emit electromagnetic signals includes:

Control the radar transmitting path to transmit a single-frequency continuous wave signal.

It should be noted that when the terminal device controls the radar transmitting channel to transmit electromagnetic signals, it can control the radar transmitting channel to transmit single-frequency continuous wave signals.

When the electromagnetic signal emitted by the radar transmitting channel is a single-frequency continuous wave signal, the radar sensor system constructed by the radar transmitting path and the radar receiving path is an extremely narrowband radar system.

The very narrowband radar system can reduce the interference of electromagnetic signals and echo signals to other frequency spectrums in the communication frequency band. Although the echo signal corresponding to the single-frequency continuous wave signal has a certain bandwidth, the bandwidth of the echo signal is on the order of Hertz, and has minimal impact on the communication frequency band. Compared with other types of radars, the very narrowband radar system can be more Good coexistence with the wireless communication module in the terminal device.

The second aspect of the embodiments of the present application provides another gesture recognition method, including:

When the gesture recognition instruction is detected, the first preset number of wireless paths are determined as the radar transmission path, and the second preset number of wireless paths are determined as the radar receiving path, and the radar transmission path and the radar receiving path are the same The wireless channel of the working frequency band;

Performing a radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data;

In a possible implementation manner of the second aspect, the determining the first preset number of wireless paths as the radar transmitting path and determining the second preset number of wireless paths as the radar receiving path includes:

Obtain the working frequency band of each wireless channel;

In another possible implementation manner of the second aspect, the determining the first preset number of wireless paths as radar transmission paths and the second preset number of wireless paths as radar receiving paths includes:

Obtain the channel performance parameters of each wireless channel;

In a possible implementation manner of the second aspect, the performing a radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data includes:

In each scanning period of the radar scanning period, a radar scanning operation is performed through the radar transmitting path and the radar receiving path to obtain radar scanning data.

Controlling the radar transmitting path to emit electromagnetic signals;

Control the radar receiving path to receive the echo signal, and perform analog-to-digital conversion processing on the echo signal to obtain radar scan data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.

In a possible implementation manner of the second aspect, the controlling the radar transmission path to emit electromagnetic signals includes:

In a possible implementation of the second aspect, the wireless path includes one or more of a Bluetooth wireless path, a wifi wireless path, and a licensed band-assisted access wireless path.

A third aspect of the embodiments of the present application provides a gesture recognition device, including:

The path selection module is used to determine the first preset number of wireless paths as the radar transmission path and the second preset number of wireless paths as the radar receiving path when the gesture recognition instruction is detected, wherein the wireless path includes Bluetooth At least one of a wireless path, a wifi wireless path, and a licensed band auxiliary access wireless path, the radar transmitting path and the radar receiving path are wireless paths having the same working frequency band;

The path multiplexing module is used to perform gesture recognition operations through the radar transmitting path and the radar receiving path in the first time period, and through at least one of the radar transmitting path and the radar receiving path in the second time period One wireless channel performs wireless communication operations.

In a possible implementation manner of the third aspect, the path multiplexing module includes:

A radar scanning sub-module, configured to perform a radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data;

The gesture recognition sub-module is used to perform gesture recognition processing on the radar scan data to obtain a gesture recognition result.

The wireless communication sub-module is configured to perform a Bluetooth communication operation or a wifi communication operation corresponding to the at least one wireless path through at least one of the radar transmission path and the radar reception path in the second time period Allowed band to assist access operations.

In a possible implementation manner of the third aspect, the path selection module includes:

Frequency band query sub-module, used to obtain the working frequency band of each wireless channel;

The calling screening sub-module is used to use wireless channels that have the same working frequency band and have not been called as target wireless channels, determine a first preset number of target wireless channels from the target wireless channels as radar transmission channels, A second preset number of target wireless paths in the wireless paths are determined as the radar receiving paths.

In another possible implementation manner of the third aspect, the path selection module includes:

The performance parameter sub-module is used to obtain the channel performance parameters of each wireless channel;

The performance screening sub-module is configured to determine, according to the channel performance parameters of each wireless channel, a third preset number of wireless channels with the best channel performance parameters and having the same working frequency band as the target wireless channel;

The target screening sub-module is used to determine a first preset number of target wireless paths from the target wireless paths as radar transmission paths, and determine a second preset number of target wireless paths from the target wireless paths as radar receiving paths .

The scanning parameter sub-module is used to obtain the radar scanning period and the scanning time period within the radar scanning period;

The intermittent scanning sub-module is used to perform gesture recognition operations through the radar transmitting path and the radar receiving path during the scanning time period in each radar scanning period, and to perform gesture recognition operations in each radar scanning period. During the scanning time period, a wireless communication operation is performed through at least one of the radar transmitting path and the radar receiving path.

In a possible implementation manner of the third aspect, the radar scanning sub-module is specifically configured to control the radar transmission path to transmit electromagnetic signals and control the radar reception path to receive feedback during the first time period. And perform analog-to-digital conversion processing on the echo signal to obtain radar scan data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.

In a possible implementation manner of the third aspect, the radar scanning submodule includes:

The single-frequency signal sub-module is used to control the radar transmission path to transmit a single-frequency continuous wave signal.

The fourth aspect of the embodiments of the present application provides another gesture recognition device, which is characterized in that it includes:

The path selection module is used to determine a first preset number of wireless paths as radar transmission paths, and a second preset number of wireless paths as radar receiving paths when a gesture recognition instruction is detected. The radar receiving channel is a wireless channel with the same working frequency band;

A radar scanning module, configured to perform a radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data;

The gesture recognition module is used to perform gesture recognition processing on the radar scan data to obtain a gesture recognition result.

In a possible implementation manner of the fourth aspect, the path selection module includes:

In another possible implementation manner of the fourth aspect, the path selection module includes:

In a possible implementation manner of the fourth aspect, the radar scanning module includes:

The intermittent scanning sub-module is used to perform a radar scanning operation through the radar transmitting path and the radar receiving path during the scanning period of each radar scanning period to obtain radar scanning data.

A signal transmitting sub-module for controlling the radar transmitting path to transmit electromagnetic signals;

The signal receiving sub-module is used to control the radar receiving path to receive echo signals and perform analog-to-digital conversion processing on the echo signals to obtain radar scan data. The echo signals indicate that the electromagnetic signal is in contact with an object After the reflected signal.

In a possible implementation manner of the fourth aspect, the signal transmission submodule is specifically configured to control the radar transmission path to transmit a single-frequency continuous wave signal.

In a possible implementation manner of the fourth aspect, the wireless path includes one or more of a Bluetooth wireless path, a wifi wireless path, and a licensed band-assisted access wireless path.

The fifth aspect of the embodiments of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, , So that the terminal device implements the steps of the above method.

A sixth aspect of the embodiments of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the terminal device realizes the steps of the above-mentioned method.

The seventh aspect of the embodiments of the present application provides a computer program product, which when the computer program product runs on a terminal device, enables the terminal device to implement the steps of the above-mentioned method.

Compared with the prior art, the embodiments of this application have the following beneficial effects:

In the gesture recognition method of the present application, the terminal device can determine the first preset number of wireless paths from the existing wireless paths as the radar transmitting path, and determine the second preset number of wireless paths as the radar receiving network. In the case of adding new radar sensors, multiplexing the wireless channels in the terminal equipment to construct a radar sensor system will not cause additional layout and wiring burdens on the RF front-end of the terminal equipment, increase any hardware costs, and do not affect the power consumption and power consumption of the terminal equipment. The volume solves the problem that when radar is used for gesture recognition, the layout of radar sensors in terminal equipment will bring a large layout and wiring burden to the radio frequency front end of the terminal equipment, and increase the hardware cost, power consumption and volume of the terminal equipment.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only of the present application. For some embodiments, those of ordinary skill in the art can obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic flowchart of a gesture recognition method provided by an embodiment of the present application;

Figure 2 is a schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of another application scenario provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of another application scenario provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a gesture recognition device provided by an embodiment of the present application;

Fig. 6 is a schematic diagram of a terminal device provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of a wireless transmission path provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of another wireless transmission path provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of a wireless receiving path provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of another wireless receiving path provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of a wireless transceiver reciprocal path provided by an embodiment of the present application;

FIG. 12 is a schematic diagram of another wireless transceiver reciprocal path provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of another wireless transceiver reciprocal path provided by an embodiment of the present application;

14 is a schematic diagram of a radar sensor system with a single-input multiple-output architecture provided by an embodiment of the present application;

15 is a schematic diagram of a radar sensor system with a multiple input single output architecture provided by an embodiment of the present application;

FIG. 16 is a schematic diagram of a radar sensor system with a multiple-input multiple-output architecture provided by an embodiment of the present application.

Detailed ways

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of this application.

It should be understood that when used in the specification and appended claims of this application, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other The existence or addition of features, wholes, steps, operations, elements, components, and/or collections thereof.

It should also be understood that the term "and/or" used in the specification and appended claims of this application refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

As used in the description of this application and the appended claims, the term "if" can be construed as "when" or "once" or "in response to determination" or "in response to detecting ". Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".

In addition, in the description of the specification of this application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.

The reference to "one embodiment" or "some embodiments" described in the specification of this application means that one or more embodiments of this application include a specific feature, structure, or characteristic described in combination with the embodiment. Therefore, the sentences "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless it is specifically emphasized otherwise. The terms "including", "including", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

The gesture recognition method provided by the embodiments of this application can be applied to mobile phones, tablet computers, wearable devices, in-vehicle devices, augmented reality (AR)/virtual reality (VR) devices, notebook computers, and super mobile personal computers For terminal devices (ultra-mobile personal computer, UMPC), netbooks, and personal digital assistants (personal digital assistant, PDA), the embodiments of this application do not impose any restrictions on the specific types of terminal devices.

For example, the terminal device may be a station (STAION, ST) in a WLAN, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a wireless local loop (Wireless Local Loop, WLL) station, Personal Digital Assistant (PDA) devices, handheld devices with wireless communication functions, computing devices or other processing devices connected to wireless modems, in-vehicle devices, car networking terminals, computers, laptop computers, handheld communication devices , Handheld computing devices, satellite wireless devices, wireless modem cards, television set top boxes (STB), customer premise equipment (customer premise equipment, CPE), and/or other equipment used to communicate on the wireless system and download First-generation communication modules, for example, mobile terminals in 5G networks or mobile terminals in the future evolution of the Public Land Mobile Network (PLMN) network, etc.

As an example and not a limitation, when the terminal device is a wearable device, the wearable device can also be a general term for applying wearable technology to intelligently design daily wear and develop wearable devices, such as glasses, gloves, Watches, clothing and shoes, etc. A wearable device is a portable device that is directly worn on the body or integrated into the user's clothes or accessories. Wearable devices are not only a hardware device, but also realize powerful functions through software support, data interaction, and cloud interaction. In a broad sense, wearable smart devices include full-featured, large-sized, complete or partial functions that can be implemented without relying on smart phones, such as smart watches or smart glasses, and only focus on a certain type of application function, and need to be used in conjunction with other devices such as smart phones. , Such as all kinds of smart bracelets and smart jewelry for physical sign monitoring.

In the radar field, the Doppler effect reflects the interaction between electromagnetic waves and moving targets. When there is relative motion between the observer and the wave source, there is a difference between the frequency of the electromagnetic wave received by the observer and the frequency of the electromagnetic wave emitted by the wave source. Based on this principle, radar and sonar systems are widely used to measure the speed information of targets.

In the past few decades, with the miniaturization and low cost of civil radar, radar sensor systems have attracted more and more attention and have been applied in many fields. Typical application examples include: mechanical vibration measurement, life signal monitoring, partition wall signal detection, gesture recognition, and low-speed application measurement. Moreover, with the development of semiconductor technology, radar sensor systems based on radio frequency integrated chips are also shining brilliantly in the academic and industrial circles.

Compared with other vital signal measurement sensors, radar sensors are more comfortable and convenient when applied to gesture recognition technology. The radar sensor senses when there is a certain distance from the sensing target. For the sensing target, this non-contact sensing is always more comfortable and convenient than the sensing method close to the skin surface.

Among the current solutions that use radar sensors for gesture recognition, some use millimeter wave radar for gesture motion detection, some use Frequency Modulated Continuous Wave (FMCW) radar to monitor gestures, and some use The single input multiple output (Single Input Multiple Output, SIMO) architecture radar sensor system tracks gestures. However, no matter which solution it is, a new radar sensor system needs to be added to the terminal equipment, and a new radar chip, adapter circuit, radar antenna, and corresponding power supply and corresponding power supply are required to be added to the narrow and crowded space of the terminal equipment. The baseband system will bring a large layout and wiring burden to the radio frequency front end of the terminal equipment, and will increase the hardware cost, power consumption and volume of the terminal equipment, and may even affect the performance of the terminal equipment.

In view of this, an embodiment of the present application provides a gesture recognition method. The terminal device can determine a first preset number of wireless paths as radar transmission paths from existing wireless paths, and determine a second preset number of wireless paths as radar transmission paths. Radar receiving and Tongluo, without adding a new radar sensor, multiplexing the wireless path of the terminal equipment to construct the radar sensor, will not cause additional layout and wiring burdens on the radio frequency front end of the terminal equipment, will not increase any hardware cost, and will not affect The power consumption and size of the terminal equipment solve the problem that when radar is used for gesture recognition, the layout of the radar sensor in the terminal equipment will bring a large layout and wiring burden to the radio frequency front end of the terminal equipment, and increase the hardware cost and power consumption of the terminal equipment. And the problem of volume.

Next, from the perspective of a terminal device, the gesture recognition method provided in this embodiment will be described. Please refer to the flowchart of the gesture recognition method shown in FIG. 1, which includes:

S101. When a gesture recognition instruction is detected, determine a first preset number of wireless paths as radar transmission paths, and determine a second preset number of wireless paths as radar receiving paths, where the wireless paths include Bluetooth wireless paths and wifi At least one of a wireless path and a licensed band auxiliary access wireless path, the radar transmitting path and the radar receiving path are wireless paths having the same working frequency band;

A trigger condition for triggering the gesture recognition instruction can be set on the terminal device. When the user wants to enable the gesture recognition function, the terminal device can be operated to trigger the gesture recognition instruction.

The trigger condition for triggering the gesture recognition instruction can be set according to the actual situation. In some embodiments, the terminal device may be provided with a physical button or a virtual button that triggers gesture recognition. When the user presses the aforementioned physical button or clicks the aforementioned virtual button, a gesture recognition instruction can be triggered.

For example, as shown in FIG. 2, the terminal device 2 includes a physical button 201 and a physical button 202. The physical button 201 is a volume button, and the physical button 202 is a power button. In the process of driving a vehicle, it is usually inconvenient for users to operate terminal devices in order to avoid traffic accidents. Therefore, assuming that the terminal device 2 is provided with an association relationship between the volume key 201 and the gesture recognition function, the user can simultaneously press the first side and the second side of the volume key with two fingers before the vehicle is driven to trigger the gesture recognition instruction. Enable the gesture operation function so that the user can give corresponding instructions to the terminal device through gestures while driving.

Or, as shown in FIG. 3, the system setting interface of the terminal device is provided with a virtual button 203 for enabling and disabling the gesture recognition function. Before the vehicle is driving, the user can click the virtual button 203 of the gesture recognition function on the terminal device to trigger the gesture recognition instruction and enable the gesture operation function, so that the user can give corresponding instructions to the terminal device through gestures during driving.

In other embodiments, the user may also set the association relationship between certain applications and gesture recognition instructions on the terminal device, and when the user starts these specific applications, the gesture recognition instructions are automatically triggered.

For example, many users currently like to use map navigation software on terminal devices for route navigation when driving a vehicle. Therefore, the user can set the association relationship between the map navigation software and the gesture recognition instruction. As shown in FIG. 4, before driving, the user can search for "map" on the terminal device, and the terminal device displays the search result. The search result includes the A navigation map 204 and the B navigation map 205. The user clicks the A navigation map 204 to activate the A navigation map software. The A navigation map software automatically triggers a gesture recognition instruction when it is started, and enables the gesture operation function, so that the user can give corresponding instructions to the terminal device through gestures during driving.

There are many wireless communication modules in terminal devices, such as Bluetooth (BT) communication modules, wifi communication modules, Licensed-Assisted Access (LAA) modules, and so on.

These wireless communication modules have one or more wireless paths, and the type of the wireless path corresponds to the type of the wireless communication module. For example, the Bluetooth communication module may include one or more Bluetooth wireless channels; the wifi communication module may include one or more wifi wireless channels; the LAA communication module may include one or more LAA wireless channels.

Among them, the working frequency band of the LAA wireless channel is 5150MHz to 5925MHz, and the working frequency band of the wifi wireless channel working in the 5GHz frequency band is the frequency band of 5150MHz to 5850MHz. Therefore, the LAA wireless channel and the wifi wireless channel working in the 5GHz frequency band have the same operation. Frequency band, that is, the frequency band from 5150MHz to 5850MHz. The working frequency band of the Bluetooth wireless channel is 2401MHz to 2479MHz, and the working frequency of the wifi wireless channel working in the 2.4GHz frequency band is 2400MHz to 2483.5MHz. Therefore, the Bluetooth wireless channel and the wifi wireless channel working in the 2.4GHz frequency band have the same The working frequency band is the frequency band from 2401MHz to 2479MHz.

When the terminal device detects the gesture recognition instruction, the terminal device may select a first preset number of wireless paths from the wireless paths of each wireless communication module as the radar transmission path, and select the second preset wireless path as the radar receiving path, Therefore, without adding a radar sensor, the wireless channel of the existing wireless communication module of the terminal equipment is reused to construct a radar sensor system.

The first preset quantity and the second preset quantity can be set according to actual needs. For example, the first preset number can be set to 1, and the second preset number can be set to 3. The terminal device selects 1 wireless path as the radar transmission path, and selects 3 wireless paths as the radar receiving path to construct a one-transmit and three-receive system Radar sensor system based on SIMO architecture. Alternatively, the first preset number can also be set to 3, the second preset number is set to 3, and the terminal device selects 3 wireless channels as the radar transmission channel and 3 wireless channels as the radar receiving channel to construct a three-transmit and three-receive system A radar sensor system with Multiple Input Multiple Output (MIMO) architecture; alternatively, the first preset number can also be set to 3, the second preset number is set to 1, and the terminal device selects 3 wireless channels as the radar transmission Channel, select one wireless channel as the radar receiving channel to construct a radar sensor system with multiple input single output (MISO) architecture with three transmissions and one reception.

When the radar sensor system constructed by the radar transmitting path and the radar receiving path is a radar sensor system of the SIMO architecture, the phase linear demodulation technology can be used for gesture recognition, and the amount of calculation is small, and there is no need to use complex models such as convolutional neural networks for complexity. For training, the terminal device can use a classifier with a relatively simple structure to distinguish the types of echo signals. When the radar sensor system constructed by the radar transmitting path and the radar receiving path is a radar sensor system of MIMO architecture, the phase linear demodulation technology cannot be used for gesture recognition, and the calculation amount of gesture recognition is relatively large. However, the radar sensor system of MIMO architecture receives The received echo signal is a superposition of multiple echo signals, which can provide a basis for pattern recognition for non-point sources, distributed and complex motions.

It is understandable that in the process of determining the radar transmitting path and the radar receiving path, the radar transmitting path and the radar receiving path should be wireless paths with the same working frequency band, otherwise the radar sensor system cannot be constructed. For example, when the radar transmission path selects the LAA wireless path working in the 5GHz frequency band, the radar receiving path should not select the Bluetooth wireless path working in the 2.4GHz frequency band, but the wireless path working in the 5GHz frequency band should be selected as the radar receiving path, otherwise Radar transmitting path and radar receiving path cannot construct a radar sensor system.

In addition, when the first preset number is greater than or equal to 2, the wireless paths in the radar transmission path may be the same type of wireless path, or may be different types of wireless paths. For example, assuming that the first preset number is set to 2, the terminal device needs to select two wireless paths as the radar transmission path. These two wireless paths may be LAA wireless paths, or the two wireless paths may include one LAA wireless path. Access and a wifi wireless access.

When the second preset number is greater than or equal to 2, each wireless path in the radar receiving path may be the same type of wireless path, or may be a different type of wireless path. For example, assuming that the second preset number is set to 2, the terminal device needs to select 2 wireless channels as the radar receiving channels. These 2 wireless channels can be LAA wireless channels, or the 2 wireless channels can include one LAA wireless channel. Access and a wifi wireless access.

In addition, the above-mentioned radar transmitting path and radar receiving path may be the same type of wireless path, or may be different types of wireless paths. For example, suppose the terminal device selects a LAA wireless path as the radar transmission path, the terminal device can select the LAA wireless path as the radar reception path, and the radar transmission path and the radar reception path are the same type of wireless path; or, the terminal device Other wireless channels can also be selected as the radar receiving channel. For example, the terminal device can select the wifi wireless channel as the radar receiving channel. At this time, the radar transmitting channel and the radar receiving channel are different types of wireless channels.

The selection method of the radar transmitting path and the radar receiving path can be set according to the actual situation.

In some possible implementation manners, the terminal device may obtain the working frequency band of each wireless channel, and use the wireless channel that has the same working frequency band and has not been called as the target wireless channel. Then, the terminal device determines the first preset number of target wireless paths from the target wireless paths as the radar transmitting path, and determines the second preset number of wireless paths as the radar receiving path.

For example, if the terminal device detects that there are currently 6 wireless channels that have not been called, 5 wireless channels are working in the 2.4GHz frequency band, and one wireless channel is working in the 5GHz frequency band, then the terminal device can operate 5 wireless channels in the 2.4GHz frequency band without being called. The called wireless path is used as the target wireless path. Assuming that the first preset number is 1 and the second preset number is 3, the terminal device selects one wireless path from the five target wireless paths as the radar transmitting path, and three wireless paths as the radar receiving path.

At this time, if the number of uncalled wireless channels corresponding to a certain working frequency band is greater than or equal to the sum of the first preset number and the second preset number, the terminal device can select from the target wireless channels corresponding to the working frequency band Radar transmitting path and radar receiving path. If the number of uncalled wireless channels corresponding to each working frequency band is less than the sum of the first preset number and the second preset number, the terminal device may temporarily not select the radar transmission path and the radar receiving path, and wait for a certain working frequency band When the corresponding number of wireless channels that have not been called is greater than or equal to the sum of the first preset number and the second preset number, then the radar transmitting path and the radar receiving path are selected.

Through the above method, the terminal device can select the wireless channel that has not been called as the radar transmission channel and the radar receiving channel. It can reuse the wireless channel in the idle state to construct the radar sensor system without affecting the wireless communication function of each wireless communication module. Make an impact.

In other possible implementation manners, the terminal device may also obtain the path performance parameters of each wireless path. The content of the channel performance parameters can be set according to the actual situation. For example, the channel performance parameters may include one or more of parameters such as Quality of Service (QoS), number of antennas, and power.

The terminal device can evaluate the path status of each wireless path through path performance parameters, and select a third preset number of wireless paths with the best path performance parameters and the same working frequency band as the target wireless path.

The third preset quantity should be greater than or equal to the sum of the first preset quantity and the second preset quantity. After selecting the target wireless path, the terminal device determines the first preset number of target wireless paths from the target wireless path as the radar transmitting path, and determines the second preset number of wireless paths as the radar receiving path.

For example, suppose that the wireless channels working in the 5GHz frequency band are preferentially selected as the radar transmitting channel and the radar receiving channel, the first preset number is 1, the second preset number is 2, and the third preset number is 4, the terminal device can obtain For the channel performance parameters of each wireless channel working in the 5GHz frequency band, four wireless channels with the best channel performance parameters are selected as the target wireless channels. Then one target wireless path is selected from the four target wireless paths as the radar transmitting path, and two target wireless paths are selected as the radar receiving path.

In some other possible implementation manners, the terminal device may also preferentially select wireless channels that have not been called as the radar transmitting channel or the radar receiving channel. If the uncalled wireless channels corresponding to each working frequency band are less than the sum of the first preset number and the second preset number, the terminal device can obtain the channel performance parameters of each wireless channel and select the third preset number of channel performance The wireless channel with the optimal parameters and the same working frequency band is used as the target wireless channel.

In other possible implementations, the terminal device may also determine the first preset number of radar transmission paths and the second preset number of radar reception paths from wireless paths with the same operating frequency band by random selection. .

It is understandable that the foregoing manner of determining the radar transmitting path and the radar receiving path is only a schematic example of this embodiment, and this embodiment does not limit the manner of determining the radar transmitting path and the radar receiving path. In the actual application process, the terminal equipment can determine the radar transmission path and the radar reception path through the above-mentioned methods, or the terminal equipment may also determine the radar transmission path and the radar reception path through other methods.

S102. Perform a gesture recognition operation through the radar transmitting path and the radar receiving path in the first time period, and perform wireless through at least one of the radar transmitting path and the radar receiving path in the second time period. Communication operation.

After the terminal device selects the radar transmission path and the radar reception path, it can perform gesture recognition operations through the radar transmission path and the radar reception path in the first time period, and the terminal device can pass the radar transmission path and the radar reception path in the second time period At least one of the wireless channels in the wireless channel performs wireless communication operations.

The type of wireless communication operation corresponds to the path type of the wireless path. For example, when the wireless path is a Bluetooth wireless path, the wireless communication operation performed by the wireless path is a Bluetooth communication operation; when the wireless path is a wifi wireless path, the wireless communication operation performed by the wireless path is a wifi communication operation; when the wireless path is When the permitted band assists in accessing the wireless channel, the wireless communication operation performed by the wireless channel is the permitted band assisted access operation.

The first time period and the second time period may be preset time periods or non-preset time periods.

Gesture movement is a low-frequency movement. When performing gesture recognition, the radar scan frequency can usually be less than 10 Hz, that is, the radar scan period is usually greater than 100 milliseconds, and each radar scan takes a few microseconds. Therefore, in a possible implementation, after selecting the radar transmitting path and the radar receiving path, the terminal device can obtain the radar scanning period. Each radar scanning period can be divided into a scanning period and a non-scanning period. The multiplexing method controls the radar transmitting path and the radar receiving path to perform gesture recognition operations and wireless communication operations. At this time, the first time period and the second time period are preset time periods, the first time period is the scanning time period of each radar scanning period, and the second time period is the non-scanning time period of each radar scanning period.

During the scanning period of each radar scanning period, the terminal device can perform gesture recognition operations in the scanning period through the radar transmission path and the radar receiving path. During the non-scanning period of each radar scanning period, the terminal device can perform corresponding wireless communication operations through at least one of the radar transmitting path and the radar receiving path.

For example, assuming that the Bluetooth wireless path is selected as the radar transmission path and the wifi wireless path is selected as the radar receiving path, during the scanning period of the radar scan cycle, the terminal device can perform radar scanning operations through the Bluetooth wireless path and the wifi wireless path; During the non-scanning period of the radar scanning period, the terminal device can perform Bluetooth communication operations through the Bluetooth wireless path and/or perform wifi communication operations through the wifi wireless path.

At this time, the terminal device can not only use the wireless path of the existing wireless communication module to perform gesture recognition operations, but also, because the scanning time period accounts for a very small proportion of the radar scanning cycle, the wireless communication module is multiplexed by time division multiplexing. The wireless path in the wireless communication module has minimal impact on the wireless communication function of the wireless communication module.

It is understandable that the wireless channels in the radar transmitting path and the radar receiving path perform different operations during the scanning period and the non-scanning period of the radar scan cycle to achieve different functions. Therefore, the processor in the terminal device can pass through each The coexistence mechanism between the wireless communication modules periodically generates a trigger signal to control the wireless path switching function.

When there are multiple processors in the terminal device, in order to ensure that the timing of each wireless path is the same, the trigger signal for controlling the switching function of each wireless path should be generated by the same processor. After the processor generates the trigger signal, it sends the trigger signal to other processors, so that multiple processors, under the control of the coexistence mechanism, can control each wireless channel to switch different functions in an orderly manner.

For example, suppose that the radar transmitting path and the radar receiving path include a Bluetooth wireless path and a wifi wireless path, the Bluetooth communication module includes a Bluetooth baseband chip, and the wifi communication module includes a wifi baseband chip. At this time, the trigger signals that control the function switching of each wireless channel should all be generated by the Bluetooth baseband chip; or, the trigger signals that control each wireless channel to switch the function should all be generated by the wifi baseband chip; or, control each wireless channel for function switching The trigger signal of should all be generated by some other processor. After a processor generates a trigger signal to control the wireless channel switching function, it transmits the trigger signal to other processors by means of interrupt transmission, etc., and each processor controls the corresponding wireless channel to perform function switching according to the trigger signal, thereby enabling multiple processing Under the control of the coexistence mechanism, the device controls each wireless channel to switch different functions in an orderly manner.

In another possible implementation manner, the terminal device may not set the radar scan period. As mentioned in the foregoing, the terminal device can select a wireless channel with the same working frequency band as the target wireless channel from the wireless channels that have not been called, and select the radar transmitting channel and the radar receiving channel from the target wireless channels.

At this time, the first time period and the second time period are non-preset time periods. The first time period refers to the time period when the wireless channel is called as the radar transmitting channel or the radar receiving channel, and the second time period refers to The time period during which the wireless path is called to perform wireless communication operations.

In the process of performing the gesture recognition operation, the terminal device can perform the radar scanning operation through the above-mentioned radar transmitting path and the radar receiving path to obtain radar scanning data. Then, the terminal device performs gesture recognition processing on the radar scan data to obtain the gesture recognition result.

When performing radar scanning operations, the terminal device can transmit electromagnetic signals through the radar transmission path. After the electromagnetic signal emitted by the radar transmission path touches the object, the object will reflect the echo signal.

The terminal device can receive the echo signal through the radar receiving channel, and the terminal device performs analog-to-digital conversion processing on the echo signal, converts the echo signal from an analog signal to a digital signal, and obtains radar scan data. After that, the terminal device performs gesture recognition processing on the radar scan data to obtain the gesture recognition result.

The type of electromagnetic signal emitted by the radar transmission path can be set according to the actual situation. For example, the electromagnetic signal emitted by the radar transmission path may be a pulse signal, a frequency modulated continuous wave signal, a single frequency continuous wave signal, and so on.

When the type of electromagnetic signal emitted by the radar transmitting path is a single-frequency continuous wave signal, the radar sensor system constructed by the radar transmitting path and the radar receiving path is an extremely narrowband radar system. The very narrowband radar system can reduce the interference of electromagnetic signals and echo signals to other frequency spectrums in the communication frequency band. Although the echo signal corresponding to the single-frequency continuous wave signal has a certain bandwidth, the bandwidth of the echo signal is on the order of Hertz, and has minimal impact on the communication frequency band. Compared with other types of radars, the very narrowband radar system can be more Good coexistence with the wireless communication module in the terminal device.

In addition, when two or more terminal devices are relatively close, signal interference may occur. At this time, each terminal device can perform communication negotiation to allocate different working frequency bands to different terminal devices. After each terminal device determines its own intermediate frequency signal, even if there is signal interference between each terminal device, each terminal device can filter out the interference signal outside the working frequency band through the intermediate frequency filter, and through frequency division multiplexing, To achieve the coexistence of multiple terminal devices.

To sum up, in the gesture recognition method provided in this embodiment, the terminal device can determine the first preset number of wireless paths as the radar transmission path from the existing wireless paths, and determine the second preset number of wireless paths. The channel is used as a radar to receive the network. Without adding a new radar sensor, the wireless channel of the terminal device is reused to construct the radar sensor, which will not cause additional layout and wiring burdens on the radio frequency front end of the terminal device, and does not increase any cost. Affects the power consumption and volume of terminal equipment, and solves the problem that when radar is used for gesture recognition, the layout of radar sensors in terminal equipment will bring a large layout and wiring burden to the radio frequency front end of the terminal equipment, and increase the hardware cost and power of the terminal equipment. The problem of consumption and volume.

It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

Referring to FIG. 5, an embodiment of the present application provides a gesture recognition device. For ease of description, only parts related to the present application are shown. As shown in FIG. 5, the gesture recognition device includes:

The path selection module 501 is configured to determine a first preset number of wireless paths as radar transmission paths and a second preset number of wireless paths as radar receiving paths when a gesture recognition instruction is detected, wherein the wireless paths include At least one of a Bluetooth wireless channel, a wifi wireless channel, and a licensed band auxiliary access wireless channel, the radar transmitting channel and the radar receiving channel are wireless channels having the same working frequency band;

The path multiplexing module 502 is configured to perform gesture recognition operations through the radar transmitting path and the radar receiving path in the first time period, and to perform gesture recognition operations through the radar transmitting path and the radar receiving path in the second time period. At least one wireless channel performs wireless communication operations.

Further, the path multiplexing module 502 includes:

Further, the path selection module 501 includes:

Further, the path multiplexing module 502 includes:

Further, the radar scanning sub-module is specifically configured to control the radar transmission path to transmit electromagnetic signals, and control the radar reception path to receive echo signals, and respond to the echo signals in the first time period. Perform analog-to-digital conversion processing to obtain radar scan data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.

Further, the radar scanning sub-module includes:

It should be noted that the information interaction and execution process between the above-mentioned devices/units are based on the same concept as the method embodiment of this application, and its specific functions and technical effects can be found in the method embodiment section. I won't repeat it here.

Referring to FIG. 6, an embodiment of the present application also provides a terminal device. As shown in FIG. 6, the terminal device 6 of this embodiment includes: a processor 60, a memory 61, a computer program 62 stored in the memory 61 and running on the processor 60, and a wireless communication module 63. When the processor 60 executes the computer program 62, the steps in the embodiment of the screen expansion method described above are implemented, for example, steps S101 to S102 shown in FIG. 1. Alternatively, when the processor 60 executes the computer program 62, the functions of the modules/units in the foregoing device embodiments, such as the functions of the modules 501 to 502 shown in FIG. 5, are realized.

Exemplarily, the computer program 62 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 61 and executed by the processor 60 to complete This application. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 62 in the terminal device 6. For example, the computer program 62 can be divided into a path selection module and a path multiplexing module, and the specific functions of each module are as follows:

The terminal device 6 may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. The terminal device may include, but is not limited to, a processor 60 and a memory 61. Those skilled in the art can understand that FIG. 6 is only an example of the terminal device 6 and does not constitute a limitation on the terminal device 6. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access devices, buses, and so on.

The so-called processor 60 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk equipped on the terminal device 6, a smart memory card (Smart Media Card, SMC), or a Secure Digital (SD). Card, Flash Card, etc. Further, the memory 61 may also include both an internal storage unit of the terminal device 6 and an external storage device. The memory 61 is used to store the computer program and other programs and data required by the terminal device. The memory 61 can also be used to temporarily store data that has been output or will be output.

The wireless communication module 63 may be a wireless communication module such as a Bluetooth communication module, a wifi communication module, a licensed band auxiliary access module, etc. The type of the wireless communication module 63 is not limited in this embodiment. The above-mentioned wireless communication module 63 may include at least one wireless path, and the wireless path may be a wireless transmission path, a wireless reception path, or a wireless transceiver reciprocal path.

As shown in FIG. 7, the above-mentioned wireless transmission path may include a transmitter 701 and a transmission antenna 702. After the transmitter 701 generates the electromagnetic signal, it transmits the electromagnetic signal through the transmitting antenna 702.

The structure of the transmitter 701 can be set according to actual conditions. For example, as shown in FIG. 8, the transmitter 701 may include a local oscillator (LO) 7011 and a power amplifier 7012. After receiving the clock signal, the local oscillator 7011 generates an electromagnetic signal according to the clock signal, which is amplified by the power amplifier 7012, and then the transmitting antenna 702 transmits the amplified electromagnetic signal.

As shown in FIG. 9, the above-mentioned wireless receiving path may include a receiver 901 and a receiving antenna 902. After receiving the electromagnetic signal by the receiving antenna 902, the receiver 901 performs signal processing.

The structure of the receiver 901 can be set according to actual conditions. For example, as shown in FIG. 10, the receiver 901 may include a low-noise amplifier 9011, a local oscillator 9012, a phase shifter 9013, a first multiplier 9014, a second multiplier 9015, and a first filter. 9016, a second filter 9017, a first analog-to-digital converter 9018, and a second analog-to-digital converter 9019.

The receiving antenna 902 receives the electromagnetic signal, and the electromagnetic signal is amplified by the low-noise amplifier 9011 and then divided into a first amplified signal and a second amplified signal. After receiving the clock signal, the local oscillator 9012 generates a local oscillator signal according to the clock signal and transmits it to the phase shifter 9013. After processing the local oscillator signal, the phase shifter 9013 outputs the first phase shift signal and the second phase shift signal. The first multiplier 9014 performs mixing processing on the first amplified signal and the first phase-shifted signal to obtain the first mixed signal. The second multiplier 9015 performs frequency mixing processing on the second amplified signal and the second phase-shifted signal to obtain the second mixed signal. After the first mixed signal undergoes filtering processing by the first filter 9016 and analog-to-digital conversion by the first analog-to-digital converter 9018, first data is obtained. After the second mixed signal undergoes filtering processing by the second filter 9017 and analog-to-digital conversion by the second analog-to-digital converter 9019, second data is obtained.

The filter types of the first filter 9016 and the second filter 9017 can be selected according to actual conditions. For example, a band pass filter, a Nyquist filter, etc. can be selected as the first filter 9016 and the second filter 9017.

As shown in FIG. 11, the above-mentioned wireless transceiving reciprocal path may include a transmitter 1101, a receiver 1102, a duplexer 1103 and a transceiving antenna 1104. As shown in FIG. 12, when the duplexer 1103 is in state 1, the above-mentioned wireless transceiving reciprocal path can transmit electromagnetic signals through the transmitter 1101, the duplexer 1103, and the transceiver antenna 1104.

As shown in FIG. 13, when the duplexer 1103 is in state 2, the above-mentioned wireless transceiving reciprocal path can receive electromagnetic signals through the transceiving antenna 1104, the duplexer 1103, and the receiver 1102.

The type of the duplexer 1103 can be selected according to the actual situation. For example, devices or circuits such as circulators, isolators, and switching circuits can be selected as duplexers.

It is understandable that when the above-mentioned wireless receiving path or the wireless transceiving reciprocal path is determined to be the radar receiving path, the electromagnetic signal received by the receiving antenna/transceiving antenna is the reflection of the electromagnetic signal emitted by the radar transmitting path after contacting an object. Wave signal. The first data and the second data processed by the above-mentioned receiver are radar scan data, and the processor 60 performs gesture recognition on the radar scan data to obtain a gesture recognition result.

When the processor 60 determines the radar transmitting path and the radar receiving path from the above wireless paths, the clock signals of the radar transmitting path and the radar receiving path should be the clock signal generated by the same reference clock to ensure the time synchronization of the radar transmitting path and the radar receiving path. .

As shown in FIG. 14, the wireless path of each wireless communication module 63 can construct a radar sensor system of the SIMO architecture under the control of the processor. The radar sensor system of the SIMO architecture includes a radar transmitting path 1401 and multiple radar receiving paths 1402.

Or, as shown in FIG. 15, the wireless path of each wireless communication module 63 can construct a radar sensor system of MISO architecture under the control of the processor. The radar sensor system of MISO architecture includes multiple radar transmitting paths 1501 and one radar receiving path. 1502.

Or, as shown in FIG. 16, the wireless channels of each wireless communication module 63 can construct a radar sensor system with a MIMO architecture under the control of the processor. The radar sensor system with a MIMO architecture includes multiple radar transmission paths 1601 and multiple radar receivers. Passage 1602.

The aforementioned radar transmission path may be a wireless transmission path and/or a wireless transceiver reciprocal path, and the aforementioned radar reception path may be a wireless reception path and/or a wireless transceiver reciprocal path. Since the wireless transceiver reciprocal path can transmit electromagnetic signals or receive electromagnetic signals by switching the duplexer, when the processor 60 selects the wireless transceiver reciprocal path as the radar transmitting path or the radar receiving path, the radar sensor can be constructed more flexibly The system minimizes the impact of radar sensors on the original communication functions of the terminal equipment.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the division of the above functional units and modules is used as an example. In practical applications, the above functions can be allocated to different functional units and modules as needed. Module completion, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist alone physically, or two or more units can be integrated into one unit. The above-mentioned integrated units can be hardware-based Formal realization can also be realized in the form of a software functional unit. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of the units and modules in the foregoing system, reference may be made to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed device/terminal device and method may be implemented in other ways. For example, the device/terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units. Or components can be combined or integrated into another system, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated module/unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, it can implement the steps of the foregoing method embodiments. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunications signal, and software distribution media, etc. It should be noted that the content contained in the computer-readable medium can be appropriately added or deleted according to the requirements of the legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to the legislation and patent practice, the computer-readable medium Does not include electrical carrier signals and telecommunication signals.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims

A gesture recognition method, characterized in that it comprises:

When the gesture recognition instruction is detected, the first preset number of wireless paths are determined as radar transmission paths, and the second preset number of wireless paths are determined as radar receiving paths, where the wireless paths include Bluetooth wireless paths and wifi wireless paths. At least one of the licensed band auxiliary access wireless channels, the radar transmitting channel and the radar receiving channel are wireless channels with the same working frequency band;

Perform a gesture recognition operation through the radar transmission path and the radar reception path in the first time period, and perform a wireless communication operation through at least one of the radar transmission path and the radar reception path in the second time period .
The gesture recognition method according to claim 1, wherein the performing a gesture recognition operation through the radar transmitting path and the radar receiving path in the first time period comprises:

Performing a radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data;

Perform gesture recognition processing on the radar scan data to obtain a gesture recognition result.
The gesture recognition method according to claim 1, wherein the performing a wireless communication operation through at least one of the radar transmitting path and the radar receiving path in the second time period comprises:

In the second time period, a Bluetooth communication operation or a wifi communication operation or a permitted band-assisted access operation corresponding to the at least one wireless path is performed through at least one of the radar transmission path and the radar reception path.
The gesture recognition method according to claim 1, wherein the determining a first preset number of wireless paths as radar transmitting paths and determining a second preset number of wireless paths as radar receiving paths comprises:

Obtain the working frequency band of each wireless channel;

Use wireless channels that have the same operating frequency band and have not been called as target wireless channels, determine a first preset number of target wireless channels from the target wireless channels as radar transmission channels, and determine a second predetermined number from the target wireless channels. Set a number of target wireless channels as radar receiving channels.
The gesture recognition method according to claim 1, wherein the determining a first preset number of wireless paths as radar transmitting paths and determining a second preset number of wireless paths as radar receiving paths comprises:

Obtain the channel performance parameters of each wireless channel;

According to the channel performance parameters of each wireless channel, determine a third preset number of wireless channels with the best channel performance parameters and having the same working frequency band as the target wireless channel;

A first preset number of target wireless paths are determined from the target wireless paths as radar transmission paths, and a second preset number of target wireless paths are determined from the target wireless paths as radar receiving paths.
The gesture recognition method according to claim 1, wherein the gesture recognition operation is performed through the radar transmission path and the radar receiving path in the first time period, and the gesture recognition operation is performed through the radar in the second time period. Performing wireless communication operations on at least one of the path and the radar receiving path includes:

Acquiring a radar scanning period and a scanning time period within the radar scanning period;

In the scanning time period in each radar scanning period, the gesture recognition operation is performed through the radar transmission path and the radar receiving path, and in the non-scanning time period in each radar scanning period, the At least one of the radar transmitting path and the radar receiving path performs a wireless communication operation.
The gesture recognition method according to claim 2, wherein the performing a radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data comprises:

In the first time period, the radar transmission path is controlled to transmit electromagnetic signals, and the radar reception path is controlled to receive echo signals, and the echo signals are processed by analog-to-digital conversion to obtain radar scan data, where: The echo signal is a signal reflected by the electromagnetic signal after touching an object.
The gesture recognition method according to claim 7, wherein the controlling the radar transmission path to emit electromagnetic signals comprises:

Control the radar transmitting path to transmit a single-frequency continuous wave signal.
A gesture recognition device, characterized in that it comprises:

The path selection module is used to determine the first preset number of wireless paths as the radar transmission path and the second preset number of wireless paths as the radar receiving path when the gesture recognition instruction is detected, wherein the wireless path includes Bluetooth At least one of a wireless path, a wifi wireless path, and a licensed band auxiliary access wireless path, the radar transmitting path and the radar receiving path are wireless paths having the same working frequency band;

The path multiplexing module is used to perform gesture recognition operations through the radar transmitting path and the radar receiving path in the first time period, and through at least one of the radar transmitting path and the radar receiving path in the second time period One wireless channel performs wireless communication operations.
The gesture recognition device according to claim 9, wherein the path multiplexing module comprises:

A radar scanning sub-module, configured to perform a radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data;

The gesture recognition sub-module is used to perform gesture recognition processing on the radar scan data to obtain a gesture recognition result.
The gesture recognition device according to claim 9, wherein the path multiplexing module comprises:

The wireless communication sub-module is configured to perform a Bluetooth communication operation or a wifi communication operation corresponding to the at least one wireless path through at least one of the radar transmission path and the radar reception path in the second time period Allowed band to assist access operations.
The gesture recognition device according to claim 9, wherein the path selection module comprises:

Frequency band query sub-module, used to obtain the working frequency band of each wireless channel;

The calling screening sub-module is used to use wireless channels that have the same working frequency band and have not been called as target wireless channels, determine a first preset number of target wireless channels from the target wireless channels as radar transmission channels, A second preset number of target wireless paths in the wireless paths are determined as the radar receiving paths.
The gesture recognition device according to claim 9, wherein the path selection module comprises:

The performance parameter sub-module is used to obtain the channel performance parameters of each wireless channel;

The performance screening sub-module is configured to determine, according to the channel performance parameters of each wireless channel, a third preset number of wireless channels with the best channel performance parameters and having the same working frequency band as the target wireless channel;

The target screening sub-module is used to determine a first preset number of target wireless paths from the target wireless paths as radar transmission paths, and determine a second preset number of target wireless paths from the target wireless paths as radar receiving paths .
The gesture recognition device according to claim 9, wherein the path multiplexing module comprises:

The scanning parameter sub-module is used to obtain the radar scanning period and the scanning time period within the radar scanning period;

The intermittent scanning sub-module is used to perform gesture recognition operations through the radar transmitting path and the radar receiving path during the scanning time period in each radar scanning period, and to perform gesture recognition operations in each radar scanning period. During the scanning time period, a wireless communication operation is performed through at least one of the radar transmitting path and the radar receiving path.
The gesture recognition device according to claim 10, wherein the radar scanning sub-module is specifically configured to control the radar transmitting path to emit electromagnetic signals and to control the radar receiving path during the first time period An echo signal is received, and analog-to-digital conversion processing is performed on the echo signal to obtain radar scan data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.
The gesture recognition device according to claim 15, wherein the radar scanning sub-module comprises:

The single-frequency signal sub-module is used to control the radar transmission path to transmit a single-frequency continuous wave signal.
A terminal device includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program so that the terminal device implements such as The steps of the method according to any one of claims 1 to 8.
A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, it enables a terminal device to implement the method according to any one of claims 1 to 8 A step of.