CN113220112B

CN113220112B - Gesture recognition method, gesture recognition device, terminal equipment and computer storage medium

Info

Publication number: CN113220112B
Application number: CN202010073476.3A
Authority: CN
Inventors: 张翼; 冉立新; 张广煜; 王辉
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-01-21
Filing date: 2020-01-21
Publication date: 2023-07-18
Anticipated expiration: 2040-01-21
Also published as: CN113220112A; WO2021147428A1

Abstract

The application is applicable to the technical field of wireless technology, and provides a gesture recognition method, a gesture recognition device, terminal equipment and a computer storage medium. In the gesture recognition method, the terminal equipment determines a first preset number of wireless channels from the existing wireless channels as radar transmitting channels, determines a second preset number of wireless channels as radar receiving channels, constructs a radar sensor in a mode of multiplexing the existing wireless channels in the terminal equipment, does not need to add a new radar sensor in the terminal equipment, does not cause extra layout wiring burden on the radio frequency front end of the terminal equipment, does not increase hardware cost, power consumption and size of the terminal equipment, and solves the problems that the layout radar sensor in the terminal equipment can bring larger layout wiring burden on the radio frequency front end of the terminal equipment and increases the hardware cost, power consumption and size of the terminal equipment when the radar is used for gesture recognition at present.

Description

Gesture recognition method, gesture recognition device, terminal equipment and computer storage medium

Technical Field

The application belongs to the technical field of wireless technology, and particularly relates to a gesture recognition method, a gesture recognition device, terminal equipment and a computer storage medium.

Background

Gesture recognition refers to the entire process of a terminal device tracking human gestures, recognizing their meaning, and converting into semantically meaningful commands. In the present terminal device, gesture content can be captured by a contact sensor or a contactless sensor.

Radar is a non-contact sensor that senses at a distance from a sensing target, where the sensing is non-contact and is always more comfortable and more convenient for sensing the target than the sensing against the skin surface.

However, various types of terminal devices are currently being developed in the direction of light weight and miniaturization, and the content space of the terminal devices is limited. If radar sensors are added in the narrow and crowded space of the terminal equipment to realize the gesture recognition function, a larger layout and wiring burden is brought to the radio frequency front end of the terminal equipment, and the hardware cost, the power consumption and the volume of the terminal equipment are increased.

Disclosure of Invention

The embodiment of the application provides a gesture recognition method, a gesture recognition device, terminal equipment and a computer storage medium, which can solve the problems that when the radar is used for gesture recognition at present, a layout radar sensor in the terminal equipment can bring a larger layout wiring burden to the radio frequency front end of the terminal equipment, and the hardware cost, the power consumption and the volume of the terminal equipment are increased.

A first aspect of an embodiment of the present application provides a gesture recognition method, including:

when a gesture recognition instruction is detected, determining a first preset number of wireless channels as radar transmitting channels, and determining a second preset number of wireless channels as radar receiving channels, wherein the wireless channels comprise at least one of Bluetooth wireless channels, wifi wireless channels and licensed band auxiliary access wireless channels, and the radar transmitting channels and the radar receiving channels are wireless channels with the same working frequency band;

a gesture recognition operation is performed over the radar transmit path and the radar receive path for a first period of time, and a wireless communication operation is performed over at least one of the radar transmit path and the radar receive path for a second period of time.

It should be noted that, a plurality of wireless paths are usually provided on the terminal device, where the wireless paths may include one or more of a bluetooth wireless path, a wifi wireless path, and a licensed band assisted access wireless path,

when constructing the radar sensor system, the terminal device may determine a first preset number of wireless channels from the existing wireless channels as radar transmitting channels, determine a second preset number of wireless channels as radar receiving channels, and multiplex the wireless channels in the terminal device to construct the radar sensor system without adding a new radar sensor. The radar transmit path and the radar receive path should be wireless paths having the same operating frequency band.

Because the terminal equipment constructs the radar sensor system by multiplexing the existing wireless channels of the terminal equipment, the radar transmitting channel and the radar receiving channel can execute gesture recognition operation in the first time period and execute wireless communication operation in the second time period, so that the gesture recognition function can be realized, and the wireless communication function of the terminal equipment is not influenced.

The radar sensor system is built in a mode of multiplexing the existing wireless channel of the terminal equipment, extra layout and wiring burden is not caused to the radio frequency front end of the terminal equipment, any hardware cost is not increased, and the power consumption and the size of the terminal equipment are not affected.

In a possible implementation manner of the first aspect, the performing, during the first period, a gesture recognition operation through the radar transmitting path and the radar receiving path includes:

executing radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data;

and carrying out gesture recognition processing on the radar scanning data to obtain a gesture recognition result.

When the terminal device performs gesture recognition operation through the radar transmitting path and the radar receiving path, the terminal device performs radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data.

And then the terminal equipment performs gesture recognition processing on the radar scanning data to obtain a gesture recognition result. The algorithm of the gesture recognition process can be selected according to actual conditions. For example, in a single-input multiple-output architecture radar sensor system, gesture recognition using phase linear demodulation techniques may be selected.

In a possible implementation manner of the first aspect, the performing, in the second period of time, a wireless communication operation through at least one wireless path of the radar transmitting path and the radar receiving path includes:

and in the second time period, executing Bluetooth communication operation or wifi communication operation or permission band auxiliary access operation corresponding to at least one wireless access channel through the radar transmitting access channel and at least one wireless access channel in the radar receiving access channel.

The terminal device may perform a wireless communication operation corresponding to a path type of the wireless path through the wireless path.

For example, when the above-mentioned wireless path is a bluetooth wireless path, the terminal device may perform a bluetooth communication operation through the bluetooth wireless path; when the wireless access is a wifi wireless access, the terminal equipment can execute wifi communication operation through the wifi wireless access; when the radio path is a licensed band assisted access radio path, the terminal device may perform a licensed band assisted access operation through the licensed band assisted access radio path.

In a possible implementation manner of the first aspect, the determining the first preset number of radio paths as radar transmitting paths and the determining the second preset number of radio paths as radar receiving paths includes:

acquiring the working frequency range of each wireless channel;

and taking the wireless paths which have the same working frequency range and are not invoked as target wireless paths, determining a first preset number of target wireless paths from the target wireless paths as radar transmitting paths, and determining a second preset number of target wireless paths from the target wireless paths as radar receiving paths.

When the terminal device selects the radar transmitting path and the radar receiving path, the wireless path which is not called can be selected as the radar transmitting path or the radar receiving path, so that the influence of multiplexing the wireless path on the wireless communication function of the terminal device is reduced.

In another possible implementation manner of the first aspect, the determining the first preset number of radio paths as radar transmitting paths and the determining the second preset number of radio paths as radar receiving paths includes:

obtaining access performance parameters of each wireless access;

According to the path performance parameters of the wireless paths, determining a third preset number of wireless paths with the optimal path performance parameters and the same working frequency band as target wireless paths;

and determining a first preset number of target wireless channels from the target wireless channels as radar transmitting channels, and determining a second preset number of target wireless channels from the target wireless channels as radar receiving channels.

It should be noted that, when the terminal device selects the radar transmitting path and the radar receiving path, a wireless path with a better path performance parameter may be selected as the radar transmitting path or the radar receiving path, so as to improve accuracy of the gesture recognition result.

In a possible implementation manner of the first aspect, the performing, in a first period of time, a gesture recognition operation through the radar transmitting path and the radar receiving path, and performing, in a second period of time, a wireless communication operation through at least one wireless path of the radar transmitting path and the radar receiving path, includes:

acquiring a radar scanning period and a scanning time period in the radar scanning period;

in a scanning period in each of the radar scanning periods, a gesture recognition operation is performed through the radar transmitting path and the radar receiving path, and in a non-scanning period in each of the radar scanning periods, a wireless communication operation is performed through at least one of the radar transmitting path and the radar receiving path.

In order to reduce the influence of the multiplexed wireless path on the wireless communication function of the terminal device, a radar scan period may be set.

A scanning period and a non-scanning period are set in the radar scanning period. In the scanning period of the radar scanning period, the terminal device can perform gesture recognition operation through the radar transmitting path and the radar receiving path. During the non-scanning period of the radar scanning period, the terminal device may perform a wireless communication operation through at least one of the radar transmitting path and the radar receiving path.

Since the gesture motion is a motion with a low frequency, when gesture recognition is performed, the radar scanning frequency can be generally less than 10Hz, that is, the radar scanning period is generally greater than 100 milliseconds, and each radar scanning takes several microseconds, so that the scanning period occupies a very small proportion of the radar scanning period, and the influence of multiplexing the wireless channels in the wireless communication module by the time division multiplexing manner on the wireless communication function of the wireless communication module is very small.

In a possible implementation manner of the first aspect, the performing, in the first period, a radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data includes:

And in the first time period, controlling the radar transmitting path to transmit electromagnetic signals, controlling the radar receiving path to receive echo signals, and performing analog-to-digital conversion processing on the echo signals to obtain radar scanning data, wherein the echo signals are signals reflected by the electromagnetic signals after contacting an object.

When the terminal device performs gesture recognition operation through the radar transmitting path and the radar receiving path, the terminal device may control the radar transmitting path to transmit electromagnetic signals and control the radar receiving path to receive echo signals.

The echo signals are signals emitted by the electromagnetic signals after the electromagnetic signals contact with the object, and the echo signals are subjected to analog-to-digital conversion processing, so that radar scanning data can be obtained.

In a possible implementation manner of the first aspect, the controlling the radar transmission path to transmit the electromagnetic signal includes:

and controlling the radar transmitting path to transmit a single-frequency continuous wave signal.

When the terminal equipment controls the radar transmitting channel to transmit electromagnetic signals, the terminal equipment can control the radar transmitting channel to transmit single-frequency continuous wave signals.

When the electromagnetic signal transmitted by the radar transmitting channel is a single-frequency continuous wave signal, the radar sensor system constructed by the radar transmitting channel and the radar receiving channel belongs to an ultra-narrow band radar system.

The ultra-narrow band radar system can reduce interference of electromagnetic signals and echo signals to other frequency spectrums in a communication frequency band. Although the echo signal corresponding to the single-frequency continuous wave signal has a certain bandwidth, the bandwidth of the echo signal is in the Hertz magnitude, the influence on the communication frequency band is very small, and compared with other types of radars, the ultra-narrow band radar system can better coexist with a wireless communication module in the terminal equipment.

A second aspect of embodiments of the present application provides another gesture recognition method, including:

when a gesture recognition instruction is detected, determining a first preset number of wireless channels as radar transmitting channels, and determining a second preset number of wireless channels as radar receiving channels, wherein the radar transmitting channels and the radar receiving channels are wireless channels with the same working frequency band;

executing radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data;

In a possible implementation manner of the second aspect, the determining the first preset number of radio paths as radar transmitting paths and the determining the second preset number of radio paths as radar receiving paths includes:

Acquiring the working frequency range of each wireless channel;

In another possible implementation manner of the second aspect, the determining the first preset number of radio paths as radar transmitting paths and the determining the second preset number of radio paths as radar receiving paths includes:

obtaining access performance parameters of each wireless access;

In a possible implementation manner of the second aspect, the performing a radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data includes:

and in the scanning time period in each radar scanning period, radar scanning operation is carried out through the radar transmitting path and the radar receiving path, and radar scanning data are obtained.

controlling the radar transmitting path to transmit electromagnetic signals;

and controlling the radar receiving passage to receive echo signals, and performing analog-to-digital conversion processing on the echo signals to obtain radar scanning data, wherein the echo signals are signals reflected by the electromagnetic signals after the electromagnetic signals contact an object.

In a possible implementation manner of the second aspect, the controlling the radar transmission path to transmit the electromagnetic signal includes:

In one possible implementation manner of the second aspect, the wireless path includes one or more of a bluetooth wireless path, a wifi wireless path, and a licensed band assisted access wireless path.

A third aspect of the embodiments of the present application provides a gesture recognition apparatus, including:

the access selection module is used for determining a first preset number of wireless accesses as radar transmitting accesses and a second preset number of wireless accesses as radar receiving accesses when the gesture recognition instruction is detected, wherein the wireless accesses comprise at least one of Bluetooth wireless accesses, wifi wireless accesses and licensed band auxiliary access wireless accesses, and the radar transmitting accesses and the radar receiving accesses are wireless accesses with the same working frequency band;

and the path multiplexing module is used for executing gesture recognition operation through the radar transmitting path and the radar receiving path in a first time period and executing wireless communication operation through at least one wireless path in the radar transmitting path and the radar receiving path in a second time period.

In a possible implementation manner of the third aspect, the path multiplexing module includes:

the radar scanning sub-module is used for executing radar scanning operation through the radar transmitting path and the radar receiving path in the first time period to obtain radar scanning data;

and the gesture recognition sub-module is used for carrying out gesture recognition processing on the radar scanning data to obtain a gesture recognition result.

and the wireless communication sub-module is used for executing Bluetooth communication operation or wifi communication operation or permission band auxiliary access operation corresponding to at least one path of wireless access through the radar transmitting access and the radar receiving access in the second time period.

In a possible implementation manner of the third aspect, the path selection module includes:

the frequency band inquiry sub-module is used for acquiring the working frequency band of each wireless channel;

and the call screening sub-module is used for taking the wireless paths which have the same working frequency band and are not called as target wireless paths, determining a first preset number of target wireless paths from the target wireless paths as radar transmitting paths, and determining a second preset number of target wireless paths from the target wireless paths as radar receiving paths.

In another possible implementation manner of the third aspect, the path selection module includes:

a performance parameter sub-module, configured to obtain a path performance parameter of each wireless path;

the performance screening sub-module is used for determining a third preset number of wireless channels with the same working frequency band and optimal channel performance parameters as target wireless channels according to the channel performance parameters of the wireless channels;

And the target screening sub-module is used for determining a first preset number of target wireless channels from the target wireless channels as radar transmitting channels and determining a second preset number of target wireless channels from the target wireless channels as radar receiving channels.

the scanning parameter sub-module is used for acquiring a radar scanning period and a scanning time period in the radar scanning period;

an intermittent scanning sub-module for performing a gesture recognition operation through the radar transmitting path and the radar receiving path in a scanning period in each of the radar scanning periods, and performing a wireless communication operation through at least one wireless path of the radar transmitting path and the radar receiving path in a non-scanning period in each of the radar scanning periods.

In a possible implementation manner of the third aspect, the radar scanning submodule is specifically configured to control the radar transmitting path to transmit an electromagnetic signal in the first time period, control the radar receiving path to receive an echo signal, and perform analog-to-digital conversion processing on the echo signal to obtain radar scanning data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.

In a possible implementation manner of the third aspect, the radar scanning sub-module includes:

and the single-frequency signal submodule is used for controlling the radar transmitting path to transmit a single-frequency continuous wave signal.

A fourth aspect of the embodiments of the present application provides another gesture recognition apparatus, including:

the path selection module is used for determining a first preset number of wireless paths as radar transmitting paths and a second preset number of wireless paths as radar receiving paths when the gesture recognition instruction is detected, wherein the radar transmitting paths and the radar receiving paths are wireless paths with the same working frequency band;

the radar scanning module is used for executing radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data;

and the gesture recognition module is used for carrying out gesture recognition processing on the radar scanning data to obtain a gesture recognition result.

In a possible implementation manner of the fourth aspect, the path selection module includes:

In another possible implementation manner of the fourth aspect, the path selection module includes:

In a possible implementation manner of the fourth aspect, the radar scanning module includes:

and the intermittent scanning sub-module is used for executing radar scanning operation through the radar transmitting path and the radar receiving path in the scanning time period in each radar scanning period to obtain radar scanning data.

The signal transmitting sub-module is used for controlling the radar transmitting path to transmit electromagnetic signals;

the signal receiving sub-module is used for controlling the radar receiving passage to receive echo signals and carrying out analog-to-digital conversion processing on the echo signals to obtain radar scanning data, wherein the echo signals are signals reflected by the electromagnetic signals after the electromagnetic signals contact an object.

In a possible implementation manner of the fourth aspect, the signal transmitting sub-module is specifically configured to control the radar transmitting path to transmit a single-frequency continuous wave signal.

In a possible implementation manner of the fourth aspect, the wireless path includes one or more of a bluetooth wireless path, a wifi wireless path, and a licensed band assisted access wireless path.

A fifth aspect of the embodiments of the present application provides a terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, which when executed by the processor causes the terminal device to implement the steps of the method as described above.

A sixth aspect of the embodiments of the present application provides a computer readable storage medium storing a computer program which, when executed by a processor, causes a terminal device to implement the steps of the method as described above.

A seventh aspect of the embodiments of the present application provides a computer program product for causing a terminal device to carry out the steps of the method as described above when the computer program product is run on the terminal device.

Compared with the prior art, the embodiment of the application has the beneficial effects that:

in the gesture recognition method, the terminal equipment can determine the first preset number of wireless channels from the existing wireless channels as radar transmitting channels, and determine the second preset number of wireless channels as radar receiving channels, so that a radar sensor system is built by multiplexing the wireless channels in the terminal equipment under the condition that a new radar sensor is not added, no extra layout and wiring burden is caused on the radio frequency front end of the terminal equipment, no hardware cost is increased, the power consumption and the size of the terminal equipment are not influenced, and the problems that the layout radar sensor in the terminal equipment brings larger layout and wiring burden to the radio frequency front end of the terminal equipment and increases the hardware cost, the power consumption and the size of the terminal equipment when the radar is used for gesture recognition at present are solved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following description will briefly introduce the drawings that are needed in the embodiments or the description of the prior art, it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic flow chart of a gesture recognition method according to an embodiment of the present application;

fig. 2 is a schematic diagram of an application scenario provided in an embodiment of the present application;

fig. 3 is a schematic diagram of another application scenario provided in an embodiment of the present application;

fig. 4 is a schematic diagram of another application scenario provided in an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a gesture recognition apparatus according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram of a terminal device provided in an embodiment of the present application;

fig. 7 is a schematic diagram of a wireless transmission path according to an embodiment of the present application;

fig. 8 is a schematic diagram of another wireless transmit path provided in an embodiment of the present application;

fig. 9 is a schematic diagram of a wireless receiving path according to an embodiment of the present application;

fig. 10 is a schematic diagram of another wireless receiving path provided in an embodiment of the present application;

fig. 11 is a schematic diagram of a wireless transceiver reciprocal path according to an embodiment of the present application;

FIG. 12 is a schematic diagram of another wireless transmit-receive reciprocal path provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of another wireless transmit-receive reciprocal path provided by an embodiment of the present application;

FIG. 14 is a schematic diagram of a single input multiple output architecture radar sensor system provided in an embodiment of the present application;

FIG. 15 is a schematic diagram of a radar sensor system of a multiple-input single-output architecture provided in an embodiment of the present application;

fig. 16 is a schematic diagram of a radar sensor system with a mimo architecture according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.

As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".

In addition, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance.

Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.

The gesture recognition method provided by the embodiment of the application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (augmented reality, AR)/Virtual Reality (VR) devices, notebook computers, ultra-mobile personal computer (UMPC), netbooks, personal digital assistants (personal digital assistant, PDA) and the like, and the specific types of the terminal devices are not limited.

For example, the terminal device may be a Station (ST) in a WLAN, a cellular telephone, a cordless telephone, a Session initiation protocol (Session InitiationProtocol, SIP) telephone, a wireless local loop (Wireless Local Loop, WLL) station, a personal digital assistant (Personal Digital Assistant, PDA) device, a handheld device with wireless communication capabilities, a computing device or other processing device connected to a wireless modem, an in-vehicle device, a car networking terminal, a computer, a laptop computer, a handheld communication device, a handheld computing device, a satellite radio, a wireless modem card, a television Set Top Box (STB), a customer premise equipment (customer premise equipment, CPE) and/or other devices for communicating over a wireless system and next generation communication modules, such as a mobile terminal in a 5G network or a mobile terminal in a future evolved public land mobile network (Public Land Mobile Network, PLMN) network, etc.

By way of example, but not limitation, when the terminal device is a wearable device, the wearable device may also be a generic name for applying wearable technology to intelligently design daily wear, developing wearable devices, such as glasses, gloves, watches, apparel, shoes, and the like. The wearable device is a portable device that is worn directly on the body or integrated into the clothing or accessories of the user. The wearable device is not only a hardware device, but also can realize a powerful function through software support, data interaction and cloud interaction. The generalized wearable intelligent device comprises full functions, large size, and complete or partial functions which can be realized independent of a smart phone, such as a smart watch or a smart glasses, and is only focused on certain application functions, and needs to be matched with other devices such as the smart phone for use, such as various smart bracelets, smart jewelry and the like for physical sign monitoring.

In the radar field, the doppler effect reflects interactions between electromagnetic waves and moving objects. When there is relative motion between the observer and the wave source, there is a difference in the frequency of the electromagnetic wave received by the observer and the frequency of the electromagnetic wave emitted by the wave source. Based on this principle, radar and sonar systems are widely used to measure speed information of a target.

In the past decades, radar sensor systems have attracted more and more attention as consumer radars have been miniaturized and reduced in cost, and are used in a wide variety of fields. Typical examples of applications include: mechanical vibration measurement, vital signal monitoring, partition wall signal detection, gesture recognition, and low-speed application measurement. Also, with the development of semiconductor technology, radar sensor systems based on radio frequency integrated chips are also finding great popularity in the academic and industrial fields.

Compared with other vital signal measuring sensors, the radar sensor has the characteristics of comfort and convenience when being applied to gesture recognition technology. The radar sensor senses under the condition of a certain distance from a sensing target, and for the sensing target, the non-contact sensing is always more comfortable and convenient than the sensing mode of clinging to the skin surface.

Among the current schemes for gesture recognition using radar sensors, some schemes use millimeter wave radar for gesture motion detection, some schemes use frequency modulated continuous wave (Frequency Modulated Continuous Wave, FMCW) type radar for gesture monitoring, and some schemes use single input multiple output (Single Input Multiple Output, SIMO) architecture radar sensor systems for gesture tracking. However, in either scheme, a new radar sensor system needs to be additionally added to the terminal device, and a new radar chip, an adaptive circuit, a radar antenna and a corresponding power supply and baseband system need to be added to a narrow and crowded space of the terminal device, which can bring a larger burden of layout and wiring to the radio frequency front end of the terminal device, increase the hardware cost, power consumption and volume of the terminal device, and even possibly affect the performance of the terminal device.

In view of this, the embodiment of the present application provides a gesture recognition method, where a terminal device may determine, from existing wireless channels, a first preset number of wireless channels as radar transmitting channels, and determine, as radar receiving channels, a second preset number of wireless channels, where, without adding a new radar sensor, the wireless channels of the terminal device are multiplexed to construct a radar sensor, so that no additional burden of layout and wiring is caused to a radio frequency front end of the terminal device, no hardware cost is added, and power consumption and volume of the terminal device are not affected.

Next, a gesture recognition method provided by the present embodiment will be described from the point of view of the terminal device. Referring to fig. 1, a flowchart of a gesture recognition method is shown, which includes:

s101, when a gesture recognition instruction is detected, determining a first preset number of wireless channels as radar transmitting channels, and determining a second preset number of wireless channels as radar receiving channels, wherein the wireless channels comprise at least one of Bluetooth wireless channels, wifi wireless channels and licensed band auxiliary access wireless channels, and the radar transmitting channels and the radar receiving channels are wireless channels with the same working frequency band;

A triggering condition for triggering the gesture recognition instruction may be set on the terminal device, and when the user wants to enable the gesture recognition function, the terminal device may be operated to trigger the gesture recognition instruction.

The triggering condition for triggering the gesture recognition instruction can be set according to the actual situation. In some embodiments, a physical key or a virtual key that triggers gesture recognition, etc. may be provided on the terminal device. When the user presses the physical key or clicks the virtual key, a gesture recognition instruction may be triggered.

For example, as shown in fig. 2, the terminal device 2 includes an entity key 201 and an entity key 202, the entity key 201 is a volume key, and the entity key 202 is a power key. In order to avoid traffic accidents during driving of a vehicle, it is often inconvenient for a user to operate the terminal device. Therefore, assuming that the association relationship between the volume key 201 and the gesture recognition function is set in the terminal device 2, the user may press the first side and the second side of the volume key with two fingers simultaneously before the vehicle runs, trigger the gesture recognition instruction, and enable the gesture operation function, so that the user can issue a corresponding instruction to the terminal device through the gesture in the running process.

Alternatively, as shown in fig. 3, in the system setting interface of the terminal device, a virtual key 203 for enabling and disabling the gesture recognition function is provided. The user can click the virtual key 203 of the gesture recognition function on the terminal device before the vehicle runs, trigger a gesture recognition instruction, and enable the gesture operation function so that the user can give a corresponding instruction to the terminal device through gestures in the running process.

In other embodiments, the user may set an association between some applications and gesture recognition instructions on the terminal device, and when the user starts these specific applications, the gesture recognition instructions are automatically triggered.

For example, many users currently prefer route navigation using map navigation software on a terminal device while driving a vehicle. Thus, the user can set the association relationship of the map navigation software and the gesture recognition instruction. As shown in fig. 4, when the user is before driving, the "map" may be searched on the terminal device, and the terminal device displays the search results including the a navigation map 204 and the B navigation map 205. The user clicks the A navigation map 204, enables the A navigation map software, automatically triggers gesture recognition instructions when the A navigation map software is started, and enables gesture operation functions so that the user can give corresponding instructions to the terminal equipment through gestures in the driving process.

There are numerous wireless communication modules in the terminal device, such as Bluetooth (BT) communication modules, wifi communication modules, licensed-Assisted Access (LAA) modules, etc.

The wireless communication modules have one or more wireless paths, and the types of the wireless paths correspond to the types of the wireless communication modules. For example, one or more bluetooth wireless channels may be included in the bluetooth communication module; one or more wifi wireless channels may be included in the wifi communication module; one or more LAA wireless pathways may be included in the LAA communication module.

The working frequency band of the LAA wireless access is 5150MHz to 5925MHz, and the working frequency band of the wifi wireless access working in the 5GHz frequency band is 5150MHz to 5850MHz, so that the LAA wireless access and the wifi wireless access working in the 5GHz frequency band have the same working frequency band, namely 5150MHz to 5850 MHz. The working frequency band of the Bluetooth wireless access is 2401MHz to 2479MHz, and the working frequency band of the wifi wireless access working in the 2.4GHz frequency band is 2400MHz to 2483.5MHz, so the Bluetooth wireless access and the wifi wireless access working in the 2.4GHz frequency band have the same working frequency band, namely 2401MHz to 2479 MHz.

When the terminal device detects the gesture recognition instruction, the terminal device can select a first preset number of wireless channels from the wireless channels of the wireless communication modules as radar transmitting channels and select a second preset wireless channel as radar receiving channels, so that the wireless channels of the existing wireless communication modules of the terminal device are multiplexed to construct a radar sensor system under the condition that a radar sensor is not additionally arranged.

The first preset number and the second preset number can be set according to actual requirements. For example, the first preset number may be set to 1, the second preset number may be set to 3, the terminal device selects 1 wireless path as a radar transmitting path, selects 3 wireless paths as radar receiving paths, and constructs a radar sensor system of a SIMO architecture with one transmitter and three receivers. Or, the first preset number may be set to 3, the second preset number is set to 3, the terminal device selects 3 wireless paths as radar transmitting paths, selects 3 wireless paths as radar receiving paths, and constructs a three-transmission three-reception multi-input multi-output (Multiple Input Multiple Output, MIMO) architecture radar sensor system; alternatively, the first preset number may be set to 3, the second preset number is set to 1, the terminal device selects 3 wireless paths as radar transmitting paths, selects 1 wireless path as radar receiving path, and constructs a three-transmission one-reception multi-input single-output (Multiple Input Single Output, MISO) architecture radar sensor system.

When the radar sensor system constructed by the radar transmitting path and the radar receiving path is a radar sensor system of a SIMO architecture, the phase linear demodulation technology can be used for gesture recognition, the calculated amount is small, complex training is not required to be carried out by using complex models such as a convolutional neural network, and the terminal equipment can use a classifier with a simpler structure to distinguish the types of echo signals. When the radar sensor system constructed by the radar transmitting path and the radar receiving path is a radar sensor system of a MIMO architecture, gesture recognition cannot be performed by using a phase linear demodulation technology, and the calculated amount of gesture recognition is large, however, echo signals received by the radar sensor system of the MIMO architecture are superposition of a plurality of echo signals, and the plurality of echo signals can provide a basis for pattern recognition for non-point sources, distributed and complex motions.

It will be appreciated that in determining the radar transmit path and the radar receive path, the radar transmit path and the radar receive path should be wireless paths having the same operating frequency band, otherwise the radar sensor system cannot be built. For example, when the radar transmitting path selects the LAA wireless path operating in the 5GHz band, the radar receiving path should not select the bluetooth wireless path operating in the 2.4GHz band, but should select the wireless path operating in the 5GHz band as the radar receiving path, otherwise the radar transmitting path and the radar receiving path cannot construct the radar sensor system.

In addition, when the first preset number is greater than or equal to 2, each radio path in the radar transmitting paths may be the same type of radio path, or may be different types of radio paths. For example, assuming that the first preset number is set to 2, the terminal device needs to select 2 radio paths as radar transmission paths, and the 2 radio paths may be all LAA radio paths, or the 2 radio paths may include one LAA radio path and one wifi radio path.

When the second preset number is greater than or equal to 2, each radio path in the radar receiving paths may be the same type of radio path, or may be different types of radio paths. For example, assuming that the second preset number is set to 2, the terminal device needs to select 2 radio paths as radar receiving paths, and the 2 radio paths may be all LAA radio paths, or the 2 radio paths may include one LAA radio path and one wifi radio path.

The radar transmitting path and the radar receiving path may be the same type of wireless path or different types of wireless path. For example, assuming that the terminal device selects 1 LAA radio path as the radar transmitting path, the terminal device may select the LAA radio path as the radar receiving path, where the radar transmitting path and the radar receiving path are the same type of radio path; alternatively, the terminal device may also select other radio paths as radar receiving paths, for example, the terminal device may select wifi radio paths as radar receiving paths, where the radar transmitting paths and the radar receiving paths are different types of radio paths.

The selection modes of the radar transmitting path and the radar receiving path can be set according to actual conditions.

In some possible implementations, the terminal device may acquire the operating frequency band of each radio path, and take, as the target radio path, a radio path that has the same operating frequency band and is not invoked. Then, the terminal device determines a first preset number of target wireless paths from among the target wireless paths as radar transmitting paths, and determines a second preset number of wireless paths as radar receiving paths.

For example, if the terminal device detects that 6 radio paths are not invoked currently, wherein 5 radio paths operate in the 2.4GHz band and 1 radio path operates in the 5GHz band, the terminal device may use 5 radio paths that operate in the 2.4GHz band and are not invoked as target radio paths. Assuming that the first preset number is 1 and the second preset number is 3, the terminal device selects 1 wireless path from the 5 target wireless paths as a radar transmitting path and selects 3 wireless paths as radar receiving paths.

At this time, if the number of the wireless channels which are not invoked and correspond to a certain working frequency band is greater than or equal to the sum of the first preset number and the second preset number, the terminal device may select a radar transmitting channel and a radar receiving channel from the target wireless channels which correspond to the working frequency band. If the number of the non-invoked wireless channels corresponding to each working frequency band is smaller than the sum of the first preset number and the second preset number, the terminal equipment can temporarily select no radar transmitting channel or no radar receiving channel, and select the radar transmitting channel or the radar receiving channel when the number of the non-invoked wireless channels corresponding to a certain working frequency band is larger than or equal to the sum of the first preset number and the second preset number.

By the method, the terminal equipment can select the wireless access which is not called as the radar transmitting access and the radar receiving access, and can multiplex the wireless access in an idle state to construct a radar sensor system without influencing the wireless communication function of each wireless communication module.

In other possible implementations, the terminal device may also obtain the path performance parameters of the respective radio paths. The content of the channel performance parameter can be set according to the actual situation. For example, the path performance parameters may include one or more of quality of service identification (Quality of Service, qoS), number of antennas, and power.

The terminal device can evaluate the channel state of each wireless channel through the channel performance parameters, and select a third preset number of wireless channels with the optimal channel performance parameters and the same working frequency band as target wireless channels.

The third preset number should be greater than or equal to the sum of the first preset number and the second preset number. After selecting the target radio paths, the terminal device determines a first preset number of target radio paths from the target radio paths as radar transmitting paths, and determines a second preset number of radio paths as radar receiving paths.

For example, assuming that the radio paths operating in the 5GHz band are preferentially selected as the radar transmitting paths and the radar receiving paths, the first preset number is 1, the second preset number is 2, and the third preset number is 4, the terminal device may obtain the path performance parameters of the radio paths operating in the 5GHz band, and select 4 radio paths with the optimal path performance parameters as the target radio paths. And then selecting 1 item of target wireless path from the 4 items of target wireless paths as radar transmitting path, and selecting 2 item of target wireless path as radar receiving path.

In other possible implementations, the terminal device may also prioritize the wireless path that is not invoked as a radar transmit path or a radar receive path. If the non-invoked wireless channels corresponding to each working frequency band are smaller than the sum of the first preset number and the second preset number, the terminal equipment can acquire the channel performance parameters of each wireless channel, and selects the wireless channel with the optimal channel performance parameters of the third preset number and the same working frequency band as the target wireless channel.

In other possible implementations, the terminal device may also determine, by means of random selection, a first predetermined number of radar transmission paths from among the radio paths having the same operating frequency band, and a second predetermined number of radar reception paths.

It will be appreciated that the above manner of determining the radar transmit path and the radar receive path is merely illustrative of the present embodiment, which is not limited to the manner in which the radar transmit path and the radar receive path are determined. In the practical application process, the terminal device may determine the radar transmitting path and the radar receiving path in the above manner, or the terminal device may determine the radar transmitting path and the radar receiving path in other manners.

S102, performing gesture recognition operation through the radar transmitting path and the radar receiving path in a first time period, and performing wireless communication operation through at least one wireless path in the radar transmitting path and the radar receiving path in a second time period.

After the terminal device selects the radar transmitting path and the radar receiving path, gesture recognition operation can be performed through the radar transmitting path and the radar receiving path in a first time period, and wireless communication operation can be performed through at least one wireless path in the radar transmitting path and the radar receiving path in a second time period.

The type of wireless communication operation corresponds to the path type of the wireless path. For example, when the wireless path is a bluetooth wireless path, the wireless communication operation performed by the wireless path is a bluetooth communication operation; when the wireless access is a wifi wireless access, the wireless communication operation executed by the wireless access is a wifi communication operation; when the radio path is a licensed band assisted access radio path, the radio communication operation performed by the radio path is a licensed band assisted access operation.

The first time period and the second time period may be preset time periods or non-preset time periods.

Gesture motion is a relatively low frequency motion and, when performing gesture recognition, the radar scan frequency may typically be less than 10Hz, i.e., the radar scan period is typically greater than 100 milliseconds, with each radar scan taking several microseconds. Thus, in one possible implementation, after the radar transmitting path and the radar receiving path are selected, the terminal device may acquire radar scanning periods, each of which may be divided into a scanning period and a non-scanning period, and control the radar transmitting path and the radar receiving path to perform gesture recognition operation and wireless communication operation in a time division multiplexing manner. At this time, the first period and the second period are preset periods, the first period is a scanning period of each radar scanning period, and the second period is a non-scanning period of each radar scanning period.

In the scanning period of each radar scanning period, the terminal device may perform a gesture recognition operation in the scanning period through the radar transmitting path and the radar receiving path. During the non-scanning period of each radar scanning period, the terminal device may perform a corresponding wireless communication operation through at least one of the radar transmitting path and the radar receiving path.

For example, assuming that a bluetooth wireless path is selected as a radar transmitting path and a wifi wireless path is selected as a radar receiving path, in a scanning period of a radar scanning period, the terminal device may perform a radar scanning operation through the bluetooth wireless path and the wifi wireless path; in the non-scanning time period of the radar scanning period, the terminal device can execute Bluetooth communication operation through a Bluetooth wireless channel and/or wifi communication operation through a wifi wireless channel.

At this time, the terminal device can perform gesture recognition operation not only by using the radio path of the existing radio communication module, but also because the scanning period occupies a very small proportion of the radar scanning period, multiplexing the radio path in the radio communication module by means of time division multiplexing has a very small influence on the radio communication function of the radio communication module.

It will be appreciated that the radio paths in the radar transmit path and the radar receive path perform different operations in the scan period and the non-scan period of the radar scan period to implement different functions, and therefore the processor in the terminal device may periodically generate a trigger signal for controlling the radio path switching function through the coexistence mechanism between the respective radio communication modules.

When there are a plurality of processors in the terminal device, in order to ensure that the timings of the respective radio paths are the same, a trigger signal controlling the respective radio path switching functions should be generated by the same processor. After the processor generates the trigger signal, the trigger signal is sent to other processors, so that the processors orderly control each wireless channel to switch different functions under the control of a coexistence mechanism.

For example, assume that the radar transmit path and the radar receive path include a bluetooth wireless path and a wifi wireless path, the bluetooth communication module includes a bluetooth baseband chip, and the wifi communication module includes a wifi baseband chip. At this time, the trigger signals for controlling the respective wireless channels to perform function switching should be all generated by the bluetooth baseband chip; or, the trigger signals for controlling the wireless channels to switch functions should be all generated by the wifi baseband chip; alternatively, the trigger signal controlling the switching of the functions of the individual radio paths should all be generated by some other processor. After one processor generates a trigger signal for controlling the wireless access switching function, the trigger signal is transmitted to other processors in an interrupt transmission mode and the like, and each processor controls the corresponding wireless access to switch the function according to the trigger signal, so that a plurality of processors orderly control each wireless access to switch different functions under the control of a coexistence mechanism.

In another possible implementation, the terminal device may not set the radar scan period. As described above, the terminal device may select a radio path having the same operating frequency band from among the radio paths that have not been invoked as the target radio path, and select a radar transmitting path and a radar receiving path from among the target radio paths.

At this time, the first period and the second period are non-preset periods, the first period refers to a period in which the wireless access is called as a radar transmitting access or a radar receiving access, and the second period refers to a period in which the wireless access is called to perform a wireless communication operation.

In the process of executing gesture recognition operation, the terminal device can execute radar scanning operation through the radar transmitting path and the radar receiving path to obtain radar scanning data. Then, the terminal equipment performs gesture recognition processing on the radar scanning data to obtain a gesture recognition result.

When performing a radar scanning operation, the terminal device may transmit electromagnetic signals through a radar transmission path. After the electromagnetic signal emitted by the radar emission path contacts the object, the object reflects the echo signal.

The terminal equipment can receive the echo signals through the radar receiving channel, and the terminal equipment performs analog-to-digital conversion processing on the echo signals, converts the echo signals from analog signals to digital signals, and obtains radar scanning data. And then, the terminal equipment performs gesture recognition processing on the radar scanning data to obtain a gesture recognition result.

The type of electromagnetic signal emitted by the radar emission path can be set according to practical situations. For example, the electromagnetic signal transmitted by the radar transmit path may be a pulse signal, a frequency modulated continuous wave signal, a single frequency continuous wave signal, or the like.

When the type of electromagnetic signals transmitted by the radar transmitting path is single-frequency continuous wave signals, the radar sensor system constructed by the radar transmitting path and the radar receiving path belongs to an ultra-narrow band radar system. The ultra-narrow band radar system can reduce interference of electromagnetic signals and echo signals to other frequency spectrums in a communication frequency band. Although the echo signal corresponding to the single-frequency continuous wave signal has a certain bandwidth, the bandwidth of the echo signal is in the Hertz magnitude, the influence on the communication frequency band is very small, and compared with other types of radars, the ultra-narrow band radar system can better coexist with a wireless communication module in the terminal equipment.

In addition, when two or more terminal devices are closer in distance, signal interference may occur. At this time, each terminal device may perform communication negotiation, and allocate different working frequency bands to different terminal devices. After each terminal device determines respective intermediate frequency signals, each terminal device can filter interference signals outside the working frequency band through an intermediate frequency filter even if signal interference exists between each terminal device, and the aim of coexistence of a plurality of terminal devices is fulfilled through a frequency division multiplexing mode.

In summary, in the gesture recognition method provided in this embodiment, the terminal device may determine, from existing wireless paths, a first preset number of wireless paths as radar transmitting paths, and determine, as radar receiving and communicating paths, a second preset number of wireless paths, where, without adding a new radar sensor, the wireless paths of the terminal device are multiplexed to construct a radar sensor, which does not cause additional burden of layout and wiring to the radio frequency front end of the terminal device, does not increase any cost, does not affect power consumption and volume of the terminal device, and solves the problem that when the radar is currently used for gesture recognition, the layout radar sensor in the terminal device brings a larger burden of layout and wiring to the radio frequency front end of the terminal device, and increases hardware cost, power consumption and volume of the terminal device.

It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way.

Referring to fig. 5, an embodiment of the present application provides a gesture recognition apparatus, for convenience of description, only a portion related to the present application is shown, and as shown in fig. 5, the gesture recognition apparatus includes,

the path selection module 501 is configured to determine, when a gesture recognition instruction is detected, a first preset number of wireless paths as radar transmitting paths, and determine a second preset number of wireless paths as radar receiving paths, where the wireless paths include at least one of a bluetooth wireless path, a wifi wireless path, and a licensed band assisted access wireless path, and the radar transmitting paths and the radar receiving paths are wireless paths with the same working frequency band;

the path multiplexing module 502 is configured to perform a gesture recognition operation through the radar transmitting path and the radar receiving path in a first period of time, and perform a wireless communication operation through at least one wireless path of the radar transmitting path and the radar receiving path in a second period of time.

Further, the path multiplexing module 502 includes:

Further, the path selection module 501 includes:

Further, the path multiplexing module 502 includes:

Further, the radar scanning sub-module is specifically configured to control the radar transmitting path to transmit an electromagnetic signal in the first time period, control the radar receiving path to receive an echo signal, and perform analog-to-digital conversion processing on the echo signal to obtain radar scanning data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.

Further, the radar scanning sub-module includes:

It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein again.

Referring to fig. 6, the embodiment of the application further provides a terminal device. As shown in fig. 6, the terminal device 6 of this embodiment includes: a processor 60, a memory 61, a computer program 62 stored in said memory 61 and executable on said processor 60, and a wireless communication module 63. The processor 60, when executing the computer program 62, implements the steps in the screen expansion method embodiment described above, such as steps S101 to S102 shown in fig. 1. Alternatively, the processor 60, when executing the computer program 62, performs the functions of the modules/units of the apparatus embodiments described above, such as the functions of the modules 501 to 502 shown in fig. 5.

By way of example, the computer program 62 may be partitioned into one or more modules/units that are stored in the memory 61 and executed by the processor 60 to complete the present application. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions for describing the execution of the computer program 62 in the terminal device 6. For example, the computer program 62 may be divided into a path selection module and a path multiplexing module, each of which specifically functions as follows:

The terminal device 6 may be a computing device such as a desktop computer, a notebook computer, a palm computer, a cloud server, etc. The terminal device may include, but is not limited to, a processor 60, a memory 61. It will be appreciated by those skilled in the art that fig. 6 is merely an example of the terminal device 6 and does not constitute a limitation of the terminal device 6, and may include more or less components than illustrated, or may combine certain components, or different components, e.g., the terminal device may further include an input-output device, a network access device, a bus, etc.

The processor 60 may be a central processing unit (Central Processing Unit, CPU), other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or a memory of the terminal device 6. The memory 61 may be an external storage device of the terminal device 6, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the terminal device 6. Further, the memory 61 may also include both an internal storage unit and an external storage device of the terminal device 6. The memory 61 is used for storing the computer program and other programs and data required by the terminal device. The memory 61 may also be used for temporarily storing data that has been output or is to be output.

The wireless communication module 63 may be a wireless communication module such as a bluetooth communication module, a wifi communication module, a licensed band auxiliary access module, etc., and the type of the wireless communication module 63 is not limited in this embodiment. In the above wireless communication module 63, at least one wireless path may be included, and the wireless path may be a wireless transmission path, a wireless reception path, or a wireless transceiver reciprocal path.

As shown in fig. 7, the wireless transmit path may include a transmitter 701 and a transmit antenna 702. After the transmitter 701 generates an electromagnetic signal, the electromagnetic signal is transmitted through the transmitting antenna 702.

The structure of the transmitter 701 may be set according to actual circumstances. For example, as shown in fig. 8, the transmitter 701 may include a Local Oscillator (LO) 7011 and a power amplifier 7012. After receiving the clock signal, the local oscillator 7011 generates an electromagnetic signal from the clock signal, amplifies the electromagnetic signal by the power amplifier 7012, and transmits the amplified electromagnetic signal by the transmitting antenna 702.

As shown in fig. 9, the above-described wireless reception path may include a receiver 901 and a reception antenna 902. After receiving the electromagnetic signal, the receiving antenna 902 performs signal processing by the receiver 901.

The structure of the receiver 901 may be set according to the actual situation. For example, as shown in fig. 10, the receiver 901 may include a low-noise amplifier (low-noise amplifier) 9011, a local oscillator 9012, a phase shifter 9013, a first multiplier 9014, a second multiplier 9015, a first filter 9016, a second filter 9017, a first analog-to-digital converter 9018, and a second analog-to-digital converter 9019.

The receiving antenna 902 receives the electromagnetic signal, and the electromagnetic signal is amplified by the low noise amplifier 9011 and then split into a first amplified signal and a second amplified signal. After receiving the clock signal, the local oscillator 9012 generates a local oscillator signal according to the clock signal and transmits the local oscillator signal to the phase shifter 9013. The phase shifter 9013 processes the local oscillation signal and outputs a first phase shift signal and a second phase shift signal. The first multiplier 9014 mixes the first amplified signal and the first phase-shifted signal to obtain a first mixed signal. The second multiplier 9015 mixes the second amplified signal with the second phase-shifted signal to obtain a second mixed signal. The first mixed signal is subjected to filtering processing by the first filter 9016 and analog-to-digital conversion by the first analog-to-digital converter 9018, and first data is obtained. The second mixed signal is subjected to filtering processing by the second filter 9017 and analog-to-digital conversion by the second analog-to-digital converter 9019, and second data is obtained.

The filter types of the first filter 9016 and the second filter 9017 may be selected according to actual conditions. For example, a band-pass filter, a nyquist filter, or the like may be selected as the first filter 9016 and the second filter 9017.

As shown in fig. 11, the wireless transception-reciprocal path may include a transmitter 1101, a receiver 1102, a duplexer 1103, and a transceiver antenna 1104. As shown in fig. 12, when the duplexer 1103 is in state 1, the above-described wireless transmit-receive reciprocal path may transmit electromagnetic signals through the transmitter 1101, the duplexer 1103, and the transmit-receive antenna 1104.

As shown in fig. 13, when the duplexer 1103 is in state 2, the above-described wireless transmit-receive reciprocal path may receive electromagnetic signals through the transmit-receive antenna 1104, the duplexer 1103, and the receiver 1102.

The type of the diplexer 1103 may be selected according to the actual situation. For example, a device or circuit such as a circulator, an isolator, a switching circuit, or the like may be selected as the duplexer.

It will be appreciated that when the wireless receiving path or the wireless transceiving reciprocal path is determined as the radar receiving path, the electromagnetic signal received by the receiving antenna/transceiving antenna is an echo signal reflected by the electromagnetic signal transmitted by the radar transmitting path after contacting the object. The first data and the second data processed by the receiver are radar scan data, and the processor 60 performs gesture recognition on the radar scan data to obtain a gesture recognition result.

When the processor 60 determines the radar transmit path and the radar receive path from the above wireless paths, the clock signals of the radar transmit path and the radar receive path should be clock signals generated by the same reference clock, ensuring time synchronization of the radar transmit path and the radar receive path.

As shown in fig. 14, the wireless path of each wireless communication module 63 may construct a SIMO-architecture radar sensor system under the control of a processor, in which one radar transmitting path 1401 and a plurality of radar receiving paths 1402 are included.

Alternatively, as shown in fig. 15, the wireless paths of each wireless communication module 63 may construct a MISO architecture radar sensor system including a plurality of radar transmitting paths 1501 and one radar receiving path 1502 under the control of a processor.

Alternatively, as shown in fig. 16, the wireless paths of each wireless communication module 63 may construct a radar sensor system of a MIMO architecture under the control of a processor, where the radar sensor system of the MIMO architecture includes a plurality of radar transmitting paths 1601 and a plurality of radar receiving paths 1602.

The radar transmitting path may be a wireless transmitting path and/or a wireless receiving/transmitting reciprocal path, and the radar receiving path may be a wireless receiving path and/or a wireless receiving/transmitting reciprocal path. Because the wireless transceiver reciprocal path can transmit electromagnetic signals or receive electromagnetic signals through the switching duplexer, when the processor 60 selects the wireless transceiver reciprocal path as the radar transmitting path or the radar receiving path, the radar sensor system can be constructed more flexibly, and the influence of the radar sensor on the original communication function of the terminal equipment is reduced to the minimum.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each method embodiment described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.

Claims

1. A method of gesture recognition, comprising:

when a gesture recognition instruction is detected, acquiring working frequency bands of all wireless channels, taking the wireless channels which have the same working frequency band and are not called as target wireless channels, determining a first preset number of wireless channels as radar transmitting channels from the target wireless channels, and determining a second preset number of wireless channels as radar receiving channels, wherein the wireless channels comprise at least one of Bluetooth wireless channels, wifi wireless channels and permission wave band auxiliary access wireless channels, and the radar transmitting channels and the radar receiving channels are wireless channels with the same working frequency band;

2. The gesture recognition method of claim 1, wherein the performing a gesture recognition operation through the radar transmit path and the radar receive path during a first time period comprises:

3. The gesture recognition method of claim 1, wherein the performing wireless communication operation over at least one of the radar transmit path and the radar receive path for a second period of time comprises:

4. The gesture recognition method of claim 1, wherein the determining a first preset number of radio paths as radar transmitting paths and determining a second preset number of radio paths as radar receiving paths comprises:

acquiring the working frequency range of each wireless channel;

5. The gesture recognition method of claim 1, wherein the determining a first preset number of radio paths as radar transmitting paths and determining a second preset number of radio paths as radar receiving paths comprises:

obtaining access performance parameters of each wireless access;

6. The gesture recognition method of claim 1, wherein the performing gesture recognition operations over the radar transmit path and the radar receive path for a first period of time and performing wireless communication operations over at least one of the radar transmit path and the radar receive path for a second period of time comprises:

7. The gesture recognition method according to claim 2, wherein the performing a radar scanning operation through the radar transmitting path and the radar receiving path in the first period of time to obtain radar scan data includes:

8. The gesture recognition method of claim 7, wherein the controlling the radar transmission path to transmit an electromagnetic signal comprises:

9. A gesture recognition apparatus, comprising:

the access selection module is used for acquiring the working frequency bands of all wireless access channels when the gesture recognition instruction is detected, taking the wireless access channels which have the same working frequency band and are not called as target wireless access channels, determining a first preset number of wireless access channels as radar transmitting access channels from the target wireless access channels, and determining a second preset number of wireless access channels as radar receiving access channels, wherein the wireless access channels comprise at least one of Bluetooth wireless access channels, wifi wireless access channels and permission wave band auxiliary access wireless access channels, and the radar transmitting access channels and the radar receiving access channels are wireless access channels with the same working frequency band;

10. The gesture recognition apparatus of claim 9, wherein the path multiplexing module comprises:

11. The gesture recognition apparatus of claim 9, wherein the path multiplexing module comprises:

12. The gesture recognition device of claim 9, wherein the pathway selection module comprises:

13. The gesture recognition device of claim 9, wherein the pathway selection module comprises:

14. The gesture recognition apparatus of claim 9, wherein the path multiplexing module comprises:

15. The gesture recognition apparatus according to claim 10, wherein the radar scanning submodule is specifically configured to control the radar transmitting path to transmit an electromagnetic signal in the first period of time, control the radar receiving path to receive an echo signal, and perform analog-to-digital conversion processing on the echo signal to obtain radar scanning data, where the echo signal is a signal reflected by the electromagnetic signal after contacting an object.

16. The gesture recognition apparatus of claim 15, wherein the radar scanning sub-module comprises:

17. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor, when executing the computer program, causes the terminal device to carry out the steps of the method according to any one of claims 1 to 8.

18. A computer readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, causes a terminal device to carry out the steps of the method according to any one of claims 1 to 8.