WO2023083105A1

WO2023083105A1 - Electronic device, interaction module, and control method and control apparatus therefor

Info

Publication number: WO2023083105A1
Application number: PCT/CN2022/129793
Authority: WO
Inventors: 庞胜利
Original assignee: 歌尔微电子股份有限公司
Priority date: 2021-11-15
Filing date: 2022-11-04
Publication date: 2023-05-19
Also published as: CN114121002A

Abstract

An electronic device, an interaction module, and a control method and control apparatus therefor. The control method for an interaction module comprises: controlling an ultrasound generation apparatus to transmit an ultrasonic signal, and controlling a pickup apparatus to receive an acoustic wave signal (S100); controlling a signal processing unit to determine, according to the acoustic wave signal, voice instruction information and/or posture instruction information of a user (S200); and controlling the signal processing unit to determine a user instruction according to the voice instruction information and/or the posture instruction information (S300). The method improves the human-computer interaction efficiency.

Description

Electronic equipment, interactive module and its control method and control device

This application claims the priority of the Chinese patent application with the application number 202111351728.5 and the title of the invention "electronic equipment, interactive module and its control method and control device" filed with the China Patent Office on November 15, 2021, the entire contents of which are incorporated by reference incorporated in the application.

technical field

The present application relates to the field of interaction technology, and in particular to an electronic device, an interaction module, a control method and a control device thereof.

Background technique

With the development of AI technology, there are more and more applications of voice control and interaction, and the technology is becoming more mature.

technical problem

Although voice interaction is more convenient to use, in some relatively complex control or frequent control scenarios, the efficiency of voice interaction is relatively low.

technical solution

The control method of the interactive module proposed in the present application, the interactive module includes an ultrasonic sound generating device, a sound pickup device and a signal processing unit, wherein the control method of the interactive module includes:

Control the ultrasonic sound generating device to emit ultrasonic signals, and control the pickup device to receive sound wave signals;

The control signal processing unit determines the user's voice command information and/or gesture command information according to the sound wave signal;

The control signal processing unit determines a user instruction according to the voice instruction information and/or the gesture instruction information.

In one embodiment, the step of determining the user's voice command information and/or gesture command information according to the sound wave signal by the control signal processing unit includes:

controlling the signal processing unit to determine the sound signal and/or the ultrasonic signal in the sound wave signal;

The control signal processing unit determines the user's voice instruction information according to the sound signal, and/or determines the user gesture instruction information according to the ultrasonic signal.

In one embodiment, the step of controlling the ultrasonic sound generating device to emit ultrasonic signals is specifically:

The ultrasonic sound generating device is controlled to emit ultrasonic signals having the first characteristic parameter at intervals.

In an embodiment, the determining the user gesture instruction information according to the ultrasonic signal is specifically:

Determining an ultrasonic signal with a first characteristic parameter among the ultrasonic signals, and determining user gesture instruction information according to the ultrasonic signal with the first characteristic parameter.

In one embodiment, before the step of controlling the ultrasonic sound generating device to emit ultrasonic signals and controlling the sound pickup device to receive the sound wave signal, the control method of the interaction module further includes:

Control the pickup device to receive the sound wave signal in the current environment;

The control signal processing unit determines the ultrasonic signal in the current environment according to the sound wave signal in the current environment, and configures the first characteristic parameter according to the ultrasonic signal in the current environment.

In an embodiment, the step of determining the user instruction by the control signal processing unit according to the voice instruction information and/or the gesture instruction information is specifically:

When the signal processing unit determines the voice command information but not the gesture command information, the voice command corresponding to the voice command information is used as the user command;

When the signal processing unit does not determine the voice command information but determines the gesture command information, the gesture command corresponding to the gesture command information is used as the user command;

When the signal processing unit determines the voice instruction information and the gesture instruction information, according to the instruction priorities of the voice instruction corresponding to the voice instruction information and the gesture instruction corresponding to the gesture instruction information, the one with the higher instruction priority as a user instruction.

The present application also proposes a control device for an interactive module, the interactive module includes an ultrasonic sound generating device, a sound pickup device and a signal processing unit, and the intelligent interactive control control device includes:

memory;

processor; and

An intelligent interactive control program stored in the memory and operable on the processor, when the processor executes the intelligent interactive control program, the above-mentioned control method of the interactive module is realized.

The present application also proposes an interactive module, which includes:

Ultrasonic sounding device for sending out ultrasonic signals;

a pickup device for receiving acoustic signals; and,

The signal processing unit is configured to determine the user's voice instruction information and/or gesture instruction information according to the sound wave signal, and determine the user instruction according to the voice instruction information and/or the gesture instruction information.

In one embodiment, the interaction module also includes:

The casing, the ultrasonic sound generating device, the sound pickup device and the signal processing unit are accommodated in the casing.

The present application also proposes an electronic device, the electronic device comprising:

interactive modules as described above; and,

Like the control device of the interaction module mentioned above, the control device of the interaction module is electrically connected with the interaction module.

Beneficial effect

The technical solution of the present application controls the ultrasonic sound generating device to emit ultrasonic signals, and controls the sound pickup device to receive the sound wave signal; and controls the signal processing unit to determine the user's voice command information and/or gesture command information according to the sound wave signal; and, the control signal The processing unit determines a user instruction according to the voice instruction information and/or the gesture instruction information. The technical solution of the present application combines voice interaction with gesture interaction, so that users can flexibly choose two interaction methods according to actual needs to realize the control of electronic devices. Compared with pure voice interaction, the interaction process can be more efficient. Concise, higher adjustment accuracy, greatly improving the convenience and efficiency of interaction. In addition, the technical solution of the present application uses ultrasonic waves to realize posture detection, which not only avoids the dependence of image-based posture detection on light sources, but also improves the stability of posture detection, and can also use the same sound pickup device to simultaneously acquire user voice and posture. There is no need to install additional camera components, which is conducive to the miniaturization and light weight design of electronic equipment.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to the structures shown in these drawings without creative effort.

Fig. 1 is a schematic flow chart of the steps of an embodiment of the control method of the interactive module of the present application;

FIG. 2 is a schematic structural diagram of the hardware operating environment of an embodiment of the control device of the interactive module of the present application;

FIG. 3 is a schematic structural diagram of an embodiment of an interactive module of the present application;

FIG. 4 is a schematic structural diagram of another embodiment of the interactive module of the present application;

FIG. 5 is a schematic diagram of modules of an embodiment of an electronic device according to the present application.

Embodiments of the present invention

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

In addition, descriptions such as "first", "second" and so on in this application are used for description purposes only, and should not be understood as indicating or implying their relative importance or implicitly indicating the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In addition, the technical solutions of the various embodiments can be combined with each other, but it must be based on the realization of those skilled in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered that the combination of technical solutions does not exist , nor within the scope of protection required by the present application.

The present application proposes a method for controlling an interactive module.

At present, electronic devices that use voice interaction, such as Xiaoai classmates or mobile phones, are all question-and-answer interactions, that is, after receiving the user's voice command, the electronic device executes the corresponding function and feedbacks the function to the user in the form of voice to complete the execution. In this way, in scenarios where complex control or frequent control is required, the user is required to issue complex or frequent voice commands, which makes interactive control less efficient and very inconvenient. For example: when the user needs to adjust the video parameters such as the music volume or the brightness, progress, and sound of the video being played, the user can only repeatedly output the voice command for adjustment, and can only adjust it again according to the effect of the current adjustment. Adjustment, the overall adjustment process is very lengthy and complicated, and the question-and-answer interaction cannot be applied to scenarios where it is inconvenient for users to speak, such as meetings or people taking a break next to them.

The subject of execution of the control method of the interaction module of the present application may be a control device of the interaction module. An ultrasonic sound generating device, a sound pickup device and a signal processing unit can be integrated in the interactive module.

Referring to Fig. 1, in an embodiment of the present application, the control method of the interactive module includes:

Step S100, controlling the ultrasonic sound generating device to emit ultrasonic signals, and controlling the sound pickup device to receive the sound wave signals;

The control device of the interactive module can control the interactive module to work when it is triggered to enter the interactive mode. Specifically: controlling the ultrasonic sound generating device in the interactive module to emit sound wave signals with a frequency in the range of 20KHz~40KHz, and simultaneously controlling the sound pickup device to receive sound wave signals with a frequency within the first preset frequency range. It can be understood that the sound wave signal in the range of 20KHz~40KHz is the ultrasonic signal, and the ultrasonic signal and the sound signal sent by the user (for the sake of simplicity, the following "user sound signal" means "the sound signal sent by the user") Both belong to a kind of sound wave signal, so in this embodiment, the lower limit of the first preset frequency range can be determined by the lowest frequency of the user's voice signal, and the upper limit of the first preset frequency range can be determined by the highest frequency of the ultrasonic signal. In this way, the ultrasonic wave and the user's voice signal can be received at the same time.

Step S200, the control signal processing unit determines the user's voice command information and/or gesture command information according to the sound wave signal;

The sound pickup device can convert the sound wave signal in the form of sound wave into the form of electrical signal, and output it to the signal processing unit for signal separation processing, so as to separate the user voice signal component and/or ultrasonic signal component from the sound wave signal. A preset voice command library may be pre-integrated in the signal processing unit, and multiple pieces of preset voice command information may be pre-stored in the preset voice command library, so that when the user voice signal component is separated, the separated user voice signal component and Multiple pieces of preset voice command information in the voice command library are matched, and the preset voice command information with the highest matching degree can be used as the voice command information corresponding to the sound wave signal, so as to realize the determination of the user's voice command information. The signal processing unit can also be pre-integrated with an ultrasonic signal analysis algorithm, so that when the ultrasonic signal component is separated, the ultrasonic signal analysis algorithm is run to analyze and calculate the ultrasonic signal component, and then to obtain the posture image information corresponding to the ultrasonic signal component and the The gesture command represented by the gesture image information can be used as the gesture command information corresponding to the sound wave signal, so as to realize the determination of the user's gesture command information. Wherein, the ultrasonic signal analysis algorithm may be a TOF algorithm, and the posture command information may be one or more combinations of posture information such as gesture command information, body posture information, and mouth shape posture information. It can be understood that, according to the actual interaction situation of the user, the determination results of this step can be divided into the following three situations, the first one: only the voice command information is determined; the second one: only the gesture command information is determined; the third one : Determine the voice command information and gesture command information at the same time.

Step S300, the control signal processing unit determines the user instruction according to the voice instruction information and/or gesture instruction information.

When only the voice command information or gesture command information is determined, the signal processing unit can further determine the function that the user wants to trigger according to the determined voice command information or gesture command information, that is, respectively determine the voice command corresponding to the voice command information and The gesture command corresponding to the gesture command information, at this time, the signal processing unit can output a user command for triggering the function to the main control unit or corresponding functional components in the electronic device according to the determination result, so as to trigger the function through the main control unit or directly The corresponding functional components are used to realize the functions that users want to trigger, so as to realize human-computer interaction. When the voice command information and the gesture command information are determined at the same time, the signal processing unit can use the function that the user wants to trigger determined by any one of the voice command information and the gesture command information, to the user determined by the other. For the function to be triggered, perform one or more combinations of operations such as confirmation, correction, or supplement, so as to improve the accuracy of the final output user instruction.

In this way, when the user is in a scene that requires simple control, the adjustment can be completed through simple voice or simple gesture. When the user is in a scene that requires complex or frequent control, such as adjusting the music volume or the video parameters of the played video, the user can continuously increase the brightness or volume, or speed up the video progress, by raising or lifting gestures, etc. You can continue to reduce the brightness or volume by lifting or lowering gestures, or roll back the progress of the video, and when you reach a satisfactory brightness, volume or progress, you can exit the adjustment directly through the gesture or voice that characterizes the stop adjustment, so as to continue listening to music Or watch a video without waiting for voice feedback. When the user is in a scene where it is inconvenient to speak, the user can trigger a corresponding function of the electronic device through gestures. The technical solution of the present application combines voice interaction with gesture interaction, so that users can flexibly choose two interaction methods according to actual needs to realize the control of electronic devices. Compared with pure voice interaction, the interaction process can be more efficient. Concise, higher adjustment accuracy, greatly improving the convenience and efficiency of interaction. In addition, the technical solution of the present application uses ultrasonic waves to realize posture detection, which not only avoids the dependence of image-based posture detection on light sources, but also improves the stability of posture detection, and can also use the same sound pickup device to simultaneously acquire user voice and posture. There is no need to install additional camera components, which is conducive to the miniaturization and light weight design of electronic equipment.

Referring to FIG. 1, in an embodiment of the present application, the step S200 of controlling the signal processing unit to determine the user's voice command information and/or gesture command information according to the sound wave signal includes:

Step S200, control the signal processing unit to determine the sound signal and/or ultrasonic signal in the sound wave signal;

After the acoustic wave signal is converted into an electrical signal, the electrical signal frequency intervals corresponding to the user's voice signal component and the ultrasonic signal component are different from each other, so a hardware circuit or software program and algorithm for filtering can be integrated in the signal processing unit. When the sound wave signal of the electrical signal is received, it is filtered to filter out the components in the frequency range corresponding to the sound signal and the components in the frequency range corresponding to the ultrasonic signal in the sound wave signal, so as to obtain the user sound signal component and the ultrasonic signal portion. It should be noted that the user voice signal component is the voice signal recorded in this step, and the ultrasonic signal component is the ultrasonic signal recorded in this step.

Step S210, the control signal processing unit determines the user's voice command information according to the sound signal, and/or determines the user's gesture command information according to the ultrasonic signal.

In this embodiment, the signal processing unit can match the determined sound signal with the local pre-integrated preset voice command library, so as to use the preset voice command with the highest matching degree in the preset voice command library as the voice command information; signal processing The unit can also use the locally integrated TOF algorithm to analyze and calculate the ultrasonic signal to determine the gesture instruction information, so as to realize the local recognition of the voice instruction information and the gesture instruction information. In addition, the signal processing unit can also send the voice signal or ultrasonic signal to the server through the wireless communication module in the electronic device when the local recognition cannot determine the voice command information and gesture command information, and can receive the output from the server through the wireless communication module. The result of the determination is to realize the online recognition of voice command information and gesture command information. Such setting makes the technical solution of the present application applicable to both offline and online network conditions of electronic equipment, which greatly improves user convenience and wide application.

Further, in step S100, control the ultrasonic sound generating device to emit ultrasonic signals, specifically:

Those skilled in the art can encode and encrypt the emitted ultrasonic waves by changing the frequency or intensity of the ultrasonic waves, so that the emitted ultrasonic signals have the first characteristic parameter. For example, the ultrasonic signal of the first preset frequency is recorded as "0", the ultrasonic signal of the second preset frequency is recorded as "1", and the ultrasonic signals of the first preset frequency and the second preset frequency are alternately sent out at the same preset time interval. Ultrasonic signal, the ultrasonic signal whose first characteristic parameter is "010101010" can be realized. In addition, those skilled in the art can also encode and encrypt the parameter group formed by the multiple first characteristic parameters transmitted sequentially by controlling all the first characteristic parameters of the ultrasonic signals sent at each interval, so as to improve the technology of the present application. The characteristics of the ultrasonic waves emitted by the scheme are used to reduce the interference of environmental ultrasonic signals on posture detection.

Further, in step S210, the gesture instruction information of the user is determined according to the ultrasonic signal, specifically:

Determining the ultrasonic signal with the first characteristic parameter among the ultrasonic signals, and determining the gesture instruction information of the user according to the ultrasonic signal with the first characteristic parameter.

Since the environment where the electronic device is located usually has many other types of electronic devices, there are often ultrasonic signals emitted by other electronic devices (ie, ambient ultrasonic signals) in the air where the electronic device is located, which greatly affects the accuracy of posture detection. In response to this problem, the technical solution of the present application further separates the ultrasonic signal with the first characteristic parameter from the ultrasonic signal after determining the ultrasonic signal, and determines the posture instruction information according to the ultrasonic signal with the first characteristic parameter, thus effectively eliminating The interference of the environmental ultrasonic signal to the posture detection is beneficial to improve the accuracy of the posture detection.

In addition, due to the complexity of the environmental ultrasonic signal, the uniformly preset first characteristic parameter cannot effectively reduce the interference of different environmental ultrasonic signals. Therefore, before step S100, a step may be included: controlling the sound pickup device to receive the environmental sound wave signal, And configure the first characteristic parameter according to the environmental sound wave signal; this step can make the electronic device determine the environmental ultrasonic signal in the environmental sound wave signal before emitting the ultrasonic wave, and configure the first characteristic parameter according to the environmental ultrasonic signal, so that the ultrasonic wave to be emitted The first characteristic parameter of the signal can avoid the interference of the current environmental ultrasonic signal to the greatest extent.

Referring to FIG. 1 , in an embodiment of the present application, the control signal processing unit determines the user instruction step S300 according to the voice instruction information and/or gesture instruction information, specifically:

When the signal processing unit determines the voice command information and the gesture command information, according to the command priorities of the voice command corresponding to the voice command information and the gesture command corresponding to the gesture command information, the one with higher command priority is taken as the user command.

Under normal circumstances, the user will not issue voice commands and gesture commands at the same time, but only issue voice commands or gesture commands in sequence according to their own needs. The technical solution of the present application is to use the voice command corresponding to the voice command information as the user command when the signal processing unit only determines the voice command information, that is, when the user only issues a voice command; when the signal processing unit only determines the gesture command information, that is, When the user only issues a gesture command, the gesture command corresponding to the gesture command information is used as the user command, so as to meet the user's interaction needs in normal situations.

However, in some special cases, for example, when the user issues voice commands and gesture commands at the same time, the technical solution of the present application enables the signal processing unit to determine the voice command information and gesture command information according to both voice commands and gesture commands. The priority of the command is the one with the higher priority as the user command. Experiments have shown that when the user sends an instruction, the error rate of the voice instruction is lower than that of the gesture instruction, and the voice instruction can better express the function that the user actually wants to perform. Therefore, in this embodiment, the priority of the voice instruction is higher than that of the gesture instruction. In order to prevent electronic equipment from performing two opposite functions at the same time and causing hardware damage.

The present application also proposes a control device for an interactive module, where the interactive module includes an ultrasonic sound generating device, a sound pickup device and a signal processing unit.

Referring to Figure 2, in an embodiment of the present application, the control device of the interactive module includes:

memory 101;

processor 102; and

The control program of the interactive module is stored in the memory 101 and can be run on the processor. When the processor 102 executes the control program of the interactive module, the above method for controlling the interactive module is realized.

In this embodiment, the memory 101 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory, and the memory 101 can optionally also be a storage device independent of the aforementioned control device; the processor 102 Can be CPU. The memory 101 and the processor 102 are connected by a communication bus 103, which may be a UART bus or an I2C bus. It can be understood that other related programs can also be set in the control device to drive other functional units and modules in the interaction module to work.

The application also proposes an interactive module.

Referring to Fig. 3 to Fig. 5, in one embodiment, the interaction module includes:

Ultrasonic sounding device 210, used for sending out ultrasonic signals;

The sound pickup device 220 is used to receive the sound wave signal; and,

The signal processing unit 230 is configured to determine the user's voice instruction information and/or gesture instruction information according to the sound wave signal, and determine the user instruction according to the voice instruction information and/or gesture instruction information.

In this embodiment, the ultrasonic sounding device 210 can be an ultrasonic sounding chip 211; the ultrasonic sounding device 210 can be provided with a sounding diaphragm and an electric drive structure, and can control the electric field loaded on both sides of the sounding diaphragm through the electric drive structure to Drive the sounding diaphragm to vibrate and send out ultrasonic signals. The sound pickup device 220 can be a sound pickup MEMS chip 221; the sound pickup device 220 can be provided with a sound receiving diaphragm, and the sound wave signal in the air can be sensed by the sound receiving diaphragm in the sound pickup device 220, and can be based on the sound receiving diaphragm The change of the electric field on both sides outputs the corresponding electric signal, so as to realize the reception of the sound wave signal. Signal processing unit 230 can be made up of ASIC chip 232 and speech processing chip 231; Wherein, ASIC chip 232 is used for according to the sound wave signal of electric signal, determines the sound signal and the ultrasonic signal in the sound wave signal and outputs to speech processing chip 231, makes speech The processing chip 231 can determine the user instruction according to the sound signal and the ultrasonic signal.

Further, the interactive module also includes:

The casing 240 , the ultrasonic sound generating device 210 , the sound pickup device 220 and the signal processing unit 230 are accommodated in the casing 240 .

In this embodiment, the casing 240 can be formed by surrounding the shell 241 and the substrate 242 . The housing 240 may be provided with an accommodating cavity, and the ultrasonic sound generating device 210 , the sound pickup device 220 and the signal processing unit 230 may all be accommodated in the accommodating cavity of the housing 240 . In the embodiment shown in Fig. 3, sound pick-up MEMS chip 221 and ultrasonic sound generation chip 211 all can be connected with substrate 242 by support member, can be provided with sound pick-up holes corresponding to sound pickup MEMS chip 221 and ultrasonic sound generation chip 211 respectively on the substrate 242 243 and the sound outlet 244, so that a sound pickup space can be formed between the sound pickup hole 243 and the sound pickup MEMS chip 221, and a sound outlet space can be formed between the ultrasonic sound chip 211 and the sound outlet 244, which is conducive to respectively enhancing The sound-sensing capability of the sound-picking MEMS chip 221 and the sound-generating capability of the ultrasonic sound-generating chip 211, and in the embodiment shown in Fig. On the side of the voice processing chip 231 away from the substrate 242 . With such arrangement, the volume of the interactive module can be reduced while enhancing the sound output and sound pickup capabilities of the interactive module. In the embodiment of FIG. 4 , the voice processing chip 231 can also be embedded in the substrate 242 to save space, reduce interference between devices, and improve the anti-interference ability of the entire device.

The present application also proposes an electronic device. Referring to FIG. 5 , the interactive module includes an interactive module and a control device 100 for the interactive module. All the technical solutions of the embodiments at least have all the beneficial effects brought about by the technical solutions of the above embodiments, and will not be repeated here.

Wherein, the electronic device can be a wearable device; the control device 100 of the interactive module can be electrically connected with the interactive module, and the control device 100 of the interactive module can be housed in the shell 241 of the electronic device.

The above is only an optional embodiment of the application, and does not limit the patent scope of the application. Under the concept of the application, the equivalent structure transformation made by using the description of the application and the contents of the accompanying drawings, or direct/indirect use All other relevant technical fields are included in the patent protection scope of the present application.

Claims

A control method of an interactive module, the interactive module includes an ultrasonic sound generating device, a sound pickup device and a signal processing unit, wherein the control method of the interactive module includes:

Control the ultrasonic sound generating device to emit ultrasonic signals, and control the pickup device to receive sound wave signals;

The control signal processing unit determines the user's voice command information and/or gesture command information according to the sound wave signal; and,

The control signal processing unit determines a user instruction according to the voice instruction information and/or the gesture instruction information.
The control method of the interactive module according to claim 1, wherein the step of determining the voice command information and/or gesture command information of the user according to the sound wave signal by the control signal processing unit comprises:

controlling the signal processing unit to determine the sound signal and/or the ultrasonic signal in the sound wave signal;

The control signal processing unit determines the user's voice instruction information according to the sound signal, and/or determines the user gesture instruction information according to the ultrasonic signal.
The control method of the interactive module according to claim 2, wherein the step of controlling the ultrasonic sound generating device to emit ultrasonic signals is specifically:

The ultrasonic sound generating device is controlled to emit ultrasonic signals having the first characteristic parameter at intervals.
The control method of the interactive module according to claim 3, wherein said determining the user posture instruction information according to the ultrasonic signal is specifically:

Determining an ultrasonic signal with a first characteristic parameter among the ultrasonic signals, and determining user gesture instruction information according to the ultrasonic signal with the first characteristic parameter.
The control method of the interactive module according to claim 3, wherein, before the step of controlling the ultrasonic sound generating device to emit ultrasonic signals, and controlling the sound pickup device to receive the sound wave signal, the control method of the interactive module further comprises:

Control the pickup device to receive the sound wave signal in the current environment;

The control signal processing unit determines the ultrasonic signal in the current environment according to the sound wave signal in the current environment, and configures the first characteristic parameter according to the ultrasonic signal in the current environment.
The control method of the interactive module according to any one of claims 1-5, wherein the step of determining the user instruction according to the voice instruction information and/or the gesture instruction information by the control signal processing unit is specifically:

When the signal processing unit determines the voice command information but not the gesture command information, the voice command corresponding to the voice command information is used as the user command;

When the signal processing unit does not determine the voice command information but determines the gesture command information, the gesture command corresponding to the gesture command information is used as the user command;

When the signal processing unit determines the voice instruction information and the gesture instruction information, according to the instruction priorities of the voice instruction corresponding to the voice instruction information and the gesture instruction corresponding to the gesture instruction information, the one with the higher instruction priority as a user instruction.
A control device for an interactive module, the interactive module includes an ultrasonic sound generating device, a sound pickup device and a signal processing unit, wherein the control device for intelligent interactive control includes:

memory;

processor; and

An intelligent interactive control program stored in a memory and operable on a processor, when the processor executes the intelligent interactive control program, the control method of the interactive module according to any one of claims 1-6 is realized.
An interactive module, wherein the interactive module includes:

Ultrasonic sounding device for sending out ultrasonic signals;

a pickup device for receiving acoustic signals; and,

The signal processing unit is configured to determine the user's voice instruction information and/or gesture instruction information according to the sound wave signal, and determine the user instruction according to the voice instruction information and/or the gesture instruction information.
The interactive module according to claim 8, wherein the interactive module further comprises:

The casing, the ultrasonic sound generating device, the sound pickup device and the signal processing unit are accommodated in the casing.
An electronic device, wherein the electronic device includes:

The interactive module according to any one of claims 8-9; and,

The control device of the interactive module according to claim 7, the control device of the interactive module is electrically connected with the interactive module.