CN108305638B - Signal processing method, signal processing device and terminal equipment - Google Patents
Signal processing method, signal processing device and terminal equipment Download PDFInfo
- Publication number
- CN108305638B CN108305638B CN201810022097.4A CN201810022097A CN108305638B CN 108305638 B CN108305638 B CN 108305638B CN 201810022097 A CN201810022097 A CN 201810022097A CN 108305638 B CN108305638 B CN 108305638B
- Authority
- CN
- China
- Prior art keywords
- signal
- module
- ultrasonic
- audio signal
- sound wave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0272—Voice signal separating
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
- G10L2025/783—Detection of presence or absence of voice signals based on threshold decision
Abstract
The embodiment of the invention discloses a signal processing method, a signal processing device and terminal equipment, relates to the technical field of communication, and aims to solve the problem that personal information of a user is possibly leaked due to the fact that the terminal equipment carrying a voice assistant in the prior art has a bug controlled by a voice signal demodulated from a modulated ultrasonic signal. The method comprises the following steps: acquiring a sound wave signal; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and if the amplitude of the audio signal is smaller than that of the ultrasonic signal, filtering the audio signal.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a signal processing method, a signal processing device and terminal equipment.
Background
The voice assistant carried by the terminal equipment can enable a user to control the terminal equipment to execute various functions through voice under the condition that the user does not contact the terminal equipment. And the microphone used in the terminal equipment can receive sound wave with frequency far wider than the frequency (20 Hz-20 kHz) which can be heard by human ears, such as ultrasonic wave (the frequency is more than 20kHz) which can not be heard by human ears, and the microphone can still receive and convert the sound wave into electric signal to be output.
Taking the terminal device as a mobile phone as an example, the user can control the mobile phone to perform functions such as making a call, sending information, taking a picture and the like through voice. However, if a lawbreaker modulates the voice signal for controlling the handset of the user onto the ultrasonic signal and sends the ultrasonic signal to the handset of the user, because the microphone in the handset demodulates the signal in a non-linear manner, the microphone can demodulate the voice signal from the ultrasonic signal and send the voice signal to the voice assistant in the handset, so that the voice assistant can control the handset to perform functions of making a call, sending information, taking a picture and the like by recognizing the voice signal. As described above, the terminal device equipped with the voice assistant in the related art has a leak controlled by the voice signal demodulated from the modulated ultrasonic signal, and further, may cause leakage of personal information of the user.
Disclosure of Invention
The embodiment of the invention provides a signal processing method, a signal processing device and terminal equipment, which aim to solve the problem that the terminal equipment carrying a voice assistant in the prior art has a loophole controlled by a voice signal demodulated from a modulated ultrasonic signal, and further personal information of a user is possibly leaked.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides a signal processing method, where the method includes:
acquiring a sound wave signal;
if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal;
if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal, the audio signal is filtered out.
In a second aspect, an embodiment of the present invention provides a signal processing apparatus, including an obtaining module and a filtering module;
the acquisition module is used for acquiring sound wave signals;
the separation module is used for separating an audio signal and an ultrasonic signal from the sound wave signal if the obtained sound wave signal comprises the ultrasonic signal;
and the filtering module is used for filtering the audio signal if the amplitude of the audio signal separated by the separating module is smaller than that of the ultrasonic signal.
In a third aspect, an embodiment of the present invention provides a terminal device, which includes the signal processing apparatus according to the second aspect.
In the embodiment of the invention, the sound wave signal can be obtained; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal. According to the scheme, when the amplitude of the audio signal is smaller than that of the ultrasonic signal, the audio signal can be judged not to be the voice signal sent by a user, and the terminal equipment can be controlled to execute some illegal action, so that the audio signal is filtered, the terminal equipment cannot be controlled, and further personal information of the user is prevented from being leaked.
Drawings
Fig. 1 is a flowchart of a signal processing method according to an embodiment of the present invention;
FIG. 2 is a block diagram of a signal processing apparatus according to an embodiment of the present invention;
fig. 3 is a second block diagram of a signal processing apparatus according to an embodiment of the present invention;
fig. 4 is a third block diagram of a signal processing apparatus according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a signal processing apparatus according to an embodiment of the present invention;
fig. 6 is a second schematic diagram of a signal processing apparatus according to an embodiment of the present invention;
fig. 7 is a block diagram of a terminal device according to an embodiment of the present invention;
fig. 8 is a hardware schematic diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the embodiments of the present invention, words such as "exemplary" or "for example" are used to mean serving as examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "e.g.," an embodiment of the present invention is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
The embodiment of the invention provides a signal processing method, a signal processing device and terminal equipment, which can acquire sound wave signals; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal. According to the scheme, when the amplitude of the audio signal is smaller than that of the ultrasonic signal, the audio signal can be judged not to be the voice signal sent by a user, and the terminal equipment can be controlled to execute some illegal action, so that the audio signal is filtered, the terminal equipment cannot be controlled, and further personal information of the user is prevented from being leaked.
The terminal device in the embodiment of the invention can be a terminal device carrying a voice assistant, such as other mobile terminal devices or non-mobile terminal devices carrying a voice assistant, such as a mobile phone, an intelligent sound box, an intelligent watch, a vehicle-mounted terminal and the like. The embodiments of the present invention are not particularly limited.
An execution main body of the control method of the application program provided by the embodiment of the present invention may be a signal processing apparatus, and the signal processing method provided by the embodiment of the present invention is exemplarily described below. As shown in fig. 1, an embodiment of the present invention provides a signal processing method, which may include steps 101 to 107 described below.
In the embodiment of the present invention, the terminal device is a mobile phone for example, a microphone of the mobile phone receives a sound wave signal, and the sound wave signal received by the microphone may be an audio signal, such as a voice signal of a user; it may also be an ultrasonic signal, such as an ultrasonic signal in which the audio signal is modulated. The microphone processes the acoustic signals it receives, for example by demodulation. In general, an ideal linear circuit receives a sinusoidal signal having a frequency f and outputs a sinusoidal signal having the same frequency f, i.e., fout＝AfinWherein A is gain, finFor input sinusoidal signals, foutFor the output sinusoidal signal, finAnd foutAre the same. WhileIn practice, the demodulation of the sound wave signal by the microphone is non-linear, i.e. there will be high order terms in the output. Assuming that the output contains only primary and secondary terms, i.e.
Wherein A and B are gains, finFor input sinusoidal signals, foutFor the output sinusoidal signal, finAnd foutIs different. If the sound wave signal received by the microphone is an audio signal, the sound wave signal processed by the microphone may only include the audio signal, and may also include the audio signal and the ultrasonic signal (in this case, the amplitude of the audio signal is greater than or equal to the amplitude of the ultrasonic signal); if the sound wave signal received by the microphone is an ultrasonic wave signal in the nature, the sound wave signal processed by the microphone only comprises the ultrasonic wave signal; if the sound wave signal received by the microphone is an ultrasonic wave signal modulated by an audio signal, the sound wave signal processed by the microphone may include the audio signal and the ultrasonic wave signal (in this case, the amplitude of the audio signal is smaller than that of the ultrasonic wave signal).
In the following, an example is given in which the sound wave signal received by the microphone is an ultrasonic wave signal modulated by an audio signal, and the sound wave signal processed by the microphone includes the audio signal and the ultrasonic wave signal.
The frequency is fm (fm)<20kHz) into an ultrasonic frequency band fc (fc > 20kHz) to form a new amplitude modulation signal fin＝cos2πfmt·cos2πfct+cos2πfct, substitution into
The demodulated signal can be obtained as follows:
fout＝Acos2πfmt·cos2πfct+Acos2πfct+Bcos22πfmt·cos22πfct+Bcos22πfct
+2Bcos2πfmt·cos22πfct
the above equation is expanded according to the trigonometric function formula as follows:
from the expansion, it can be seen that the frequencies contained in the demodulated signal are fc + fm, fc-fm, fc, 2(fc + fm), 2(fc-fm), 2fm, 2fc + fm, 2fc-fm, and the like from the left to the right. Meanwhile, the audio signals with the frequencies fc-fm, 2fm and fm respectively have the amplitudes of A/2, B/4 and B in the above formula, and the audio signals with the frequencies fc + fm, fc, 2(fc + fm), 2(fc-fm), 2fc + fm and 2fc-fm respectively have the amplitudes of A/2, A, B/8, B/8, 3B/4, B/2 and B/2 in the above formula, so that the amplitude of the ultrasonic wave signal is obviously larger than that of the audio signal. In summary, since the demodulation of the signal by the microphone is non-linear, the audio signal modulated in the ultrasonic signal is demodulated. That is, by emitting an ultrasonic signal modulated by an audio signal, which is not audible to the human ear, to the user's handset, it is possible to control the user's handset to perform various functions, which are difficult to be discovered. In the embodiment of the invention, because the received sound wave signal is determined to be demodulated from the modulated ultrasonic wave signal by judging the relation between the amplitude of the audio signal and the amplitude of the ultrasonic wave signal, and the audio signal in the sound wave signal is filtered, the audio signal can be prevented from controlling the mobile phone to execute a certain function, thereby avoiding the leakage of personal information of a user.
The microphone sends the processed sound wave signals to the signal processing device, and the signal processing device receives the sound wave signals sent by the microphone.
Step 102 (optional), detecting whether the sound wave signal contains an ultrasonic wave signal.
As shown in step 101, if the sound wave signal received by the microphone is an ultrasonic wave signal modulated by an audio signal, the sound wave signal processed by the microphone includes the audio signal and the ultrasonic wave signal. Therefore, it is first detected whether the acoustic wave signal includes an ultrasonic wave signal. For a specific method for detecting whether the sound wave signal includes the ultrasonic wave signal, reference may be made to the related art, which is not described herein again.
If the sound wave signal comprises an ultrasonic wave signal, executing step 103-step 107; if the acoustic wave signal does not include an ultrasonic wave signal, step 107 (optional) is performed directly. It should be noted that: the sound wave signal comprises an ultrasonic wave signal, and in one case comprises an audio signal and an ultrasonic wave signal, the steps 103 and 106 provided according to the embodiment of the invention are executed; another situation is that only the ultrasonic signal is included, since outputting the ultrasonic signal does not affect the terminal device of the user, the ultrasonic signal may be directly output without processing the sound wave signal, or step 103 and step 106 provided in the embodiment of the present invention may be performed, where only the ultrasonic signal is included, and then the audio signal is 0, and the amplitude of the audio signal is also 0.
And 103, separating the audio signal and the ultrasonic signal from the sound wave signal.
If the sound wave signal includes an ultrasonic wave signal, the sound wave signal needs to be separated, and an audio signal and an ultrasonic wave signal need to be separated from the sound wave signal. For a specific method for separating the acoustic wave signal, reference may be made to the related art, which is not described herein.
Step 104 (optional), the amplitude of the audio signal and the amplitude of the ultrasonic signal are obtained.
In the embodiment of the present invention, the obtaining of the amplitudes of the audio signals and the amplitudes of the ultrasonic signals refers to obtaining the amplitudes of all the audio signals in the sound wave signals and obtaining the amplitudes of all the ultrasonic signals in the sound wave signals, and a specific method for obtaining the amplitudes of the audio signals and the amplitudes of the ultrasonic signals may refer to the related art and is not described herein again.
Step 105 (optional), compares the amplitude of the audio signal with the amplitude of the ultrasonic signal.
In the embodiment of the present invention, comparing the amplitude of the audio signal with the amplitude of the ultrasonic signal means comparing the sum of all the audio signal amplitudes and the sum of all the ultrasonic signal amplitudes in the sound wave signal. For example, the amplitudes of all the audio signals in the sound wave signal may be added up as S1, and the amplitudes of all the ultrasonic signals in the sound wave signal may be added up as S2, and then the added results may be compared. Specifically, the difference between the two, i.e., S1 to S2, may be calculated, and if the result is less than 0, the amplitude of the audio signal is less than the amplitude of the ultrasonic signal, and if the result is greater than or equal to 0, the amplitude of the audio signal is greater than or equal to the amplitude of the ultrasonic signal. It is also possible to calculate the quotient of the two, i.e., S1/S2, and if the result is less than 1, the amplitude of the audio signal is less than the amplitude of the ultrasonic signal, and if the result is greater than or equal to 1, the amplitude of the audio signal is greater than or equal to the amplitude of the ultrasonic signal.
If the amplitude of the audio signal is smaller than the amplitude of the ultrasonic signal, go to step 106; if the amplitude of the audio signal is greater than or equal to the amplitude of the ultrasonic signal, step 107 (optional) is performed.
As can be seen from step 101, if the amplitude of the audio signal is smaller than the amplitude of the ultrasonic signal, it can be determined that the sound wave signal received by the signal processing apparatus may be an audio signal demodulated from the ultrasonic signal modulated by the audio signal, and not an audio signal sent by the user himself, and if the signal is output, the mobile phone of the user may be controlled to perform various functions of making a call, sending a message, and taking a picture, which may further cause leakage of personal information of the user. Therefore, in order to prevent the user personal information from being leaked, the audio signal may be filtered out so that the user's handset is not controlled.
Optionally, in this embodiment of the present invention, the step 106 may be specifically implemented by the following step 106a or step 106 b.
Step 106a, discarding the acoustic signal to filter out the audio signal.
If the sound wave signal is discarded, the audio signal in the sound wave is also discarded, so that the mobile phone of the user cannot be controlled, and personal information of the user cannot be leaked.
Step 106b, filtering out the audio signal by a filter.
The audio signal may be filtered by a high pass filter (i.e., a signal having a frequency higher than a certain frequency value may be passed, and a signal having a frequency lower than the certain frequency value may be blocked), and the sound wave signal with the audio signal filtered out may be output. Because the ultrasonic wave signal in the sound wave signal can not influence the terminal equipment of the user, the personal information of the user can not be leaked by outputting the ultrasonic wave signal.
Step 107 (optional), outputting the acoustic wave signal.
If it is detected in step 102 (optional) that the sound wave signal does not include the ultrasonic wave signal, in combination with step 101, it is described that the sound wave signal is an audio signal sent by the user himself or an audio signal that can be heard by the user, and is not a sound wave signal demodulated from the ultrasonic wave signal modulated by the audio signal, that is, the sound wave signal does not affect the terminal device of the user, so that the sound wave signal can be output.
If the amplitude of the audio signal obtained by the comparison in step 105 (optional) is greater than or equal to the amplitude of the ultrasonic signal, in combination with step 101, it is indicated that the sound wave signal is an audio signal sent by the user himself or an audio signal that can be heard by the user, and is not an audio signal demodulated from the ultrasonic signal modulated by the audio signal, that is, the sound wave signal does not affect the terminal device of the user, so that the sound wave signal can be output.
The embodiment of the invention provides a signal processing method, which can acquire acoustic signals; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal. According to the scheme, when the amplitude of the audio signal is smaller than that of the ultrasonic signal, the audio signal can be judged not to be the voice signal sent by a user, and the terminal equipment can be controlled to execute some illegal action, so that the audio signal is filtered, the terminal equipment cannot be controlled, and further personal information of the user is prevented from being leaked.
As shown in fig. 2, the embodiment of the present invention provides a signal processing apparatus 120, which includes an obtaining module 121, a separating module 122, and a filtering module 123; an acquiring module 121, configured to acquire an acoustic wave signal; the separation module 122 is configured to separate an audio signal and an ultrasonic signal from the sound wave signal if the obtained sound wave signal includes the ultrasonic signal; the filtering module 123 is configured to filter the audio signal if the amplitude of the audio signal separated by the separating module 122 is smaller than the amplitude of the ultrasonic signal.
Optionally, the filtering module 123 is specifically configured to discard the sound wave signal acquired by the acquiring module 121, so as to filter out the audio signal.
Optionally, the filtering module 123 is specifically configured to filter out the audio signal through a filter.
Optionally, with reference to fig. 2, as shown in fig. 3, the signal processing apparatus 120 further includes: an output module 124; and an output module 124, configured to output the sound wave signal acquired by the acquisition module 121 if the sound wave signal acquired by the acquisition module 121 does not include the ultrasonic wave signal.
Optionally, with reference to fig. 2, as shown in fig. 3, the signal processing apparatus 120 further includes: an output module 124; and an output module 124, configured to output the sound wave signal acquired by the acquisition module 121 if the amplitude of the audio signal separated by the separation module 122 is greater than or equal to the amplitude of the ultrasonic signal.
Optionally, with reference to fig. 3, as shown in fig. 4, the signal processing apparatus 120 further includes: a comparison module 125; a comparing module 125, configured to obtain the amplitude of the audio signal and the amplitude of the ultrasonic signal separated by the separating module 122 before the filtering module 123 filters out the audio signal; and compares the amplitude of the audio signal acquired by the acquisition module 121 with the amplitude of the ultrasonic signal.
The signal processing apparatus provided in the embodiment of the present invention can implement each process shown in fig. 1 in the above method embodiment, and is not described here again to avoid repetition.
The signal processing apparatus 120 provided in the embodiment of the present invention is further exemplarily described in two implementation manners.
Illustratively, the signal processing device 120 may be implemented by a schematic diagram shown in fig. 5. The specific signal processing apparatus 120 includes a detection module 201, a separation module 202, a comparison module 203 and a control output module 204. It should be noted that: the detection module 201 and the separation module 202 implement the functions of the acquisition module 121 of the signal processing apparatus 120, the comparison module 203 implement the functions of the comparison module 125 of the signal processing apparatus 120, and the control output module 204 implement the functions of the filtering module 123 and the output module 124 of the signal processing apparatus 120.
Specifically, the detecting module 201 is configured to detect whether the acoustic wave signal includes an ultrasonic wave signal. The detection module 201 includes an input 2010, a first output 2011 and a second output 2012, where the input 2010 is configured to input an acoustic wave signal, the first output 2011 is configured to output the acoustic wave signal if the detection module 201 detects that the acoustic wave signal includes an ultrasonic wave signal, and the second output 2012 is configured to output the acoustic wave signal if the detection module 201 detects that the acoustic wave signal does not include an ultrasonic wave signal.
The separation module 202 is configured to separate the ultrasonic signal and the audio signal in the sound wave signal, and obtain an amplitude of the audio signal and an amplitude of the ultrasonic signal. The separation module 202 comprises an input 2020, a first output 2021 and a second output 2022, the input 2020 of the separation module 202 being connected to the first output 2011 of the detection module 201. The input 2020 of the separation module 202 is used for inputting the sound wave signal, the first output 2021 is used for outputting the amplitude of the audio signal, and the second output 2022 is used for outputting the amplitude of the ultrasonic signal.
The comparison module 203 is used for comparing the amplitude of the audio signal with the amplitude of the ultrasonic signal. The comparing block 203 comprises a first input 2030, a second input 2031 and an output 2032, the first input 2030 of the comparing block 203 being connected to the first output 2021 of the splitting block 202 and the second input 2031 being connected to the second output 2022 of the splitting block 202. The comparing module 203 has a first input 2030 for inputting the amplitude of the audio signal, a second input 2031 for inputting the amplitude of the ultrasonic signal, and an output 2032 for outputting a first control signal when the input value at the first input 2030 is smaller than the input value at the second input 2031, that is, when the amplitude of the audio signal is smaller than the amplitude of the ultrasonic signal, and outputting a second control signal when the input value at the first input 2030 is greater than or equal to the input value at the second input 2031, that is, when the amplitude of the audio signal is greater than or equal to the amplitude of the ultrasonic signal.
The control output module 204 is used for outputting the sound wave signal. The control output module 204 includes a control end 2040, an input end 2041 and an output end 2042, the control end 2040 of the control output module 204 is connected to the output end 2032 of the comparison module 203, and the input end 2041 is connected to the first output end 2011 of the detection module 201. The control end 2040 of the control output module 204 is used for inputting the first control signal or the second control signal. The input terminal 2041 is used for inputting a sound wave signal, the output terminal 2042 is used for outputting no sound wave signal (i.e., discarding the sound wave signal to filter out the audio signal) when the control terminal 2040 inputs a first control signal, and outputting the sound wave signal when the control terminal 2040 inputs a second control signal.
The detection module 201 may be a digital frequency meter, the separation module 202 may be a filter, the comparison module 203 may be a comparator, and the control output module 204 may be a transistor switch or a field effect transistor switch.
For example, the signal processing device 120 may also be implemented by the schematic diagram shown in fig. 6. The specific signal processing apparatus 120 includes a detection module 201, a separation module 202, a comparison module 203, a filtering module 205, and a selection output module 206. It should be noted that: the detection module 201 and the separation module 202 implement the function of the acquisition module 121 of the signal processing apparatus 120, the comparison module 203 implement the function of the comparison module 125 of the signal processing apparatus 120, the filtering module 205 implement the function of the filtering module 123 of the signal processing apparatus 120, and the selection output module 206 implement the function of the output module 124 of the signal processing apparatus 120.
Specifically, the detection module 201, the separation module 202 and the comparison module 203 refer to the above description, and are not described herein again.
The filtering module 205 is used to filter out the audio signal in the acoustic wave signal. The filter module 205 comprises an input 2050 and an output 2051, the input 2050 of the filter module 205 being connected to a first output 2011 of the detection module 201. The input end 2050 of the filtering module 205 is used for inputting the sound wave signal, and the output end 2051 is used for outputting the sound wave signal with the audio signal filtered out.
The selection output module 206 is used for outputting the sound wave signal. The selection output module 206 includes a control terminal 2060, a first input terminal 2061, a second input terminal 2062 and an output terminal 2063, the control terminal 2060 of the selection output module 206 is connected to the output terminal 2032 of the comparison module 203, the first input terminal 2061 is connected to the output terminal 2051 of the filtering module 205, and the second input terminal 2062 is connected to the first output terminal 2011 of the detection module 201. The control terminal 2060 of the selection output module 206 is used for inputting a first control signal or a second control signal, the first input terminal 2061 is used for inputting a sound wave signal with an audio signal filtered out, the second input terminal 2062 is used for inputting a sound wave signal, the output terminal 2063 is used for outputting the sound wave signal with the audio signal filtered out and input by the first input terminal 2061 when the control terminal 2060 inputs the first control signal, and outputting the sound wave signal input by the second input terminal 2062 when the control terminal 2060 inputs the second control signal.
The detection module 201 may be a digital frequency meter, the separation module 202 may be a filter, the comparison module 203 may be a comparator, the filter module 205 may be a high-pass filter, and the selection output module 206 may be an alternative selector.
The embodiment of the invention provides a signal processing device which can acquire a sound wave signal; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal. According to the scheme, when the amplitude of the audio signal is smaller than that of the ultrasonic signal, the audio signal can be judged not to be the voice signal sent by a user, and the terminal equipment can be controlled to execute some illegal action, so that the audio signal is filtered, the terminal equipment cannot be controlled, and further personal information of the user is prevented from being leaked.
Optionally, an embodiment of the present invention further provides a terminal device, including the signal processing apparatus 120 in the foregoing embodiment. The signal processing apparatus 120 can implement the processes in fig. 1 in the above method embodiments, and can achieve the same technical effect, and for avoiding repetition, the details are not described here again.
Optionally, as shown in fig. 7, the terminal device may further include a sound wave signal collecting module 130, an amplifying module 140, a filtering module 150, a coding and decoding module 160, and a speech engine module 170.
The sound wave signal collecting module 130 is configured to collect sound wave signals, the amplifying module 140 is configured to amplify the sound wave signals processed by the signal processing device 120, the filtering module 150 is configured to filter out ultrasonic wave signals in the sound wave signals amplified by the amplifying module 140, the encoding and decoding module 160 is configured to encode the sound wave signals output by the filtering module 150, and the speech engine module 170 is configured to identify the sound wave signals output by the encoding and decoding module 160.
The terminal equipment provided by the embodiment of the invention can acquire the sound wave signal; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal. According to the scheme, when the amplitude of the audio signal is smaller than that of the ultrasonic signal, the audio signal can be judged not to be the voice signal sent by a user, and the terminal equipment can be controlled to execute some illegal action, so that the audio signal is filtered, the terminal equipment cannot be controlled, and further personal information of the user is prevented from being leaked.
Fig. 8 is a schematic diagram of a hardware structure of a terminal device for implementing various embodiments of the present invention. As shown in fig. 8, the terminal device 100 includes but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the terminal device configuration shown in fig. 8 does not constitute a limitation of the terminal device, and that the terminal device may include more or fewer components than shown, or combine certain components, or a different arrangement of components. In the embodiment of the present invention, the terminal device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 110 is configured to acquire an acoustic wave signal; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and if the amplitude of the audio signal is smaller than that of the ultrasonic signal, filtering the audio signal.
The terminal equipment provided by the embodiment of the invention can acquire the sound wave signal; if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal; and filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal. According to the scheme, when the amplitude of the audio signal is smaller than that of the ultrasonic signal, the audio signal can be judged not to be the voice signal sent by a user, and the terminal equipment can be controlled to execute some illegal action, so that the audio signal is filtered, the terminal equipment cannot be controlled, and further personal information of the user is prevented from being leaked.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.
The terminal device provides wireless broadband internet access to the user through the network module 102, such as helping the user send and receive e-mails, browse webpages, access streaming media, and the like.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the terminal device 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.
The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.
The terminal device 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the terminal device 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the terminal device posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration identification related functions (such as pedometer, tapping), and the like; the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a liquid Crystal Display (L acquired Crystal Display, L CD), an Organic light-Emitting Diode (O L ED), or the like.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the terminal device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 8, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the terminal device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the terminal device, and is not limited herein.
The interface unit 108 is an interface for connecting an external device to the terminal apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the terminal apparatus 100 or may be used to transmit data between the terminal apparatus 100 and the external device.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the terminal device, connects various parts of the entire terminal device by using various interfaces and lines, and performs various functions of the terminal device and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the terminal device. Processor 110 may include one or more processing units; alternatively, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The terminal device 100 may further include a power supply 111 (such as a battery) for supplying power to each component, and optionally, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the terminal device 100 includes some functional modules that are not shown, and are not described in detail here.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A method of signal processing, the method comprising:
acquiring a sound wave signal;
if the sound wave signal comprises an ultrasonic wave signal, separating an audio signal and the ultrasonic wave signal from the sound wave signal;
filtering the audio signal if the amplitude of the audio signal is less than the amplitude of the ultrasonic signal;
wherein filtering out the audio signal comprises: discarding the acoustic signal to filter out the audio signal; alternatively, the audio signal is filtered out by a filter.
2. The method of claim 1, further comprising:
and if the ultrasonic wave signal is not contained in the sound wave signal, outputting the sound wave signal.
3. The method of claim 1, further comprising:
and if the amplitude of the audio signal is greater than or equal to that of the ultrasonic signal, outputting the sound wave signal.
4. The method according to any one of claims 1 to 3, wherein after separating the audio signal and the ultrasonic signal from the acoustic signal, the method further comprises:
acquiring the amplitude of the audio signal and the amplitude of the ultrasonic signal;
comparing the amplitude of the audio signal with the amplitude of the ultrasonic signal.
5. The signal processing device is characterized by comprising an acquisition module, a separation module and a filtering module;
the acquisition module is used for acquiring sound wave signals;
the separation module is used for separating an audio signal and an ultrasonic signal from the sound wave signal if the sound wave signal comprises the ultrasonic signal;
the filtering module is configured to filter the audio signal if the amplitude of the audio signal separated by the separation module is smaller than the amplitude of the ultrasonic signal;
wherein filtering out the audio signal comprises: discarding the acoustic signal to filter out the audio signal; alternatively, the audio signal is filtered out by a filter.
6. The apparatus of claim 5, further comprising: an output module;
the output module is configured to output the sound wave signal acquired by the acquisition module if the sound wave signal acquired by the acquisition module does not include the ultrasonic wave signal.
7. The apparatus of claim 5, further comprising: an output module;
the output module is configured to output the sound wave signal acquired by the acquisition module if the amplitude of the audio signal separated by the separation module is greater than or equal to the amplitude of the ultrasonic signal.
8. The apparatus of any of claims 5 to 7, further comprising: a comparison module;
the comparison module is used for acquiring the amplitude of the audio signal and the amplitude of the ultrasonic signal which are separated by the separation module before the audio signal is filtered by the filtering module; and comparing the amplitude of the audio signal with the amplitude of the ultrasonic signal.
9. A terminal device, characterized in that it comprises a signal processing apparatus according to any one of claims 5 to 7.
10. The terminal device according to claim 9, wherein the terminal device further comprises: the voice recognition system comprises a sound wave signal acquisition module, an amplification module, a filtering module, a coding and decoding module and a voice engine module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810022097.4A CN108305638B (en) | 2018-01-10 | 2018-01-10 | Signal processing method, signal processing device and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810022097.4A CN108305638B (en) | 2018-01-10 | 2018-01-10 | Signal processing method, signal processing device and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108305638A CN108305638A (en) | 2018-07-20 |
| CN108305638B true CN108305638B (en) | 2020-07-28 |
Family
ID=62868898
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810022097.4A Active CN108305638B (en) | 2018-01-10 | 2018-01-10 | Signal processing method, signal processing device and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108305638B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109831583B (en) * | 2019-01-28 | 2021-05-07 | 维沃移动通信有限公司 | Audio playing control method and terminal equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1378764A (en) * | 1999-08-26 | 2002-11-06 | 美国技术公司 | Modulator processing for parametric speaker system |
| CN104850278A (en) * | 2015-05-28 | 2015-08-19 | 北京京东方多媒体科技有限公司 | Non-contact control integrated machine and control method implemented by same |
| CN206117976U (en) * | 2016-08-30 | 2017-04-19 | 江西联创宏声电子股份有限公司 | Intelligent sound box |
| CN106686188A (en) * | 2016-12-29 | 2017-05-17 | 广东小天才科技有限公司 | Play control method of wearable device and wearable device |
| CN107171738A (en) * | 2017-06-29 | 2017-09-15 | 深圳传音控股有限公司 | The apparatus and method that ultrasonic propagation is carried out to audio |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170018282A1 (en) * | 2015-07-16 | 2017-01-19 | Chunghwa Picture Tubes, Ltd. | Audio processing system and audio processing method thereof |
-
2018
- 2018-01-10 CN CN201810022097.4A patent/CN108305638B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1378764A (en) * | 1999-08-26 | 2002-11-06 | 美国技术公司 | Modulator processing for parametric speaker system |
| CN104850278A (en) * | 2015-05-28 | 2015-08-19 | 北京京东方多媒体科技有限公司 | Non-contact control integrated machine and control method implemented by same |
| CN206117976U (en) * | 2016-08-30 | 2017-04-19 | 江西联创宏声电子股份有限公司 | Intelligent sound box |
| CN106686188A (en) * | 2016-12-29 | 2017-05-17 | 广东小天才科技有限公司 | Play control method of wearable device and wearable device |
| CN107171738A (en) * | 2017-06-29 | 2017-09-15 | 深圳传音控股有限公司 | The apparatus and method that ultrasonic propagation is carried out to audio |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108305638A (en) | 2018-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108459797B (en) | Control method of folding screen and mobile terminal | |
| CN109078319B (en) | Game interface display method and terminal | |
| CN108684029B (en) | Bluetooth pairing connection method and system, Bluetooth device and terminal | |
| CN107742523B (en) | Voice signal processing method and device and mobile terminal | |
| CN109994111B (en) | Interaction method, interaction device and mobile terminal | |
| CN110012143B (en) | Telephone receiver control method and terminal | |
| CN108551534B (en) | Method and device for multi-terminal voice call | |
| CN108521501B (en) | Voice input method, mobile terminal and computer readable storage medium | |
| CN107835495B (en) | Message prompting method and device and mobile terminal | |
| CN108540243B (en) | Radio frequency channel detection method and mobile terminal | |
| CN108848267B (en) | Audio playing method and mobile terminal | |
| CN107749306B (en) | Vibration optimization method and mobile terminal | |
| CN111182118B (en) | Volume adjusting method and electronic equipment | |
| CN111093137B (en) | Volume control method, volume control equipment and computer readable storage medium | |
| CN108632718B (en) | Audio sharing method and system | |
| CN108319440B (en) | Audio output method and mobile terminal | |
| CN108093119B (en) | Strange incoming call number marking method and mobile terminal | |
| CN108305638B (en) | Signal processing method, signal processing device and terminal equipment | |
| CN108430025B (en) | Detection method and mobile terminal | |
| CN107743174B (en) | Clipping judgment method of sound signal and mobile terminal | |
| CN110764650A (en) | Key trigger detection method and electronic equipment | |
| CN111031175B (en) | Electronic device and control method of electronic device | |
| CN109309758B (en) | Audio processing device, terminal equipment and signal processing method | |
| CN109819118B (en) | Volume adjusting method and mobile terminal | |
| CN110753391B (en) | Information transmission method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |