CN111565088B - Interference method of sensor signal in terminal equipment and related device - Google Patents

Interference method of sensor signal in terminal equipment and related device Download PDF

Info

Publication number
CN111565088B
CN111565088B CN202010680613.XA CN202010680613A CN111565088B CN 111565088 B CN111565088 B CN 111565088B CN 202010680613 A CN202010680613 A CN 202010680613A CN 111565088 B CN111565088 B CN 111565088B
Authority
CN
China
Prior art keywords
signal
sensor
parameter
interference
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010680613.XA
Other languages
Chinese (zh)
Other versions
CN111565088A (en
Inventor
于旸
陈昱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202010680613.XA priority Critical patent/CN111565088B/en
Publication of CN111565088A publication Critical patent/CN111565088A/en
Application granted granted Critical
Publication of CN111565088B publication Critical patent/CN111565088B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04KSECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K3/00Jamming of communication; Counter-measures
    • H04K3/80Jamming or countermeasure characterized by its function
    • H04K3/82Jamming or countermeasure characterized by its function related to preventing surveillance, interception or detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04KSECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K3/00Jamming of communication; Counter-measures
    • H04K3/40Jamming having variable characteristics
    • H04K3/42Jamming having variable characteristics characterized by the control of the jamming frequency or wavelength
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04KSECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K2203/00Jamming of communication; Countermeasures
    • H04K2203/10Jamming or countermeasure used for a particular application
    • H04K2203/16Jamming or countermeasure used for a particular application for telephony

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Soundproofing, Sound Blocking, And Sound Damping (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the application discloses a method for interfering sensor signals in terminal equipment and a related device, wherein the method comprises the following steps: acquiring a first sensor signal acquired by a target sensor, and determining a frequency domain amplitude parameter of the first sensor signal; obtaining a frequency domain amplitude parameter after interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter; the interference spectrum parameters are used for representing the interference of the electroacoustic transducer on the target sensor through the target noise signals; and determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor. The processing equipment can interfere the sensor signal acquired by the target sensor in the frequency domain amplitude based on the target noise signal with lower interference on the normal use of the target sensor, so that an eavesdropper cannot accurately process the acquired sound signal, and the influence on the normal use of the sensor is reduced while eavesdropping is prevented.

Description

Interference method of sensor signal in terminal equipment and related device
Technical Field
The present application relates to the field of data processing, and in particular, to a method and a related apparatus for interfering a sensor signal in a terminal device.
Background
With the miniaturization of the modules, various hardware modules can be configured in the terminal device to realize different functions. Such as various types of sensors, electro-acoustic transducers, etc. The electroacoustic transducer can convert an electric signal into a voice signal, for example, an earphone, a speaker, etc. in a mobile phone are common electroacoustic transducers.
The electroacoustic transducer may cause vibration of a terminal device when converting an electric signal into a voice signal, for example, a main board of the terminal device on which the electroacoustic transducer is disposed may vibrate, and some sensors disposed in the terminal device, for example, Micro Electro Mechanical Systems (MEMS) sensors, may capture a vibration signal generated by the vibration. By using the characteristic, an attacker can restore the voice signal causing the vibration through a voice reconstruction algorithm according to the vibration signal captured by the sensor, so that the eavesdropping on the terminal equipment is realized.
In order to avoid eavesdropping, the sampling rate of the sensors is limited in the related art, and although the possibility of eavesdropping is reduced to a certain extent, the actual data acquisition function of the sensors is directly affected, so that the applications or services needing to call the sensors cannot be used normally.
Disclosure of Invention
In order to solve the technical problem, the application provides an interference method for a sensor signal in terminal equipment, wherein a processing device can obtain an interference spectrum parameter based on a target noise signal with low interference on normal use of a target sensor, and the interference spectrum parameter interferes the sensor signal acquired by the target sensor in a frequency domain amplitude, so that an eavesdropper cannot accurately process the sensor signal after interference to obtain a sound signal, and the influence on normal use of the sensor is reduced while an anti-eavesdropping effect is achieved.
The embodiment of the application discloses the following technical scheme:
in a first aspect, an embodiment of the present application discloses a method for interfering a sensor signal in a terminal device, where the method includes:
acquiring a first sensor signal acquired by a target sensor,
determining a frequency domain amplitude parameter of the first sensor signal, wherein the target sensor is a sensor capable of collecting a vibration signal generated when an electric signal is converted into a sound signal through an electroacoustic converter;
obtaining a frequency domain amplitude parameter after interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter; wherein the disturbance spectrum parameter is used for representing the disturbance of the electroacoustic transducer on the target sensor through a target noise signal;
and determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor.
In a second aspect, an embodiment of the present application discloses an interference apparatus for a sensor signal in a terminal device, where the apparatus includes an acquisition unit, a first determination unit, a calculation unit, and a second determination unit:
the acquisition unit is used for acquiring a first sensor signal acquired by a target sensor;
the first determining unit is used for determining frequency domain amplitude parameters of the first sensor signal, wherein the target sensor is a sensor capable of collecting vibration signals, and the vibration signals are generated when the electric signals are converted into sound signals through an electroacoustic converter;
the calculating unit is used for obtaining a frequency domain amplitude parameter after interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter; wherein the disturbance spectrum parameter is used for representing the disturbance of the electroacoustic transducer on the target sensor through a target noise signal;
and the second determining unit is used for determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor.
In a third aspect, an embodiment of the present application discloses an apparatus for disturbing a sensor signal in a terminal device, the apparatus including a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to perform the method for interference of sensor signals in a terminal device according to the first aspect, according to instructions in the program code.
In a fourth aspect, an embodiment of the present application discloses a computer-readable storage medium for storing a computer program for executing the method for interfering a sensor signal in a terminal device according to the first aspect.
According to the technical scheme, when the electroacoustic converter converts the electric signal into the sound signal, the vibration signal is generated in the terminal equipment, the first sensor signal acquired by the target sensor is acquired aiming at the target sensor capable of acquiring the vibration signal, the corresponding frequency domain amplitude parameter is determined, and if the target sensor acquires the vibration signal caused by the electroacoustic converter, the frequency domain amplitude parameter can embody the signal amplitude of the kinematic signal to be acquired in the normal working range of the target sensor and can also embody the acoustic characteristic expressed by the vibration signal. In order to avoid that the acoustic features are restored by an eavesdropper to form an acoustic signal, the frequency domain amplitude parameters can be scrambled through the interference spectrum parameters, the interference spectrum parameters are determined based on the interference of the target noise signal to the target sensor, the target noise signal also belongs to an acoustic signal, the frequency domain where the interference to the target sensor is located is greatly overlapped with the vibration signal, the vibration signal included in the first sensor signal can be directly influenced through scrambling, and due to the fact that the frequency domain difference is large, the influence on the fact that the target sensor actually acquires the kinematic signals is small, and the actual service of the target sensor cannot be influenced. And the second sensor signal obtained according to the interfered frequency domain amplitude parameter is used as the output signal of the target sensor, so that even if an eavesdropper acquires the second sensor signal, the eavesdropper can not restore the sound signal due to scrambling, and the eavesdropping possibility is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of an interference method of a sensor signal in a terminal device in an actual application scenario according to an embodiment of the present application;
fig. 2 is a flowchart of a method for interfering a sensor signal in a terminal device according to an embodiment of the present disclosure;
fig. 3 is a schematic diagram of interference in an actual application scenario according to an embodiment of the present application;
fig. 4 is a schematic diagram of an interference method of a sensor signal in a terminal device in an actual application scenario according to an embodiment of the present application;
fig. 5 is a schematic diagram of an interference method of a sensor signal in a terminal device in an actual application scenario according to an embodiment of the present application;
fig. 6 is a block diagram of a structure of an interference apparatus for a sensor signal in a terminal device according to an embodiment of the present disclosure;
fig. 7 is a block diagram of an apparatus for disturbing a sensor signal in a terminal device according to an embodiment of the present disclosure;
fig. 8 is a block diagram of a server according to an embodiment of the present application.
Detailed Description
Embodiments of the present application are described below with reference to the accompanying drawings.
With the continuous development of information technology, information security has become one of the hot issues currently studied by related people. In various electronic devices used by people in daily life, there are many kinds of sensors, in which an electroacoustic transducer for generating sound can convert a collected electric signal into a sound signal to output. When outputting a sound signal, since sound is generated by vibration, a corresponding vibration signal may be generated. If the vibration signal is stolen, the sound signal can be restored conveniently according to the vibration signal, so that the sound signal is eavesdropped.
Wherein the vibration signal can be picked up by some sensor, for example a MEMS sensor. Therefore, in the related art, in order to prevent eavesdropping, the processing device may limit the sampling rate of such sensors, so that the sensors cannot acquire high-precision sensor signals, and an eavesdropper cannot restore accurate sound signals. However, since some applications or users may need to acquire some high-precision sensor signals when the sensor is normally used, the anti-eavesdropping implemented by limiting the sampling rate may cause that part of the normal use to be impossible.
In order to solve the technical problem, the application provides an interference method for a sensor signal in terminal equipment, wherein a processing device can obtain an interference spectrum parameter based on a target noise signal with low interference on normal use of a target sensor, and the interference spectrum parameter interferes the sensor signal acquired by the target sensor in a frequency domain amplitude, so that an eavesdropper cannot accurately process the sensor signal after interference to obtain a sound signal, and the influence on normal use of the sensor is reduced while an anti-eavesdropping effect is achieved.
It is understood that the method may be applied to a processing device having a signal interference function, for example, a terminal device or a server having a signal interference function. The method can be independently executed through the terminal equipment or the server, can also be applied to a network scene of communication between the terminal equipment and the server, and is executed through the cooperation of the terminal equipment and the server. The server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing cloud computing services. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein. Meanwhile, in a hardware environment, the technology has been implemented in the following environments: an ARM architecture processor, an X86 architecture processor; in a software environment, the technology has been implemented in the following environments: android platform, Windows xp and operating systems or Linux operating systems.
In addition, the application also relates to the technical field of cloud, for example, cloud security technology can be involved.
Cloud Security (Cloud Security) refers to a generic term for Security software, hardware, users, organizations, secure Cloud platforms based on Cloud computing business model applications. The cloud security integrates emerging technologies and concepts such as parallel processing, grid computing and unknown virus behavior judgment, abnormal monitoring of software behaviors in the network is achieved through a large number of meshed clients, the latest information of trojans and malicious programs in the internet is obtained and sent to the server for automatic analysis and processing, and then the virus and trojan solution is distributed to each client.
The main research directions of cloud security include: 1. the cloud computing security mainly researches how to guarantee the security of the cloud and various applications on the cloud, including the security of a cloud computer system, the secure storage and isolation of user data, user access authentication, information transmission security, network attack protection, compliance audit and the like; 2. the cloud of the security infrastructure mainly researches how to adopt cloud computing to newly build and integrate security infrastructure resources and optimize a security protection mechanism, and comprises the steps of constructing a super-large-scale security event and an information acquisition and processing platform through a cloud computing technology, realizing the acquisition and correlation analysis of mass information, and improving the handling control capability and the risk control capability of the security event of the whole network; 3. the cloud security service mainly researches various security services, such as anti-virus services and the like, provided for users based on a cloud computing platform.
In the technical scheme provided by the application, the safety protection of the sound signal can be realized based on a cloud safety technology, for example, the sensor signal acquired by the target sensor can be interfered by a cloud server.
In order to facilitate understanding of the technical solution of the present application, a method for interfering a sensor signal in a terminal device provided in the embodiments of the present application will be described below with reference to an actual application scenario.
Referring to fig. 1, fig. 1 is a schematic diagram of an interference method of a sensor signal in a terminal device in an actual application scenario according to an embodiment of the present application. In this practical application scenario, the processing device is a terminal device 101 capable of performing voice call, the terminal device 101 has a main board carrying various components, and the main board is mounted with an electroacoustic converter and a speed sensor. Wherein, electroacoustic transducer can be with the signal conversion sound signal of gathering, and speed sensor can gather the vibration signal that transmits on terminal equipment 101's the speed signal and the mainboard.
When a user uses the terminal apparatus 101 for a voice call, since the electroacoustic transducer needs to transmit a sound signal by means of vibration, the main board is caused to vibrate along with the electroacoustic transducer. The speed sensor can collect vibration signals transmitted from the main board when the electroacoustic transducer converts an electric signal into a sound signal, and the vibration signals and the speed signals collected by the speed sensor form first sensor signals.
The speed signal can identify the speed generated by the terminal device 101 in the process of being used, and the speed signal can be acquired by some conventional application software in the terminal device, such as some sports application software, health application software, and the like, so as to analyze the sports information of the user, and such application mode belongs to the normal application of the first sensor signal; the vibration signal can identify the vibration of the terminal device 101 caused by the sound signal, and therefore if the vibration signal is stolen maliciously, the call information of the user may be leaked.
It is understood that, during normal use of the terminal device 101, besides the voice signal when the user is talking, some daily noise signals, such as a noise signal of the surrounding environment, a vehicle voice signal on the lane, etc., may be touched. In general, different types of signals may have different frequency domain characteristics, and the signal types of the sound signal and the kinematic signal such as the velocity signal are different greatly, so that there may be a large difference in the frequency domain, and thus the noise signals do not have a large influence on the accuracy of the velocity signal acquired by the velocity sensor in the frequency domain amplitude. For example, when a user walks on a noisy sidewalk, the moving software in the terminal device 101 can still accurately record the walking speed of the user, and therefore, the speed signal acquired by the speed sensor has strong anti-interference capability on such noise signals.
When the sound signal is obtained through the vibration signal processing, the obtained sound signal has a high degree of correlation with the frequency domain amplitude parameter of the vibration signal, and the frequency domain amplitude parameter can embody the sound characteristic of the sound signal, so that if the frequency domain amplitude parameter of the vibration signal is interfered, the sound signal obtained through the restoration of the vibration signal may be distorted to a certain extent, and an eavesdropper cannot eavesdrop the terminal device 101 through the vibration signal. Because the vibration signal is generated based on the sound signal, and the noise signal belongs to the same sound signal, the frequency domain is closer to the vibration signal, and the frequency domain amplitude parameter of the vibration signal can be effectively interfered by the noise signal.
Based on this, in order to realize the anti-eavesdropping function and avoid influencing the normal use of the speed sensor as much as possible, the terminal device 101 may acquire a section of target noise signal in daily use, and determine an interference spectrum parameter through the target noise signal, where the interference spectrum parameter is used to interfere with a frequency domain amplitude parameter of the first sensor signal acquired by the speed sensor. Before outputting the first sensor signal collected by the speed sensor, the terminal device 101 may determine a frequency domain amplitude parameter of the first sensor signal based on the first sensor signal. Then, the terminal device 101 may interfere with the frequency domain amplitude parameter through the interference spectrum parameter to obtain an interfered frequency domain amplitude parameter, determine the sensor signal according to the interfered frequency domain amplitude parameter to obtain a second sensor signal, and convert the second sensor signal into an output signal of the target sensor for output.
Because the frequency domain amplitude parameter of the second sensor signal is already interfered by the interference spectrum parameter, and the frequency domain amplitude parameter of the vibration signal is greatly influenced by the interference spectrum parameter, even if the terminal device 101 is intercepted, the eavesdropper cannot process the vibration signal in the second sensor signal output by the speed sensor to obtain an accurate sound signal; meanwhile, the interference frequency spectrum parameter is determined through the target noise signal, so that the influence on the frequency domain amplitude parameter of the speed signal in the second sensor signal is small, the influence on the interference processing is small in the process of normally using the second sensor signal, and the normal use of the speed sensor is guaranteed to a certain extent while the anti-eavesdropping effect is achieved.
Next, a method for disturbing a sensor signal in a terminal device according to an embodiment of the present application will be described with reference to the accompanying drawings.
Referring to fig. 2, fig. 2 is a flowchart of a method for interfering a sensor signal in a terminal device according to an embodiment of the present application, where the method includes:
s201: a first sensor signal acquired by a target sensor is acquired.
The sensor is an important component for realizing signal acquisition and transmission at present, and different types of sensors can acquire different types of signals, for example, a speed sensor can acquire a speed signal of equipment where the sensor is located, and a temperature sensor can acquire a temperature signal of the equipment where the sensor is located. Among them, the MEMS sensor is one of the sensors widely used in recent years, has many advantages of small volume, light weight, high reliability, and the like, and is a key object of research by the following related people.
In a terminal device capable of emitting a sound signal, an electroacoustic transducer is generally provided, which is capable of converting a collected electric signal into a sound signal to output the sound signal. Since the sound is generated by the vibration of the object, the part contacted by the electroacoustic transducer generates a vibration signal due to the vibration during the conversion process of the electroacoustic transducer, and some sensors, such as MEMS sensors, can collect the vibration signal. If the vibration signal collected by the sensor is stolen maliciously, the stealing party can process the vibration signal and restore the corresponding sound signal, so that the terminal equipment can be eavesdropped.
In order to prevent the terminal device from being eavesdropped due to the fact that the signal collected by the target sensor in the terminal device is stolen, in the embodiment of the application, the processing device may interfere with the first sensor signal collected by the target sensor before the target sensor outputs the signal. The target sensor is a sensor capable of collecting a vibration signal generated when an electric signal is converted into an acoustic signal by an electroacoustic converter. First, the processing device may acquire a first sensor signal acquired by a target sensor.
S202: a frequency domain amplitude parameter of the first sensor signal is determined.
It will be appreciated that the first sensor signal collected by the target sensor does not necessarily include a vibration signal, since the electroacoustic sensor is not constantly converting the signal. The target sensor collects a vibration signal, and also collects a corresponding sensor signal in a normal working process, for example, when the target sensor is an acceleration sensor, and when the electroacoustic transducer outputs a sound signal, the acceleration sensor can collect not only the vibration signal generated by the sound signal, but also the acceleration signal of the terminal equipment where the acceleration sensor is located. Therefore, when the first sensor signal collected by the target sensor is interfered, if the interference manner adopted is not proper, the target sensor may not normally provide the signal collected by itself, and an application party needing to use the signal may not normally operate.
In order to perform targeted interference on the vibration signal possibly included in the first sensor signal, in the embodiment of the present application, the characteristics of the signal itself may be analyzed to determine the difference point between the vibration signal and the signals collected by other target sensors. Research shows that the vibration signal can restore the sound signal mainly because the frequency domain feature of the vibration signal can embody the acoustic feature of the sound signal, that is, the vibration signal is closer to the frequency domain feature of the sound signal in the frequency domain feature. When the sound signal is reduced, it is actually the frequency domain amplitude parameter of the vibration signal, which is the characteristic parameter of the signal in the frequency domain, that is analyzed and processed.
And because other signals collected by the target sensor are not collected based on the sound signals, the signal type of the signals is different from the sound signals greatly, so that the similarity degree with the sound signals on the frequency domain characteristics is low, namely, the frequency domain amplitude parameters of the signals are different from the frequency domain amplitude parameters of the sound signals greatly. It can be seen that the vibration signal in the first sensor signal is greatly different from other signals in the frequency domain. Based on this, the processing device may disturb the first sensor signal in a frequency domain feature in order to disturb the vibration signal without affecting the normal use of other signals.
First, the processing device may determine a frequency domain amplitude parameter of the first sensor signal based on the first sensor signal acquired by the target sensor. The method for determining the frequency domain amplitude parameter may include multiple methods, and in the embodiment of the present application, the frequency domain amplitude parameter may be determined by using a fourier transform. The processing device may register a first sensor signal as x, which first sensor signalThe number x is formed by a frame signal, and the processing device can divide the signal x into a multi-frame signal with the length of N and the number of overlapping points of two adjacent frames of M by taking N as the frame length and M as the number of overlapping points of the two adjacent frames. Wherein, the value of M can be taken from various methods
Figure 795074DEST_PATH_IMAGE001
Or
Figure 737622DEST_PATH_IMAGE002
In the embodiments of the present application mean
Figure 362508DEST_PATH_IMAGE003
. At this time, the corresponding analysis window
Figure 783125DEST_PATH_IMAGE004
The following were used:
Figure 193377DEST_PATH_IMAGE005
where n is an argument, the analysis window is a window function for performing fourier transform on the signal x, and a certain error can be eliminated by adding the analysis window when performing short-time fourier transform. After framing and adding an analysis window, obtaining a frame signal of an m-th frame
Figure 41248DEST_PATH_IMAGE006
The following were used:
Figure 156359DEST_PATH_IMAGE007
the processing device may then transform the frame signal by discrete fourier transform
Figure 318350DEST_PATH_IMAGE008
Transforming from time domain to frequency domain to obtain frame signal in frequency domain
Figure 645426DEST_PATH_IMAGE009
Figure 116727DEST_PATH_IMAGE010
Wherein,
Figure 529254DEST_PATH_IMAGE011
are common parameters required for fourier transformation. The processing device may derive the frame signal from a frequency domain
Figure 229357DEST_PATH_IMAGE012
Separating out frame amplitude
Figure 410940DEST_PATH_IMAGE013
Sum frame phase
Figure 53142DEST_PATH_IMAGE014
. Wherein the frame phase
Figure 952965DEST_PATH_IMAGE015
I.e. the phase amplitude parameter of the first sensor signal x, since the main disturbance of the processing device is a frequency domain characteristic, the processing device is a phase-amplitude parameter of the first sensor signal x
Figure 456759DEST_PATH_IMAGE016
Can be kept unchanged, will
Figure 492848DEST_PATH_IMAGE017
As a frequency domain amplitude parameter of the first sensor signal x.
S203: and obtaining the frequency domain amplitude parameter after the interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter.
As already mentioned above, the vibration signal differs considerably from the other signals contained in the first sensor signal in terms of frequency domain characteristics, so that, in order to be able to specifically disturb the vibration signal, the processing device can determine the parameters for disturbance from the signals which are closer to the frequency domain characteristics of the vibration signal. The processing device can generate the interference parameter by the sound signal because the frequency domain characteristics of the vibration signal and the sound signal are relatively close.
In selecting the sound signal for determining the disturbance parameter, the processing device may select a sound signal having a smaller influence on the other signal from among the plurality of sound signals in order to reduce the influence on the other signal as much as possible. It can be understood that various noise signals are contacted in daily use of the terminal device, for example, when the mobile phone is used on a sidewalk, the sound of a vehicle running on a lane and the speaking sound of surrounding people can be used as the noise signals to cause the mobile phone to vibrate to generate vibration signals, and various application software in the mobile phone cannot be easily interfered by the noise signals when the sensor signals collected by a sensor in the mobile phone are used. For example, when the speed measuring software and the step counting software in the mobile phone are operated, accurate speed measurement and step counting can be still performed even in a noisy environment. It follows that the sensor signals acquired by the target sensor, which are required for normal use, are less affected by these noise signals, i.e. they differ more in frequency domain characteristics from these noise signals.
The noise signal is also one of the sound signals and is closer to the vibration signal in frequency domain characteristics, so that if the frequency domain amplitude parameter of the first sensor signal is interfered based on the noise signal, the vibration signal is effectively interfered to a certain extent, and meanwhile, the influence on other normal sensor signals is reduced as much as possible. Based on this, the processing device may acquire a segment of the target noise signal and determine the interference spectrum parameter based on the target noise signal. The target noise signal refers to a noise signal that can be touched when the target sensor is in normal use, and may be, for example, background noise of an environment where a terminal device carrying the target sensor is located. The interference spectrum parameter is generated based on the frequency domain characteristics of the target noise signal, and in order to simulate the interference situation of the target sensor in normal use, the processing device can process the target noise signal through the electroacoustic converter to obtain the interference spectrum parameter, so that the interference spectrum parameter can be used for representing the interference of the electroacoustic converter on the target sensor through the target noise signal.
The processing device may obtain the frequency domain amplitude parameter after the interference according to the interference spectrum parameter and the frequency domain amplitude parameter, where the method for interfering with the frequency domain amplitude parameter by the interference spectrum parameter may include multiple methods, and in a possible implementation manner, because the frequency domain amplitude parameter is interfered, the processing device may determine a corresponding amplitude gain parameter according to the interference spectrum parameter, and the amplitude gain parameter may represent the interference of the interference spectrum parameter on the sensor signal in the frequency domain amplitude. The processing device may obtain the frequency domain amplitude parameter after the interference according to the amplitude gain parameter and the frequency domain amplitude parameter.
It is understood that the determination method of the amplitude gain parameter may also include various methods. In one possible implementation, the processing device may determine an amplitude gain parameter corresponding to the target sensor according to the interference spectrum parameter and the frequency domain amplitude parameter. For example, the processing device determines the interference spectrum parameter corresponding to the target noise signal
Figure 119002DEST_PATH_IMAGE018
Then, the amplitude gain can be calculated by the following equation
Figure 693071DEST_PATH_IMAGE019
Figure 797293DEST_PATH_IMAGE020
Wherein,
Figure 891151DEST_PATH_IMAGE021
for interfering spectral parameters
Figure 688206DEST_PATH_IMAGE022
Is used for embodying the interference frequency domain parameter X (n) to the frequency domain amplitude parameter in the frequency domain amplitude
Figure 486922DEST_PATH_IMAGE023
The influence of (c). As mentioned above, since the sound characteristic is due to the frequency of the vibration signalThe interception of the sound signal is mainly to process the frequency domain characteristic of the signal, so that the interference on the phase parameter does not have a significant interference effect on the sound signal. Therefore, in order to simplify the interference flow and improve the efficiency of the interference processing, in one possible implementation, the processing device may not interfere with the phase parameter of the first sensor signal when the frequency domain amplitude parameter is interfered according to the amplitude gain parameter, that is, the phase parameter of the first sensor signal is the same as the phase parameter of the second sensor signal. The processing device may obtain the disturbed frequency domain amplitude parameter according to the amplitude gain parameter, the frequency domain amplitude parameter, and the phase parameter of the first sensor signal.
For example, the frequency domain amplitude parameter after applying the interference is obtained by the amplitude gain
Figure 660415DEST_PATH_IMAGE024
The following were used:
Figure 608779DEST_PATH_IMAGE025
wherein,
Figure 576735DEST_PATH_IMAGE026
representing the amplitude gain of the sensor signal for the mth frame,
Figure 672867DEST_PATH_IMAGE027
is a phase amplitude parameter of the first sensor signal x. Since the phase parameter used in the frequency domain amplitude parameter after the interference is the phase amplitude parameter of the first sensor signal x, when the second sensor signal is obtained by processing the frequency domain amplitude parameter after the interference, the phase parameter of the second sensor signal is the same as the phase parameter of the first sensor signal.
S204: and determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor.
After obtaining the disturbed frequency domain amplitude parameter, since the frequency domain amplitude parameter is obtained by transforming the sensor signal into a form, the form may not be normally used by a user who needs the sensor signal, and therefore, the processing device needs to restore the processed sensor signal to a normal form. In this embodiment, the processing device may determine the second sensor signal according to the frequency domain amplitude parameter after the interference, and use the second sensor signal as an output signal of the target sensor.
The manner of determining the second sensor signal according to the disturbed frequency domain amplitude parameter may include multiple manners, and in one possible implementation, the processing device may perform the interference on the disturbed frequency domain amplitude parameter
Figure 305843DEST_PATH_IMAGE028
Performing inverse discrete Fourier transform, and transforming the inverse discrete Fourier transform from the frequency domain to the time domain to obtain a time domain frame signal
Figure 436610DEST_PATH_IMAGE029
Figure 513150DEST_PATH_IMAGE030
Subsequently, since the processing is performed through the analysis window in the foregoing process, the time-domain frame signal is also required to be processed in the inverse transformation process
Figure 96578DEST_PATH_IMAGE031
Additive composite window
Figure 533245DEST_PATH_IMAGE032
The composite window
Figure 518518DEST_PATH_IMAGE032
Is a rectangular window, corresponding to
Figure 765960DEST_PATH_IMAGE033
And an analysis window
Figure 836684DEST_PATH_IMAGE034
Figure 890091DEST_PATH_IMAGE035
The processing device may add the signals after adding the synthesis window frame by frame to obtain a second sensor signal
Figure 916821DEST_PATH_IMAGE036
Figure 397481DEST_PATH_IMAGE037
The processing device may convert the second sensor signal
Figure 627605DEST_PATH_IMAGE038
The output signal of the target sensor is output to a user such as an application program that needs to use the sensor signal. According to the technical scheme, when the electroacoustic converter converts the electric signal into the sound signal, the vibration signal is generated in the terminal equipment, the first sensor signal acquired by the target sensor is acquired aiming at the target sensor capable of acquiring the vibration signal, the corresponding frequency domain amplitude parameter is determined, and if the target sensor acquires the vibration signal caused by the electroacoustic converter, the frequency domain amplitude parameter can embody the signal amplitude of the kinematic signal to be acquired in the normal working range of the target sensor and can also embody the acoustic characteristic expressed by the vibration signal. In order to avoid that the acoustic features are restored by an eavesdropper to form an acoustic signal, the frequency domain amplitude parameters can be scrambled through the interference spectrum parameters, the interference spectrum parameters are determined based on the interference of the target noise signal to the target sensor, the target noise signal also belongs to an acoustic signal, the frequency domain where the interference to the target sensor is located is greatly overlapped with the vibration signal, the vibration signal included in the first sensor signal can be directly influenced through scrambling, and due to the fact that the frequency domain difference is large, the influence on the fact that the target sensor actually acquires the kinematic signals is small, and the actual service of the target sensor cannot be influenced. Will be based on the disturbed frequency domain amplitude parameterThe obtained second sensor signal is used as the output signal of the target sensor, so that even if an eavesdropper acquires the second sensor signal, the audio signal is difficult to restore due to scrambling, and the possibility of eavesdropping is reduced.
In order to facilitate timely processing of sensor signals acquired by a target sensor, in a possible implementation manner, a processing device may determine interference spectrum parameters for interference in advance before processing, so that when interference processing is required, the processing device may directly acquire the interference spectrum parameters for use without temporarily generating the interference spectrum parameters, thereby saving the time for the interference processing.
Meanwhile, the determination method of the interference spectrum parameter may also include multiple manners. It can be understood that the vibration signals generated by the same vibration source are often similar in frequency domain characteristics, so that several scrambling spectrum parameters are the same as the vibration source of the vibration signal collected by the target sensor, and even if an eavesdropper wants to filter out the interference signal in the interfered second sensor signal by using a signal filtering technique, the interference spectrum parameters are too similar to the frequency domain characteristics of the vibration signal, which is difficult to implement.
Based on this, in order to further improve the effectiveness of the interference, in one possible implementation, the processing device may play the target noise signal through the electroacoustic transducer, collect a target vibration signal collected by the target transducer during the playing of the target noise signal, and determine the interference spectrum parameter according to the target vibration signal. Because the vibration signal collected by the target sensor is also generated by playing the sound signal through the acoustic converter, the target vibration signal collected by the target sensor and the vibration signal possibly included in the first sensor signal come from the same vibration source and are closer to each other in frequency domain characteristics, so that the interference frequency spectrum parameter determined according to the target vibration signal can carry out more targeted interference on the frequency domain amplitude parameter of the vibration signal, the interfered second sensor signal is difficult to carry out signal filtering, and the effectiveness of the interference is improved.
It can be understood that the target sensor provides normal service, so that the sensor signal required to be acquired is usually in a lower frequency band, for example, the frequency of the kinematic signal such as the acceleration signal, the velocity signal, and the like acquired by the MEMS sensor is often lower than the frequency of the sound signal and the vibration signal, and therefore, in order to improve the pertinence of the interference spectrum parameter to the interference of the vibration signal, in one possible implementation, when determining the interference spectrum parameter, the processing device may obtain the interference spectrum parameter by performing high-pass filtering on the target vibration signal. The frequency range adopted by the high-pass filtering is determined according to the auditory frequency range, namely, the high-pass filtering is performed according to the frequency range of the sound signal which can be overheard by an eavesdropper, for example, the frequency range can be 50-100 Hz, so that the target vibration signal in the auditory frequency range is filtered out, and the interference spectrum parameter obtained according to the target vibration signal is closer to the vibration signal in the frequency domain characteristic. When interference occurs, the frequency of the vibration signal is usually higher than the frequencies of other sensor signals, so that the influence of interference spectrum parameters on the low-frequency sensor signals can be reduced.
Since the electroacoustic transducer does not perform signal conversion all the time, but only when performing signal conversion, the target transducer can acquire the vibration signal related to the sound signal generated by conversion, and when no signal conversion is performed, the first transducer signal cannot be processed to obtain a sound signal which may be leaked even if the first transducer signal is stolen. Therefore, in order to reduce the impact on the normal use of the target sensor, in one possible implementation, the processing device may determine whether the electroacoustic transducer performs the conversion of the electrical signal into the sound signal, and if so, perform the step of obtaining the disturbed frequency-domain amplitude parameter from the disturbance spectral parameter and the frequency-domain amplitude parameter during the conversion of the electrical signal into the sound signal by the electroacoustic transducer. Meanwhile, the processing pressure of the processing equipment can be relieved to a certain extent due to the reduction of the interference frequency.
It will be appreciated that the content configuration may also differ due to the different functional complexity of different terminal devices. For example, when a sound box plays sound, the main requirement is to satisfy the function of playing sound, and a mobile phone needs to have both the function of playing sound and the function of playing a receiver that satisfies the requirement of a user for voice communication. The electroacoustic transducers corresponding to different sound playing functions may also be different, and therefore, the same terminal device may include a plurality of electroacoustic transducers, that is, different vibration signals collected by the target sensor may originate from different electroacoustic transducers.
It has been mentioned above that interfering spectral parameters from the same source can interfere more effectively with the sensor signal. Therefore, in a possible implementation manner, the terminal device has a first electroacoustic transducer and a second electroacoustic transducer capable of performing signal conversion, and the processing device may preset a corresponding interference spectrum parameter for each electroacoustic transducer by the above-mentioned interference spectrum parameter determination manner. In the process of performing the disturbance, the processing device may determine that the target converter performs conversion of the electric signal into the sound signal, where the target converter is an electroacoustic converter performing the signal conversion, and may include any one or more of the first electroacoustic converter and the second electroacoustic converter. In order to improve the effectiveness of the interference, the processing device may obtain the frequency domain amplitude parameter after the interference according to the interference spectrum parameter and the frequency domain amplitude parameter corresponding to the target converter.
For example, the processing device may set the interference spectrum parameter corresponding to the first electroacoustic transducer to be l (n), and the interference spectrum parameter corresponding to the second electroacoustic transducer to be r (n). When the processing device determines the interference of the interference spectrum parameter to the frequency domain amplitude parameter in the manner of the amplitude gain parameter, if it is determined that the first electroacoustic transducer performs signal conversion, the formula of the amplitude gain h (n) is obtained as follows:
Figure 484703DEST_PATH_IMAGE039
if the second electroacoustic transducer is determined to perform signal conversion, the formula of the amplitude gain h (n) is obtained as follows:
Figure 178990DEST_PATH_IMAGE040
if the first electroacoustic transducer and the second electroacoustic transducer are determined to perform signal conversion, the formula of the amplitude gain h (n) is obtained as follows:
Figure 32150DEST_PATH_IMAGE041
it will be appreciated that the target sensor and the electroacoustic sensor may be mounted differently in different application scenarios. For example, in some application scenarios, the target sensor and the electroacoustic transducer may be configured in the same terminal device, for example, the target sensor and the electroacoustic transducer may be mounted on the same motherboard; in another part of application scenarios, the target sensor and the electroacoustic sensor may also be configured in different terminal devices, for example, the target sensor may be configured in one detection device, and the electroacoustic sensor may be configured in one device to be tested, and the detection device may be attached to the device to be tested, so that the target sensor can acquire a vibration signal through relaying of vibration. However, in any arrangement, it is practically sufficient that the target sensor can collect the vibration signal generated by the electroacoustic transducer through signal conversion.
In addition, the use of the second sensor signal output by the target sensor may include a plurality of types. In a possible implementation manner, the user of the second sensor signal may be an application installed in the terminal device, and if the processing device obtains a data call request of the application in the terminal device to the target sensor, the processing device returns the second sensor signal to the application. For example, when the target sensor is a speed sensor, a fitness application installed in the terminal device needs to acquire a speed signal acquired by the speed sensor to analyze the motion state of the user. After processing the sensor signal collected by the speed sensor, the processing device may send the processed sensor signal to the fitness application after receiving the data call request sent by the fitness application.
Next, a method for interfering a sensor signal in a terminal device provided in the embodiment of the present application will be described in conjunction with a practical application scenario. In this practical application scenario, the processing device is a mobile phone with a call function used by a user in daily life, and the target sensor is a MEMS sensor, as shown in fig. 5, the MEMS sensor includes an acceleration sensor and a gyroscope. The MEMS sensor and the electroacoustic transducer are mounted on the same main board of the mobile phone. Wherein the electroacoustic transducer comprises a loudspeaker and an earpiece.
As shown in fig. 3, fig. 3 is a schematic diagram of an interference method of a sensor signal in a terminal device in an actual application scenario. After the MEMS sensor acquires the MEMS signal, the mobile phone may perform short-time fourier transform (STFT) on the signal, divide the signal into a phase parameter and a frequency domain amplitude parameter, and then detect whether the receiver and the speaker are sounding, that is, whether the conversion from the electrical signal to the sound signal is performed. The processing device may perform earpiece interference and/or speaker interference on the frequency domain amplitude parameter according to the actual occurrence. After the frequency domain amplitude parameter is interfered, the mobile phone may perform short-time inverse fourier transform (ispft) according to the phase parameter and the interfered frequency domain amplitude parameter, to obtain an interfered MEMS signal, and output the interfered MEMS signal.
The specific interference method is shown in fig. 4:
s401: the earpiece or speaker plays the random noise.
Firstly, the mobile phone can determine interference spectrum parameters corresponding to a loudspeaker and an earphone respectively. The random noise is obtained by collecting noise in a daily environment.
S402: the mobile phone stands still, and the MEMS sensor collects vibration signals from a receiver or a loudspeaker.
In order to make the vibration signal cleaner, the mobile phone can be placed still to prevent additional vibration caused by other operations. When the earpiece or speaker plays noise, it causes vibration of the main plate, which the MEMS sensor can pick up.
S403: to vibrationCarrying out high-pass filtering on the signal to obtain interference frequency spectrum parameters
Figure 77466DEST_PATH_IMAGE042
Or
Figure 410359DEST_PATH_IMAGE043
S404: and acquiring the MEMS signal acquired by the MEMS sensor.
S405: frequency domain amplitude parameters of the MEMS signal are determined.
S406: detecting whether the earphone and the loudspeaker sound.
In order to make the interference to the MEMS signal more accurate, the mobile phone may first determine which electroacoustic transducer is currently sounding, thereby determining the corresponding interference spectrum parameter.
S407: detecting only the sounding of the receiver, and determining R (n) as the interference spectrum parameter.
S408: detecting only speaker sounding, and determining L (n) as an interference spectrum parameter.
S409: detecting the occurrence of both the receiver and the loudspeaker, and determining R (n) and L (n) as interference spectrum parameters.
S410: and determining an amplitude gain parameter according to the interference spectrum parameter.
S411: and obtaining the interfered MEMS signal according to the amplitude gain parameter and the frequency domain amplitude parameter.
S412: and outputting the interfered MEMS signal to an application party.
Based on the method for interfering a sensor signal in a terminal device provided in the foregoing embodiment, an embodiment of the present application further provides an apparatus for interfering a sensor signal in a terminal device, and referring to fig. 6, the apparatus 600 includes an obtaining unit 601, a first determining unit 602, a calculating unit 603, and a second determining unit 604:
an obtaining unit 601 for obtaining a first sensor signal collected by a target sensor
A first determining unit 602, configured to determine a frequency domain amplitude parameter of a first sensor signal, where a target sensor is a sensor capable of acquiring a vibration signal, and the vibration signal is generated when an electric signal is converted into a sound signal by an electroacoustic converter;
the calculating unit 603 is configured to obtain a frequency domain amplitude parameter after interference according to the interference spectrum parameter and the frequency domain amplitude parameter; the interference spectrum parameters are used for representing the interference of the electroacoustic transducer on the target sensor through the target noise signals;
a second determining unit 604, configured to determine a second sensor signal according to the disturbed frequency domain amplitude parameter, and use the second sensor signal as an output signal of the target sensor.
In one possible implementation manner, the apparatus 600 further includes a playing unit, a collecting unit, and a third determining unit:
a playing unit for playing the target noise signal through the electroacoustic transducer;
the collecting unit is used for collecting a target vibration signal collected by the target sensor in the target noise signal playing process;
and the third determining unit is used for determining the interference frequency spectrum parameters according to the target vibration signal.
In a possible implementation manner, the third determining unit is specifically configured to:
carrying out high-pass filtering on the target vibration signal to obtain interference frequency spectrum parameters; the frequency range used for the high-pass filtering is determined from the auditory frequency range.
In a possible implementation manner, the apparatus 600 further includes a fourth determining unit:
a fourth determination unit for determining whether or not the electroacoustic transducer performs conversion of the electric signal into a sound signal;
if so, during the period of converting the electric signal into the sound signal by the electroacoustic converter, the step of obtaining the frequency domain amplitude parameter after the interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter is executed.
In a possible implementation manner, if the electroacoustic transducer configured in the terminal device includes a first electroacoustic transducer and a second electroacoustic transducer, the fourth determining unit is specifically configured to:
determining a target converter to convert the electric signal into a sound signal, wherein the target converter comprises any one or more of a first electro-acoustic converter or a second electro-acoustic converter;
the calculating unit 603 is specifically configured to:
and obtaining the frequency domain amplitude parameter after the interference according to the interference spectrum parameter corresponding to the target converter and the frequency domain amplitude parameter.
In one possible implementation, the phase parameter of the first sensor signal is the same as the phase parameter of the second sensor signal.
In a possible implementation manner, the computing unit 603 is specifically configured to:
determining an amplitude gain parameter of a corresponding target sensor according to the interference spectrum parameter;
and obtaining the frequency domain amplitude parameter after the interference according to the amplitude gain parameter and the frequency domain amplitude parameter.
In a possible implementation manner, the computing unit 603 is specifically configured to:
determining an amplitude gain parameter corresponding to the target sensor according to the interference spectrum parameter and the frequency domain amplitude parameter;
and obtaining the frequency domain amplitude parameter after the interference according to the amplitude gain parameter, the frequency domain amplitude parameter and the phase parameter of the first sensor signal.
In a possible implementation, the target sensor and the electroacoustic transducer are configured in the same terminal device, and the apparatus 600 further comprises a return unit:
and the returning unit is used for returning a second sensor signal to the application if the data calling request of the application to the target sensor in the terminal equipment is acquired.
The embodiment of the present application further provides a device for disturbing a sensor signal in a terminal device, which is described below with reference to the accompanying drawings. Referring to fig. 7, an embodiment of the present application provides a device, which may also be a terminal device, where the terminal device may be any intelligent terminal including a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), a Point of Sales (POS), a vehicle-mounted computer, and the terminal device is taken as the mobile phone as an example:
fig. 7 is a block diagram illustrating a partial structure of a mobile phone related to a terminal device provided in an embodiment of the present application. Referring to fig. 7, the handset includes: radio Frequency (RF) circuit 710, memory 720, input unit 730, display unit 740, sensor 750, audio circuit 760, wireless fidelity (WiFi) module 770, processor 780, and power supply 790. Those skilled in the art will appreciate that the handset configuration shown in fig. 7 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the mobile phone in detail with reference to fig. 7:
the RF circuit 710 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information of a base station and then processes the received downlink information to the processor 780; in addition, the data for designing uplink is transmitted to the base station. In general, the RF circuit 710 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 710 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.
The memory 720 may be used to store software programs and modules, and the processor 780 may execute various functional applications and data processing of the cellular phone by operating the software programs and modules stored in the memory 720. The memory 720 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 720 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The input unit 730 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 730 may include a touch panel 731 and other input devices 732. The touch panel 731, also referred to as a touch screen, can collect touch operations of a user (e.g. operations of the user on or near the touch panel 731 by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. Alternatively, the touch panel 731 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts it to touch point coordinates, and sends the touch point coordinates to the processor 780, and can receive and execute commands from the processor 780. In addition, the touch panel 731 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 730 may include other input devices 732 in addition to the touch panel 731. In particular, other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 740 may be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 740 may include a display panel 741, and optionally, the display panel 741 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch panel 731 can cover the display panel 741, and when the touch panel 731 detects a touch operation on or near the touch panel 731, the touch operation is transmitted to the processor 780 to determine the type of the touch event, and then the processor 780 provides a corresponding visual output on the display panel 741 according to the type of the touch event. Although the touch panel 731 and the display panel 741 are two independent components in fig. 7 to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 731 and the display panel 741 may be integrated to implement the input and output functions of the mobile phone.
The handset may also include at least one sensor 750, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 741 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 741 and/or a backlight when the mobile phone is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, can be used for applications of recognizing the gesture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and tapping) and the like, and can also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor and the like, which are not described herein again.
Audio circuitry 760, speaker 761, and microphone 762 may provide an audio interface between a user and a cell phone. The audio circuit 760 can transmit the electrical signal converted from the received audio data to the speaker 761, and the electrical signal is converted into a sound signal by the speaker 761 and output; on the other hand, the microphone 762 converts the collected sound signal into an electric signal, converts the electric signal into audio data after being received by the audio circuit 760, and then processes the audio data output processor 780, and then transmits the audio data to, for example, another cellular phone through the RF circuit 710, or outputs the audio data to the memory 720 for further processing.
WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 770, and provides wireless broadband Internet access for the user. Although fig. 7 shows the WiFi module 770, it is understood that it does not belong to the essential constitution of the handset, and can be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 780 is a control center of the mobile phone, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 720 and calling data stored in the memory 720, thereby integrally monitoring the mobile phone. Optionally, processor 780 may include one or more processing units; preferably, the processor 780 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 780.
The handset also includes a power supply 790 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 780 via a power management system, so that the power management system may be used to manage charging, discharging, and power consumption.
Although not shown, the mobile phone may further include a camera, a bluetooth module, etc., which are not described herein.
In this embodiment, the processor 780 included in the terminal device further has the following functions:
acquiring a first sensor signal acquired by a target sensor;
determining a frequency domain amplitude parameter of the first sensor signal, wherein the target sensor is a sensor capable of collecting a vibration signal generated when an electric signal is converted into a sound signal through an electroacoustic converter;
obtaining a frequency domain amplitude parameter after interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter; wherein the disturbance spectrum parameter is used for representing the disturbance of the electroacoustic transducer on the target sensor through a target noise signal;
and determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor.
Referring to fig. 8, fig. 8 is a block diagram of a server 800 provided in this embodiment, and the server 800 may have a relatively large difference due to different configurations or performances, and may include one or more Central Processing Units (CPUs) 822 (e.g., one or more processors) and a memory 832, and one or more storage media 830 (e.g., one or more mass storage devices) storing an application 842 or data 844. Memory 832 and storage medium 830 may be, among other things, transient or persistent storage. The program stored in the storage medium 830 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Still further, a central processor 822 may be provided in communication with the storage medium 830 for executing a series of instruction operations in the storage medium 830 on the server 800.
The server 800 may also include one or more power supplies 826, one or more wired or wireless network interfaces 850, one or more input-output interfaces 858, and/or one or more operating systems 841, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, and so forth.
The steps performed by the server in the above embodiments may be based on the server structure shown in fig. 8.
The embodiment of the present application further provides a computer-readable storage medium for storing a computer program, where the computer program is used to execute any one implementation of the method for interfering a sensor signal in a terminal device described in the foregoing embodiments.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium may be at least one of the following media: various media that can store program codes, such as read-only memory (ROM), RAM, magnetic disk, or optical disk.
It should be noted that, in the present specification, all the embodiments are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus and system embodiments, since they are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described embodiments of the apparatus and system are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only one specific embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (15)

1. A method for interfering with a sensor signal in a terminal device, the method comprising:
acquiring a first sensor signal acquired by a target sensor;
determining a frequency domain amplitude parameter of the first sensor signal, wherein the target sensor is a sensor capable of collecting a vibration signal generated when an electric signal is converted into a sound signal through an electroacoustic converter;
obtaining a frequency domain amplitude parameter after interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter; wherein the disturbance spectrum parameter is used for representing the disturbance of the electroacoustic transducer on the target sensor through a target noise signal;
and determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor.
2. The method of claim 1, further comprising:
playing the target noise signal through the electro-acoustic transducer;
collecting a target vibration signal collected by the target sensor in the target noise signal playing process;
and determining the interference frequency spectrum parameters according to the target vibration signals.
3. The method of claim 2, wherein the determining the interference spectrum parameter from the target vibration signal comprises:
obtaining the interference frequency spectrum parameter by carrying out high-pass filtering on the target vibration signal; the frequency range used for the high-pass filtering is determined from the auditory frequency range.
4. The method of claim 1, further comprising:
determining whether the electroacoustic transducer performs conversion of an electric signal into a sound signal;
and if so, during the period of converting the electric signal into the sound signal by the electroacoustic converter, executing the step of obtaining the frequency domain amplitude parameter after the interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter.
5. The method of claim 4, wherein if the electroacoustic transducer of the terminal device comprises a first electroacoustic transducer and a second electroacoustic transducer, the determining whether the electroacoustic transducer performs the conversion of the electrical signal into the sound signal comprises:
determining a target converter to convert the electric signal into a sound signal, wherein the target converter comprises any one or more of a first electro-acoustic converter or a second electro-acoustic converter;
the obtaining of the frequency domain amplitude parameter after the interference according to the interference spectrum parameter and the frequency domain amplitude parameter includes:
and obtaining the frequency domain amplitude parameter after the interference according to the interference spectrum parameter corresponding to the target converter and the frequency domain amplitude parameter.
6. The method of claim 1, wherein the obtaining the frequency-domain amplitude parameter after the interference according to the interference spectrum parameter and the frequency-domain amplitude parameter comprises:
determining an amplitude gain parameter corresponding to the target sensor according to the interference spectrum parameter;
and obtaining the frequency domain amplitude parameter after the interference according to the amplitude gain parameter and the frequency domain amplitude parameter.
7. The method of claim 6, wherein determining an amplitude gain parameter corresponding to the target sensor from the interference spectrum parameter comprises:
determining an amplitude gain parameter corresponding to the target sensor according to the interference spectrum parameter and the frequency domain amplitude parameter;
the obtaining of the frequency domain amplitude parameter after the interference according to the amplitude gain parameter and the frequency domain amplitude parameter includes:
and obtaining the interfered frequency domain amplitude parameter according to the amplitude gain parameter, the frequency domain amplitude parameter and the phase parameter of the first sensor signal.
8. The method of claim 1, wherein the target sensor and the electro-acoustic transducer are configured in the same terminal device, the method further comprising:
and if a data call request of the application in the terminal equipment to the target sensor is obtained, returning the second sensor signal to the application.
9. An interference device of a sensor signal in a terminal device is characterized by comprising an acquisition unit, a first determination unit, a calculation unit and a second determination unit:
the acquisition unit is used for acquiring a first sensor signal acquired by a target sensor;
the first determining unit is used for determining frequency domain amplitude parameters of the first sensor signal, wherein the target sensor is a sensor capable of collecting vibration signals, and the vibration signals are generated when the electric signals are converted into sound signals through an electroacoustic converter;
the calculating unit is used for obtaining a frequency domain amplitude parameter after interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter; wherein the disturbance spectrum parameter is used for representing the disturbance of the electroacoustic transducer on the target sensor through a target noise signal;
and the second determining unit is used for determining a second sensor signal according to the frequency domain amplitude parameter after the interference, and taking the second sensor signal as an output signal of the target sensor.
10. The apparatus according to claim 9, further comprising a play unit, a collection unit, and a third determination unit:
the playing unit is used for playing the target noise signal through the electroacoustic transducer;
the collecting unit is used for collecting a target vibration signal collected by the target sensor in the target noise signal playing process;
the third determining unit is configured to determine the interference spectrum parameter according to the target vibration signal.
11. The apparatus according to claim 10, wherein the third determining unit is specifically configured to:
obtaining the interference frequency spectrum parameter by carrying out high-pass filtering on the target vibration signal; the frequency range used for the high-pass filtering is determined from the auditory frequency range.
12. The apparatus according to claim 9, characterized in that the apparatus further comprises a fourth determination unit:
the fourth determination unit is configured to determine whether the electroacoustic transducer performs conversion of the electric signal into a sound signal;
and if so, during the period of converting the electric signal into the sound signal by the electroacoustic converter, executing the step of obtaining the frequency domain amplitude parameter after the interference according to the interference frequency spectrum parameter and the frequency domain amplitude parameter.
13. The apparatus according to claim 12, wherein if the electroacoustic transducer of the terminal device comprises a first electroacoustic transducer and a second electroacoustic transducer, the fourth determining unit is specifically configured to:
determining a target converter to convert the electric signal into a sound signal, wherein the target converter comprises any one or more of a first electro-acoustic converter or a second electro-acoustic converter;
the computing unit is specifically configured to:
and obtaining the frequency domain amplitude parameter after the interference according to the interference spectrum parameter corresponding to the target converter and the frequency domain amplitude parameter.
14. An apparatus for disturbing a sensor signal in a terminal device, the apparatus comprising a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to perform the method for interfering with a sensor signal in a terminal device according to any one of claims 1 to 8 according to instructions in the program code.
15. A computer-readable storage medium, characterized in that the computer-readable storage medium is used for storing a computer program for executing the method of interference of a sensor signal in a terminal device according to any of claims 1-8.
CN202010680613.XA 2020-07-15 2020-07-15 Interference method of sensor signal in terminal equipment and related device Active CN111565088B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010680613.XA CN111565088B (en) 2020-07-15 2020-07-15 Interference method of sensor signal in terminal equipment and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010680613.XA CN111565088B (en) 2020-07-15 2020-07-15 Interference method of sensor signal in terminal equipment and related device

Publications (2)

Publication Number Publication Date
CN111565088A CN111565088A (en) 2020-08-21
CN111565088B true CN111565088B (en) 2020-10-16

Family

ID=72072833

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010680613.XA Active CN111565088B (en) 2020-07-15 2020-07-15 Interference method of sensor signal in terminal equipment and related device

Country Status (1)

Country Link
CN (1) CN111565088B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112003670A (en) * 2020-08-27 2020-11-27 维沃移动通信有限公司 Privacy protection method and device and electronic equipment
CN112329011A (en) * 2020-11-13 2021-02-05 维沃移动通信有限公司 Sensor data processing method and device, electronic equipment and readable storage medium
CN114553324A (en) * 2020-11-18 2022-05-27 北京小米移动软件有限公司 Method and device for eliminating resonant frequency interference, mobile terminal and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050059075A (en) * 2002-08-20 2005-06-17 더 리전트 오브 더 유니버시티 오브 캘리포니아 Vibration detectors, sound detectors, hearing aids, cochlear implants and related methods
CN104538039B (en) * 2015-01-07 2017-07-28 中国人民解放军国防科学技术大学 Utilize the audio conferencing security system and time slot scrambling of echo cancellation function
CN104579628B (en) * 2015-01-07 2017-10-17 中国人民解放军国防科学技术大学 Audio conferencing security system and time slot scrambling
CN106160897B (en) * 2016-07-29 2018-07-06 浙江工业大学 A kind of anti-interference frequency spectrum access method of anti-eavesdrop based on bandwidth and power distribution
JP6669011B2 (en) * 2016-08-29 2020-03-18 沖電気工業株式会社 Active noise control device, active noise control program, and active noise control method
CN107154256B (en) * 2017-06-27 2023-11-24 山东省计算中心(国家超级计算济南中心) Sound masking system based on sound source positioning and self-adaptive adjusting method

Also Published As

Publication number Publication date
CN111565088A (en) 2020-08-21

Similar Documents

Publication Publication Date Title
CN111565088B (en) Interference method of sensor signal in terminal equipment and related device
US10924614B2 (en) Speech signal processing method and apparatus
CN109256146B (en) Audio detection method, device and storage medium
CN109768810B (en) Signal processing circuit, terminal equipment and signal processing method
CN109004947A (en) A kind of radio-frequency unit and electronic equipment
CN107993672B (en) Frequency band expanding method and device
CN110536193B (en) Audio signal processing method and device
CN109274437A (en) A kind of camera anti-interference method, equipment and computer readable storage medium
CN107785027B (en) Audio processing method and electronic equipment
CN108492837B (en) Method, device and storage medium for detecting audio burst white noise
CN111477243A (en) Audio signal processing method and electronic equipment
CN111405416A (en) Stereo recording method, electronic device and storage medium
CN107749306B (en) Vibration optimization method and mobile terminal
CN110636530B (en) Method for processing adjacent channel interference and terminal equipment
CN107728990B (en) Audio playing method, mobile terminal and computer readable storage medium
CN110677770B (en) Sound production control method, electronic device, and medium
CN111863006B (en) Audio signal processing method, audio signal processing device and earphone
CN110049395B (en) Earphone control method and earphone device
CN109889665B (en) Volume adjusting method, mobile terminal and storage medium
CN111399011A (en) Position information determining method and electronic equipment
CN108900361B (en) Cloud resource configuration determining method and device and electronic equipment
CN113518152B (en) Telephone number identification method and system and electronic equipment
CN110139181B (en) Audio processing method and device, earphone, terminal equipment and storage medium
CN110971335B (en) Signal processing method and device and electronic equipment
CN115884088A (en) Method and device for determining equipment position information and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40027325

Country of ref document: HK