CN112329011A

CN112329011A - Sensor data processing method and device, electronic equipment and readable storage medium

Info

Publication number: CN112329011A
Application number: CN202011271293.9A
Authority: CN
Inventors: 张鹏; 周铮
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-11-13
Filing date: 2020-11-13
Publication date: 2021-02-05

Abstract

The application discloses a sensor data processing method and device, electronic equipment and a readable storage medium, and belongs to the technical field of communication. The method comprises the following steps: and when the fact that the sound changing component and the acceleration sensor are called is detected, the acceleration sensor is controlled to conduct preset processing on the collected sensor data, processed sensor data are obtained, and the processed sensor data are provided for the application program. Because the preset processing can hide the sound signal output by the sound changing component in the sensor data, when the application program calls the sensor data, the user information cannot be acquired through the processed sensor data, and the application program can be prevented from eavesdropping the user information under the condition that the user does not know.

Description

Sensor data processing method and device, electronic equipment and readable storage medium

Technical Field

The application belongs to the technical field of communication, and particularly relates to a sensor data processing method and device, electronic equipment and a readable storage medium.

Background

With the development and popularization of electronic devices, electronic devices have become an indispensable part of people's work and life. Various sensors are usually integrated in the electronic device, information such as the position, image and sound of a user can be acquired through the sensors, and the electronic device can provide various services for the user according to the acquired information.

In the process of implementing the present application, the inventor finds that at least the following problems exist in the prior art: under the condition that a user does not know, an application program in the electronic equipment can acquire vibration signals generated when the sound changing component (a receiver and a loudspeaker) acts through the acceleration sensor, and obtains sound signals of the user through vibration signal reconstruction, so that the user can be eavesdropped.

Disclosure of Invention

An object of the embodiments of the present application is to provide a sensor data processing method, an apparatus, an electronic device, and a readable storage medium, which can solve the problem that an application program eavesdrops on a user through an acceleration sensor.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a sensor data processing method, where the method includes:

detecting that the sound changing component and the acceleration sensor are called;

controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data; the preset processing is for concealing a sound signal output by the sound change section included in the sensor data.

In a second aspect, an embodiment of the present application provides a sensor data processing apparatus, including:

the detection module is used for detecting that the sound changing component and the acceleration sensor are called;

the control module is used for controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data; the preset processing is for concealing a sound signal output by the sound change section included in the sensor data.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, and when executed by the processor, the program or instructions implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, when the electronic device detects that the sound changing component and the acceleration sensor are called, the acceleration sensor is controlled to perform preset processing on the acquired sensor data to obtain processed sensor data, and the processed sensor data are provided for an application program. Because the preset processing can hide the sound signal output by the sound changing component in the sensor data, when the application program calls the sensor data, the user information cannot be acquired through the processed sensor data, and the application program can be prevented from eavesdropping the user information under the condition that the user does not know.

Drawings

FIG. 1 is a schematic diagram of an electronic device provided in accordance with an exemplary embodiment;

FIG. 2 is a schematic illustration of an analysis of sensor data provided in accordance with an exemplary embodiment;

FIG. 3 is a flow chart of steps of a method of processing sensor data provided in accordance with an exemplary embodiment;

FIG. 4 is a flow chart of steps of another method of sensor data processing provided in accordance with an exemplary embodiment;

FIG. 5 is a waveform diagram of sensor data before smoothing filtering provided in accordance with an exemplary embodiment;

FIG. 6 is a waveform diagram of a smoothed filtered sensor data provided in accordance with an exemplary embodiment;

FIG. 7 is a schematic block diagram of a sensor data processing apparatus according to an exemplary embodiment;

FIG. 8 is a schematic block diagram of another sensor data processing apparatus provided in accordance with an exemplary embodiment;

FIG. 9 is a schematic diagram of an electronic device provided in accordance with an exemplary embodiment;

fig. 10 is a schematic diagram of a hardware structure of an electronic device according to an exemplary embodiment.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

For a clearer explanation of the present invention, the principle of the acceleration sensor in the prior art will be briefly described first.

As shown in fig. 1, fig. 1 is a schematic structural diagram of an electronic device provided according to an exemplary embodiment, the electronic device 100 is a terminal device such as a mobile phone, a wearable device, and the like, a sound variation component may be integrated in the electronic device 100, the sound variation component includes an earpiece 101 or a speaker 102, and the electronic device may output a sound signal of a user through the sound variation component. For example, during a conversation with other users using the electronic device, the electronic device may output voice signals sent by the other users through the speaker.

Meanwhile, an acceleration sensor 103 is integrated in the electronic device, the acceleration sensor 103 is arranged in the electronic device, the acceleration sensor 103 can acquire motion information of the electronic device, such as linear acceleration and rotational acceleration, and the motion state of the electronic device can be judged through analysis of the motion information. When the sound changing component outputs a sound signal, the electronic equipment vibrates due to the action of the sound changing component, and a vibration signal is generated. When the acceleration sensor collects the motion information of the electronic equipment, the acceleration sensor can simultaneously collect vibration signals generated when the sound changing component acts.

As shown in fig. 2, fig. 2 is a schematic diagram of analysis of sensor data provided according to an exemplary embodiment, and the sensor data (motion information) acquired by an acceleration sensor is analyzed, so that a vibration signal generated when a sound-changing component moves can be analyzed, the vibration signal is reconstructed and restored, a sound signal 201 can be obtained, the sound signal 201 is identified, and user information 202 (such as an account number and a password) can be obtained. In the process that a user uses the electronic equipment, an Application program (APP) calls an acceleration sensor to acquire motion information of the electronic equipment under the condition that the user does not know, vibration signals generated when a sound changing component acts are analyzed and obtained from the motion information, and user information is acquired through the vibration signals, so that the user can be eavesdropped.

In order to solve the above technical problem, an embodiment of the present invention provides a sensor data processing method, and the sensor data processing method provided by the embodiment of the present invention is described in detail through specific embodiments and application scenarios thereof with reference to the accompanying drawings.

Fig. 3 is a flowchart of steps of a sensor data processing method provided according to an exemplary embodiment, as shown in fig. 3, the method including:

step 301, detecting that the sound changing component and the acceleration sensor are called.

In this embodiment, the electronic device may monitor the sound variation component and the acceleration sensor to determine whether the sound variation component and the acceleration sensor are called by the application program. For example, the electronic device may monitor the earpiece and speaker and determine that the sound-altering component is invoked by an application upon detecting that one or more of the earpiece and speaker is open by any of the applications. Or, the user may set an interrupt function in the electronic device for the sound-changing component, and when any one of the earphone and the speaker is opened by the application program, the interrupt function is triggered to notify the electronic device that the sound-changing component is called by the application program. Similarly, the electronic device may monitor the acceleration sensor to determine whether the acceleration sensor is called by the application.

The application program may be any application program in the electronic device, and the method for the electronic device to determine whether the sound changing component and the acceleration sensor are called by the application program may be set according to actual requirements, which is not limited in this embodiment.

And 302, controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data.

Wherein the preset processing is for hiding a sound signal output by the sound varying section included in the sensor data.

In this embodiment, when the electronic device detects that the sound variation component and the acceleration sensor are simultaneously called by the application program, the acceleration sensor may be controlled to perform preset processing on the acquired sensor data, so as to hide a sound signal output by the sound variation component included in the sensor data, and provide the processed sensor data for the application program calling the acceleration sensor. The preset processing on the sensor data may be filtering the sensor data, so as to filter information related to the sound signal in the sensor data, and make the filtered sensor data unable to be reconstructed to obtain the sound signal. Or, the sensor data added with the interference information is added into the sensor data, and the sensor data added with the interference information is provided for the application program, so that the application program cannot reconstruct and obtain the sound signal according to the sensor data added with the interference information. Or, the original sensor data is converted into the state information of the electronic device, so that the original sensor data is prevented from being provided for the application program, and the application program cannot reconstruct the sound signal according to the state information.

Illustratively, step 302 may be implemented as follows:

and controlling the acceleration sensor to filter the sensor data to obtain the processed sensor data.

In this embodiment, when the electronic device detects that the sound-changing component and the acceleration sensor are simultaneously called, the acceleration sensor may be controlled to perform filtering processing (preset processing) on the acquired sensor data. As an example, the filtering process may adopt a filtering method of low-pass filtering, and a cut-off frequency of the low-pass filtering may be set in advance, for example, the cut-off frequency is set to 85 hertz (Hz). When detecting that the sound changing component and the acceleration sensor are simultaneously called by an application program, the electronic equipment can send a filtering instruction and a cut-off frequency to the acceleration sensor, and trigger the acceleration sensor to perform low-pass filtering on the acquired sensor data. The acceleration sensor can respond to a filtering instruction sent by the electronic equipment, low-pass filtering is carried out on the collected sensor data according to the received cut-off frequency, and frequency components with the frequency being greater than or equal to 85Hz in the sensor data are filtered out. The specific value of the cut-off frequency can be set according to actual requirements, and the specific method for controlling the acceleration sensor to perform filtering processing on the sensor data by the electronic device can refer to the prior art, which is not described in detail in this embodiment.

After low pass filtering the sensor data to obtain filtered sensor data, i.e. processed sensor data, the acceleration sensor may provide the processed sensor data to the application. For example, if the voice communication APP calls the acceleration sensor, the acceleration sensor may send the filtered sensor data to the voice communication APP. Since the fundamental frequency of the sound signal is between 85Hz and 255Hz, when the frequency component with the frequency greater than or equal to 85Hz in the sensor data is filtered, the vibration signal generated by the audio signal included in the sensor data can be filtered, and the obtained processed sensor data only includes the motion information related to the motion state of the electronic equipment. The processed sensor data only comprises motion information, so that when the processed sensor data is analyzed, a vibration signal cannot be obtained through analysis, a sound signal cannot be reconstructed, and user information can be obtained.

The method for performing the preset processing on the sensor data may include, but is not limited to, a method for performing a filtering processing on the sensor data, and the method for performing the filtering processing on the sensor data may include, but is not limited to, a filtering method for low-pass filtering. In practical application, the sensor data acquired by the acceleration sensor is subjected to filtering processing, and information related to the sound signal in the sensor data can be filtered, so that an application program can be prevented from analyzing the sensor data to obtain the sound signal and obtain user information.

It should be noted that the electronic device may control the acceleration sensor to perform the preset processing on the sensor data when detecting that the sound-changing component and the acceleration sensor are simultaneously called by one application program, or may control the acceleration sensor to perform the preset processing on the sensor data when detecting that the sound-changing component and the acceleration sensor are respectively called by different application programs.

In summary, in this embodiment, when the electronic device detects that the sound variation component and the acceleration sensor are called, the acceleration sensor is controlled to perform preset processing on the acquired sensor data, so as to obtain processed sensor data, and provide the processed sensor data for the application program. The preset processing can hide the sound signal output by the sound changing component in the sensor data, so that when the application program calls the sensor data, the user information cannot be acquired through the processed sensor data, and the application program can be prevented from eavesdropping the user information under the condition that the user does not know.

FIG. 4 is a flow chart of steps of another sensor data processing method provided in accordance with an exemplary embodiment, which may include, as shown in FIG. 4:

step 401, detecting that the sound changing component and the acceleration sensor are called.

And 402, controlling the acceleration sensor to perform preset processing on the sensor data under the condition that the sound changing component is called by a preset application program to obtain processed sensor data.

In this embodiment, when the electronic device detects that the sound variation component and the acceleration sensor are simultaneously called, if the sound variation component is called by a preset application program, the electronic device may control the acceleration sensor to perform preset processing on the acquired sensor data.

The preset application program may be an application program that outputs a sound signal of a user, such as a dialing APP, a voice communication APP, an audio/video recording APP, and the like. In the process of using the electronic device by the user, the sound variation component is called by different application programs, which indicates that the user is in different scenes, in some scenes, the sound signal output by the sound variation component may contain the user information of the user, and in some scenes, the sound signal output by the sound variation component does not contain the user information of the user. For example, if the sound change component is called by the dialing APP to indicate that the user is currently talking with another user, the sound signal output by the sound change component may include user information of the user, and if the sound change component is called by the music playing APP to indicate that the user is playing music, the sound signal output by the sound change component does not include user information of the user.

In practical applications, the preset application program may be manually set by a user using the electronic device, or may be automatically identified and determined by the electronic device according to the authority required by the application program, for example, if the application program needs to acquire the authority to call the sound-changing component, the electronic device may identify the application program as the preset application program. Conversely, if the application does not need to obtain the right to invoke the voice-change component, the electronic device may identify the application as a non-default application. The setting method of the preset application program may be set according to the requirement, and this embodiment does not limit this.

When the sound changing component is called by the preset application program, the electronic equipment controls the acceleration sensor to preset collected sensor data, so that the situation that when the sound changing component is called by all application programs, the sensor data are preset can be avoided, and the power consumption of the electronic equipment can be reduced. Meanwhile, when the preset processing is not carried out on the sensor data, more information can be reserved in the sensor data, and the application program of the acceleration sensor can be conveniently called to accurately determine the motion state of the electronic equipment.

Optionally, the step of controlling the acceleration sensor to perform filtering processing on the sensor data to obtain the processed sensor data may be implemented by the following method:

acquiring a sound signal output by a sound changing component, and determining the fundamental frequency of the sound signal;

and controlling the acceleration sensor to filter out frequency components which are greater than or equal to the fundamental frequency in the sensor data to obtain the processed sensor data.

In this embodiment, the electronic device may control the acceleration sensor to perform filtering processing on the acquired sensor data according to the user's voice signal output by the current time varying component. For example, when detecting that the sound variation component and the acceleration sensor are called simultaneously, the electronic device may first acquire a sound signal currently output by the sound variation component. For example, when the sound changing component is called by the dialing APP and the acceleration sensor is called by another application program, the electronic device may obtain a section of sound signal of a preset length (e.g., 0.2 second) every preset time (e.g., 0.5 second), where the obtained sound signal may be a sound signal output by an earphone or a speaker, perform fourier transform on the obtained sound signal, and determine a fundamental frequency of the sound signal. After determining the fundamental frequency of the sound signal, the fundamental frequency can be used as a cut-off frequency, the fundamental frequency is sent to the acceleration sensor, the acceleration sensor is controlled to perform low-pass filtering on the acquired sensor data according to the fundamental frequency, frequency components which are greater than or equal to the fundamental frequency in the sensor data are filtered, and the processed sensor data are obtained. The method for determining the fundamental frequency of the sound signal may refer to the prior art, and this embodiment is not described in detail herein.

When the electronic device performs low-pass filtering on the acquired sensor data according to the fundamental frequency of the sound signal, more information can be retained in the processed sensor data while filtering the vibration signal (generated by the sound signal) in the sensor data, or the processed sensor data can be prevented from retaining part of the vibration signal. In combination with step 302, if the fundamental frequency of the sound signal of the user is 100Hz, when the electronic device controls the acceleration sensor to filter the sensor data at the cut-off frequency of 100Hz, the frequency component between 100Hz and 85Hz can be retained compared with the cut-off frequency of 85 Hz; if the fundamental frequency of the sound signal of the user is 50Hz, when the electronic device controls the acceleration sensor to filter the sensor data at a cut-off frequency of 50Hz, compared with a cut-off frequency of 85Hz, the frequency component between 50Hz and 85Hz can be filtered.

Optionally, the step of controlling the acceleration sensor to perform filtering processing on the sensor data to obtain the processed sensor data may also be implemented by the following method:

and controlling the acceleration sensor to carry out smooth filtering on the sensor data to obtain the processed sensor data.

In this embodiment, in the process of controlling the acceleration sensor to perform filtering processing on the acquired sensor data, the electronic device may control the acceleration sensor to perform smooth filtering on the acquired sensor data, so as to implement fuzzy processing on the sensor data, and obtain the processed sensor data. As shown in fig. 5 and 6, fig. 5 is a waveform diagram of sensor data before smoothing filtering provided according to an exemplary embodiment, fig. 6 is a waveform diagram of sensor data after smoothing filtering provided according to an exemplary embodiment, when detecting that a sound variation component and an acceleration sensor are simultaneously called, an electronic device may send a filtering instruction to the acceleration sensor, control the acceleration sensor to perform smoothing filtering on sensor data 501 including a vibration signal shown in fig. 5 by using a filtering method such as mean filtering or median filtering, and filter the sensor data 601 shown in fig. 6. In fig. 5 and 6, the abscissa is a time axis and the unit is milliseconds (ms), and the ordinate is an output value of the acceleration sensor and the unit is 0.0098 m/s (mg). As shown in fig. 6, after the sensor data is subjected to smoothing filtering, high frequency components (frequency components with frequencies between 85Hz and 255 Hz) in the processed sensor data are filtered out, and low frequency components related to motion information in the sensor data are retained. The specific implementation method of the smoothing filtering may refer to the prior art, and this embodiment will not be described in detail.

In practical application, when the sensor data is filtered by adopting a smooth filtering mode, a part related to motion information in the sensor data can be reserved, and a part related to sound signals can be filtered, so that an application program can be prevented from acquiring user information from the sensor data.

In summary, in this embodiment, when the electronic device detects that the sound variation component and the acceleration sensor are called, the acceleration sensor is controlled to perform preset processing on the acquired sensor data, so as to obtain processed sensor data, and provide the processed sensor data for the application program. Because the preset processing can hide the sound signal output by the sound changing component in the sensor data, when the application program calls the sensor data, the user information cannot be acquired through the processed sensor data, and the application program can be prevented from eavesdropping the user information under the condition that the user does not know.

Optionally, the step of controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain the processed sensor data may also be implemented in the following manner:

and controlling the acceleration sensor to convert the sensor data into state information corresponding to the preset condition under the condition that the sensor data meet the preset condition.

In this embodiment, when the electronic device detects that the sound-changing component and the acceleration sensor are simultaneously called, the electronic device may control the acceleration sensor to convert the sensor data into corresponding state information, so as to avoid providing original sensor data for an application program calling the acceleration sensor.

For example, the preset conditions may be preset accelerations of the electronic device in different directions, and with reference to fig. 2, the acceleration sensor may respectively acquire accelerations of the electronic device in the X-axis direction, the Y-axis direction, and the Z-axis direction to obtain sensor data, and the preset conditions may be a first preset acceleration, a second preset acceleration, and a third preset acceleration. The acceleration sensor may analyze the acquired sensor data to determine accelerations of the electronic device in X-axis, Y-axis, and Z-axis directions, respectively, and if it is determined that the acceleration of the electronic device in the X-axis direction is greater than or equal to a first preset acceleration, the acceleration of the electronic device in the Y-axis direction is greater than or equal to a second preset acceleration, and the acceleration of the electronic device in the Z-axis direction is greater than or equal to a third preset acceleration, the electronic device may be determined to be in a first motion state. Similarly, when the acceleration of the electronic device in the X-axis direction is determined to be greater than or equal to the first preset acceleration, the acceleration of the electronic device in the Y-axis direction is determined to be less than the second preset acceleration, and the acceleration of the electronic device in the Z-axis direction is determined to be less than the third preset acceleration, the electronic device may be determined to be in the second motion state. The state information of the first motion state may be set to "a" and the state information of the second motion state may be set to "B", respectively. When an application invokes an acceleration sensor, the acceleration sensor may provide state information "a" and state information "B" to the application, thereby avoiding providing raw sensor data directly to the application. The specific form of the preset condition and the state information corresponding to the preset condition may be set according to a requirement, which is not limited in this embodiment.

In practical application, the electronic device controls the acceleration sensor to convert the sensor data into corresponding state information, the state information is provided for the application program, and the situation that original sensor data are directly provided for the application program can be avoided, so that the situation that the application program obtains user information through analysis of the original sensor data and eavesdrops on a user can be avoided.

acquiring authority information of an application program calling the acceleration sensor;

and under the condition that the application program does not have the authority for calling the acceleration sensor according to the authority information, controlling the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data.

In practical application, a user may set corresponding permissions for each application program in the process of using the electronic device, for example, a permission to call the location information of the electronic device, and a permission to acquire a picture in the electronic device. Similarly, the user can set the authority of the application program for calling the acceleration sensor aiming at the acceleration sensor. When the electronic equipment detects that the sound changing component and the acceleration sensor are called simultaneously, authority information of an application program calling the acceleration sensor can be obtained firstly, and if the application program has the authority of calling the acceleration sensor in the prestored authority information, the acceleration sensor is controlled not to perform preset processing on sensor data, and original sensor data are directly provided for the application program. On the contrary, if the application program calling the acceleration sensor does not have the authority of calling the acceleration sensor, the acceleration sensor is controlled to perform preset processing on the sensor data, and the processed sensor data are provided for the application program.

The electronic equipment controls the acceleration sensor to perform preset processing on the sensor data when the application program does not have the authority of calling the acceleration sensor, provides the processed sensor data for the application program, and controls the acceleration sensor to provide original sensor data for the application program when the application program has the authority of calling the acceleration sensor. The method and the device have the advantages that the application program can provide original sensor data for the application program with the authority of calling the acceleration sensor while acquiring user information through analysis of the sensor data, and the application program calling the acceleration sensor can conveniently and accurately determine the motion state of the electronic equipment.

Optionally, the electronic device may output the call information when detecting that the acceleration sensor is called.

For example, the electronic device may display the call information through the display screen when detecting that the acceleration sensor is called by the application. For example, when detecting that the acceleration sensor is called by the voice communication APP, the electronic device may display "the acceleration sensor is called by the voice communication APP, and the device may be monitored by the voice communication APP" in the display screen to notify the user that the voice communication APP is calling the acceleration sensor, and there may be a risk of information leakage. The specific form of the call information and the specific method for the electronic device to output the call information may be set according to the requirement, which is not limited in this embodiment.

Optionally, the electronic device may control the acceleration sensor to decrease the sampling frequency when detecting that the sound variation component and the acceleration sensor are simultaneously called.

For example, the electronic device may send a down-conversion instruction to the acceleration sensor when detecting that the sound variation component and the acceleration sensor are simultaneously called, and the acceleration sensor may set the sampling frequency to a preset sampling frequency (e.g., 85Hz) in response to the down-conversion instruction sent by the electronic device. Because the frequency of the vibration signal generated by the sound signal is higher and is positioned between the 85Hz value and the 255Hz value, when the sampling frequency is reduced, the acceleration sensor can be prevented from acquiring the vibration signal with higher frequency, so that the acceleration sensor can be prevented from providing sensor data comprising the vibration signal for the application program, and the application program can be further prevented from eavesdropping user information of a user.

The method for controlling the acceleration sensor to perform the preset processing on the sensor data by the electronic device may include, but is not limited to, the filtering processing and the converting processing described in the above embodiment, or may perform the preset processing on the sensor data by adding the interference information to the sensor data (the specific method for adding the interference information to the sensor data may be set according to the requirement), and the specific manner of the preset processing is not specifically limited in this embodiment.

It should be noted that, in the sensor data processing method provided in the embodiment of the present application, the execution main body may be a sensor data processing apparatus, or a control module in the sensor data processing apparatus for executing the sensor data processing method. In the embodiment of the present application, a sensor data processing method executed by a sensor data processing apparatus is taken as an example, and the sensor data processing method provided in the embodiment of the present application is described.

Fig. 7 is a schematic structural diagram of a sensor data processing apparatus according to an exemplary embodiment, and as shown in fig. 7, a sensor data processing apparatus 700 includes: a detection module 701 and a control module 702.

The detection module 701 is used for detecting that the sound changing component and the acceleration sensor are called.

The control module 702 is configured to control the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data; the preset processing is for hiding the sound signal output by the sound change section included in the sensor data.

Optionally, the control module 702 is specifically configured to control the acceleration sensor to perform preset processing on the sensor data under the condition that the sound-changing component is called by a preset application program, so as to obtain processed sensor data.

Optionally, the control module 702 is specifically configured to control the acceleration sensor to perform filtering processing on the sensor data, so as to obtain processed sensor data.

As shown in fig. 8, fig. 8 is a schematic structural diagram of another sensor data processing apparatus provided according to an exemplary embodiment, and the control module 702 includes: an acquisition unit 7021 and a control unit 7022.

Acquiring unit 7021 is configured to acquire the sound signal output by the sound changing component and determine a fundamental frequency of the sound signal.

The control unit 7022 is configured to control the acceleration sensor to filter out frequency components greater than or equal to the fundamental frequency in the sensor data, so as to obtain processed sensor data.

Optionally, the control module 702 is specifically configured to control the acceleration sensor to convert the sensor data into state information corresponding to the preset condition when the sensor data meets the preset condition.

Optionally, the control module 702 is specifically configured to obtain permission information of an application program calling the acceleration sensor; and under the condition that the application program does not have the authority for calling the acceleration sensor according to the authority information, controlling the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data.

The sensor data processing device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The sensor data processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The sensor data processing apparatus provided in the embodiment of the present application can implement each process implemented by the method embodiment of fig. 3 or fig. 4, and is not described here again to avoid repetition.

As shown in fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an exemplary embodiment, where the electronic device 900 includes a processor 901, a memory 902, and a program or an instruction stored in the memory 902 and executable on the processor 901, and when the program or the instruction is executed by the processor 901, the process of the sensor data processing method embodiment is implemented, and the same technical effect can be achieved, and is not described herein again to avoid repetition.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

The electronic device 1000 includes, but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.

Those skilled in the art will appreciate that the electronic device 1000 may further comprise a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 10 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.

A processor 1010 to detect that the sound changing component and the acceleration sensor are invoked;

controlling an acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data; the preset processing is for hiding the sound signal output by the sound change section included in the sensor data.

Optionally, the processor 1010 is specifically configured to control the acceleration sensor to perform preset processing on the sensor data to obtain processed sensor data when the sound-changing component is called by a preset application program.

In practical application, when the sound variation component is called by a preset application program, the acceleration sensor is controlled to preset collected sensor data, so that the situation that when the sound variation component is called by all application programs, the sensor data are preset can be avoided, and the power consumption of the electronic equipment can be reduced. Meanwhile, when the preset processing is not carried out on the sensor data, more information can be reserved in the sensor data, and the application program of the acceleration sensor can be conveniently called to accurately determine the motion state of the electronic equipment.

Optionally, the processor 1010 is specifically configured to control the acceleration sensor to perform filtering processing on the sensor data, so as to obtain processed sensor data.

In practical application, the sensor data acquired by the acceleration sensor is subjected to filtering processing, and information related to the sound signal in the sensor data can be filtered, so that an application program can be prevented from analyzing the sensor data to obtain the sound signal and obtain user information.

Optionally, the processor 1010 is specifically configured to acquire a sound signal output by the sound changing component, and determine a fundamental frequency of the sound signal;

In practical application, when the acquired sensor data is low-pass filtered according to the fundamental frequency of the sound signal, more information can be retained in the processed sensor data while filtering the vibration signal (generated by the sound signal) in the sensor data, or the processed sensor data can be prevented from retaining part of the vibration signal.

Optionally, the processor 1010 is specifically configured to control the acceleration sensor to convert the sensor data into state information corresponding to a preset condition when the sensor data meets the preset condition.

Optionally, the processor 1010 is specifically configured to obtain authority information of an application program calling the acceleration sensor; and under the condition that the application program does not have the authority for calling the acceleration sensor according to the authority information, controlling the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data.

In practical application, when the application program does not have the authority of calling the acceleration sensor, the acceleration sensor is controlled to perform preset processing on the sensor data, the processed sensor data is provided for the application program, and when the application program has the authority of calling the acceleration sensor, the acceleration sensor is controlled to provide original sensor data for the application program. The method and the device have the advantages that the application program can provide original sensor data for the application program with the authority of calling the acceleration sensor while acquiring user information through analysis of the sensor data, and the application program calling the acceleration sensor can conveniently and accurately determine the motion state of the electronic equipment.

It should be understood that in the embodiment of the present application, the input Unit 1004 may include a Graphics Processing Unit (GPU) 10041 and a microphone 10042, and the Graphics Processing Unit 10041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also referred to as a touch screen. The touch panel 10071 may include two parts, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. The memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. Processor 1010 may integrate an application processor that handles primarily operating systems, user interfaces, applications, etc. and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1010.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the sensor data processing method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the sensor data processing method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A sensor data processing method, comprising:

2. The method according to claim 1, wherein the controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data comprises:

and under the condition that the sound changing component is called by a preset application program, controlling the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data.

3. The method according to claim 1, wherein the controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data comprises:

4. The method according to claim 1, wherein the controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data comprises:

and controlling the acceleration sensor to convert the sensor data into state information corresponding to a preset condition under the condition that the sensor data meet the preset condition.

5. The method according to claim 1, wherein the controlling the acceleration sensor to perform preset processing on the acquired sensor data to obtain processed sensor data comprises:

and under the condition that the application program does not have the authority of calling the acceleration sensor according to the authority information, controlling the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data.

6. A sensor data processing apparatus, comprising:

7. The device according to claim 6, wherein the control module is specifically configured to control the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data when the sound-changing component is called by a preset application program.

8. The device according to claim 6, wherein the control module is specifically configured to control the acceleration sensor to perform filtering processing on the sensor data to obtain the processed sensor data.

9. The device according to claim 6, wherein the control module is specifically configured to control the acceleration sensor to convert the sensor data into state information corresponding to a preset condition when the sensor data meets the preset condition.

10. The device according to claim 6, wherein the control module is specifically configured to obtain permission information of an application program calling the acceleration sensor; and under the condition that the application program does not have the authority of calling the acceleration sensor according to the authority information, controlling the acceleration sensor to perform preset processing on the sensor data to obtain the processed sensor data.