CN110502109B - Information processing method, information processing device, electronic equipment and storage medium - Google Patents
Information processing method, information processing device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110502109B CN110502109B CN201910702558.7A CN201910702558A CN110502109B CN 110502109 B CN110502109 B CN 110502109B CN 201910702558 A CN201910702558 A CN 201910702558A CN 110502109 B CN110502109 B CN 110502109B
- Authority
- CN
- China
- Prior art keywords
- motion state
- signal processor
- digital signal
- relative motion
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
- G06F1/3215—Monitoring of peripheral devices
- G06F1/3218—Monitoring of peripheral devices of display devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
The application discloses an information processing method, an information processing device, electronic equipment and a storage medium, and belongs to the technical field of communication. The method is applied to a communication digital signal processor of electronic equipment, the electronic equipment further comprises an audio digital signal processor, a gesture detection device and a screen, and the method comprises the following steps: acquiring a relative motion state sent by the audio digital signal processor; determining attitude information of the electronic equipment according to the attitude data; and controlling the screen to be on or off according to the posture information and the relative motion state. According to the information processing method, the communication digital signal processor can control on and off of the screen of the electronic equipment by combining the attitude information and the relative motion state of the electronic equipment, and power consumption generated by data transmission can be reduced to a certain extent.
Description
Technical Field
The present application relates to the field of communications technologies, and in particular, to an information processing method and apparatus, an electronic device, and a storage medium.
Background
In recent years, with the development of electronic devices, functions implemented by the electronic devices are more and more diversified and intelligent, for example, a screen of the electronic device is turned off or turned on through keys of the electronic device. The existing screen extinguishing or lighting operation is mostly realized by pressing keys in electronic equipment by a user, namely the existing control mode of the screen state is relatively rigid and low in intelligence.
Disclosure of Invention
In view of the above, the present invention provides an information processing method, an information processing apparatus, an electronic device, and a storage medium to solve the above problems.
In a first aspect, an embodiment of the present application provides an information processing method applied to a communication digital signal processor of an electronic device, where the electronic device further includes an audio digital signal processor, a gesture detection device, and a screen, and the method includes: acquiring a relative motion state sent by the audio digital signal processor, wherein the relative motion state is a motion state between the electronic equipment and an object, and the relative motion state is acquired by the audio digital signal processor according to the received audio data returned by the object; acquiring attitude data acquired by the attitude detection device; determining attitude information of the electronic equipment according to the attitude data; and controlling the screen to be on or off according to the posture information of the electronic equipment and the relative motion state.
In a second aspect, an embodiment of the present application provides an information processing method applied to an audio digital signal processor of an electronic device, where the electronic device further includes a communication digital signal processor, a gesture detection device, and a screen, and the method includes: acquiring a relative motion state according to audio data returned by an object, wherein the relative motion state is a motion state between the electronic equipment and the object; and sending the relative motion state to the communication digital signal processor, indicating the communication digital signal processor to acquire the attitude data acquired by the attitude detection device, determining the attitude information of the electronic equipment according to the attitude data, and controlling the screen to be on or off according to the attitude information of the electronic equipment and the relative motion state.
In a third aspect, an embodiment of the present application provides an information processing apparatus, which is applied to a communication digital signal processor of an electronic device, where the electronic device further includes an audio digital signal processor, a gesture detection apparatus, and a screen. The device comprises: the device comprises a first state acquisition module, a posture data acquisition module, a posture information determination module and a screen control module. The first state acquisition module is used for acquiring a relative motion state sent by the audio digital signal processor, wherein the relative motion state is a motion state between the electronic equipment and an object, and the relative motion state is acquired by the audio digital signal processor according to received audio data returned by the object. And the attitude data acquisition module is used for acquiring the attitude data acquired by the attitude detection device. The attitude information determination module is used for determining the attitude information of the electronic equipment according to the attitude data. And the screen control module is used for controlling the screen to be on or off according to the posture information of the electronic equipment and the relative motion state.
In a fourth aspect, an embodiment of the present application provides an information processing apparatus applied to an audio digital signal processor of an electronic device, where the electronic device further includes a communication digital signal processor, a gesture detection apparatus, and a screen. The device comprises: the device comprises a second state acquisition module and a motion state sending module, wherein the second state acquisition module is used for acquiring a relative motion state according to audio data returned by an object, and the relative motion state is a motion state between the electronic equipment and the object. And the motion state sending module is used for sending the relative motion state to the communication digital signal processor, indicating the communication digital signal processor to acquire the attitude data acquired by the attitude detection device, determining the attitude information of the electronic equipment according to the attitude data, and controlling the screen to be on or off according to the attitude information of the electronic equipment and the relative motion state.
In a fifth aspect, an embodiment of the present application further provides an electronic device, which includes a communication digital signal processor, an audio digital signal processor, a gesture detection apparatus, and a screen. The audio digital signal processor is used for acquiring a relative motion state according to audio data returned by an object, the relative motion state is a motion state between the electronic equipment and the object, the audio digital signal processor is further used for sending the relative motion state to the communication digital signal processor, the communication digital signal processor is used for receiving the relative motion state, the communication digital signal processor is further used for acquiring gesture data acquired by the gesture detection device, the communication digital signal processor is further used for determining gesture information of the electronic equipment according to the gesture data, and the communication digital signal processor is further used for controlling the screen to be on or off according to the gesture information of the electronic equipment and the relative motion state.
In a sixth aspect, an embodiment of the present application further provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code can be called by a processor to execute the above method.
Compared with the prior art, the information processing method, the device, the electronic device and the storage medium provided by the embodiment of the application control the on and off of the screen by acquiring the relative motion state and the posture information of the electronic device, wherein the relative motion state is acquired by the audio digital signal processor according to the received audio data returned by the object, and the posture information of the electronic device is acquired according to the posture data acquired by the posture detection device.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram illustrating a propagation path of an ultrasonic wave provided by an embodiment of the present application;
FIG. 2 illustrates an exemplary diagram of ultrasonic transmission, reception, and sensing data transmission;
FIG. 3 is a flow chart of a method of processing information provided by an embodiment of the present application;
FIG. 4 is a diagram illustrating an example of data transmission in an information processor method according to an embodiment of the present application;
FIG. 5 is a flow chart of a method of processing information provided by another embodiment of the present application;
FIG. 6 is a flow chart of a method of processing information provided by another embodiment of the present application;
FIG. 7 shows a block diagram of an information processing apparatus provided in an embodiment of the present application;
FIG. 8 is a block diagram of an information processing apparatus provided in an embodiment of the present application;
FIG. 9 shows a block diagram of an electronic device provided by an embodiment of the present application;
fig. 10 shows a storage unit provided in an embodiment of the present application, for storing or carrying program codes for implementing an information processing method according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
With the popularity of the full-screen design of electronic devices, more manufacturers have adopted an ultrasonic proximity monitoring scheme to replace the conventional infrared proximity detection scheme on electronic devices in order to save the head space of the electronic devices. The electronic device transmits ultrasonic waves through an ultrasonic wave transmitting device (such as a receiver, a loudspeaker, a special ultrasonic wave transmitter and the like), a part of the ultrasonic waves directly reach an ultrasonic wave receiving device (a sound pick-up) through air propagation (such as a path 1 in fig. 1), and a part of the ultrasonic waves are reflected with an object through air propagation and then reach the ultrasonic wave receiving device (such as a path 2 in fig. 1). The superposed signal of the direct sound and the reflected sound is picked up by the ultrasonic receiving device and converted into an audio signal through the A/D converter. And processing the audio data through an algorithm to obtain the running state of the object relative to the electronic equipment, and further guiding the display screen of the electronic equipment to be in a bright screen state or a dark screen state.
Specifically, when the electronic equipment is monitored to be in a conversation state, an ultrasonic wave signal with fixed frequency can be sent through an ultrasonic wave sending device arranged in the electronic equipment, and it can be understood that one part of the ultrasonic wave signal sent by the ultrasonic wave sending device directly reaches an ultrasonic wave receiving device through air propagation, the other part of the ultrasonic wave signal forms reflection with an object through air propagation and then reaches the ultrasonic wave receiving device, the ultrasonic wave receiving device picks up a superposed signal of the direct sound and the reflected sound, and the superposed signal is converted into an audio signal through A/D (analog to digital) conversion, wherein the object can comprise a human face, a human body and the like. For example, as shown in fig. 2, an earpiece, a speaker or a dedicated ultrasonic transmitter built in the electronic device transmits an ultrasonic signal with a fixed frequency, a part of the ultrasonic signal is propagated through air to reach a sound pick-up, another part of the ultrasonic signal is propagated through air to form reflection with an object and then reaches the sound pick-up, and the sound pick-up picks up a superimposed signal of direct sound and reflected sound and converts the superimposed signal into an audio signal through a/D.
In addition, after the electronic device acquires the ultrasonic waves, the a/D converter may convert the acquired ultrasonic waves into Audio data, transmit the Audio data to an Audio Digital Signal Processor (ADSP), and process the Audio data by using the Audio Digital Signal Processor. Meanwhile, after the sensor acquires the sensing data, the sensing data can be transmitted to a Communication Digital Signal Processor (CDSP), and the Communication Digital Signal Processor can process the sensing data to obtain the attitude information of the electronic device, and then transmit the attitude information of the electronic device to the audio Digital Signal Processor according to a fixed period. The audio digital signal processor processes the acquired audio data to obtain the motion state of the object relative to the electronic equipment, and simultaneously can process the posture information of the electronic equipment transmitted by the communication digital signal processor, namely the audio digital signal processor can control the on-off of the screen of the electronic equipment according to the acquired motion state and the posture information of the electronic equipment.
The communication digital signal processor needs to transmit the acquired attitude information of the electronic device to the audio digital signal processor in a fixed period, which causes a large amount of data transmission between the two processors, and further causes the electronic device to generate large power consumption.
Therefore, in order to overcome the above-mentioned drawbacks, as shown in fig. 3, an embodiment of the present application provides an information processing method applied to a communication digital signal processor of an electronic device, the electronic device further including an audio digital signal processor, a gesture detection device, and a screen, and the method may include steps S301 to S304.
Step S301: and acquiring a relative motion state sent by the audio digital signal processor, wherein the relative motion state is a motion state between the electronic equipment and an object, and the relative motion state is acquired by the audio digital signal processor according to the received audio data returned by the object.
In one embodiment, the communication digital signal processor may receive the relative motion state sent by the audio digital signal processor, the relative motion state is a motion state between the electronic device and the object, that is, a motion state of the electronic device relative to the object, and the motion state is obtained by the audio digital signal processor according to the received audio data returned by the object.
If the electronic equipment acquires audio data by using the ultrasonic emitter and the sound pick-up, analog-to-digital conversion is performed on the data, then the converted audio data are transmitted to the audio digital signal processor, the audio digital signal processor can analyze the audio data after receiving the audio data, and then the motion state of an object relative to the electronic equipment is acquired, and then the audio digital signal processor can control the on-off of a screen of the electronic equipment by combining the relative motion state and the posture information of the electronic equipment, so that the electronic equipment generates large power consumption. In the embodiment of the present application, after the audio digital signal processor obtains the motion state of the object relative to the electronic device, the motion state may be transmitted to the communication digital signal processor, and the communication digital signal processor is used to analyze the relative motion state of the electronic device and the posture information of the electronic device, so as to further realize the control of turning on and off the screen of the electronic device, where a specific data transmission flow is shown in fig. 4.
Step S302: and acquiring attitude data acquired by the attitude detection device.
The communication digital signal processor can acquire the attitude data of the electronic equipment by utilizing an attitude detection device, wherein the attitude detection device refers to a sensor and is mainly used for detecting the attitude data of the electronic equipment in real time. Obviously, the electronic device may be provided with a sensor for collecting attitude data or operating state information of the electronic device, such as an acceleration sensor, a gyroscope sensor, an infrared sensor, a gravity sensor, a magnetic sensor, an orientation sensor, a linear sensor, and the like. In addition, a light sensing sensor, a pressure sensor, a temperature sensor, a proximity sensor and the like which assist in acquiring other information of the electronic equipment can be arranged in the electronic equipment. The sensing data acquired by the attitude detection device may be referred to as attitude data of the electronic device, and the attitude data in this embodiment may include at least one of data acquired by a gravity sensor, data acquired by an acceleration sensor, and data acquired by a gyroscope.
Step S303: and determining attitude information of the electronic equipment according to the attitude data.
After the attitude data of the electronic device is acquired, the communication digital signal processor can analyze and process the attitude data to further obtain the attitude information of the electronic device. The posture information of the electronic device in this embodiment may include acceleration information, distance information, or position information, and the like, and information such as a moving distance, a moving direction, and the like of the electronic device in a certain period of time may be determined by using the information, so that the posture of the electronic device may be determined.
Step S304: and controlling the screen to be on or off according to the posture information of the electronic equipment and the relative motion state.
It can be known from fig. 4 that the attitude data acquired by the electronic device using the attitude detecting means and the audio data acquired by the ultrasonic transmitter and the microphone are transmitted to the communication digital signal processor in a direct or indirect manner. Obviously, in this embodiment, after the attitude data acquired by the attitude detection device is acquired by using the communication digital signal processor, the acquired attitude data does not need to be transmitted to the audio digital signal processor in a certain period, but only the attitude data needs to be analyzed and processed to obtain the attitude information of the electronic device, so that the electronic device can control the screen of the electronic device to be turned on or off.
It should be noted that, the communication digital signal processor may first obtain the attitude information of the electronic device according to the attitude data, and then receive the relative motion state sent by the audio digital signal processor, may also first receive the relative motion state sent by the audio digital signal processor, and then obtain the attitude information of the electronic device according to the attitude data, or may also obtain the two data according to the actual situation. For example, if the gesture detection device collects gesture data first, the communication dsp may obtain the gesture information of the electronic device according to the gesture data first, and then receive the relative motion state sent by the audio dsp. In addition, the communication digital signal processor may also acquire two data, namely, the attitude information and the relative motion state of the electronic device at the same time, and specifically, which data is acquired first is not specifically limited herein.
According to the information processing method, the communication digital signal processor acquires the attitude information of the electronic equipment by using the attitude detection device, and combines the attitude information of the electronic equipment with the relative motion state sent by the audio digital signal processor, so that the control of on and off of the screen of the electronic equipment can be realized.
Another embodiment of the present application provides an information processing method, please refer to fig. 5, which is applied to a communication digital signal processor of an electronic device, the electronic device further includes an audio digital signal processor, a gesture detection device, and a screen, and the information processing method may include steps S501 to S504.
Step S501: and acquiring a relative motion state sent by the audio digital signal processor, wherein the relative motion state is a motion state between the electronic equipment and an object, and the relative motion state is acquired by the audio digital signal processor according to the received audio data returned by the object.
Step S502: and acquiring attitude data acquired by the attitude detection device.
Step S503: and determining attitude information of the electronic equipment according to the attitude data.
Step S504: and controlling the screen to be on or off according to the posture information of the electronic equipment and the relative motion state.
After the communication digital signal processor acquires the attitude information and the relative motion state of the electronic equipment, the brightness of the screen of the electronic equipment can be controlled by combining the attitude information and the relative motion state of the electronic equipment. When the communication digital signal processor determines that the motion state between the electronic equipment and the object is that the electronic equipment approaches to the object, and the screen can be controlled to be in a screen-off state when the posture information of the electronic equipment is changed.
The motion state between the electronic device and the object may be obtained based on the doppler effect area difference and the doppler effect area sum, or the motion state between the electronic device and the object may be obtained directly by using the attribute value of the ultrasonic signal in the transmission process. In one embodiment, the motion state between the electronic device and the object may be determined using a change in amplitude of the ultrasonic signal, and when the amplitude of the ultrasonic signal becomes large, it may be determined that the electronic device approaches the object, and when the amplitude of the ultrasonic signal becomes small, it may be determined that the electronic device is away from the object.
In addition, in order to make the on-off control of the screen more accurate, in this embodiment, when it is determined that the amplitude of the ultrasonic signal is increased, it may be further determined whether the amplitude of the ultrasonic signal is greater than a first preset threshold, and if the amplitude of the ultrasonic signal is greater than the first preset threshold, it is determined that the electronic device approaches to the object. Meanwhile, the communication digital signal processor can judge whether the posture information of the electronic equipment is changed within a preset time period, and if the posture information of the electronic equipment is changed within the preset time period, the screen can be controlled to be in a screen-off state. In this embodiment, the posture information of the electronic device may include gravity information, acceleration information, gyroscope information, and the like, and when it is determined whether the posture information of the electronic device changes, it may be compared whether the posture information of the electronic device changes at two times before and after, and if at least the posture information of the electronic device changes at two times before and after, it may be determined that the posture information of the electronic device changes. At this time, the electronic device can be controlled to be in the screen-off state.
In one embodiment, when the relative motion state is that the electronic device is in a state of unchanged relative position with respect to the object and the posture information of the electronic device is not changed, the last motion state of the electronic device is acquired, and the on-off of the screen is controlled according to the last relative motion state. In other words, if it is determined that the motion state of the electronic device relative to the object has not changed and the posture information of the electronic device has also changed, the last motion trend of the electronic device is obtained, and if it is determined that the last relative motion state of the electronic device is approaching to the object, the screen of the electronic device is controlled to be in the screen-off state continuously. And if the last relative motion state of the electronic equipment is determined to be far away from the object, controlling the screen of the electronic equipment to be in a bright screen state continuously. The above description is provided in detail for determining whether the relative motion state of the electronic device is approaching to the object or away from the object, and will not be described in detail here.
In addition, when the relative motion state is that the electronic equipment is far away from the object and the posture information of the electronic equipment is changed, the screen is controlled to be in a bright screen state. Similarly, in order to determine whether the relative motion state is that the electronic device is far away from the object, the amplitude of the ultrasonic wave at different times can be obtained first, and then it is determined whether the amplitude of the ultrasonic wave signal is gradually reduced, and if the amplitude is continuously reduced, it can be determined that the electronic device is far away from the object. In order to make the determination of the relative motion state more accurate, this embodiment may further determine whether the amplitude of the ultrasonic signal is smaller than a second preset threshold, and determine that the electronic device is far away from the object if the amplitude of the ultrasonic signal is smaller than the second preset threshold. At this time, if the posture information of the electronic device is also changed, the communication digital signal processor controls the screen of the electronic device to be in a bright screen state.
It should be noted that, when it is determined that the relative motion state is that the electronic device is close to or far from the object, but the posture information of the electronic device is not changed, the communication digital signal processor may preferentially control the screen of the electronic device to turn on or turn off according to the motion state of the electronic device relative to the object. Obviously, the on-off control of the screen of the electronic device in this embodiment is mainly based on the relative motion state, and the change of the posture information of the electronic device is used to assist the change of the motion state.
According to the information processing method, the screen on-off is controlled comprehensively by combining the posture information and the relative motion state of the electronic equipment, the on-off control of the corresponding screen is different when the relative motion state is different from the posture information of the electronic equipment, and the control of the screen on-off can be more intelligent through the information processing method.
Still another embodiment of the present application provides an information processing method applied to an audio digital signal processor of an electronic device, where the electronic device further includes a communication digital signal processor, a gesture detection device, and a screen, please refer to fig. 6, and the information processing method may include steps S601 to S602.
Step S601: and acquiring a relative motion state according to the audio data returned by the object, wherein the relative motion state is a motion state between the electronic equipment and the object.
In this embodiment, the electronic device may include both the ultrasonic wave transmitting device and the ultrasonic wave receiving device. In the process of moving the ultrasonic wave transmitting device relative to the object, the electronic equipment moves relative to the object, so that the ultrasonic wave receiving device also moves relative to the object. The wavelength of the object radiation varies due to the relative motion of the source (electronics) and the observer (object) according to the doppler effect, which is formulated as follows:
where f' is the observed frequency, f is the original emission frequency of the emission originating in the medium, v is the propagation velocity of the wave in the medium, v0The moving speed of the observer is the forward operation sign is plus sign if the observer approaches the emission source, otherwise, the forward operation sign is minus sign; v. ofsFor the emitting source moving speed, the forward operation symbol is a minus sign if the object is close to the observer, and a plus sign if the object is not close to the observer. As can be seen from the doppler effect formula, when the emission source is relatively close to the observer, the frequency of the signal received by the observer will become higher; when the emission source is relatively far away from the observer, the frequency of the signal received by the observer becomes smaller; when the source and the observer are relatively stationary, the signal received by the observer coincides with the source.
In one embodiment, after the electronic device receives the ultrasonic signal through the ultrasonic receiving device, the attribute value of the ultrasonic signal in the transmission process can be obtained, and the doppler effect area difference and the doppler effect area sum of the ultrasonic signal in the transmission process can be calculated based on the attribute value. The attribute value may include a transmission frequency, a transmission amplitude, a transmission time, and the like of the ultrasonic signal transmitted by the ultrasonic transmitting device, and a frequency variation range, a reception amplitude, a reception time, and the like of the ultrasonic signal received by the ultrasonic receiving device, which is not limited herein.
The electronic device may obtain the motion state between the electronic device and the object based on the doppler effect area difference and the doppler effect area sum, and it can be known from the above description that the motion state between the electronic device and the object may include that the electronic device approaches to the object, the electronic device is far away from the object, and the electronic device and the object are in a relative position unchanged state. The corresponding motion states may be different if the attribute values of the ultrasonic signals in the transmission process are different or the doppler effect area difference and the doppler effect area sum are different. In this embodiment, when the amplitude of the ultrasonic wave becomes large, it indicates that the object approaches the electronic device, and when the amplitude of the ultrasonic wave becomes small, it indicates that the object is far away from the electronic device, and if the amplitude of the ultrasonic wave is not changed, it indicates that the electronic device and the object are in a state of unchanged relative position. In addition, the motion state between the electronic device and the object may also be determined according to other attribute values of the ultrasonic signal during transmission, and the specific method for acquiring the motion state is not specifically limited here.
Step S602: and sending the relative motion state to the communication digital signal processor, indicating the communication digital signal processor to acquire the attitude data acquired by the attitude detection device, determining the attitude information of the electronic equipment according to the attitude data, and controlling the screen to be on or off according to the attitude information of the electronic equipment and the relative motion state.
After the audio digital signal processor acquires the relative motion state, the relative motion state can be sent to the communication digital signal processor, the communication digital signal processor is instructed to acquire the attitude data acquired by the attitude detection device, then the attitude information of the electronic equipment is determined according to the attitude data, and the screen is controlled to be on or off according to the attitude information of the electronic equipment and the relative motion state. The posture information of the electronic device may include information such as a moving speed, a moving distance, and a moving direction of the electronic device.
Before sending the relative motion state to the communication digital signal processor, the audio digital signal processor may determine whether the relative motion state obtained this time is not matched with the relative motion state obtained last time. In one embodiment, after the audio digital signal processor acquires the relative motion state, the audio digital signal processor may compare the acquired relative motion state of this time with the acquired relative motion state of the last time, and determine whether the motion states of the electronic device and the object acquired twice before and after are matched, and if the acquired relative motion state of this time is matched with the relative motion state acquired last time, the audio digital signal processor may be used to acquire the audio data and the motion state corresponding to the audio data again. And if the relative motion state obtained this time is not matched with the relative motion state obtained last time, the relative motion state obtained this time is sent to the communication digital signal processor. Obviously, the audio digital signal processor transmits the relative motion state to the communication digital signal processor only when the relative motion state obtained this time is determined to be changed from the relative motion state obtained last time, otherwise, the relative motion state is not required to be transmitted.
In this embodiment, whether the motion states acquired by the electronic device twice before and after the electronic device are matched or not can be determined by comparing the doppler effect area difference with the doppler effect area sum, that is, whether the matching degree between the doppler effect area differences acquired by the electronic device twice before and after the electronic device is greater than a first preset matching degree or not can be determined, if the matching degree is greater than the first preset matching degree, it is indicated that the motion states between the electronic device and the object are matched, and if not, it is indicated that the motion states between the electronic device and the object are not matched. In addition, whether the matching degree between the doppler effect area sums obtained in the two previous and subsequent times is smaller than a second preset matching degree or not can be judged, if so, the motion state matching between the electronic device and the object is indicated, and if not, the motion state mismatching between the electronic device and the object is indicated. It should be noted that, when determining whether the motion state between the electronic device and the object matches twice before and after, the present embodiment may also directly use the attribute value of the ultrasonic signal during transmission to perform the determination, and specifically, which manner is used to determine is not explicitly limited herein.
According to the information processing method provided by the embodiment of the application, the audio digital signal processor determines whether the relative motion state acquired this time is transmitted to the communication digital signal processor or not by comparing the relative motion states of the audio digital signal processor and the relative motion states of the audio digital signal processor before and after twice, so that the relative motion states acquired by the communication digital signal processor can be guaranteed to be valid data, transmission of unnecessary data can be reduced to a great extent, and the operation power consumption of electronic equipment is reduced.
Referring to fig. 7, an information processing apparatus 700 provided in an embodiment of the present application is applied to a communication digital signal processor of an electronic device, where the electronic device further includes an audio digital signal processor, a gesture detection apparatus, and a screen, and specifically, the information processing apparatus 700 includes: a first state acquisition module 701, a posture data acquisition module 702, a posture information determination module 703 and a screen control module 704.
A first state obtaining module 701, configured to obtain a relative motion state sent by the audio digital signal processor, where the relative motion state is a motion state between the electronic device and an object, and the relative motion state is obtained by the audio digital signal processor according to received audio data returned by the object.
And an attitude data acquiring module 702, configured to acquire the attitude data acquired by the attitude detecting apparatus.
Further, the attitude data includes at least one of data collected by a gravity sensor, data collected by an acceleration sensor, and data collected by a gyroscope.
A pose information determining module 703, configured to determine pose information of the electronic device according to the pose data.
And the screen control module 704 is configured to control the screen to turn on or turn off according to the posture information of the electronic device and the relative motion state.
Further, the screen control module 704 is configured to control the screen to be in a screen-off state when the motion state is that the electronic device approaches the object and the posture information of the electronic device changes. And when the motion state is that the electronic equipment is in a relative position invariant state relative to the object and the posture information of the electronic equipment is not changed, acquiring the last motion state of the electronic equipment, and controlling the on-off of the screen according to the last motion state. And when the motion state is that the electronic equipment is far away from the object and the posture information of the electronic equipment is changed, controlling the screen to be in a bright screen state.
Referring to fig. 8, an information processing apparatus 800 according to an embodiment of the present application is applied to an audio digital signal processor of an electronic device, where the electronic device further includes a communication digital signal processor, a gesture detection apparatus, and a screen, and specifically, the information processing apparatus 800 includes: a second state acquisition module 801 and a motion state transmission module 802.
A second state obtaining module 801, configured to obtain a relative motion state according to audio data returned by an object, where the relative motion state is a motion state between the electronic device and the object.
A motion state sending module 802, configured to send the relative motion state to the communication digital signal processor, instruct the communication digital signal processor to obtain the gesture data acquired by the gesture detection device, determine the gesture information of the electronic device according to the gesture data, and control the screen to turn on or off according to the gesture information of the electronic device and the relative motion state.
Further, the motion state sending module 802 is configured to determine whether the relative motion state obtained this time is not matched with the relative motion state obtained last time; and if not, sending the relative motion state acquired this time to the communication digital signal processor. And if the relative motion state obtained at this time is the same as the relative motion state obtained at the last time, re-obtaining the relative motion state.
Referring to fig. 9, a block diagram of an electronic device 100 according to an embodiment of the present disclosure is shown. The electronic device 100 may be a smart phone, a tablet computer, an electronic book, or other electronic devices capable of running an application. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, a gesture detection device 130, a screen 140, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform the method as described in the aforementioned method embodiments.
The processor 110 may include an audio digital signal processor 111 and a communication digital signal processor 112 and one or more processing cores. The processor 110 connects various parts within the overall electronic device 100 using various interfaces and lines, and performs various functions of the electronic device 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.
The audio Digital Signal Processor 111 is one of DSPs (Digital Signal processors), which are mainly used for processing audio Digital signals. DSPs are processors consisting of large-scale or very-large-scale integrated circuit chips that perform certain signal processing tasks and are being developed to accommodate the needs of high-speed real-time signal processing tasks. The communication dsp 112 is mainly used to cooperate with the cpu to perform voice communication functions.
In one embodiment, the audio digital signal processor 111 is configured to obtain a relative motion state according to audio data returned by an object, where the relative motion state is a motion state between the electronic device and the object, the audio digital signal processor 111 is further configured to send the relative motion state to the communication digital signal processor 112, the communication digital signal processor 112 is configured to receive the relative motion state, the communication digital signal processor 112 is further configured to obtain gesture data collected by the gesture detection device, determine gesture information of the electronic device according to the gesture data, and control the screen to turn on or off according to the gesture information of the electronic device and the relative motion state.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The data storage area may also store data created by the electronic device 100 during use (e.g., phone book, audio-video data, chat log data), and the like.
The electronic device 100 further includes an attitude detecting device 130, and the attitude detecting device 130 in this embodiment is a sensor, which is mainly used for detecting attitude data of the electronic device 100. Common gesture detection devices 130 include light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the screen 140 according to the brightness of ambient light, and a proximity sensor that turns off the screen 140 and/or the backlight when the electronic device 100 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the gesture detection device 130 may further include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which are not described in detail herein.
The screen 140 is used to display information input by a user or information provided to the user, and the present embodiment may configure the screen 140 in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like.
Referring to fig. 10, a block diagram of a computer-readable storage medium 1200 according to an embodiment of the present application is shown. The computer-readable storage medium 1000 has stored therein program code that can be called by a processor to execute the methods described in the above-described method embodiments.
The computer-readable storage medium 1000 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 1000 includes a non-volatile computer-readable storage medium. The computer readable storage medium 1000 has storage space for program code 1010 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 1010 may be compressed, for example, in a suitable form.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (12)
1. An information processing method, characterized in that, is applied to the communication digital signal processor of the electronic equipment, the electronic equipment still includes ultrasonic wave transmitting device, sound pick-up, analog-to-digital converter, audio digital signal processor, gesture detection device and screen, sound pick-up, analog-to-digital converter and audio digital signal processor connect gradually, communication digital signal processor, analog-to-digital converter and gesture detection device connect gradually, communication digital signal processor and audio digital signal processor connect, analog-to-digital converter and ultrasonic wave transmitting device connect, the method includes:
acquiring a relative motion state sent by the audio digital signal processor, wherein the relative motion state is a motion state between the electronic equipment and an object, the relative motion state is obtained by analyzing audio data by the audio digital signal processor, the audio data is obtained by the analog-to-digital converter based on a reflected ultrasonic signal acquired by the sound pickup, and the reflected ultrasonic signal is a signal obtained by reflecting an ultrasonic signal emitted by the ultrasonic sending device by the object;
acquiring attitude data acquired by the attitude detection device;
determining attitude information of the electronic equipment according to the attitude data;
and controlling the screen to be on or off according to the posture information of the electronic equipment and the relative motion state.
2. The method of claim 1, wherein the controlling the screen to be on or off according to the posture information and the relative motion state of the electronic device comprises:
and when the motion state is that the electronic equipment approaches to an object and the posture information of the electronic equipment is changed, controlling the screen to be in a screen-off state.
3. The method of claim 1, wherein the controlling the screen to be on or off according to the posture information and the relative motion state of the electronic device comprises:
and when the motion state is that the electronic equipment is in a relative position invariant state relative to the object and the posture information of the electronic equipment is not changed, acquiring the last motion state of the electronic equipment, and controlling the on-off of the screen according to the last motion state.
4. The method of claim 1, wherein the controlling the screen to be on or off according to the posture information and the relative motion state of the electronic device comprises:
and when the motion state is that the electronic equipment is far away from the object and the posture information of the electronic equipment is changed, controlling the screen to be in a bright screen state.
5. The method of any one of claims 1-4, wherein the pose data comprises at least one of data collected by a gravity sensor, data collected by an acceleration sensor, and data collected by a gyroscope.
6. An information processing method, characterized in that, applied to the audio digital signal processor of the electronic equipment, the electronic equipment still includes ultrasonic wave transmitting device, sound pick-up, analog-to-digital converter, communication digital signal processor, gesture detection device and screen, sound pick-up, analog-to-digital converter and audio digital signal processor connect gradually, communication digital signal processor, analog-to-digital converter and gesture detection device connect gradually, communication digital signal processor and audio digital signal processor connect, analog-to-digital converter and ultrasonic wave transmitting device connect, the method includes:
acquiring a relative motion state according to audio data sent by the sound pick-up, wherein the relative motion state is a motion state between the electronic equipment and an object, the audio data is obtained by the analog-to-digital converter based on a reflected ultrasonic signal collected by the sound pick-up, and the reflected ultrasonic signal is a signal obtained by reflecting an ultrasonic signal sent by the ultrasonic sending device by the object;
sending the relative motion state to the communication digital signal processor, instructing the communication digital signal processor to perform the following operations: acquiring the attitude data acquired by the attitude detection device, determining the attitude information of the electronic equipment according to the attitude data, and controlling the screen to be on or off according to the attitude information of the electronic equipment and the relative motion state.
7. The method of claim 6, wherein sending the relative motion state to the communication digital signal processor comprises:
judging whether the relative motion state obtained this time is not matched with the relative motion state obtained last time;
and if not, sending the relative motion state acquired this time to the communication digital signal processor.
8. The method of claim 7, further comprising:
and if the relative motion state obtained at this time is the same as the relative motion state obtained at the last time, re-obtaining the relative motion state.
9. The utility model provides an information processing apparatus, its characterized in that is applied to the communication digital signal processor of electronic equipment, electronic equipment still includes ultrasonic wave transmitting device, adapter, analog-to-digital converter, audio digital signal processor, gesture detection device and screen, adapter, analog-to-digital converter with audio digital signal processor connects gradually, communication digital signal processor, analog-to-digital converter with gesture detection device connects gradually, and communication digital signal processor and audio digital signal processor connect, analog-to-digital converter and ultrasonic wave transmitting device connect, the device includes:
a first state obtaining module, configured to obtain a relative motion state sent by the audio digital signal processor, where the relative motion state is a motion state between the electronic device and an object, the relative motion state is obtained by analyzing audio data sent by the audio digital signal processor according to the sound pickup, the audio data is obtained by the analog-to-digital converter based on a reflected ultrasonic signal collected by the sound pickup, and the reflected ultrasonic signal is a signal obtained by reflecting an ultrasonic signal, which is sent by the ultrasonic sending apparatus, by an object;
the attitude data acquisition module is used for acquiring the attitude data acquired by the attitude detection device;
the attitude information determining module is used for determining the attitude information of the electronic equipment according to the attitude data;
and the screen control module is used for controlling the screen to be on or off according to the posture information of the electronic equipment and the relative motion state.
10. The utility model provides an information processing apparatus, its characterized in that is applied to the audio digital signal processor of electronic equipment, electronic equipment still includes ultrasonic wave transmitting device, adapter, analog-to-digital converter, communication digital signal processor, gesture detection device and screen, adapter, analog-to-digital converter with audio digital signal processor connects gradually, communication digital signal processor, analog-to-digital converter with gesture detection device connects gradually, and communication digital signal processor and audio digital signal processor connect, analog-to-digital converter and ultrasonic wave transmitting device connect, the device includes:
a second state obtaining module, configured to obtain a relative motion state according to audio data sent by the sound pickup, where the relative motion state is a motion state between the electronic device and an object, the audio data is obtained by the analog-to-digital converter based on a reflected ultrasonic signal collected by the sound pickup, and the reflected ultrasonic signal is a signal obtained by reflecting an ultrasonic signal, which is sent by the ultrasonic sending apparatus, by the object;
a motion state sending module, configured to send the relative motion state to the communication digital signal processor, and instruct the communication digital signal processor to perform the following operations: acquiring the attitude data acquired by the attitude detection device, determining the attitude information of the electronic equipment according to the attitude data, and controlling the screen to be on or off according to the attitude information of the electronic equipment and the relative motion state.
11. An electronic device is characterized by comprising an ultrasonic transmitting device, a sound pick-up, an analog-to-digital converter, a communication digital signal processor, an audio digital signal processor, an attitude detection device and a screen, wherein the sound pick-up, the analog-to-digital converter and the audio digital signal processor are sequentially connected;
the audio digital signal processor is used for acquiring a relative motion state according to audio data sent by the sound pick-up, wherein the relative motion state is a motion state between the electronic equipment and an object, the audio data is obtained by the analog-to-digital converter based on a reflected ultrasonic signal collected by the sound pick-up, and the reflected ultrasonic signal is a signal obtained by reflecting an ultrasonic signal sent by the ultrasonic sending device by the object;
the audio digital signal processor is further used for sending the relative motion state to the communication digital signal processor;
the communication digital signal processor is used for receiving the relative motion state;
the communication digital signal processor is also used for acquiring the attitude data acquired by the attitude detection device;
the communication digital signal processor is further used for determining attitude information of the electronic equipment according to the attitude data;
the communication digital signal processor is also used for controlling the screen to be on or off according to the attitude information of the electronic equipment and the relative motion state.
12. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910702558.7A CN110502109B (en) | 2019-07-31 | 2019-07-31 | Information processing method, information processing device, electronic equipment and storage medium |
| PCT/CN2020/102377 WO2021017860A1 (en) | 2019-07-31 | 2020-07-16 | Information processing method and apparatus, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910702558.7A CN110502109B (en) | 2019-07-31 | 2019-07-31 | Information processing method, information processing device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110502109A CN110502109A (en) | 2019-11-26 |
| CN110502109B true CN110502109B (en) | 2022-04-19 |
Family
ID=68586802
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910702558.7A Active CN110502109B (en) | 2019-07-31 | 2019-07-31 | Information processing method, information processing device, electronic equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110502109B (en) |
| WO (1) | WO2021017860A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110502109B (en) * | 2019-07-31 | 2022-04-19 | Oppo广东移动通信有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
| CN110865710B (en) * | 2019-11-19 | 2023-08-18 | Oppo（重庆）智能科技有限公司 | Terminal control method and device, mobile terminal and storage medium |
| CN111045518B (en) * | 2019-12-09 | 2023-06-30 | 上海瑾盛通信科技有限公司 | Method and related device for acquiring attitude data |
| CN113313136A (en) * | 2020-02-27 | 2021-08-27 | 惠州迪芬尼声学科技股份有限公司 | Motion characteristic detection method and device for electronic equipment and loudspeaker |
| CN114513573A (en) * | 2020-11-16 | 2022-05-17 | 深圳市万普拉斯科技有限公司 | Screen control method and device, electronic equipment and storage medium |
| CN112579037B (en) * | 2020-12-21 | 2024-08-09 | Oppo广东移动通信有限公司 | Audio control method and device, storage medium and electronic equipment |
| CN112882035A (en) * | 2021-02-18 | 2021-06-01 | 联想(北京)有限公司 | Detection method, equipment and storage medium |
| CN116708661B (en) * | 2022-10-26 | 2024-05-03 | 荣耀终端有限公司 | Audio call processing method, electronic equipment and storage medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8688392B2 (en) * | 2010-06-04 | 2014-04-01 | Apple Inc. | System and method for testing a light sensor of a portable electronic device |
| KR102068749B1 (en) * | 2013-08-23 | 2020-01-21 | 삼성전자주식회사 | Photographing apparatus and method |
| CN103631494A (en) * | 2013-11-15 | 2014-03-12 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104267819B (en) * | 2014-10-09 | 2017-07-14 | 苏州触达信息技术有限公司 | Can gesture wake up electronic equipment and electronic equipment gesture awakening method |
| CN105988559B (en) * | 2015-02-03 | 2019-02-05 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN106933366A (en) * | 2017-03-23 | 2017-07-07 | 北京小米移动软件有限公司 | Bright screen method and device |
| CN107896272B (en) * | 2017-08-11 | 2020-09-18 | Oppo广东移动通信有限公司 | Call control method and device |
| CN109710142A (en) * | 2017-10-25 | 2019-05-03 | 华为技术有限公司 | A kind of method and terminal for controlling terminal screen light on and off |
| CN108052352A (en) * | 2017-11-30 | 2018-05-18 | 努比亚技术有限公司 | Control method, terminal and the computer readable storage medium of screen on-off state |
| CN110502109B (en) * | 2019-07-31 | 2022-04-19 | Oppo广东移动通信有限公司 | Information processing method, information processing device, electronic equipment and storage medium |
-
2019
- 2019-07-31 CN CN201910702558.7A patent/CN110502109B/en active Active
-
2020
- 2020-07-16 WO PCT/CN2020/102377 patent/WO2021017860A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN110502109A (en) | 2019-11-26 |
| WO2021017860A1 (en) | 2021-02-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110502109B (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN108427876B (en) | Fingerprint identification method and mobile terminal | |
| CN110113528B (en) | Parameter obtaining method and terminal equipment | |
| WO2018201847A1 (en) | Optical fingerprint identification method, and related product | |
| WO2021017947A1 (en) | Terminal control method and device, mobile terminal and storage medium | |
| CN110865710B (en) | Terminal control method and device, mobile terminal and storage medium | |
| WO2021017927A1 (en) | Method and device for controlling apparatus, electronic apparatus, and storage medium | |
| CN107765251B (en) | Distance detection method and terminal equipment | |
| CN107463897B (en) | Fingerprint identification method and mobile terminal | |
| CN109212534B (en) | Method, device, equipment and storage medium for detecting holding gesture of mobile terminal | |
| CN109088973B (en) | Antenna control method and device and mobile terminal | |
| CN111310677B (en) | Fingerprint image processing method and electronic equipment | |
| WO2021017851A1 (en) | Screen state control method and apparatus, mobile terminal and storage medium | |
| CN112098929B (en) | Method, device and system for determining relative angle between intelligent devices and intelligent device | |
| CN111246061B (en) | Mobile terminal, method for detecting shooting mode and storage medium | |
| CN110418023B (en) | Ring processing method, device, mobile terminal and storage medium | |
| CN108388459B (en) | Message display processing method and mobile terminal | |
| CN110764612B (en) | Ultrasonic processing method, ultrasonic processing device, electronic equipment and computer readable medium | |
| CN111638522B (en) | Proximity detection method and electronic device | |
| CN113873332B (en) | Multimedia playing method and device, electronic equipment and storage medium | |
| CN113517935B (en) | Ultrasonic calibration method and device, mobile terminal and storage medium | |
| CN113160790A (en) | Echo cancellation method, echo cancellation device, electronic equipment and storage medium | |
| CN110381281B (en) | Prompting method and mobile terminal | |
| CN108107422B (en) | A kind of method for determining speed and mobile terminal of Moving Objects | |
| CN111491212A (en) | Video processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |