CN110493459B

CN110493459B - Screen state control method and device, mobile terminal and storage medium

Info

Publication number: CN110493459B
Application number: CN201910701478.XA
Authority: CN
Inventors: 范辉
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2019-07-31
Filing date: 2019-07-31
Publication date: 2021-03-12
Anticipated expiration: 2039-07-31
Also published as: CN110493459A; WO2021017851A1

Abstract

The application discloses a screen state control method and device, a mobile terminal and a storage medium. When the mobile terminal is in a call state, an ultrasonic signal is sent through an ultrasonic sending device, the ultrasonic signal returned after the ultrasonic signal meets an object is received through an ultrasonic receiving device, a first attribute value of the ultrasonic signal in the transmission process is obtained, the variance of the signal intensity is calculated based on the first attribute value, a second attribute value of the ultrasonic signal in the transmission process is obtained, the Doppler effect area difference is calculated based on the second attribute value, the relative motion state of the mobile terminal and the object is judged according to the variance of the signal intensity and the Doppler effect area difference, and the display screen is controlled to be in a bright screen state or a screen resting state according to the relative motion state. According to the method and the device, the display screen is controlled to be in a bright screen state or a screen resting state by calculating the variance of the signal intensity of the ultrasonic signal and the Doppler effect area difference, so that the accuracy of detection control is improved.

Description

Screen state control method and device, mobile terminal and storage medium

Technical Field

The present application relates to the field of mobile terminal technologies, and in particular, to a screen state control method and apparatus, a mobile terminal, and a storage medium.

Background

With the popularity of the full-screen design of mobile terminals, more manufacturers have adopted an ultrasonic proximity detection scheme to replace the conventional infrared proximity detection scheme on the mobile terminal in order to save the top space of the mobile terminal. However, the current approach detection scheme using ultrasonic waves has poor anti-interference capability, so that when some ultrasonic noise interference exists in the environment, a large error is generated in the detection result.

Disclosure of Invention

In view of the above problems, the present application provides a screen state control method, apparatus, mobile terminal and storage medium to solve the above problems.

In a first aspect, an embodiment of the present application provides a screen state control method, which is applied to a mobile terminal, where the mobile terminal includes an ultrasonic wave transmitting device, an ultrasonic wave receiving device, and a display screen, and the method includes: when the mobile terminal is in a call state, sending an ultrasonic signal through the ultrasonic sending device, and receiving an ultrasonic signal returned by the ultrasonic signal after encountering an object through the ultrasonic receiving device; acquiring a first attribute value of an ultrasonic signal in the transmission process, calculating the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first attribute value, acquiring a second attribute value of the ultrasonic signal in the transmission process, and calculating the Doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value; and judging the relative motion state of the mobile terminal and the object according to the variance of the signal intensity and the Doppler effect area difference, and controlling the display screen to be in a bright screen state or a dark screen state according to the relative motion state.

In a second aspect, an embodiment of the present application provides a screen state control device, which is applied to a mobile terminal, where the mobile terminal includes an ultrasonic wave transmitting device, an ultrasonic wave receiving device, and a display screen, and the device includes: the ultrasonic signal receiving and sending module is used for receiving an ultrasonic signal sent by the ultrasonic sending device and an ultrasonic signal returned by the ultrasonic signal after encountering an object through the ultrasonic receiving device when the mobile terminal is in a call state; the calculation module is used for acquiring a first attribute value of the ultrasonic signal in the transmission process, calculating the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first attribute value, acquiring a second attribute value of the ultrasonic signal in the transmission process, and calculating the Doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value; and the state control module is used for judging the relative motion state of the mobile terminal and the object according to the variance of the signal intensity and the Doppler effect area difference, and controlling the display screen to be in a screen-on state or a screen-off state according to the relative motion state.

In a third aspect, an embodiment of the present application provides a mobile terminal, including an ultrasonic wave transmitting device, an ultrasonic wave receiving device, a display screen, a memory, and a processor, where the ultrasonic wave transmitting device, the ultrasonic wave receiving device, the display screen, and the memory are coupled to the processor, and the memory stores instructions, and when the instructions are executed by the processor, the processor executes the above method.

In a fourth aspect, the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.

The screen state control method, device, mobile terminal and storage medium provided by the embodiments of the present application, when the mobile terminal is in a call state, send an ultrasonic signal through an ultrasonic sending device, receive an ultrasonic signal returned after the ultrasonic signal meets an object through an ultrasonic receiving device, obtain a first attribute value of the ultrasonic signal in a transmission process, calculate a variance of signal intensity of the ultrasonic signal in the transmission process based on the first attribute value, obtain a second attribute value of the ultrasonic signal in the transmission process, calculate a doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value, determine a relative motion state of the mobile terminal and the object according to the variance of the signal intensity and the doppler effect area difference, control a display screen to be in a bright screen state or a dark screen state according to the relative motion state, therefore, the display screen is controlled to be in a bright screen state or a dark screen state by calculating the variance of the signal intensity of the ultrasonic signal and the Doppler effect area difference, and the accuracy of detection control is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating a propagation path of an ultrasonic wave provided by an embodiment of the present application;

fig. 2 is a schematic diagram illustrating a variation rule of doppler _ dif during a process of relatively approaching, being stationary and moving away between an object and a mobile terminal provided by an embodiment of the present application;

fig. 3 is a schematic diagram illustrating a variation rule of doppler _ dif during relative approaching, shaking and moving away of an object and a mobile terminal provided by an embodiment of the present application;

FIG. 4 is a flow chart illustrating a screen state control method according to an embodiment of the present application;

FIG. 5 is a schematic diagram illustrating the flow of ultrasonic wave transmission, reception and data processing provided by the embodiment of the present application;

FIG. 6 is a flow chart illustrating a screen state control method according to another embodiment of the present application;

FIG. 7 illustrates a spectrogram of audio data provided by an embodiment of the present application;

FIG. 8 is a flow chart illustrating a method for controlling screen status according to still another embodiment of the present application;

FIG. 9 is a flow chart illustrating a method for controlling screen status according to another embodiment of the present application;

fig. 10 is a schematic diagram illustrating a variation rule of doppler _ dif and ultrasound _ amp _ dif _ var _ log during a process of relatively approaching, being still, and being far away, of an object and a mobile terminal provided by an embodiment of the present application;

fig. 11 is a schematic diagram illustrating a variation rule of doppler _ dif and ultrasound _ amp _ dif _ var _ log during relative approaching, shaking and moving away of an object and a mobile terminal provided by the embodiment of the present application;

FIG. 12 is a block diagram of a screen state control device provided in an embodiment of the present application;

fig. 13 is a block diagram illustrating a mobile terminal for performing a screen state control method according to an embodiment of the present application;

fig. 14 illustrates a storage unit for storing or carrying program codes for implementing a screen equipment control method according to an embodiment of the present application.

Detailed Description

In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.

With the popularity of the full-screen design of mobile terminals, in order to save the top space of the mobile terminals, more manufacturers have adopted an ultrasonic proximity monitoring scheme to replace the conventional infrared proximity detection scheme on the mobile terminals. The mobile terminal transmits ultrasonic waves through an ultrasonic wave transmitting device (such as a receiver, a loudspeaker, a special ultrasonic wave transmitter and the like), a part of the ultrasonic waves directly reach an ultrasonic wave receiving device (a sound pick-up) through air propagation (such as a path 1 in fig. 1), and a part of the ultrasonic waves are reflected with an object through air propagation and then reach the ultrasonic wave receiving device (such as a path 2 in fig. 1). The superposed signal of the direct sound and the reflected sound is picked up by the ultrasonic receiving device and converted into an audio signal through the A/D converter. And processing the audio data through an algorithm to obtain the running state of the object relative to the mobile terminal, and further guiding the display screen of the mobile terminal to be in a bright screen state or a dark screen state.

The inventor researches and discovers that the mobile terminal can recognize the relative motion state of the object and the mobile terminal through ultrasonic waves, and the method comprises the following steps:

time difference method

The ultrasonic wave sending device of the mobile terminal sends scanning signals of an ultrasonic frequency range at intervals, the ultrasonic wave receiving device of the mobile terminal receives reflected and direct ultrasonic wave signals, the algorithm determines the relative distance between an object and the mobile terminal by comparing the time difference of receiving different ultrasonic wave signals, the relative speed can be calculated through the relative distance, and the relative motion state between the mobile terminal and the object can be further judged according to the relative distance and the relative speed. However, the method has poor interference resistance, and when some ultrasonic noise interference exists in the environment, a large error is generated in the identification result.

(II) phase difference method

The ultrasonic transmitting device of the mobile terminal transmits continuous ultrasonic signals, the receiving end determines the phase difference generated by the ultrasonic receiving device after the ultrasonic waves are reflected by calculating the correlation index between the transmitted signals and the received signals, the relative distance between the object and the mobile terminal is determined according to the phase difference, the relative speed can be calculated according to the relative distance, and the relative motion state of the mobile terminal and the object can be further judged according to the relative distance and the relative speed. However, the method has poor interference resistance, and when some ultrasonic noise interference exists in the environment, a large error is generated in the identification result.

(III) method for using Doppler effect area difference as audio frequency characteristic

The doppler effect area difference is obtained by differencing the spectral intensities in the frequency ranges above and below the ultrasonic transmission frequency:

doppler_dif＝sum_up-sum_low

as shown in fig. 2, the doppler effect area difference doppler _ dif may regularly change due to different motion states of the object relative to the mobile terminal, and when the object approaches the mobile terminal at a certain speed, doppler _ dif takes a larger positive value; when the object is far away from the mobile terminal at a certain speed, doppler _ dif takes a smaller negative value; when the object and the mobile terminal are relatively stationary, doppler _ dif takes a value close to 0.

Further, the motion state of the object relative to the mobile terminal may be determined by setting positive and negative thresholds. When doppler _ dif is larger than reference 1threshold1, judging as close state; when doppler _ dif is less than reference 2threshold2, determining the status as away; when doppler _ dif is between threshold1 and threshold2, normal state is judged. When the algorithm judges that the mobile terminal is in a close state, controlling a display screen of the mobile terminal to be in a screen-off state; when the algorithm judges that the mobile terminal is in the away state, controlling a display screen of the mobile terminal to be in a bright screen state; and when the algorithm judges that the state is normal, controlling the screen state of the mobile terminal to keep the last state unchanged. However, in this method, when the object or the mobile terminal is in a jittering state, doppler _ dif will change repeatedly between a larger positive value and a smaller negative value in a short time (as shown in fig. 3), and the mobile terminal will have a continuous screen flashing problem.

In view of the above problems, the inventor finds and provides a screen state control method, an apparatus, a mobile terminal and a storage medium provided in the embodiments of the present application through long-term research, and controls a display screen to be in a bright screen state or a dark screen state by calculating a variance of signal intensity of an ultrasonic signal and a doppler effect area difference, so as to improve accuracy of detection control. The specific screen state control method is described in detail in the following embodiments.

Referring to fig. 4, fig. 4 is a flowchart illustrating a screen state control method according to an embodiment of the present application. The screen state control method is used for calculating the variance of the signal intensity of the ultrasonic signal and the Doppler effect area difference to control the display screen to be in a bright screen state or a dark screen state so as to improve the accuracy of detection control. In a specific embodiment, the screen state control method is applied to the screen state control device 200 as shown in fig. 12 and the mobile terminal 100 (fig. 13) equipped with the screen state control device 200. The following will describe a specific process of this embodiment by taking a mobile terminal as an example, and it is understood that the mobile terminal applied in this embodiment may be a smart phone, a tablet computer, a wearable electronic device, and the like, which is not limited herein. In this embodiment, the mobile terminal may include an ultrasonic wave transmitting device, an ultrasonic wave receiving device, and a display screen, and the flow shown in fig. 4 will be described in detail below, where the screen state control method may specifically include the following steps:

step S101: when the mobile terminal is in a call state, the ultrasonic wave transmitting device transmits an ultrasonic wave signal, and the ultrasonic wave receiving device receives an ultrasonic wave signal returned by the ultrasonic wave signal after encountering an object.

In the present embodiment, the mobile terminal includes both the ultrasonic wave transmitting device and the ultrasonic wave receiving device. In the process of moving the ultrasonic wave transmitting device relative to the object, the essence is that the mobile terminal moves relative to the object, so that the ultrasonic wave receiving device also moves relative to the object. The wavelength of the object radiation varies due to the relative motion of the source (mobile terminal) and the observer (object) according to the doppler effect, which is formulated as follows:

where f' is the observed frequency, f is the original emission frequency of the emission originating in the medium, v is the propagation velocity of the wave in the medium, v₀The moving speed of the observer is the forward operation sign is plus sign if the observer approaches the emission source, otherwise, the forward operation sign is minus sign; v. of_sFor the emitting source moving speed, the forward operation symbol is a minus sign if the object is close to the observer, and a plus sign if the object is not close to the observer. As can be seen from the doppler effect formula, when the emission source is relatively close to the observer, the frequency of the signal received by the observer will become higher; when the emission source is relatively far away from the observer, the frequency of the signal received by the observer becomes smaller; when the source and the observer are relatively stationary, the signal received by the observer coincides with the source.

In this embodiment, the mobile terminal may monitor an incoming CALL or an outgoing CALL of the mobile terminal in real time through a built-in monitoring module, and when it is monitored that the mobile terminal is in a ring start (CALL _ STATE _ RINGING) incoming CALL or when a dialing operation is outgoing, monitor whether the mobile terminal enters a CALL STATE. The method includes the steps that when a mobile terminal performs dialing operation and CALLs, system broadcast is sent, the mobile terminal can use broadcastrechiveriver to monitor, in addition, whether the mobile terminal is in a CALL STATE or not can be an interface for monitoring whether the mobile terminal is in the CALL after the mobile terminal CALLs or CALLs, and when the mobile terminal is in the CALL (CALL _ STATE _ OFFHOOK) in monitoring, the mobile terminal can be determined to be in the CALL STATE.

In some embodiments, when it is monitored that the mobile terminal is in a call state, an ultrasonic wave signal with a fixed frequency may be transmitted by an ultrasonic wave transmitting device built in the mobile terminal, it may be understood that a part of the ultrasonic wave signal transmitted by the ultrasonic wave transmitting device directly reaches the ultrasonic wave receiving device through air propagation, another part of the ultrasonic wave signal forms a reflection with an object through air propagation and then reaches the ultrasonic wave receiving device, and the ultrasonic wave receiving device picks up a superimposed signal of direct sound and reflected sound and converts the superimposed signal into an audio signal through a/D, where the object may include a human face, a human body, and the like. For example, as shown in fig. 5, an earpiece, a speaker or a dedicated ultrasonic transmitter built in the mobile terminal transmits an ultrasonic signal with a fixed frequency, a part of the ultrasonic signal is propagated through air to reach a sound pick-up, another part of the ultrasonic signal is propagated through air to form reflection with an object and then reaches the sound pick-up, and the sound pick-up picks up a superimposed signal of direct sound and reflected sound and converts the superimposed signal into an audio signal through a/D.

In this embodiment, when the mobile terminal is in a call state, the ultrasonic wave transmitting device may transmit an ultrasonic wave signal, and the ultrasonic wave receiving device may receive an ultrasonic wave signal returned after the ultrasonic wave signal encounters an object, or extract an ultrasonic wave signal (reflected sound) returned after the ultrasonic wave signal encounters an object from the ultrasonic wave signals (direct sound and reflected sound) received by the ultrasonic wave receiving device, which is not limited herein.

Step S102: acquiring a first attribute value of the ultrasonic signal in the transmission process, calculating the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first attribute value, acquiring a second attribute value of the ultrasonic signal in the transmission process, and calculating the Doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value.

In some embodiments, after the mobile terminal receives the ultrasonic signal through the ultrasonic receiving device, the attribute value of the ultrasonic signal during transmission may be obtained, and the doppler effect area difference and the variance of the signal strength of the ultrasonic signal during transmission may be calculated based on the attribute value. The transmission process may include a process of transmitting an ultrasonic signal and a process of receiving an ultrasonic signal, and the attribute value may include a transmission frequency, a transmission amplitude, a transmission time, and the like of the ultrasonic signal transmitted by the ultrasonic transmitting device, and a frequency variation range, a reception amplitude, a reception time, and the like of the ultrasonic signal received by the ultrasonic receiving device.

Specifically, in the present embodiment, a first attribute value of the ultrasonic signal during transmission may be acquired from the attribute values, and the variance of the signal intensity of the ultrasonic signal during transmission may be calculated based on the first attribute value, where the first attribute value may include the frequency of the ultrasonic signal received by the ultrasonic receiving apparatus.

Specifically, in this embodiment, a second attribute value of the ultrasonic signal during transmission may be obtained from the attribute values, and the doppler effect area difference of the ultrasonic signal during transmission may be calculated based on the second attribute value, where the second attribute value may include a fixed frequency of the ultrasonic signal transmitted by the ultrasonic transmitting device and a frequency range of the ultrasonic signal received by the ultrasonic receiving device.

Step S103: and judging the relative motion state of the mobile terminal and the object according to the variance of the signal intensity and the Doppler effect area difference, and controlling the display screen to be in a bright screen state or a dark screen state according to the relative motion state.

In some embodiments, after the mobile terminal obtains the doppler effect area difference and the signal intensity variance, the relative motion state of the mobile terminal and the object can be obtained based on the doppler effect area difference and the signal intensity variance, and the display screen is controlled to be in the bright screen state or the screen turning-off state according to the relative motion state of the mobile terminal and the object, so that the accuracy and the stability of state control of the display screen in the call state of the mobile terminal are improved, the power consumption of the mobile terminal is effectively reduced, and the radiation of the display screen on the face caused by the bright screen state when the display screen is close to the face is reduced.

In the screen state control method provided in an embodiment of the present application, when a mobile terminal is in a call state, an ultrasonic signal is sent by an ultrasonic sending device, an ultrasonic signal returned after encountering an object is received by an ultrasonic receiving device, a first attribute value of the ultrasonic signal in a transmission process is obtained, a variance of signal intensity of the ultrasonic signal in the transmission process is calculated based on the first attribute value, a second attribute value of the ultrasonic signal in the transmission process is obtained, a doppler effect area difference of the ultrasonic signal in the transmission process is calculated based on the second attribute value, a relative motion state of the mobile terminal and the object is determined according to the variance of the signal intensity and the doppler effect area difference, and the display screen is controlled to be in a bright screen state or a dark screen state according to the relative motion state, so that the display screen is controlled to be in a bright screen state or a dark screen state by calculating the variance of the signal intensity and the doppler effect area difference of the ultrasonic signal And the screen is turned off to improve the accuracy of detection control.

Referring to fig. 6, fig. 6 is a flowchart illustrating a screen state control method according to another embodiment of the present application. The method is applied to the mobile terminal, which includes an ultrasonic wave transmitting device, an ultrasonic wave receiving device and a display screen, and will be described in detail with respect to the flow shown in fig. 6, the screen state control method may specifically include the following steps:

step S201: when the mobile terminal is in a call state, the ultrasonic wave transmitting device transmits an ultrasonic wave signal, and the ultrasonic wave receiving device receives an ultrasonic wave signal returned by the ultrasonic wave signal after encountering an object.

For detailed description of step S201, please refer to step S101, which is not described herein again.

Step S202: and acquiring a first frequency and a second frequency of the ultrasonic signal received by the ultrasonic receiving device.

In this embodiment, when the mobile terminal is in a call state, the relative motion state of the mobile terminal with respect to the object is substantially a process in which the user picks up the mobile terminal to approach or leave the human body during the process of using the mobile terminal, and it is considered that the speed at which the user picks up the mobile terminal changes within a certain range, so that the frequency change of the ultrasonic signal received by the ultrasonic receiving device is also within a certain range, that is, the frequency range of the ultrasonic signal. In some embodiments, after acquiring the frequency range of the ultrasonic signal received by the ultrasonic receiving device, a first frequency and a second frequency may be selected from the frequency range of the ultrasonic signal, wherein the first frequency may be greater than the second frequency, and the first frequency may also be less than the second frequency, which is not limited herein. Optionally, in this embodiment, the first frequency and the second frequency are adjacent, that is, in the frequency range, the first frequency may be a next frequency of the second frequency or a previous frequency of the second frequency.

Specifically, based on the doppler effect formula, f' is the frequency of the ultrasonic signal reflected by the object received by the ultrasonic receiving device. f is the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device. v is sound in the skyThe propagation velocity in air was 340 m/s. Assuming that the mobile terminal is stationary, v_s0. If the speed of movement of the object relative to the terminal is v₀₁Then the moving speed of the object in the Doppler effect formula is v₀＝2v₀₁. Assuming that the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device is 22500Hz, the frequency range of the ultrasonic signal received by the ultrasonic reception device is 22420Hz, 22580Hz]Then, the maximum relative speed between the object and the mobile terminal, which can be identified according to the doppler effect, is:

if the data length of the DFT is fftlen-8192 and the audio data sampling rate is fs-48 kHz, the frequency resolution of the DFT result is:

then is represented by

And formula

Then the minimum relative speed of the object and the mobile terminal that can be identified is:

therefore, in the present embodiment, it is possible to acquire the maximum relative velocity and the minimum relative velocity of the mobile terminal and the object based on the history data and the like, and reversely derive and acquire the frequency range of the ultrasonic signal received by the ultrasonic receiving device by the maximum relative velocity, the minimum relative velocity and the above formula, and acquire the first frequency and the second frequency after acquiring the frequency range of the ultrasonic signal received by the ultrasonic receiving device.

Step S203: and acquiring a first signal strength corresponding to the first frequency and a second signal strength corresponding to the second frequency.

As shown in fig. 7, fig. 7 shows a spectrogram of audio data provided in the embodiment of the present application, where a frequency spectrum is a frequency spectrum for short, and is a distribution curve of frequencies, and a discrete audio data sampling point can be obtained through discrete fourier transform, and in fig. 7, the frequency spectrum is a spectrogram obtained by performing discrete fourier transform on a segment of audio data, each point on an abscissa corresponds to a real frequency value, and an ordinate represents a signal intensity of the frequency. Therefore, in this embodiment, as a first way, after the first frequency and the second frequency are obtained, fourier transform may be performed on the first frequency to obtain a first signal strength corresponding to the first frequency, and fourier transform may be performed on the second frequency to obtain a second signal strength corresponding to the second frequency. As a second mode, after the ultrasonic wave receiving device receives the ultrasonic wave signal, fourier transform is performed on the frequency of each received frame of ultrasonic wave signal to obtain the signal intensity corresponding to the frequency of each frame of ultrasonic wave signal, and a first signal intensity corresponding to the first frequency and a second signal intensity corresponding to the second frequency are selected from the signal intensities.

Step S204: and obtaining the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first signal intensity and the second signal intensity.

In some embodiments, after acquiring the first signal strength and the second signal strength, a calculation may be performed based on the first signal strength and the second signal strength to obtain a variance of the signal strength of the ultrasonic signal during transmission. Optionally, in this embodiment, the first frequency is adjacent to the second frequency, the first signal intensity is adjacent to the second signal intensity, an ultrasonic intensity vector is formed by the adjacent first signal intensity and the adjacent second signal intensity, a signal intensity variation vector can be obtained by taking an absolute value after the difference is made between the ultrasonic intensities of two adjacent frames, and then the signal intensity variation vector is calculated by using a variance calculation formula to obtain the transmission process of the ultrasonic signalWherein the variance represents a difference between each variable (observed value) and the overall mean, and the variance is calculated as

σ²Is the global variance, X is the variable, μ is the global mean, and N is the global reciprocal.

Specifically, the method is based on ultrasonic _ amp _ dif ═ abs (ultrasonic _ amp [ n [ ])]-ultrasonic_amp[n-1]) Calculating the first signal strength and the second signal strength to obtain a signal strength variation vector, wherein adjacent ultrasonic _ amp _ dif form the signal strength variation vector, and ultrasonic _ amp [ n ] is]For the first signal strength, ultrasonic _ amp [ n-1]]Is the second signal strength. Then based on

Calculating the signal intensity variation vector to obtain the variance of the signal intensity of the ultrasonic signal in the transmission process, wherein,

supersonics _ amp _ dif _ var is the variance of the signal strength, and N is the length of the signal strength variation vector.

Step S205: the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device and the frequency range of the ultrasonic signal received by the ultrasonic reception device are acquired.

In some embodiments, the mobile terminal may acquire a transmission frequency of an ultrasonic signal transmitted by its built-in ultrasonic transmitting device and acquire a frequency range of an ultrasonic signal received by its built-in ultrasonic receiving device. The transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device may be a fixed frequency, and therefore, the mobile terminal may acquire the transmission frequency based on the set transmission parameter of the ultrasonic signal of the ultrasonic transmission device. In addition, the frequency range of the ultrasonic signal received by the ultrasonic receiving device is related to the relative motion relationship between the mobile terminal and the object, so that the change range of the motion speed of most users in the process of using the mobile terminal can be obtained, and the frequency range of the ultrasonic signal received by the ultrasonic receiving device is determined according to the change range of the motion speed.

Step S206: determining a frequency variation interval based on the transmission frequency and the frequency range.

In some embodiments, after acquiring the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device and the frequency range of the ultrasonic signal received by the ultrasonic reception device, the frequency variation interval may be determined based on the transmission frequency and the frequency range. Referring to fig. 7, in some embodiments, the feature extraction module performs DFT with a data module having a length of fftlen 8192 each time to obtain a corresponding amplitude-frequency vector X as shown in fig. 7, where the actual frequency f is_nThe relation with the nth data of the amplitude-frequency vector X is as follows:

wherein f is_sFor the sampling rate, fftlen is the data length. Then X [ n ]]Representing the actual frequency f_nThe strength of (2).

Assuming that the key frequencies considered in the algorithm are n1, n2, n3, n4 and n5, n1 is point _ low, n2 is point _ mid _ low, n3 is point _ mid, n4 is point _ mid _ up, n5 is point _ up, ultrasonic 22500Hz, f _ min _ low 22494Hz, f _ min _ up 22506Hz, f _ low 22420Hz, and fup 22580Hz, the number of the considered key frequency in the amplitude-frequency vector is:

as shown in fig. 7, the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmitting device is point _ mid, the corresponding signal strength is ultrasonic _ amp, and the frequency range of the ultrasonic signal received by the ultrasonic receiving device is point _ low to point _ up, so that the frequency variation interval can be determined to be point _ low to point _ mid _ low and point _ min-up to point _ up.

In some embodiments, the first frequency variation interval and the second frequency variation interval may be determined based on the transmission frequency and the frequency range. For example, as shown in fig. 7, the first frequency variation interval is from point _ low to point _ mid _ low, and the second frequency variation interval is from point _ min-up to point _ up.

Step S207: and calculating the Doppler effect area difference of the ultrasonic signals in the transmission process according to the frequency change interval and the intensity change curve corresponding to the frequency change interval.

In some embodiments, after the frequency variation interval is acquired, an intensity variation curve corresponding to the frequency variation interval may be acquired based on the spectrogram, and the doppler effect area difference of the ultrasonic signal during transmission may be calculated based on the frequency variation interval and the intensity variation curve corresponding to the frequency variation interval. Specifically, after the first frequency variation interval is acquired, a first intensity variation curve corresponding to the first frequency variation interval may be acquired based on a spectrogram, and a first area of the ultrasonic signal during transmission may be calculated based on the first intensity variation curve corresponding to the first frequency variation interval and the first frequency variation interval, and meanwhile, after the second frequency variation interval is acquired, a second intensity variation curve corresponding to the second frequency variation interval may be acquired based on the spectrogram, and a second area of the ultrasonic signal during transmission may be calculated based on the second frequency variation interval and a second intensity variation curve corresponding to the second frequency variation interval. Further, a difference between the first area and the second area is calculated, for example, by subtracting the second area from the first area or by subtracting the first area from the second area, and a doppler effect area difference of the ultrasonic signal during transmission is obtained.

For example, in the frequency spectrum diagram shown in fig. 7, if the first frequency variation interval is from point _ low to point _ mid _ low, and X is a first intensity variation curve corresponding to the first frequency variation interval, the frequency point data from point _ low to point _ mid _ low may be summed to obtain a first area sum _ low:

and if the second frequency change interval is from point _ min-up to point _ up and X is a second intensity change curve corresponding to the second frequency change interval, summing the frequency point data between point _ min-up and point _ up to obtain a second area sum _ up:

obtaining the Doppler effect area difference Doppler _ dif of the ultrasonic signal in the transmission process according to the first area sum _ low and the second area sum _ up:

doppler_dif＝sum_up-sum_sum

step S208: and judging the relative motion relation between the mobile terminal and the object according to the variance of the signal intensity and the Doppler effect area difference.

For detailed description of step S208, please refer to step S103, which is not described herein.

Step S209: and when the mobile terminal is relatively close to the object, controlling the display screen to be in a screen-off state.

In some embodiments, when the detection result indicates that the mobile terminal and the object are relatively close to each other, the relative motion relationship between the mobile terminal and the object is an approaching motion, that is, when the mobile terminal is in a talking state, the mobile terminal is close to the ear of the user, that is, the display screen of the mobile terminal can be controlled to be in a screen resting state.

Step S210: and when the mobile terminal is relatively far away from the object, controlling the display screen to be in a bright screen state.

In some embodiments, when the detection result indicates that the mobile terminal and the object are relatively far away from each other, the relative motion relationship between the mobile terminal and the object is characterized as back-to-back motion, that is, when the mobile terminal is in a call state, the mobile terminal is far away from the ear of the user, that is, the display screen of the mobile terminal can be controlled to be in a bright screen state.

Step S211: and when the mobile terminal and the object are relatively static or the distance between the mobile terminal and the object is relatively kept unchanged and the mobile terminal or the object is in a shaking state, controlling the display screen to keep the previous state unchanged.

In some embodiments, the relative stillness of the mobile terminal and the object may be that the mobile terminal and the object both remain still, or that the motion state of the mobile terminal and the object is the same, for example, the motion speed of the mobile terminal and the object is the same, the motion amplitude is the same, and the motion frequency is the same, which is not limited herein. In this embodiment, when the determination result indicates that the mobile terminal and the object are relatively stationary, the relative motion relationship between the mobile terminal and the object is not changed, and the display screen may be controlled to keep the previous state unchanged, that is, in the process that the mobile terminal is in the call state, when the previous state of the display screen is the bright screen state, the display screen is kept in the bright screen state unchanged, and when the previous state of the display screen is the rest screen state, the display screen is kept in the rest screen state unchanged.

In some embodiments, the keeping of the distance between the mobile terminal and the object relatively constant and the mobile terminal or the object in the jittered state may include: the distance between the mobile terminal and the object is relatively kept unchanged, the mobile terminal is in a static state, and the object is in a shaking state; the distance between the mobile terminal and the object is relatively kept unchanged, the mobile terminal is in a shaking state, and the object is in a static state; the distance between the mobile terminal and the object is relatively kept unchanged, the mobile terminal is in a shaking state, and the object is in a shaking state. In this embodiment, when the determination result indicates that the distance between the mobile terminal and the object is relatively kept unchanged and the mobile terminal and/or the object is in a shaking state, it indicates that the mobile terminal or the object is in a normal shaking state, and the relative distance between the mobile terminal and the object is kept unchanged, and the display screen can be controlled to be kept unchanged from a previous state, that is, in the process that the mobile terminal is in a call state, when the previous state of the display screen is a bright screen state, the display screen is kept unchanged in a bright screen state, and when the previous state of the display screen is a rest screen state, the display screen is kept unchanged in a rest screen state.

Compared with the screen state control method shown in fig. 4, the screen state control method provided in another embodiment of the present application further calculates the variance of the signal intensity of the ultrasonic signal based on two signal intensities corresponding to two frequencies of the ultrasonic signal received by the ultrasonic receiving device, and calculates the doppler effect area difference based on the transmission frequency of the ultrasonic transmitting device and the frequency variation interval of the ultrasonic receiving device, so as to improve the calculation accuracy. In addition, the embodiment also controls the display screen to be in different states when the mobile terminal is relatively close to, relatively far away from, relatively still and shaken with the object, so that the accuracy and stability of the control of the display screen are improved.

Referring to fig. 8, fig. 8 is a flowchart illustrating a screen state control method according to still another embodiment of the present application. The method is applied to the mobile terminal, which includes an ultrasonic wave transmitting device, an ultrasonic wave receiving device and a display screen, and will be described in detail with respect to the flow shown in fig. 8, the screen state control method may specifically include the following steps:

step S301: when the mobile terminal is in a call state, the ultrasonic wave transmitting device transmits an ultrasonic wave signal, and the ultrasonic wave receiving device receives an ultrasonic wave signal returned by the ultrasonic wave signal after encountering an object.

Step S302: and acquiring a first frequency and a second frequency of the ultrasonic signal received by the ultrasonic receiving device.

Step S303: and acquiring a first signal strength corresponding to the first frequency and a second signal strength corresponding to the second frequency.

Step S304: and obtaining the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first signal intensity and the second signal intensity.

Step S305: the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device and the frequency range of the ultrasonic signal received by the ultrasonic reception device are acquired.

Step S306: determining a frequency variation interval based on the transmission frequency and the frequency range.

Step S307: and calculating the Doppler effect area difference of the ultrasonic signals in the transmission process according to the frequency change interval and the intensity change curve corresponding to the frequency change interval.

For detailed description of steps S301 to S307, refer to steps S201 to S207, which are not described herein again.

Step S308: and obtaining a target characteristic vector according to the variance of the signal intensity and the Doppler effect area difference.

In this embodiment, after obtaining the doppler effect area difference and the variance of the signal strength, the target feature vector may be obtained based on the doppler effect area difference and the variance of the signal strength, so as to obtain the relative motion relationship between the mobile terminal and the object according to the target feature vector, and control the state of the display screen based on the relative motion relationship between the mobile terminal and the object.

In some embodiments, after obtaining the variance of the signal strength, the mobile terminal may perform a logarithmic process on the variance of the signal strength, obtain a first eigenvector corresponding to the variance of the signal strength,so that the variation trend of the variance of the signal intensity is more clearly clear. In particular, in the present embodiment, it may be based on

Calculating the variance of the signal strength to obtain a first feature vector, wherein the supersonics _ amp _ dif _ var _ log is the first feature vector, the supersonics _ amp _ dif _ var is the variance of the signal strength, and the supersonics _ amp _ dif _ var _ log _ scale is an amplification factor. As one way, a plurality of adjacent ultrasonic _ amp _ dif _ var _ log are combined into a vector ultrasonic _ amp _ dif _ var _ log, and the vector ultrasonic _ amp _ dif _ var _ log is taken as a first feature vector.

In some embodiments, after obtaining the doppler effect area difference, the mobile terminal may process the doppler effect area difference to obtain a second feature vector corresponding to the doppler effect area difference. As one way, a plurality of adjacent doppler _ difs are combined into a vector doppler _ dif, and the vector doppler _ dif is taken as the second feature vector.

In this embodiment, after acquiring the first feature vector and the second feature vector, the mobile terminal may obtain the target feature vector based on the first feature vector and the second feature vector. In some embodiments, may be based on

And calculating the first feature vector and the second feature vector to obtain a target feature vector, wherein a contribution _ vector is the target feature vector, an ultrasonic _ amp _ dif _ var _ log is the first feature vector, and a doppler _ dif is the second feature vector.

Step S309: and inputting the target feature vector into a trained target classification model, wherein the trained target classification model is used for acquiring the variation trend of the target feature vector and outputting state information corresponding to the variation trend and used for representing the relative motion state of the mobile terminal and the object.

In some embodiments, after obtaining the target feature vector, the mobile terminal may input the target feature vector into a trained target classification model, where the trained target classification model is obtained through machine learning, specifically, first, a training data set is collected, attributes or features of one type of data in the training data set are distinguished from another type of data, and then, a neural network is trained and modeled by using the collected training data set according to a preset algorithm, so as to obtain the trained target classification model based on the training data set, where the trained target classification model may include a conventional SVM or a human worker neural network, and is not limited herein. In this embodiment, the training data set may include, for example, a target feature vector and status information indicating a bright screen status or a dark screen status of the control display screen.

It is understood that the trained target classification model may be stored locally at the mobile terminal after the pre-training is completed. Based on this, after obtaining the target feature vector, the mobile terminal may directly call the trained target classification model locally, for example, may directly send an instruction to the trained target classification model to instruct the trained target classification model to read the target feature vector in the target storage region, or the mobile terminal may directly input the target feature vector into the trained target classification model stored locally, thereby effectively avoiding reducing the speed at which the target feature vector is input into the trained target classification model due to the influence of network factors, so as to improve the speed at which the trained target classification model obtains the target feature vector, and improve user experience.

The trained target classification model may be stored in a server in communication with the mobile terminal after training is completed in advance. Based on this, after the mobile terminal obtains the target feature vector, the mobile terminal may send an instruction to the trained target classification model stored in the server through the network to instruct the trained target classification model to read the target feature vector obtained by the mobile terminal through the network, or the mobile terminal may send the target feature vector to the trained target classification model stored in the server through the network, so that the occupation of the storage space of the mobile terminal is reduced and the influence on the normal operation of the mobile terminal is reduced by storing the trained target classification model in the server.

Step S310: and acquiring the state information output by the trained target classification model.

In some embodiments, the trained target classification model outputs corresponding state information based on the read target feature vector, and the mobile terminal obtains the state information output by the trained target classification model. It can be understood that, if the trained target classification model is stored locally in the mobile terminal, the mobile terminal directly obtains the state information output by the trained target classification model; if the trained target classification model is stored in the server, the mobile terminal can acquire the state information output by the trained target classification model from the server through the network.

Step S311: and controlling the display screen to be in a bright screen state or a dark screen state based on the state information.

In some embodiments, the mobile terminal controls the display screen to be in a bright screen state or a dark screen state based on the state information output by the trained target classification model, so that the recognition success rate of the mobile terminal in different scenes is improved, and the control accuracy and stability of the bright screen of the display screen are improved.

Compared with the screen state control method shown in fig. 4, the screen state control method provided in another embodiment of the present application further calculates the variance of the signal intensity of the ultrasonic signal based on two signal intensities corresponding to two frequencies of the ultrasonic signal received by the ultrasonic receiving device, and calculates the doppler effect area difference based on the transmission frequency of the ultrasonic transmitting device and the frequency variation interval of the ultrasonic receiving device, thereby improving the calculation accuracy. In addition, the embodiment also obtains the relative motion state of the mobile terminal and the object through the trained target classification model and controls the state of the display screen, so as to improve the accuracy and stability of the control of the display screen through the machine model.

Referring to fig. 9, fig. 9 is a schematic flowchart illustrating a screen state control method according to another embodiment of the present application. The method is applied to the mobile terminal, which includes an ultrasonic wave transmitting device, an ultrasonic wave receiving device and a display screen, and will be described in detail with respect to the flow shown in fig. 9, the screen state control method may specifically include the following steps:

step S401: when the mobile terminal is in a call state, the ultrasonic wave transmitting device transmits an ultrasonic wave signal, and the ultrasonic wave receiving device receives an ultrasonic wave signal returned by the ultrasonic wave signal after encountering an object.

Step S402: and acquiring a first frequency and a second frequency of the ultrasonic signal received by the ultrasonic receiving device.

Step S403: and acquiring a first signal strength corresponding to the first frequency and a second signal strength corresponding to the second frequency.

Step S404: and obtaining the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first signal intensity and the second signal intensity.

Step S405: the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmission device and the frequency range of the ultrasonic signal received by the ultrasonic reception device are acquired.

Step S406: determining a frequency variation interval based on the transmission frequency and the frequency range.

Step S407: and calculating the Doppler effect area difference of the ultrasonic signals in the transmission process according to the frequency change interval and the intensity change curve corresponding to the frequency change interval.

Step S408: based on

And calculating the variance of the signal strength to obtain a first feature vector, wherein an ultrasonic _ amp _ dif _ var _ log is the first feature vector, an ultrasonic _ amp _ dif _ var is the variance of the signal strength, and an ultrasonic _ amp _ dif _ var _ log _ scale is an amplification factor.

Step S409: and taking the Doppler effect area difference as a second feature vector.

For detailed description of steps S401 to S409, refer to steps S301 to S308, which are not described herein again.

Step S410: and when the first characteristic vector and the second characteristic vector both meet a first condition, determining that the mobile terminal is relatively close to the object, wherein the first condition is a positive value and is changed from small to large.

As can be seen from fig. 10 and 11, during the process that the mobile terminal and the object are relatively close to each other, the first feature vector is ultrasonic _ amp _ dif _ var _ log, and the second feature vector is doppler _ dif, both the first feature vector and the second feature vector gradually increase from a small positive value to a large positive value. Therefore, when the first and second feature vectors ultrasonic _ amp _ dif _ var _ log and doppler _ dif both satisfy the first condition (positive and small to large), it may be determined that the mobile terminal is relatively close to the object, and the target feature vector may be marked as close.

Step S411: when the first characteristic vector meets a second condition and the second characteristic vector meets a third condition, the mobile terminal and the object are determined to be relatively far away, the second condition is a positive value and is changed from big to small, and the third condition is a negative value and is changed from small to big.

As can be seen from fig. 10 and 11, during the relative distance between the mobile terminal and the object, the first eigenvector ultrasonic _ amp _ dif _ var _ log decreases from a larger positive value to a smaller positive value, and the second eigenvector doppler _ dif gradually increases from a smaller negative value to around 0. Therefore, when the first feature vector ultrasonic _ amp _ dif _ var _ log satisfies the second condition (positive value and decreasing from large) and the second feature vector doppler _ dif satisfies the third condition (negative value and increasing from small), it may be determined that the mobile terminal and the object are relatively far away, and at this time, the target feature vector may be marked as an away state.

Step S412: determining that the mobile terminal and the object are relatively stationary, or that a distance between the mobile terminal and the object remains relatively unchanged and the mobile terminal or the object is in a shaken state, when the first feature vector does not satisfy the first condition and the second feature vector does not satisfy the first condition and the third condition.

As can be known from fig. 10 and 11, when the mobile terminal and the object are relatively stationary, or the distance between the mobile terminal and the object remains relatively unchanged and the mobile terminal or the object is in a shaking state, the first feature vector ultrasonic _ amp _ dif _ var _ log and the second feature vector doppler _ dif do not simultaneously have a trend of change in the process of relatively approaching the mobile terminal and the object or relatively moving away the mobile terminal and the object. Therefore, when the first feature vector ultrasonic _ amp _ dif _ var _ log does not satisfy the first condition (positive value and small size) and the second condition (positive value and small size), and the second feature vector doppler _ dif does not satisfy the first condition (positive value and small size) and the third condition (negative value and small size), it may be determined that the mobile terminal and the object are relatively stationary, or the distance between the mobile terminal and the object remains relatively unchanged and the mobile terminal and the object are in a jittering state, and at this time, the target feature vector may be marked as a normal state.

Step S413: and controlling the display screen to be in a bright screen state or a dark screen state according to the relative motion state.

For a detailed description of step S413, please refer to step S103, which is not described herein.

Compared with the screen state control method shown in fig. 4, the screen state control method provided in another embodiment of the present application further calculates the variance of the signal intensity of the ultrasonic signal based on two signal intensities corresponding to two frequencies of the ultrasonic signal received by the ultrasonic receiving device, and calculates the doppler effect area difference based on the transmission frequency of the ultrasonic transmitting device and the frequency variation interval of the ultrasonic receiving device, so as to improve the calculation accuracy. In addition, the embodiment also controls the display screen to be in the bright screen state or the dark screen state according to whether the first characteristic vector meets the first condition and the second condition and whether the second characteristic vector meets the first condition and the third condition, so that the accuracy and the stability of the control are improved.

Referring to fig. 12, fig. 12 is a block diagram illustrating a screen state control device 200 according to an embodiment of the present disclosure. The screen state control device 200 is applied to the mobile terminal including an ultrasonic wave transmitting device, an ultrasonic wave receiving device, and a display screen, and the screen state control device 200 includes: an ultrasonic signal transceiver module 210, a calculation module 220 and a state control module 230, wherein:

the ultrasonic signal transceiving module 210 is configured to receive, when the mobile terminal is in a call state, an ultrasonic signal sent by the ultrasonic sending apparatus, and receive, by the ultrasonic receiving apparatus, an ultrasonic signal returned by the ultrasonic signal after encountering an object.

A calculating module 220, configured to obtain a first attribute value of the ultrasonic signal in the transmission process, and calculate a variance of signal strength of the ultrasonic signal in the transmission process based on the first attribute value, and obtain a second attribute value of the ultrasonic signal in the transmission process, and calculate a doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value. Further, the calculation module 220 includes: a receiving frequency obtaining submodule, a signal strength obtaining submodule and a signal strength variance obtaining submodule, wherein:

and the receiving frequency acquisition submodule is used for acquiring the first frequency and the second frequency of the ultrasonic signal received by the ultrasonic receiving device.

And the signal strength acquisition submodule is used for acquiring first signal strength corresponding to the first frequency and second signal strength corresponding to the second frequency.

And the signal intensity variance obtaining sub-module is used for obtaining the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first signal intensity and the second signal intensity. Further, the variance obtaining submodule of the signal strength includes: a signal intensity variation vector obtaining unit and a variance obtaining unit of signal intensity, wherein:

a signal strength variation vector obtaining unit, configured to obtain a signal strength variation vector based on ultrasonic _ amp _ dif ═ abs (ultrasonic _ amp [ n ] -ultrasonic _ amp [ n-1]), where ultrasonic _ amp _ dif is the signal strength variation vector, ultrasonic _ amp [ n ] is the first signal strength, and ultrasonic _ amp [ n-1] is the second signal strength.

A variance obtaining unit of signal intensity for obtaining variance based on

Further, the calculating module 220 further includes: frequency acquisition submodule, frequency change interval confirm submodule and area difference calculation submodule, wherein:

and the frequency acquisition sub-module is used for acquiring the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmitting device and the frequency range of the ultrasonic signal received by the ultrasonic receiving device.

A frequency change interval determination submodule for determining a frequency change interval based on the transmission frequency and the frequency range. Further, the frequency variation interval determination submodule includes: a frequency change interval determination unit, wherein:

a frequency change interval determination unit configured to determine a first frequency change interval and a second frequency change interval based on the transmission frequency and the frequency range.

And the area difference calculation submodule is used for calculating the Doppler effect area difference of the ultrasonic signal in the transmission process according to the frequency change interval and the intensity change curve corresponding to the frequency change interval. Further, the area difference calculation submodule includes: a first area calculating unit, a second area calculating unit, and an area difference calculating unit, wherein:

and the first area calculation unit is used for calculating and obtaining a first area according to the first frequency change interval and a first intensity change curve corresponding to the first frequency change interval.

And the second area calculating unit is used for calculating and obtaining a second area according to the second frequency change interval and a second intensity change curve corresponding to the second frequency change interval.

And the area difference calculating unit is used for calculating the difference between the first area and the second area to obtain the Doppler effect area difference of the ultrasonic signals in the transmission process.

And the state control module 230 is configured to determine a relative motion state of the mobile terminal and the object according to the variance of the signal strength and the doppler effect area difference, and control the display screen to be in a bright screen state or a dark screen state according to the relative motion state. Further, the state control module 230 includes: relative motion relation judgment submodule, screen state control submodule, bright screen state control submodule and state holding submodule, wherein:

and the relative motion relation judgment submodule is used for judging the relative motion relation between the mobile terminal and the object according to the variance of the signal intensity and the Doppler effect area difference.

And the screen-turning state control submodule is used for controlling the display screen to be in a screen-turning state when the mobile terminal is relatively close to the object.

And the bright screen state control submodule is used for controlling the display screen to be in a bright screen state when the mobile terminal is relatively far away from the object.

And the state keeping sub-module is used for controlling the display screen to keep the previous state unchanged when the mobile terminal and the object are relatively static or the distance between the mobile terminal and the object is relatively kept unchanged and the mobile terminal or the object is in a shaking state.

Further, the state control module 230 further includes: the device comprises a target characteristic vector obtaining submodule, a target characteristic vector input submodule, a state information obtaining submodule and a state control submodule, wherein:

and the target characteristic vector obtaining submodule is used for obtaining a target characteristic vector according to the variance of the signal intensity and the Doppler effect area difference. Further, the target feature vector obtaining sub-module includes: a first feature vector obtaining unit, a second feature vector obtaining unit, and a target feature vector obtaining unit, wherein:

a first feature vector obtaining unit for obtaining a feature vector based on

A second eigenvector obtaining unit, configured to use the doppler effect area difference as a second eigenvector.

A target feature vector obtaining unit, configured to obtain the target feature vector based on the first feature vector and the second feature vector. Further, the method is carried out. The target feature vector obtaining unit includes: a target feature vector obtaining subunit, wherein:

a target feature vector obtaining subunit for obtaining a target feature vector based on

And calculating the first feature vector and the second feature vector to obtain the target feature vector, wherein a contribution _ vector is the target feature vector, an ultrasonic _ amp _ dif _ var _ log is the first feature vector, and a doppler _ dif is the second feature vector.

And the target feature vector input submodule is used for inputting the target feature vector into a trained target classification model, and the trained target classification model is used for acquiring the variation trend of the target feature vector and outputting state information which corresponds to the variation trend and is used for representing the relative motion state of the mobile terminal and the object.

And the state information acquisition submodule is used for acquiring the state information output by the trained target classification model.

And the state control submodule is used for controlling the display screen to be in a bright screen state or a dark screen state based on the state information.

Further, the state control module 230 further includes: a first determination submodule, a second determination submodule, and a third determination submodule, wherein:

the first determining submodule is used for determining that the mobile terminal is relatively close to the object when the first characteristic vector and the second characteristic vector both meet a first condition, and the first condition is a positive value and is changed from small to large.

The second determining submodule is used for determining that the mobile terminal is relatively far away from the object when the first characteristic vector meets a second condition and the second characteristic vector meets a third condition, the second condition is a positive value and is changed from big to small, and the third condition is a negative value and is changed from small to big.

A third determining sub-module, configured to determine that the mobile terminal and the object are relatively stationary or that a distance between the mobile terminal and the object remains relatively unchanged and the mobile terminal or the object is in a jittered state when the first feature vector does not satisfy the first condition and the second feature vector does not satisfy the first condition and the third condition.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.

In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.

Referring to fig. 13, a block diagram of a mobile terminal 100 according to an embodiment of the present disclosure is shown. The mobile terminal 100 may be a smart phone, a tablet computer, an electronic book, or other electronic devices capable of running an application program. The mobile terminal 100 in the present application may include one or more of the following components: a processor 110, a memory 120, a display 130, an ultrasound transmitting device 140, an ultrasound receiving device 150, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by the one or more processors 110, the one or more programs configured to perform the methods as described in the aforementioned method embodiments.

Processor 110 may include one or more processing cores, among other things. The processor 110 interfaces with various components throughout the mobile terminal 100 using various interfaces and lines, and performs various functions of the mobile terminal 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and invoking data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-programmable gate array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a communication chip.

The memory 120 may include a Random Access Memory (RAM) or a Read-only memory (Read-only memory). The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal 100 in use, such as a phonebook, audio-video data, chat log data, and the like.

The display 130 is used to display information input by a user, information provided to the user, and various graphic user interfaces of the mobile terminal 100, which may be composed of graphics, text, icons, numbers, video, and any combination thereof, and in one example, the display 130 may be a Liquid Crystal Display (LCD) or an organic light-emitting diode (OLED), which is not limited herein.

Referring to fig. 14, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 300 has stored therein a program code that can be called by a processor to execute the method described in the above-described method embodiments.

The computer-readable storage medium 300 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 300 includes a non-volatile computer-readable medium (non-transitory-readablestogramedium). The computer readable storage medium 300 has storage space for program code 310 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 310 may be compressed, for example, in a suitable form.

To sum up, according to the screen state control method, device, mobile terminal and storage medium provided in the embodiments of the present application, when the mobile terminal is in a call state, the ultrasonic signal is sent by the ultrasonic sending device, the ultrasonic signal returned by the ultrasonic signal after encountering an object is received by the ultrasonic receiving device, the first attribute value of the ultrasonic signal in the transmission process is obtained, the variance of the signal intensity of the ultrasonic signal in the transmission process is calculated based on the first attribute value, the second attribute value of the ultrasonic signal in the transmission process is obtained, the doppler effect area difference of the ultrasonic signal in the transmission process is calculated based on the second attribute value, the relative motion state between the mobile terminal and the object is determined according to the variance of the signal intensity and the doppler effect area difference, and the display screen is controlled to be in a bright screen state or a dark screen state according to the relative motion state, therefore, the display screen is controlled to be in a bright screen state or a dark screen state by calculating the variance of the signal intensity of the ultrasonic signal and the Doppler effect area difference, and the accuracy of detection control is improved.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A screen state control method is applied to a mobile terminal, wherein the mobile terminal comprises an ultrasonic wave transmitting device, an ultrasonic wave receiving device and a display screen, and the method comprises the following steps:

when the mobile terminal is in a call state, sending an ultrasonic signal through the ultrasonic sending device, and receiving an ultrasonic signal returned by the ultrasonic signal after encountering an object through the ultrasonic receiving device;

acquiring a first attribute value of an ultrasonic signal in the transmission process, calculating the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first attribute value, acquiring a second attribute value of the ultrasonic signal in the transmission process, and calculating the Doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value;

based on

Calculating the variance of the signal intensity to obtain a first feature vector, wherein ultrasonic _ amp _ dif _ var _ log is the first feature vector, ultrasonic _ amp _ dif _ var is the variance of the signal intensity, and ultrasonic _ amp _ dif _ var _ log _ scale is an amplification factor;

taking the Doppler effect area difference as a second feature vector;

when the first characteristic vector and the second characteristic vector both meet a first condition, determining that the mobile terminal is relatively close to the object, wherein the first condition is a positive value and is changed from small to big;

when the first characteristic vector meets a second condition and the second characteristic vector meets a third condition, determining that the mobile terminal is relatively far away from the object, wherein the second condition is a positive value and is changed from big to small, and the third condition is a negative value and is changed from small to big;

determining that the mobile terminal and the object are relatively stationary, or a distance between the mobile terminal and the object remains relatively unchanged and the mobile terminal or the object is in a shaken state, when the first feature vector does not satisfy the first condition and the second feature vector does not satisfy the first condition and the third condition;

and controlling the display screen to be in a bright screen state or a dark screen state according to the relative motion state of the mobile terminal and the object.

2. The method according to claim 1, wherein the determining a relative motion state of the mobile terminal and the object according to the variance of the signal strength and the doppler effect area difference, and controlling the display screen to be in a bright screen state or a dim screen state according to the relative motion state comprises:

judging the relative motion relation between the mobile terminal and the object according to the variance of the signal intensity and the Doppler effect area difference;

when the mobile terminal is relatively close to the object, controlling the display screen to be in a screen-off state;

when the mobile terminal is relatively far away from the object, controlling the display screen to be in a bright screen state;

and when the mobile terminal and the object are relatively static or the distance between the mobile terminal and the object is relatively kept unchanged and the mobile terminal or the object is in a shaking state, controlling the display screen to keep the previous state unchanged.

3. The method according to claim 1, wherein the determining a relative motion state of the mobile terminal and the object according to the variance of the signal strength and the doppler effect area difference, and controlling the display screen to be in a bright screen state or a dim screen state according to the relative motion state comprises:

obtaining a target characteristic vector according to the variance of the signal intensity and the Doppler effect area difference;

inputting the target feature vector into a trained target classification model, wherein the trained target classification model is used for acquiring the variation trend of the target feature vector and outputting state information corresponding to the variation trend and used for representing the relative motion state of the mobile terminal and the object;

acquiring the state information output by the trained target classification model;

and controlling the display screen to be in a bright screen state or a dark screen state based on the state information.

4. The method of claim 3, wherein obtaining a target feature vector based on the variance of the signal strength and the Doppler effect area difference comprises:

obtaining the target feature vector based on the first feature vector and the second feature vector.

5. The method of claim 4, wherein obtaining the target feature vector based on the first feature vector and the second feature vector comprises:

based on the parameter _ vector [ ultrasonic _ amp _ dif _ var _ log ]^T doppler_dif^T]^TAnd calculating the first feature vector and the second feature vector to obtain the target feature vector, wherein a contribution _ vector is the target feature vector, an ultrasonic _ amp _ dif _ var _ log is the first feature vector, and a doppler _ dif is the second feature vector.

6. The method according to any one of claims 1 to 5, wherein the acquiring a first attribute value of the ultrasonic signal during transmission and calculating a variance of signal strength of the ultrasonic signal during transmission based on the first attribute value comprises:

acquiring a first frequency and a second frequency of an ultrasonic signal received by the ultrasonic receiving device;

acquiring a first signal intensity corresponding to the first frequency and a second signal intensity corresponding to the second frequency;

and obtaining the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first signal intensity and the second signal intensity.

7. The method of claim 6, wherein obtaining the variance of the signal strength of the ultrasonic signal during transmission based on the first signal strength and the second signal strength comprises:

obtaining a signal strength variation vector based on ultrasonic _ amp _ dif ═ abs (ultrasonic _ amp [ n ] -ultrasonic _ amp [ n-1]), wherein ultrasonic _ amp _ dif is the signal strength variation vector, ultrasonic _ amp [ n ] is the first signal strength, and ultrasonic _ amp [ n-1] is the second signal strength;

based on

8. The method according to any one of claims 1-5, wherein said obtaining the value of the second attribute and the value of the mid-transmission attribute of the ultrasonic signal, and calculating the difference in Doppler effect area of the ultrasonic signal during transmission based on the value of the second attribute comprises:

acquiring the transmission frequency of the ultrasonic signal transmitted by the ultrasonic transmitting device and the frequency range of the ultrasonic signal received by the ultrasonic receiving device;

determining a frequency variation interval based on the transmission frequency and the frequency range;

and calculating the Doppler effect area difference of the ultrasonic signals in the transmission process according to the frequency change interval and the intensity change curve corresponding to the frequency change interval.

9. The method of claim 8, wherein determining a frequency variation interval based on the transmission frequency and the frequency range comprises:

determining a first frequency variation interval and a second frequency variation interval based on the transmission frequency and the frequency range;

the calculating the doppler effect area difference of the ultrasonic signal in the transmission process according to the frequency change interval and the intensity change curve corresponding to the frequency change interval includes:

calculating to obtain a first area according to the first frequency change interval and a first intensity change curve corresponding to the first frequency change interval;

calculating to obtain a second area according to the second frequency change interval and a second intensity change curve corresponding to the second frequency change interval;

and calculating the difference between the first area and the second area to obtain the Doppler effect area difference of the ultrasonic signals in the transmission process.

10. A screen state control device is applied to a mobile terminal, wherein the mobile terminal comprises an ultrasonic wave transmitting device, an ultrasonic wave receiving device and a display screen, and the device comprises:

the ultrasonic signal receiving and sending module is used for receiving an ultrasonic signal sent by the ultrasonic sending device and an ultrasonic signal returned by the ultrasonic signal after encountering an object through the ultrasonic receiving device when the mobile terminal is in a call state;

the calculation module is used for acquiring a first attribute value of the ultrasonic signal in the transmission process, calculating the variance of the signal intensity of the ultrasonic signal in the transmission process based on the first attribute value, acquiring a second attribute value of the ultrasonic signal in the transmission process, and calculating the Doppler effect area difference of the ultrasonic signal in the transmission process based on the second attribute value;

a state control module for controlling the operation of the motor based on

Calculating the variance of the signal intensity to obtain a first feature vector, wherein ultrasonic _ amp _ dif _ var _ log is the first feature vector, ultrasonic _ amp _ dif _ var _ log is the variance of the signal intensity, ultrasonic _ amp _ dif _ var _ log _ scale is an amplification factor, the Doppler effect area difference is used as a second feature vector, and when the first feature vector and the first feature vector are combined, the Doppler effect area difference is used as a second feature vectorWhen the second characteristic vectors meet a first condition, determining that the mobile terminal is relatively close to the object, wherein the first condition is a positive value and is changed from small to big, determining that the mobile terminal is relatively far away from the object when the first feature vector satisfies a second condition and the second feature vector satisfies a third condition, the second condition is a positive value and is changed from large to small, the third condition is a negative value and is changed from small to large, determining that the mobile terminal is relatively stationary with the object when the first feature vector does not satisfy the first condition and the second feature vector does not satisfy the first condition and the third condition, or the distance between the mobile terminal and the object is relatively kept constant and the mobile terminal or the object is in a shaking state, and controlling the display screen to be in a bright screen state or a dark screen state according to the relative motion state of the mobile terminal and the object.

11. A mobile terminal comprising an ultrasound transmitting device, an ultrasound receiving device, a display screen, a memory, and a processor, the ultrasound transmitting device, the ultrasound receiving device, the display screen, and the memory and memory coupled to the processor, the memory storing instructions that, when executed by the processor, the processor performs the method of any of claims 1-9.

12. A computer-readable storage medium, having stored thereon program code that can be invoked by a processor to perform the method according to any one of claims 1 to 9.