CN107544803B

CN107544803B - Ultrasonic wave-based on-off screen control method and device and readable storage medium

Info

Publication number: CN107544803B
Application number: CN201710777820.5A
Authority: CN
Inventors: 白金; 苗雷; 王维平; 常江; 冯协; 孙丽; 王冲; 郭佳良
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2017-08-31
Filing date: 2017-08-31
Publication date: 2020-08-21
Anticipated expiration: 2037-08-31
Also published as: CN107544803A

Abstract

The invention discloses a method and a device for controlling on and off of a screen based on ultrasonic waves and a computer readable storage medium, wherein the method for controlling on and off of the screen based on the ultrasonic waves comprises the following steps: acquiring an ultrasonic frequency change interval received by an ultrasonic receiving party and an intensity change curve corresponding to the frequency change interval; determining a displacement curve of the ultrasonic wave sender according to the frequency change interval and the corresponding intensity change curve; and controlling the screen on or off of the ultrasonic wave sender according to the displacement curve. According to the scheme, the moving trend of the ultrasonic sender is determined by directly representing the displacement curve of the moving direction of the ultrasonic sender, and then the screen on/off of the ultrasonic sender is controlled according to the moving trend, so that the screen on/off of the ultrasonic sender is more accurate.

Description

Ultrasonic wave-based on-off screen control method and device and readable storage medium

Technical Field

The invention relates to the technical field of ultrasonic waves, in particular to a method and a device for controlling on and off of a screen based on ultrasonic waves and a readable storage medium.

Background

The ultrasonic wave is sound wave with frequency higher than 20KHz, and is widely applied to industry, agriculture and medicine, such as distance measurement, speed measurement, welding, stone breaking, sterilization and disinfection and the like. The method can also be applied to the mobile terminal and used for detecting the displacement between the mobile terminal and the human body so as to determine the moving trend of the mobile terminal relative to the human body according to the displacement, thereby controlling the on-off screen of the mobile terminal. During detection, the mobile terminal sends out ultrasonic waves and receives the ultrasonic waves which are reflected by the head of a human body and return to the mobile terminal, and whether the mobile terminal is far away from the human body or close to the human body is determined according to the time length of the mobile terminal for receiving the ultrasonic waves each time. The method does not consider the influence of external environment factors according to the time length of receiving the ultrasonic waves, and cannot accurately reflect the motion trend of the mobile terminal, so that the control of the on-off screen of the mobile terminal is inaccurate.

Disclosure of Invention

The invention mainly aims to provide a method and a system for controlling on/off of a screen based on ultrasonic waves and a readable storage medium, and aims to solve the problem that the control of on/off of the screen of a mobile terminal is inaccurate in the prior art.

In order to achieve the above object, the present invention provides an ultrasonic-based on-off screen control method, which includes the following steps:

acquiring an ultrasonic frequency change interval received by an ultrasonic receiving party and an intensity change curve corresponding to the frequency change interval;

determining a displacement curve of the ultrasonic wave sender according to the frequency change interval and the corresponding intensity change curve;

and controlling the screen on or off of the ultrasonic wave sender according to the displacement curve.

Optionally, the step of controlling the ultrasonic wave transmitter to turn on or turn off the screen according to the displacement curve includes:

acquiring a plurality of continuous data points on a displacement curve, and averaging each data value of the plurality of continuous data points;

taking the average value as a new data value of a plurality of continuous data points, and forming a new displacement curve according to the new data value;

and controlling the screen to be on or off by the ultrasonic transmitter according to the new displacement curve.

Optionally, the step of obtaining a plurality of consecutive data points on the displacement curve, and averaging the respective data values of the plurality of consecutive data points includes:

determining the value intervals and the preset number of a plurality of continuous data points on the displacement curve;

determining an initial data point of a plurality of continuous data points according to the value interval, and acquiring continuous data points corresponding to a preset number from a displacement curve according to the initial data point;

the successive data points are formed into a combination of data points and the combination of data points is averaged.

Optionally, the step of controlling the ultrasonic wave transmitter to turn on or turn off the screen according to the new displacement curve includes:

judging whether the numerical value on the new displacement curve is larger than a first threshold value, and controlling an ultrasonic wave sender to light the screen when the numerical value on the new displacement curve is larger than the first threshold value;

and judging whether the numerical value on the new displacement curve is smaller than a second threshold value, and controlling the ultrasonic wave sender to perform screen-off operation when the numerical value on the new displacement curve is smaller than the second threshold value, wherein the first threshold value is larger than the second threshold value.

Optionally, the frequency change interval includes a first interval and a second interval, and the step of determining the displacement curve of the ultrasonic wave transmitting side according to the frequency change interval and the corresponding intensity change curve includes:

determining a first area according to a first interval and an intensity change curve corresponding to the first interval;

determining a second area according to a second interval and an intensity change curve corresponding to the second interval;

and determining a displacement curve of the ultrasonic wave sender according to the first area and the second area.

Optionally, the step of determining a displacement curve of the ultrasonic wave transmitting side according to the first area and the second area includes:

determining a plurality of difference values of a plurality of first areas and second areas, and forming a displacement data set of an ultrasonic transmitter by the plurality of difference values;

and forming a displacement curve by the displacement data group.

Optionally, before the step of acquiring the ultrasonic frequency change interval received by the ultrasonic receiving side and the intensity change curve corresponding to the frequency change interval, the one or more programs may be further executable by the one or more processors to:

and determining an ultrasonic frequency change interval received by the ultrasonic receiving party and an intensity change curve corresponding to the ultrasonic frequency change interval according to the preset moving speed of the ultrasonic transmitting party.

Optionally, the step of determining the ultrasonic frequency change interval received by the ultrasonic receiving side according to the preset moving speed of the ultrasonic transmitting side includes:

determining the frequency variation range of the ultrasonic wave received by the ultrasonic wave receiving party according to the preset moving speed of the ultrasonic wave sending party;

acquiring the basic frequency of the ultrasonic wave sent by the ultrasonic wave sender, and determining a frequency change interval according to the basic frequency and the frequency change range.

In addition, in order to achieve the above object, the present invention further provides an ultrasonic wave-based on-off screen control device, including: the device comprises a memory, a processor, a communication bus and an ultrasonic wave-based on-off screen control program stored on the memory, wherein the ultrasonic wave-based on-off screen control program comprises the following steps:

the communication bus is used for realizing connection communication between the processor and the memory;

the processor is used for executing the ultrasonic wave-based on-off screen control program to realize the following steps:

Further, to achieve the above object, the present invention also provides a readable storage medium storing one or more programs, the one or more programs being executable by one or more processors for:

According to the technical scheme, the screen on-off control method based on the ultrasonic waves comprises the steps of obtaining an ultrasonic wave frequency change interval received by an ultrasonic wave receiving party and an intensity change curve corresponding to the frequency change interval; determining a displacement curve of the ultrasonic wave sender according to the frequency change interval and the intensity change curve corresponding to the frequency change interval; thereby controlling the screen on or off of the ultrasonic wave sender according to the displacement curve. According to the scheme, the moving trend of the ultrasonic sender is determined by directly representing the displacement curve of the moving direction of the ultrasonic sender, and then the screen on/off of the ultrasonic sender is controlled according to the moving trend, so that the screen on/off of the ultrasonic sender is more accurate.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention;

FIG. 2 is a diagram illustrating a wireless communication system of the mobile terminal shown in FIG. 1;

fig. 3 is a schematic flow chart of the ultrasonic-based on-off screen control method applied to a first embodiment of a sending end according to the present invention;

fig. 4 is a schematic flow chart of the ultrasonic-based on-off screen control method applied to a second embodiment of the sending end;

FIG. 5 is a schematic diagram of an apparatus structure of a hardware operating environment according to a method of an embodiment of the present invention;

FIG. 6 is a schematic diagram of a first scene of the ultrasonic-based on-off screen control method according to the present invention;

fig. 7 is a schematic view of a second scene of the ultrasonic-based on-off screen control method according to the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

The following description will be given by way of example of a mobile terminal, and it will be understood by those skilled in the art that the construction according to the embodiment of the present invention can be applied to a fixed type terminal, in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex-Long Term Evolution), and TDD-LTE (Time Division duplex-Long Term Evolution).

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and charging functions Entity) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the hardware structure of the mobile terminal and the structure of the communication device, the invention provides various embodiments of the ultrasonic-based on-off screen control method.

Referring to fig. 3, the present invention provides an ultrasonic-based on-off screen control method, and in a first embodiment of the ultrasonic-based on-off screen control method, the ultrasonic-based on-off screen control method includes:

step S10, obtaining the ultrasonic frequency change interval received by the ultrasonic receiver and the intensity change curve corresponding to the frequency change interval;

the ultrasonic wave-based on-off screen control of the present embodiment is mainly applicable to on-off screen control of a sender sending the ultrasonic wave by the ultrasonic wave. The ultrasonic wave transmitting party is equipment with a screen display device and transmits ultrasonic waves outwards, the ultrasonic wave receiving party receives the transmitted ultrasonic waves, the displacement trend of the ultrasonic wave transmitting party is determined according to parameters of the transmitted and received ultrasonic waves, and then the screen on/off of the ultrasonic wave transmitting party is controlled according to the displacement trend. The ultrasonic wave sender and the ultrasonic wave receiver can be integrated in the same mobile terminal, the mobile terminal can be used as the ultrasonic wave sender and the ultrasonic wave receiver at the same time, and can be a smart phone or a tablet computer, wherein the smart phone is taken as an example for explanation. The smart phone is provided with an ultrasonic wave sender capable of sending ultrasonic waves and an ultrasonic wave receiver capable of receiving the ultrasonic waves, and particularly, the ultrasonic wave sender can be integrated in a receiver of the smart phone, and the ultrasonic wave receiver can be integrated in Mic of the smart phone; therefore, the earphone converts the current signal with the changed intensity into a sound signal, the transmitted sound is restored, meanwhile, the ultrasonic signal is sent out, and the Mic converts the received sound signal into the current signal with the changed intensity to transmit, and meanwhile, the ultrasonic signal sent out by the earphone is received. For the smart phone with the main Mic and the auxiliary Mic, the main Mic is set to be used for receiving voice signals during conversation, and the auxiliary Mic is set to be used for receiving ultrasonic signals, so that mutual interference of the signals is avoided. Understandably, the ultrasonic wave is a sound wave with a frequency greater than 20KHz, so that the frequency of the ultrasonic wave sent out by the mobile terminal is correspondingly a certain frequency greater than 20KHz, such as 40KHz, and the certain frequency greater than 20KHz is the fundamental frequency of the ultrasonic wave sent by the ultrasonic wave sender.

In addition, the displacement trend of the ultrasonic wave sender in this embodiment is a displacement trend of the mobile terminal relative to the user, and the user holds the mobile terminal close to or away from the user in the process of using the mobile terminal, so that the mobile terminal has a displacement trend close to or away from the user, and relative movement exists between the mobile terminal and the user. On the other hand, according to the doppler effect, when the mobile terminal as the ultrasonic wave transmitting side moves relative to the user, if the two are close to each other, the ultrasonic wave is compressed, the wavelength becomes shorter, the frequency becomes higher, and the blue shift phenomenon is generated; if the two are far away from each other, the opposite effect is generated, the wavelength of the ultrasonic wave becomes longer, and the frequency becomes lower, namely the red shift phenomenon is generated; and the higher the speed of movement between the two, the greater the effect produced. The movement of the mobile terminal relative to the user in this embodiment is substantially a process in which the user picks up the mobile terminal to get close to or get away from the user during the process of using the mobile terminal, and the change of the frequency of the ultrasonic wave received by the ultrasonic wave receiving party is correspondingly changed within a certain range in consideration of the fact that the speed of picking up the mobile terminal by the user is changed within a certain range, which is a frequency change range. The frequency variation range is a frequency variation range due to relative movement between the ultrasonic wave reception side and the ultrasonic wave sound source, and the frequency received by the ultrasonic wave reception side can be varied within this range. Therefore, the frequency variation interval of the ultrasonic wave received by the ultrasonic receiving side can be determined according to the frequency variation range, and the frequency variation interval is the interval obtained by changing the basic frequency in the frequency variation range. In addition, the ultrasonic frequencies received by the ultrasonic receiving side all have corresponding intensity values, so that after the frequency change interval is determined, each frequency in the frequency change interval corresponds to a corresponding intensity value, and the intensities corresponding to all the changed frequencies in the interval form an intensity change curve. And acquiring an ultrasonic frequency change interval received by the ultrasonic receiver and an intensity change curve corresponding to the frequency interval to determine the movement trend of the mobile terminal relative to the user and control the screen on or off of the mobile terminal.

Step S20, determining the displacement curve of the ultrasonic wave sender according to the frequency change interval and the corresponding intensity change curve;

further, the frequency variation interval and the area formed by the intensity variation curve corresponding to the frequency variation interval can be used to represent the displacement of the ultrasonic sound source, i.e. the displacement of the ultrasonic wave transmitting side. Because a single displacement data can not reflect the moving trend between the mobile terminal and the user, a plurality of displacements need to be determined, the moving trend between the mobile terminal and the user is reflected through the numerical value change among the plurality of displacements, and if the plurality of numerical values display that the distance between the mobile terminal and the user is closer or farther, the moving trend that the mobile terminal is close to or far away from the user is indicated. The ultrasonic wave transmitting side transmits the ultrasonic wave in a certain time period, and the corresponding ultrasonic wave receiving side receives the ultrasonic wave in the certain time period. Each area represents a displacement of the mobile terminal relative to the user, and the change of the displacement is represented by the change of the size of the area. Specifically, a two-dimensional coordinate system of XY axes is established, the X axis is time, the Y axis is displacement, and a displacement curve can be formed by using the area formed by the frequency change interval corresponding to each time period and the intensity change curve corresponding to the frequency change interval as displacement value points on the Y axis and the displacement value points corresponding to a plurality of time periods. And determining the moving trend of the mobile terminal and the user according to the change of the displacement on the displacement curve.

And step S30, controlling the screen on or off of the ultrasonic wave sender according to the displacement curve.

Furthermore, in the two-dimensional coordinate system of the displacement curve, a value in the positive direction of the Y axis indicates that the mobile terminal approaches to the user, and a value in the negative direction of the Y axis indicates that the mobile terminal moves away from the user. Therefore, the mobile terminal is determined to approach or depart from the user according to the positive and negative values, and the screen on/off of the mobile terminal is realized according to the approaching or departing state. If the mobile terminal receives an incoming call, the mobile terminal is lightened to display the incoming call, and when the movement trend between the mobile terminal and the user is determined to be close through the displacement curve, the user is judged to take the mobile terminal close to answer the incoming call, so that the screen of the mobile terminal is controlled to be turned off, and the energy consumption of the mobile terminal is reduced; and when the movement trend between the mobile terminal and the user is determined to be far away through the displacement curve, the fact that the user has finished taking the mobile terminal away from the user is judged, and therefore the mobile terminal is controlled to be bright to display call information, and the user can know the call state.

According to the technical scheme, the screen on-off control method based on the ultrasonic waves comprises the steps of obtaining an ultrasonic wave frequency change interval received by an ultrasonic wave receiving party and an intensity change curve corresponding to the frequency change interval; determining a displacement curve of the ultrasonic wave sender according to the frequency change interval and the intensity change curve corresponding to the frequency change interval; thereby controlling the screen on or off of the ultrasonic wave sender according to the displacement curve. According to the scheme, the moving trend of the mobile terminal and a user is determined by directly representing the displacement curve of the moving direction of the ultrasonic sender, and then the screen on or off of the ultrasonic sender is controlled according to the moving trend, so that the judgment of the moving trend is more accurate, and the control of the screen on or off is more accurate.

Further, in another embodiment of the method for controlling on/off of a screen based on ultrasonic waves, the step of controlling on/off of a screen of an ultrasonic wave transmitter according to the displacement curve includes:

step S31, obtaining a plurality of continuous data points on the displacement curve, and averaging each data value of the plurality of continuous data points;

step S32, taking the average value as a new data value of a plurality of continuous data points, and forming a new displacement curve according to the new data value;

and step S33, controlling the screen on or off of the ultrasonic wave sender according to the new displacement curve.

Understandably, in a time period, there are numerous frequency variation intervals and area values representing numerous displacements formed by corresponding intensity variation curves, and the numerous displacement values may be partially located in the positive direction of the Y axis or partially located in the negative direction of the Y axis in the two-dimensional coordinate system. Therefore, the mobile terminal is judged to be possibly close to the user and possibly far away from the user, and the problem that the judgment result is inaccurate occurs. To avoid this problem, the present embodiment performs smoothing processing on the numerical points on the displacement curve. Specifically, a plurality of consecutive data points on the displacement curve are acquired, the respective data values of the plurality of consecutive data points are averaged, and the average is taken as a new data value of the plurality of consecutive data points used for averaging. Referring to fig. 6, after all points on the displacement curve are subjected to the average value processing, a new displacement curve is formed by all new data values obtained through the average value processing, so as to control the screen on/off of the ultrasonic wave sender according to the new displacement curve. A new displacement curve is formed by averaging a plurality of continuous data points on the original displacement curve, so that the data points on the displacement curve can reflect the displacement trend of the mobile terminal more accurately. Wherein the step of obtaining a plurality of consecutive data points on the displacement curve and averaging the data values of the plurality of consecutive data points comprises:

step S311, determining the value intervals and the preset number of a plurality of continuous data points on the displacement curve;

step S312, determining an initial data point of a plurality of continuous data points according to the value interval, and acquiring continuous data points corresponding to a preset number from a displacement curve according to the initial data point;

step S313, forming the continuous data points into a data point combination, and averaging the data point combination.

Furthermore, in order to obtain more accurate average values, the data points for each averaging are set to be partially repeated, such as the first averaging of the 1 st to 10 th data points on the displacement curve, the second averaging of the 2 nd to 11 th or 3 rd to 12 th data points, and the 2 nd to 10 th or 3 th to 10 th data points for the first and second averaging are repeated, so that the averaged result fits the data points of the original displacement curve. The number of the overlapped data is determined by the value interval, and the value interval is 1 if the 2 nd to 11 th data points are averaged for the second time; and when the 3 rd to 12 th data points are averaged for the second time, the value interval is 2. The number of the averaging points is determined by the preset number, and if the preset number is 10, the averaging is performed on 10 data points on the displacement curve each time. In this embodiment, the initial data point of the plurality of continuous data points, which are averaged each time, is determined according to the value interval by determining the value interval and the preset number of the plurality of continuous data points on the displacement curve. Additionally, the first averaged starting data point may be determined by a predetermined convention, such as a convention that uses the first data point on the displacement curve as the first averaged starting data point. And determining the initial data point of the subsequent averaging according to the value interval, wherein if the initial data point of the first time is 1 and the value interval is 3, the initial data point of the second time is 4, and the initial data point of the third time is based on the initial data point 4 of the second time and the value interval is 3, namely the initial data point of the third time is 7. After the initial data point of each value is determined, continuous data points corresponding to the preset number are obtained from the displacement curve by the initial data point, such as 1-10, 4-13, 7-16 and the like. After acquiring successive data points for each averaging, the successive data points are formed into a data point combination, which is averaged. Specifically, the data values corresponding to all the data points in the numerical combination are summed, and the result obtained by the summation operation and the preset number are subjected to quotient operation, wherein the quotient operation result is the average value of the data point combination. In the embodiment, the data points of each averaging are set to be partially repeated, so that the averaging is more accurate, and the moving trend of the mobile terminal can be reflected.

In another embodiment of the method for controlling on/off of a screen based on ultrasonic waves, the step of controlling on/off of the screen by an ultrasonic wave sender according to the displacement curve includes:

step S34, the step of controlling the screen on or off of the ultrasonic wave sender according to the new displacement curve comprises the following steps:

step S35, judging whether the value on the new displacement curve is larger than a first threshold value, and controlling the ultrasonic wave sender to turn off the screen when the value is larger than the first threshold value;

and step S36, judging whether the value on the new displacement curve is smaller than a second threshold value, and controlling the ultrasonic wave sender to perform screen-on operation when the value on the new displacement curve is smaller than the second threshold value, wherein the first threshold value is larger than the second threshold value.

Understandably, in the process of using the mobile terminal by a user, the mobile terminal has two states of approaching and departing from the user, wherein the relative distance between the mobile terminal and the user is the farthest distance of the arm of the user. When the relative distance between the mobile terminal and the mobile terminal is in the farthest state and the motion trend of the mobile terminal is judged to be close to the user, the screen of the mobile terminal is controlled to be off, so that the display is unreasonable, and the user may not see the content of the caller identification on the mobile terminal. Correspondingly, when the motion trend of the mobile terminal is judged to be far away from the user, it is unreasonable to immediately control the mobile terminal to be lightened, the mobile terminal may not reach the position where the user can see the display screen, and the lightening of the screen can cause the waste of the electric quantity of the mobile terminal. Therefore, the embodiment is provided with the first threshold and the second threshold, the first threshold is used for judging whether the moving distance between the mobile terminal and the user is close enough to the user when the displacement trend between the mobile terminal and the user is close, and the second threshold is used for judging whether the moving distance between the mobile terminal and the user is far enough to the user when the displacement trend between the mobile terminal and the user is far away. Referring to fig. 6, since the approach is determined by the positive Y-axis direction on the displacement curve and the approach is determined by the negative Y-axis direction on the displacement curve, the first threshold is greater than the second threshold, and the first threshold is a positive value and the second threshold is a negative value. Referring to fig. 7, when the value on the displacement curve after the smoothing process is greater than the first threshold, that is, the distance that the mobile terminal moves to the user is greater than the first threshold, it is determined that the displacement trend between the mobile terminal and the user is close, and the distance between the mobile terminal and the user reaches the screen-off distance, and the screen-off process is performed; and when the numerical value on the displacement curve is smaller than a second threshold value, namely the distance of the mobile terminal moving away from the user is smaller than the second threshold value, judging that the displacement trend between the mobile terminal and the user is away, and the distance between the mobile terminal and the user reaches a screen lightening distance, and carrying out screen lightening processing.

Further, in another embodiment of the method for controlling on/off of a screen based on ultrasonic waves of the present invention, the frequency variation interval includes a first interval and a second interval, and the step of determining the displacement curve of the ultrasonic wave transmitting side according to the frequency variation interval and the corresponding intensity variation curve includes:

step S21, determining a first area according to a first interval and an intensity variation curve corresponding to the first interval;

step S22, determining a second area according to a second interval and an intensity change curve corresponding to the second interval;

and step S23, determining the displacement curve of the ultrasonic wave transmitting side according to the first area and the second area.

Further, since the frequency variation section is a section in which the base frequency is varied within the frequency variation range, and the frequency variation range is a range in which the frequency value including the upper boundary and the lower boundary is varied, the base frequency is varied between the upper boundary and the lower boundary of the frequency variation range and includes being larger and smaller. Wherein, the difference operation is performed on the basic frequency and the frequency variation range when the frequency is reduced, and the sum operation is performed on the basic frequency and the frequency variation range when the frequency is increased. The difference between the difference operation and the sum operation can determine different frequency change intervals, wherein the result obtained by the sum operation is a first interval of the frequency change intervals, and the result obtained by the difference operation is a second interval of the frequency change intervals. If the basic frequency is f and the frequency variation range is f 1-f 2, the first interval is (f + f1) - (f + f 2); the second interval is (f-f2) to (f-f 1). After the first interval and the second interval are determined, the frequencies in the first interval and the second interval correspond to the respective intensity curves, and the intensity value corresponding to the starting point and the ending point of the first interval, the frequency variation range of the first interval and the closed area surrounded by the intensity variation curve of the first interval are used as the first area. And taking the intensity value corresponding to the starting point and the ending point of the second interval, the frequency change range of the second interval and a closed area surrounded by the intensity change curve of the second interval as a second area. The size of the area of the first region, i.e., the first area, can be obtained by integrating the frequency variation range of the first interval through the intensity variation curve corresponding to the first interval. And integrating the frequency change range of the second interval through the intensity change curve corresponding to the second interval to obtain the area size of the second area, namely the second area. Thereby according to this first area and second area, confirm the displacement curve of the ultrasonic wave sender, its concrete step:

step S231, determining a plurality of difference values of a plurality of first areas and second areas, and forming a displacement data group of an ultrasonic wave sender by the plurality of difference values;

and step S232, forming a displacement curve by the displacement data group.

After the area size of the first area and the area size of the second area, namely the first area and the second area, are determined, the first area and the second area are subjected to difference operation, namely the second area is subtracted from the first area, and the difference result of the difference operation is the displacement of the ultrasonic wave sender. The difference value is the distance of displacement, the positive and negative of the difference value is the direction of displacement, the difference value is that the mobile terminal moves close to the user in a regular mode, and the mobile terminal moves away from the user in a negative mode. In this embodiment, by obtaining the frequency variation interval and the corresponding intensity variation curve in each time period, each frequency variation interval and the corresponding intensity variation curve form a corresponding first area and a corresponding second area, that is, a plurality of first areas and second areas. And performing difference operation on the plurality of first areas and the corresponding second areas to obtain a plurality of difference values, forming a displacement data set of the ultrasonic wave sending party by the plurality of difference values, wherein each displacement data set at least comprises a time period and the difference value, forming a displacement curve according to the plurality of groups of time periods and the difference values, determining the moving trend of the mobile terminal relative to the user, and controlling the screen on or off of the mobile terminal.

Further, referring to fig. 4, on the basis of the first embodiment of the method for controlling on/off of a screen based on ultrasonic waves, the second embodiment of the method for controlling on/off of a screen based on ultrasonic waves is provided, and in the second embodiment, the step of acquiring the frequency variation interval of the ultrasonic waves received by the ultrasonic wave receiving side and the intensity variation curve corresponding to the frequency variation interval includes:

and step S40, determining the frequency change interval of the ultrasonic wave received by the ultrasonic wave receiving side and the intensity change curve corresponding to the frequency change interval of the ultrasonic wave according to the preset moving speed of the ultrasonic wave transmitting side.

Further, the frequency change of the ultrasonic wave received by the mobile terminal is caused by the relative motion between the mobile terminal and the user, and the frequency change interval is determined by the speed change range of the relative motion. Understandably, the relative motion between the mobile terminal and the user is the relative motion between the mobile terminal and the trunk or the head of the human body of the user when the user picks up the mobile terminal in the process of using the mobile terminal. The speed of the user for picking up the mobile terminal is changed within a certain range, and the specific change range can determine the speed of most users for using the mobile terminal in a test mode. And taking the speed range meeting the requirements of most users as the preset moving speed of the ultrasonic wave sender, and determining the frequency change interval of the ultrasonic wave received by the ultrasonic wave receiver according to the preset moving speed. And the ultrasonic frequency received by the ultrasonic receiver has corresponding intensity value, so that after the frequency change interval is determined, each frequency in the frequency change interval corresponds to the corresponding intensity value, and the intensities corresponding to all the changed frequencies in the interval form an intensity change curve. The step of determining the ultrasonic frequency change interval received by the ultrasonic receiver according to the preset moving speed of the ultrasonic transmitter comprises the following steps:

step S41, determining the frequency variation range of the ultrasonic wave received by the ultrasonic wave receiving party according to the preset moving speed of the ultrasonic wave sending party and the basic frequency of the ultrasonic wave sent by the ultrasonic wave sending party;

step S42, determining a frequency variation interval according to the frequency variation range and the fundamental frequency.

Furthermore, after the preset moving speed meeting the requirements of most users is determined, the frequency variation range of the ultrasonic wave received by the ultrasonic wave receiving party can be determined according to the preset moving speed and the basic frequency of the ultrasonic wave sent by the ultrasonic wave sending party. Specifically, according to the doppler effect, the relationship between velocity and frequency:

where f is the frequency of the received ultrasonic wave, f₀Is the fundamental frequency of ultrasonic transmission, c is the propagation speed of sound in the air at 340m/s, and Δ v is the speed of the user relative to the ultrasonic sound source, i.e., the preset moving speed.

Thereby changing the frequency

Since the preset moving speed Δ v is a value that changes within a certain range, the corresponding change frequency Δ f also changes within a certain range, that is, the frequency change range. Since the frequency variation range is a range in which the frequency value varies and includes an upper boundary and a lower boundary, the frequency received by the ultrasonic wave receiving side varies in this range on the basis of the fundamental frequency, that is, varies between the upper boundary and the lower boundary. Therefore, the frequency change interval received by the ultrasonic receiving party can be determined according to the frequency change range and the basic frequency. And determining a displacement curve according to the frequency change interval and the corresponding intensity change curve to realize the screen on/off of the mobile terminal.

Referring to fig. 5, fig. 5 is a schematic device structure diagram of a hardware operating environment related to a method according to an embodiment of the present invention.

The ultrasonic-based on-screen and off-screen control device comprises an interactive mobile terminal, wherein the mobile terminal can be a mobile terminal device with a display function, such as a smart phone, a tablet computer, an electronic book reader, an MP3(Moving Picture Experts Group Audio Layer III, dynamic Picture Experts compression Standard Audio Layer 3) player, an MP4(Moving Picture Experts Group Audio Layer IV, dynamic Picture Experts compression Standard Audio Layer 3) player, a portable computer and the like.

As shown in fig. 5, the ultrasonic wave-based on-off screen control device may include: a processor 110, such as a CPU, a memory 109, and a communication bus 1002. Wherein the communication bus 1002 is used for implementing connection communication between the processor 110 and the memory 109. The memory 109 may be a high-speed RAM memory or a non-volatile memory (e.g., a disk memory). The memory 109 may alternatively be a storage device separate from the processor 110 described above.

Optionally, the ultrasonic-based on-off screen control device may further include a user interface, a network interface, a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. The user interface may comprise a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface may also comprise a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface).

It will be understood by those skilled in the art that the configuration of the ultrasonic-based on-off screen control device shown in fig. 5 does not constitute a limitation of the ultrasonic-based on-off screen control device, and may include more or less components than those shown, or some components in combination, or a different arrangement of components.

As shown in fig. 5, the memory 109, which is a readable storage medium, may include therein an operating system, a network communication module, and an ultrasonic wave-based on-off screen control program. The operating system is a program for managing and controlling hardware and software resources of the ultrasonic wave-based on-off screen control device, and supports the running of the ultrasonic wave-based on-off screen control program and other software and/or programs. The network communication module is used for realizing communication among components in the memory 109 and communication with other hardware and software in the ultrasonic wave-based on-off screen control device.

In the ultrasonic wave based on-off screen control apparatus shown in fig. 5, the ultrasonic wave based on-off screen control program is applicable to the mobile terminal as the transmitting end, and the processor 110 is configured to execute the ultrasonic wave based on-off screen control program stored in the memory 109, and implement the following steps:

Further, the step of controlling the screen on or off of the ultrasonic wave transmitter according to the displacement curve includes:

Further, the step of obtaining a plurality of consecutive data points on the displacement curve and averaging the respective data values of the plurality of consecutive data points comprises:

Further, the step of controlling the screen on or off of the ultrasonic wave transmitter according to the new displacement curve includes:

Further, the frequency change interval includes a first interval and a second interval, and the step of determining the displacement curve of the ultrasonic wave transmitting side according to the frequency change interval and the corresponding intensity change curve includes:

Further, the step of determining a displacement curve of the ultrasonic wave transmitting side according to the first area and the second area includes:

and forming a displacement curve by the displacement data group.

Further, before the step of acquiring the ultrasonic frequency variation interval received by the ultrasonic receiving side and the intensity variation curve corresponding to the frequency variation interval, the processor 110 is configured to execute the ultrasonic-based on-off screen control program stored in the memory 109, and implement the following steps:

Further, the step of determining the ultrasonic frequency change interval received by the ultrasonic receiver according to the preset moving speed of the ultrasonic transmitter includes:

The specific implementation of the ultrasonic-based on-off screen control device of the present invention is substantially the same as that of each embodiment of the ultrasonic-based on-off screen control method, and is not described herein again.

The present invention provides a readable storage medium storing one or more programs, the one or more programs further executable by one or more processors for:

and forming a displacement curve by the displacement data group.

Further, before the step of acquiring the frequency variation interval of the ultrasonic wave received by the ultrasonic wave receiving side and the intensity variation curve corresponding to the frequency variation interval, the one or more programs may be further executable by the one or more processors to:

The specific implementation of the readable storage medium of the present invention is substantially the same as that of the above-mentioned embodiments of the method for controlling the on/off screen based on ultrasonic waves, and is not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. An ultrasonic wave based on-screen and off-screen control method is characterized in that the ultrasonic wave sampling method comprises the following steps:

controlling the ultrasonic wave sender to turn on or turn off the screen according to the displacement curve;

wherein, the frequency change interval comprises a first interval and a second interval, and the step of determining the displacement curve of the ultrasonic wave sender according to the frequency change interval and the corresponding intensity change curve comprises the following steps:

and forming a displacement curve by the displacement data group, wherein the positive and negative of the plurality of difference values forming the displacement data group are the direction of displacement, determining that the mobile terminal approaches or leaves the user based on the positive and negative of the difference values, and realizing the on-off screen of the mobile terminal according to the approaching or leaving state.

2. The ultrasonic-based on-screen turn-off control method of claim 1, wherein the step of controlling the turn-on or turn-off of the screen of the ultrasonic transmitter according to the displacement curve comprises:

3. The ultrasonic-based on-off screen control method according to claim 2, wherein the step of obtaining a plurality of consecutive data points on the displacement curve and averaging the respective data values of the plurality of consecutive data points comprises:

4. The ultrasonic-based on-screen turn-off control method of claim 2, wherein the step of controlling the turn-on or turn-off of the screen of the ultrasonic transmitter according to the new displacement curve comprises:

5. The ultrasonic-based on-off screen control method according to any one of claims 1 to 4, wherein the step of acquiring the frequency variation interval of the ultrasonic wave received by the ultrasonic wave receiving party and the intensity variation curve corresponding to the frequency variation interval comprises the following steps:

6. The ultrasonic-based on-off screen control method according to claim 5, wherein the step of determining the ultrasonic frequency variation interval received by the ultrasonic receiver according to the preset moving speed of the ultrasonic transmitter comprises:

7. The utility model provides a bright screen controlling means that goes out based on ultrasonic wave which characterized in that, bright screen controlling means that goes out based on ultrasonic wave includes: the device comprises a memory, a processor, a communication bus and an ultrasonic wave-based on-off screen control program stored on the memory, wherein the ultrasonic wave-based on-off screen control program comprises the following steps:

the processor is used for executing the ultrasonic wave-based on-off screen control program to realize the steps of the ultrasonic wave-based on-off screen control method according to any one of claims 1-6.

8. A readable storage medium, wherein the readable storage medium stores thereon an ultrasonic wave-based on-off screen control program, and the ultrasonic wave-based on-off screen control program, when executed by a processor, implements the steps of the ultrasonic wave-based on-off screen control method according to any one of claims 1 to 6.