CN110505341A - Terminal control method, device, mobile terminal and storage medium - Google Patents

Terminal control method, device, mobile terminal and storage medium Download PDF

Info

Publication number
CN110505341A
CN110505341A CN201910702590.5A CN201910702590A CN110505341A CN 110505341 A CN110505341 A CN 110505341A CN 201910702590 A CN201910702590 A CN 201910702590A CN 110505341 A CN110505341 A CN 110505341A
Authority
CN
China
Prior art keywords
mobile terminal
eigenvalue
ultrasonic wave
ultrasonic
ultrasonic signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910702590.5A
Other languages
Chinese (zh)
Other versions
CN110505341B (en
Inventor
林进全
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910702590.5A priority Critical patent/CN110505341B/en
Publication of CN110505341A publication Critical patent/CN110505341A/en
Priority to PCT/CN2020/103305 priority patent/WO2021017947A1/en
Application granted granted Critical
Publication of CN110505341B publication Critical patent/CN110505341B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72463—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions to restrict the functionality of the device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/02—Power saving arrangements
    • H04W52/0209—Power saving arrangements in terminal devices
    • H04W52/0261—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level
    • H04W52/0267—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level by controlling user interface components
    • H04W52/027—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level by controlling user interface components by controlling a display operation or backlight unit
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Telephone Function (AREA)

Abstract

This application discloses a kind of terminal control method, device, mobile terminal and storage mediums, the terminal control method is applied to mobile terminal, this method comprises: when mobile terminal is on call, ultrasonic signal, and the ultrasonic signal returned after encountering object by ultrasonic wave receiving module received ultrasonic signal are sent by ultrasonic wave transmitting module；Obtain the first detection data of acceleration transducer detection and the second detection data of gyro sensor detection；Obtain the First Eigenvalue, first detection data corresponding Second Eigenvalue and second detection data corresponding third feature value of the ultrasonic signal in transmission process；The First Eigenvalue, Second Eigenvalue and third feature value are inputted to the preset model trained, exported as a result, preset model is used to obtain the moving condition of mobile terminal counterbody, and the state of the display screen according to output result control mobile terminal.This method can promote the accuracy of the state control to display screen.

Description

Terminal control method, device, mobile terminal and storage medium
Technical field
This application involves technical field of mobile terminals, eventually more particularly, to a kind of terminal control method, device, movement End and storage medium.
Background technique
Mobile terminal, such as mobile phone, tablet computer etc. have become most common consumer electronics in people's daily life One of product.Increasingly developed with mobile terminal technology, Quan Mianping, curved surface screen mobile phone have become main product, due to needing The headspace of mobile terminal is saved, many producers use ultrasonic wave proximity test scheme to replace tradition on mobile terminals Infrared proximity detection scheme.But because the factors such as the complexity of internal structure of mobile phone and ultrasonic wave self character, make It obtains and ultrasonic wave accuracy of testing result under certain special screnes is used not can guarantee, cause to control not the state of display screen Accurately.
Summary of the invention
In view of the above problems, present applicant proposes a kind of terminal control method, device, mobile terminal and storage medium, with Promote the accuracy of the state control to display screen.
In a first aspect, the embodiment of the present application provides a kind of terminal control method, it is applied to mobile terminal, it is described mobile whole End includes ultrasonic wave transmitting module, ultrasonic wave receiving module, acceleration transducer, gyro sensor and display screen, described Method includes: to send ultrasonic signal by the ultrasonic wave transmitting module, and lead to when the mobile terminal is on call Cross the ultrasonic signal that the ultrasonic wave receiving module received ultrasonic signal returns after encountering object；Obtain the acceleration First detection data of sensor detection and the second detection data of gyro sensor detection；Obtain the ultrasonic wave The First Eigenvalue, first detection data corresponding Second Eigenvalue and second detection of the signal in transmission process The corresponding third feature value of data；By the input of the First Eigenvalue, the Second Eigenvalue and the third feature value Trained preset model is exported as a result, the preset model is used to obtain the mobile shape of the mobile terminal counterbody State, and according to the state for exporting result and controlling the display screen of the mobile terminal.
Second aspect, the embodiment of the present application provide a kind of terminal control mechanism, are applied to mobile terminal, described mobile whole End includes ultrasonic wave transmitting module, ultrasonic wave receiving module, acceleration transducer, gyro sensor and display screen, described Device includes: transmitting-receiving control module, data acquisition module, feature acquisition module and screen control module, wherein the transmitting-receiving Control module is on call for working as the mobile terminal, sends ultrasonic signal by the ultrasonic wave transmitting module, And the ultrasonic signal returned after encountering object by the ultrasonic wave receiving module received ultrasonic signal；The data obtain Modulus block be used to obtain acceleration transducer detection the first detection data and gyro sensor detection the Two detection datas；The feature obtains the First Eigenvalue, the institute that module is used to obtain the ultrasonic signal in transmission process State the corresponding Second Eigenvalue of the first detection data and the corresponding third feature value of second detection data；The screen control Molding block is used to the First Eigenvalue, the Second Eigenvalue and the third feature value inputting the default mould trained Type is exported as a result, the preset model is used to obtain the moving condition of the mobile terminal counterbody, and according to described Output result controls the state of the display screen of the mobile terminal.
The third aspect, the embodiment of the present application provide a kind of mobile terminal, comprising: one or more processors；Memory； One or more application program, wherein one or more of application programs be stored in the memory and be configured as by One or more of processors execute, and one or more of programs are configured to carry out the terminal that above-mentioned first aspect provides Control method.
Fourth aspect, the embodiment of the present application provides a kind of computer-readable storage medium, described computer-readable Program code is stored in storage medium, said program code can be called the terminal for executing above-mentioned first aspect and providing by processor Control method.
Scheme provided by the present application passes through ultrasonic wave transmitting module and sends ultrasonic wave when mobile terminal is on call Signal, and acceleration is obtained in the ultrasonic signal for encountering object return by ultrasonic wave receiving module received ultrasonic signal First detection data of sensor detection and the second detection data of gyro sensor detection, obtain ultrasonic signal and are passing The corresponding third of the First Eigenvalue, the corresponding Second Eigenvalue of the first detection data and the second detection data during defeated is special Then the First Eigenvalue, Second Eigenvalue and third feature value are inputted the preset model trained by value indicative, obtain output knot Fruit, the preset model are used to obtain the moving condition of mobile terminal counterbody, finally control mobile terminal according to output result Display screen state.Therefore, realize the data detected according to ultrasonic wave characteristic value, acceleration transducer characteristic value and The characteristic value for the data that gyro sensor detects, and utilize the pre- of moving condition for obtaining mobile terminal counterbody If model, the moving condition of mobile terminal counterbody is obtained, the moving condition of mobile terminal counterbody can be accurately detected, mention Rise the accuracy to the state control of display screen in communication process.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the drawings in the following description are only some examples of the present application, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 shows the schematic diagram of the propagation path of ultrasonic wave provided by the embodiments of the present application.
Fig. 2 shows the terminal control method flow charts according to the application one embodiment.
Fig. 3 shows the terminal control method flow chart according to another embodiment of the application.
Fig. 4 shows the schematic diagram of model training process provided by the embodiments of the present application.
Fig. 5 shows audio data spectrogram provided by the embodiments of the present application.
Fig. 6 shows the terminal control method flow chart according to another embodiment of the application.
Fig. 7 shows a kind of block diagram of the terminal control mechanism according to the application one embodiment.
Fig. 8 is the embodiment of the present application for executing the mobile terminal of the terminal control method according to the embodiment of the present application Block diagram.
Fig. 9 is the embodiment of the present application for saving or carrying the terminal control method realized according to the embodiment of the present application Program code storage unit.
Specific embodiment
In order to make those skilled in the art more fully understand application scheme, below in conjunction in the embodiment of the present application Attached drawing, the technical scheme in the embodiment of the application is clearly and completely described.
Currently, increasingly developed with mobile terminal technology, Curved screen, the mobile terminal shielded comprehensively are more and more, in order to The headspace of mobile terminal is saved, it is traditional to substitute close to monitoring scheme that many producers use ultrasonic wave on mobile terminals Infrared proximity detection scheme.Currently, ultrasonic wave is close to monitoring scheme, mobile terminal by ultrasonic wave sending device (such as earpiece, Loudspeaker, special-purpose ultrasonic transmitter etc.) emit ultrasonic wave, a part of ultrasonic wave passes through the through ultrasonic wave receiving module of air borne (sound pick-up) (path 1 of such as Fig. 1), a part of ultrasonic wave reach ultrasonic wave after forming reflection by air borne and shelter again Receiving module (path 2 of such as Fig. 1).What ultrasonic wave receiving module picked up is the superposed signal of direct sound wave and reflected sound, is passed through A/D converter is converted into audio signal.The motion state that shelter relatively moves terminal is obtained by algorithm process audio data, And then the display screen of mobile terminal is instructed to be in bright screen state or put out screen state.
Inventor is by prolonged the study found that since the complexity of internal structure of mobile phone and ultrasonic wave itself are special The factors such as property, can make the display state that can not accurately control display screen.For example, mobile terminal checks display in communication process Shield the content of display, the display content on the manual operating display of user, can trigger ultrasonic wave proximity test scheme and examine at this time It is close to measure object relative movement terminal, so that controlling display screen puts out screen, influences user experience.
In view of the above-mentioned problems, inventors herein proposing terminal control method provided by the embodiments of the present application, device, mobile terminal And storage medium, by by the corresponding characteristic value of the detection data of the characteristic value of ultrasonic signal, acceleration transducer and The corresponding characteristic value of the detection data of gyro sensor is input to preset model, and according to output result control display screen Display state, to promote the accuracy of the state control to display screen.Wherein, specific terminal control method is in subsequent implementation It is described in detail in example.
Referring to Fig. 2, the flow diagram of the terminal control method provided Fig. 2 shows the application one embodiment.Institute Terminal control method is stated for by by the corresponding characteristic value of the detection data of the characteristic value of ultrasonic signal, acceleration transducer And the corresponding characteristic value of detection data of gyro sensor, it is input to preset model, and according to output result control display The display state of screen, to promote the accuracy of the state control to display screen.In the particular embodiment, the terminal control side Method is applied to terminal control mechanism 400 as shown in Figure 7 and the mobile terminal 100 configured with the terminal control mechanism 400 (Fig. 8).It will illustrate the detailed process of the present embodiment by taking mobile terminal as an example below, it will of course be understood that, the present embodiment institute The mobile terminal of application can be for smart phone, tablet computer, wearable electronic equipment etc., it is not limited here.Wherein, at this In embodiment, which may include ultrasonic wave transmitting module, ultrasonic wave receiving module, acceleration transducer, gyroscope Sensor and display screen will be explained in detail below for process shown in Fig. 2, and the terminal control method specifically may be used With the following steps are included:
Step S110: when the mobile terminal is on call, passes through the ultrasonic wave transmitting module and send ultrasonic wave Signal, and the ultrasonic signal returned after encountering object by the ultrasonic wave receiving module received ultrasonic signal.
In the embodiment of the present application, mobile terminal can detect talking state, to be in logical in mobile terminal When speech phase, ultrasonic signal is emitted by ultrasonic wave transmitting module and ultrasonic wave letter is received by ultrasonic wave receiving module Number, characteristic value of the subsequent then available ultrasonic signal in transmission process, to determine the movement of mobile terminal counterbody State.
In some embodiments, mobile terminal can by built-in monitoring module to the incoming call of the mobile terminal or It goes electricity to be monitored in real time, is in when jingle bell starts (CALL_STATE_RINGING) incoming call or dials when listening to mobile terminal When electricity is removed in operation, monitor whether the mobile terminal enters talking state.Wherein, it carries out dialing operation in mobile terminal When removing electricity, system broadcasts can be issued, Broadcast Receiver can be used to monitor in mobile terminal, in addition, monitoring movement Whether whether terminal is on call can be in the interface in call for monitoring mobile terminal after sending a telegram here or removing electricity, In, when listening to the mobile terminal (CALL_STATE_OFFHOOK) in call, it can determine that mobile terminal is in Talking state.
In the embodiment of the present application, mobile terminal can include ultrasonic wave sending module and ultrasonic wave receiving module simultaneously. During ultrasonic wave sending module relative object movement, its essence is mobile terminal relative object movements, thus ultrasonic wave Receiving module also relative object movement.According to Doppler effect, the wavelength of object radiation is because of wave source (mobile terminal) and observation The relative motion of person's (object) and generate variation, Doppler effect formulas is as follows:
Wherein, f ' is the frequency observed, f is the original transmitted frequency emitted in the medium, v is wave in the medium In spread speed, v0For observer's movement speed, if observer is close to emission source front oeprator be+number, otherwise For-number；vsFor emission source movement speed, if object proximity observer front oeprator be-number, otherwise for+number.By more It is found that when emission source and observer are relatively close to, the signal frequency that observer receives can become larger general Le effect formula；Work as hair It penetrates source and when observer is relatively distant from, the signal frequency that observer receives can become smaller；When emission source is opposing stationary with observer When, it is consistent with emission source that observer receives signal frequency.
In some embodiments, when listen to mobile terminal it is on call when, can be by built in mobile terminal Ultrasonic wave sending module send the ultrasonic signal of fixed frequency, it is to be understood that ultrasonic wave sending module is sent super For a part in acoustic signals by the through ultrasonic wave receiving module of air borne, another part passes through air borne and shelter Reach ultrasonic wave receiving module again after forming reflection, what ultrasonic wave receiving module picked up is the superposition letter of direct sound wave and reflected sound Number, audio signal is converted to by A/D, wherein the shelter may include face, human body etc..For example, can be by mobile whole The ultrasonic signal of the built-in earpiece in end, loudspeaker or special-purpose ultrasonic transmitter transmission fixed frequency, the one of ultrasonic signal Part reaches pickup after forming reflection by air borne and shelter by the through sound pick-up of air borne, another part again Device, sound pick-up are that is got is the superposed signal of direct sound wave and reflected sound, are converted to audio signal by A/D.
In the present embodiment, when mobile terminal is on call, ultrasound can be sent by ultrasonic wave sending module Wave signal, and the ultrasonic signal returned after encountering object by ultrasonic wave receiving module received ultrasonic signal, Huo Zhecong Ultrasonic signal is extracted in the ultrasonic signal (direct sound wave and reflected sound) that ultrasonic wave receiving module receives after encountering object The ultrasonic signal (reflected sound) of return, it is not limited here.
Step S120: the first detection data and gyro sensor inspection of the acceleration transducer detection are obtained The second detection data surveyed.
In the embodiment of the present application, mobile terminal can also include acceleration transducer and gyro sensor simultaneously. Wherein, acceleration transducer is a kind of sensor that can measure acceleration.Sensor is in accelerator, by mass block The measurement of suffered inertia force obtains acceleration value using Newton's second law.It can be passed using 3-axis acceleration in mobile terminal Sensor, by 3-axis acceleration sensor, can measure mobile phone terminal on three different directions (i.e. x-axis, y-axis, z-axis) plus Speed.It recycles and logic judgment is carried out to the numerical value of three axis, so that it may probably measure the positions such as movement, the movement of mobile phone terminal Variation.Gyro sensor is called angular-rate sensor, is to be different from accelerometer (G-sensor), its measurement physical quantity Rotational angular velocity when being deflection, inclination only can not measure or reconstruct complete 3D with accelerometer in the terminal Movement, does not detect the movement of rotation, and G-sensor can only detect axial line movement, but gyroscope then can to rotation, Good measurement is done in the movement of deflection, and the actual act of user can be thus judged with Accurate Analysis.
In the embodiment of the present application, mobile terminal can send ultrasonic signal by ultrasonic wave sending module and lead to During crossing ultrasonic wave receiving module received ultrasonic signal, controls acceleration transducer and gyro sensor holding is opened State is opened, and obtains the first detection data of acceleration transducer detection and the second testing number of gyro sensor detection According to.Wherein, the first detection data may include the acceleration of the x-axis of acceleration transducer detection, y-axis and z-axis, the second detection Data may include the rotational angular velocity of the x-axis of gyro sensor detection, y-axis and z-axis, it is not limited here.
Step S130: the First Eigenvalue of the ultrasonic signal in transmission process, first detection data are obtained Corresponding Second Eigenvalue and the corresponding third feature value of second detection data.
In the embodiment of the present application, the ultrasonic signal that the available ultrasonic wave sending module of mobile terminal is sent is transmitting The First Eigenvalue in the process, the corresponding Second Eigenvalue of the first detection data and the corresponding third of third detection data are special Value indicative.
In some embodiments, the First Eigenvalue of the ultrasonic signal in transmission process may include Doppler effect Difference in areas, Doppler effect area and and one or more of amplitude of ultrasonic change rate absolute value, do not limit herein It is fixed.
In some embodiments, acceleration transducer detects the corresponding Second Eigenvalue of the first detection data, Ke Yiyou The acceleration value of x-axis, y-axis and z-axis forms a feature vector and obtains in first detection data；Gyro sensor detection the The corresponding third feature value of two detection datas can be formed by the rotational angular velocity of x-axis, y-axis and z-axis in the second detection data One feature vector obtains, it is not limited here.
Step S140: the input of the First Eigenvalue, the Second Eigenvalue and the third feature value has been trained Preset model, exported as a result, the preset model is used to obtain the moving condition of the mobile terminal counterbody, and The state of the display screen of the mobile terminal is controlled according to the output result.
In the embodiment of the present application, the First Eigenvalue of the ultrasonic signal in transmission process, the first testing number are being obtained It, can be by the First Eigenvalue, the second spy after corresponding Second Eigenvalue and the corresponding third feature value of the second detection data Value indicative and third feature value are input to the preset model trained as input parameter, obtain the output knot that preset model exports Fruit.Wherein, output result may include the moving condition of mobile terminal counterbody.
In some embodiments, preset model can be trained to obtain previously according to a large amount of training samples.Training sample It originally may include input sample and output sample, input sample may include fisrt feature of the ultrasonic signal in transmission process The corresponding third of data of value, the corresponding Second Eigenvalue of data of acceleration transducer detection and gyro sensor detection Characteristic value, output sample can be worth corresponding mobile terminal counterpart for the First Eigenvalue, Second Eigenvalue and third feature The moving condition of body, from and the preset model trained can be used for according to the First Eigenvalue of acquisition, Second Eigenvalue and Third feature value, the moving condition of output mobile terminal counterbody.Wherein, preset model may include support vector machines (Support Vector Machine, SVM), neural network etc., it is not limited here.
In the embodiment of the present application, mobile terminal is after the moving condition for getting mobile terminal counterbody, then can be with Bright screen state is according to the moving condition of mobile terminal counterbody control display screen or puts out screen state, to promote display screen In the case where mobile terminal is on call state control accuracy rate and stability, be effectively reduced mobile terminal power consumption and Display screen is reduced to radiate caused by face when close to face in bright screen state.
Terminal control method provided by the embodiments of the present application is realized according to ultrasonic wave characteristic value, acceleration transducer inspection The characteristic value for the data that the characteristic value and gyro sensor of the data measured detect, and utilize for obtaining mobile terminal The preset model of the moving condition of counterbody obtains the moving condition of mobile terminal counterbody, can be according to ultrasonic wave characteristic Value, acceleration signature value and rotational angular velocity characteristic value determine the moving condition of mobile terminal counterbody jointly, thus quasi- The really moving condition of detection mobile terminal counterbody promotes the accuracy to the state control of display screen in communication process.
Referring to Fig. 3, Fig. 3 shows the flow diagram of the terminal control method of another embodiment of the application offer. This method is applied to above-mentioned mobile terminal, which includes ultrasonic wave transmitting module, ultrasonic wave receiving module, acceleration biography Sensor, gyro sensor and display screen will be explained in detail, the terminal control for process shown in Fig. 3 below Method processed can specifically include following steps:
Step S210: obtaining training dataset, and the training dataset includes being labeled with the mobile terminal counterpart The training data of the moving condition of body, the training data include the First Eigenvalue of the ultrasonic signal in transmission process, institute The data of the corresponding Second Eigenvalue of data and gyro sensor detection of stating acceleration transducer detection are corresponding Third feature value.
It in the embodiment of the present application, further include to this in the embodiment of the present application for the preset model in previous embodiment The training method of preset model, it is worth noting that, the training of preset model can be pre- according to the training dataset of acquisition First carry out, it is subsequent then to be obtained according to the preset model in the moving condition of detection mobile terminal counterbody every time, Preset model is trained when moving condition without detecting mobile terminal counterbody every time.
In some embodiments, training dataset may include the moving condition for being labeled with mobile terminal counterbody Training data, training data may include the First Eigenvalue, acceleration transducer of the ultrasonic signal in transmission process The corresponding Second Eigenvalue of data and the corresponding third feature value of data of gyro sensor detection.Wherein, fisrt feature The content of value, Second Eigenvalue and third feature value can in previous embodiment for obtaining mobile terminal counterbody The First Eigenvalue, Second Eigenvalue and the third feature of moving condition are worth identical.
When constructing training dataset, mobile terminal counterbody is separate under available a large number of users service condition, leans on When close and static moving condition, the First Eigenvalue, Second Eigenvalue and the third feature value being calculated, and by the of calculating One characteristic value, Second Eigenvalue and third feature value, are labeled as the movement that mobile terminal counterbody is separate, close or static State.
Furthermore it is also possible to be readily detected mobile terminal by ultrasonic wave proximity test method under some special screnes The close moving condition of counterbody can control display screen extinguishing at this time, but user is not intended to display screen extinguishing, for example, with Screen is watched at family when using mobile terminal call, and with the content shown in hand operation display, can detect at this time it is mobile eventually End counterbody is close and display screen is caused to extinguish.Therefore, pass through traditional detection method under available some special screnes Detect that mobile terminal counterbody is close, but the fisrt feature that the case where user demand display screen keeps bright screen when calculates Value, Second Eigenvalue and third feature value, and these the First Eigenvalues, Second Eigenvalue and third feature value are labeled as The separate or static state of mobile terminal counterbody, so that trained preset model can be by mobile terminal phase in the case of these The separate or static state of mobile terminal counterbody is identified as to the moving condition of object.Similarly, available some spies Detect that mobile terminal counterbody is separate by traditional detection method under different scene, but the holding of user demand display screen is put out The First Eigenvalue, Second Eigenvalue and the third feature value calculated when the case where screen, and by these the First Eigenvalues, second special Value indicative and third feature value are labeled as the close or static state of mobile terminal counterbody.It is thus possible to train Obtained model can be avoided the moving condition of the mobile terminal counterbody detected under special screne, to the control of display screen Cause inaccuracy.
In the embodiment of the present application, in training data set, the First Eigenvalue, Second Eigenvalue and third feature value are For the input sample for being trained, the close or static state of the mobile terminal counterbody being marked be for into The output sample of row training, every group of training data may include an input sample and an output sample.
Step S220: according to training dataset training initial model, the preset model trained.
In the embodiment of the present application, can according to training data set, by training data set be input to initial model into Row training, to obtain the preset model of the moving condition for obtaining mobile terminal counterbody.Wherein, initial model can be with For SVM, neural network etc., it is not limited here.
Below by taking neural network as an example, it is illustrated to according to training data set training initial model.
Fig. 4 shows the process being trained according to the neural network connected entirely.As shown in figure 4, in training data set The input sample of the First Eigenvalue, Second Eigenvalue and third feature value as neural network in one group of data, one group of number It can be used as the output sample of neural network, the nerve net connected entirely according to the moving condition of the mobile terminal counterbody of middle mark Network is divided into close, separate, static three branches by input layer, hidden layer with output layer, realizes to mobile terminal counterbody The static moving condition of close moving condition, mobile terminal counterbody separate moving condition and mobile terminal counterbody It is trained.
In neural network as shown in Figure 4, the neuron of neuron and hidden layer in input layer connects entirely, hidden layer Neuron and the neuron of output layer connect entirely, so as to effectively extract varigrained potential feature.And hidden layer Number can be to be multiple, so as to preferably fit non-linear relationship, so that the preset model that training obtains is more accurate.
It should be understood that the training process of preset model can be completed by mobile terminal, it can not also be by mobile terminal It completes.When training process is not completed by mobile terminal, then mobile terminal can be intended only as direct user, between being also possible to Meet user, i.e., mobile terminal the First Eigenvalue, Second Eigenvalue and third feature value can be sent to be stored with it is default The server of model obtains the moving condition of mobile terminal counterbody from server.
In some embodiments, the preset model that training obtains can store in mobile terminal local, which obtains Preset model preset model can also be stored in the mode of server in the server connecting with communication of mobile terminal, can To reduce the memory space for occupying mobile terminal, running of mobile terminal efficiency is promoted.
In some embodiments, preset model can it is periodic or it is irregular obtain new training data, it is right The preset model is trained and updates.
Step S230: when the mobile terminal is on call, passes through the ultrasonic wave transmitting module and send ultrasonic wave Signal, and the ultrasonic signal returned after encountering object by the ultrasonic wave receiving module received ultrasonic signal.
Step S240: the first detection data and gyro sensor inspection of the acceleration transducer detection are obtained The second detection data surveyed.
In the embodiment of the present application, step S230 and step S240 can be refering to the content of above-described embodiment, herein no longer It repeats.
Step S250: the First Eigenvalue of the ultrasonic signal in transmission process, first detection data are obtained Corresponding Second Eigenvalue and the corresponding third feature value of second detection data.
In the embodiment of the present application, the First Eigenvalue of the ultrasonic signal in transmission process may include Doppler effect Difference in areas, Doppler effect area and and one or more of amplitude of ultrasonic change rate absolute value, do not limit herein It is fixed.
In some embodiments, it when the First Eigenvalue includes Doppler effect difference in areas, obtains ultrasonic signal and is passing The First Eigenvalue during defeated may include:
The transmission frequency and the ultrasonic wave for obtaining the ultrasonic signal that the ultrasonic wave sending module is sent receive mould The frequency range of the received ultrasonic signal of block；First frequency variation zone is determined based on the transmission frequency and the frequency range Between and second frequency constant interval；According to the first frequency constant interval and the first frequency constant interval corresponding One intensity variation curve calculates and obtains the first area；According to the second frequency constant interval and the second frequency variation zone Between corresponding second intensity variation curve, calculate obtain second area；The difference of first area and the second area is calculated, Obtain the Doppler effect difference in areas of the ultrasonic signal in transmission process.
When mobile terminal is on call, the relative motion state of mobile terminal counterbody is substantially user During using mobile terminal, user picks up mobile terminal close to human body or far from the process of human body, it is contemplated that user takes The speed for playing mobile terminal changes in a certain range, thus the frequency for the ultrasonic signal for receiving ultrasonic wave receiving module Variation also it is corresponding in a certain range, i.e. the frequency range of ultrasonic signal.
In some embodiments, the ultrasonic wave letter that the available ultrasonic wave sending module built in it of mobile terminal is sent Number transmission frequency, and obtain the frequency range of the received ultrasonic signal of ultrasonic wave receiving module built in it.Wherein, should The transmission frequency for the ultrasonic signal that ultrasonic wave sending module is sent can be fixed frequency, and therefore, mobile terminal can be based on The transmission parameter of the ultrasonic signal of the ultrasonic wave sending module set obtains the transmission frequency.In addition, the ultrasonic wave receives The frequency range and mobile terminal of the received ultrasonic signal of module are related to the relative motion relation of object, therefore, can obtain Take most users during using mobile terminal, the variation range of movement velocity, and according to the change of its movement velocity Change the frequency range that range determines the received ultrasonic signal of ultrasonic wave receiving module.
Specifically, based on Doppler effect formulas it is found that f ' is the super of the object reflection that ultrasonic wave receiving module receives The frequency of acoustic signals.F is the transmission frequency for the ultrasonic signal that ultrasonic wave sending module is sent.V is that sound is aerial Spread speed takes 340m/s.Assuming that mobile terminal is static, then vs=0.If the movement velocity of object relative termination is v01, then the movement speed of object is v in Doppler effect formulas0=2v01.Assuming that the ultrasonic wave letter that ultrasonic wave sending module is sent Number transmission frequency be ultrasonic=22500Hz, the frequency range of the received ultrasonic signal of ultrasonic wave receiving module is [22420Hz, 22580Hz], the then object and mobile terminal relative velocity that can be recognized according to Doppler effect are as follows:
If the data length for carrying out Fourier transformation (fast Fourier Transform, DFT) transformation is fftlen= 8192, audio data samples rate is fs=48kHz, then the frequency resolution of DFT result are as follows:
Then by formulaAnd formulaThe object and mobile terminal minimum relative velocity that can then recognize are as follows:
Therefore, in the present embodiment, the relative velocity of mobile terminal and object can be obtained based on historical data etc. With minimum relative velocity, and the ultrasound is obtained by relative velocity, minimum relative velocity and above-mentioned formula reverse-direction derivation The frequency range of the received ultrasonic signal of wave receiving module.
In some embodiments, it is obtaining the transmission frequency of the ultrasonic signal of ultrasonic wave sending module transmission and is surpassing After the frequency range for the ultrasonic signal that acoustic receiver module receives, frequency can be determined based on the transmission frequency and frequency range Rate constant interval.For example, frequency spectrum is frequency as shown in figure 5, Fig. 5 shows audio data spectrogram provided by the embodiments of the present application The abbreviation of rate spectrum, is the distribution curve of frequency, for discrete audio data sampling point, can be obtained by discrete Fourier transform , in Fig. 5, pass through the spectrogram that discrete Fourier transform obtains for a segment of audio data, each point of abscissa is respectively Frequency values in a corresponding reality, ordinate represent the signal strength of the frequency.
In some embodiments, characteristic extracting module is DFT using the data module of length fftlen=8192 every time Transformation, obtain corresponding amplitude-frequency vector X as shown in figure 5,
Actual frequency fnRelationship between the nth data of amplitude-frequency vector X is as follows:
Wherein, fsFor sample rate, fftlen is data length.Then X [n] represents actual frequency fnIntensity.
Assuming that the critical frequencies considered in algorithm have ultrasonic=22500Hz, f_min_low=22494Hz, f_ Min_up=22506Hz, f_low=22420Hz, f_up=22580Hz, the then critical frequencies considered are as follows: n1, n2, n3, n4 and N5, n1 point_low, n2 point_mid_low, n3 point_mid, n4 point_mid_up, n5 point_ Up, wherein
As shown in figure 5, the transmission frequency for the ultrasonic signal that the ultrasonic wave sending module is sent is point_mid, send The corresponding signal strength of frequency is ultrasonic_amp, the frequency model for the ultrasonic signal which receives It encloses for point_low to point_up, hence, it can be determined that the frequency constant interval is point_low to point_mid_low And point_min-up to point_up.
In some embodiments, first frequency constant interval and second can be determined based on transmission frequency and frequency range Frequency constant interval.For example, as shown in figure 5, the first frequency constant interval be point_low to point_mid_low, second Frequency constant interval is point_min-up to point_up.
In some embodiments, after obtaining frequency constant interval, which can be obtained based on spectrogram Between corresponding intensity variation curve, and be based on the frequency constant interval and the corresponding intensity variation curve of frequency constant interval, meter Calculate Doppler effect difference in areas of the ultrasonic signal in transmission process.
Specifically, after obtaining first frequency constant interval, which can be obtained based on spectrogram Corresponding first intensity variation curve, and it is based on the first frequency constant interval and corresponding the last the first of first frequency constant interval Change curve is spent, first area of the ultrasonic signal in transmission process is calculated, meanwhile, obtaining second frequency constant interval Afterwards, corresponding second intensity variation curve of the second frequency constant interval can be obtained based on spectrogram, and based on second frequency Rate constant interval and corresponding second intensity variation curve of second frequency constant interval, calculate the ultrasonic signal in transmission process In second area.Further, the difference for calculating the first area and second area, for example, subtracting the second face by the first area Product subtracts the first area by second area, then Doppler effect of the available ultrasonic signal in transmission process Difference in areas.
In some embodiments, the First Eigenvalue include Doppler effect area and when, obtain ultrasonic signal passing The First Eigenvalue during defeated may include:
The transmission frequency and the ultrasonic wave for obtaining the ultrasonic signal that the ultrasonic wave sending module is sent receive mould The frequency range of the received ultrasonic signal of block；First frequency variation zone is determined based on the transmission frequency and the frequency range Between and second frequency constant interval；According to the first frequency constant interval and the first frequency constant interval corresponding One intensity variation curve calculates and obtains the first area；According to the second frequency constant interval and the second frequency variation zone Between corresponding second intensity variation curve, calculate obtain second area；The sum of first area and described second area are calculated, Obtain the Doppler effect area of the ultrasonic signal in transmission process and.
Wherein, obtain Doppler effect area and process can with obtain Doppler effect difference in areas process substantially phase Together, after obtaining the first area and second area, then the sum of the first area and second area can be calculated, obtains Doppler's effect Answer area and.When the First Eigenvalue include simultaneously Doppler effect difference in areas and Doppler effect area and when, then can be The sum of above-mentioned first area and second area is calculated, calculate Doppler effect difference in areas and calculates Doppler effect area With.
In some embodiments, when the First Eigenvalue includes amplitude of ultrasonic change rate absolute value, ultrasonic wave letter is obtained The First Eigenvalue number in transmission process may include:
Obtain corresponding first ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module and upper a period of time Corresponding second ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module carved；Obtain first ultrasonic wave The absolute value of amplitude and the difference of second ultrasonic amplitude, obtains ultrasonic wave of the ultrasonic signal in transmission process Amplitude change rate absolute value.
Wherein, when the First Eigenvalue includes amplitude of ultrasonic change rate absolute value, mobile terminal can acquire current time Corresponding first ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module, and the ultrasonic wave for obtaining last moment receives Second ultrasonic amplitude of the received ultrasonic signal of module.Wherein, the specific interval of current time and last moment are not made To limit, for example, can be 0.5S, 0.75S etc..In some embodiments, mobile terminal is connect by ultrasonic wave receiving module When receiving ultrasonic signal, the amplitude of the ultrasonic signal of each reception can be recorded.
Mobile terminal can then calculate first after getting above-mentioned first ultrasonic amplitude and the second ultrasonic amplitude The difference of ultrasonic amplitude and the second ultrasonic amplitude, and the absolute value of the difference is taken, it is being transmitted to obtain ultrasonic signal Amplitude of ultrasonic change rate absolute value in the process.
In some embodiments, the corresponding Second Eigenvalue of first detection data and second detection are obtained The corresponding third feature value of data, comprising: feature vector is generated according to first detection data, obtains first testing number According to corresponding Second Eigenvalue；Feature vector is generated according to second detection data, it is corresponding to obtain second detection data Third feature value.
Wherein, it is special can to generate first according to the acceleration value of x-axis, y-axis and z-axis in the first detection data for mobile terminal Vector is levied, and using first eigenvector as the corresponding Second Eigenvalue of the first detection data；Mobile terminal can be according to by The rotational angular velocity of x-axis, y-axis and z-axis generates second feature vector in two detection datas, and using second feature vector as the The corresponding third feature value of two detection datas.It is specific to obtain the corresponding second feature vector of the first detection data and acquisition second The mode of the corresponding third feature vector of detection data can be not as restriction.
Step S260: the input of the First Eigenvalue, the Second Eigenvalue and the third feature value has been trained Preset model, exported as a result, the preset model is used to obtain the moving condition of the mobile terminal counterbody, and The state of the display screen of the mobile terminal is controlled according to the output result.
In some embodiments, the preset model trained is stored in mobile terminal local, and mobile terminal can be direct The input of the First Eigenvalue, Second Eigenvalue and third feature value is stored in the local preset model trained, it is mobile whole End can also send a command to the preset model, this, which is instructed, is used to indicate preset model and goes to read the First Eigenvalue obtained, the Two characteristic values and third feature value, and result is exported according to the First Eigenvalue, Second Eigenvalue and third feature value.
In other embodiments, when which is stored in server, mobile terminal can basis First eigenvector, second feature vector and third feature vector generate request perhaps instruction and by the instruction of generation or Request is sent to server, to indicate that server inputs first eigenvector, second feature vector and third feature vector Preset model obtains output result.In such a way that preset model is stored in server, preset model can be effectively reduced and accounted for With the memory space of mobile terminal, also avoid occupying mobile terminal.
To which mobile terminal can obtain pre- according to first eigenvector, second feature vector and third feature vector If the output of model is as a result, output result includes the moving condition of mobile terminal counterbody, and mobile terminal can basis The moving condition of its counterbody, control display screen is in bright screen state or puts out screen state, to improve mobile terminal in difference Recognition success rate under scene improves the precise control rate and stability of the bright screen of display screen.
Terminal control method provided by the embodiments of the present application provides the method for trained preset model, by being labeled with The training data of the moving condition of mobile terminal counterbody, is trained initial model, to obtain preset model.It is default The characteristic value and gyro sensor for the data that model can be used for being detected according to ultrasonic wave characteristic value, acceleration transducer The characteristic value of the data detected, the moving condition of output mobile terminal counterbody, so that mobile terminal can be according to ultrasonic wave Characteristic value, acceleration signature value and rotational angular velocity characteristic value determine the moving condition of mobile terminal counterbody jointly, and The moving condition of accurate detection mobile terminal counterbody promotes the accuracy to the state control of display screen in communication process.
Referring to Fig. 6, Fig. 6 shows the flow diagram of the terminal control method of another embodiment of the application offer. This method is applied to above-mentioned mobile terminal, which includes ultrasonic wave transmitting module, ultrasonic wave receiving module, acceleration biography Sensor, gyro sensor and display screen will be explained in detail, the terminal control for process shown in fig. 6 below Method processed can specifically include following steps:
Step S310: when the mobile terminal is on call, passes through the ultrasonic wave transmitting module and send ultrasonic wave Signal, and the ultrasonic signal returned after encountering object by the ultrasonic wave receiving module received ultrasonic signal.
Step S320: the first detection data and gyro sensor inspection of the acceleration transducer detection are obtained The second detection data surveyed.
Step S330: the First Eigenvalue of the ultrasonic signal in transmission process, first detection data are obtained Corresponding Second Eigenvalue and the corresponding third feature value of second detection data.
In the embodiment of the present application, step S310 to step S330 can be refering to the content of above-described embodiment, herein no longer It repeats.
Step S340: the input of the First Eigenvalue, the Second Eigenvalue and the third feature value has been trained Preset model, exported as a result, the preset model is used to obtain the moving condition of the mobile terminal counterbody, and The state of the display screen of the mobile terminal is controlled according to the output result.
In the embodiment of the present application, the mobile shape of mobile terminal counterbody is controlled according to the output result of preset model State may include:
When the output result characterizes the mobile terminal and object is relatively close, controls the display screen and be in and put out screen State；When the output result characterizes the mobile terminal and object is relatively distant from, controls the display screen and be in bright screen shape State；When the output result characterization mobile terminal counterbody is static, the display that the display screen keeps current is controlled State.
It should be understood that characterizing mobile terminal and object when output result characterizes the mobile terminal and relatively close object The relative motion relation of body is that may be implemented when mobile terminal is on call, mobile terminal is close to the users close to movement Ear, it can control mobile terminal display screen be in puts out screen state.When output result characterizes the mobile terminal and object When being relatively distant from, the relative motion relation for characterizing mobile terminal and object is the movement being located remotely from each other, that is to say, that be may be implemented When mobile terminal is on call, ear of the mobile terminal far from user, it can control the display screen of mobile terminal In bright screen state.Mobile terminal and object are opposing stationary can be for mobile terminal and object is remain stationary or the movement Terminal is identical as the motion state of object, for example, mobile terminal is identical as the movement velocity of object, the direction of motion is identical, movement Amplitude is identical, motion frequency is mutually same, it is not limited here.When to characterize the mobile terminal opposing stationary with object for judging result When, the relative motion relation for characterizing the mobile terminal and object is constant, can control display screen and keeps current display state not Become, that is to say, that during mobile terminal is on call, when display screen current display state be bright screen state when, It then keeps display screen to be in bright screen state constant, when display screen is when current display state is to put out screen state, then keeps display screen In putting out, screen state is constant.
Step S350: if detect the operation of the control to the state of the display screen in preset duration, according to institute The control operation control display screen is stated to be in bright screen state or put out screen state.
In the embodiment of the present application, mobile terminal may be used also after the display state according to output result control display screen To be detected to user to the control operation of the state of display screen, if detecting the state to display screen in preset duration Control operation, then can control display screen and be in display state corresponding with control operation.Wherein, preset duration can be with For user after mobile terminal controls the state of display screen according to output result the duration that can react, for example, preset duration can be with It is 1 second~5 seconds, specific preset duration is not construed as limiting；Control operation can be the operation of the bright screen of triggering, such as click screen, point Home key is hit, power key etc. is clicked, control operation may be to put out to shield operation, for example, clicking power key etc., specific control is operated It is not construed as limiting.
It should be understood that user can be quick if mobile terminal is wrong according to the state of output result control display screen The state of display screen is controlled, to meet the display state of user demand.Therefore, if grasped in preset duration content detection to control Make, then bright screen state is according to the state that control operates control display screen or puts out screen state.For example, mobile terminal is according to defeated Display screen is to put out screen state, and it is wrong for controlling at this time, therefore user can manual point by the control of bright screen state by result out Bright display screen.
Step S360: by the corresponding the First Eigenvalue of the output result, Second Eigenvalue and third feature value It is labeled as the target moving condition of the mobile terminal counterbody, the target moving condition is corresponding with the control operation The state of display screen is corresponding.
It in the embodiment of the present application, can be with if detecting that user operates the control of display screen after preset duration Indicate that mobile terminal is wrong according to the state of output result control display screen, i.e. the output result of preset model is wrong.Therefore, may be used It is opposite the First Eigenvalue corresponding to above-mentioned output result, Second Eigenvalue and third feature value are labeled as mobile terminal The target moving condition of object, the First Eigenvalue, Second Eigenvalue and third feature value, that is, preset model obtain the output As a result the data inputted, target moving condition can be corresponding with the state that control operates corresponding display screen, for example, control behaviour The state for making corresponding display screen is bright screen state, then the shape that target moving condition can be separate for mobile terminal counterbody State.To, it is subsequent can according to the First Eigenvalue of the moving condition for being labeled with mobile terminal counterbody, Second Eigenvalue with And third feature value, preset model is trained, enable preset model learn to the First Eigenvalue, Second Eigenvalue and The moving condition of mobile terminal counterbody corresponding to third feature value is target moving condition.
In some embodiments, by the corresponding the First Eigenvalue of the output result, Second Eigenvalue and Third feature value is labeled as before the target moving condition of the mobile terminal counterbody, can also generate suggestion content, with Prompt the user whether the correction for needing to carry out preset model；If received for confirming corrected instruction, just inciting somebody to action The corresponding the First Eigenvalue of output result, Second Eigenvalue and third feature value are labeled as the target of mobile terminal counterbody Moving condition.
Step S370: the First Eigenvalue, Second Eigenvalue and the third of the target moving condition will be labeled with Characteristic value inputs the preset model, carries out calibration training to the preset model.
In the embodiment of the present application, the corresponding the First Eigenvalue of result, Second Eigenvalue and third feature will exported Value is labeled as after the target moving condition of mobile terminal counterbody, then can will be labeled with the institute of the target moving condition It states the First Eigenvalue, Second Eigenvalue and third feature value and inputs the preset model, i.e., by the First Eigenvalue, second Characteristic value and third feature value instruct preset model using target moving condition as output sample as input sample Practice, reaches the correction purpose to preset model, keep the accuracy of the output result of preset model higher.
Terminal control method provided by the embodiments of the present application, acquisition for mobile terminal ultrasonic wave characteristic value, acceleration transducer The characteristic value for the data that the characteristic value and gyro sensor of the data detected detect, and moved using preset model output The moving condition of dynamic terminal counterbody, so that mobile terminal can be according to ultrasonic wave characteristic value, acceleration signature value and rotation Angular speed characteristic value determines the moving condition of mobile terminal counterbody jointly, and accurately detects the shifting of mobile terminal counterbody Dynamic state promotes the accuracy to the state control of display screen in communication process.In addition, the control also according to user to display screen Operation, is corrected preset model, improves the accuracy of the output result of preset model.
Referring to Fig. 7, it illustrates a kind of structural block diagrams of terminal control mechanism 400 provided by the embodiments of the present application.It should Terminal control mechanism 400 applies above-mentioned mobile terminal, and mobile terminal includes transmitting-receiving control module, data acquisition module, feature Obtain module and screen control module.The terminal control mechanism 400 includes: transmitting-receiving control module 410, data acquisition module 420, feature obtains module 430 and screen control module 440.Wherein, the transmitting-receiving control module 410 is used to work as the movement Terminal is on call, sends ultrasonic signal by the ultrasonic wave transmitting module, and receive mould by the ultrasonic wave The ultrasonic signal that block received ultrasonic signal returns after encountering object；The data acquisition module 420 is described for obtaining First detection data of acceleration transducer detection and the second detection data of gyro sensor detection；The feature Obtain the First Eigenvalue, first detection data pair that module 430 is used to obtain the ultrasonic signal in transmission process The Second Eigenvalue and the corresponding third feature value of second detection data answered；The screen control module 440 is used for will The First Eigenvalue, the Second Eigenvalue and the third feature value input the preset model trained, and are exported As a result, the preset model is used to obtain the moving condition of the mobile terminal counterbody, and according to the output result control Make the state of the display screen of the mobile terminal.
In some embodiments, which can also include: data set acquisition module and model instruction Practice module.Data set acquisition module includes being labeled with the movement eventually for obtaining training dataset, the training dataset The training data of the moving condition of counterbody is held, the training data includes first spy of the ultrasonic signal in transmission process The data of value indicative, the corresponding Second Eigenvalue of data of acceleration transducer detection and gyro sensor detection Corresponding third feature value；Model training module is used to trained according to training dataset training initial model Preset model.
In some embodiments, the First Eigenvalue includes Doppler effect difference in areas.Feature obtains module 430 can To be specifically used for: the transmission frequency and the ultrasonic wave for obtaining the ultrasonic signal that the ultrasonic wave sending module is sent connect Receive the frequency range of the received ultrasonic signal of module；Determine that first frequency becomes based on the transmission frequency and the frequency range Change section and second frequency constant interval；It is corresponding according to the first frequency constant interval and the first frequency constant interval The first intensity variation curve, calculate obtain the first area；Become according to the second frequency constant interval and the second frequency Change corresponding second intensity variation curve in section, calculates and obtain second area；Calculate first area and the second area Difference, obtain the Doppler effect difference in areas of the ultrasonic signal in transmission process.
In some embodiments, the First Eigenvalue include Doppler effect area and.Feature obtains module 430 can To be specifically used for: the transmission frequency and the ultrasonic wave for obtaining the ultrasonic signal that the ultrasonic wave sending module is sent connect Receive the frequency range of the received ultrasonic signal of module；Determine that first frequency becomes based on the transmission frequency and the frequency range Change section and second frequency constant interval；It is corresponding according to the first frequency constant interval and the first frequency constant interval The first intensity variation curve, calculate obtain the first area；Become according to the second frequency constant interval and the second frequency Change corresponding second intensity variation curve in section, calculates and obtain second area；Calculate first area and the second area The sum of, obtain the Doppler effect area of the ultrasonic signal in transmission process and.
In some embodiments, the First Eigenvalue includes amplitude of ultrasonic change rate absolute value.Feature obtains mould Block 430 can be specifically used for: corresponding first ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module is obtained, And corresponding second ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module of last moment；Described in acquisition The absolute value of the difference of first ultrasonic amplitude and second ultrasonic amplitude, obtains the ultrasonic signal in transmission process In amplitude of ultrasonic change rate absolute value.
In some embodiments, feature obtains module 430 and can also be specifically used for according to first detection data life At first eigenvector, using the first eigenvector as the corresponding Second Eigenvalue of first detection data；According to institute It states the second detection data and generates second feature vector, using the second feature vector as second detection data corresponding the Three characteristic values.
In some embodiments, screen control module 440 can be specifically used for: when the output result characterizes the shifting When dynamic terminal and relatively close object, controls the display screen and be in and put out screen state；When the output result characterizes the movement When terminal and object are relatively distant from, control the display screen and be in bright screen state；When output result characterization is described mobile whole When holding counterbody static, the display state that the display screen keeps current is controlled.
In some embodiments, screen control module 440 can be also used for according to output result control After the state of the display screen of mobile terminal, if detecting that the control to the state of the display screen operates in preset duration When, bright screen state is according to the control operation control display screen or puts out screen state.
Further, which can also include state labeling module and model correction module.State Labeling module is for the corresponding the First Eigenvalue of the output result, Second Eigenvalue and third feature value to be labeled as The target moving condition of the mobile terminal counterbody, target moving condition display screen corresponding with the control operation State it is corresponding；Model correction module is used to be labeled with the First Eigenvalue, the second feature of the target moving condition Value and third feature value input the preset model, carry out calibration training to the preset model.
It is apparent to those skilled in the art that for convenience and simplicity of description, foregoing description device and The specific work process of module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, the mutual coupling of module can be electrical property, mechanical or other The coupling of form.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould Block both can take the form of hardware realization, can also be realized in the form of software function module.
In conclusion scheme provided by the present application, when mobile terminal is on call, sent out by ultrasonic wave transmitting module Ultrasonic signal is sent, and is obtained by ultrasonic wave receiving module received ultrasonic signal in the ultrasonic signal for encountering object return Second detection data of the first detection data and the gyro sensor detection for taking acceleration transducer to detect, obtains ultrasonic wave The First Eigenvalue, first detection data corresponding Second Eigenvalue and second detection data of the signal in transmission process are corresponding Third feature value, the First Eigenvalue, Second Eigenvalue and third feature value are then inputted into the preset model trained, obtained To output as a result, the preset model is used to obtain the moving condition of mobile terminal counterbody, finally according to output result control The state of the display screen of mobile terminal.Therefore, the spy of the data detected according to ultrasonic wave characteristic value, acceleration transducer is realized The characteristic value for the data that value indicative and gyro sensor detect, and utilize the movement for obtaining mobile terminal counterbody The preset model of state obtains the moving condition of mobile terminal counterbody, can accurately detect the shifting of mobile terminal counterbody Dynamic state promotes the accuracy to the state control of display screen in communication process.
Referring to FIG. 8, it illustrates a kind of structural block diagrams of mobile terminal provided by the embodiments of the present application.The mobile terminal 100, which can be smart phone, tablet computer, e-book etc., can run the mobile terminal of application program.Movement in the application Terminal 100 may include one or more such as lower component: processor 110, memory 120, display screen 130, ultrasonic wave send mould Block 140, ultrasonic wave receiving module 150, acceleration transducer 160, gyro sensor 170 and one or more application journey Sequence, wherein one or more application programs can be stored in memory 120 and be configured as by one or more processors 110 execute, and one or more programs are configured to carry out the method as described in preceding method embodiment.
Processor 110 may include one or more processing core.Processor 110 is whole using various interfaces and connection Various pieces in a mobile terminal 100, by run or execute the instruction being stored in memory 120, program, code set or Instruction set, and the data being stored in memory 120 are called, execute the various functions and processing data of mobile terminal 100.It can Selection of land, processor 110 can use Digital Signal Processing (Digital Signal Processing, DSP), field-programmable Gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA) at least one of example, in hardware realize.Processor 110 can integrating central processor (Central Processing Unit, CPU), in image processor (Graphics Processing Unit, GPU) and modem etc. One or more of combinations.Wherein, the main processing operation system of CPU, user interface and application program etc.；GPU is for being responsible for Show the rendering and drafting of content；Modem is for handling wireless communication.It is understood that above-mentioned modem It can not be integrated into processor 110, be realized separately through one piece of communication chip.
Memory 120 may include random access memory (Random Access Memory, RAM), also may include read-only Memory (Read-Only Memory).Memory 120 can be used for store instruction, program, code, code set or instruction set.It deposits Reservoir 120 may include storing program area and storage data area, wherein the finger that storing program area can store for realizing operating system Enable, for realizing at least one function instruction (such as touch function, sound-playing function, image player function etc.), be used for Realize the instruction etc. of following each embodiments of the method.Storage data area can also store the number that terminal 100 is created in use According to (such as phone directory, audio, video data, chat record data) etc..
Display screen 130 is used for the information and the mobile terminal 100 for showing information input by user, being supplied to user Various graphical user interface, these graphical user interface can be by figure, text, icon, number, video and any combination thereof It constitutes, in an example, which can be liquid crystal display (Liquid Crystal Display, LCD), May be Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED), it is not limited here.
Ultrasonic wave transmitting module 140 for emitting ultrasonic wave, ultrasonic transmitting device module 140 can be earpiece, loudspeaker, Special-purpose ultrasonic transmitter etc., it is not limited here.Ultrasonic wave receiving module 150 is set for receiving ultrasonic wave, ultrasonic wave reception Standby module 150 can be sound pick-up etc., it is not limited here.Acceleration transducer 160 is a kind of biography that can measure acceleration Sensor, gyro sensor 170 are called angular-rate sensor, are to be different from accelerometer (G-sensor), its measurement object Rotational angular velocity when reason amount is deflection, inclination.
Referring to FIG. 9, it illustrates a kind of structural block diagrams of computer readable storage medium provided by the embodiments of the present application. Program code is stored in the computer-readable medium 800, said program code can be called by processor and execute above method reality Apply method described in example.
Computer readable storage medium 800 can be such as flash memory, EEPROM (electrically erasable programmable read-only memory), The electronic memory of EPROM, hard disk or ROM etc.Optionally, computer readable storage medium 800 includes non-volatile meter Calculation machine readable medium (non-transitory computer-readable storage medium).Computer-readable storage Medium 800 has the memory space for the program code 810 for executing any method and step in the above method.These program codes can With from reading or be written in one or more computer program product in this one or more computer program product. Program code 810 can for example be compressed in a suitable form.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations；Although The application is described in detail with reference to the foregoing embodiments, those skilled in the art are when understanding: it still can be with It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；And These are modified or replaceed, do not drive corresponding technical solution essence be detached from each embodiment technical solution of the application spirit and Range.

Claims (12)

1. a kind of terminal control method, which is characterized in that be applied to mobile terminal, the mobile terminal includes ultrasonic wave transmitting mould Block, ultrasonic wave receiving module, acceleration transducer, gyro sensor and display screen, which comprises
When the mobile terminal is on call, ultrasonic signal is sent by the ultrasonic wave transmitting module, and pass through institute State the ultrasonic signal that ultrasonic wave receiving module received ultrasonic signal returns after encountering object；
Obtain the first detection data of the acceleration transducer detection and the second detection of gyro sensor detection Data；
Obtain the First Eigenvalue of the ultrasonic signal in transmission process, the corresponding second feature of first detection data Value and the corresponding third feature value of second detection data；
The First Eigenvalue, the Second Eigenvalue and the third feature value are inputted to the preset model trained, obtained To output as a result, the preset model is used to obtain the moving condition of the mobile terminal counterbody, and according to the output As a result the state of the display screen of the mobile terminal is controlled.
2. the method according to claim 1, wherein sending ultrasound by the ultrasonic wave transmitting module described Wave signal, and the ultrasonic signal returned after encountering object by the ultrasonic wave receiving module received ultrasonic signal it Before, the method also includes:
Training dataset is obtained, the training dataset includes the moving condition for being labeled with the mobile terminal counterbody Training data, the training data include the First Eigenvalue, the acceleration transducer of the ultrasonic signal in transmission process The corresponding Second Eigenvalue of the data of detection and the corresponding third feature value of data of gyro sensor detection；
According to training dataset training initial model, the preset model trained.
3. the method according to claim 1, wherein the First Eigenvalue includes Doppler effect difference in areas, The First Eigenvalue that the ultrasonic signal is obtained in transmission process, comprising:
The transmission frequency and the ultrasonic wave receiving module for obtaining the ultrasonic signal that the ultrasonic wave sending module is sent connect The frequency range of the ultrasonic signal of receipts；
First frequency constant interval and second frequency constant interval are determined based on the transmission frequency and the frequency range；
According to the first frequency constant interval and corresponding first intensity variation curve of the first frequency constant interval, calculate Obtain the first area；
According to the second frequency constant interval and corresponding second intensity variation curve of the second frequency constant interval, calculate Obtain second area；
It is described more in transmission process to obtain the ultrasonic signal for the difference for calculating first area and the second area General Le effect difference in areas.
4. the method according to claim 1, wherein the First Eigenvalue include Doppler effect area and, The First Eigenvalue that the ultrasonic signal is obtained in transmission process, comprising:
The transmission frequency and the ultrasonic wave receiving module for obtaining the ultrasonic signal that the ultrasonic wave sending module is sent connect The frequency range of the ultrasonic signal of receipts；
First frequency constant interval and second frequency constant interval are determined based on the transmission frequency and the frequency range；
According to the first frequency constant interval and corresponding first intensity variation curve of the first frequency constant interval, calculate Obtain the first area；
According to the second frequency constant interval and corresponding second intensity variation curve of the second frequency constant interval, calculate Obtain second area；
The sum of first area and described second area are calculated, it is described more in transmission process to obtain the ultrasonic signal General Le effect area and.
5. the method according to claim 1, wherein the First Eigenvalue includes that amplitude of ultrasonic change rate is exhausted To value, the First Eigenvalue for obtaining the ultrasonic signal in transmission process, comprising:
Obtain corresponding first ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module and last moment Corresponding second ultrasonic amplitude of the received ultrasonic signal of ultrasonic wave receiving module；
The absolute value for obtaining the difference of first ultrasonic amplitude and second ultrasonic amplitude obtains the ultrasonic wave letter Amplitude of ultrasonic change rate absolute value number in transmission process.
6. the method according to claim 1, wherein obtaining the corresponding Second Eigenvalue of first detection data And the corresponding third feature value of second detection data, comprising:
First eigenvector is generated according to first detection data, using the first eigenvector as first testing number According to corresponding Second Eigenvalue；
Second feature vector is generated according to second detection data, using the second feature vector as second testing number According to corresponding third feature value.
7. method according to claim 1-6, which is characterized in that described according to output result control The state of the display screen of mobile terminal, comprising:
When the output result characterizes the mobile terminal and object is relatively close, controls the display screen and be in and put out screen shape State；
When the output result characterizes the mobile terminal and object is relatively distant from, controls the display screen and be in bright screen shape State；
When the output result characterization mobile terminal counterbody is static, the display that the display screen keeps current is controlled State.
8. the method according to the description of claim 7 is characterized in that controlling the mobile terminal according to the output result After the state of display screen, the method also includes:
If detect the operation of the control to the state of the display screen in preset duration, is operated and controlled according to the control The display screen is in bright screen state or puts out screen state.
9. according to the method described in claim 8, it is characterized in that, the method also includes:
The corresponding the First Eigenvalue of the output result, Second Eigenvalue and third feature value are labeled as the movement The target moving condition of terminal counterbody, the state pair of target moving condition display screen corresponding with the control operation It answers；
It will be labeled with described in the First Eigenvalue, Second Eigenvalue and third feature the value input of the target moving condition Preset model carries out calibration training to the preset model.
10. a kind of terminal control mechanism, which is characterized in that be applied to mobile terminal, the mobile terminal includes ultrasonic wave transmitting Module, ultrasonic wave receiving module, acceleration transducer, gyro sensor and display screen, described device include: transmitting-receiving control Module, data acquisition module, feature obtain module and screen control module, wherein
The transmitting-receiving control module is on call for working as the mobile terminal, passes through the ultrasonic wave transmitting module and sends Ultrasonic signal, and the ultrasonic wave letter returned after encountering object by the ultrasonic wave receiving module received ultrasonic signal Number；
The data acquisition module is used to obtain the first detection data and the gyroscope that the acceleration transducer detects Second detection data of sensor detection；
The feature obtains the First Eigenvalue, first inspection that module is used to obtain the ultrasonic signal in transmission process The corresponding Second Eigenvalue of measured data and the corresponding third feature value of second detection data；
The screen control module is used to input the First Eigenvalue, the Second Eigenvalue and the third feature value The preset model trained is exported as a result, the preset model is used to obtain the movement of the mobile terminal counterbody State, and according to the state for exporting result and controlling the display screen of the mobile terminal.
11. mobile terminal characterized by comprising
One or more processors；
Memory；
One or more application program, wherein one or more of application programs are stored in the memory and are configured To be executed by one or more of processors, one or more of programs are configured to carry out as claim 1-9 is any Method described in.
12. a kind of computer-readable storage medium, which is characterized in that be stored with journey in the computer-readable storage medium Sequence code, said program code can be called by processor and execute such as the described in any item methods of claim 1-9.
CN201910702590.5A 2019-07-31 2019-07-31 Terminal control method and device, mobile terminal and storage medium Active CN110505341B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910702590.5A CN110505341B (en) 2019-07-31 2019-07-31 Terminal control method and device, mobile terminal and storage medium
PCT/CN2020/103305 WO2021017947A1 (en) 2019-07-31 2020-07-21 Terminal control method and device, mobile terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910702590.5A CN110505341B (en) 2019-07-31 2019-07-31 Terminal control method and device, mobile terminal and storage medium

Publications (2)

Publication Number Publication Date
CN110505341A true CN110505341A (en) 2019-11-26
CN110505341B CN110505341B (en) 2021-05-07

Family

ID=68586879

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910702590.5A Active CN110505341B (en) 2019-07-31 2019-07-31 Terminal control method and device, mobile terminal and storage medium

Country Status (2)

Country Link
CN (1) CN110505341B (en)
WO (1) WO2021017947A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110916725A (en) * 2019-12-19 2020-03-27 上海尽星生物科技有限责任公司 Ultrasonic volume measurement method based on gyroscope
WO2021017947A1 (en) * 2019-07-31 2021-02-04 Oppo广东移动通信有限公司 Terminal control method and device, mobile terminal and storage medium
CN112890860A (en) * 2021-01-20 2021-06-04 李逸丰 5G-based ultrasonic detection method and device
CN114298105A (en) * 2021-12-29 2022-04-08 东莞市猎声电子科技有限公司 Signal processing method for quickly responding to wrist lifting action and brightening screen in running process
CN118450035A (en) * 2023-09-12 2024-08-06 荣耀终端有限公司 Control method for electronic device, and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116466058B (en) * 2023-06-15 2023-09-05 上海博取仪器有限公司 Water quality detection data processing method, water quality evaluation system, equipment and medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108196778A (en) * 2017-12-29 2018-06-22 努比亚技术有限公司 Control method, mobile terminal and the computer readable storage medium of screen state
CN109218538A (en) * 2018-11-29 2019-01-15 努比亚技术有限公司 Mobile terminal screen control method, mobile terminal and computer readable storage medium
CN109710142A (en) * 2017-10-25 2019-05-03 华为技术有限公司 A kind of method and terminal for controlling terminal screen light on and off

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170138279A (en) * 2016-06-07 2017-12-15 엘지전자 주식회사 Mobile terminal and method for controlling the same
CN106413060B (en) * 2016-10-24 2019-11-08 北京小米移动软件有限公司 Screen state control method and device
CN108234767B (en) * 2017-12-29 2021-07-23 努比亚技术有限公司 Control method of screen state, mobile terminal and computer readable storage medium
CN108562890B (en) * 2017-12-29 2023-10-03 努比亚技术有限公司 Method and device for calibrating ultrasonic characteristic value and computer readable storage medium
CN108989546B (en) * 2018-06-15 2021-08-17 Oppo广东移动通信有限公司 Approach detection method of electronic device and related product
CN110505341B (en) * 2019-07-31 2021-05-07 Oppo广东移动通信有限公司 Terminal control method and device, mobile terminal and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109710142A (en) * 2017-10-25 2019-05-03 华为技术有限公司 A kind of method and terminal for controlling terminal screen light on and off
CN108196778A (en) * 2017-12-29 2018-06-22 努比亚技术有限公司 Control method, mobile terminal and the computer readable storage medium of screen state
CN109218538A (en) * 2018-11-29 2019-01-15 努比亚技术有限公司 Mobile terminal screen control method, mobile terminal and computer readable storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021017947A1 (en) * 2019-07-31 2021-02-04 Oppo广东移动通信有限公司 Terminal control method and device, mobile terminal and storage medium
CN110916725A (en) * 2019-12-19 2020-03-27 上海尽星生物科技有限责任公司 Ultrasonic volume measurement method based on gyroscope
CN112890860A (en) * 2021-01-20 2021-06-04 李逸丰 5G-based ultrasonic detection method and device
CN114298105A (en) * 2021-12-29 2022-04-08 东莞市猎声电子科技有限公司 Signal processing method for quickly responding to wrist lifting action and brightening screen in running process
CN114298105B (en) * 2021-12-29 2023-08-22 东莞市猎声电子科技有限公司 Signal processing method for quickly responding to wrist lifting action and brightening screen in running process
CN118450035A (en) * 2023-09-12 2024-08-06 荣耀终端有限公司 Control method for electronic device, and storage medium

Also Published As

Publication number Publication date
CN110505341B (en) 2021-05-07
WO2021017947A1 (en) 2021-02-04

Similar Documents

Publication Publication Date Title
CN110505341A (en) Terminal control method, device, mobile terminal and storage medium
CN109091869B (en) Method and device for controlling action of virtual object, computer equipment and storage medium
CN110515085A (en) Ultrasonic processing method, device, electronic equipment and computer-readable medium
CN111223143B (en) Key point detection method and device and computer readable storage medium
CN110865710B (en) Terminal control method and device, mobile terminal and storage medium
CN110519448A (en) Screen state control method, device, mobile terminal and storage medium
CN110826358A (en) Animal emotion recognition method and device and storage medium
CN107576986B (en) A kind of method and apparatus when determining submarine earthquake back wave is travelled
CN107765251B (en) Distance detection method and terminal equipment
CN107505653B (en) A kind of method and apparatus of determining migration before stack time result
CN108920119A (en) A kind of sharing method and mobile terminal
CN110019929A (en) Processing method, device and the computer readable storage medium of web page contents
CN110659542B (en) Monitoring method and device
CN107884157A (en) A kind of method for detecting abnormality of diffractive-optical element, mobile terminal
CN110505549A (en) The control method and device of earphone
US20230345196A1 (en) Augmented reality interaction method and electronic device
CN107682558A (en) A kind of screen control method and mobile terminal
CN107785027A (en) A kind of audio-frequency processing method and electronic equipment
CN110796918A (en) Training method and device and mobile terminal
CN110493459A (en) Screen state control method, device, mobile terminal and storage medium
CN110297543A (en) A kind of audio frequency playing method and terminal device
CN110418023A (en) Jingle bell processing method, device, mobile terminal and storage medium
CN110764612B (en) Ultrasonic processing method, ultrasonic processing device, electronic equipment and computer readable medium
CN109361804B (en) Incoming call processing method and mobile terminal
CN112827167B (en) Plot triggering method, device, terminal and medium in virtual relationship culture application

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant