CN112817552A - Screen control method, device, equipment and storage medium - Google Patents

Screen control method, device, equipment and storage medium Download PDF

Info

Publication number
CN112817552A
CN112817552A CN202110220331.6A CN202110220331A CN112817552A CN 112817552 A CN112817552 A CN 112817552A CN 202110220331 A CN202110220331 A CN 202110220331A CN 112817552 A CN112817552 A CN 112817552A
Authority
CN
China
Prior art keywords
screen
change information
condition
radar wave
sample
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110220331.6A
Other languages
Chinese (zh)
Inventor
彭聪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202110220331.6A priority Critical patent/CN112817552A/en
Publication of CN112817552A publication Critical patent/CN112817552A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/04Display arrangements
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/41Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Human Computer Interaction (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure relates to a screen control method, apparatus, device and storage medium, the method is applied to an electronic device having a radar wave sensor, the method includes: responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to emit a radar wave signal; in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal; canceling execution of an operation of closing the screen in response to determining that a condition for canceling the screen-closing operation is currently satisfied based on the shape change information. The method and the device can determine whether the user has the requirement for canceling the screen closing of the electronic equipment or not based on the radar sensor, and further cancel the execution of the screen closing operation when the user is determined to have the requirement, so that the intelligent level of the automatic screen closing scheme of the electronic equipment can be improved.

Description

Screen control method, device, equipment and storage medium
Technical Field
The present disclosure relates to the field of terminal technologies, and in particular, to a screen control method, apparatus, device, and storage medium.
Background
With the rapid development of terminal technology, the automatic screen turning function of the terminal has become one of the indispensable functions. In the related art, the judgment basis of the terminal automatic screen turning is usually realized on the basis of timing, that is, when the terminal does not detect the operation of the user within a specific time after executing the operation, the screen is turned off, so as to achieve the purposes of saving the power consumption of equipment and delaying the service life of the screen.
However, in application scenarios such as web browsing, video playing in a small window, or GIF picture, the user may not want the screen to be automatically closed, but if the user clicks the screen, the current display may be changed, or the user may jump to another page, which may not meet the user's requirement.
Disclosure of Invention
In order to overcome the problems in the related art, embodiments of the present disclosure provide a screen control method, device, apparatus, and storage medium, so as to solve the defects in the related art.
According to a first aspect of the embodiments of the present disclosure, there is provided a screen control method applied to an electronic device having a radar wave sensor, the method including:
responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to emit a radar wave signal;
in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal;
canceling execution of an operation of closing the screen in response to determining that a condition for canceling the screen-closing operation is currently satisfied based on the shape change information.
In an embodiment, the method further comprises:
starting timing in response to detecting an operation for an application running in the foreground;
and in response to that the operation aiming at the application program is not detected within a first set time after the start of timing, determining that the condition for executing the screen closing operation is met currently.
In an embodiment, the method further comprises:
in response to detecting that the operation of closing the screen is cancelled at least once, starting timing again;
and in response to that the operation of the application program is not detected within a second set time after the timer is started again, determining that the electronic equipment meets the condition of executing the screen-off operation again, wherein the second set time is longer than the first set time.
In one embodiment, the identifying the shape change information of the target object based on the echo signal includes:
determining a signal characteristic of the echo signal;
inputting the signal characteristics into a pre-constructed neural network model, and determining the shape change information of the target object based on the output result of the model.
In an embodiment, the method further comprises training the neural network model in advance based on:
acquiring a sample echo signal returned by projecting a sample radar wave signal to a sample object;
extracting sample characteristics of the sample echo signals;
determining shape change information of the sample object corresponding to the sample characteristics;
and training a pre-constructed neural network to be trained based on the sample characteristics and the corresponding shape change information of the sample object to obtain a trained neural network model.
In an embodiment, the target object comprises a hand, the method further comprising:
comparing the shape change information with preset gesture change information;
and responding to the fact that the shape change information is matched with the preset gesture change information, and determining that the condition of canceling the screen closing operation is met currently.
According to a second aspect of the embodiments of the present disclosure, there is provided a screen control apparatus applied to an electronic device having a radar wave sensor, the apparatus including:
the radar signal transmitting module is used for responding to the fact that the condition of executing screen closing operation is met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to transmit radar wave signals;
the change information identification module is used for responding to the received echo signal returned by the radar wave signal projected to the target object and identifying the shape change information of the target object based on the echo signal;
and the screen closing operation canceling module is used for canceling the operation of closing the screen in response to the fact that the condition for canceling the screen closing operation is determined to be met currently based on the shape change information.
In one embodiment, the device further comprises a screen-off condition judgment module;
the screen-off condition judgment module comprises:
a first timing unit configured to start timing in response to detection of an operation for an application running in a foreground;
and the first condition judging unit is used for responding to the fact that the operation aiming at the application program is not detected within a first set time after the start of timing, and determining that the condition for executing the screen closing operation is met currently.
In an embodiment, the screen-off condition determining module further includes:
the second timing module is used for responding to the detection of canceling the execution of the operation of closing the screen at least once and starting timing again;
the screen turn-off condition judging module is further configured to determine that the electronic device satisfies the condition for executing the screen turn-off operation again in response to that no operation for the application program is detected within a second set time after timing is restarted, where the second set time is longer than the first set time.
In one embodiment, the change information identification module further includes:
a signal characteristic determination unit for determining a signal characteristic of the echo signal;
and the change information determining unit is used for inputting the signal characteristics into a pre-constructed neural network model and determining the shape change information of the target object based on the output result of the model.
In an embodiment, the apparatus further comprises a network model training module;
the network model training module comprises:
the sample signal acquisition unit is used for acquiring a sample echo signal returned by projecting a sample radar wave signal to a sample object;
the sample characteristic extraction unit is used for extracting sample characteristics of the sample echo signals;
a sample information determination unit for determining shape change information of the sample object corresponding to the sample feature;
and the network model training unit is used for training a pre-constructed neural network to be trained based on the sample characteristics and the corresponding shape change information of the sample object to obtain a trained neural network model.
In one embodiment, the target object comprises a hand, and the device further comprises a screen-off condition judgment module;
the screen turn-off cancellation condition judgment module comprises:
the change information comparison unit is used for comparing the shape change information with preset gesture change information;
and the screen closing cancellation condition judgment unit is used for responding to the condition that the shape change information is matched with the preset gesture change information and determining that the condition of canceling the screen closing operation is met currently.
According to a third aspect of embodiments of the present disclosure, there is provided an electronic apparatus, the apparatus comprising:
a radar wave sensor, a processor, and a memory for storing processor-executable instructions;
the radar wave sensor is used for transmitting radar wave signals and identifying the object based on echo signals returned by the projection of the radar wave sensors to the object;
the processor is configured to:
responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to emit a radar wave signal;
in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal;
canceling the execution of the operation of closing the screen in response to determining that a condition for canceling the screen closing operation is currently satisfied based on the shape change information.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements:
responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling a radar wave sensor to emit a radar wave signal;
in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal;
canceling the execution of the operation of closing the screen in response to determining that a condition for canceling the screen closing operation is currently satisfied based on the shape change information.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
the present disclosure generates prompt information for prompting that the screen is about to be closed in response to detecting that a condition for performing a screen-off operation is currently satisfied, and controls the radar wave sensor to transmit a radar wave signal, then responding to the received echo signal returned by the radar wave signal projected to the target object, identifying the shape change information of the target object based on the echo signal, and further in response to determining that a condition for canceling the screen-off operation is currently satisfied based on the shape change information, canceling the execution of the operation for closing the screen, it is possible to realize that, without the user touching the screen of the electronic apparatus, it is determined whether the user has a need to cancel the turning off of the screen of the electronic apparatus based on the radar sensor, and furthermore, when the user is determined to have the requirement, the operation of closing the screen is cancelled, so that the intelligent level of the automatic screen closing scheme of the electronic equipment can be improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a flow chart illustrating a method of screen control according to an exemplary embodiment;
FIG. 2 is a flow chart illustrating a method of screen control according to yet another exemplary embodiment;
FIG. 3 is a flow diagram illustrating how shape change information for the target object is identified based on the echo signals in accordance with an exemplary embodiment;
FIG. 4 is a flow diagram illustrating how the neural network model is trained in accordance with an exemplary embodiment;
FIG. 5 is a flow diagram illustrating how it is determined that a condition for canceling an off-screen operation is currently satisfied in accordance with an illustrative embodiment;
FIG. 6 is a diagram illustrating an application scenario for a screen control method according to an exemplary embodiment;
FIG. 7 is a block diagram of a screen control device shown in accordance with an exemplary embodiment;
FIG. 8 is a block diagram illustrating a screen control device according to yet another exemplary embodiment;
FIG. 9 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
FIG. 1 is a flow chart illustrating a method of screen control according to an exemplary embodiment; the method of the embodiment can be applied to an electronic device (e.g., a smart phone, a tablet computer, a notebook computer, or a wearable device) with a radar wave sensor.
As shown in fig. 1, the method comprises the following steps S101-S103:
in step S101, in response to detecting that the condition for performing the screen closing operation is currently satisfied, generating a prompt message for prompting that the screen is to be closed, and controlling the radar wave sensor to transmit a radar wave signal.
In the related art, when the electronic device detects that information such as a current device operating condition satisfies a condition for performing a screen closing operation (e.g., closing a screen of the electronic device), the screen closing operation is performed. However, in some cases, the user may not want the electronic device to automatically turn off the screen. For example, when a user browses a web page, plays a video or a GIF picture in a small window, and the like, the user may not operate the screen of the electronic device for a long time (exceeding a time threshold for the electronic device to perform automatic screen closing determination), which may cause the electronic device to misjudge that the current condition for performing the screen closing operation is satisfied, and obviously, this is not in line with the user's requirement.
In view of this, in the embodiment, when it is detected that the condition for performing the screen closing operation is currently satisfied, the screen closing operation is not immediately performed, but prompt information for prompting that the screen is to be closed is generated, and a radar wave sensor preset on the electronic device is controlled to emit a radar wave signal.
The form of the prompt message for prompting that the screen is to be closed may be set based on actual needs of a user or a developer, for example, the prompt message is set to be in a form of displaying a floating window or an air bubble, or in a form of generating a text, a specific sound effect, or the like, which is not limited in this embodiment.
In this embodiment, a radar wave sensor may be preset on the electronic device, and the sensor may be configured to transmit a radar wave signal, and complete a distance test and identify and detect an object based on an echo signal (e.g., a chirp echo signal) returned by the projection to the object. The radar wave sensor may be disposed on the electronic device in a front-end or rear-end manner, which is not limited in this embodiment.
In step S102, in response to receiving an echo signal returned by the radar wave signal projected to a target object, shape change information of the target object is identified based on the echo signal.
In this embodiment, the radar wave sensor may emit a radar wave signal to the outside of the screen of the electronic device, and if the user does not want the electronic device to perform the screen-off operation at this time, the user may shake a target object (e.g., a hand, a head, etc. of the user) in front of the screen of the electronic device, so that the radar wave signal may be projected onto the surface of the target object.
It is understood that the echo signal returned by the radar wave signal projected to the target object is related to the shape of the target object. If the shape of the target object is changed during the process that the radar wave sensor projects a radar wave signal to the target object at a preset frequency, the returned echo signals are also different. Therefore, the embodiment can utilize the characteristics to analyze the echo signals returned during the process of changing the shape of the target object so as to determine the shape change information of the target object.
In another embodiment, the above-mentioned manner of identifying the shape change information of the target object based on the echo signal can also be referred to the following embodiment shown in fig. 3, which is not described in detail herein.
In step S103, in response to determining that a condition for canceling the screen-off operation is currently satisfied based on the shape change information, the execution of the operation for closing the screen is canceled.
In this embodiment, after the shape change information of the target object is identified based on the echo signal, the shape change information may be compared with target shape change information corresponding to a condition for canceling the screen closing operation, and if the similarity between the two exceeds a set similarity threshold, it may be determined that the condition for canceling the screen closing operation is currently satisfied, and then the operation for closing the screen may be cancelled.
It is understood that the above-mentioned set similarity threshold may be set based on actual sensitivity requirements, which is not limited by the embodiment.
As can be seen from the above description, the method of the present embodiment generates the prompt information for prompting that the screen is about to be closed by responding to the detection that the condition for performing the screen closing operation is currently satisfied, and controls the radar wave sensor to emit the radar wave signal, then responding to the received echo signal returned by the radar wave signal projected to the target object, identifying the shape change information of the target object based on the echo signal, and further in response to determining that a condition for canceling the screen-off operation is currently satisfied based on the shape change information, canceling the execution of the operation for closing the screen, it is possible to realize that, without the user touching the screen of the electronic apparatus, it is determined whether the user has a need to cancel the turning off of the screen of the electronic apparatus based on the radar sensor, and furthermore, when the user is determined to have the requirement, the operation of closing the screen is cancelled, so that the intelligent level of the automatic screen closing scheme of the electronic equipment can be improved.
FIG. 2 is a flow chart illustrating a method of screen control according to yet another exemplary embodiment; the method of the embodiment can be applied to an electronic device (e.g., a smart phone, a tablet computer, a notebook computer, or a wearable device) with a radar wave sensor.
As shown in fig. 2, the method comprises the following steps S201-S107:
in step S201, in response to detection of an operation for an application running in the foreground, a timer is started.
In this embodiment, when the electronic device runs the application program in the foreground, if the operation of the user is detected, timing may be started to determine whether the operation of the user for the application program will be detected again within the first set time.
The application program may include a browser, a video player, an album, or the like, which is not limited in this embodiment.
In step S202, in response to that no operation for the application program is detected within a first set time after the start of the time counting, it is determined that a condition for performing a screen-off operation is currently satisfied.
In this embodiment, when the electronic device does not detect an operation for the application within a first set time after the start of the timing, it may be determined that a condition for performing the screen-off operation is currently satisfied, and then it may be determined whether the user has a need to cancel the screen-off operation based on the following steps.
In step S203, in response to detecting that the condition for executing the screen closing operation is currently satisfied, generating a prompt message for prompting that the screen is to be closed, and controlling the radar wave sensor to transmit a radar wave signal.
In step S204, in response to receiving an echo signal returned by the radar wave signal projected to the target object, shape change information of the target object is identified based on the echo signal.
In step S205, in response to determining that the condition for canceling the screen-off operation is currently satisfied based on the shape change information, the execution of the operation for closing the screen is canceled.
For the explanation and description of steps S203-S205, reference may be made to the above embodiments, which are not repeated herein.
In step S206, in response to detection of at least one cancellation of execution of the operation of closing the screen, the timer is started again.
In this embodiment, after the electronic device performs at least one cancellation of the execution of the operation of closing the screen, the electronic device may start timing again in response to the cancellation operation to determine whether the operation of the user on the application program will be detected again within a second set time. Wherein the second setting time is longer than the first setting time. That is to say, in this embodiment, after it is detected that at least one user cancels the execution of the screen closing operation, the time interval for the next screen closing operation judgment may be extended, so as to appropriately slow down the frequency of judging whether to execute the screen closing operation, and meet the use requirement of the user.
In an embodiment, the second setting time may be infinitely long. In this case, it can be considered that the electronic apparatus temporarily turns off the function of the automatic screen-off operation. After the user manually clicks a key for closing the screen, and the like, the function can be enabled again.
In step S207, in response to that the operation for the application program is not detected within the second set time after the timer is started again, it is determined that the electronic device satisfies the condition for performing the screen-off operation again.
In this embodiment, when the electronic device does not detect the operation for the application within the second set time after the electronic device starts timing again, it may be determined that the electronic device satisfies the condition for executing the screen-off operation again, and then the step S203 may be skipped to determine whether the user has a requirement for canceling the screen-off operation again.
As can be seen from the above description, in this embodiment, by starting timing in response to detection of an operation on an application program running in the foreground, and determining that a condition for performing a screen-off operation is currently satisfied in response to no detection of an operation on the application program within a first set time after the start of timing, it is possible to accurately determine whether the condition for performing a screen-off operation is currently satisfied, and lay a foundation for subsequently generating a prompt message for prompting that the screen is to be closed based on the determination result, and controlling the radar wave sensor to transmit a radar wave signal; further, by responding to the detection of at least one cancellation of execution of the operation of closing the screen, restarting timing, and responding to the detection of no operation on the application program within a second set time after the restarting of timing, determining that the electronic equipment meets the condition of executing the screen closing operation again, the time interval of executing the screen closing operation again can be adjusted, and the requirements of the user can be met.
FIG. 3 is a flow diagram illustrating how shape change information for the target object is identified based on the echo signals in accordance with an exemplary embodiment; the present embodiment is exemplified by how to identify the shape change information of the target object based on the echo signal on the basis of the above-described embodiments. As shown in fig. 3, the identifying the shape change information of the target object based on the echo signal in step S102 may include the following steps S301 to S302:
in step S301, a signal characteristic of the echo signal is determined.
In this embodiment, after receiving an echo signal returned by a radar wave signal projected to a target object, a signal characteristic of the echo signal may be determined. The signal characteristics can not only well highlight the characteristics of the echo signals, but also show the characteristics of distinguishing and connecting with other echo signals of the same kind of objects so as to enhance the characteristic identification degree.
In an embodiment, one feature or multiple features (corresponding to the feature types extracted in the training process of the neural network model described below) may be extracted from the echo signal, so as to fully and comprehensively represent the characteristics of the shape of the target object corresponding to the echo signal.
In step S302, the signal feature is input to a neural network model constructed in advance, and shape change information of the target object is determined based on an output result of the model.
In this embodiment, after the signal characteristics of the echo signal are determined, the signal characteristics may be input into a neural network model constructed in advance, so as to determine the shape change information of the target object based on the output result of the model.
For example, FIG. 4 is a flow diagram illustrating how the neural network model is trained in accordance with an exemplary embodiment. As shown in fig. 4, the method of this embodiment may further include training the neural network model in advance based on the following steps S401-S404:
in step S401, a sample echo signal returned by projecting a sample radar wave signal to a sample object is acquired.
In this embodiment, in order to train a neural network model for determining the shape of the target object based on the characteristics of the echo signals, sample echo signals returned by a large number of sample radar wave signals projected onto sample objects of different shapes may be acquired.
In step S402, a sample feature of the sample echo signal is extracted.
After obtaining a sample echo signal returned by the sample radar wave signal projected to the sample object, a sample feature of the sample echo signal may be extracted.
The manner of extracting the sample features of the sample echo signal is the same as the manner of determining the signal features of the echo signal described in step S301, and is not described herein again.
In step S403, shape change information of the sample object corresponding to the sample feature is determined.
In this embodiment, after the sample characteristics of the sample echo signal are extracted, the shape change information of the sample object corresponding to the sample characteristics may be calibrated by using a method such as manual calibration.
The shape change information of the sample object may include identification information corresponding to different shapes of the sample object, and the identification information uniquely corresponds to the shape change information, that is, the shape change information may be used to distinguish the shape change information from other shape change information.
In step S404, a pre-constructed neural network to be trained is trained based on the sample features and the shape change information of the corresponding sample object, so as to obtain a trained neural network model.
In this embodiment, after the shape change information of the sample object corresponding to the sample feature is determined, a pre-constructed neural network to be trained may be trained based on the sample feature and the shape change information of the corresponding sample object, and when a training termination condition is satisfied, the model training process is stopped, so as to obtain a trained neural network model.
The training termination condition may be set based on actual needs, such as iteration times, model prediction accuracy, and the like, which is not limited in this embodiment.
As can be seen from the above description, in this embodiment, by obtaining a sample echo signal returned by a sample radar wave signal projected to a sample object, extracting a sample feature of the sample echo signal, then determining shape change information of the sample object corresponding to the sample feature, and then training a pre-constructed neural network to be trained based on the sample feature and the corresponding shape change information of the sample object, a neural network model accurately trained based on the sample feature of the sample echo signal and the corresponding shape change information can be realized, and then subsequently determining a signal feature of a radar wave signal after receiving an echo signal returned by the radar wave signal projected to a target object, and inputting the signal feature into the pre-constructed neural network model, so as to determine the shape change information of the target object based on an output result of the model, and providing accurate basis for determining whether the condition of canceling the screen-off operation is met or not based on the shape change information.
FIG. 5 is a flow diagram illustrating how it is determined that a condition for canceling an off-screen operation is currently satisfied in accordance with an illustrative embodiment; the present embodiment exemplifies how to determine that the condition for canceling the off-screen operation is currently satisfied, on the basis of the above-described embodiment. Wherein the target object may comprise a hand. On this basis, as shown in fig. 5, the method of the present embodiment may further include determining whether a condition for canceling the off-screen operation is currently satisfied based on the following steps S501 to S502:
in step S501, the shape change information is compared with preset gesture change information.
In this embodiment, in the case where the target object is a hand of a user, the shape change information of the target object may be understood as posture change information of the hand of the user (i.e., gesture change information of the user). And then after the gesture change information of the user is identified based on the echo signal, the gesture change information can be compared with preset gesture change information to determine the similarity of the gesture change information and the preset gesture change information.
It can be understood that the preset gesture change information may be gesture change information corresponding to the condition for canceling the screen-off operation, such as a continuous flexion and extension state of the five fingers of the user, which is not limited in this embodiment.
In step S502, in response to determining that the shape change information matches the preset gesture change information, it is determined that a condition for canceling the screen-off operation is currently satisfied.
In this embodiment, after the shape change information is compared with the preset gesture change information, a comparison result, such as a similarity between the shape change information and the preset gesture change information, may be obtained, and then the similarity may be compared with a preset similarity threshold, and if the similarity is greater than or equal to the preset similarity threshold, it may be determined that the shape change information matches with the preset gesture change information, and then it may be determined that the condition for canceling the screen closing operation is currently satisfied.
As can be seen from the above description, in this embodiment, by comparing the shape change information with preset gesture change information, and determining that the condition for canceling the screen closing operation is currently satisfied in response to determining that the shape change information matches the preset gesture change information, it can be accurately determined whether the condition for canceling the screen closing operation is currently satisfied based on the matching result of the shape change information of the hand of the user and the preset gesture change information, and an accurate basis can be provided for subsequently determining to cancel execution of the operation for closing the screen based on the determination result.
In another embodiment, the target object may further include a limb such as a head of the user, or an organ such as an eye and a mouth, which is not limited in this embodiment. For example, when the electronic device detects that a condition for performing a screen-off operation is currently satisfied, a prompt message for prompting that the screen is to be closed may be generated, and the radar wave sensor may be controlled to transmit a radar wave signal. Furthermore, after the user sees the prompt message, if the user does not want the electronic device to perform the screen closing operation, the user can shake the limbs such as the head in front of the screen of the electronic device, or move the eye sight, or change the shape of the mouth, and the like, so that the electronic device can recognize the shape change information of the target object and compare the recognized shape change information with the preset sample change information, and when the shape change information is determined to be matched with the preset sample change information, the user can determine that the condition for canceling the screen closing operation is currently satisfied, and cancel the operation for closing the screen. It should be understood that the above-mentioned detection manners of the shapes of the limbs such as the head, the eye sight line, or the mouth can be referred to in the related art, for example, by an image recognition manner, and the present embodiment does not limit this.
FIG. 6 is a diagram illustrating an application scenario for a screen control method according to an exemplary embodiment; as shown in fig. 6, the application scenario involves a user 100 and an electronic device 200, and a radar wave sensor 201 is provided on the electronic device 200. In the actual application process, when the electronic device detects that the condition for executing the screen closing operation is currently met, prompt information for prompting that the screen is to be closed can be generated, and the radar wave sensor 201 is controlled to emit a radar wave signal 202; then, after seeing the prompt information, if the user 100 does not want the electronic device 200 to perform the screen-off operation, the user may shake the limbs such as the hands in front of the screen of the electronic device 200, so that the radar wave signal 202 may be projected to the hands of the user 100; further, the electronic device may receive an echo signal 101 returned by the radar wave signal 202 projected to the hand of the user, and may further identify shape change information (e.g., gesture information of the user) of the hand of the user 100 based on the echo signal 101; on this basis, the electronic apparatus 200 may cancel performing the operation of closing the screen when it is determined that the condition for canceling the screen closing operation is currently satisfied based on the shape change information.
FIG. 7 is a block diagram of a screen control device shown in accordance with an exemplary embodiment; the apparatus of the embodiment may be applied to an electronic device (e.g., a smart phone, a tablet computer, a notebook computer, or a wearable device) having a radar wave sensor. As shown in fig. 7, the apparatus is applied to an electronic device having a radar wave sensor, and includes: a radar signal emitting module 110, a change information identifying module 120 and a screen-off operation canceling module 130, wherein:
a radar signal transmitting module 110, configured to generate a prompt message for prompting that the screen is to be closed in response to detecting that a condition for executing a screen closing operation is currently satisfied, and control the radar wave sensor to transmit a radar wave signal;
a change information identification module 120, configured to identify, in response to receiving an echo signal returned by the radar wave signal projected to a target object, shape change information of the target object based on the echo signal;
a screen-off operation canceling module 130 configured to cancel execution of an operation of closing the screen in response to determining that a condition for canceling the screen-off operation is currently satisfied based on the shape change information.
As can be seen from the above description, the apparatus of this embodiment generates a prompt message for prompting that the screen is about to be closed by responding to the detection that the condition for performing the screen closing operation is currently satisfied, and controls the radar wave sensor to emit a radar wave signal, then responding to the received echo signal returned by the radar wave signal projected to the target object, identifying the shape change information of the target object based on the echo signal, and further in response to determining that a condition for canceling the screen-off operation is currently satisfied based on the shape change information, canceling the execution of the operation for closing the screen, it is possible to realize that, without the user touching the screen of the electronic apparatus, it is determined whether the user has a need to cancel the turning off of the screen of the electronic apparatus based on the radar sensor, and furthermore, when the user is determined to have the requirement, the operation of closing the screen is cancelled, so that the intelligent level of the automatic screen closing scheme of the electronic equipment can be improved.
FIG. 8 is a block diagram illustrating a screen control device according to yet another exemplary embodiment; the apparatus of the embodiment may be applied to an electronic device (e.g., a smart phone, a tablet computer, a notebook computer, or a wearable device) having a radar wave sensor. The functions of the radar signal transmitting module 210, the change information identifying module 220, and the screen-off operation canceling module 230 are the same as those of the radar signal transmitting module 110, the change information identifying module 120, and the screen-off operation canceling module 130 in the embodiment shown in fig. 7, and are not described herein again. As shown in fig. 8, the apparatus of this embodiment may further include a screen-off condition determining module 240;
the screen-related condition determining module 240 may include:
a first timing unit 241 for starting timing in response to detection of an operation for an application running in the foreground;
a first condition judgment unit 242, configured to determine that a condition for performing a screen-off operation is currently satisfied in response to that no operation for the application program is detected within a first set time after the start of the timing.
In an embodiment, the screen condition determining module 240 may further include:
a second timing module 243, configured to, in response to detecting that the operation of closing the screen is cancelled at least once, start timing again;
a second condition judgment unit 244, configured to determine that the electronic device satisfies the condition for performing the screen-off operation again in response to that no operation for the application program is detected within a second set time after the timer is started again, where the second set time is longer than the first set time.
In an embodiment, the change information identification module 220 may further include:
a signal characteristic determination unit 221 configured to determine a signal characteristic of the echo signal;
a change information determination unit 222, configured to input the signal characteristics into a pre-constructed neural network model, and determine shape change information of the target object based on an output result of the model.
In an embodiment, the apparatus may further include a network model training module 250;
the network model training module 250 may include:
a sample signal acquiring unit 251 for acquiring a sample echo signal returned by the sample radar wave signal projected to the sample object;
a sample feature extraction unit 252, configured to extract a sample feature of the sample echo signal;
a sample information determining unit 253 for determining shape change information of the sample object corresponding to the sample feature;
and the network model training unit 254 is configured to train a pre-constructed neural network to be trained based on the sample characteristics and the corresponding shape change information of the sample object to obtain a trained neural network model.
In one embodiment, the target object includes a hand, and the apparatus may further include a screen-off condition determining module 260;
the screen cancellation condition determining module 260 may include:
a change information comparison unit 261 for comparing the shape change information with preset gesture change information;
a screen turn-off canceling condition judging unit 262, configured to determine that a condition for canceling the screen turn-off operation is currently satisfied in response to determining that the shape change information matches the preset gesture change information.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
FIG. 9 is a block diagram illustrating an electronic device in accordance with an example embodiment. For example, the device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and so forth.
Referring to fig. 9, device 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.
The processing component 902 generally controls the overall operation of the device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing component 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The memory 904 is configured to store various types of data to support operation at the device 900. Examples of such data include instructions for any application or method operating on device 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 904 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power component 906 provides power to the various components of the device 900. The power components 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 900.
The multimedia components 908 include a screen that provides an output interface between the device 900 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 910 is configured to output and/or input audio signals. For example, audio component 910 includes a Microphone (MIC) configured to receive external audio signals when device 900 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.
I/O interface 912 provides an interface between processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 914 includes one or more sensors for providing status assessment of various aspects of the device 900. For example, the sensor component 914 may detect an open/closed state of the device 900, the relative positioning of components, such as a display and keypad of the device 900, the sensor component 914 may also detect a change in the position of the device 900 or a component of the device 900, the presence or absence of user contact with the device 900, orientation or acceleration/deceleration of the device 900, and a change in the temperature of the device 900. The sensor assembly 914 may also include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate communications between the device 900 and other devices in a wired or wireless manner. The device 900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G or 5G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the device 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 904 comprising instructions, executable by the processor 920 of the device 900 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (14)

1. A screen control method applied to an electronic apparatus having a radar wave sensor, the method comprising:
responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to emit a radar wave signal;
in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal;
canceling execution of an operation of closing the screen in response to determining that a condition for canceling the screen-closing operation is currently satisfied based on the shape change information.
2. The method of claim 1, further comprising:
starting timing in response to detecting an operation for an application running in the foreground;
and in response to that the operation aiming at the application program is not detected within a first set time after the start of timing, determining that the condition for executing the screen closing operation is met currently.
3. The method of claim 2, further comprising:
in response to detecting that the operation of closing the screen is cancelled at least once, starting timing again;
and in response to that the operation of the application program is not detected within a second set time after the timer is started again, determining that the electronic equipment meets the condition of executing the screen-off operation again, wherein the second set time is longer than the first set time.
4. The method of claim 1, wherein the identifying shape change information of the target object based on the echo signal comprises:
determining a signal characteristic of the echo signal;
inputting the signal characteristics into a pre-constructed neural network model, and determining the shape change information of the target object based on the output result of the model.
5. The method of claim 4, further comprising training the neural network model in advance based on:
acquiring a sample echo signal returned by projecting a sample radar wave signal to a sample object;
extracting sample characteristics of the sample echo signals;
determining shape change information of the sample object corresponding to the sample characteristics;
and training a pre-constructed neural network to be trained based on the sample characteristics and the corresponding shape change information of the sample object to obtain a trained neural network model.
6. The method of claim 1, wherein the target object comprises a hand,
the method further comprises the following steps:
comparing the shape change information with preset gesture change information;
and responding to the fact that the shape change information is matched with the preset gesture change information, and determining that the condition of canceling the screen closing operation is met currently.
7. A screen control apparatus applied to an electronic device having a radar wave sensor, the apparatus comprising:
the radar signal transmitting module is used for responding to the fact that the condition of executing screen closing operation is met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to transmit radar wave signals;
the change information identification module is used for responding to the received echo signal returned by the radar wave signal projected to the target object and identifying the shape change information of the target object based on the echo signal;
and the screen closing operation canceling module is used for canceling the operation of closing the screen in response to the fact that the condition for canceling the screen closing operation is determined to be met currently based on the shape change information.
8. The apparatus of claim 7, further comprising a screen condition determining module;
the screen-off condition judgment module comprises:
a first timing unit configured to start timing in response to detection of an operation for an application running in a foreground;
and the first condition judging unit is used for responding to the fact that the operation aiming at the application program is not detected within a first set time after the start of timing, and determining that the condition for executing the screen closing operation is met currently.
9. The apparatus of claim 8, wherein the screen condition determining module further comprises:
the second timing module is used for responding to the detection of canceling the execution of the operation of closing the screen at least once and starting timing again;
and the second condition judging unit is used for responding to that the operation aiming at the application program is not detected within a second set time after the timing is started again, and determining that the electronic equipment meets the condition of executing the screen closing operation again, wherein the second set time is longer than the first set time.
10. The apparatus of claim 7, wherein the change information identification module further comprises:
a signal characteristic determination unit for determining a signal characteristic of the echo signal;
and the change information determining unit is used for inputting the signal characteristics into a pre-constructed neural network model and determining the shape change information of the target object based on the output result of the model.
11. The apparatus of claim 10, further comprising a network model training module;
the network model training module comprises:
the sample signal acquisition unit is used for acquiring a sample echo signal returned by projecting a sample radar wave signal to a sample object;
the sample characteristic extraction unit is used for extracting sample characteristics of the sample echo signals;
a sample information determination unit for determining shape change information of the sample object corresponding to the sample feature;
and the network model training unit is used for training a pre-constructed neural network to be trained based on the sample characteristics and the corresponding shape change information of the sample object to obtain a trained neural network model.
12. The apparatus of claim 7, wherein the target object comprises a hand, the apparatus further comprising a screen cancellation condition determination module;
the screen turn-off cancellation condition judgment module comprises:
the change information comparison unit is used for comparing the shape change information with preset gesture change information;
and the screen closing cancellation condition judgment unit is used for responding to the condition that the shape change information is matched with the preset gesture change information and determining that the condition of canceling the screen closing operation is met currently.
13. An electronic device, characterized in that the device comprises:
a radar wave sensor, a processor, and a memory for storing processor-executable instructions;
the radar wave sensor is used for transmitting radar wave signals and identifying the object based on echo signals returned by the projection of the radar wave sensors to the object;
the processor is configured to:
responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling the radar wave sensor to emit a radar wave signal;
in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal;
canceling the execution of the operation of closing the screen in response to determining that a condition for canceling the screen closing operation is currently satisfied based on the shape change information.
14. A computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing:
responding to the condition that the screen closing operation is executed and detected to be met currently, generating prompt information for prompting that the screen is about to be closed, and controlling a radar wave sensor to emit a radar wave signal;
in response to receiving an echo signal returned by the radar wave signal projected to a target object, identifying shape change information of the target object based on the echo signal;
canceling the execution of the operation of closing the screen in response to determining that a condition for canceling the screen closing operation is currently satisfied based on the shape change information.
CN202110220331.6A 2021-02-26 2021-02-26 Screen control method, device, equipment and storage medium Pending CN112817552A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110220331.6A CN112817552A (en) 2021-02-26 2021-02-26 Screen control method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110220331.6A CN112817552A (en) 2021-02-26 2021-02-26 Screen control method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN112817552A true CN112817552A (en) 2021-05-18

Family

ID=75864121

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110220331.6A Pending CN112817552A (en) 2021-02-26 2021-02-26 Screen control method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN112817552A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106384033A (en) * 2016-09-29 2017-02-08 努比亚技术有限公司 Screen off method and apparatus of terminal screen
CN106909256A (en) * 2017-02-27 2017-06-30 北京小米移动软件有限公司 Screen control method and device
CN108646908A (en) * 2018-04-28 2018-10-12 上海与德科技有限公司 A kind of terminal screen control method, device, terminal and storage medium
CN109167873A (en) * 2018-07-17 2019-01-08 珠海格力电器股份有限公司 A kind of control method of terminal, device, storage medium and terminal
CN109188414A (en) * 2018-09-12 2019-01-11 北京工业大学 A kind of gesture motion detection method based on millimetre-wave radar
US20200026361A1 (en) * 2018-07-19 2020-01-23 Infineon Technologies Ag Gesture Detection System and Method Using A Radar Sensors
CN111819523A (en) * 2018-08-22 2020-10-23 谷歌有限责任公司 Smart phone, system and method implemented in electronic device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106384033A (en) * 2016-09-29 2017-02-08 努比亚技术有限公司 Screen off method and apparatus of terminal screen
CN106909256A (en) * 2017-02-27 2017-06-30 北京小米移动软件有限公司 Screen control method and device
CN108646908A (en) * 2018-04-28 2018-10-12 上海与德科技有限公司 A kind of terminal screen control method, device, terminal and storage medium
CN109167873A (en) * 2018-07-17 2019-01-08 珠海格力电器股份有限公司 A kind of control method of terminal, device, storage medium and terminal
US20200026361A1 (en) * 2018-07-19 2020-01-23 Infineon Technologies Ag Gesture Detection System and Method Using A Radar Sensors
CN111819523A (en) * 2018-08-22 2020-10-23 谷歌有限责任公司 Smart phone, system and method implemented in electronic device
CN109188414A (en) * 2018-09-12 2019-01-11 北京工业大学 A kind of gesture motion detection method based on millimetre-wave radar

Similar Documents

Publication Publication Date Title
US10956706B2 (en) Collecting fingreprints
EP3301551B1 (en) Electronic device for identifying touch
CN109360197B (en) Image processing method and device, electronic equipment and storage medium
CN104123093A (en) Information processing method and device
CN110619873A (en) Audio processing method, device and storage medium
CN110059547B (en) Target detection method and device
US20180238748A1 (en) Pressure detection method and apparatus, and storage medium
CN108829475B (en) UI drawing method, device and storage medium
CN107392160B (en) Optical fingerprint identification method and device and computer readable storage medium
CN109862169B (en) Electronic equipment control method, device and storage medium
CN108040213B (en) Method and apparatus for photographing image and computer-readable storage medium
CN110059548B (en) Target detection method and device
CN112489653B (en) Speech recognition method, device and storage medium
CN112185388B (en) Speech recognition method, device, equipment and computer readable storage medium
CN108319899B (en) Fingerprint identification method and device
CN108830194B (en) Biological feature recognition method and device
CN107087073B (en) Terminal control method and device
CN107948876B (en) Method, device and medium for controlling sound box equipment
CN107402677B (en) Method and device for recognizing finger lifting in touch operation and terminal
CN112817552A (en) Screen control method, device, equipment and storage medium
CN113035189A (en) Document demonstration control method, device and equipment
CN112148149A (en) Touch screen control method, touch screen control device and storage medium
CN108037875B (en) Method, device and storage medium for switching input modes
CN112702514A (en) Image acquisition method, device, equipment and storage medium
CN114418865A (en) Image processing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination