CN111666840A

CN111666840A - Information prompting method and device and electronic equipment

Info

Publication number: CN111666840A
Application number: CN202010447135.8A
Authority: CN
Inventors: 章苏迟
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-05-25
Filing date: 2020-05-25
Publication date: 2020-09-15

Abstract

The application discloses an information prompting method, an information prompting device and electronic equipment, and belongs to the technical field of communication. The method is applied to electronic equipment, the electronic equipment comprises a screen and a camera assembly positioned below the screen, and the method comprises the following steps: acquiring a preview image acquired by a camera component; based on the preview image, obtaining a dirt detection result of a target screen area corresponding to the camera shooting assembly; and outputting prompt information under the condition that the dirt detection result meets a preset dirt condition. According to the method, the device and the system, the device can prompt that the screen area corresponding to the camera shooting assembly below the screen is dirty.

Description

Information prompting method and device and electronic equipment

Technical Field

The application belongs to the technical field of communication, and particularly relates to an information prompting method and device and electronic equipment.

Background

With the rapid development of electronic equipment technology, the demand of users on electronic equipment is increasing, and all electronic equipment manufacturers try to improve the screen occupation ratio of the electronic equipment so as to improve the user experience. In order to improve the screen ratio, the camera shooting assembly can be placed below the display screen, namely the camera shooting assembly under the screen, so that full-screen display is realized.

In the process of implementing the present application, the inventors found that at least the following technical problems exist in the prior art: the screen area corresponding to the camera shooting assembly is likely to be clicked and touched by a user at high frequency. Therefore, the screen area corresponding to the camera module is more easily contaminated by dirt, and the contamination degree may be more serious. Because the contamination of filth can influence face identification, functions such as autodyne. Therefore, it is desirable to provide an information prompting method for prompting a user that a screen area corresponding to a camera module is dirty.

Disclosure of Invention

The embodiment of the application aims to provide an information prompting method, an information prompting device and electronic equipment, which can prompt that a screen area corresponding to a camera shooting assembly below a screen is dirty.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides an information prompting method, which is applied to an electronic device, where the electronic device includes a screen and a camera module located below the screen, and the method includes:

acquiring a preview image acquired by a camera component;

based on the preview image, obtaining a dirt detection result of a target screen area corresponding to the camera shooting assembly;

and outputting prompt information under the condition that the dirt detection result meets a preset dirt condition.

In a second aspect, an embodiment of the present application provides an information prompting apparatus, which is applied to an electronic device, where the electronic device includes a screen and a camera module located below the screen, and the apparatus includes:

the preview image acquisition module is used for acquiring a preview image acquired by the camera shooting assembly;

the dirty detection result determining module is used for obtaining a dirty detection result of a target screen area corresponding to the camera shooting assembly based on the preview image;

and the prompt information output module is used for outputting prompt information under the condition that the dirt detection result meets the preset dirt condition.

In a third aspect, embodiments of the present application provide an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium on which a program or instructions are stored, which when executed by a processor, implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, the dirt detection result of the target screen area corresponding to the camera shooting assembly can be obtained by utilizing the preview image acquired by the camera shooting assembly. Under the condition that the smudginess detection result meets the preset smudginess condition, the prompt information is output to prompt that the target screen area corresponding to the camera shooting assembly below the screen of the user is dirty, so that the user can timely clean the target screen area, and the convenience of using the camera shooting assembly under the screen by the user is improved.

Drawings

Fig. 1 is a schematic flowchart of an information prompting method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a prompt message provided by an embodiment of the present application;

fig. 3 is a schematic flowchart of an information prompting method according to another embodiment of the present application;

fig. 4 is a schematic structural diagram of an information prompt apparatus according to an embodiment of the present application;

fig. 5 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The information prompting method, the information prompting device, and the electronic device provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Fig. 1 is a schematic flow chart of an information prompting method according to an embodiment of the present application. As shown in fig. 1, the information prompting method includes steps 110 to 130. The execution main body of the information prompting method provided by the embodiment of the application can be applied to electronic equipment, and the electronic equipment comprises a screen and a camera shooting assembly positioned below the screen.

And step 110, acquiring a preview image acquired by the camera assembly.

And step 120, obtaining a dirt detection result of the target screen area corresponding to the camera shooting assembly based on the preview image.

And step 130, outputting prompt information under the condition that the dirt detection result meets the preset dirt condition.

The specific implementation of each of steps 110 to 130 is described in detail below.

First, a specific implementation of step 110 will be described. As an example, the camera module may be turned on according to a preset period to obtain a preview image captured by the camera module.

In the embodiment of the application, the preview image acquired by the camera shooting component can be acquired in the scene that the screen of the information prompting device is in the bright screen state or the dark screen state.

In some embodiments, to further improve convenience of the user, before step 110, the information prompting method provided in the embodiments of the present application further includes: acquiring a target face image acquired by a camera component; in case that it is determined that the target face image does not match the preset face unlock image, step 110 is performed.

As an example, the shooting prompting device may be a terminal having an off-screen camera component. Under the condition that a user needs to unlock the screen of the shooting prompting device by using the face unlocking function, the user watches the screen, and then the camera shooting assembly can collect a target face image. Then, the shooting prompting device can acquire a target face image acquired by the shooting component. And the shooting prompting device judges whether the target face image is matched with the preset face unlocking image or not. If the target face image is determined not to be matched with the preset face unlocking image, the

steps

110 and 120 are executed to judge whether the target screen area corresponding to the camera shooting assembly is dirty or not.

In the embodiment of the application, if the target face image is not matched with the preset face unlocking image, the representation may be caused by the fact that the target screen region corresponding to the camera shooting assembly is dirty, so that the preview image acquired by the camera shooting assembly can be acquired, the preview image is input into the dirty detection model after training, the dirty detection result of the target screen region corresponding to the camera shooting assembly is obtained, whether the target screen region is dirty or not is judged by using the dirty detection result, the reason that the user face unlocking fails can be timely prompted, and convenience of the user is improved.

The specific implementation of step 120 is described below.

In some embodiments, whether the target screen area corresponding to the camera assembly is dirty or not can be judged according to whether shadows exist in the preview image or not.

In some embodiments, in order to improve the accuracy of determining whether the target screen region corresponding to the camera assembly is dirty, step 120 includes inputting the preview image to the trained dirty detection model, and obtaining a dirty detection result of the target screen region corresponding to the camera assembly.

In the embodiment of the present application, if a contamination detection result of a target screen region corresponding to a camera module is to be obtained, a trained contamination detection model needs to be used, so that before step 110, the contamination detection model needs to be trained. In order to describe the information prompting method provided in the embodiment of the present application in detail, a specific implementation manner of the training method of the contamination detection model is described below.

In some embodiments of the present application, before step 110, the information prompting method provided in the embodiments of the present application further includes steps a to C.

And step A, acquiring a plurality of positive samples and a plurality of negative samples.

And step B, respectively inputting each positive sample and each negative sample into the pollution detection model to be trained to obtain a pollution prediction result corresponding to each positive sample and a pollution prediction result corresponding to each negative sample.

And C, training the contamination model to be trained based on the contamination prediction result corresponding to each positive sample, the label value of each positive sample, the contamination prediction result corresponding to each negative sample and the label value of each negative sample to obtain the trained contamination detection model.

The label value of the positive sample is used for representing that the target screen area is not polluted, and the label value of the negative sample is used for representing that the target screen area is polluted.

The specific implementation of steps A-C will be described in detail below.

First, a specific implementation of step a is described.

In some embodiments of the present application, a batch of preview images of a camera assembly in different scenes is collected, and each preview image is taken as a positive sample, under the condition that it is ensured that a target screen region corresponding to the camera assembly is not dirty (i.e., clean and tidy).

And under the condition that the target screen area corresponding to the camera shooting assembly is contaminated with oil stains and dust, acquiring a batch of preview images of the camera shooting assembly under different scenes, and taking each preview image as a negative sample.

In some embodiments, the format of both the positive and negative samples may be YUV format. YUV refers to a pixel format in which a luminance parameter and a chrominance parameter are separately expressed, where "Y" represents brightness, that is, a gray value; the "U" and "V" represent the chromaticity, which is used to describe the color and saturation of the image for specifying the color of the pixel.

Then, the positive sample is marked with a clean label value, that is, the positive sample is marked with a label that the target screen area corresponding to the camera assembly is not dirty. And marking a dirty label value on the negative sample, namely marking a dirty label on the target screen area on the negative sample.

In some embodiments, the smudge detection result includes a first probability that the target screen region is smudged and a second probability that the target screen region is not smudged. Wherein the sum of the first probability and the second probability is 1. In this scenario, for example, the label value of the positive sample may be 0, and the first probability for characterizing the target screen region as dirty is 0, i.e., the second probability for characterizing the target screen region as not dirty is 1. The label value of the negative sample may be 1, and the first probability for characterizing that the target screen region is dirty is 1, that is, the second probability that the target screen region is not dirty is 0.

In some embodiments, the smudge detection result includes whether the target screen area is smudged. In this scenario, for example, the label value of the positive sample may be set to 0 for indicating that the target screen region is not dirty, and the label value of the negative sample may be set to 1 for indicating that the target screen region is dirty.

The following describes a specific implementation of step B. In some embodiments, the smudge prediction result includes a first probability that the target screen region is dirty and a second probability that the target screen region is not dirty.

Then, after the positive sample or the negative sample is input into the to-be-trained dirt detection model, probability values of two categories, namely, a dirt-free (clean) target screen region corresponding to the camera module and a dirt-free target screen region corresponding to the camera module can be obtained, and the two probability values are dirt prediction results.

Wherein the sum of probability values of two categories, i.e. no dirt on the target screen area (i.e. clean) and dirt on the target screen area (i.e. dirty), is 1. For example: the probability of no contamination of the target screen area is 0.95, and the probability of contamination of the target screen area is 0.05.

In some embodiments, the smudge prediction result includes a determination of whether the target screen region is dirty. The dirty detection result may be that the target screen area is dirty or the target screen area is not dirty.

The specific implementation of step C is described below.

In some embodiments, the predetermined training condition is that the loss function value is less than a predetermined threshold.

In step C, the stain prediction result corresponding to each positive sample, the label value of each positive sample, the stain prediction result corresponding to each negative sample, and the label value of each negative sample may be substituted into a preset loss function to obtain a loss function value.

In embodiments of the present application, a Loss Function (Loss Function) may be used to estimate the gap between the results of model training and the goals of the model training.

As an example, the loss function may be a cross entropy loss function or a mean square error loss function, etc., and is not particularly limited herein.

And then, judging whether the loss function value is smaller than a first preset threshold value or not to judge whether the training needs to be stopped or not. And if the loss function value is smaller than a first preset threshold value, finishing the model training to obtain a trained dirt detection model. And if the loss function value is not less than the first preset threshold value, adjusting parameters of the contamination detection model to be trained based on the contamination prediction result corresponding to each positive sample, the label value of each positive sample, the contamination prediction result corresponding to each negative sample and the label value of each negative sample.

As an example, a back propagation algorithm may be used to calculate a gradient of each parameter in the contamination detection model to be trained with respect to the loss function value, and the gradient may be used to adjust the parameter in the contamination detection model to be trained.

After the parameters in the dirty detection model to be trained are adjusted, the dirty detection model to be trained after the parameters are adjusted is continuously trained by using the positive sample and the negative sample until a preset training condition is met, namely, until the loss function value is smaller than a first preset threshold value, and the dirty detection model after training is obtained.

In other embodiments of the present application, the predetermined training condition includes the number of iterations reaching a predetermined number threshold.

In step C, after adjusting parameters in the contamination detection model to be trained based on the contamination prediction result corresponding to the positive sample, the label value of the positive sample, the contamination prediction result corresponding to the negative sample, and the label value of the negative sample, it is determined whether the iteration number reaches a preset number threshold.

And if the iteration times reach a preset time threshold value, taking the to-be-trained contamination detection model with the parameters adjusted as the trained contamination detection model. And if the iteration times do not reach the preset time threshold, continuing to train the to-be-trained contamination detection model after the parameters are adjusted by using the positive sample and the negative sample until the iteration times reach the preset time threshold, and obtaining the trained contamination detection model.

In the embodiment of the application, the positive sample and the negative sample are sent into the to-be-trained dirt detection model for training, and in the training process, each positive sample and each negative sample have a label value, so that the to-be-trained dirt detection model can learn the image data characteristics respectively corresponding to the dirt appearing in the target screen area corresponding to the camera shooting assembly and the dirt not appearing in the target screen area corresponding to the camera shooting assembly, and the image data characteristics are stored for determining whether the target screen area corresponding to the camera shooting assembly is dirty or not based on the preview image of the camera shooting assembly.

As can be seen from the above description of the training method of the contamination detection model, in some embodiments, the contamination detection result includes a first probability that the target screen region is contaminated and a second probability that the target screen region is not contaminated.

In other embodiments, the dirty detection result may be a determination result of whether the target screen area is dirty.

In the embodiment of the application, the preview image is input into the trained dirt detection model, so that the dirt detection result of the target screen area can be quickly obtained, the condition that whether the target screen area is dirty or not is judged without manual work, the dirt judging efficiency of the target screen area is improved, and the condition that whether the target screen area is dirty or not is prompted in time can be realized.

The specific implementation of step 130 is described below.

In some embodiments, if the smudge detection result obtained based on the preview image includes a first probability that the target screen region is smudged and a second probability that the target screen region is not smudged. The preset dirty condition includes the first probability being greater than a preset probability threshold.

In the process of training the contamination detection model, the trained contamination detection model learns the image data characteristics respectively corresponding to the contamination of the target screen area corresponding to the camera shooting assembly and the non-contamination of the target screen area corresponding to the camera shooting assembly. If the target screen area corresponding to the camera shooting assembly is dirty, the preview image is input into the trained dirty detection model, the obtained first probability that the target screen area is dirty is relatively high, and the second probability that the target screen area is not dirty is relatively low.

By setting a preset probability threshold, whether the target screen area is dirty or not can be judged. In some embodiments, the preset probability threshold is 0.8.

That is to say, if the first probability in the contamination detection result is greater than the preset probability threshold, it may be determined that the target screen region corresponding to the camera shooting assembly is contaminated, and then prompt information is output to prompt a user that the target screen region is contaminated, so that the user may clean the target screen region in time.

In some embodiments of the application, the size of the first probability reflects the probability that the target screen region corresponding to the camera shooting assembly is dirty, so that whether the target screen region is dirty or not can be accurately judged by setting a preset probability threshold, and the prompting accuracy is improved.

In other embodiments, the dirty detection result may be a determination result of whether the target screen area is dirty. The preset contamination condition includes that the contamination detection result indicates that the target screen area is contaminated.

In the embodiment of the application, the dirty detection model can be used for outputting the judgment result of whether the target screen area is dirty or not, so that the efficiency of judging whether the target screen area is dirty or not is improved, and the user can be prompted whether the target screen area is dirty or not in time.

In some embodiments of the present application, step 130 includes outputting the prompt message in the target screen area in a preset output manner.

And prompting after the target screen area of the camera shooting assembly is judged to be dirty. Because the particularity of the industrial design of the camera shooting assembly, the light transmittance of the screen in front of the camera shooting assembly is higher, so that the regional coordinates of the screen made of special materials can be stored in advance, and the coordinate range is the prompt range. In some embodiments, the location of the target screen area may be prompted and prompt information may be output at the target screen area.

Fig. 2 is a schematic diagram of prompt information provided in an embodiment of the present application. The dashed box in fig. 2 is used to indicate the location of the target screen area to the user, for example, a green dashed box may be used to indicate the location of the target screen area. And a prompt message 'the target screen area is dirty, please clean the area' is displayed in the target screen area. The dashed box and reminder information is then displayed in an intermittent flashing manner for alerting the user. Fig. 2 shows the output of the prompt message in the state of the message screen.

In the embodiment of the application, the attention of the user can be attracted more easily by means of the prompt information flickering, the specific position of the dirty area is prompted, and the user can clean more pertinently.

In some embodiments, step 130 comprises: and outputting prompt information under the condition of preset output time.

As an example, the preset output time condition includes an output time period of the prompt message, and the prompt message may be output periodically according to the output time period to avoid that the prompt message is not visible to the user.

In other examples, the preset output time condition includes a maximum cue time for the cue information. As one example, the maximum cue time may be 1 minute. The preset output time condition may be preset by a user.

When the maximum prompting time is reached, the output of the prompting message is stopped until the next dirt detection period, and the

steps

110 and 120 are carried out. Wherein the contamination detection period may be preset by a user. As an example, the soil detection period is 1 day.

In other embodiments, the prompting message may be output in the form of voice, or the user may be prompted by flashing lights.

In the embodiment of the application, the detection period of the dirt detection of the target screen area can be set by a user, so that frequent output of prompt information can be avoided, the user experience is improved, and the power consumption is saved.

Fig. 3 is a schematic flow chart of an information prompting method according to another embodiment of the present application. As shown in fig. 3, as an example, the shooting prompting apparatus may be a mobile phone. And when the mobile phone starts a face unlocking function, a camera shooting assembly of the mobile phone acquires a target face image. The mobile phone can acquire a target face image acquired by the camera shooting assembly and judge whether the target face image is matched with a preset face unlocking image or not. And if the target face image is determined not to be matched with the preset face unlocking image, acquiring a preview image acquired by the camera shooting assembly again, and inputting the preview image into a pre-trained dirt detection model to judge whether the target screen area is dirty or not.

And under the condition that the target screen area is determined to be not dirty, ending the dirty detection, waiting for the coming of the next dirty detection period, and performing the dirty detection on the target screen area again. And under the condition that the target screen area is determined to be polluted, displaying a green dotted frame to prompt the position of the target screen area, displaying prompt information in the target screen area, and carrying out flicker prompt on the dotted frame and the prompt information. And if the prompt time of the prompt message reaches the maximum prompt time, stopping displaying the dotted frame and the prompt message.

It should be noted that, in the embodiment of the present application, an information prompting device executes a loading information prompting method as an example, and the information prompting method provided in the embodiment of the present application is described. In the information prompting method provided by the embodiment of the application, the execution main body may be an information prompting device, or a control module used for executing the loaded information prompting method in the information prompting device.

Fig. 4 is a schematic structural diagram of an information prompt apparatus according to an embodiment of the present application. As shown in fig. 4, the information presentation apparatus 400 includes:

and a preview image acquiring module 410, configured to acquire a preview image acquired by the camera assembly.

And a contamination detection result determining module 420, configured to obtain a contamination detection result of the target screen region corresponding to the camera component based on the preview image.

And a prompt information output module 430, configured to output a prompt information when the contamination detection result meets a preset contamination condition.

In the embodiment of the application, the dirt detection result of the target screen area corresponding to the camera shooting assembly can be obtained by utilizing the preview image acquired by the camera shooting assembly. Under the condition that the smudginess detection result meets the preset smudginess condition, the prompt information is output to prompt that the target screen area corresponding to the camera shooting assembly below the screen of the user is dirty, so that the user can timely clean the target screen area, and the convenience of using the camera shooting assembly under the screen by the user is improved. .

In some embodiments, to improve the prompt efficiency, the soil detection result determination module 420 is configured to:

and inputting the preview image into the trained dirt detection model to obtain a dirt detection result of the target screen area corresponding to the camera shooting assembly.

In some embodiments, to improve the prompt accuracy, the smudge detection result includes a first probability that the target screen region is smudged;

the preset dirty condition includes the first probability being greater than a preset probability threshold.

In some embodiments, in order to prompt the user in time, the information prompting device 400 further includes:

the target face image acquisition module is used for acquiring a target face image acquired by the camera shooting assembly;

and the matching result determining module is used for determining that the target face image is not matched with the preset face unlocking image.

In some embodiments, the hint information output module 430 is to:

and outputting prompt information in a target screen area in a preset output mode.

the sample acquisition module is used for acquiring a plurality of positive samples and a plurality of negative samples.

And the dirt prediction result determining module is used for respectively inputting each positive sample and each negative sample into the dirt detection model to be trained to obtain a dirt prediction result corresponding to each positive sample and a dirt prediction result corresponding to each negative sample.

And the training module is used for training the contamination model to be trained based on the contamination prediction result corresponding to each positive sample, the label value of each positive sample, the contamination prediction result corresponding to each negative sample and the label value of each negative sample to obtain the trained contamination detection model.

The information prompting device in the embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in the device. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a kiosk, and the like, and the embodiments of the present application are not particularly limited.

The information prompting device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The information prompting device provided in the embodiment of the application can implement each process implemented by the information prompting device in the method embodiments of fig. 1 to fig. 3, and is not described here again to avoid repetition.

Optionally, an embodiment of the present application further provides an electronic device, which includes a processor, a memory, and a program or an instruction stored in the memory and capable of being executed on the processor, where the program or the instruction is executed by the processor to implement each process of the above-mentioned information prompting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and the non-mobile electronic devices described above.

Fig. 5 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application. The electronic device 500 includes, but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a camera module 511.

Those skilled in the art will appreciate that the electronic device 500 may further include a power supply (e.g., a battery) for supplying power to various components, and the power supply may be logically connected to the processor 510 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 5 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The camera module 511 is used for capturing a preview image.

The processor 510 is configured to obtain a preview image acquired by the camera assembly; based on the preview image, obtaining a dirt detection result of a target screen area corresponding to the camera shooting assembly; and outputting prompt information under the condition that the dirt detection result meets a preset dirt condition.

Optionally, the display unit 506 is used for displaying the prompt information output by the processor 510.

Optionally, the audio output unit 503 is configured to output the prompt information output by the processor 510.

Optionally, the processor 510 is further configured to input the preview image to the trained contamination detection model, so as to obtain a contamination detection result of the target screen region corresponding to the camera assembly.

The dirty detection result is obtained by using the trained dirty detection model, so that the efficiency of obtaining the dirty detection result can be improved.

Optionally, the camera module 511 is further configured to capture a target face image.

The processor 510 is further configured to obtain a target face image acquired by the camera module 511; and determining that the target face image is not matched with the preset face unlocking image.

Optionally, the display unit 506 is configured to output the prompt information in the target screen area in a preset output manner.

In the embodiment of the application, the attention of the user can be more easily attracted through the preset output mode, the specific position of the dirty area is prompted, and the user can clean more pertinently.

A processor 510 further configured to obtain a plurality of positive samples and a plurality of negative samples; respectively inputting each positive sample and each negative sample into a dirt detection model to be trained to obtain a dirt prediction result corresponding to each positive sample and a dirt prediction result corresponding to each negative sample; training a to-be-trained dirt model based on the dirt prediction result corresponding to each positive sample, the label value of each positive sample, the dirt prediction result corresponding to each negative sample and the label value of each negative sample until preset training conditions are met, and obtaining a trained dirt detection model; the label value of the positive sample is used for representing that the target screen area is not polluted, and the label value of the negative sample is used for representing that the target screen area is polluted.

In the embodiment of the application, the dirty detection result can be rapidly obtained by training the dirty detection model, so that the user can be timely prompted that the target screen area of the user is dirty.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the above-mentioned information prompting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device in the above embodiment. Readable storage media, including computer-readable storage media, such as Read-Only Memory (ROM), random-access Memory (RAM), magnetic or optical disks, etc.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the above-mentioned information prompting method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. An information prompting method is applied to electronic equipment, the electronic equipment comprises a screen and a camera assembly positioned below the screen, and the method is characterized by comprising the following steps:

acquiring a preview image acquired by the camera shooting assembly;

acquiring a dirt detection result of a target screen area corresponding to the camera shooting assembly based on the preview image;

2. The method according to claim 1, wherein obtaining a contamination detection result of a target screen region corresponding to the camera assembly based on the preview image comprises:

and inputting the preview image into the trained dirt detection model to obtain a dirt detection result of a target screen area corresponding to the camera shooting assembly.

3. The method of claim 2, wherein the smudge detection result comprises a first probability that the target screen region is smudged;

4. The method of claim 1, wherein prior to acquiring the preview image captured by the camera assembly, the method further comprises:

acquiring a target face image acquired by the camera shooting assembly;

and under the condition that the target face image is not matched with a preset face unlocking image, executing the step of acquiring the preview image acquired by the camera shooting assembly.

5. The method of claim 1, wherein outputting the prompt message comprises:

and outputting the prompt information in the target screen area in a preset output mode.

6. An information prompting device is applied to electronic equipment, the electronic equipment comprises a screen and a camera shooting assembly positioned below the screen, and the device is characterized by comprising:

and the prompt information output module is used for outputting prompt information under the condition that the dirt detection result meets a preset dirt condition.

7. The apparatus of claim 6, wherein the contamination detection result determination module is configured to:

8. The apparatus of claim 7, wherein the smudge detection result comprises a first probability that the target screen region is smudged;

9. The apparatus of claim 6, further comprising:

and the matching result determining module is used for determining that the target face image is not matched with a preset face unlocking image.

10. The apparatus of claim 6, wherein the hint information output module is configured to:

11. An electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the information presentation method as claimed in any one of claims 1 to 5.