CN116361761A - Information shielding method, information shielding device and electronic equipment - Google Patents
Information shielding method, information shielding device and electronic equipment Download PDFInfo
- Publication number
- CN116361761A CN116361761A CN202111619557.XA CN202111619557A CN116361761A CN 116361761 A CN116361761 A CN 116361761A CN 202111619557 A CN202111619557 A CN 202111619557A CN 116361761 A CN116361761 A CN 116361761A
- Authority
- CN
- China
- Prior art keywords
- scene image
- objects
- display screen
- feature
- condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/70—Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
- G06F21/82—Protecting input, output or interconnection devices
- G06F21/84—Protecting input, output or interconnection devices output devices, e.g. displays or monitors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the application discloses an information shielding method, which comprises the following steps: controlling an image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at first power; wherein the first scene image has a first resolution; if the characteristics of the object in the first scene image meet the first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution; and if the characteristics of the objects in the second scene image meet the second characteristic conditions, shielding the display content in the display screen. The embodiment of the application also discloses an information shielding device, electronic equipment and a storage medium.
Description
Technical Field
The present application relates to, but not limited to, the field of image capturing, and in particular, to an information shielding method, an information shielding apparatus, an electronic device, and a storage medium.
Background
At present, with the popularization of electronic devices such as smartphones, tablet computers and point of sale (POS) and the ubiquitous application of the mobile internet, but at the same time, the problem of information security is more important, especially when people use the electronic devices, people can easily see the screen of the electronic devices so as to obtain sensitive information of users, such as chat records, account passwords or unlocking passwords, and if the sensitive information is utilized by lawbreakers, the users are lost. In the related art, the method of information shielding is to prevent personal information from being peeped and acquired by a third person through a screen of the electronic device by physical means, namely, attaching a peeping-preventing protective film on the screen of the electronic device. However, this method has at least the problems of high cost, poor touch sensing and high power consumption.
Content of the application
The embodiment of the application expects to provide an information shielding method, an information shielding device, electronic equipment and a storage medium, and solves the problems of high cost, poor touch induction and high power consumption in the related technology.
The technical scheme of the application is realized as follows:
an information shielding method, the method comprising:
controlling an image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at first power; wherein the first scene image has a first resolution;
if the characteristics of the object in the first scene image meet a first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
and if the characteristics of the objects in the second scene image meet a second characteristic condition, shielding the display content in the display screen.
An information shielding apparatus, the information shielding apparatus comprising:
the control module is used for controlling the image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at the first power; wherein the first scene image has a first resolution;
The control module is further configured to control the image acquisition module to acquire a second scene image including the object at a second power greater than the first power if the feature of the object in the first scene image satisfies a first feature condition; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
and the processing module is used for shielding the display content in the display screen if the characteristics of the object in the second scene image meet the second characteristic condition.
An electronic device, the electronic device comprising: a processor, a memory, and a communication bus;
the communication bus is used for realizing communication connection between the processor and the memory;
the processor is configured to execute the information masking program stored in the memory, so as to implement the steps of the information masking method described above.
A storage medium storing one or more programs executable by one or more processors to implement the steps of the information masking method described above.
According to the information shielding method, the information shielding device, the electronic equipment and the storage medium, at least one frame of first scene image on the side where the display screen is located is acquired by controlling the image acquisition module of the electronic equipment with first power; wherein the first scene image has a first resolution; if the characteristics of the object in the first scene image meet the first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution; if the characteristics of the objects in the second scene image meet the second characteristic conditions, shielding the display content in the display screen; that is, under the condition that the image acquisition module of the electronic device acquires the first scene image with the first resolution under the first power, the peeping scene is primarily judged, the image acquisition module is controlled to acquire the second scene image with the second resolution under the second power, the accurate judgment is performed, namely, if the characteristics of the object in the second scene image meet the second characteristic condition, the display content is shielded; therefore, the problem of poor touch induction caused by using the peep-proof film is avoided, the problem of sensitive information leakage of a user in the using process is solved, and meanwhile, the cost is reduced, and the power consumption of the electronic equipment is reduced.
Drawings
FIG. 1 is a schematic flow chart of an alternative information shielding method according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of an alternative method for shielding information according to an embodiment of the present application;
FIG. 3 is a schematic flow chart of an alternative information shielding method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an information shielding device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail with reference to the accompanying drawings, and the described embodiments should not be construed as limiting the present application, and all other embodiments obtained by those skilled in the art without making any inventive effort are within the scope of the present application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is to be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with one another without conflict.
In the following description, the terms "first", "second", "third" and the like are merely used to distinguish similar objects and do not represent a specific ordering of the objects, it being understood that the "first", "second", "third" may be interchanged with a specific order or sequence, as permitted, to enable embodiments of the application described herein to be practiced otherwise than as illustrated or described herein.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the present application.
An embodiment of the present application provides an information shielding method, applied to an electronic device, and referring to fig. 1, the method includes the following steps:
and step 101, controlling an image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located by using first power.
Wherein the first scene image has a first resolution.
In this embodiment of the present application, the first power is smaller than a first power threshold, which may be understood as a power critical value when the image acquisition module operates in a low power consumption mode.
In the embodiment of the application, the first scene image is an image of the side where the image acquisition module acquires the display screen with first power. Here, the first scene image is an image whose distance from the display screen is within a preset distance range. Here, the size of the first scene image is smaller than the size threshold, and the size of the first scene image may be 160×120 pixels, for example.
In this embodiment of the present application, the image capturing module captures at least one frame of the first scene image on the side where the display screen is located with the first power, which may be understood as capturing at least one frame of the first scene image on the side where the display screen is located when the image capturing module operates in the low power consumption mode. Here, the image capturing module of the low power mode is configured with a first frame rate and a first resolution. The frame rate is a frequency at which bitmap images in frames continuously appear on the display, where the first frame rate may be any one of 1 to 5 transmission frame numbers per second (Frames Per Second, fps), and the first frame rate may be 1fps, for example. The first resolution may be understood as the amount of information stored in the acquired scene image, i.e. how many Pixels are within the scene image Per Inch, the resolution being in Pixels Per Inch (PPI). The first resolution is also called first image resolution; it should be noted that, changing the resolution of the configuration of the image acquisition module can change the definition of the image acquired by the image acquisition module; the frame rate configured for the image acquisition module is changed, so that the number of images acquired by the image acquisition module per second can be changed.
In this embodiment of the present application, the image capturing module is an image or video input device, and the image capturing module may be a front camera of an electronic device, or may be a camera module of a display screen of the electronic device, such as a monitoring camera, where the camera, and the like of other electronic devices may capture a device lens, where the camera is located in front of the display screen.
In other embodiments of the present application, the electronic device may further configure, in a front-end image processing chip of the electronic device, a frame rate and a resolution when the image capturing module captures images in different modes, where the different modes include a low power consumption mode and a high definition mode, that is, a high power consumption mode, and the frame rate and the resolution configured in the different modes of the image capturing module are different.
In practical applications, the electronic devices may include electronic device devices such as mobile phones, tablet computers, notebook computers, personal digital assistants (Personal Digital Assistant, PDA), cameras, wearable devices, and fixed terminal devices such as desktop computers.
In the embodiment of the application, under the condition that the electronic equipment determines that the image acquisition module operates at the first power, the image acquisition module is controlled to acquire at least one frame of first scene image on the side where the display screen is located at the first power, and the first scene image has the first resolution.
In other embodiments of the present application, after the electronic device obtains the first scene image, the noise reduction module in the image signal processing (Image Signal Processing, ISP) may perform noise reduction processing on the first scene image, and process the first scene image into a gray scale map, and further process the gray scale map.
Wherein the second scene image has a second resolution, the second resolution being greater than the first resolution.
In this embodiment, the feature of the object in the first scene image satisfies a first feature condition, including at least one of: the number of objects satisfies a number increase condition, the number of objects is greater than or equal to a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold.
In this embodiment of the present application, the second power is greater than the second power threshold, which may be understood as a power threshold when the image acquisition module operates in a high-definition mode, i.e. a high-power mode, and the second power threshold is greater than the first power threshold.
In the embodiment of the application, the second scene image is an image of the side where the image acquisition module acquires the display screen with the second power.
In this embodiment of the present application, the image acquisition module acquires the second scene image including the object with the second power that is greater than the first power, which can be understood as the second scene image on the side where the acquisition display screen is located when the image acquisition module operates in the high-definition mode, that is, the high-power mode. Here, the image capturing module in the high definition mode is configured with a second frame rate and a second resolution, and the second frame rate is greater than the first frame rate, and the second resolution is greater than the first resolution. The frame rate is a frequency at which bitmap images in units of frames continuously appear on the display, where the second frame rate may be any one of 13 to 20 fps.
In this embodiment of the present application, when the image acquisition module of the electronic device for controlling the electronic device acquires at least one frame of the first scene image on the side where the display screen is located with the first power, it is determined whether the feature of the object in the first scene meets the first feature condition, where the feature of the object in the first scene image meets the first feature condition, including at least one of the following: the number of objects satisfies a number increase condition, the number of objects is greater than or equal to a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold. If the electronic device determines that the feature of the object in the first scene image meets the first feature condition, further, the electronic device modifies a configuration parameter of the image acquisition module, wherein the configuration parameter comprises the running power of the image acquisition module, and the frame rate and the resolution when the image acquisition module acquires the image, namely, modifying the first power into a second power which is larger than the first power, modifying the first frame rate into a second frame rate which is larger than the first frame rate, and modifying the first resolution into a second resolution which is larger than the first resolution. Then, the electronic device controls the image acquisition module to acquire a second scene image including the object at a second power.
And 103, if the characteristics of the objects in the second scene image meet the second characteristic conditions, shielding the display content in the display screen.
In the embodiment of the application, the feature of the object in the second scene image meets the second feature condition, which includes that the face feature of the object in the second scene image is not matched with the reference face feature in the face feature library; or the face features of the target object in the second scene image are matched with the reference face features in the face feature library, and the sight angle of the eyes of the rest objects different from the target object in the objects, which watch the display screen, is within the sight angle threshold range.
In this embodiment of the present application, the display content in the display screen may be the displayed content of a target application (App), such as the content of an application program such as a payment device, a WeChat, a mailbox, an album, an address book, and the like; the display content in the display screen can also be content needing confidentiality, such as content containing account, password and other information; the display content in the display screen may also be user-specified content. The target application or the content to be kept secret may be preset by the terminal or may be set by the user. For example, the user may set application programs such as payment treasures, weChat, address book and the like as target application programs; the content comprising the password input window can be set as display content, and the user can set account number, password and other information as the content needing confidentiality. In this regard, the present application is not particularly limited.
In this embodiment of the present application, the shielding processing is performed on the display content in the display screen, including at least one of the following: lowering the display brightness of the display screen; blurring processing the display content; controlling the display screen to display the display content in a polarized mode; switching to a screen locking interface; covering a display area for displaying the content with the solid color patch; and replacing the display content with the preset characters and displaying.
The blurring processing of the display content refers to performing an atomization processing on the display content or drastically reducing the resolution of the display content, so that the human eyes cannot see the display content clearly.
The display after replacing the display content with the preset character refers to the display after replacing the display content with the preset common character or the display after converting the display content into the messy code.
The control of the display screen to display the display content in the polarization mode means that the object looking at the display screen from the side cannot see the display content displayed by the display screen without affecting the viewing experience of the object looking at the display screen from the front.
In one possible application scenario, when the number of objects in the first scene image acquired by the electronic device meets a number increasing condition, or the number of objects in the first scene image acquired by the electronic device is greater than a number threshold, the electronic device can directly mask display content in the display screen; the electronic device may also control the image acquisition module to acquire a second scene image including the object at a second power greater than the first power in response to the operation of the user, so as to accurately identify the object in the second scene image, and mask the display content in the display screen when it is determined that the feature of the object in the second scene image satisfies the second feature condition.
In one possible application scenario, when the number of objects in the first scene image acquired by the electronic device is equal to the number threshold, the electronic device may directly display the display content in the display screen; the electronic device may further control the image acquisition module to acquire a second scene image including the object at a second power greater than the first power in response to an operation of the user, so as to accurately identify the object in the second scene image, perform shielding processing on display content in the display screen when it is determined that the feature of the object in the second scene image meets the second feature condition, or normally display the display content in the display screen when it is determined that the feature of the object in the second scene image does not meet the second feature condition.
In one possible application scenario, when the number of objects in a first scene image acquired by an electronic device is greater than a number threshold, an orientation angle between a face orientation of the object and a display screen is within an orientation angle threshold, the electronic device controls an image acquisition module to acquire a second scene image including the object at a second power greater than the first power, so as to accurately identify the object in the second scene image, and when it is determined that the feature of the object in the second scene image meets a second feature condition, the display content in the display screen is shielded, or when it is determined that the feature of the object in the second scene image does not meet the second feature condition, the display content in the display screen is displayed normally.
According to the information shielding method provided by the embodiment of the application, at least one frame of first scene image on the side where the display screen is located is acquired by controlling the image acquisition module of the electronic equipment with first power; wherein the first scene image has a first resolution; if the characteristics of the object in the first scene image meet the first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution; if the characteristics of the objects in the second scene image meet the second characteristic conditions, shielding the display content in the display screen; that is, under the condition that the image acquisition module of the electronic device acquires the first scene image with the first resolution under the first power, the peeping scene is primarily judged, the image acquisition module is controlled to acquire the second scene image with the second resolution under the second power, the accurate judgment is performed, namely, if the characteristics of the object in the second scene image meet the second characteristic condition, the display content is shielded; therefore, the problem of poor touch induction caused by using the peep-proof film is avoided, the problem of sensitive information leakage of a user in the using process is solved, and meanwhile, the cost is reduced, and the power consumption of the electronic equipment is reduced.
The embodiment of the application provides an information shielding method, which is applied to electronic equipment, and is shown with reference to fig. 2, and the method comprises steps 201 to 205 and 209; or steps 201 to 204, 206 to 209; or steps 201 to 202, 210:
Wherein the first scene image has a first resolution.
Wherein the second scene image has a second resolution, the second resolution being greater than the first resolution.
In this embodiment, the feature of the object in the first scene image satisfies a first feature condition, including at least one of: the number of objects satisfies a number increase condition, the number of objects is greater than or equal to a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold.
In the embodiment of the application, the face feature may be understood as face information capable of representing the object. Here, the face features may be represented in a vector form, or the face features may be represented in a matrix form, which is not particularly limited in this application.
In other embodiments of the present application, acquiring the face features of the object includes extracting depth features of the object.
In the embodiment of the application, the depth features of the object are used for representing the global characteristics of the face region, and the electronic device can identify the face according to the depth features of the face.
Here, the depth feature of the face of the object may be extracted by obtaining the depth feature through a trained depth neural network, and as an example, the face of the object is input to the trained depth neural network to obtain a vector of a convolution layer or a full connection layer, and the vector is used as the depth feature of the face of the object.
And 204, matching the face features with the reference face features stored in the face feature library to perform face recognition so as to obtain a recognition result.
In the embodiment of the application, the identification result includes that the face feature is not matched with the reference face feature, and the face feature is matched with the reference face feature.
In the embodiment of the application, the electronic device controls the image acquisition module of the electronic device to acquire at least one frame of first scene image on the side where the display screen is located with first power, if the characteristics of the object in the first scene image meet a first characteristic condition, the image acquisition module is controlled to acquire a second scene image comprising the object with second power larger than the first power, after the face characteristics of the object are acquired, the face characteristics are matched with the reference face characteristics stored in the face characteristic library, so that face recognition is performed, and a recognition result is obtained.
Wherein the feature of the object in the first scene image satisfying the first feature condition comprises the number of objects being equal to a number threshold.
In this embodiment of the present application, when the electronic device obtains the number of objects in the first scene image, if it is determined that the number of objects is equal to the number threshold, for example, 1, the image acquisition module is controlled to acquire a second scene image including the objects with a second power greater than the first power, and obtain face features of the objects in the second scene image. Further, the electronic device matches the face features with the reference face features stored in the face feature library to perform face recognition, and a recognition result is obtained. If the identification result represents that the face feature is not matched with the reference face feature, namely the object is not the object trusted by the electronic equipment, determining that the feature of the object meets a second feature condition, and shielding the display content in the display screen.
Wherein the features of the objects in the first scene image satisfy a first feature condition comprising at least one of: the number of objects satisfies a number increase condition, the number of objects is greater than a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold.
In this embodiment, when the electronic device obtains the number of objects in the first scene image, if the number of objects in the first scene images of two adjacent frames increases, or if the number of objects is greater than a number threshold, such as 1, and the orientation angle between the face orientation of the object and the display screen is within the orientation angle threshold, the image acquisition module is controlled to acquire a second scene image including the object at a second power greater than the first power, and acquire the face feature of the object in the second scene image. Further, the electronic device matches the face features with the reference face features stored in the face feature library to perform face recognition, and a recognition result is obtained. If the identification result represents that the face features matched with the reference face features exist, determining that the object corresponding to the face features matched with the face features in the object is a target object.
And step 208, if the sight line angle is within the sight line angle threshold range, determining that the characteristics of the remaining objects meet the second characteristic condition, and shielding the display content in the display screen.
In this embodiment of the present invention, if the identification result indicates that there is a face feature matching with the reference face feature, after the electronic device determines that an object corresponding to the face feature matching with the face feature in the object is a target object, the electronic device obtains a line of sight angle of a human eye of a remaining object different from the target object in the object, which gazes at the display screen, and determines whether the line of sight angle of each remaining object is within a line of sight angle threshold range, if at least one line of sight angle is within the line of sight angle threshold range, it is determined that the feature of at least one remaining object meets a second feature condition, and at this time, the electronic device performs shielding processing on display content in the display screen. If the sight angles of all the remaining objects are not in the sight angle threshold range, determining that the characteristics of the remaining objects do not meet the second characteristic condition, and at the moment, the electronic equipment normally displays the display content in the display screen.
In this embodiment, the at least one prompting mode includes, but is not limited to, voice prompting, vibration prompting, screen message prompting, and the like.
In this embodiment of the present application, after performing a shielding process on a display content in a display screen, an electronic device generates a prompt message for prompting that a peeping behavior exists, and outputs the prompt message in at least one of a voice prompt, a vibration prompt, and a screen message prompt. Therefore, the problem of poor touch induction caused by using the peep-proof film is avoided, the problem of sensitive information leakage of a user in the using process is solved, and meanwhile, the cost is reduced, and the power consumption of the electronic equipment is reduced.
In the embodiment of the application, if the characteristics of the object in the first scene image meet the first characteristic condition, the electronic device controls the image acquisition module to acquire a second scene image comprising the object with a second power larger than the first power, and if the characteristics of the object in the second scene image do not meet the second characteristic condition, it is determined that the display content of the display screen does not meet the shielding condition, and the image acquisition module is controlled to continuously acquire a third scene image on the side where the display screen is located with the first power; that is, the electronic device modifies the configuration parameters of the image capturing module, where the configuration parameters include the power of operation of the image capturing module, and the frame rate and resolution of the image capturing module when capturing the image, i.e., re-modifying the second power to the first power, re-modifying the second frame rate to the first frame rate, and re-modifying the second resolution to the first resolution. Then, the electronic equipment controls the image acquisition module to acquire a third scene image comprising the object at the first power, and continuously judges whether the characteristics of the object in the third scene image meet the first characteristic condition or not so as to judge whether to carry out shielding processing on the display content or not based on the condition. And after determining that the characteristics of the object do not meet the second characteristic conditions, resetting configuration parameters of the image acquisition module so as to enable the electronic equipment to enter a low-power consumption mode, and controlling the image acquisition module to continuously acquire the scene images.
It should be noted that, in this embodiment, the descriptions of the same steps and the same content as those in other embodiments may refer to the descriptions in other embodiments, and are not repeated here.
The application further describes an information shielding method provided by an embodiment of the application, which is applied to an electronic device, and is shown with reference to fig. 3, and the method includes the following steps:
In this embodiment, if the electronic device determines that the operating state of the display screen is not the use state, step 303 is executed; if the electronic device determines that the operating state of the display screen is a use state, step 304 is executed.
Here, the sensor may be an infrared sensor.
In the embodiment of the present application, if the electronic device determines, through the sensor, that there is no user gaze on the side where the display screen is located, step 301 is executed; if the electronic device determines, through the sensor, that the side where the display screen is located has the user's gaze, it determines that there is a risk of peeping, and step 307 is executed.
Wherein the first scene image has a first resolution.
Here, the first scene image is an image whose distance from the display screen is within a preset distance range.
In the embodiment of the present application, the number threshold may be 1; when the electronic device determines that the number of faces or the number of heads of the user in the first scene image is greater than the number threshold, determining that there is a peeping risk, and executing step 307; when the electronic device determines that the number of faces or the number of heads of the user in the first scene image is not greater than the number threshold, step 306 is performed.
Here, the electronic device identifies the user in the first scene image by a built-in algorithm or by a pre-processing chip software layer identification model.
In other embodiments of the present application, if the number of faces or the number of heads of the user in the first scene image is smaller than the number threshold, judging whether to set the sensitive information to be displayed in the unmanned state, and if the sensitive information to be displayed in the unmanned state is set, normally displaying the sensitive information on the display screen by the electronic device; and if the sensitive information is not displayed in the unmanned state, the electronic equipment performs shielding processing on the sensitive information on the display screen.
In other embodiments of the present application, if the number of faces or the number of heads of the user in the first scene image is greater than a number threshold, such as 1, and the orientation angle between the face orientation of the user and the display screen is not within the orientation angle threshold, it is determined that there is no peeping risk.
In this embodiment, if the number of faces or the number of heads of the user in the first scene image is equal to the number threshold, for example, 1, then determining whether user identification is required, if yes, controlling the image acquisition module to acquire a second scene image including the object with a second power greater than the first power, identifying the faces in the second scene image, determining whether the user is the user, if yes, executing step 301; if it is determined that the user is not himself, it is determined that there is a peeping action, and step 307 is executed.
In other embodiments of the present application, the electronic device may further identify a line of sight of a third party eye in the second scene image, so as to obtain a line of sight angle of the third party eye, and determine that peeping behavior exists if the line of sight angle is within an angle threshold.
In other embodiments of the present application, if the voice sensor of the electronic device receives the sensitive vocabulary, face recognition is performed on the user, and whether the user is himself or herself is judged, if so, the sensitive information is displayed normally; if not, shielding the sensitive information on the display screen.
From the above, in the embodiment of the present application, the problem of poor touch sensing caused by using the peep-proof film is avoided, the problem of sensitive information leakage of the user in the use process is solved, and meanwhile, the cost is reduced, and the power consumption of the electronic device is reduced.
An embodiment of the present application provides an information shielding device, which may be applied to an information shielding method provided in an embodiment corresponding to fig. 1 to 2, and referring to fig. 4, the information shielding device 4 includes:
the control module 401 is used for controlling the image acquisition module of the electronic device to acquire at least one frame of first scene image on the side where the display screen is located at a first power; wherein the first scene image has a first resolution;
the control module 401 is further configured to control the image acquisition module to acquire a second scene image including the object at a second power greater than the first power if the feature of the object in the first scene image satisfies the first feature condition; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
And the processing module 402 is configured to mask the display content in the display screen if the feature of the object in the second scene image meets the second feature condition.
In other embodiments of the present application, the features of the objects in the first scene image satisfy a first feature condition, comprising at least one of: the number of objects satisfies a number increase condition, the number of objects is greater than or equal to a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold.
In other embodiments of the present application, the processing module 402 is further configured to obtain a face feature of the object; and matching the face features with the reference face features stored in the face feature library to perform face recognition so as to obtain a recognition result.
In other embodiments of the present application, the processing module 402 is further configured to determine that the feature of the object meets the second feature condition if the face feature represented by the recognition result does not match the reference face feature; wherein the feature of the object in the first scene image satisfying the first feature condition comprises the number of objects being equal to a number threshold.
In other embodiments of the present application, the processing module 402 is further configured to determine, if the identification result indicates that there is a face feature matching with the reference face feature, that an object corresponding to the face feature matching with the face feature in the objects is a target object; wherein the features of the objects in the first scene image satisfy a first feature condition comprising at least one of: the number of the objects meets the number increasing condition, the number of the objects is larger than the number threshold, and the orientation angle between the face orientation of the objects and the display screen is within the orientation angle threshold under the condition that the number of the objects is larger than the number threshold; obtaining the eye gaze angle of the human eyes of the residual objects different from the target object in the objects; and if the sight line angle is within the sight line angle threshold range, determining that the characteristics of the rest objects meet the second characteristic condition.
In other embodiments of the present application, the processing module 402 is further configured to determine that the display content of the display screen does not meet the shielding condition if the feature of the object in the second scene image does not meet the second feature condition, and control the image acquisition module to continuously acquire the third scene image on the side where the display screen is located with the first power.
In other embodiments of the present application, the masking processing is performed on the display content in the display screen, including at least one of the following: lowering the display brightness of the display screen; blurring processing the display content; controlling the display screen to display the display content in a polarized mode; switching to a screen locking interface; covering a display area for displaying the content with the solid color patch; and replacing the display content with the preset characters and displaying.
In other embodiments of the present application, the processing module 402 is further configured to generate a prompt message for prompting that peeking behavior exists; outputting the prompt information in at least one prompt mode.
It should be noted that, in this embodiment, the descriptions of the same steps and the same content as those in other embodiments may refer to the descriptions in other embodiments, and are not repeated here.
An embodiment of the present application provides an electronic device, which may be applied to an information shielding method provided in an embodiment corresponding to fig. 1 to 2, referring to fig. 5, the electronic device 5 (the electronic device 5 in fig. 5 corresponds to the information shielding apparatus 4 in fig. 4) includes: a processor 501, a memory 502, and a communication bus 503, wherein:
A communication bus 503 is used to enable a communication connection between the processor 501 and the memory 502.
The processor 501 is configured to execute the information mask program stored in the memory 502 to implement the following steps:
controlling an image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at first power; wherein the first scene image has a first resolution;
if the characteristics of the object in the first scene image meet the first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
and if the characteristics of the objects in the second scene image meet the second characteristic conditions, shielding the display content in the display screen.
In other embodiments of the present application, the features of the objects in the first scene image satisfy a first feature condition, comprising at least one of: the number of objects satisfies a number increase condition, the number of objects is greater than or equal to a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold.
In other embodiments of the present application, the processor 501 is configured to execute the information mask program stored in the memory 502 to implement the following steps:
acquiring face characteristics of an object; and matching the face features with the reference face features stored in the face feature library to perform face recognition so as to obtain a recognition result.
In other embodiments of the present application, the processor 501 is configured to execute the information mask program stored in the memory 502 to implement the following steps:
if the identification result represents that the face features are not matched with the reference face features, determining that the features of the object meet a second feature condition; wherein the feature of the object in the first scene image satisfying the first feature condition comprises the number of objects being equal to a number threshold.
In other embodiments of the present application, the processor 501 is configured to execute the information mask program stored in the memory 502 to implement the following steps:
if the identification result represents that the face features matched with the reference face features exist, determining an object corresponding to the face features matched with the face features in the object as a target object; wherein the features of the objects in the first scene image satisfy a first feature condition comprising at least one of: the number of the objects meets the number increasing condition, the number of the objects is larger than the number threshold, and the orientation angle between the face orientation of the objects and the display screen is within the orientation angle threshold under the condition that the number of the objects is larger than the number threshold; obtaining the eye gaze angle of the human eyes of the residual objects different from the target object in the objects; and if the sight line angle is within the sight line angle threshold range, determining that the characteristics of the rest objects meet the second characteristic condition.
In other embodiments of the present application, the processor 501 is configured to execute the information mask program stored in the memory 502 to implement the following steps:
if the characteristics of the objects in the second scene image do not meet the second characteristic conditions, determining that the display content of the display screen does not meet the shielding conditions, and controlling the image acquisition module to continuously acquire a third scene image on the side where the display screen is located at the first power.
In other embodiments of the present application, the masking processing is performed on the display content in the display screen, including at least one of the following: lowering the display brightness of the display screen; blurring processing the display content; controlling the display screen to display the display content in a polarized mode; switching to a screen locking interface; covering a display area for displaying the content with the solid color patch; and replacing the display content with the preset characters and displaying.
In other embodiments of the present application, the processor 501 is configured to execute the information mask program stored in the memory 502 to implement the following steps:
generating prompt information for prompting the existence of peeping behaviors; outputting the prompt information in at least one prompt mode.
By way of example, the processor 501 may be an integrated circuit chip having signal processing capabilities such as a general purpose processor, such as a microprocessor or any conventional processor, a digital signal processor (DSP, digital Signal Processor), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like.
It should be noted that, in the specific implementation process of the steps executed by the processor in this embodiment, reference may be made to the implementation process in the information shielding method provided in the embodiment corresponding to fig. 1 to 2, which is not described herein again.
Embodiments of the present application provide a computer-readable storage medium storing one or more programs executable by one or more processors to implement the steps of:
controlling an image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at first power; wherein the first scene image has a first resolution;
if the characteristics of the object in the first scene image meet the first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
and if the characteristics of the objects in the second scene image meet the second characteristic conditions, shielding the display content in the display screen.
In other embodiments of the present application, the features of the objects in the first scene image satisfy a first feature condition, comprising at least one of: the number of objects satisfies a number increase condition, the number of objects is greater than or equal to a number threshold, and an orientation angle between a face orientation of the object and the display screen is within an orientation angle threshold under the condition that the number of objects is greater than the number threshold.
In other embodiments of the present application, the one or more programs may be executed by one or more processors, and the following steps may also be implemented:
acquiring face characteristics of an object; and matching the face features with the reference face features stored in the face feature library to perform face recognition so as to obtain a recognition result.
In other embodiments of the present application, the one or more programs may be executed by one or more processors, and the following steps may also be implemented:
if the identification result represents that the face features are not matched with the reference face features, determining that the features of the object meet a second feature condition; wherein the feature of the object in the first scene image satisfying the first feature condition comprises the number of objects being equal to a number threshold.
In other embodiments of the present application, the one or more programs may be executed by one or more processors, and the following steps may also be implemented:
if the identification result represents that the face features matched with the reference face features exist, determining an object corresponding to the face features matched with the face features in the object as a target object; wherein the features of the objects in the first scene image satisfy a first feature condition comprising at least one of: the number of the objects meets the number increasing condition, the number of the objects is larger than the number threshold, and the orientation angle between the face orientation of the objects and the display screen is within the orientation angle threshold under the condition that the number of the objects is larger than the number threshold; obtaining the eye gaze angle of the human eyes of the residual objects different from the target object in the objects; and if the sight line angle is within the sight line angle threshold range, determining that the characteristics of the rest objects meet the second characteristic condition.
In other embodiments of the present application, the one or more programs may be executed by one or more processors, and the following steps may also be implemented:
if the characteristics of the objects in the second scene image do not meet the second characteristic conditions, determining that the display content of the display screen does not meet the shielding conditions, and controlling the image acquisition module to continuously acquire a third scene image on the side where the display screen is located at the first power.
In other embodiments of the present application, the masking processing is performed on the display content in the display screen, including at least one of the following: lowering the display brightness of the display screen; blurring processing the display content; controlling the display screen to display the display content in a polarized mode; switching to a screen locking interface; covering a display area for displaying the content with the solid color patch; and replacing the display content with the preset characters and displaying.
In other embodiments of the present application, the one or more programs may be executed by one or more processors, and the following steps may also be implemented:
generating prompt information for prompting the existence of peeping behaviors; outputting the prompt information in at least one prompt mode.
It should be noted that, in the specific implementation process of the steps executed by the processor in this embodiment, reference may be made to the implementation process in the information shielding method provided in the embodiment corresponding to fig. 1 to 2, which is not described herein again.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, magnetic disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing description is only of the preferred embodiments of the present application and is not intended to limit the scope of the present application.
Claims (10)
1. An information shielding method, the method comprising:
controlling an image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at first power; wherein the first scene image has a first resolution;
If the characteristics of the object in the first scene image meet a first characteristic condition, controlling the image acquisition module to acquire a second scene image comprising the object at a second power which is larger than the first power; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
and if the characteristics of the objects in the second scene image meet a second characteristic condition, shielding the display content in the display screen.
2. The method of claim 1, wherein the characteristics of the objects in the first scene image satisfy a first characteristic condition, comprising at least one of: the number of the objects satisfies a number increasing condition, the number of the objects is greater than or equal to the number threshold, and the orientation angle between the face orientation of the objects and the display screen is within an orientation angle threshold under the condition that the number of the objects is greater than the number threshold.
3. The method of claim 1 or 2, wherein after the controlling the image acquisition module to acquire a second scene image comprising the object at a second power that is greater than the first power, the method comprises:
Acquiring the face characteristics of the object;
and matching the face features with the reference face features stored in the face feature library to perform face recognition so as to obtain a recognition result.
4. A method according to claim 3, wherein the matching the face features with the reference face features stored in the face feature library is performed to perform face recognition, and after obtaining the recognition result, the method comprises:
if the identification result represents that the face feature is not matched with the reference face feature, determining that the feature of the object meets the second feature condition; wherein the feature of the object in the first scene image satisfying the first feature condition comprises the number of objects being equal to a number threshold.
5. A method according to claim 3, wherein the matching the face features with the reference face features stored in the face feature library is performed to perform face recognition, and after obtaining the recognition result, the method comprises:
if the identification result represents that the face features matched with the reference face features exist, determining that an object corresponding to the face features matched with the face features in the objects is a target object; wherein the characteristics of the objects in the first scene image satisfy a first characteristic condition, including at least one of: the number of the objects meets a number increasing condition, the number of the objects is larger than the number threshold, and the orientation angle between the face orientation of the objects and the display screen is within an orientation angle threshold under the condition that the number of the objects is larger than the number threshold;
Acquiring the sight angle of the human eyes of the rest objects different from the target object in the objects, which watch the display screen;
and if the sight angle is in the sight angle threshold range, determining that the characteristics of the residual object meet the second characteristic condition.
6. The method according to any one of claims 1 to 5, further comprising:
and if the characteristics of the object in the second scene image do not meet the second characteristic conditions, determining that the display content of the display screen does not meet the shielding conditions, and controlling the image acquisition module to continuously acquire a third scene image on the side where the display screen is located by the first power.
7. The method according to any one of claims 1 to 5, wherein the masking the display content in the display screen comprises at least one of: reducing the display brightness of the display screen; blurring the display content; controlling the display screen to display the display content in a polarized mode; switching to a screen locking interface; covering a display area of the display content with a solid color patch; and replacing the display content with a preset character and displaying.
8. The method according to any one of claims 1 to 5, wherein if the feature of the object in the second scene image satisfies a second feature condition, after masking the display content in the display screen, the method further comprises:
Generating prompt information for prompting the existence of peeping behaviors;
and outputting the prompt information in at least one prompt mode.
9. An information shielding apparatus, characterized in that the information shielding apparatus comprises:
the control module is used for controlling the image acquisition module of the electronic equipment to acquire at least one frame of first scene image on the side where the display screen is located at the first power; wherein the first scene image has a first resolution;
the control module is further configured to control the image acquisition module to acquire a second scene image including the object at a second power greater than the first power if the feature of the object in the first scene image satisfies a first feature condition; wherein the second scene image has a second resolution, the second resolution being greater than the first resolution;
and the processing module is used for shielding the display content in the display screen if the characteristics of the object in the second scene image meet the second characteristic condition.
10. An electronic device, the electronic device comprising: a processor, a memory, and a communication bus;
the communication bus is used for realizing communication connection between the processor and the memory;
The processor is configured to execute an information masking program stored in a memory to implement the steps of the information masking method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619557.XA CN116361761A (en) | 2021-12-27 | 2021-12-27 | Information shielding method, information shielding device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619557.XA CN116361761A (en) | 2021-12-27 | 2021-12-27 | Information shielding method, information shielding device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116361761A true CN116361761A (en) | 2023-06-30 |
Family
ID=86910367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111619557.XA Pending CN116361761A (en) | 2021-12-27 | 2021-12-27 | Information shielding method, information shielding device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116361761A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116561829A (en) * | 2023-07-04 | 2023-08-08 | 广州思涵信息科技有限公司 | Safety protection method, device, equipment and storage medium of display equipment |
-
2021
- 2021-12-27 CN CN202111619557.XA patent/CN116361761A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116561829A (en) * | 2023-07-04 | 2023-08-08 | 广州思涵信息科技有限公司 | Safety protection method, device, equipment and storage medium of display equipment |
| CN116561829B (en) * | 2023-07-04 | 2024-04-02 | 广州思涵信息科技有限公司 | Safety protection method, device, equipment and storage medium of display equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11321575B2 (en) | Method, apparatus and system for liveness detection, electronic device, and storage medium | |
| US10007841B2 (en) | Human face recognition method, apparatus and terminal | |
| CN111553864B (en) | Image restoration method and device, electronic equipment and storage medium | |
| WO2016024173A1 (en) | Image processing apparatus and method, and electronic device | |
| US11281892B2 (en) | Technologies for efficient identity recognition based on skin features | |
| EP2336949B1 (en) | Apparatus and method for registering plurality of facial images for face recognition | |
| EP3333844B1 (en) | Display operation method and apparatus, computer program and recording medium | |
| CN107730448B (en) | Beautifying method and device based on image processing | |
| CN110457963B (en) | Display control method, display control device, mobile terminal and computer-readable storage medium | |
| CN107220614B (en) | Image recognition method, image recognition device and computer-readable storage medium | |
| CN112422817B (en) | Image processing method and device | |
| CN110619239A (en) | Application interface processing method and device, storage medium and terminal | |
| CN113486377A (en) | Image encryption method and device, electronic equipment and readable storage medium | |
| CN107977636B (en) | Face detection method and device, terminal and storage medium | |
| US20210090335A1 (en) | Augmented interface distraction reduction | |
| CN116361761A (en) | Information shielding method, information shielding device and electronic equipment | |
| US10438377B2 (en) | Method and device for processing a page | |
| CN113552989A (en) | Screen recording method and device and electronic equipment | |
| CN114040048A (en) | Privacy protection method and electronic equipment | |
| CN111553865B (en) | Image restoration method and device, electronic equipment and storage medium | |
| CN111968605A (en) | Exposure adjusting method and device | |
| CN109934168B (en) | Face image mapping method and device | |
| CN111373409B (en) | Method and terminal for obtaining color value change | |
| CN115580690B (en) | Image processing method and electronic equipment | |
| CN115691387A (en) | Method for adjusting refresh frequency of display screen and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |