CN117574461A

CN117574461A - Privacy screen display data processing method, device and system

Info

Publication number: CN117574461A
Application number: CN202311589519.3A
Authority: CN
Inventors: 张舟
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2023-11-27
Filing date: 2023-11-27
Publication date: 2024-02-20

Abstract

The embodiment of the application provides a privacy screen display data processing method, device and system, which relate to the field of information security and can also be used in the financial field, and the method comprises the following steps: performing face recognition authentication operation according to the face image information and face recognition information reserved during user signing registration to obtain a face recognition authentication result, wherein the face information acquisition is performed after user authorization approval is obtained; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; the screen peeping prevention effect can be effectively improved, and information safety is guaranteed.

Description

Privacy screen display data processing method, device and system

Technical Field

The application relates to the field of information security, and also can be used in the field of finance, in particular to a privacy screen display data processing method, device and system.

Background

Today, with the development of digitization, electronic display screens are being used everywhere in the work, study and life of people. These display screens are also an important source of personal privacy information disclosure while providing information acquisition for users. Especially in the financial industry, the damage caused by the leakage is huge, with the current acceleration of intelligent banking steps, electronic display screens are more and more, and how to protect the financial privacy of users in the use of electronic equipment screens is an important subject.

The existing electronic screen privacy protection means are generally divided into three types. First, a private space for a personal screen is manufactured by physical decoration means, and only one user is accommodated in the private space for viewing. The second technical means is that a grating peep-proof film is attached to a common screen, so that a user can only view the content of the screen from the view angle with the screen. The third technical means is that a privacy screen display technology with a grating is adopted, and an ultra-fine shutter grating privacy layer capable of controlling grating gaps and display angles is added in a screen. According to the change of the view angle of the user, the user is only allowed to view the screen from the view angle.

The inventors have found that the three screen privacy protection schemes described above are now in use. There are the following disadvantages.

1. The method of adopting the physical space to decorate the license private space has the defects of obvious decoration cost waste and incapability of meeting the private decoration requirement due to space limitation. This approach is also only suitable for places where the screen device is fixed, and if it is a mobile device it will not be able to do so. The equipment can be laid out and moved at any time when the place is fixed in time, and the original space decoration can not be used, and meanwhile, the dismantling cost is wasted.

2. The method of pasting the grating peep-proof film on the display screen can effectively prevent the risk of financial privacy leakage caused by lateral peeping of the screen, but the mode requires that a user must view the screen from a view angle perpendicular to the screen, requirements are relatively easy to meet on portable mobile display equipment, but intelligence requires that the user always keep an angle to view the screen on a large or fixed equipment electronic display screen, and when the viewing angle is different from the public viewing view angle due to the height of the user or other reasons, the user is inconveniently aware. In this way, the brightness of the screen will be severely reduced due to the blocking of light by the grating, and the user will not be able to see the screen display when the operation place is dim.

3. The privacy screen display technology adopting the controllable grating can well solve the problem of viewing the screen in a manner of adapting to the variable visual angle of a user, but the screen is expensive, hardware equipment is difficult to replace and equipment technology is difficult to maintain, and the screen cannot be widely used in a large area.

Disclosure of Invention

Aiming at the problems in the prior art, the application provides a privacy screen display data processing method, device and system, which can effectively improve the peep-proof effect of a screen and ensure the information safety.

In order to solve at least one of the above problems, the present application provides the following technical solutions:

in a first aspect, the present application provides a method for processing privacy screen display data, including:

face information acquisition is carried out on the face information captured in the set range to obtain face image information, wherein the face information acquisition is carried out after the user authorization consent is obtained;

performing face recognition authentication operation according to the face image information and face recognition information reserved during user signing registration to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device;

performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen;

Determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system;

and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing.

Further, after the face recognition authentication result is obtained, the method includes:

judging whether a screen range facing the equipment captures a plurality of face information or not, or judging that the face identification authentication result is not passed;

if yes, a full-screen fuzzy display instruction is sent to the corresponding equipment screen so as to control the equipment to display in a full-screen fuzzy mode.

Further, the performing image analysis on the eye movement image according to a preset human vision model simulation algorithm to determine the vision range of the user attention device screen includes:

acquiring real-time phase parameter data of the pupil center position of the user and the reflection point of infrared light on the cornea of the user according to the eye movement image;

and performing eye movement analysis according to a preset human vision model simulation algorithm, the user pupil center position, the real-time phase parameter data and other user eye movement image characteristic values, and determining the vision range of the user attention device screen.

Further, before determining the corresponding peepable screen range according to the visual range and the preset space object coordinate system, the method includes:

acquiring spatial image information facing different angles of an equipment screen through a spatial information camera preset at different positions of the equipment screen;

and carrying out space image analysis on the space image information, and constructing a space object coordinate system according to the space image analysis result.

Further, the performing spatial image analysis on the spatial image information, and constructing a spatial object coordinate system according to the spatial image analysis result, includes:

setting a device screen as a coordinate system reference;

and constructing a space object coordinate system facing the equipment screen according to the multi-angle image ranging rule, the coordinate system reference and the space image information.

Further, the determining the corresponding peepable screen range according to the visual range and the preset space object coordinate system includes:

determining a user visual focus range and a user human body shielding range according to the space object coordinate system and the visual range;

and determining a corresponding peepable screen range according to the user visual focus range and the user human body shielding range.

Further, the sending a corresponding partially blurred display range signal to the device screen according to the peepable screen range so as to control the device to perform partially blurred processing, including:

determining a corresponding partial fuzzy pixel range according to the screen size pixel information of the equipment screen and the peepable screen range;

and generating a corresponding partial blurring display range signal according to the partial blurring pixel range and sending the partial blurring display range signal to the equipment screen so as to control the equipment to carry out partial blurring processing.

In a second aspect, the present application provides a privacy screen data processing device, including:

the face image acquisition module is used for acquiring face information of the face information captured in the set range to obtain face image information, wherein the face information acquisition is executed after the user authorization consent is obtained;

the eye movement image acquisition module is used for carrying out face recognition authentication operation according to the face image information and the face recognition information reserved during user signing registration to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device;

The visual range determining module is used for carrying out image analysis on the eye movement image according to a preset human visual model simulation algorithm and determining the visual range of the user attention equipment screen;

the peepable screen range determining module is used for determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system;

and the partial blurring processing module is used for sending a corresponding partial blurring display range signal to the equipment screen according to the peepable screen range so as to control the equipment to carry out partial blurring processing.

Further, the eye movement image acquisition module includes:

the abnormality judging unit is used for judging whether the screen range of the facing equipment captures a plurality of face information or not, or whether the face identification authentication result is not passed;

and the full-screen blurring unit is used for sending a full-screen blurring display instruction to the corresponding equipment screen if so as to control the equipment to display in a full-screen blurring mode.

Further, the visual range determination module includes:

the eye movement parameter determining unit is used for acquiring real-time phase parameter data of the pupil center position of the user and the reflection point of infrared light on the cornea of the user according to the eye movement image;

And the eye movement analysis unit is used for carrying out eye movement analysis according to a preset human vision model simulation algorithm, the pupil center position of the user, the real-time phase parameter data and other user eye movement image characteristic values, and determining the vision range of the user attention equipment screen.

Further, the peepable screen range determining module includes:

the space image acquisition unit is used for acquiring space image information facing different angles of the equipment screen through a space information camera preset at a position different from the equipment screen;

and the coordinate system construction unit is used for carrying out space image analysis on the space image information and constructing a space object coordinate system according to the space image analysis result.

Further, the coordinate system construction unit includes:

a reference determination subunit for setting the device screen as a coordinate system reference;

and the coordinate system constructing subunit is used for constructing a space object coordinate system facing the equipment screen according to the multi-angle image ranging rule, the coordinate system reference and the space image information.

Further, the peepable screen range determining module includes:

the shielding range determining unit is used for determining a user visual focus range and a user human body shielding range according to the space object coordinate system and the visual range;

The peepable screen range determining unit is used for determining a corresponding peepable screen range according to the user visual focus range and the user human body shielding range.

Further, the partial blurring processing module includes:

the pixel determining unit is used for determining a corresponding partial fuzzy pixel range according to the screen size pixel information of the equipment screen and the peepable screen range;

and the blurring processing unit is used for generating a corresponding partial blurring display range signal according to the partial blurring pixel range and sending the partial blurring display range signal to the equipment screen so as to control the equipment to perform partial blurring processing.

In a third aspect, the present application provides a privacy screen data processing system, including: the device screen and the system core processing module are electrically connected;

the system core processing module comprises:

the face image acquisition module is used for acquiring face information of the face information captured in the set range to obtain face image information;

In a fourth aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the privacy screen data processing method when the program is executed.

In a fifth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the privacy screen data processing method.

In a sixth aspect, the present application provides a computer program product comprising computer programs/instructions which when executed by a processor implement the steps of the privacy screen data processing method.

According to the technical scheme, the application provides a privacy screen display data processing method, device and system, and the face identification authentication operation is carried out according to face image information and face identification information reserved during user signing registration to obtain a face identification authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flowchart of a method for processing privacy screen data according to an embodiment of the present application;

FIG. 2 is a second flowchart of a method for processing privacy-preserving data according to an embodiment of the present application;

FIG. 3 is a third flowchart of a method for processing privacy-preserving data according to an embodiment of the present application;

FIG. 4 is a flowchart of a method for processing privacy screen data according to an embodiment of the present application;

FIG. 5 is a flowchart of a method for processing privacy-preserving data according to an embodiment of the present application;

FIG. 6 is a flowchart of a method for processing privacy screen data according to an embodiment of the present application;

FIG. 7 is a flowchart of a method for processing privacy screen data according to an embodiment of the present application;

FIG. 8 is one of the block diagrams of the privacy screen data processing apparatus in the embodiment of the present application;

FIG. 9 is a second block diagram of a privacy screen data processing device in an embodiment of the present application;

FIG. 10 is a third block diagram of a privacy screen data processing apparatus according to an embodiment of the present application;

FIG. 11 is a diagram of a structure of a privacy screen data processing apparatus in an embodiment of the present application;

FIG. 12 is a fifth block diagram of a privacy screen data processing device in an embodiment of the present application;

FIG. 13 is a sixth block diagram of a privacy screen data processing device in an embodiment of the present application;

FIG. 14 is a seventh block diagram of a privacy screen data processing device in the embodiments of the present application;

FIG. 15 is a block diagram of a privacy screen data processing system in an embodiment of the present application;

FIG. 16 is a block diagram of a privacy screen data processing system in one embodiment of the present application;

FIG. 17 is a schematic diagram of a method for processing privacy screen data according to an embodiment of the present application;

fig. 18 is a schematic structural diagram of an electronic device in an embodiment of the present application.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The data acquisition, storage, use, processing and the like in the technical scheme meet the relevant regulations of national laws and regulations.

The related information and data (including but not limited to user information, face information and account information) acquired by the method are information and data authorized by the user or fully authorized by all parties, and a corresponding operation entrance is provided for the user to select authorization or rejection; the collection, storage, use, processing, transmission, provision, disclosure, application and other processes of the related data all obey the related laws and regulations and standards of the related countries and regions, and necessary security measures are adopted without violating the public order colloquial.

In consideration of the problems in the prior art, the application provides a privacy screen display data processing method, device and system, which are used for performing face recognition authentication operation according to face image information and face recognition information reserved during user signing registration to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

In order to effectively improve the peeping prevention effect of a screen and ensure the information security, the application provides an embodiment of a privacy screen display data processing method, referring to fig. 1, wherein the privacy screen display data processing method specifically comprises the following contents:

step S101: face information acquisition is carried out on the face information captured in the set range to obtain face image information, wherein the face information acquisition is carried out after the user authorization consent is obtained;

optionally, the present application may first register and sign up for the system user, and reserve face recognition information. After the user completes the user registration of the system, the user can start to use, and the system controls various terminal equipment screens in the range. The face information acquisition camera of the equipment is in real-time monitoring and capturing of faces in the screen range of the equipment, and when face information appears in the user capturing range, the face information acquisition camera system captures faces.

Optionally, the user registers and signs up for the user of the system and reserves face recognition information, the application requests whether the user authorizes the user to collect the face information, and after the user authorization is obtained, the face information collection camera of the application device starts working.

Optionally, the face information acquisition is performed on the face information captured in the range by the face information acquisition system, the face image information is acquired, and the face recognition authentication is performed through the face image information acquired and the face recognition information reserved when the user signs up for the registration system.

Step S102: performing face recognition authentication operation according to the face image information and face recognition information reserved during user signing registration to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device;

optionally, the method and the device can capture the face information and judge the face recognition authentication, and when the device screen is captured with a plurality of face information or the face recognition information does not pass, the system sends a full-screen fuzzy display instruction and controls the system to display in a full-screen fuzzy manner.

Optionally, when the authentication of the face information of the user is normal, the system passes the authentication of the user identity and is continuously in real-time monitoring. Meanwhile, the system starts human eye information acquisition equipment and acquires the eye movement image of the user by using a high-speed high-definition camera.

Step S103: performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen;

Optionally, the method and the device can analyze the user eye movement image acquired in real time by utilizing image analysis and video eye movement analysis technology to acquire real-time phase parameter data of the pupil center position of the user and the reflection point of infrared light on the cornea of the user and other user eye movement image characteristic values.

Optionally, according to the acquired user eye movement analysis parameter data, the real-time visual angle of the user and the visual focus range information of the user can be calculated by using a mature human visual model simulation algorithm, so that the visual range of the user focusing on the screen of the equipment can be acquired.

Step S104: determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system;

optionally, after the user face identification passes the identity authentication, the method can start the space information cameras arranged at different positions with the screen to collect the space image information at different angles facing the equipment screen while starting the eye movement image collection.

And further analyzing the acquired space images with different angles, and using a multi-angle image ranging technology in image analysis to establish a space object coordinate system facing the screen and a close-range space object coordinate by taking the equipment screen as a reference.

Optionally, the method and the device can calculate the peeping screen view angles of various peeping user screen angles in the equipment screen facing range according to the face capturing information, the face recognition authentication information, the user view angle, the visual focus and the space object coordinate system data of the screen facing range, determine the user visual focus range and the user human body shielding range, and comprehensively obtain the sum of the peeping screen ranges of the view angles.

Step S105: and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing.

Optionally, according to the acquired device screen peepable screen range data and combined with the screen size pixel information, the pixel range data parameters of the screen to be displayed in a fuzzy manner can be calculated in the whole range of the screen display. And further, according to the calculated pixel range needing to be displayed in a fuzzy way, the system controls the display page to display the range needing to be displayed in a fuzzy way by using output color confusion.

As can be seen from the above description, the privacy screen display data processing method provided by the embodiment of the present application can obtain a face recognition authentication result by performing a face recognition authentication operation according to the face image information and the face recognition information reserved during user sign-up registration; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

In an embodiment of the privacy screen data processing method of the present application, referring to fig. 2, the following may further be specifically included:

step S201: judging whether a screen range facing the equipment captures a plurality of face information or not, or judging that the face identification authentication result is not passed;

step S202: if yes, a full-screen fuzzy display instruction is sent to the corresponding equipment screen so as to control the equipment to display in a full-screen fuzzy mode.

In an embodiment of the privacy screen data processing method of the present application, referring to fig. 3, the following may further be specifically included:

step S301: acquiring real-time phase parameter data of the pupil center position of the user and the reflection point of infrared light on the cornea of the user according to the eye movement image;

Step S302: and performing eye movement analysis according to a preset human vision model simulation algorithm, the user pupil center position, the real-time phase parameter data and other user eye movement image characteristic values, and determining the vision range of the user attention device screen.

In an embodiment of the privacy screen data processing method of the present application, referring to fig. 4, the following may further be specifically included:

step S401: acquiring spatial image information facing different angles of an equipment screen through a spatial information camera preset at different positions of the equipment screen;

step S402: and carrying out space image analysis on the space image information, and constructing a space object coordinate system according to the space image analysis result.

In an embodiment of the privacy screen data processing method of the present application, referring to fig. 5, the following may further be specifically included:

step S501: setting a device screen as a coordinate system reference;

step S502: and constructing a space object coordinate system facing the equipment screen according to the multi-angle image ranging rule, the coordinate system reference and the space image information.

In an embodiment of the privacy screen data processing method of the present application, referring to fig. 6, the following may be further specifically included:

step S601: determining a user visual focus range and a user human body shielding range according to the space object coordinate system and the visual range;

step S602: and determining a corresponding peepable screen range according to the user visual focus range and the user human body shielding range.

In an embodiment of the privacy screen data processing method of the present application, referring to fig. 7, the following may further be specifically included:

step S701: determining a corresponding partial fuzzy pixel range according to the screen size pixel information of the equipment screen and the peepable screen range;

step S702: and generating a corresponding partial blurring display range signal according to the partial blurring pixel range and sending the partial blurring display range signal to the equipment screen so as to control the equipment to carry out partial blurring processing.

In order to effectively improve the peeping prevention effect of a screen and ensure the information security, the application provides an embodiment of a privacy screen data processing device for implementing all or part of the content of the privacy screen data processing method, referring to fig. 8, the privacy screen data processing device specifically includes the following contents:

the face image acquisition module 10 is used for acquiring face information of the face information captured in the set range to obtain face image information;

the eye movement image acquisition module 20 is configured to perform face recognition authentication operation according to the face image information and face recognition information reserved during user subscription registration, so as to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device;

the visual range determining module 30 is configured to perform image analysis on the eye movement image according to a preset human visual model simulation algorithm, and determine a visual range of the user attention device screen;

the peepable screen range determining module 40 is configured to determine a corresponding peepable screen range according to the visual range and a preset space object coordinate system;

And the partial blurring processing module 50 is used for sending a corresponding partial blurring display range signal to the device screen according to the peepable screen range so as to control the device to perform partial blurring processing.

As can be seen from the above description, the privacy screen display data processing device provided in the embodiments of the present application can obtain a face recognition authentication result by performing a face recognition authentication operation according to the face image information and the face recognition information reserved during user sign-up registration; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

In an embodiment of the privacy screen data processing apparatus of the present application, referring to fig. 9, the eye movement image capturing module 20 includes:

An abnormality judging unit 21 for judging whether a plurality of face information is captured in a facing device screen range or the face recognition authentication result is failed;

and the full-screen blurring unit 22 is used for sending a full-screen blurring display instruction to the corresponding device screen if yes so as to control the device to display in a full-screen blurring mode.

In an embodiment of the privacy screen data processing apparatus of the present application, referring to fig. 10, the visual range determining module 30 includes:

an eye movement parameter determining unit 31, configured to obtain real-time phase parameter data of the user pupil center position and the reflection point of infrared light on the user cornea according to the eye movement image;

the eye movement analysis unit 32 is configured to perform eye movement analysis according to a preset human vision model simulation algorithm, the pupil center position of the user, the real-time phase parameter data, and other user eye movement image feature values, so as to determine a vision range of the user attention device screen.

In an embodiment of the privacy screen data processing apparatus of the present application, referring to fig. 11, the peepable screen range determining module 40 includes:

a space image acquisition unit 41 for acquiring space image information facing different angles of the apparatus screen through a space information camera preset at a position different from the apparatus screen;

And a coordinate system construction unit 42, configured to perform spatial image analysis on the spatial image information, and construct a spatial object coordinate system according to the spatial image analysis result.

In an embodiment of the privacy screen data processing apparatus of the present application, referring to fig. 12, the coordinate system construction unit 42 includes:

a reference determination subunit 421 for setting the device screen as a coordinate system reference;

a coordinate system construction subunit 422, configured to construct a spatial object coordinate system facing the device screen according to the multi-angle image ranging rule, the coordinate system reference, and the spatial image information.

In an embodiment of the privacy screen data processing apparatus of the present application, referring to fig. 13, the peepable screen range determining module 40 includes:

an occlusion range determining unit 43 for determining a user visual focus range and a user human body occlusion range according to the spatial object coordinate system and the visual range;

the peepable screen range determining unit 44 is configured to determine a corresponding peepable screen range according to the user visual focus range and the user human body occludable range.

In one embodiment of the privacy screen data processing apparatus of the present application, referring to fig. 14, the partial blur processing module 50 includes:

A pixel determining unit 51, configured to determine a corresponding partially blurred pixel range according to the screen size pixel information of the device screen and the peepable screen range;

and the blurring processing unit 52 is configured to generate a corresponding partially blurring display range signal according to the partially blurring pixel range, and send the partially blurring display range signal to the device screen, so as to control the device to perform a partially blurring process.

In order to further explain the scheme, the application also provides a specific application example of a system for implementing the privacy screen display data processing method by using the privacy screen display data processing device, referring to fig. 15, which specifically includes the following contents: the device screen and the system core processing module are electrically connected;

the system core processing module comprises:

As can be seen from the above description, the privacy screen display data processing system provided in the embodiments of the present application can obtain a face recognition authentication result by performing a face recognition authentication operation according to the face image information and the face recognition information reserved during user sign-up registration; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

In a specific embodiment of a system of the present application, see fig. 16, which relates to the following modules and functions:

the face recognition authentication module 101 performs a function of performing feature value recognition comparison according to face recognition information of a user and face information recorded during user registration, and performing face recognition authentication on the user.

The face capturing module 102 is used for capturing the faces of the people in the range facing the screen through an image capturing technology, and is used as the face recognition basis of the face recognition module and the multi-face judgment basis of the visual range of the screen.

The face information acquisition camera module 103 is an on-screen face information acquisition equipment module and is mainly used for face image information acquisition.

The user face information base 104, the module mainly stores the user face information, when the user registers to use the system, the user face information is reserved in the system to the system user face information base. In the process of using a screen controlled by a system, a registered user needs to carry out face recognition authentication in real time, and a face information base of the system user is called to carry out face image characteristic value comparison so as to finish user identity recognition authentication.

The eye movement image analysis module 105 has the functions of analyzing an eye movement image by using a high-speed high-definition camera of the eye information acquisition module, calculating the relative phase change of the pupil center position of the eye of a user and the infrared light at the reflection point position of the cornea of the user in real time and acquiring image analysis data.

The human eye information acquisition camera module 106 is composed of a high-speed high-definition eye movement camera and an infrared light projection device for projecting infrared light to a user, and has the function of acquiring dynamic image information including the pupil center position of the user's eye and the reflection point position of infrared light on the cornea of the user in real time. The method is used for eye movement image analysis.

The system core processes the module 107, and the main function of the module is to call the coordinated operation of each module in the system.

The display blur area calculation module 108 calculates the pixel area data parameters required for the blurred display of the screen within the whole area of the screen display according to the face capturing information, the face recognition authentication information, the user viewing angle, the visual focus, the viewing area data information of each viewing angle of the peepable screen, and the screen size pixel information.

And the fuzzy display processing module 109 is used for controlling the display page to display the range to be fuzzy according to the pixel range to be fuzzy calculated by the module 108 and performing fuzzy processing display by using the output color confusion.

The user visual angle and visual focus calculating module 110 is used for analyzing image data by using the eye movement image acquired by the module 105, calculating the real-time visual angle and visual focus range information of the user according to a mature human visual model simulation algorithm, and acquiring the visual range of the screen of the user attention device.

The spatial information acquisition camera module 111 is mainly a camera arranged at a position different from that of the display device, and the cameras can acquire spatial images of different angles facing the screen of the device.

The spatial object coordinate component module 112 uses the multi-angle image ranging technology in image analysis to create a spatial object coordinate system facing the screen based on the device screen according to the different angle spatial images acquired by the module 111.

The peeping screen view angle calculating module 113 calculates the peeping screen view angles of the peeping user screen angles in the range of the facing equipment screen except the range of the visual focus of the user and the range which can be shielded by the human body of the user according to the face capturing information, the face recognition authentication information, the user view angle, the visual focus and the space object coordinate system data of the facing screen, and comprehensively obtains the sum of the peeping screen ranges of the view angles.

In a specific embodiment of a method of the present application, referring to fig. 17, the flow is described as follows:

the step A101 is as follows: the user uses the system, and needs to register and sign up the system user first, and reserve the face recognition information.

The step A102 is as follows: after the user completes the user registration of the system, the user can start to use, and the system controls various terminal equipment screens in the range.

The step A103 is as follows: the face information acquisition camera of the equipment is in real-time monitoring and capturing of faces in the screen range of the equipment, and when face information appears in the user capturing range, the face information acquisition camera system captures faces.

The step A104 is as follows: the system collects face information of the face information captured in the range, and obtains face image information so as to carry out next face recognition authentication.

The step A105 is as follows: the system performs face recognition authentication on the face image information acquired by the A104 module and the face recognition information reserved when the user signs up for the registration system.

The step A106 is as follows: and when the face capturing information and the face recognition authentication judgment face the equipment screen range to capture a plurality of face information or the face recognition information does not pass, the system sends a full-screen fuzzy display instruction to the step A113, and controls the system to display in a full-screen fuzzy manner.

The step A107 is as follows: when the authentication of the face information of the A106 user is normal, the system passes the authentication of the user identity and is continuously in real-time monitoring. Meanwhile, the system starts human eye information acquisition equipment and acquires the eye movement image of the user by using a high-speed high-definition camera.

A108 comprises the following steps: the system analyzes the user eye movement image acquired in real time by utilizing image analysis and video eye movement analysis technology to acquire real-time phase parameter data of the pupil center position of the user and the reflection point of infrared light on the cornea of the user and other user eye movement image characteristic values.

The step A109 is as follows: and (3) calculating the real-time visual angle of the user and the visual focus range information of the user by using a mature human visual model simulation algorithm according to the user eye movement analysis parameter data acquired by the A108, and acquiring the visual range of the screen of the user attention device.

The step A110 is as follows: after the user face identification passes the identity authentication, the eye movement image acquisition is started, and meanwhile, the spatial information cameras arranged at different positions with the screen are started to acquire spatial image information of different angles facing the equipment screen.

The step A111 is as follows: the system analyzes the space images of different angles acquired in the step A110, and creates a space object coordinate system facing the screen and a near space object coordinate by using a multi-angle image ranging technology in image analysis and taking the screen of the equipment as a reference.

The step A112 is as follows: and calculating the peeping screen view angles of the peeping user screen angles in the equipment facing screen range according to the face capturing information, the face recognition authentication information, the user view angle, the visual focus and the space object coordinate system data of the facing screen, determining the user visual focus range and the peeping screen view angles of the peeping user screen angles outside the shielding range of the user human body, and comprehensively obtaining the sum of the peeping screen ranges of the view angles.

The step A113 is as follows: and calculating pixel range data parameters which need to be displayed in a fuzzy manner on the screen in the whole range of the screen display according to the peepable screen range data of the equipment screen acquired by the A112 and the pixel information of the screen size.

The step A114 is as follows: and the system controls the display page to display the range needing to be displayed in a fuzzy manner by using the output color confusion according to the pixel range needing to be displayed in a fuzzy manner calculated by the A113.

As can be seen from the foregoing, the present application proposes a system scheme for authenticating a user's identity through face recognition, monitoring, detecting and tracking a user's viewing angle and a screen vision focus in real time, and calculating a viewing angle range in which a screen can be peeped by a user's human body with respect to parameters such as a shielding range of the screen, so that a screen display text in the user's viewing angle vision focus range and the human body shielding range is clearly visible, and performing a fuzzy display outside this range. On the premise that the user does not influence the free use of the device, other people cannot peep, and the effect of protecting personal finance privacy is achieved.

1. By adopting the user face recognition authentication technology, the system control screen display is more intelligent, the system display is only displayed according to the use requirement, and when the face which cannot be recognized or the face of the user cannot be recognized is captured, the system can control the screen to immediately perform fuzzy display processing, so that the privacy of the user is timely protected.

2. The system scheme is used for actively identifying the user, tracking, detecting and calculating the visual angle and visual focus of the user, and is used for enabling the system to control the privacy display control of the screen, so that no sense is achieved in the experience of the user.

3. In the scheme, the front image information of the screen is acquired from the blind view angle, a space coordinate system is established, the shielding range of the human body shielding screen is acquired from the blind view angle, and the human body can be fully utilized as a screen shielding object.

4. The method adopts the fuzzy display mode of the content in the screen display range through the software system, reduces the dependence on a hardware privacy screen, and avoids the defects of light reduction and narrow visible view angle caused by additionally installing a grating mask on the screen.

In order to effectively improve the peeping prevention effect of a screen and ensure the information security, the application provides an embodiment of an electronic device for realizing all or part of contents in the privacy screen display data processing method, wherein the electronic device specifically comprises the following contents:

A processor (processor), a memory (memory), a communication interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete communication with each other through the bus; the communication interface is used for realizing information transmission between the privacy screen display data processing device and related equipment such as a core service system, a user terminal, a related database and the like; the logic controller may be a desktop computer, a tablet computer, a mobile terminal, etc., and the embodiment is not limited thereto. In this embodiment, the logic controller may refer to an embodiment of the privacy screen data processing method and an embodiment of the privacy screen data processing device in the embodiment, and the contents thereof are incorporated herein, and are not repeated here.

It is understood that the user terminal may include a smart phone, a tablet electronic device, a network set top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), a vehicle-mounted device, a smart wearable device, etc. Wherein, intelligent wearing equipment can include intelligent glasses, intelligent wrist-watch, intelligent bracelet etc..

In practical applications, part of the privacy screen data processing method may be executed on the electronic device side as described above, or all operations may be completed in the client device. Specifically, the selection may be made according to the processing capability of the client device, and restrictions of the use scenario of the user. The present application is not limited in this regard. If all operations are performed in the client device, the client device may further include a processor.

The client device may have a communication module (i.e. a communication unit) and may be connected to a remote server in a communication manner, so as to implement data transmission with the server. The server may include a server on the side of the task scheduling center, and in other implementations may include a server of an intermediate platform, such as a server of a third party server platform having a communication link with the task scheduling center server. The server may include a single computer device, a server cluster formed by a plurality of servers, or a server structure of a distributed device.

Fig. 18 is a schematic block diagram of a system configuration of an electronic device 9600 of an embodiment of the present application. As shown in fig. 18, the electronic device 9600 may include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 18 is exemplary; other types of structures may also be used in addition to or in place of the structures to implement telecommunications functions or other functions.

In one embodiment, the privacy screen data processing method functionality may be integrated into the central processor 9100.

The central processor 9100 may be configured to perform the following control:

Step S101: acquiring face information of the captured face information in a set range to obtain face image information;

As can be seen from the above description, the electronic device provided in the embodiment of the present application performs the face recognition authentication operation according to the face image information and the face recognition information reserved during user sign-up registration, so as to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

In another embodiment, the privacy screen data processing device may be configured separately from the central processor 9100, for example, the privacy screen data processing device may be configured as a chip connected to the central processor 9100, and the privacy screen data processing method functions are implemented by the control of the central processor.

As shown in fig. 18, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 need not include all of the components shown in fig. 18; in addition, the electronic device 9600 may further include components not shown in fig. 18, and reference may be made to the related art.

As shown in fig. 18, the central processor 9100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, which central processor 9100 receives inputs and controls the operation of the various components of the electronic device 9600.

The memory 9140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information about failure may be stored, and a program for executing the information may be stored. And the central processor 9100 can execute the program stored in the memory 9140 to realize information storage or processing, and the like.

The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. The power supply 9170 is used to provide power to the electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, but not limited to, an LCD display.

The memory 9140 may be a solid state memory such as Read Only Memory (ROM), random Access Memory (RAM), SIM card, etc. But also a memory which holds information even when powered down, can be selectively erased and provided with further data, an example of which is sometimes referred to as EPROM or the like. The memory 9140 may also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 storing application programs and function programs or a flow for executing operations of the electronic device 9600 by the central processor 9100.

The memory 9140 may also include a data store 9143, the data store 9143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, address book applications, etc.).

The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. A communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, as in the case of conventional mobile communication terminals.

Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, etc., may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and to receive audio input from the microphone 9132 to implement usual telecommunications functions. The audio processor 9130 can include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100 so that sound can be recorded locally through the microphone 9132 and sound stored locally can be played through the speaker 9131.

The embodiments of the present application further provide a computer readable storage medium capable of implementing all the steps in the privacy screen data processing method in which the execution subject in the above embodiments is a server or a client, where the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the privacy screen data processing method in which the execution subject in the above embodiments is a server or a client, for example, the processor implements the following steps when executing the computer program:

As can be seen from the above description, the computer readable storage medium provided in the embodiments of the present application performs face recognition authentication operation according to face image information and face recognition information reserved during user sign-up registration to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

The embodiments of the present application further provide a computer program product capable of implementing all the steps in the privacy screen data processing method in which the execution subject in the above embodiments is a server or a client, where the steps of the privacy screen data processing method are implemented when the computer program/instructions are executed by a processor, for example, the computer program/instructions implement the following steps:

As can be seen from the above description, the computer program product provided in the embodiments of the present application performs face recognition authentication operation according to face image information and face recognition information reserved during user sign-up registration, so as to obtain a face recognition authentication result; if the face recognition authentication result is passed, acquiring an eye movement image of the user through a preset eye information acquisition device; performing image analysis on the eye movement image according to a preset human vision model simulation algorithm, and determining the vision range of the user attention equipment screen; determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system; and sending a corresponding partial fuzzy display range signal to the equipment screen according to the peepable screen range so as to control the equipment to perform partial fuzzy processing, thereby effectively improving the peeping prevention effect of the screen and guaranteeing the information safety.

It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The principles and embodiments of the present invention have been described in detail with reference to specific examples, which are provided to facilitate understanding of the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims

1. The privacy screen display data processing method is characterized by comprising the following steps of:

2. The method for processing privacy screen data according to claim 1, wherein after the face recognition authentication result is obtained, the method comprises:

3. The method for processing private screen display data according to claim 1, wherein the performing image analysis on the eye movement image according to a preset human vision model simulation algorithm to determine the visual range of the user attention device screen comprises:

4. The method for processing private screen display data according to claim 1, comprising, before said determining a corresponding peepable screen range according to said visual range and a preset spatial object coordinate system:

5. The method for processing private screen display data according to claim 4, wherein the performing spatial image analysis on the spatial image information and constructing a spatial object coordinate system according to the spatial image analysis result comprises:

setting a device screen as a coordinate system reference;

6. The method for processing private screen display data according to claim 1, wherein determining a corresponding peepable screen range according to the visual range and a preset space object coordinate system comprises:

7. The method according to claim 1, wherein the sending a corresponding partially obscured display range signal to the device screen according to the peepable screen range to control the device to perform partially obscured processing includes:

8. A privacy screen data processing apparatus, comprising:

9. A privacy screen data processing system, comprising: the device screen and the system core processing module are electrically connected;

the system core processing module comprises:

10. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the privacy screen data processing method of any of claims 1 to 7 when the program is executed by the processor.

11. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the privacy screen data processing method of any one of claims 1 to 7.

12. A computer program product comprising computer programs/instructions which when executed by a processor implement the steps of the method of processing privacy-preserving data of any of claims 1 to 7.