CN107148775B

CN107148775B - Image processing method and device, electronic equipment and readable storage medium

Info

Publication number: CN107148775B
Application number: CN201580058789.9A
Authority: CN
Inventors: 陈苑锋; 王利强
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2015-09-15
Filing date: 2015-09-15
Publication date: 2020-02-21
Anticipated expiration: 2035-09-15
Also published as: WO2017045126A1; CN107148775A

Abstract

The invention relates to an image processing method and a terminal, wherein the method comprises the following steps: receiving display images frame by frame; determining a shielding pattern according to each frame of display image, wherein each frame of shielding pattern shields a part of the corresponding frame of display image; determining an output image by superimposing a corresponding frame occlusion pattern on each frame display image; each pixel of each frame of display image appears at least once in N frames of output images which are continuously output, and in the N frames of output images which are continuously output, the display image of the unshielded part of each frame of shielding pattern meets the visual retention principle, wherein N is the frame number of the display image output per second. According to the embodiment of the invention, the shielding pattern is arranged on each frame of the display image, and the terminal display image can be prevented from being candid under the condition of meeting the user requirement by combining the visual retention principle according to the frequency of the output signal of the terminal, so that the safety of the user using the terminal is ensured.

Description

Image processing method and device, electronic equipment and readable storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to an image processing method and a terminal.

Background

The terminal is used in daily life of people, and besides a call function, the terminal also has functions of personal information management, a browser, a Global Positioning System (GPS), e-mail, and the like. The terminal can provide various application services for users through software operation and content services, and becomes a comprehensive body with powerful functions by combining the support of a communication network and integrating conversation, short messages, network access and movie and television entertainment. Therefore, the demand for safe use of the terminal is also increasing.

However, at present, the security protection work of the terminal is mainly completed by a third party platform and cannot be completed based on the terminal itself.

Disclosure of Invention

The embodiment of the invention provides an image processing method and a terminal, wherein a shielding pattern is arranged on a display image. And the anti-candid photographing of the display content of the terminal is realized by combining the visual retention principle. The safety of the user using the terminal is ensured.

In a first aspect, an embodiment of the present invention provides an image processing method, which is applied to a portable electronic device, where the electronic device has a display, and the method includes:

receiving display images frame by frame;

determining an occlusion pattern of each frame of a display image, wherein the occlusion pattern occludes partial pixels of the display image;

and outputting an image frame by frame, wherein the output image is the superposition of the display image and the shielding pattern corresponding to the display image.

In a first possible implementation manner of the first aspect, each pixel of the display image appears in the output image output consecutively for N frames at least once without being occluded by an occlusion pattern.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, the determining an occlusion pattern of the display image includes:

and moving the N frame of shielding pattern along the first direction to obtain an N +1 frame of shielding pattern, wherein the partial pixels of the display image shielded by the N +1 frame of shielding pattern are the partial pixels of the display image not shielded by the N frame of shielding pattern, and N is a positive integer from 1 to N-1.

With reference to the first aspect or any one of the first to the second possible implementation manners of the first aspect, in a third possible implementation manner, when the shielding pattern is a bar-type pattern, the method further includes:

and determining the width of the bar-type pattern and the interval of the bar-type pattern.

In a fourth possible implementation manner of the first aspect, the method further includes:

and receiving an operation instruction input by a user, wherein the operation instruction is used for indicating to open the shielding pattern.

In a second aspect, an embodiment of the present invention provides an image processing apparatus, including:

a receiving module for receiving the display image frame by frame;

the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining an occlusion pattern of each frame of display image, and the occlusion pattern occludes partial pixels of the display image;

and the output module is used for outputting images frame by frame, and the output images are the superposition of the display images and the shielding patterns corresponding to the display images.

In a first possible implementation manner of the second aspect, each pixel of the display image appears in the image output consecutively in N frames at least once without being occluded by an occlusion pattern.

With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, the determining module is specifically configured to,

With reference to the second aspect or any one of the first to the second possible implementation manners of the second aspect, in a third possible implementation manner, when the shielding pattern is a grid-type pattern, the determining module is further configured to determine a width of the grid-type pattern and a pitch of the grid-type pattern.

In a fourth possible implementation manner of the second aspect, the receiving module is further configured to receive an operation instruction input by a user, where the operation instruction is used to instruct to open the shielding pattern.

In a third aspect, an embodiment of the present invention provides a portable electronic device, including:

a display for displaying an image;

a memory to store instructions;

a processor to invoke instructions stored in the memory to implement:

receiving display images frame by frame;

In a fourth aspect, embodiments of the invention provide a non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device comprising a display, cause the portable electronic device to perform the following:

receiving display images frame by frame;

Based on the technical scheme, according to the image processing method and the terminal provided by the embodiment of the invention, the terminal sets the shielding pattern for each frame of the display image, and combines the visual retention principle according to the frequency of the output signal of the terminal, so that the display image of the terminal can be prevented from being captured under the condition of meeting the user requirement, and the safety of the user using the terminal is ensured.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic flow chart diagram of an image processing method of an embodiment of the present invention;

FIG. 2 is a schematic diagram of displaying an image according to another embodiment of the present invention

FIG. 3A is a diagram illustrating an occlusion pattern of an nth frame according to another embodiment of the present invention;

FIG. 3B is a diagram of an occlusion pattern of the (n + 1) th frame according to another embodiment of the present invention;

FIG. 4 is a schematic view of an occlusion pattern distributed over a portion of a display image;

fig. 5 is a schematic configuration diagram of a terminal according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a determination module in a terminal according to another embodiment of the present invention;

fig. 7 is a schematic configuration diagram of a terminal according to another embodiment of the present invention;

fig. 8 is a schematic configuration diagram of a terminal according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, shall fall within the scope of protection of the present invention.

In the implementation of the present invention, a User Equipment (UE), also called a Terminal (Terminal), is used. The terminal performs image processing on the display images output frame by frame, and superimposes a shielding pattern on the display image of each frame. The shielding patterns in the continuous frames are changed according to a certain sequence, and the terminal outputs the display image after the shielding patterns are overlapped frame by frame. According to the frequency of the image output by the terminal, at a certain moment, the displayed image cannot be completely displayed, but the user can see the complete displayed image by combining the visual dwell principle. In the embodiment of the invention, the terminal can be a mobile phone, a tablet computer, a television and other equipment with a display.

For convenience of explanation, the technical solution of the embodiment of the present invention will be described in detail with reference to fig. 1. It should be understood that this is only an example for illustrating the technical solutions of the embodiments of the present invention, and does not constitute any limitation to the embodiments of the present invention.

FIG. 1 is a schematic flow chart diagram of an image processing method according to an embodiment of the invention. The execution subject of the image processing method 100 shown in fig. 1 is a terminal, and the method 100 includes:

110, receiving display images frame by frame;

120, determining an occlusion pattern of each frame of display image, the occlusion pattern occluding a portion of the display image;

and 130, outputting the images frame by frame, wherein the output images are the superposition of the display images and the shielding patterns corresponding to the display images.

And the terminal receives the display images frame by frame according to a preset frame rate. The terminal outputs images frame by frame according to a preset frame rate, and each output image is continuously output in N frames. The display images in the output images of the N-frame continuous output are the same. Each pixel of each frame display image appears in N frames of successively output images at least once unobstructed by an obstruction pattern. In the output images continuously output by N frames, the display image of the unoccluded part of each frame of the occlusion pattern meets the visual retention principle. N is a positive integer.

Specifically, in the embodiment of the present invention, the terminal outputs the image according to the preset frame rate. And the terminal overlaps the shielding pattern corresponding to the display image on each frame of display image. And superposing the display image and the shielding pattern corresponding to the display image to synthesize an output image. The corresponding shielding pattern of each frame of display image only shields partial pixels of the frame of display image. Each pixel of each frame of the display image is not occluded by the occlusion pattern at least once in N frames of the output images which are continuously output. When the preset frame rate meets the time of the visual retention of the user, and N frames of images are output continuously, the visual retention principle or the visual retention principle is combined, so that when the user sees the next frame of output image, the previous frame of output image is still kept in the sight of the user, and the user can see a complete display image.

The occlusion patterns of different frames may be different and may be changed in a certain order.

In 110, the display image may be a display image that the terminal needs to output. The terminal receives the display image to be output frame by frame.

In 120, the occlusion pattern may be used to occlude a portion of the information of the display image. The terminal determines an occlusion pattern for each frame of the display image.

In the embodiment of the invention, the occlusion pattern of each frame can occlude part of pixels of the display image of the corresponding frame. The occlusion patterns for successive frames may be different and may be changed in a certain order. Determining that each pixel of the display image is not occluded by the occlusion pattern at least once in the output images of successive frames based on the number of frames of the output image of the terminal for one second. In order to meet the requirements of users, the display image which is not shielded by the shielding pattern in each frame meets the visual stay principle so as to meet the requirement that the users can see the complete display image.

Wherein, in the embodiment of the invention, N is the number of frames per second of the output image output by the terminal.

At 130, the terminal outputs an image frame by frame, the output image being a superposition of the display image and the occlusion pattern corresponding to the display image.

Therefore, the technical scheme of the embodiment of the invention discloses that the shielding pattern is set for each frame of display image, and the shooting equipment which is not matched with the output frame rate of the terminal cannot acquire the display content of the terminal through shooting. The technical scheme of the embodiment of the invention can protect personal privacy, prevent the terminal display image from being captured by theft and ensure the safety of the user using the terminal.

In an embodiment of the present invention, the shielding pattern includes a regular-shaped pattern or an irregular-shaped pattern.

Alternatively, each pixel of the display image is not occluded by the occlusion pattern at least once in N frames of the output images successively output.

Optionally, the occlusion patterns corresponding to the display images of different frames occlude contents of different parts of the display images.

Optionally, as another embodiment of the present invention, the determining the occlusion pattern of the display image includes:

and moving the n frame of shielding pattern along the first direction to obtain an n +1 frame of shielding pattern. The partial pixels of the display image occluded by the (N + 1) th frame of occlusion pattern can be partial pixels of the display image not occluded by the (N) th frame of occlusion pattern, and N is a positive integer from 1 to N-1.

In the embodiment of the present invention, n is a previous frame signal in the continuously received frame signals, and n +1 is a frame signal after the nth frame signal in the continuously received frame signals. The first direction is any one preset direction of the terminal. And after the terminal determines the shielding pattern for the nth frame of display image, the terminal moves the shielding pattern of the nth frame of display image along the preset first direction. And taking the moved shielding pattern as the shielding pattern of the display image of the (n + 1) th frame. The pixels of the display image that are not occluded by the (n + 1) th frame occlusion pattern may be all or part of the pixels of the display image that are occluded by the (n) th frame occlusion pattern.

The following describes the technical solution of the present invention, taking a terminal to output 60 frames of images per second, taking a shielding pattern as a horizontal bar as an example, and when the widths of transparent bars in the horizontal bar and the shielding pattern are the same.

As shown in fig. 2, 3A and 3B, fig. 2 is a display image, fig. 3A is an nth frame output image, and fig. 3B is an n +1 th frame output image. The pixels in fig. 3A and 3B that are not occluded by the occluding pattern are portions of transparent strip 310. When the 20 th frame output image outputted from the terminal is the image shown in fig. 3A, the shielding pattern shields information of the partially displayed image. The terminal moves the shielding pattern for shielding the 20 th frame display image as the shielding pattern for the 21 st frame display image in a certain direction.

It should be understood that, in the embodiment of the present invention, the terminal outputs 60 frames of images per second, and the blocking pattern is a horizontal bar, which is only for illustrating the technical solution of the present invention, but the technical solution of the present invention is not limited thereto.

It should also be understood that in embodiments of the present invention, images occluded by an occlusion pattern in different frame output images may partially overlap. Each pixel of the display image is not occluded by the occlusion pattern at least once in the output images consecutively output for N consecutive frames.

In the embodiment of the present invention, the shielding pattern is a regular-shaped grating pattern, and the grating pattern may be a horizontal grating pattern, a vertical grating pattern, or an oblique grating pattern.

It should be noted that, in the embodiment of the present invention, the occlusion patterns in consecutive frames move in a certain direction. The blocking patterns may be moved in a certain order. For example, it may be moved at a certain speed.

It should also be understood that, in the embodiment of the present invention, when the shielding pattern satisfies the condition: each frame of shielding pattern shields a part of the corresponding frame of display image, each pixel of each frame of display image is not shielded by the shielding pattern at least once in N frames of continuously output images, the displayed images which are not shielded by each frame of shielding pattern in the N frames of continuously output images meet the visual retention principle, and N is the number of frames of the displayed images output in each second. The blocking pattern may also move randomly. This is not to be construed as limiting the embodiments of the invention.

Optionally, as another embodiment of the present invention, the method 100 further includes: when the shielding pattern is a grid-type pattern, the width of the grid-type pattern and the interval of the grid-type pattern are determined.

In the embodiment of the present invention, when the shielding pattern is a bar type pattern, the terminal may determine the width and the interval of the bar type pattern. For example, the terminal determines the width and pitch of the raster-type pattern according to the size of the output display image. In this embodiment, the blocking pattern may be a pattern of equal spacing, unequal spacing, equal width, and/or unequal width.

Optionally, as another embodiment of the present invention, the method 100 may further include: the color of the occlusion pattern is determined for each frame.

In the embodiment of the present invention, the terminal may set a color for each frame of the shielding pattern. The color of each frame of shielding pattern can be a fixed color or different colors.

In the embodiment of the present invention, the terminal may further set a different visual effect for the occlusion pattern of each frame. For example, the terminal sets the blocking pattern with different transparency, or the terminal sets the blocking pattern with a special effect, for example, a ground glass effect.

Preferably, in the embodiment of the present invention, when the terminal turns on the blocking pattern once, the blocking pattern of each frame of output image of the time is the same color, the same transparency and/or the same special effect, so as to reduce the stimulation of the color, the transparency and/or the special effect change to the eyes, so as to protect the eyes. When the terminal opens the shielding pattern for many times, the color, transparency and/or special effect of the shielding pattern at each time can be inconsistent, so that the diversity of vision in the use process of a user is realized, and the user experience is improved.

In the embodiment of the present invention, the terminal may further adjust the brightness and/or the gray scale of the shielding pattern, for example, the terminal may adjust the brightness of the screen of the terminal display in combination with the brightness and/or the gray scale of the shielding pattern, and adjust the brightness of the screen of the terminal display and the brightness and/or the gray scale of the shielding pattern at the same time, so as to improve the user experience.

Alternatively, as another embodiment of the present invention, the occlusion patterns of each frame are distributed on a part of the display image or the occlusion patterns of each frame are distributed on the entire display image.

Specifically, the shielding pattern of each frame may be distributed on the whole display image or on a part of the display image of the whole display image, that is, the terminal shielding pattern may shield the display image of all the areas of the display or shield the display image of a part of the areas of the display.

FIG. 4 is a schematic diagram of a display image of a partial area of a display blocked by a blocking pattern. In fig. 4, the shielding pattern is distributed over the middle area of the display.

It should be understood that, in the embodiment of the present invention, the blocking pattern is distributed in the middle area of the display as an example, which is only for describing the technical solution of the embodiment of the present invention in detail, but not limiting the scope of the embodiment of the present invention.

In the embodiment of the present invention, when the occlusion pattern occludes the display image in the partial area of the display, the occlusion pattern may also be distributed in the top position, the bottom position, the left position, the right position of the display, or any possible position of the display, which is not limited in the embodiment of the present invention.

It is also understood that the blocking pattern may be a regular shaped pattern or an irregular shaped pattern of any shape.

Optionally, as another embodiment of the present invention, the method further includes: and receiving an operation instruction input by a user, wherein the operation instruction is used for indicating to open the shielding pattern.

Specifically, in the embodiment of the present invention, the terminal receives an instruction for opening a shielding pattern, which is input by a user, so as to set a shielding pattern for each frame of the received display image according to the instruction.

In the embodiment of the present invention, the operation instruction may be triggered by a user pressing a key on the terminal, or may be triggered by a gesture. For example, taking the terminal as a mobile phone as an example, the mobile phone may be triggered to turn on the shielding pattern according to the fact that the user presses the power key and/or the up volume key; or triggering the mobile phone to open the shielding pattern according to the user rotation gesture.

It should be understood that, in the embodiment of the present invention, the terminal may also close the shielding pattern according to an operation instruction input by the user.

It should also be understood that, in the embodiment of the present invention, the operation instruction may be triggered by a software switch or a specific program, besides by pressing a key on the terminal by the user, which is not limited in any way in the embodiment of the present invention.

Therefore, by adopting the image processing method provided by the embodiment of the invention, the terminal can prevent the display image from being candid under the condition of meeting the user requirement by setting the shielding pattern for the display image of each frame and combining the visual dwell principle according to the frequency of the output signal of the terminal, so as to ensure the safety of the user using the terminal.

The method of image processing according to an embodiment of the present invention is described in detail above with reference to fig. 1 to 4, and the terminal according to an embodiment of the present invention is described in detail below with reference to fig. 5 to 8.

Fig. 5 is a schematic configuration diagram of a terminal according to an embodiment of the present invention. The terminal 500 shown in fig. 5 includes: a receiving module 510, a determining module 520, and an outputting module 530.

A receiving module 510 for receiving a display image frame by frame;

the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining an occlusion pattern of each frame of display image, and the occlusion pattern occludes a part of the display image;

an output module 530, configured to output an image frame by frame, where the output image is a superposition of a display image and a shielding pattern corresponding to the display image.

Each pixel of each frame of display image is not shielded by a shielding pattern at least once in N frames of continuously output images, the display image of the shielding pattern non-shielding part of each frame of display images meets the visual retention principle in the N frames of continuously output images, and N is a positive integer.

Specifically, in the embodiment of the present invention, the terminal outputs the image according to the preset frame rate. The frame rate used by each terminal satisfies the visual dwelling principle. The determining module 520 processes each frame of the display image received by the receiving module 510, superimposes the occlusion pattern on the display image of each frame, and synthesizes a final output image. The occlusion pattern of each frame may occlude only a portion of the pixels of the display image of the frame. Because the output image comprises the display image and the shielding pattern, in each frame of output image, because partial pixels of the display image are shielded by the shielding pattern, each frame of output image can not present a complete display image, each pixel of each frame of display image appears in N frames of output images which are continuously output at least once and is not shielded by the shielding pattern, and a user can see the complete display image by combining the visual retention principle. Wherein the occlusion patterns in successive output frames may be changed in a certain order.

In the embodiment of the present invention, the display image may be a display image that the terminal needs to output. The receiving module 510 receives display images to be output frame by frame. The determination module 520 determines an occlusion pattern for each frame of the display image. The occlusion pattern may be used to occlude part of the information of the displayed image.

The occlusion pattern of each frame occludes a portion of the pixels of the corresponding frame display image, and the occlusion patterns of successive frames may change in a certain order. And determining that each pixel of the display image is not shielded by the shielding pattern at least once in the specified continuous frame output image according to the frame number of the image output by the terminal for one second, wherein in order to meet the requirements of users, the display image of the display part which is not shielded by the shielding pattern in each frame meets the visual retention principle, so that the users can see the complete display image. That is, when the preset frame rate satisfies the time for the user to visually stay, and N frames of images are output continuously, the user can see the next frame of image while the previous frame of image remains in the user's sight line, so that the user can see the complete display image.

Wherein, in the embodiment of the invention, N is the number of frames per second of the display image output by the terminal.

And the terminal superposes the display image of each frame and the shielding pattern of the display image of the corresponding frame to form a final output image.

Therefore, the technical scheme of the embodiment of the invention discloses that the shielding pattern is set for the display image of each frame, and the shooting equipment which is not matched with the output frame rate of the terminal cannot acquire the display content of the terminal through shooting.

Alternatively, as another embodiment of the present invention, each pixel of the display image is not occluded by the occlusion pattern at least once in the output images of the N frames of continuous output.

Specifically, each frame of the occlusion pattern can occlude different parts of the content in the display image.

Optionally, in an embodiment of the present invention, the determining module 520 is specifically configured to,

In the embodiment of the present invention, n is a previous frame signal in the continuously received frame signals, and n +1 is a frame signal after the nth frame signal in the continuously received frame signals. The first direction is any one preset direction of the terminal. After the determining module 520 determines the blocking pattern for the display image received by the previous frame receiving module 510, the determining module 520 moves along the preset first direction according to the blocking pattern determined by the previous frame, and uses the moved blocking pattern as the blocking pattern of the next frame, where the pixel of the display image that is not blocked by the blocking pattern of the next frame may be the pixel of the display image that is blocked by the blocking pattern of the previous frame.

It should be understood that in the inventive embodiment, the contents of the display images blocked by the blocking patterns in the output patterns of two consecutive frames may partially overlap.

In the embodiment of the present invention, the shielding pattern is a regular-shaped grating pattern, and the grating pattern may be a transverse grating, a vertical grating, or an oblique grating or other grating-shaped patterns.

In the embodiment of the present invention, the blocking patterns in the consecutive frames may move in a certain direction, and the blocking patterns may move in a certain order in any direction, for example, may move at a predetermined speed.

It should also be understood that, in the embodiment of the present invention, when the shielding pattern satisfies the condition: each frame of shielding pattern shields a part of the corresponding frame of display image, each pixel of each frame of display image appears at least once in N frames of continuously output images, in the N frames of continuously output images, the display image of the non-shielding part of each frame of shielding pattern meets the visual retention principle, and when N is the number of frames of the output display image per second, the shielding pattern can move irregularly.

Optionally, as another embodiment of the present invention, when the shielding pattern is a grid-type pattern, the determining module 520 is further configured to determine a width of the grid-type pattern and a pitch of the grid-type pattern.

In an embodiment of the present invention, when the shielding pattern is a grid-type pattern, the determining module 520 may determine a width and a pitch of the grid-type pattern. For example, the determination module 520 determines the width and pitch of the bar-type pattern according to the size of the output image. In this embodiment, the blocking pattern may be a pattern of equal spacing, unequal spacing, equal width, and/or unequal width.

Optionally, as another embodiment of the present invention, the determining module 520 may be further configured to determine a color of the occlusion pattern for each frame.

In this embodiment of the present invention, the determining module 520 may set a color for each frame of the shielding pattern, where the color of each frame of the shielding pattern may be a fixed color or different colors.

In the embodiment of the present invention, the determining module 520 may further set a different visual effect for each frame of the shielding pattern, for example, the determining module 520 sets a different transparency for the shielding pattern, or the determining module 520 sets the shielding pattern to a special effect, for example, a ground glass effect.

Preferably, in the embodiment of the present invention, when the terminal turns on an occlusion pattern once, the determining module 520 sets the same color, the same transparency, and/or the same special effect for the occlusion pattern in each frame of output image of the time output, so as to reduce the stimulation of the color, the transparency, and/or the special effect change to the eyes, so as to protect the eyes. When the terminal opens the shielding pattern for multiple times, the determining module 520 may set the color, transparency and/or special effect of the shielding pattern to be inconsistent each time, so as to improve the user experience.

In this embodiment of the present invention, the determining module 520 may further adjust the brightness of the shielding pattern, for example, the terminal may adjust the brightness of the screen of the terminal display in combination with the brightness of the shielding pattern, and simultaneously adjust the brightness of the screen of the terminal display and the brightness of the shielding pattern, so as to improve the user experience.

In the embodiment of the present invention, the terminal may further adjust the brightness of the shielding pattern, for example, the determining module 520 may adjust the brightness of the screen of the terminal display in combination with the brightness of the shielding pattern, and simultaneously adjust the brightness of the screen of the terminal display and the brightness of the shielding pattern, so as to improve the user experience.

Fig. 6 is a schematic structural diagram of a determination module in a terminal according to another embodiment of the present invention.

In the embodiment of the present invention, as shown in fig. 6, the determining module 520 may include an encrypting unit 521, a coloring unit 522 and a filtering unit 523. The encryption unit 521 is used to set a mask pattern for each frame of the display image; the coloring unit 522 is used to set a color for the blocking pattern of each frame; the filtering unit 523 is configured to superimpose each frame of shielding pattern and the corresponding frame of display image to obtain a final output image.

It should be understood that, in the embodiment of the present invention, the determining module 520 may further provide other units according to the internal logic requirement, and is not limited in any way in the embodiment of the present invention.

Optionally, as another embodiment of the present invention, the determining module 520 is further configured to set each frame of the occlusion pattern to be distributed on a part of the display image or each frame of the occlusion pattern to be distributed on the whole display image.

Specifically, the shielding pattern of each frame may be distributed on the whole display image or on a part of the display image of the whole display image, that is, the shielding pattern of the terminal may shield a part of the area of the display screen of the terminal or shield a complete area of the display screen of the terminal. As shown in fig. 4.

It should be understood that, in the embodiment of the present invention, the shielding pattern is distributed in the middle position of the display image as an example, which is only for describing the technical solution of the embodiment of the present invention in detail, but not limiting the scope of the embodiment of the present invention.

In the embodiment of the present invention, when the occlusion pattern is distributed in a part of the display image, the occlusion pattern may also be distributed in a top position, a bottom position, a left position, a right position of the display image, or any possible position of the display image, which is not limited in the embodiment of the present invention.

Optionally, as another embodiment of the present invention, the receiving module 510 is further configured to receive an operation instruction input by a user, where the operation instruction is used to instruct to open the shielding pattern.

Specifically, in the embodiment of the present invention, the receiving module 510 receives an instruction for opening the occlusion pattern, which is input by a user, so as to set the occlusion pattern for each frame of the received display image according to the instruction.

In the embodiment of the invention, the operation instruction can be triggered by a user through a key on the terminal or a gesture on the terminal. For example, the terminal is a mobile phone, and the mobile phone can trigger the mobile phone to open the shielding pattern according to the fact that a user passes through a power key and an upper volume key; or the mobile phone triggers the mobile phone to open the shielding pattern by rotating the mobile phone according to the user.

It should also be understood that, in the embodiment of the present invention, the operation instruction may be triggered by a software switch or a specific program, besides being triggered by a key on the terminal, which is not limited in any way in the embodiment of the present invention.

Therefore, by adopting the terminal provided by the embodiment of the invention, the terminal can prevent the display image from being candid under the condition of meeting the user requirement by setting the shielding pattern for the display image of each frame and combining the visual dwell principle according to the frequency of the output signal of the terminal, so as to ensure the safety of the user using the terminal.

It should be noted that, in the embodiment of the present invention, the above-mentioned and other operations and/or functions of each module in the terminal 500 according to the embodiment of the present invention are respectively for implementing corresponding flows of each method in fig. 1, and are not described herein again for brevity.

Fig. 7 is a schematic configuration diagram of a terminal according to another embodiment of the present invention. The terminal 600 shown in fig. 7 includes a content caching module 710, a display output module 720, a processing module 730, a parallel display interface 740, a digital-to-analog conversion module 750, and a display module 760.

When the terminal receives an operation instruction of opening the shielding pattern input by a user, the specific process of outputting the image by the terminal is as follows:

the display output module 720 obtains the display image from the content buffer module 710, and sends the display image to the processing module 730 frame by frame, and the processing module 730 determines a shielding pattern for each frame of the display image according to the display image received frame by frame, and overlaps the shielding pattern with the display image to obtain an output image. The processing module 730 sends the output image to a digital-to-analog conversion module 750 through a parallel Display Interface (DSI) 740, converts a digital signal of the output image into an analog signal through the digital-to-analog conversion module 750, and outputs the analog signal to the Display module 760 for displaying the output image.

It should be noted that, in the embodiment of the present invention, the terminal 600 according to the embodiment of the present invention may correspond to an execution main body of the method 100 according to the embodiment of the present invention, and the above and other operations and/or functions of each module in the terminal 600 are respectively for implementing corresponding flows of each method in fig. 1, and are not described herein again for brevity

In this embodiment of the present invention, the processing module 730 includes the receiving module 510 and the determining module 520 in the terminal 500, and the processing module 730 may also implement the operations and/or functions of the receiving module 510 and the determining module 520 in the terminal 500, and for implementing the corresponding flow of the method 100 in fig. 1, details are not described herein for brevity. The processing module 730 further includes a sending module, configured to send the obtained output image to the digital-to-analog conversion module 750 through the parallel display interface 740.

Therefore, by adopting the terminal provided by the embodiment of the invention, the terminal can prevent the display image from being candid under the condition of meeting the user requirement by setting the shielding pattern for the display image of each frame and combining the visual dwell principle according to the frequency of the output signal of the terminal, so that the safety of the user using the terminal is ensured.

It should be further noted that, in the embodiment of the present invention, the processing module 730 is disposed between the display output module 720 and the parallel display interface 740, which is only for describing the technical solution of the embodiment of the present invention, and the technical solution of the present invention is not limited thereto.

In the embodiment of the present invention, the processing module 730 may also process each frame of the display image through a software algorithm to obtain an output image. For example, before the parallel display interface 740 packages the display image, the operation of the processing module 730 is executed, or before the display image enters the content cache module 710, the operation of the processing module 730 is executed, so as to complete the encryption of the display image, achieve the anti-candid shooting of the display image, and ensure the safety of the user.

Fig. 8 is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in fig. 8, the terminal 800 includes: a processor 810, a display 820, a memory 830, and a communication bus system 840. Wherein processor 810, display 820, and memory 830 are coupled via communication bus system 840. Wherein,

a memory 830 for storing instructions;

a processor 810 for calling instructions stored in the memory 830 to perform the following steps;

receiving display images frame by frame; determining an occlusion pattern of each frame of display image, wherein the occlusion pattern occludes a part of the display image; outputting images frame by frame, wherein the output images are the superposition of display images and shielding patterns corresponding to the display images;

and a display 820 for displaying an output image, wherein the output image is a superposition of the display image and the shielding pattern corresponding to the display image.

Each pixel of each frame of display image is not shielded by a shielding pattern at least once in N frames of continuously output images, the display image of the shielding pattern shielding part of each frame meets the visual retention principle in the N frames of continuously output images, and N is a positive integer. The vision dwell principle is that when a user looks at an image for a long time, the image is removed within a certain time period, and the user keeps the image in sight.

Specifically, in the embodiment of the present invention, the terminal outputs the display image according to the preset frame rate. The frame rate used by each terminal satisfies the visual dwelling principle. The processor 810 processes each frame of the received display image, superimposes the shielding pattern on the display image of each frame, and synthesizes a final output image. The occlusion pattern of each frame occludes only a portion of the pixels of the display image of the frame. Because partial pixels are shielded by the shielding pattern, each frame of output image is the superposition of the display image and the shielding pattern, and a certain frame of output image cannot present a complete display image, but a user can see the complete output image by combining a visual retention principle. Wherein the occlusion patterns in successive output frames may be changed in a certain order.

In the embodiment of the present invention, the display image may be a display image that the terminal needs to output. The processor 810 receives display images to be output frame by frame. The processor 810 determines an occlusion pattern for each frame of the display image. The occlusion pattern may be used to occlude part of the information of the displayed image.

The occlusion pattern of each frame occludes a portion of the pixels of the corresponding frame display image, and the occlusion patterns of successive frames may change in a certain order. And determining that each pixel of the display image is not shielded by the shielding pattern at least once in the specified continuous frame output images according to the frame number of the image output by the terminal for one second, wherein in order to meet the requirements of users, the display image of the display part which is not shielded by the shielding pattern in each frame meets the visual retention principle, so that the users can see the complete display image.

And the terminal superposes the display image of each frame and the shielding pattern corresponding to the display image to form a final output image.

It should be understood that, in the embodiment of the present invention, the processor 810 may be a Central Processing Unit (CPU), and the processor 810 may also be other general processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The bus system 840 may include a power bus, a control bus, a status signal bus, and the like, in addition to a data bus. For clarity of illustration, the various buses are designated as the bus system 840 in the figure.

In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 810. The steps of a method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 830, and the processor 810 reads the information in the memory and performs the steps of the method in combination with the hardware. To avoid repetition, it is not described in detail here.

Alternatively, in an embodiment of the invention, processor 810 is specifically configured to,

and moving the nth frame of shielding pattern along the first direction to obtain an N +1 th frame of shielding pattern, wherein the partial pixels of the display image shielded by the (N + 1) th frame of shielding pattern can be partial pixels of the display image not shielded by the nth frame of shielding pattern, and N is a positive integer from 1 to N-1.

In the embodiment of the present invention, n is a previous frame signal in the continuously received frame signals, and n +1 is a frame signal after the nth frame signal in the continuously received frame signals. The first direction is any one preset direction of the terminal. After the terminal determines the shielding pattern for the nth frame of display image, the terminal moves the shielding pattern of the nth frame of display image along a preset first direction, the moved shielding pattern is used as the shielding pattern of the (n + 1) th frame of display image, and the pixels of the display image which is not shielded by the (n + 1) th frame of shielding pattern can be all or part of the pixels of the display image shielded by the nth frame of shielding pattern.

It should be noted that, in the embodiment of the present invention, the occlusion patterns in the consecutive frames move in a certain direction, and the occlusion patterns may move in a certain order, for example, may move at a certain speed.

It should also be understood that, in the embodiment of the present invention, when the shielding pattern satisfies the condition: each frame of shielding pattern shields a part of the corresponding frame of display image, each pixel of each frame of display image is not shielded by the shielding pattern at least once in N frames of continuously output images, the display image which is not shielded by each frame of shielding pattern in the N frames of continuously output images meets the visual retention principle, N is the frame number of the display image output in each second, and the shielding pattern can move randomly, and the embodiment of the invention does not limit the method.

Alternatively, as another embodiment of the present invention, when the shielding pattern is a regular-shaped bar-type pattern, the processor 810 is further configured to determine a width of the bar-type pattern and a pitch of the bar-type pattern.

In an embodiment of the present invention, when the shielding pattern is a bar type pattern, the processor 810 may determine the width and the interval of the bar type pattern. For example, the processor 810 determines the width and pitch of the bar-type pattern according to the size of the output display image. In this embodiment, the blocking pattern may be a pattern of equal spacing, unequal spacing, equal width, and/or unequal width.

Optionally, as another embodiment of the present invention, the processor 810 may be further configured to determine a color of the occlusion pattern for each frame.

In this embodiment of the present invention, the processor 810 may set a color for each frame of the shielding pattern, and the color of each frame of the shielding pattern may be a fixed color or different colors.

In an embodiment of the present invention, the processor 810 may further set a different visual effect for each frame of the shielding pattern, for example, the processor 810 sets a different transparency for the shielding pattern, or the processor 810 sets the shielding pattern to a special effect, for example, a ground glass effect.

Preferably, in the embodiment of the present invention, when the terminal turns on the occlusion pattern once, the processor 810 sets the same color, the same transparency, and/or the same special effect for the occlusion pattern in each frame of output image of the time output, so as to reduce the stimulation of the color, transparency, and/or special effect change to the eye, so as to protect the eye. When the terminal opens the shielding pattern for multiple times, the processor 810 may set the color, transparency, and/or special effect of the shielding pattern to be inconsistent each time, so as to improve the user experience.

In this embodiment of the present invention, the processor 810 may further adjust the brightness of the shielding pattern, for example, the terminal may adjust the brightness of the screen of the terminal display in combination with the brightness of the shielding pattern, and simultaneously adjust the brightness of the screen of the terminal display and the brightness of the shielding pattern, so as to improve the user experience.

In the embodiment of the present invention, the terminal may further adjust the brightness of the shielding pattern, for example, the processor 810 may adjust the brightness of the screen of the terminal display in combination with the brightness of the shielding pattern, and simultaneously adjust the brightness of the screen of the terminal display and the brightness of the shielding pattern, so as to improve the user experience.

Optionally, as another embodiment of the present invention, the processor 810 is further configured to set the occlusion patterns of each frame to be distributed on a part of the display image or the occlusion patterns of each frame to be distributed on the whole display image.

Specifically, the shielding pattern of each frame may be distributed on the whole display image, or may be distributed on a part of the display image of the whole display image, that is, the terminal shielding pattern may shield a part of the display screen of the terminal, or may shield the display screen of the whole terminal. As shown in fig. 4.

Optionally, as another embodiment of the present invention, the processor 810 is further configured to receive an operation instruction input by a user, where the operation instruction is used to instruct to turn on the shielding pattern.

Specifically, in the embodiment of the present invention, the processor 810 receives an instruction to turn on the occlusion pattern, which is input by a user, so as to set the occlusion pattern for each frame of the received display image according to the instruction.

It should be noted that, in the embodiment of the present invention, the terminal 800 in the embodiment of the present invention may correspond to the terminal 500 in fig. 5, and the above and other operations and/or functions of each module in the terminal 800 according to the embodiment of the present invention are respectively for implementing corresponding flows of each method in fig. 1, and are not described herein again for brevity.

In another embodiment of the invention, a non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device comprising a display, cause the portable electronic device to perform the following:

receiving display images frame by frame;

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the unit is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may also be an electric, mechanical or other form of connection. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention. In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium. Based on such understanding, the technical solution of the present invention essentially contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and various equivalent modifications or substitutions can be made by those skilled in the art within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. An image processing method applied to a portable electronic device having a display, the method comprising:

receiving display images frame by frame;

when the display image comprises the privacy information of the user, receiving a first input initiated by the user, and starting to set a shielding pattern for the display image according to the first input;

determining the shielding pattern of each frame of display image, wherein the shielding pattern shields partial pixels of the display image;

outputting images frame by frame, wherein the output images are the superposition of the display images and the shielding patterns corresponding to the display images, each pixel of each frame of display images is not shielded by the shielding patterns at least once in the output images continuously output by N frames, and the shielding patterns of the continuous frames are different;

when the electronic equipment opens the shielding pattern for multiple times, the color and the transparency of the shielding pattern are inconsistent every time; the shielding pattern comprises a plurality of opaque areas and a plurality of transparent areas, and the opaque areas and the transparent areas are alternately arranged; and receiving a second input initiated by a user, and closing the setting of the shielding pattern for the display image according to the second input.

2. The method according to claim 1, wherein each pixel of the display image appears unobstructed by an obstruction pattern at least once in the output images output in N frames in succession.

3. The method of claim 2, wherein the determining the occlusion pattern of the display image comprises:

4. The image processing method according to any one of claims 1 to 3, wherein when the shielding pattern is a bar-type pattern, the method further comprises:

5. An image processing apparatus, characterized in that the apparatus comprises:

a receiving module for receiving the display image frame by frame;

the receiving module is further used for receiving a first input initiated by a user when the display image comprises the privacy information of the user, and starting setting a shielding pattern for the display image according to the first input;

a determining module, configured to determine the occlusion pattern of each frame of the display image, where the occlusion pattern occludes a part of pixels of the display image;

the output module is used for outputting images frame by frame, the output images are the superposition of the display images and the shielding patterns corresponding to the display images, each pixel of each frame of display images is not shielded by the shielding patterns at least once in the output images continuously output by N frames, and the shielding patterns of the continuous frames are different;

when the electronic equipment opens the shielding pattern for multiple times, the color and the transparency of the shielding pattern are inconsistent every time; the shielding pattern comprises a plurality of opaque areas and a plurality of transparent areas, and the opaque areas and the transparent areas are alternately arranged;

and receiving a second input initiated by a user, and closing the setting of the shielding pattern for the display image according to the second input.

6. The apparatus of claim 5, wherein each pixel of the display image appears unobstructed by an unobstructed pattern at least once in N frames of the successively output images.

7. The apparatus of claim 6, wherein the means for determining is specifically configured to,

8. The apparatus according to any one of claims 5 to 7, wherein when the shielding pattern is a grid-type pattern, the determining module is further configured to determine a width of the grid-type pattern and a pitch of the grid-type pattern.

9. A portable electronic device, characterized in that the portable electronic device comprises:

a display for displaying an image;

a memory to store instructions;

a processor to invoke instructions stored in the memory to implement:

receiving display images frame by frame;

10. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device comprising a display, cause the portable electronic device to perform the following:

receiving display images frame by frame;

when the electronic equipment opens the shielding pattern for multiple times, the color and the transparency of the shielding pattern are inconsistent every time; each frame of the shielding pattern comprises a plurality of opaque areas and a plurality of transparent areas, wherein the opaque areas and the transparent areas are alternately arranged;