RU2758666C1 - Method and system for protection of digital information displayed on the screen of electronic apparatuses using dynamic digital tags - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: invention relates to the area of protection of digital data. A computer-implemented method for protection of data displayed on the screen of a computing apparatus (CA), executed by a processor and containing the stages of: forming a digital tag (DT) in the form of a data block containing encoded information at least identifying the user of the CA, wherein the encoded information is presented in the form of dynamic graphic elements scanning the area of placement thereof on the screen of the CA; forming an invisible protective layer consisting of a set of said data blocks, covering most of the display area of the screen of the CA, and impose the protective layer on the display area of the screen of the CA.

EFFECT: increasing the stability of information protection due to the change in the brightness characteristic by a given value of the formed protective layer based on digital tags.

15 cl, 8 dwg

Description

FIELD OF TECHNOLOGY

[0001] The claimed technical solution relates to the field of protecting digital data, in particular confidential and sensitive information displayed on the screen of an electronic device, by embedding digital tags (DM).

LEVEL OF TECHNOLOGY

[0002] The use of digital brains in the field of digital information protection is a common solution, in which encoded information is embedded in the image, allowing to identify its belonging or the person responsible for its leakage and / or unauthorized access.

[0003] Typically, such approaches use a given graphic element or area of an image containing a digital brain. Moreover, such a mark can be both distinguishable and indistinguishable to the human eye. One example of an indistinguishable mark is steganography.

[0004] An analogue of the proposed solution is the principle of forming a protective layer based on the CM, disclosed in US patent 9,239,910 (Markany Inc, 01.19.2016). The solution is to create an invisible protective layer consisting of digital labels, which is used as a background layer, displayed on the device screen and invisible to the user.

[0005] The disadvantage of the existing approach is its insufficient efficiency due to the fact that for the formation of the protective layer, a CM is used, which is a text or graphic primitive selected from a database and used for subsequent generation of filling the space. This leads to the fact that such layer formation becomes sensitive to quality and during the subsequent capture of the image on the screen using an external device, for example, a smartphone or camera camera, when changing the angle or capturing a part of the screen with a protective layer, subsequently removing the CM and establishing the fact of leakage data becomes complex or impossible.

SUMMARY OF THE INVENTION

[0006] The proposed approach allows to solve the technical problem, which consists in the low stability (robustness) of the method of protecting digital data when they are fixed by external means from different angles and quality of shooting, which leads to a decrease in the effectiveness of this principle of protecting digital data.

[0007] The technical result consists in increasing the efficiency of the method for protecting digital data on device screens, by increasing the stability of digital marks during their dynamic scanning of the area of placement on the screen with the formation of an invisible protective layer.

[0008] The claimed result is achieved by implementing a computer-implemented method of a computer-implemented method of protecting data displayed on the screen of a computing device (VD), executed by a processor and containing the steps at which:

form a digital mark (CM) in the form of a data block containing encoded information at least identifying the user of the VC, and the encoded information is presented in the form of dynamic graphic elements that scan the area of their placement on the screen of the VC;

forming an invisible protective layer, consisting of a set of said data blocks, covering a large part of the display area of the VC screen, and applying the protective layer to the display area of the VC screen.

[0009] In one of the particular examples of the implementation of the method, information about the date and time is additionally encoded in the CM.

[0010] In another particular embodiment of the method, when scanning with dynamic graphic elements, the color analysis of pixels in the area of their placement is carried out.

[0011] In another particular embodiment of the method, based on the color of the pixel, the brightness of the graphic element is corrected.

[0012] In another particular example of the implementation of the method, the correction is carried out based on the parameters of each pixel in the area of the graphic element in the RGB color scheme.

[0013] In another particular example of the implementation of the method, the RGB color scheme is converted to HSV with the calculation of the parameters of hue H, saturation S, and brightness V.

[0014] In another particular embodiment of the method, the obtained luminance parameter V is changed by the amount Δ.

[0015] In another particular embodiment of the method, the obtained luminance parameter V _Δ together with the parameters H and S are converted into an RGB color scheme.

[0016] In another particular embodiment of the method, the dynamics of displaying graphical elements is selected based on the refresh rate of the VC screen.

[0017] The claimed technical result is also achieved due to a computer-implemented method for processing protected data, which is performed using a processor and contains the steps at which:

an image is obtained containing at least part of a screen image with information protected by a method according to any one of claims. 1-9;

decoding information based on the digital brain from the resulting image, in which:

perform pixel-by-pixel decomposition of the image into threshold images;

identify the graphic elements that form the digital brain;

restoring information from the digital brain based on the bit sequence generated by the graphic elements.

{Р - Δр, Р + Δр}, где Р - текущий порог,

- дельта детекции порога.[0018] In one of the particular examples of the implementation of the method, each threshold image is formed as an averaged spectrum of the RGB palette of the corresponding threshold P, on the basis of which M - Δp images are created, on which each pixel of the image satisfies the condition

{Р - Δр, Р + Δр}, where Р - current threshold,

- delta detection threshold.

{S - Δs, …, S+Δs}, где S - насыщенность пикселя,

- дельта детекции насыщения.[0019] In another particular example of implementation of the method, when generating threshold images, each pixel is converted into HSV format, after which the saturation index S is extracted, on the basis of which N - Δs images are created, on which each pixel of the image satisfies the condition

{S - Δs, ..., S + Δs}, where S is the pixel saturation,

- saturation detection delta.

{V - Δv, V+Δv}, где V - яркость пикселя,

- дельта детекции яркости.[0020] In another particular example of the method, when generating threshold images, pixels are extracted from the processed image, each pixel is converted to the HSV format, and the brightness index V is extracted, on the basis of which N - Δv images are created, on which each pixel of the image satisfies the condition

{V - Δv, V + Δv}, where V is the pixel brightness,

- brightness detection delta.

[0021] The claimed solution is also implemented using a system for protecting data displayed on the screen of a computing device, which contains at least one processor and at least one memory containing machine-readable instructions that, when executed by the processor, implement the above methods.

BRIEF DESCRIPTION OF DRAWINGS

[0022] FIG. 1 illustrates the general principle of the stated solution.

[0023] FIG. 2 illustrates a block diagram of the claimed data protection method.

[0024] FIG. 3A illustrates an example of a cover data block.

[0025] FIG. 3B illustrates an example of placing a layer on a device screen.

[0026] FIG. 4 illustrates a flowchart of a method for decoding information from a DM-protected image.

[0027] FIG. 5 illustrates an example of capturing image information from a device screen.

[0028] FIG. 6 illustrates the principle of decoding a digital brain from an image.

[0029] FIG. 7 illustrates a general view of a computing device.

CARRYING OUT THE INVENTION

[0030] FIG. 1 shows the general concept of the technical implementation of the claimed solution. Protection of sensitive and / or confidential information displayed on the screen (111) of the user's computing device (VU) (110), for example, a computer, laptop, tablet, etc. ), into which the relevant information is encoded for the subsequent establishment of the place and the responsible person who leaked or unauthorized information outside the protected perimeter of the infrastructure, for example, by photographing, filming or capturing (screenshot) an image on the screen using external devices (smartphone, camera, etc. etc.), including with the subsequent printing of images with the information received. Each CM (10) is a block of data that forms an invisible protective layer (101) that covers most or all of the display area on the screen (111) of the TD (110).

[0031] As shown in FIG. 2, the claimed method (200) for protecting digital information contains a number of sequential steps. At the first stage (201), the formation of the CM (10) is carried out. Any type of information, for example, text, graphic, or their combinations, can be embedded in the digital brain (10) using binary (binary) data coding algorithms. CM (10) is formed from a set of graphic elements (11, 12) that encode information. The number of elements (11, 12) in each CM (10) can vary based on the amount of data to be encoded, for example, encoding 32 bits of information requires the formation of a CM block (10) of size 4 * 8. In the presented example of a digital brain (10), elements (11, 12) are presented in the form of oblique lines, however, their shape and principle of placement may be different, ensuring compliance with the principle of delimiting information coding in the form of logical 0s and 1s.

[0032] As a rule, the data embedded in the CM (10) is required to identify the VU (110) or directly the user of this device, for example, an employee who has access to sensitive information. Such data can be: personnel number, name, user photo, IP address, MAC address, unique identifier of the VU. This information can be used individually or in any combination. Additionally, information about the time and / or date can also be encoded, for example, the time of the formation of the CM (10), the current date. Information about the date and time can be dynamically changed to include the actual information during the coding of the CM (10).

[0033] The CM (10) is an element of the graphical interface of a given bit dimension, while the graphical elements (11, 12) forming the CM (10) are dynamic and perform constant or periodic scanning of their placement space. Space scanning is carried out based on the indicators of the screen refresh rate (111). One element (11) of the digital brain is a logical 0, the second (12) is a logical 1. The different principle of orientation of the elements (11, 12) allows to delimit them in space and form a pattern of the digital brain block (10) for encoding information inside it.

[0034] In step (202), a protective layer (101) is formed in the form of an arrangement of CMs (10) that fill most or all of the space of the screen (111). The number of CMs (10) is determined based on the screen resolution (111) and the CM dimension (10). As a rule, CMs (10) are chosen of equal dimension, but they can also have an alternating order of their placement to form a layer (101), which also does not violate the technical implementation of the claimed solution in terms of subsequent data identification during the decoding process.

[0035] The protective layer (101) is formed invisible (transparent) so as not to be visible to the human eye and to hide the fact of the application of data protection on the screen (111).

[0036] The transparency of the layer (101) of the created pattern from the CM (10) can be formed in various ways of adjusting graphic images, for example, by adjusting the opacity of the image (opacity), using the Alpha channel in the RGBA palette, using the Alpha channel in HSLA palette.

[0037] Also, in another particular aspect, the transparency of the layer (101) of the created pattern from the CM (10) is formed by changing the brightness characteristic (by a certain parameter - the brightness delta) of the pixels on which the mark will be applied.

[0038] The selection of parameters for the formation of the invisible layer (101) is performed to overcome the discrimination threshold (https://en.wikipedia.org/wiki/Just-noticeable_difference), making it invisible to a regular user.

[0039] After the formation of the protective layer (101) in step (203), it is superimposed on the display area of the screen (111) of the VD (110), so that the entire coverage area of the screen is covered by the superimposed layer (101). The use of this approach allows you to determine the value of the CM (10) in any area of the screen (111), regardless of the coordinate or scale of the screenshot or photocopy.

[0040] FIG. 3A-3B show an example of a formed protective layer (101) based on a plurality of CMs (10). The presented example of a digital brain (10) can be created using the encoding of information in the contrast channels of the color scheme, for example, RGB, HSL, ARGB, etc.

[0041] Each element (11, 12) of the PA (10) is dynamic and scans the space located behind it in order to prepare the visibility of the graphical elements (11, 12) pixel by pixel, ensuring their brightness is distinguished by a given delta. For this, a pixel P is taken in the image on the screen (111), for which its parameters P (R, G, B) are calculated. Then the parameters are converted into parameters P (H, S, V), after which the parameter V is extracted from P. Then the parameter V of the pixel P changes to delta d, V * = V +/- d, for example, d increases if V <0.5 and decreases if V is different. Moreover, if the pixels behind the graphic elements (11, 12) of the CM (10) have a dark shade, the program logic of the CM formation algorithm (10) increases the brightness, if the light one - decreases. Further, the pixel parameters P (H, S, V *) are converted to P (R, G, B) in the image. Due to this, each pixel of the mark has a brightness delta that is invisible to the human eye, but is subsequently recognized by the decoder. This makes it possible to control the stability of the formed protective layer (101) from the marks and at the same time make it indistinguishable from the user.

[0042] Next, consider the process of decoding the information protected by the CM shown in FIG. 4 to FIG. 6.

[0043] FIG. 4 illustrates a flowchart of a method (300) for decoding information from a captured image. At the first stage (301), an image (410) is supplied to the computing module (for example, a processor), which was made using an external device (400) and contains part or all of the information presented on the screen (111) of the VU (110), like this shown in FIG. 5.

[0044] Next, the acquired image (410) goes through a processing step (302). In the first step of step (302), the image is decomposed pixel by pixel into threshold images (step 3021) or thresholds. Threshold is the arithmetic mean of the RGB channel values of the image. Since the CM (10) is a homogeneous object with the same delta, which causes its manifestation in the image at a certain threshold value in an arbitrary region of the decoded image (410), which allows one to display well artifacts in the photograph caused by photographing the screen (111) , which has a certain refresh rate that does not coincide with the opening time of the aperture of the device (400), with the help of which a photo or video is taken. In this case, the CM itself (10) is an artifact.

{Р - Δр, …, Р + Δр}, где Р - текущий порог,

- дельта детекции порога.[0045] Each threshold image is formed as an averaged spectrum of the RGB palette of the corresponding threshold P, on the basis of which M - Δp images are created, on which each pixel of the image satisfies the condition

{Р - Δр, ..., Р + Δр}, where Р - current threshold,

- delta detection threshold.

{S - Δs, …, S + Δs}, где S - насыщенность пикселя,

- дельта детекции насыщения.[0046] Also, in another particular aspect, the formation of threshold images can be performed in a manner in which each pixel is converted to HSV format, after which the saturation index S is extracted, based on which N - Δs images are created, in which each pixel of the image satisfies the condition

{S - Δs, ..., S + Δs}, where S is the pixel saturation,

- saturation detection delta.

{V - Δv, …, V+Δv}, где V - яркость пикселя, Δv ∈ R - дельта детекции яркости.[0047] In another way, when generating threshold images, pixels are extracted from the processed image, each pixel is converted into HSV format, and the luminance index V is extracted, on the basis of which N - Δv images are created, in which each pixel of the image satisfies the condition

{V - Δv, ..., V + Δv}, where V is the pixel brightness, Δv ∈ R is the brightness detection delta.

[0048] At the next decoding step (3022), the graphic elements (11, 12) forming one or more digital brains (10) that have entered the image (410) are detected. During processing, the location of the elements (11, 12) is determined for subsequent accumulation and the formation of their sequence for step (3023), at which the information is restored from the CM based on the bit sequence formed by the identified graphic elements (11, 12).

[0049] The creation of a preprocessed image is carried out as follows. At each threshold, the locations of the recognized elements (11) and (12) are marked, they are stored in the device memory (RAM), while the designations for both elements (11) and (12) are different, for example, for (11) - red geometric figure (square), for (12) - green. On the new canvas (image) all the elements found above (11, 12) are placed from memory, and the placement takes place observing the color scheme described above. In the event of a collision, the choice of the geometric figure that has got to the given place the most times is carried out.

[0050] As shown in FIG. 6, as a result of decoding the preprocessed image (410), the CM (10) on the protective layer (101) is determined and information is extracted from the elements (11, 12), encoded into the CM bit sequence (10), according to which the belonging of the VU (110) to a specific employee is retrieved , as well as any other additional information encoded in the digital brain (10).

[0051] FIG. 7 shows a general view of a computing device (500) suitable for performing methods (200, 300). The device (500) can be, for example, a server or other type of computing device that can be used to implement the claimed technical solution. Including being part of a cloud computing platform.

[0052] In the General case, the computing device (500) contains one or more processors (501) united by a common bus of information exchange, memory means such as RAM (502) and ROM (503), input / output interfaces (504), input devices / output (505), and a device for networking (506).

[0053] The processor (501) (or multiple processors, multi-core processor) can be selected from a range of devices currently widely used, for example, Intel ™, AMD ™, Apple ™, Samsung Exynos ™, MediaTEK ™, Qualcomm Snapdragon ™ and etc. The processor (501) can also be a graphics processor, for example, Nvidia, AMD, Graphcore, etc.

[0054] RAM (502) is a random access memory and is intended for storing machine-readable instructions executed by the processor (501) for performing the necessary operations for logical processing of data. RAM (502), as a rule, contains executable instructions of the operating system and corresponding software components (applications, software modules, etc.).

[0055] ROM (503) is one or more persistent storage devices such as a hard disk drive (HDD), solid state data storage device (SSD), flash memory (EEPROM, NAND, etc.), optical storage media ( CD-R / RW, DVD-R / RW, BlueRay Disc, MD), etc.

[0056] Various types of I / O interfaces (504) are used to organize the operation of the components of the device (500) and to organize the operation of external connected devices. The choice of the appropriate interfaces depends on the specific version of the computing device, which can be, but are not limited to: PCI, AGP, PS / 2, IrDa, FireWire, LPT, COM, SATA, IDE, Lightning, USB (2.0, 3.0, 3.1, micro, mini, type C), TRS / Audio jack (2.5, 3.5, 6.35), HDMI, DVI, VGA, Display Port, RJ45, RS232, etc.

[0057] To ensure user interaction with the computing device (500), various I / O means (505) are used, for example, a keyboard, display (monitor), touch display, touch pad, joystick, mouse manipulator, light pen, stylus, touch panel, trackball, speakers, microphone, augmented reality, optical sensors, tablet, light indicators, projector, camera, biometric identification (retina scanner, fingerprint scanner, voice recognition module), etc.

[0058] The networking tool (506) allows the device (500) to transmit data via an internal or external computer network, for example, Intranet, Internet, LAN, and the like. One or more means (506) may be used, but not limited to: Ethernet card, GSM modem, GPRS modem, LTE modem, 5G modem, satellite communication module, NFC module, Bluetooth and / or BLE module, Wi-Fi module, and dr.

[0059] Additionally, satellite navigation aids can also be used as part of the device (500), for example, GPS, GLONASS, BeiDou, Galileo.

[0060] The presented application materials disclose preferred examples of the implementation of the technical solution and should not be construed as limiting other, particular examples of its implementation, not going beyond the scope of the claimed legal protection, which are obvious to specialists in the relevant field of technology.

Claims (23)

1. A computer-implemented method for protecting data displayed on the screen of a computing device (VU), performed by a processor and containing stages at which: - form a digital mark (CM) in the form of a data block containing encoded information, at least identifying the user of the VC, and the encoded information is presented in the form of dynamic graphic elements that scan the area of their placement on the screen of the VC; - form an invisible protective layer, consisting of a set of said data blocks, covering most of the display area of the VC screen, and - the overlay of a protective layer is performed on the display area of the VU screen. 2. The method according to claim 1, characterized in that additional information about the date and time is encoded in the CM. 3. The method according to claim 1, characterized in that when scanning with dynamic graphic elements, the color of pixels in the area of their placement is analyzed. 4. The method according to claim 3, characterized in that the brightness of the graphic element is adjusted based on the color of the pixel. 5. The method according to claim 4, characterized in that the correction is carried out based on the parameters of each pixel in the area of the graphic element in the RGB color scheme. 6. The method according to claim 5, characterized in that the RGB color scheme is converted to HSV with the calculation of the parameters of hue H, saturation S and brightness V. 7. The method according to claim 6, characterized in that the obtained brightness parameter V is changed by the value Δ. 8. The method according to claim 7, characterized in that the obtained luminance parameter V _Δ, together with the parameters H and S, are converted into an RGB color scheme. 9. The method according to claim 1, characterized in that the dynamics of displaying graphic elements is selected based on the refresh rate of the VC screen. 10. Computer-implemented method of processing protected data, performed using a processor and containing the stages at which: - get an image containing at least part of the screen image with information protected using the method according to any one of claims. 1-9; - carry out decoding of information on the basis of the digital brain from the obtained image, in which: perform pixel-by-pixel decomposition of the image into threshold images; identify the graphic elements that form the digital brain; restoring information from the digital brain based on the bit sequence generated by the graphic elements. 11. The method according to claim 10, characterized in that each threshold image is formed as an averaged spectrum of the RGB palette of the corresponding threshold P, on the basis of which M - Δp images are created, on which each pixel of the image satisfies the condition

where Р is the current threshold, Δр

- delta detection threshold. 12. The method according to claim 10, characterized in that during the formation of threshold images, each pixel is converted into HSV format, after which the saturation index S is extracted, on the basis of which N - Δs images are created, on which each pixel of the image satisfies the condition

where S is the saturation of the pixel,

- saturation detection delta. 13. The method according to claim 10, characterized in that during the formation of threshold images, pixels are extracted from the processed image, each pixel is converted to the HSV format, and the brightness index V is extracted, on the basis of which N - Δv images are created, on which each pixel of the image satisfies condition

where V is the brightness of the pixel,

- brightness detection delta. 14. A system for protecting data displayed on the screen of a computing device, comprising at least one processor and at least one memory containing machine-readable instructions, which, when executed by the processor, carry out the method according to any one of claims. 1-9. 15. A system for processing protected data, containing at least one processor and at least one memory containing machine-readable instructions, which, when executed by the processor, carry out the method according to any one of claims. 10-13.

Images