KR20180116866A - System and method for preventing information leakage through screen - Google Patents

Abstract

The present invention relates to a system and a method to prevent an information spill through a screen. The system to prevent an information spill through a screen includes: a screen providing visual content to a user; a photographing device photographing the content provided by the screen; a photography detection device detecting whether the photographing device photographs the content or not; and a control device watermarking the content on the screen if the photography detection device detects that the photographing device photographs the screen. According to the present invention, the information spill prevention system is capable of preventing nonpermitted capturing of important information while incapacitating photography in the event of capturing, and enabling only a permitted user to open the information through face recognition, thereby enhancing security.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for preventing leakage of information through a screen,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for preventing information leakage through a screen, and more particularly, to a system and method for preventing information leakage through a screen that can prevent an image file photographed by a camera, a smart phone, .

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

According to some reports, 27% of the 500 companies were affected by confidential data leaks, and 50.6% (253) of the companies did not have regulations or guidelines for security management. In addition, 64.5% of employees who have never received security education have left the company with their own data when leaving the company.

The information leakage prevention solution can be classified into two types: a leakage prevention through a network and an external storage device, and a method in which the leakage can be prevented from being read from the outside through a file encryption.

As information leakage becomes more difficult due to the existing security solution, accidents that leak image information from image files captured by screen capture, camera or smart phone are increasing steadily. In particular, operational confidentiality of military organizations, design drawings of power plants, important information of ships, automobiles, semiconductors, and documents containing personal information are continuously leaked through capturing or shooting, but there is no solution to defend at present .

The existing anti-capture solution does not support the latest DirectX graphics engine and does not support the latest OS and latest application.

On the other hand, recent attempts to introduce artificial intelligence into various fields of information technology to solve problems in the field have been actively made. Among them, artificial intelligence image recognition technology has achieved remarkable achievements in various industries due to the combination of machine learning, especially deep learning.

The present invention proposes a system and method for preventing information leakage through a screen, which can solve technical restrictions on the screen security by applying artificial intelligent image recognition technology.

[Prior Art Literature]

[Patent Literature]

(Patent Document 1) Published Korean Patent No. 10-1319562, October 12, 2012 (Name: Digital Content Spill Prevention System and Method)

(Patent Document 2) Published Korean Patent No. 10-1311286, April 19, 2013 (Name: Apparatus and Method for Displaying Watermark on the Screen)

(Patent Document 3) Korean Laid-open Patent Application No. 2014-0061215, published May 21, 2014 (name: method and electronic device for controlling display device using watermark)

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the problems of the related art described above, and it is a main object of the present invention to provide a system and method for preventing information from being leaked through a screen for preventing unauthorized capturing of important information, .

It is another object of the present invention to provide a system and method for preventing leakage of information through a screen, which can enhance security by allowing authorized users to view important information through facial recognition.

It is another object of the present invention to provide a system and method for preventing information leakage through a screen that can enhance a user's security consciousness by displaying a watermark containing user information and PC information when attempting screen unauthorized capture.

The problems to be solved by the present invention are not limited to those mentioned above, and another problem to be solved can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a system for preventing information leakage through a screen for providing screen security, the system comprising: a screen for providing visual contents to a user; A photographing device that attempts to photograph the contents provided on the screen; A photographing sensing device for sensing whether the photographing device is photographed; And a control device for watermarking the content provided on the screen when the image sensing device senses a screen image capturing of the image sensing device.

According to another aspect of the present invention, there is provided a method of preventing information leakage through a screen that provides screen security, comprising: displaying a content on a screen by executing a file including visual contents; Determining whether content to be executed in the control device is a security target; If the content to be executed is a file to be protected, driving the image sensing apparatus; Detecting a photographing attempt of the photographing apparatus in the photographing sensing apparatus; And watermarking the content to be executed on the screen by the control device when a photographing attempt of the photographing device is detected by the photographing sensing device.

According to another aspect of the present invention, there is provided a method of preventing information leakage through a screen that provides screen security, comprising: displaying a content on a screen by executing a file including visual contents; Determining whether content to be executed in the control device is a security target; If the content to be executed is a file to be protected, driving the image sensing apparatus; Detecting a face image of a user viewing the content in the image sensing apparatus and determining whether the user is an authorized user; And displaying the watermarked content screen as it is if the user viewing the content is an authorized user as a result of the facial image analysis and watermarking the content if the user is not an authorized user And a method for preventing information leakage through the network.

According to the system and method for preventing information leakage through the screen of the present invention, it is possible to prevent unauthorized capturing of important information and to recognize it when attempting to capture and to disable the shooting.

In addition, there is an effect that security can be strengthened by enabling only an authorized user to view important information through facial recognition.

In addition, when a screen-unauthorized capture is attempted, a watermark containing user information and PC information is displayed, thereby enhancing the security consciousness of the user.

The effects obtained in the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description .

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the technical features of the invention.
1 is a diagram illustrating an overall configuration of an information leakage prevention system through a screen according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a photographing sensing unit according to an embodiment of the present invention.
3 is a diagram illustrating a system for protecting an information leakage through a screen and a process for protecting screen information according to an embodiment of the present invention.
4 (a) is a diagram illustrating a screen prior to screen watermarking according to an embodiment of the present invention.
4 (a) is a diagram illustrating a screen after screen watermarking according to an embodiment of the present invention.
5 is a diagram illustrating an overall configuration of an information leakage prevention system through a screen according to another embodiment of the present invention.
6 is a diagram illustrating a method for preventing information leakage through a screen according to an embodiment of the present invention.
7 is a diagram illustrating a method for preventing information leakage through a screen according to another embodiment of the present invention.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description, together with the accompanying drawings, is intended to illustrate exemplary embodiments of the invention and is not intended to represent the only embodiments in which the invention may be practiced. The following detailed description includes specific details in order to provide a thorough understanding of the present invention. However, those skilled in the art will appreciate that the present invention may be practiced without these specific details.

In some instances, well-known structures and devices may be omitted or may be shown in block diagram form, centering on the core functionality of each structure and device, to avoid obscuring the concepts of the present invention.

Throughout the specification, when an element is referred to as "comprising" or " including ", it is meant that the element does not exclude other elements, do. Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have. Also, the terms " a or ", "one "," the ", and the like are synonyms in the context of describing the invention (particularly in the context of the following claims) May be used in a sense including both singular and plural, unless the context clearly dictates otherwise.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions in the embodiments of the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout this specification.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a diagram illustrating an overall configuration of an information leakage prevention system through a screen according to an embodiment of the present invention.

The screen 100 is a video display device that displays visually perceivable contents. The screen 100 may be a monitor of a desktop or a notebook computer, but may be a tablet PC (Tablet PC), a smart phone, , A portable multimedia player (PMP), a mobile internet device (MID), a multimedia terminal, and the like.

The photographing apparatus 200 is an information processing apparatus capable of recording an image that attempts to flow out visual content displayed on the screen 100 through photographing.

The photographing apparatus 200 may be mainly a camera but may be a camera such as a tablet computer including other camera modules, a smart phone, a mobile phone, a Portable Multimedia Player (PMP), a Mobile Internet Device (MID) Device.

The photographing sensing apparatus 110 is a device that senses that the photographing apparatus 200 attempts to outflow visual content information displayed on the screen 100.

The photographing sensing apparatus 110 analyzes an image or a video inputted through a camera apparatus installed in the vicinity of the screen 100 to discriminate whether the photographing apparatus 200 is attempting to photograph the direction toward the screen 100 .

2, the image sensing apparatus 110 includes an image sensing unit 111 for sensing a still image or a moving image, an image analyzing unit 112 for analyzing the image sensed by the image sensing unit 111, And a situation analyzer 113 for analyzing contexts or contexts through the images photographed by the unit 111. [

The image analysis unit 112 may be an artificial intelligence (AI) solution such as Google Cloud Vision, Be My Eyes, Aipoly, and the like.

The shooting sensing apparatus 110 may be provided with a deep learning based on a video flow such as an optical flow, a three-dimensional extended HOG, a Harris Corner, a SURF, or a convolutional neural network Can be applied.

Deep Learning is a machine learning technology that allows a computer to collect or classify objects or data by themselves. The human brain finds patterns in a lot of data and then identifies them, and imitates them so that the computer learns the machine so that it can discern things. The higher the amount of learning material, the finer the learning step, the better the performance of the deep learning.

When the screen 100 is a monitor of a notebook computer, the image sensing apparatus 110 may be a camera module integrally installed on the notebook monitor and a software module analyzing the camera module.

The control unit 120 controls the driving of the image sensing apparatus 110, and when the image sensing apparatus 110 detects a screen information outflow attempt, it captures and stores the image. The control device 120 transmits the image photographed by the photographing sensing device 110 to the management server 300 when necessary. The control device 120 may be an operating system (OS), an application program, and a process device that drives each configuration, such as a CPU (Central Processing Unit), an MCU (Micro Controller Unit), or an MPU (Micro Processor Unit).

The control device 120 can selectively drive the image sensing device 110 only when the time content displayed on the screen 100 includes security information, instead of always driving the image sensing device 110.

The management server 400 receives the image information of the photographing apparatus 200 photographed by the photographing sensing apparatus 110, the image information of the photographer, the content information displayed on the screen 100, Manage information leakage.

The control unit 120 and the management server 300 are connected to each other through a network. The network includes a Code Division Multiple Access (CDMA), a Wideband Code Division Multiple Access (WCDMA), a Global System for Mobile Communications (GSM) Evolution), as well as a global public communication network such as the Internet, a wide area network (WAN), a local area network (LAN), an intranet, Lt; / RTI >

3 is a diagram illustrating a system for protecting an information leakage through a screen and a process for protecting screen information according to an embodiment of the present invention.

When the photographing apparatus 200 is attempted to be photographed while the photographing apparatus 110 is being driven, the control apparatus 120 shades the screen 100 to a screen watermark layer so as to disable capturing or photographing the contents of the contents being browsed Watermarking.

A watermark, which is a special type of display that is not visible to the naked eye, is often referred to as a print watermark. In contrast, the digital watermark of the present invention is a digital watermark, (ID) or information, or inserts a specific code or type into a signal such as video or audio. Digital watermarks can be very effective in locating the origin or clone path of the original without any hindrance to the user viewing the image or using the software.

In the embodiment of the present invention, when the photographing of the contents requiring security is detected, the image information of the photographing apparatus 200 photographed by the photographing sensing apparatus 110, the image information of the photographer, Content information, and the like are combined to create a screen watermark layer and overlay it on the screen in a layered manner.

FIG. 4A is a diagram illustrating a screen prior to screen watermarking according to an embodiment of the present invention. FIG. 4A is a view illustrating a screen after screen watermarking according to an embodiment of the present invention. FIG. to be.

5 is a diagram illustrating an overall configuration of an information leakage prevention system through a screen according to another embodiment of the present invention.

When the content displayed on the screen 100 is information requiring a security level, the control device 120 drives the image sensing device 110 to photograph the face of the user viewing the content.

When the image analyzing unit 112 analyzes the image of the face detected by the image sensing unit 111 of the image sensing apparatus 110 and the user viewing the content is the authorized user, The screen that is not watermarked is displayed as it is.

However, if the user is not an authorized user, the watermarked screen is displayed as shown in FIG. 4 (b) to protect the information. In addition, the controller 120 transmits an image of a face of the unauthorized user sensed by the image sensing unit 111, content information for attempting to browse, and the like to the management server 300.

In the case where the content displayed on the screen 100 is of a grade requiring security in addition to the above-mentioned method, watermarking is basically performed and displayed. When the content detected by the image sensing unit 111 and analyzed by the image analysis unit 112, It is possible to implement watermarking by allowing watermarking only when the user is an authorized user.

6 is a diagram illustrating a method for preventing information leakage through a screen according to an embodiment of the present invention.

When the user executes the file containing the content and browses the content displayed on the screen 100 (S601), the control device 120 determines whether the content to be executed is a security target (S603).

If the content to be executed is a security target file, the image sensing apparatus 110 is driven for content security (S605).

When the photographing sensing apparatus 110 senses the photographing attempt of the photographing apparatus 200 in step S607, the image information of the photographing apparatus 200 photographed by the photographing sensing apparatus 110, the image information of the photographing person, A screen watermark layer is created by combining the displayed content information and the like and overlayed on the screen in a layered manner and watermarked (S609).

The control device 120 transmits the image information of the photographing device 200 photographed by the photographing sensing device 110, the image information of the photographer, the content information displayed on the screen 100, and the like to the management server 300, Information leakage is managed (S611).

7 is a diagram illustrating a method for preventing information leakage through a screen according to another embodiment of the present invention.

When the user executes the file containing the content and browses the content displayed on the screen 100 (S701), the control device 120 determines whether the content to be executed is a security target (S703).

If the content to be executed is a security object file, the image sensing apparatus 110 is driven for content security (S705).

The driven image sensing apparatus 110 senses the face image of the user viewing the content and determines whether the user is an authorized user (S707). More specifically, the facial image of the user sensed by the image sensing unit 111 is analyzed by the image analysis unit 112 using a deep learning-based image recognition technique.

As a result of the image analysis, if the user viewing the content is an authorized user, the screen which is not watermarked is displayed as it is, as shown in Fig. 4 (a). However, if the user is not an authorized user, the watermarked screen is displayed as shown in FIG. 4B to protect the information (S709).

In addition, the control device 120 transmits an image of a face of the unauthorized user sensed by the image sensing unit 111, content information for attempting to browse, and the like to the management server 300 (S711).

In the case where the content displayed on the screen 100 is of a grade requiring security in addition to the above-mentioned method, watermarking is basically performed and displayed. When the content detected by the image sensing unit 111 and analyzed by the image analysis unit 112, It is possible to implement watermarking by allowing watermarking only when the user is an authorized user.

6 and FIG. 7, steps S601 to S611 and steps S701 to S711 are sequentially executed. However, this is merely an example of the technical idea of the present embodiment, Those skilled in the art will understand that those skilled in the art can change or execute the procedures described in Figs. 6 and 7 without departing from the essential characteristics of the embodiment, or execute one or more of steps S601 to S611, step S701 to step S711 in parallel And FIG. 7 is not limited to the time-series order. For example, in step S703 and subsequent steps, watermarking in step S709 may be performed.

Each block of the block diagrams attached hereto and combinations of steps of the flowchart diagrams may be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus so that the instructions, which may be executed by a processor of a computer or other programmable data processing apparatus, And means for performing the functions described in each step are created. These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible for the instructions stored in the block diagram to produce a manufacturing item containing instruction means for performing the functions described in each block or flowchart of the block diagram. Computer program instructions may also be stored on a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible that the instructions that perform the processing equipment provide the steps for executing the functions described in each block of the block diagram and at each step of the flowchart.

Also, each block or each step may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially concurrently, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas falling within the scope of the same shall be construed as falling within the scope of the present invention.

100: screen 110: photographing sensing device 111: image sensing unit
112: image analysis unit 113: situation analysis unit 120: control device
200: photographing apparatus 300: management server

Claims (12)

A system for preventing information leakage through a screen providing screen security,
A screen providing visual content to the user;
A photographing device that attempts to photograph the contents provided on the screen;
A photographing sensing device for sensing whether the photographing device is photographed; And
And a control device for watermarking the content provided on the screen when the image sensing device senses screen shooting of the image sensing device,
And an information leakage prevention system for protecting information leakage through the screen. The method according to claim 1,
Further comprising a management server for receiving and managing the information of the photographing apparatus sensed by the photographing sensing apparatus and the content information attempting to photograph the control apparatus from the control apparatus. The method according to claim 1,
Wherein the control device drives the image sensing device when the content provided on the screen is a security target. The method according to claim 1,
Wherein the photographing sensing device comprises:
An image sensing unit for sensing a still image or a moving image;
An image analyzer for analyzing an image photographed by the image sensing unit;
And a situation analyzer for analyzing contexts or contexts through the images captured by the image sensing unit. 5. The method of claim 4,
Wherein the photographing sensing device comprises:
And analyzing that the photographing is attempted when the image of the photographing device and the photographing situation are detected through a deep run-based image analysis. The method according to claim 1,
In the watermarking,
A screen watermark layer is created by combining the image information of the photographing device photographed by the photographing device, the image information of the photographer, and the content information displayed on the screen, and overlays it on a screen in a layered manner. And the watermark information is watermarked. A method for preventing information leakage through a screen providing screen security,
Executing a file containing visual content and displaying the content on a screen;
Determining whether content to be executed in the control device is a security target;
If the content to be executed is a file to be protected, driving the image sensing apparatus;
Detecting a photographing attempt of the photographing apparatus in the photographing sensing apparatus; And
And watermarking the content to be executed on the screen by the control apparatus when the photographing sensing apparatus senses an attempt of photographing apparatus
The information leakage prevention method comprising the steps of: 8. The method of claim 7,
The watermarking step generates a screen watermark layer by combining the image information of the photographing device photographed by the photographing sensing device, the image information of the photographer, and the content information displayed on the screen, Wherein the screen is overlaid and watermarked on the screen. 8. The method of claim 7,
The control device further includes a step of transmitting the image information of the photographing device photographed by the photographing sensing device, the image information of the photographer, and the content information displayed on the screen to the management server so as to manage the screen information leakage A method for preventing information leakage through a screen. A method for preventing information leakage through a screen providing screen security,
Executing a file containing visual content and displaying the content on a screen;
Determining whether content to be executed in the control device is a security target;
If the content to be executed is a file to be protected, driving the image sensing apparatus;
Detecting a face image of a user viewing the content in the image sensing apparatus and determining whether the user is an authorized user; And
If the result of the facial image analysis is that the user who is viewing the content is an authorized user, the content screen that is not watermarked is displayed as it is, and watermarking the content if the user is not an authorized user
The information leakage prevention method comprising the steps of: 11. The method of claim 10,
Wherein the facial image analysis analyzes the facial image sensed by the image sensing unit included in the photographing sensing device by a deep learning based image recognition technique in an image analyzing unit. 11. The method of claim 10,
Wherein the control device further comprises a step of transmitting, to the management server, the image of the face of the unauthorized user detected by the photographing sensing device, and the content information attempting to browse the information.

Images