KR102444070B1 - Apparatus and method for censoring images - Google Patents

Abstract

An image censoring device of the present invention comprises: a display unit; a user interface unit; an image selection unit for selecting an image to be censored; an image censoring unit for determining at least one personal information leakage area included in the image to be censored; a masking unit for masking each of the personal information leakage areas to generate a censored image including at least one masked area and then displaying the censored image on the display unit; and a warning message display unit for storing at least one warning message preset for personal information leakage and displaying the warning message about an expected risk when the corresponding portion is disclosed for an area for which unmasking is requested among the at least one masked personal information leakage area. Therefore, users can conveniently use an image censorship service by automatically censoring personal information stored in an image when taking an image or selecting an image for storage or transmission. Users can be induced to be alerted and pay attention to information leakage in advance by displaying the warning message about the expected risk when the corresponding portion is disclosed.

Description

Image censorship device and method

The present invention relates to an image censoring apparatus and method, and more particularly, to an image censoring apparatus and method for censoring personal information included in a photographed or stored image using a digital device.

As the penetration rate of smartphones increases, people's use of SNS (Social Networking Service) is also increasing. In proportion to this, the frequency with which people exchange information, the speed at which information is transmitted, and the range of its spread have also greatly increased. In particular, the frequency of sharing image information such as selfies is increasing. For this reason, personal information through online is spreading rapidly.

However, users who want to share photos online rarely look carefully at the personal information contained in the photos one by one.

Therefore, the need for protecting personal information included in various photos is emerging, and various techniques for protecting personal information included in images are disclosed.

Korean Patent Registration No. 10-1952623 discloses a method and apparatus for providing a personal information protection-processed image service that hides a personal information area when a user provides an image (video, etc.) from a remote location desired by a user.

According to the above patent, the video requested by the requester is provided anytime and anywhere based on location information, but elements that can be personal information such as a person's face and vehicle license plate in the video are mosaicized and provided, thereby preventing controversy over privacy in advance. can

However, the conventional technologies as described above only function to cover the part where there is a risk of personal information leakage from the video or image when the video or image is shared through a specific server, and the video exchanged between individuals from time to time Or there was a problem that the personal information contained in the image could not be protected.

In addition, in the prior art, by not providing information about what kind of risk there is when the hidden part is disclosed, only a function to cover the part where there is a risk of personal information leakage from the video or image is included, so that users can use the information There was a problem in not feeling the alarm about the leak.

Korean Patent No. 10-1952623

Therefore, the present invention censors personal information stored in a photographed or stored image using a digital device based on preset censorship reference information, and masks an image area containing personal information to prevent leakage of personal information in advance. An image censorship device and a method for the same are provided.

In addition, the present invention allows users to conveniently use an image censorship service by automatically censoring personal information stored in the image when taking an image using a user-specific personal terminal device or selecting an image for storage or transmission. , to provide an image censorship device and method that can prevent mistakes in saving or transmitting uncensored images unknowingly.

In addition, the present invention does not censor the image at the server end, but censor the image using a personal terminal device for each user. An object of the present invention is to provide an image censorship device and method for preventing leakage.

In addition, the present invention expresses a warning about an expected risk when the corresponding part is disclosed to the area for which unmasking is requested among the masked areas, so that users feel alert and pay attention to information leakage in advance. An object of the present invention is to provide an image censorship device and method that can induce the user to do so, and thereby effectively block the leakage of personal information.

In order to achieve the above object, an image inspection apparatus provided by the present invention includes a display unit; a user interface unit providing an interface with a user; an image selection unit for selecting an image to be inspected from among images photographed or stored using a digital device based on image selection information input through the user interface unit; an image censoring unit that analyzes the censorship target image based on preset censorship reference information and determines at least one personal information leakage area included in the censorship target image; a masking unit for generating a censored image including at least one masking region by masking each of the personal information leakage regions, and then displaying the censored image on the display unit; and at least one warning message set in advance for personal information leakage, and for an area for which unmasking is requested among the masked at least one personal information leakage area, a warning message about the risk expected when the corresponding part is disclosed It is characterized in that it includes a warning text expression unit to express.

On the other hand, in order to achieve the above object, the image inspection method provided by the present invention is an image inspection method using an image inspection device including a user interface unit, a display unit, an image storage unit, an image photographing unit, and a communication interface unit, an image selection step of selecting an image to be inspected based on image selection information input through a user interface unit; an image censorship step of analyzing the censorship target image based on preset censorship reference information and determining at least one personal information leakage area included in the censorship target image; a masking step of generating a censored image including at least one masking region by masking each of the personal information leakage regions, and then displaying the censored image; And on the basis of at least one warning message set in advance for personal information leakage, for the area for which unmasking of the masked at least one personal information leakage area is requested, a warning statement about the expected risk when the corresponding part is disclosed It is characterized in that it includes a warning statement expression step to express.

As described above, the image censorship apparatus and method provided by the present invention censor personal information stored in a photographed or stored image using a digital device based on preset censorship reference information, and an image area including personal information There is an advantage of being able to block the leakage of personal information in advance by masking the

In addition, the present invention allows users to conveniently use an image censorship service by automatically censoring personal information stored in the image when taking an image using a user-specific personal terminal device or selecting an image for storage or transmission. , it has the advantage of preventing mistakes in saving or transmitting uncensored images without knowing it.

In addition, the present invention does not censor the image at the server end that receives the image through the communication network, but inspects the image using a personal terminal device for each user. It has the advantage of preventing the leakage of personal information included in the image.

In addition, the present invention can induce users to feel alert and to pay attention in advance to information leakage by expressing a warning about an expected risk when the corresponding part is disclosed for each of the masked areas, and , this has the advantage of effectively blocking the leakage of personal information.

1 is a system configuration diagram for explaining an interworking operation between systems of an image inspection apparatus according to an embodiment of the present invention.
2 is a schematic block diagram of an image inspection apparatus according to an embodiment of the present invention.
3 is a diagram illustrating an example of a data structure for a censorship reference information management DB according to an embodiment of the present invention.
4 to 8 are schematic processing flowcharts of an image inspection method according to an embodiment of the present invention.
9A to 9F are diagrams illustrating examples of a screen of a portable terminal according to an operation sequence of an image screening apparatus according to an embodiment of the present invention.
10 is a diagram for explaining a method of adding a masking area according to an embodiment of the present invention.
11A and 11B are diagrams for explaining an example of a masking type according to an embodiment of the present invention.
12A and 12B are diagrams illustrating examples of displaying a warning message for expressing an expected risk when a masking area is disclosed according to an embodiment of the present invention.
13 is a diagram illustrating an example of displaying a web page providing detailed information corresponding to a warning message according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings, but it will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily practice the present invention. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein. On the other hand, in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification. In addition, even if the detailed description is omitted, descriptions of parts that can be easily understood by those skilled in the art are omitted.

Throughout the specification and claims, when a part includes a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated.

1 is a system configuration diagram for explaining an interworking operation between systems of an image inspection apparatus according to an embodiment of the present invention. Referring to FIG. 1 , an image censoring apparatus 100 according to an embodiment of the present invention includes a server apparatus 200 that provides an arbitrary SNS service, and a terminal apparatus 300 of an individual (ie, another person) connected to a communication network. The image censoring apparatus 100 may include a communication interface for connecting to the server apparatus 200 and the personal terminal apparatus 300 through a communication network for this purpose. In particular, the image censoring apparatus 100 is portable and may be implemented as a communication terminal device (eg, a mobile phone, a tablet PC, etc.) including an image taking means, an image storage means, and a communication interface.

First, in step S10 , the image censoring apparatus 100 censors an image to be censored selected for censorship among images photographed or pre-stored using a digital device. In this case, image censorship means scanning the censorship target image to detect an area where personal information is expected to be leaked (hereinafter referred to as a 'personal information leak area'). The personal information leakage area refers to an area where personal information of another person or oneself is displayed unintentionally at the time of filming. can do.

In step S20, the image censoring device 100 stores the censored image generated as a result of the image censorship. In this case, the censored image refers to an image in which the personal information leakage area is masked. To this end, the image censorship apparatus 100 masks the personal information leakage area in which the face of another person or the vehicle number, etc. included in the censorship target image is displayed, but uses a sticker, mosaic, or blur technology to use the personal information The censorship image may be generated by masking the leaked area.

In steps S30 and S40 , the image censoring device 100 transmits the censored image selected for sharing with at least one other person to the server device 200 or the personal terminal device 300 .

2 is a schematic block diagram of an image censoring apparatus according to an embodiment of the present invention. Referring to FIGS. 1 and 2 , the image inspecting apparatus 100 according to an embodiment of the present invention includes an image management DB ( 10), censorship reference information management DB 20, user interface unit (I/F) 105, image photographing means 110, communication interface unit (I/F) 115, image selection unit 120, It includes an image inspection unit 125 , an inspection standard management unit 130 , a masking unit 135 , a warning display unit 140 , a display unit 145 , and a control unit 150 . In this case, the image management DB 10 and the censorship reference information management DB 20 may be mounted in the image censoring device 100 or configured to interwork with the image censoring device 100 from the outside.

The image management DB 10 stores at least one image. In particular, the image management DB 10 stores and manages a plurality of images photographed using a digital device.

The censorship reference information management DB 20 stores censorship reference information that is a reference for the image censorship apparatus 100 to censor an image. In particular, the censorship reference information management DB 20 may store censorship reference information including at least one censorship target serving as a criterion for determining a personal information leakage area, and preset censorship exclusion information.

At this time, the censorship target refers to information set in advance as a target that is judged to have a risk of personal information leakage when disclosed to others or unspecified large numbers of people, and the shape of a person's face ), or may include an arbitrary sequence of numbers that are continuous at least a predetermined number.

In addition, the censorship exclusion information refers to information that is preset not to be censored even if it falls under the censorship target, and may include at least one specific person's face or at least one specific number sequence.

An example of the data structure for the censorship reference information management DB 20 is illustrated in FIG. 3 . Referring to FIG. 3 , the censorship reference information management DB 20 may include a censorship target field 21 and an censorship exclusion information field 22 .

The user interface unit (I/F) 105 provides an interface with a user. That is, the user interface unit (I/F) 105 receives the user's selection information for controlling the operation of the image inspection apparatus 100 and transmits it to the control unit 150 . For example, the user interface unit (I/F) 105 transmits the user's selection information (aka, censorship criteria selection information) input to add or delete the censorship target or the censorship exclusion information to the control unit 150 . and the censorship standard information management DB 20 may add or delete the censorship target or the censorship exclusion information based on the censorship criterion selection information.

The image capturing means 110 captures an image based on the user's selection information. That is, the image capturing means 110 captures an image under the control of the control unit 150 that receives the user's selection information input through the user interface unit (I/F) 105 , and displays the result. It is transmitted to the control unit 150 .

The communication interface unit (I/F) 115 provides an interface with a communication network. That is, the communication interface unit (I/F) 115 provides an interface with an external communication network, and through this, exchanges information with the external server device 200 or the personal terminal device 300 , in particular, the control unit 150 ), the censorship image in which the personal information leakage area is masked may be transmitted to the server device 200 or the personal terminal device 300 to share with at least one other person.

The image selection unit 120 selects an image to be inspected based on the image selection information input through the user interface unit (I/F) 105 . That is, the image selection unit 120 selects an image to be inspected from among the images photographed or stored using a digital device, and selects the image photographed by the image photographing means 110 in real time or based on the image selection information. , one of images previously stored in the image management DB 10 may be selected as an image to be inspected.

The image inspector 125 inspects the image to be inspected based on preset inspection reference information. That is, the image censorship unit 125 scans the censorship target image based on the censorship reference information (ie, the censorship target and censorship exclusion information) stored in the censorship reference information management DB 20, and as a result, personal information An area in which leakage is predicted (hereinafter referred to as a 'personal information leakage area') is determined. For example, the image censoring unit 125 determines a region in which another person's face or vehicle number included in the censorship target image is displayed as the personal information leakage region.

At this time, the image censoring unit 125 may release the determined personal information leakage area based on a preset personal information leakage exception condition. That is, the image inspector 125 may release an area corresponding to the personal information leakage exception condition from among the areas determined as the personal information leakage area from the personal information leakage area. For example, the image censoring unit 125 recognizes one face with a face size larger than a preset face size from the censorship target image, or recognizes two or more faces. It is possible to release the area in which a large face of or a face larger than other faces is displayed from the personal information leakage area.

This is because it is determined that a face that meets the above conditions is an intended photographing target.

To this end, the image censoring unit 125 stores preset face size information, and when only one face shape is recognized from the censorship target image, when the size of the face shape is larger than the preset face size, the corresponding face The area in which the shape is displayed may be released from the personal information leakage area.

In addition, the image inspector 125 calculates the size of each of the two or more faces recognized from the image to be inspected and the average size of all of the two or more faces, and a predetermined time (eg, 1.2 times) than the average size. ) or larger faces can be released from the personal information leakage area. For example, as a result of the inspection by the image inspecting unit 125, five face shapes are recognized from the image to be inspected, the average size (ie, area) of all five face shapes is 1 cm 2 , and the five face shapes are When the size (ie, area) of one (ie, the first face) is 1.2 cm2, which is 1.2 times the average size, the area in which the first face is displayed may be released from the personal information leakage area.

The censorship standard management unit 130 manages the censorship standards stored in the censorship standard information management DB 20 . That is, the censorship standard management unit 130 controls the censorship standard information management DB 20 to control the censorship target or the censorship exclusion information based on the censorship criterion selection information input through the user interface unit (I/F) 105 . Control the censorship standard information management DB 20 to add or delete, but for this purpose, the censorship standard management unit 130 receives the censorship criterion selection information through the user interface unit (I/F) 105, the control unit 150 ) can be controlled.

The masking unit 135 generates a censored image by masking each of the regions determined as the personal information leakage region by the image inspecting unit 125 . At this time, the masking unit 135 masks each of the at least one personal information leakage area, but based on the masking selection information input through the user interface unit (I/F) 105 or preset masking information. A type and a masking level are determined, and a censorship image is generated by masking each of the personal information leakage areas based on the determination result. For example, the masking unit 135 may mask the personal information leakage area using any one of a sticker, a mosaic, and a blur technology, based on the determination result. Then, the masking unit 135 displays the censored image on the display unit 145 .

Meanwhile, the masking unit 135 may add or delete the masked area based on a masking addition or removal request input through the user interface unit (I/F) 105 . That is, the masking unit 135 performs automatic masking on all of the areas determined as the personal information leakage area, and based on the user's selection information confirming the result, the first masking result can be corrected. will be.

In addition, the masking unit 135 transmits the censored image to the server device 200 or at least one other terminal device 300 through the communication interface unit I/F, or to the image management DB 10 . Save. To this end, the masking unit 135 may provide the censored image to the control unit 150 .

The warning text display unit 140 stores at least one warning text (eg, infringement of portrait rights, exposure of personal information, exposure of personal identification number, etc.) preset for personal information leakage, and the masked at least one personal information leakage area For each of these, a warning statement about the expected risk when the relevant part is disclosed is expressed. At this time, the warning text display unit 140 may display a warning about the expected risk when the corresponding area is disclosed to the area for which unmasking is requested among the at least one masked personal information leakage area. Also, the warning text display unit 140 may display a schematic description for each of the warning texts together.

For example, if the region for which the masking is requested is a region including a face of an arbitrary person, the warning message display unit 140 displays a warning about the infringement of the right to portrait and personal information exposure, and the removal of the masking is requested. When the designated area is an area including an arbitrary numeric string, the warning text display unit 140 may display a warning text about exposure of the personal identification number.

At this time, the warning text display unit 140 may display the warning text on a specific area of the display unit 145 allocated for displaying the warning text, or display the warning text in a transparent or opaque pop-up form on the censored image. have.

In addition, the warning text display unit 140 stores, for each of the warning text, at least one link information for linking to a web page providing detailed information including legal information and case information corresponding to the warning text, and the warning text After automatically connecting to the web page in response to the user's request, the content may be displayed.

That is, the warning text display unit 140 connects to the corresponding web page using the link information in response to the detailed information request signal input through the user interface unit (I/F) 105, and then the contents of the web page may be displayed on the display unit 145 .

The display unit 145 may display information necessary for the operation of the image inspection apparatus 100, but may display an image to be inspected or an image to be inspected.

The controller 150 controls the operation of the image screening apparatus 100 of the present invention based on a preset control algorithm.

4 to 8 are schematic processing flowcharts of an image inspection method according to an embodiment of the present invention. An image screening method according to an embodiment of the present invention will be described with reference to FIGS. 1 to 8 . That is, as illustrated in FIG. 2 , the image inspection apparatus 100 including a user interface unit (I/F) 105 , a display unit 145 , an image management DB 10 , and an image photographing means 110 . ) using the image censorship method is described as follows.

First, in step S110, the censorship standard management unit 130 sets the censorship reference information. To this end, the censorship standard management unit 130 receives the control of the controller 150 and stores the set censorship reference information in the censorship reference information management DB 20 . To this end, the inspection standard management unit 130 registers initial inspection reference information in step S111. That is, in step S111, the censorship standard management unit 130 manages the initial inspection reference information input through the user interface unit (I/F) 105 or the communication interface unit (I/F) 115 to manage the inspection criterion information. It may be stored in the DB 20 .

In this case, the censorship reference information may include at least one censorship target serving as a criterion for determining a personal information leakage area, and censorship exclusion information, and the censorship target may include a human face shape, or a predetermined or more continuous random , and the censorship exclusion information may include at least one specific person's face or at least one specific numeric sequence.

In addition, in steps S112 and S113, in response to the user's selection information (aka, 'change selection information', or 'censorship standard selection information') for changing the set censorship target or the censorship exclusion information, Add or delete the censorship target or the censorship exclusion information.

In step S120, it is determined whether an image to be inspected is selected. To this end, the control unit 150 may receive selection information of the image selection unit 120 , and determine whether to select an image based on the result. To this end, the image selection unit 120 selects an image to be inspected based on the image selection information input through the user interface unit (I/F) 105 , but a real-time image captured by the image photographing unit 110 . , or any one of images previously stored in the image management DB 10 may be selected as an image to be inspected, and the result may be transmitted to the controller 150 .

If it is determined in step S120 that an image has been selected, in step S130 , the image inspecting unit 125 inspects the selected image to be inspected.

To this end, the image censoring unit 125 analyzes the censorship target image based on preset censorship reference information (that is, information stored in the censorship reference information management DB 20) in step S131, and in step S132, At least one personal information leakage area included in the censorship target image is determined based on the analysis result.

On the other hand, in step S130, the image inspecting unit 125 may further include a personal information leakage area release step of releasing the personal information leakage area determined in step S132 based on a preset personal information leakage exception condition. In order to do this, in steps S133 to S135, the image inspecting unit 125 selects one of the areas determined as the personal information leakage area (S133), and determines whether the area satisfies the personal information leakage exception condition, and (S134), when the selected personal information leakage area satisfies the personal information leakage exception condition, the personal information leakage area is released (S135).

And until the inspection of the selected image to be inspected is finished ( S136 ), the image inspecting unit 125 repeats steps S133 to S135 .

For this purpose, a more specific processing method of the image inspecting unit 125 is the same as described above in the description of the operation of the image inspecting unit 125 with reference to FIGS. 1 and 2 , and thus a redundant description will be omitted.

In step S140, the masking unit 135 masks each of the at least one personal information leakage area determined in step S130, and generates a censorship image including the masking area. That is, in step S140, a censorship image including a masking area (ie, at least one masking area) corresponding to each of the personal information leakage areas is generated. In this case, in step S140 , the masking unit 135 may receive the user's masking change information for adding or canceling the mask, and may add or delete the masking area based on the masking change information.

To this end, the masking unit 135 performs masking with basic masking information in step S141, and displays the masking result on the display unit 145 in step S142. That is, in step S141, the masking unit 135 masks each of the personal information leakage areas based on preset masking information (eg, a masking type and a masking level).

Meanwhile, in step S140, the masking unit 135 may further include a process of adding or deleting a masking area or changing masking information based on the user's selection information. To this end, in steps S143 and S144, , the masking unit 135 adds or deletes the masking area in response to the user's request to add or delete the mask. In addition, in steps S145 and S146, the masking unit 135 changes the masking information in response to the user's request for changing the masking information for changing the masking type and the masking step. That is, in steps S145 and S146, the masking unit 135 changes the masking type and masking level in response to the user's request for changing the masking information, and masks each of the personal information leakage areas based on the changed information. to create a censored image.

In step S150, the censored image is displayed.

In step S160, the warning text display unit 140 for storing at least one warning text preset for personal information leakage, based on the warning text, for each of the masked at least one personal information leakage area, the corresponding part is When it is disclosed, it expresses a warning about the expected risk. At this time, in step S160, the warning text display unit 140 expresses a warning about the expected risk when the corresponding area is disclosed only when the masking is requested among the at least one masked personal information leakage area. may be

To this end, the warning text display unit 140 detects, in step S161, a warning text for the region for which the masking is requested, among the at least one preset warning text, and in step S162, the detected warning text is displayed on the display unit. (145). At this time, since the warning text expression method of the display unit 145 is the same as described in the description of the display unit 145 with reference to FIGS. 1 and 2 , a detailed description of the warning text expression method is omitted.

On the other hand, in steps S163 and S164, the warning text display unit 140, in response to the user's request for detailed information, provides detailed information including legal information and case information about the warning text being expressed in step S162. It is automatically connected, and the corresponding content is displayed on the display unit 145 . To this end, the warning text display unit 140 may further include registering at least one link information for automatically connecting to a web page providing corresponding detailed information for each of the warning texts.

In step S170, it is determined whether the inspection of the image to be inspected is completed, and if the inspection is not completed, the above processes (steps S120 to S160) are repeatedly performed until the inspection of the image is completed. .

When it is determined in step S170 that the censorship has been completed, in step S180, the censored image is shared and stored. That is, in step S180 , the image censoring apparatus 100 transmits the censored image to the server apparatus 200 or the terminal apparatus 300 of another person through a communication network in order to share it online with at least one other person.

9A to 13 are diagrams illustrating an image censoring apparatus installed and operating in a portable terminal according to an embodiment of the present invention. It is a diagram illustrating an example of a screen of a mobile terminal, FIG. 10 is a diagram for explaining a method of adding a masking area according to an embodiment of the present invention, and FIGS. 11A and 11B are examples of masking types according to an embodiment of the present invention 12A and 12B are diagrams illustrating an example of displaying a warning message for expressing an expected risk when a masking area is disclosed according to an embodiment of the present invention, and FIG. 13 is a diagram of the present invention. It is a diagram illustrating an example of displaying a web page providing detailed information corresponding to a warning message according to an embodiment.

9A , a screen for selecting one of the gallery open menu (A) and the camera open menu (B) is exemplified. In the example of FIG. 9A , the image censoring apparatus of the present invention may call an image to be inspected by selecting any one of the open gallery menu (A) and the camera open menu (B). That is, in the example of FIG. 9A , when the open gallery menu (A) is selected, the image censoring apparatus of the present invention can call one of the pre-stored images as the censorship target image, and when the camera open menu (B) is selected, this The image censorship device of the present invention can open a camera and take an image to be inspected in real time.

In FIG. 9B , a screen in which an image to be inspected is selected by selecting any one of the gallery open menu (A) and the camera open menu (B) is exemplified. At this time, the image to be inspected includes three people, and their faces are displayed. In the example of FIG. 9B , if the selection menu (C) at the bottom of the screen is selected, the currently selected image may be selected as the image to be inspected.

In FIG. 9C , as an example, a screen displaying the photo censorship result for the censorship target image is shown, and the face display area of three people displayed in the censorship target image is determined as the personal information leakage area, and the sticker (D1, D2, D3) , an example of masking the corresponding area is shown.

In Figure 9d, when the user selects one of the masked areas (that is, the area on which the sticker is displayed) as the censorship release area, when the masking of the corresponding portion is removed, the damage concerned due to the leakage of personal information is displayed in the form of a warning ( E) is shown as an example. If the user who has checked the information expressed in the warning form (E) nevertheless selects the censorship release (F) menu, as illustrated in FIG. 9E , the corresponding masking is released. That is, referring to FIG. 9E , it can be seen that the masking information (ie, sticker) generated on one of the three faces is released and the corresponding face is revealed.

9F shows an example of a method of processing a finally generated censored image according to the user's selection information. Referring to FIG. 9F , a selection menu H is displayed to confirm whether the censored image is to be shared online or simply stored in the terminal. Accordingly, the censored image may be shared online or simply stored in the terminal according to the user's selection information.

FIG. 10 is a diagram for explaining a method of adding a masking area. When the screen is dragged in the direction of the arrow (I) indicated by a diagonal line in FIG. 10, a rectangular area having the arrow (I) as a diagonal may be added as a masking area. have. As described above, the reason for dragging the screen in the direction of the arrow (I) to add the masking region is to prevent the masking region from being accidentally added while zooming in/out.

11A and 11B are diagrams for explaining an example of a masking type according to an embodiment of the present invention, and show an example in which a personal information leakage area is masked by a blur technology. In particular, FIG. 11A shows an example in which the face display area J of a specific person is blurred, and FIG. 11B shows an example in which the license plate display area K is blurred.

12A and 12B are views illustrating an example of displaying a warning message for expressing an expected risk when a masking area is disclosed according to an embodiment of the present invention, and FIG. 12A is a risk expected when a person's face is disclosed; Shows an example in which a warning message is displayed for expressing , and FIG. 12b shows an example in which a warning message is displayed for expressing an expected risk when the license plate is released.

13 is a view showing an example of displaying a web page providing detailed information corresponding to a warning according to an embodiment of the present invention. If you select the 'Learn' menu, based on the pre-stored link information, the content is automatically linked to a website that provides detailed information about the reason why the masking area included in the censored image should not be disclosed or cases of legal sanctions, etc. an example is shown.

As described above, the present invention has an advantage in that the leakage of personal information can be prevented in advance by censoring personal information stored in a photographed or stored image using a digital device and masking an image area including personal information.

In addition, the present invention allows users to conveniently use an image censorship service by automatically censoring personal information stored in the image when taking an image using a user-specific personal terminal device or selecting an image for storage or transmission. , it has the advantage of preventing mistakes in saving or transmitting uncensored images without knowing it.

In addition, the present invention has the advantage of preventing leakage of personal information included in images that are frequently exchanged between individuals as well as images that are published online by censoring images using a personal terminal device for each user.

In addition, the present invention can induce users to feel alert and to pay attention in advance to information leakage by expressing a warning about an expected risk when the corresponding part is disclosed for each of the masked areas, and , this has the advantage of effectively blocking the leakage of personal information by solving the problem of indiscriminate leakage of personal information.

On the other hand, the present invention relates to a technique for censoring whether or not personal information is included in an image selected for photographing or transmission using a personal terminal device for each user, and masking, and the present specification relates to a technique for masking whether personal information is included in the image. The case has been described as an example. However, as a result of image censorship according to the present invention, when no personal information is included in the image, the personal information leakage area is not detected, and it is obvious that a process such as masking or warning text expression can be omitted.

Although the embodiment of the present invention has been described above, the scope of the present invention is not limited thereto, and the present invention is easily changed from the embodiment by a person of ordinary skill in the art to which the present invention belongs and recognized as equivalent. including all changes and modifications to the scope of

10: Image management DB 20: Censorship standard information management DB
100: image inspection device 105: user interface unit
110: image taking means 115: communication interface unit
120: image selection unit 125: image inspection unit
130: inspection standard management unit 135: masking unit
140: warning text display unit 145: display unit
150: control unit

Claims (27)

display unit;
a user interface unit providing an interface with a user;
a censorship reference information storage unit for storing censorship reference information including at least one censorship target serving as a criterion for determining a personal information leakage area and preset censorship exclusion information;
an image selection unit for selecting an image to be inspected from among images photographed or stored using a digital device based on image selection information input through the user interface unit;
an image censoring unit that analyzes the censorship target image based on censorship reference information stored in the censorship reference information storage unit and determines at least one personal information leakage area included in the censorship target image;
a masking unit for generating a censored image including at least one masking region by masking each of the personal information leakage regions, and then displaying the censored image on the display unit; and
Stores at least one warning text set in advance for personal information leakage, and displays a warning about the expected risk when the corresponding part is disclosed for an area for which unmasking is requested among the at least one masked personal information leakage area However, it includes a warning text display unit for expressing the warning text in a preset specific area, or for expressing the warning text in a transparent or opaque state pop-up on the censorship image,
The image inspection unit
After determining whether the image included in the area determined as the personal information leakage area is the intended photographing target based on the preset personal information leakage exception condition, the area including the intended photographing target is released from the personal information leakage area Image censorship device, characterized in that. delete The method of claim 1, wherein the inspection target is
An image censoring apparatus comprising a human face shape or a sequence of a predetermined number or more consecutively. The method of claim 3, wherein the censorship exclusion information is
An image censoring apparatus comprising at least one specific person's face, or at least one specific numeric sequence. 5. The method of claim 4, wherein the inspection reference information storage unit
The image censorship apparatus according to claim 1, wherein the censorship target or the censorship exclusion information is added or deleted based on the censorship criterion selection information input through the user interface unit. delete The method of claim 1, wherein the image inspecting unit
When only one face larger than the preset face size is recognized from the censorship target image,
The image censorship apparatus, characterized in that the area in which the face is displayed is released from the personal information leakage area. The method of claim 1, wherein the image inspecting unit
When two or more faces are recognized from the image to be inspected,
The size of each of the two or more faces and the average size of all of the two or more faces are calculated, and an area in which a face having a size that is at least a predetermined time larger than the average size is displayed is released from the personal information leakage area. image censorship device. The method of claim 1, wherein the masking unit
The image censoring apparatus according to claim 1, wherein the masking area is added or deleted based on a request for masking addition or cancellation input through the user interface unit. The method of claim 1, wherein the masking unit
determining a masking type and a masking level based on masking selection information input through the user interface unit or preset masking information;
and masking each of the personal information leakage areas based on the determined masking type and masking level. The method according to claim 1, wherein the warning text display unit
For each of the warning text, storing at least one link information for linking to a web page providing detailed information including legal information and case information corresponding to the warning text,
The image censorship apparatus, characterized in that after connecting to the web page in response to the detailed information request signal input through the user interface unit, the content is displayed. According to claim 1,
image storage means for storing at least one image; and
Further comprising a communication interface unit for providing an interface with a communication network,
The image selection unit
Selecting one of the images stored in the image storage means as an image to be inspected,
The masking part
The image censoring device, characterized in that for transmitting the censored image to an external server device or at least one other terminal device through the communication interface unit. 13. The method of claim 12,
Further comprising an image taking means,
The image selection unit
Selecting the image taken by the image taking means in real time,
The masking part
and storing the censored image in the image storage means. An image inspection method using an image inspection apparatus including a user interface unit, a display unit, an image storage unit, an image photographing unit, and a communication interface unit, the method comprising:
a censorship reference information setting step of setting censorship reference information including at least one censorship target serving as a criterion for determining a personal information leakage area, and censorship exclusion information;
an image selection step of selecting an image to be inspected based on image selection information input through the user interface unit;
an image censorship step of analyzing the censorship target image based on the censorship reference information preset in the censorship reference information setting step, and then determining at least one personal information leakage area included in the censorship target image;
a masking step of generating a censored image including at least one masking region by masking each of the personal information leakage regions, and then displaying the censored image; and
Based on at least one warning message set in advance for personal information leakage, with respect to the area for which unmasking is requested among the masked at least one personal information leakage area, a warning statement about the risk expected when the corresponding part is disclosed is expressed However, it includes a warning text expression step of expressing the warning text in a preset specific area, or expressing the warning text in a transparent or opaque state pop-up on the censorship image,
The image screening step is
After determining whether the image included in the area determined as the personal information leakage area is the intended photographing target based on the preset personal information leakage exception condition, the area including the intended photographing target is released from the personal information leakage area Image screening method, characterized in that. delete 15. The method of claim 14, wherein the inspection target is
An image censorship method comprising a human face shape or a sequence of a predetermined number or more consecutively. The method of claim 16, wherein the censorship exclusion information is
An image screening method comprising at least one specific person's face, or at least one specific numeric sequence. 18. The method of claim 17,
and a censorship criterion selection information input step of receiving a user's censorship criterion selection information for changing the set censorship target or the censorship exclusion information;
The censorship reference information setting step is
The image censorship method, characterized in that adding or deleting the censorship target or the censorship exclusion information. delete 15. The method of claim 14, wherein the step of releasing the personal information leakage area
The image censorship method of claim 1, wherein when only one face having a face size larger than a preset face size is recognized from the censorship target image, the area in which the face is displayed is released from the personal information leakage area. 15. The method of claim 14, wherein the step of releasing the personal information leakage area
When two or more faces are recognized from the image to be inspected,
Calculating the size of each of the two or more faces and the average size of all of the two or more faces, and excluding from the personal information leakage area an area in which a face having a size that is at least a predetermined time larger than the average size is displayed image censorship method. 15. The method of claim 14,
Further comprising a masking change information input step of receiving the user's masking change information for masking addition or release;
The masking step
The image inspection method of claim 1, wherein the masking area is added or deleted based on the masking change information. 15. The method of claim 14,
Further comprising a masking selection information input step of receiving the user's masking selection information for determining the masking type and the masking step,
The masking step
The method of claim 1, wherein a masking type and a masking level are determined based on the masking selection information, and each of the personal information leakage areas is masked based on the determined masking type and masking level. 15. The method of claim 14, wherein the masking step
An image screening method, characterized in that each of the personal information leakage areas is masked based on a preset masking type and masking level. 15. The method of claim 14,
For each of the warning text, further comprising a link information registration step of registering at least one link information for linking to a web page providing detailed information including legal information and case information corresponding to the warning text,
The warning expression step is
An image censorship method, characterized in that after connecting to the web page in response to a detailed information request signal of a user requesting the detailed information, the corresponding content is displayed. 15. The method of claim 14, wherein the image selection step
An image censorship method, characterized in that one of a real-time image captured by the image capturing means or images previously stored in the image storage means is selected as an image to be inspected. 27. The method of claim 26,
and transmitting the censored image to an external server device or a terminal device of another person through a communication network, and sharing the censored image online with at least one other person.

Images