KR20210011574A - Apparatus and method for preventing iris image theft - Google Patents

Abstract

An online iris image theft prevention method performed by an iris image theft prevention device according to an aspect of the present invention comprises the steps of: receiving user account information for a specific online service; accessing a server related to the specific online service and downloading image data uploaded for the user account information; determining whether an iris image exists in the downloaded image data; extracting the iris image when it is determined that the iris image exists in the image data, and performing conversion into a blocking image such that the extracted iris image is be contaminated; and providing the converted blocking image to be checked by a user.

Description

Iris image theft prevention method and apparatus {APPARATUS AND METHOD FOR PREVENTING IRIS IMAGE THEFT}

The present invention relates to a method for preventing theft of an iris image, and more particularly, to a method for preventing theft of an iris image to contaminate an iris image to prevent theft by recognizing the iris of an image uploaded online including a social network service. .

Biometric authentication technologies such as iris recognition and fingerprint recognition have been commercialized and used in various fields because of their convenience and high security compared to existing authentication technologies such as passwords and public certificates.

However, in the case of biometric authentication technology, once leaked, it cannot be reissued, and it is highly likely to be permanently abused. The leaked biometric information can be used not only for financial damage, but also for identity disguise, which poses a great social threat.

In the case of fingerprint recognition, there is a case in which the lock was unlocked using a fake fingerprint made with a 3D printer, and there is a case in which the iris recognition was successfully hacked by copying a high-resolution iris image and combining it with a lens.

An object of the present invention is to provide a method for preventing theft of an iris image in an iris image theft prevention server in order to prevent destruction of biometric recognition by printing a photo uploaded to an SNS or the like as to solve the problems of the prior art.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for solving the above-described technical problem, an online iris image theft prevention method performed by an iris image theft prevention apparatus according to a first aspect of the present disclosure includes: receiving user account information regarding a specific online service , Accessing a server for a specific online service, downloading image data uploaded for user account information, determining whether an iris image exists in the downloaded image data, determining that an iris image exists in the image data In this case, it includes extracting the iris image, converting the extracted iris image into a blocking image that causes contamination, and providing the converted blocking image so that the user can check it.

An on-line iris image theft prevention method performed by an iris image theft prevention apparatus according to a first aspect of the present disclosure includes extracting image data including a face image from among downloaded image data, and extracting image data including a face image from among image data including a face image. It may include determining whether image data in which an iris image exists exists.

When extracting the iris image, when the resolution of the extracted iris image is equal to or greater than a preset resolution, converting the extracted iris image to the blocking image may be included.

When the iris image is converted, it may be converted into a blocking image by mosaic or iris color-based dot overlay that is blurred below a preset level, or it may be converted into a blocking image by a hostile generation network (GAN).

After the iris image conversion is started, it may include displaying a preset advertisement on the device until the conversion is finished.

After the iris image is converted, it may include the step of inserting a preset watermark into the blocking image.

After the iris image is converted into blocking images, selecting any one of a plurality of converted images including the blocking image through a user input.

When the iris image is converted, the conversion rate value of the converted blocking images is displayed, and the step of selecting the image with the largest conversion rate value among the plurality of converted images is included, and the conversion rate value is the time taken for conversion, the photo before and after conversion. It can be calculated based on the difference in capacity of or the sum of the numerical changes of pixels.

According to any one of the above-described problem solving means of the present application, it is possible to fundamentally block iris image theft by recognizing the iris of the image uploaded to SNS, etc., and performing image conversion through Generative Adversarial Networks (GAN). .

1 is a block diagram showing the configuration of an iris image theft prevention system according to an embodiment of the present invention.
2 is a block diagram showing the configuration of an iris image theft prevention apparatus according to an embodiment of the present invention.
3 is a flowchart illustrating a method for preventing theft of an iris image according to an exemplary embodiment of the present invention.
4 is a diagram illustrating an iris image conversion method of an iris image theft prevention method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout this specification, when a part is said to be "connected" with another part, this includes not only the case that it is "directly connected", but also the case that it is "electrically connected" with another element interposed therebetween. do. In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

In the present specification, the'terminal' may be a wireless communication device with guaranteed portability and mobility, and may be any kind of handheld-based wireless communication device such as a smart phone, a tablet PC, or a notebook. In addition, the'terminal' may be a wired communication device such as a PC that can access other terminals or servers through a network. In addition, a network refers to a connection structure in which information exchange is possible between nodes such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), and the Internet (WWW). : World Wide Web), wired and wireless data networks, telephone networks, wired and wireless television networks, etc.

Examples of wireless data networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, and ultrasound. Communication, Visible Light Communication (VLC), LiFi, etc. are included, but are not limited thereto.

The following examples are detailed descriptions to aid understanding of the present invention, and do not limit the scope of the present invention. Accordingly, the invention of the same scope performing the same function as the present invention will also belong to the scope of the present invention.

The present invention may be implemented in the form of a mobile application, IOS and Android, and may be implemented in the form of a PC application on an OS including MAC OS X, windows, and linux. The mobile application of the present invention is distributed in the form of an SDK and can be used as a plug-in for other applications. For example, a developer who creates a camera app can connect the SDK of this solution to implement a function that automatically converts a captured photo.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of an iris image theft prevention system according to an embodiment of the present invention.

The device for preventing theft of an iris image may be the server 200 or the user terminal 100. The method for preventing theft of an iris image may be implemented in the server 200 or the user terminal 100. When implemented in a server, high-performance conversion or multiple conversions are possible in a short time regardless of the performance of the user terminal, and the corresponding function can be paid separately.

2 is a block diagram showing the configuration of an iris image theft prevention apparatus according to an embodiment of the present invention.

The communication module 110 communicates data with the connected user terminal 100 and the linked server 200, respectively. The communication module 110 may be a device including hardware and software necessary to transmit and receive signals such as control signals or data signals through wired/wireless connection with other network devices. In particular, when the conversion is performed in the server 200, the original image data is transmitted from the user terminal 100 to the server 200 through the communication module 110, and the converted blocking image file is transmitted to the server through the communication module 110. 200) can be transmitted and received at the user terminal.

An iris image theft prevention program is stored in the memory 120. The memory 120 stores various types of data generated in the process of executing an operating system for driving an iris image theft prevention device or an iris image theft prevention program.

In this case, the memory 120 collectively refers to a nonvolatile storage device that continuously maintains stored information even when power is not supplied and a volatile storage device that requires power to maintain the stored information.

In addition, the memory 120 may perform a function of temporarily or permanently storing data processed by the processor 130. Here, the memory 120 may include a magnetic storage media or a flash storage media in addition to a volatile storage device requiring power to maintain stored information, but the scope of the present invention is limited thereto. It does not become.

The processor 130 executes a program stored in the memory 120, and performs the following processing according to the execution of the iris image theft prevention program.

The processor 130 receives user account information for a specific online service, accesses a server for a specific online service, downloads the image data uploaded for the user account information, and checks whether an iris image exists in the downloaded image data. When it is determined that there is an iris image in the image data, the iris image is extracted, converted into a blocking image that causes the extracted iris image to be contaminated, and the converted blocking image is provided for the user to check.

In this case, the online service may include social network services including Instagram, Facebook, KakaoTalk, Twitter, Naver, and Daum.

In the case of Instagram or Facebook, it is possible to download the uploaded photos in bulk by entering the account name. You can only receive photos uploaded for a set period of time, and you can download all the photos you uploaded.

In addition to the photos uploaded to the online service, it is also possible to apply a method to prevent theft of iris images by selecting photos stored locally. In addition, by recognizing the iris on the camera preview screen of the user terminal, an image can be converted and provided in real time. When a captured video image is uploaded to an online service, it can be detected, converted, and then uploaded.

When receiving user account information, a method for preventing theft of an iris image may be applied to a public photo, and the scope to which the method is applied may vary depending on the authority.

Using image processing technology, it is possible to determine whether an iris image exists after face recognition. By combining machine learning and deep learning with image processing technology, it is possible to determine the existence of an iris image and extract the iris image.

When converting the iris image to a blocking image, the processor 130 may perform conversion only when the resolution is high. This is because, if the resolution is low, security concerns are low even if it is stolen anyway.

In order to convert an iris image into a blocking image in a user terminal such as a mobile phone or tablet PC, a mosaic blurring below a preset level can be applied, or an iris color-based dot overlay can be applied. Since this method is a simple image processing method, it can be easily implemented even in low-performance user terminals.

The concept of Generative Adversarial Networks (GAN) is to develop a generative network (Generator) and a discriminator network (Discriminator) to a level where it is difficult to distinguish whether it is real or fake. The discriminant network learns by using real learning data and fake data created through the generation network, and plays a role in distinguishing whether the actual sample is real or fake. The goal of the generation network is to create fake data at a level that is indistinguishable from the real enough to deceive the discrimination network.

The present invention can convert an iris image into a blocking image by applying a machine learning technology such as Generative Adversarial Networks (GAN). The iris recognition model can be learned by using the iris image through Google image search and the iris image included in the user's photo as input data, and through this, a fake iris image with a level that is indistinguishable from the actual iris image is created and synthesized. Image theft can be prevented.

The iris image conversion operation may be selected according to the capabilities of the user terminal. It is also possible to transmit the image data to be converted to the server 200 through the communication module 110 to be converted in the server 200. Only paid members can allow conversion on the server 200.

The processor 130 may provide an advertisement to the user terminal during the iris image conversion operation. Paid members may not watch advertisements.

The processor 130 may insert a separate watermark indicating that the iris is a protected image in the converted blocking image. When the iris image is converted into a blocking image by applying GAN and machine learning technology, it may be difficult for the user to distinguish between the original image and the contaminated image, so it is possible to check whether the converted image is a blocking image through a watermark.

The processor 130 may generate a plurality of blocking images for image data including an iris image, and a user may select one of the generated images. The iris image of the selected photo and the part of the iris image before conversion may be enlarged and contrasted.

The conversion rate value, which is a measure of the degree of conversion, may be calculated based on the time taken for conversion, the difference in the size of the photo before and after conversion, or the sum of the numerical change values of pixels. You can select a blocking image by considering the conversion rate value. The user can select the most visually natural image among the converted images, and if it is difficult to distinguish visually, the user can select an appropriate image by referring to the numerical conversion rate value.

The processor 130 may include all types of devices capable of processing data. For example, it may refer to a data processing device embedded in hardware having a circuit physically structured to perform a function represented by a code or command included in a program. As an example of a data processing device built into the hardware as described above, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an application-specific ASIC ( Integrated circuit), a field programmable gate array (FPGA), and the like may be covered, but the scope of the present invention is not limited thereto.

The camera module 140 is a module for photographing an image included in a user terminal, and may include various cameras such as a vision camera.

3 is a flowchart illustrating a method for preventing theft of an iris image according to an exemplary embodiment of the present invention.

4 is a diagram illustrating an iris image conversion method of an iris image theft prevention method according to an embodiment of the present invention. An image to be transformed can be generated by a model trained through a hostile generation network (GAN). It is possible to create a new horse image by synthesizing the horse image generated by GAN on the zebra image, or it is possible to synthesize the zebra image produced by GAN on the horse image. Similarly, for the original iris image, it is possible to prevent the iris image from being stolen by synthesizing the iris image generated by the GAN.

Meanwhile, as an additional embodiment, when the application of the present invention is driven in conjunction with another application, the camera shooting mode is executed in the other application, and when image capturing is completed, it is checked whether a face is included in the captured image After recognizing whether an iris is included in the inside, a querying whether to convert the iris image into a blocking image may be performed. Or, in the case of driving in conjunction with other applications, when the camera shooting mode button is pressed in the other application, the application of the present invention is immediately executed to perform camera shooting on the application of the present invention, as described above, face recognition, iris Steps such as recognition, conversion of blocking images, insertion of watermarks, provision of advertisements during the conversion time, etc. may be performed.

Furthermore, after downloading a photo that has already been uploaded to another sns application and completing the conversion of an iris image to a blocking image, the post about which sns and which post had a high risk of leaking the iris image from the photo. By providing the link of the post and the photo of the post to the user, the user may modify the photo of the post to a video including the blocking image.

Meanwhile, the payment processing method according to an embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include a computer storage medium. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Although the methods and systems of the present invention have been described in connection with specific embodiments, some or all of their components or operations may be implemented using a computer system having a general-purpose hardware architecture.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present application.

100: user terminal
110: communication module
120: memory
130: processor
140: camera module
150: input module
200: server

Claims (10)

In the online iris image theft prevention method performed by the iris image theft prevention device,
(a) receiving user account information regarding a specific online service;
(b) accessing a server related to the specific online service and downloading image data uploaded for the user account information;
(c) determining whether an iris image exists in the downloaded image data;
(d) when it is determined that an iris image exists in the image data, extracting an iris image and converting the extracted iris image into a blocking image that causes contamination; And
(e) providing the converted blocking image for a user to check;
Iris image theft prevention method comprising a. The method of claim 1,
The step (c) includes: extracting image data including a face image from the downloaded image data, and determining whether image data including an iris image exists among the image data including the face image; ,
How to prevent theft of iris images. The method of claim 1,
The step (d) includes converting the extracted iris image to the blocking image when the resolution of the extracted iris image is greater than or equal to a preset resolution,
How to prevent theft of iris images. The method of claim 1,
In the step (d), converting the blocking image to the blocking image by overlaying mosaic or iris color-based dots blurred below a preset level, or converting the blocking image into the blocking image by a hostile generation network (GAN).
How to prevent theft of iris images. The method of claim 1,
The step (d) comprises the step of displaying a preset advertisement on the device after the conversion starts and before the conversion ends.
How to prevent theft of iris images. The method of claim 1,
The step (d) includes the step of inserting a preset watermark into the blocking image.
How to prevent theft of iris images. The method of claim 1,
The step (d) includes the step of selecting any one of a plurality of converted images including the blocking image through a user input after being converted into the blocking images,
How to prevent theft of iris images. The method of claim 1,
Step (d)
Displaying the conversion rate values of the converted blocking images, and selecting an image having the largest conversion rate value among the plurality of converted images, and
The conversion rate value is calculated based on the time taken for conversion, the difference in the size of the photo before and after conversion, or the sum of the pixel values.
How to prevent theft of iris images. In the iris image theft prevention device providing a security service using an iris image,
A memory storing an iris image theft prevention program;
And a processor executing a program stored in the memory, wherein the processor executes the program,
Receive user account information for specific online services,
Accessing the server related to the specific online service and downloading the uploaded image data for the user account information,
Determine whether an iris image exists in the downloaded image data,
When it is determined that an iris image exists in the image data, an iris image is extracted, and the extracted iris image is converted into a blocking image that causes contamination,
Providing the converted blocking image so that the user can check
Iris image theft prevention device. A computer-readable recording medium on which a computer program for carrying out the method according to claim 1 is recorded.

Images