KR20170001933A - Method for digital image judging and system tereof, application system, and authentication system thereof - Google Patents

Method for digital image judging and system tereof, application system, and authentication system thereof Download PDF

Info

Publication number
KR20170001933A
KR20170001933A KR1020150136452A KR20150136452A KR20170001933A KR 20170001933 A KR20170001933 A KR 20170001933A KR 1020150136452 A KR1020150136452 A KR 1020150136452A KR 20150136452 A KR20150136452 A KR 20150136452A KR 20170001933 A KR20170001933 A KR 20170001933A
Authority
KR
South Korea
Prior art keywords
image
digital image
digital
dimensional
photographed
Prior art date
Application number
KR1020150136452A
Other languages
Korean (ko)
Inventor
김동진
김대진
박경자
김우현
심충섭
이진원
Original Assignee
주식회사 씽크풀
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 씽크풀 filed Critical 주식회사 씽크풀
Publication of KR20170001933A publication Critical patent/KR20170001933A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F15/18
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06K9/00201
    • G06K9/00221

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Collating Specific Patterns (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)

Abstract

Disclosed are an authentication method using a digital image, and an application system for the same. According to one aspect of the present invention, the application system installed on a portable terminal includes: an image acquisition module for acquiring a digital image of a predetermined object through an image-capturing device included in the portable terminal; and an insertion module for inserting insertion information into the acquired digital image, wherein if the digital image inserted therein with the insertion information is transmitted to a predetermined authentication system, authenticity of the insertion information is determined by the authentication system, and if the authenticity of the insertion information is determined, validity of the digital image or a user of the portable terminal is authenticated.

Description

TECHNICAL FIELD [0001] The present invention relates to a digital image judging method and system, and an application system and authentication system for the digital image judging method and system,

The present invention relates to a system and method for authenticating a user using a digital image.

Recently, various online services such as online commerce, internet banking, online certificate issuance and the like have been provided. It is very important to make sure that these services are legitimate users or trustworthy trading partners by their nature.

The most obvious method for self-certification is to visit the bank or the certificate issuing institution directly. However, since the visit is difficult, the facial photograph, own identification card or other authentication means are scanned or photographed, , A non-face authentication technology that performs identity verification through transmitted pictures is emerging.

However, when the current non-face authentication technology is used, there is a problem that a problem that the photo is stolen, forged or exploited by a hacker or the like can not be prevented.

In addition, there are cases where a car insurance company provides a service for checking mileage or black box installation and discounting insurance premiums. At this time, there are cases where forged pictures are transmitted, Even if you do not have the possession of the other person as if you are holding a photo of the person is pretending to be increasing.

Therefore, if a digital image can distinguish whether a three-dimensional object is photographed or a two-dimensional image is photographed, it can be used for various authentication and services, and a technical idea is required.

Korean Unexamined Patent Application Publication No. 10-2005-0009415, "Mutual authentication method using image image and computer readable recording medium recording program for executing this method"

SUMMARY OF THE INVENTION Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art, and an object of the present invention is to provide a method and apparatus for determining whether a digital image is an image of a real object or a two- System.

According to an aspect of the present invention, there is provided an application system installed in a mobile terminal, including an image acquisition module for acquiring at least one digital image directed to an object through image shooting means of the portable terminal, And a communication module for transmitting at least one digital image to an authentication system, wherein, when the at least one digital image is received, the digital image is transmitted to the authentication system based on the received at least one digital image, It is determined whether or not a two-dimensional image is captured, and an authentication process of authenticating a user corresponding to the object or whether the object is actually photographed is performed. The module determines whether the at least one digital image And acquires a plurality of images obtained by photographing the object at different angles.

In addition, when the illumination active image is received by the authentication system, it is determined whether or not an image characteristic that appears when the two-dimensional image is photographed while the illumination device is activated is displayed in the illumination active image, .

The authentication system is configured to receive a plurality of images in which a three-dimensional object is photographed and a plurality of images in which a two-dimensional image is photographed while the lighting apparatus is activated, and learn the image characteristics through machine learning or deep learning .

Wherein the image acquisition module obtains a lighting inactive image of the object with the lighting active image and the lighting device of the portable terminal deactivated and generates an illumination inactive image based on the lighting active image and the lighting inactive image difference So that the illumination device is physically blocked or the authentication process is performed.

Wherein the image acquisition module consecutively photographs the illumination inactive image and the illumination active image that are objects of the object, even if the image shooting request input by the user is input once.

Wherein the image acquisition module controls the portable terminal to photograph a plurality of the objects at different angles, captures the object at a predetermined angle, and displays the captured angle of the portable terminal through a sensor included in the portable terminal It is determined whether the angle is changed to a specific angle, and if it is determined that the angle is changed to the specific angle, the object can be photographed.

Wherein the specific angle is selected by the image acquisition module or the authentication system and the authentication process performed by the authentication system determines whether or not the degree of change of the shooting angle of the received plurality of digital images corresponds to the specific angle And a process for generating the image data is included.

Wherein at least one digital image transmitted to the authentication system is obtained by the image acquisition module and is based on a first image based on a user's first face image displayed on the object and a second face image on which a user's real face is captured And a second image.

Wherein at least one of the first image or the second image is an illumination active image.

The application system may further include an editing module for arranging the first image and the second image in a first area and a second area of a predetermined UI and comparing the first image and the second image.

The application system determines respective positions indicating a specific region from the first face image and the second face image, and arranges the first face image and the second face image so as to overlap each other based on the respective positions The editing module may further include an editing module.

Wherein the editing module comprises: the first face image itself; Or the first face image is used as the first image for image processing based on the image attribute of the second face image, or the second face image itself or the second face image is used for the first face image And an image-processed image based on the image attribute is used as the second image.

The image acquisition module may acquire the first image and the second image simultaneously or within a predetermined time difference through each of a plurality of image acquisition means provided in the portable terminal.

According to an aspect of the present invention, there is provided an application system installed in a mobile terminal, including an image acquisition module for acquiring a digital image of an object through an image capturing means of a portable terminal, And a communication module for transmitting to the authentication system, wherein, when the at least one digital image is received by the authentication system, the digital image captures the three-dimensional physical object based on the received at least one digital image Dimensional image is photographed, authentication is performed to authenticate a user corresponding to the object or whether the object is photographed, and the image acquisition module performs a process of authenticating the object A small number of photographs taken in different lighting conditions Also consecutively shoots two digital images.

Also, the at least two digital images that are successively photographed may include an illumination active image and a lighting inactive image.

Wherein the image acquisition module consecutively photographs the at least two digital images targeted to the object even if the image shooting request input by the user is inputted once.

According to an aspect of the present invention, there is provided an application system installed in a mobile terminal, including: an image acquisition module for acquiring at least one digital image of an object through an image capturing means of a portable terminal; And a determination module that determines whether the digital image is a three-dimensional object image or a two-dimensional image image, based on the acquired at least one digital image, The acquisition module acquires at least one of the at least one digital image as a light active image or obtains a plurality of images of the object taken at different angles.

The image acquisition module may successively photograph at least two digital images photographed in different illumination conditions on the object.

According to another aspect of the present invention, there is provided a digital image determination system including an acquisition module for acquiring at least one digital image that is intended for a predetermined object, and a digital camera for acquiring the digital image based on at least one digital image acquired by the acquisition module. And a determination module for determining whether the three-dimensional object is photographed or the two-dimensional image is photographed, wherein the determination module determines, based on the at least one illumination active image included in the at least one digital image, Determining whether a digital image is a three-dimensional object image or a two-dimensional image image, or determining whether the digital image is a three-dimensional object image or a two-dimensional image, based on a plurality of images taken at different angles from the at least one digital image, Whether the digital image is a three-dimensional object It is determined whether or not a two-dimensional image is photographed.

Wherein the determination module is included in the at least one digital image and determines whether the digital image is a three-dimensional object photographed based on at least two images successively photographed in different illumination states on the object, It is possible to judge whether or not the image of the dimension is photographed.

The determination module may determine whether an image characteristic that appears when the two-dimensional image is photographed while the illumination device is activated appears in the illumination active image.

Wherein the determination module receives a plurality of images in which a three-dimensional object is photographed and a plurality of images in which a two-dimensional image is photographed while the illumination device is activated, and learns the image characteristic through machine learning or deep learning .

Wherein the acquisition module acquires the illumination active image and the illumination inactive image photographed with the illumination device of the portable terminal inactive, and the determination module performs the determination based on the illumination active image and the illumination inactive image . ≪ / RTI >

According to another aspect of the present invention, there is provided an authentication system including an image receiving module for obtaining at least one digital image of an object from a portable terminal, and an image receiving module for receiving the digital image based on at least one digital image received by the image receiving module. And a determination module that performs authentication processing for authenticating a user corresponding to the object or whether the object is actually photographed, based on whether the three-dimensional object is photographed or the two-dimensional image is photographed, Wherein the determining module determines whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image, The object contained in one digital image Whether the said digital image is recorded to the real object in the three-dimensional based on a plurality of images taken from a different angle, it can be determined whether or not the recording of images in two dimensions.

Wherein the determination module is included in the at least one digital image and determines whether the digital image is a three-dimensional object photographed based on at least two images successively photographed in different illumination states on the object, It is possible to judge whether or not the image of the dimension is photographed.

According to an aspect of the present invention, there is provided a digital image determination method comprising: obtaining at least one digital image that is a target of a digital image determination system; determining, based on the obtained at least one digital image, Determining whether the digital image is a three-dimensional object image or a two-dimensional image image, and determining whether the digital image is a three-dimensional object object or a two-dimensional image object Wherein the digital image determination system determines whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image Or included in the at least one digital image Characterized in that it comprises the step of determining whether, based on a plurality of images taken on the object from different angles the digital image is recorded whether the real object in the 3D whether the recording of images in two dimensions.

Wherein the step of determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image comprises: And determining whether an image characteristic that appears when the illumination device is activated is displayed in the illumination active image.

The digital image determination method may include receiving the plurality of images in which the three-dimensional object is photographed and the plurality of images in which the two-dimensional image is photographed, and performing machine learning or deep learning And learning the image characteristic through the image processing unit.

Wherein the at least one digital image comprises the lighting active image and a lighting inactive image photographed with the lighting device of the portable terminal deactivated, wherein the at least one digital image comprises at least one lighting active image included in the at least one digital image The step of determining whether the digital image has taken a three-dimensional object or a two-dimensional image may comprise performing the determination based on the lighting active image and the lighting inactive image have.

Wherein the digital image determination system determines whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image Dimensional object image of the three-dimensional object based on at least two images successively photographed in different illumination states with respect to the object, the two-dimensional image And a step of judging whether or not the photographed image is photographed.

According to another aspect of the present invention, there is provided a digital image determination method comprising: obtaining at least two images successively photographed in different illumination states for a predetermined object; Determining whether the digital image is a three-dimensional object image or a two-dimensional image image, or determining whether the illumination device is physically hidden at the time of photographing.

Also, the at least two digital images that are successively photographed may include an illumination active image and a lighting inactive image.

Wherein the at least two digital images continuously photograph the at least two digital images for the object even if the image shooting request input to the portable terminal of the user is inputted once.

According to another aspect of the present invention, there is provided a computer program installed in a data processing apparatus and stored in a recording medium for performing the above-described method.

According to an embodiment of the present invention, it is possible to determine whether a digital image has taken a real object or a two-dimensional image.

It is thereby possible to easily perform non-face-to-face authentication when the digital image is a part of the user's body (e.g., a face, etc.), or the validity of the digital image (i. E., That the digital image has been taken by a legitimate user The digital image means that the physical object is photographed) can be effectively determined.

According to an embodiment, a plurality of images may be included in the digital image. If the object included in any one of the plurality of images is an ID card having a face image, the face portion of the image of the object is extracted, By arranging the screen of the digital image so as to correspond to the face image, it is possible to facilitate comparison authentication of legitimate users.

Also, depending on the implementation, digital images captured by the speaker may be included. At least one of the plurality of images captured by the photographer is photographed in a state in which the illumination device is in an inactive state, and at least one of the remaining images is photographed in a state in which the illumination device is activated, It is possible to confirm whether or not it has been operated.

In addition, according to an embodiment, a plurality of images are compared with each other in consideration of the degree of reflection of light, resolution uniformity, and the like, which may appear depending on the activation state of the lighting apparatus, There is an effect that it can be easily discriminated whether the object of shooting is a two-dimensional image or a three-dimensional real object.

BRIEF DESCRIPTION OF THE DRAWINGS A brief description of each drawing is provided to more fully understand the drawings recited in the description of the invention.
1 is a conceptual illustration of an authentication system using a digital image according to an embodiment of the present invention.
2 is a block diagram showing a schematic configuration of an authentication system using a digital image according to an embodiment of the present invention.
3 shows an example of an application system according to an embodiment of the present invention.
4 is a diagram for explaining a process of authenticating a user using a plurality of images according to the technical idea of the present invention.
5 is a view for explaining a concept of judging an image taken image and a real image according to the technical idea of the present invention.
6 shows a schematic configuration of a digital image judgment system according to the technical idea of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The terms first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

In this specification, terms such as "comprise," "comprising," and the like are intended to specify that there are stated features, numbers, steps, operations, elements, parts or combinations thereof, But do not preclude the presence or addition of one or more other features, steps, operations, elements, components, or combinations thereof.

Also, in this specification, when any one element 'transmits' data to another element, the element may transmit the data directly to the other element, or may be transmitted through at least one other element And may transmit the data to the other component. Conversely, when one element 'directly transmits' data to another element, it means that the data is transmitted to the other element without passing through another element in the element.

Hereinafter, the present invention will be described in detail with reference to the embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

1 is a conceptual illustration of an authentication system using a digital image according to an embodiment of the present invention. 1, an authentication system (hereinafter referred to as an 'authentication system') 100 using a digital image is used to implement an authentication method using a digital image according to an embodiment of the present invention .

The authentication system 100 can receive a digital image from the portable terminal 200 and verify the validity of the digital image. Here, the validity of the digital image indicates that the digital image is an image captured by a portable terminal of a user to be authenticated, or that the digital image is a three-dimensional real object (e.g., a user's face or an actual article) It can mean. Therefore, the technical idea of the present invention is to verify the validity of the photographed digital image so that the subject can effectively authenticate himself or herself when the subject of photography is an object (for example, ID card or the like) It is possible to authenticate that the real object has been photographed and can be used to confirm the reliability of the counterpart of the transaction.

The authentication system 100 may receive the digital image directly from the portable terminal 200. [ Alternatively, the mobile terminal 200 may receive the digital image from the external system by uploading the digital image to a predetermined external system (e.g., a social network system, an image publishing service providing system, or the like). Alternatively, after the digital image photographed from the portable terminal 200 is transmitted to a predetermined other terminal (e.g., a user's computer), the other terminal may transmit the digital image to the authentication system 100. [ In the present invention, a method of receiving the digital image by the authentication system 100 may be variously performed in association with the portable terminal 200.

In the present invention, a digital image does not only mean a single image but also includes an image (for example, an image frame included in a moving image) that can be provided by a moving image or other method.

The authentication system 100 and the portable terminal 200 may be directly or indirectly connected to each other through a wired / wireless network to transmit / receive various information and / or data necessary for the technical idea of the present invention to implement the technical idea of the present invention .

The object to be photographed by the digital image may be an identification card, a user's card or other object expected to be occupied by the user, or may be a physical object (e.g., a face, etc.) Objects, and so on.

The present invention can be used for non-face-to-face authentication. In this case, the digital image transmitted by the portable terminal 200 may be a facial image or an ID image of the user of the portable terminal, or other authentication means (for example, a financial transaction account, a transaction account screen, a financial card (IC card, , Or a unique identity authentication means capable of authenticating the user with a security device such as a security card or an OTP), and the digital image can be used for non-face-to-face authentication. The authentication system 100 verifies that the photograph of the ID card or the like to be used in the non-face-to-face authentication is photographed by the user's portable terminal (or photographed with the physical ID card) It is possible to provide a technical idea that can be verified that the user is occupied by the user.

2 is a block diagram illustrating a schematic configuration of an authentication system 100 according to an embodiment of the present invention. As shown in FIG. 2, the authentication system 100 may include an image receiving module 110, and a determination module 170. And may further include a predetermined editing module (not shown) according to an embodiment. In accordance with an embodiment of the present invention, some of the components may not correspond to components that are essential to the implementation of the present invention, and in accordance with an embodiment, the authentication system 100 may include more configurations Elements may also be included. For example, the authentication system 100 may determine the functionality of other configurations (e.g., the image receiving module 110 and / or the determination module 170) included in the authentication system 100 and / A control module (not shown) that can control the display device.

The authentication system 100 may include hardware resources and / or software necessary to implement the technical idea of the present invention, and does not necessarily mean a single physical component or a single device . That is, the authentication system 100 may mean a logical combination of hardware and / or software provided to implement the technical idea of the present invention. If necessary, the authentication system 100 may be installed in a separate apparatus to perform respective functions And may be embodied as a set of logical structures for realizing the technical idea of the present invention. In addition, the authentication system 100 may mean a set of configurations separately implemented for each function or role for implementing the technical idea of the present invention. For example, the image receiving module 110 and / or the determination module 170 may be located in different physical devices, or may be located in the same physical device. Also, according to an embodiment, the combination of the software and / or hardware constituting each of the image receiving module 110 and / or the determination module 170 is also located in different physical devices, And may be organically coupled to implement each of the above modules.

In this specification, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may refer to a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware But can be easily deduced to the average expert in the field of the present invention.

The image receiving module 110 may receive a digital image from the portable terminal 200 or may receive the digital image through a predetermined terminal or system photographed by the portable terminal 200. The digital image may be an image photographed on a predetermined object.

Then, the determination module 170 may determine whether the digital image is an image of a three-dimensional real object corresponding to the object or an image of the object.

According to an embodiment, the determination module 170 may determine whether the user has the object, or may authenticate the user if the object is part of the user's body (e.g., a face, etc.). Of course, in the latter case, an additional image (for example, an ID card image, etc.) other than a digital image for a part of the body may be further used for authentication, and the portable terminal 200 may further transmit the additional image to the authentication system (100).

For example, according to an embodiment of the present invention, when an image transmitted to the authentication system 100 includes a first object and a second object, or includes a first digital image and a second object including a first object When the second digital image is transmitted to the authentication system 100, the first object may be an object (for example, ID, employee ID, etc.) in which the user's face image is displayed, May be the face of the user photographed by the user. In the present invention, the face image of the user photographed by the portable terminal means not only a single photograph but also at least one photograph including facial and / or lateral photographs. As the number of photographs such as the user's face and side photographs increases, the accuracy of the user authentication can be improved. However, the number of photographs to be photographed can be selected because the user's inconvenience increases. In the embodiment of the present invention, the face image of the user is described as one photograph, but it is easily understood that the average experts in the field to which the present invention belongs can be a plurality of chapters.

According to the technical idea of the present invention, the user authenticates the first object (e.g., ID card) on which his / her face is displayed and the image (or the first object image and the second object image) To the system 100 so as to perform the identity authentication. In this case, the authentication system 100 may merely determine that the authentication of the user is successful by merely receiving the photographed image of the first object and the second object. Of course, authentication may be performed only when the first and second objects are compared with each other by a staff member of the authentication system 100, and the employee determines that the comparison result is the same person. When the authentication process is performed by the authentication system 100, a comparison operation is performed visually by the employee of the authentication system 100, and when the terminal of the employee determines that the same face is the same, . ≪ / RTI >

In this case, an effect similar to offline face-to-face authentication (for example, a process of presenting an ID card off-line and comparing the face of the user face and the ID card with the naked eye by the authentication side) can be obtained. Depending on the implementation, the authentication system 100 may determine whether the facial image displayed on the first object and the captured user's face image (second object) represent the same person, through a predetermined automated solution And the authentication of the user may be successful according to the determination result.

Meanwhile, according to the technical idea of the present invention, at least one of the application system 400 or the authentication system 100 can perform authentication of the user's personal identity, and is included in the first object Or a face image captured by the portable terminal. To this end, the authentication system 100 or the application system 400 may include an editing module (not shown).

The image processing may include, for example, scaling one of the first face image (the image included in the identification card) or the second face image (the face image taken by the portable terminal) to the same or similar size as the other one . According to an embodiment of the present invention, an image adjustment process may be included in which an image is changed or an image is filtered so as to have the same or similar color, roughness, or brightness as the other image. In any case, the image processing may be performed in such a way that the image attributes of the first face image and / or the second face image are compared with a relative image (e.g., a second face image in the case of a first face image, Based on the image attributes (e.g., size, color, illuminance, and / or brightness, etc.) of the first face image (which means first face image).

After this image processing process is performed, an editing module (not shown) included in the authentication system 100 or the application system 400 may be used to facilitate comparison of the first face image and the second face image An image arrangement process can be performed.

The image arrangement process may include arranging the first face image and the second face image after the image processing is performed in a first area and a second area, respectively, which are predefined on a predetermined UI. The first face image and the second face image can be confirmed at the same time through the image arrangement process, thereby increasing the efficiency of the comparison process.

Depending on the implementation, only the image placement process may be performed without the image processing. In this case, the first face image and the second face image may be simply placed in the first region and the second region so that a predetermined solution or user can easily compare the first face image and the second face image.

If the second face image is a plurality of photographs, the arrangement area can be appropriately adjusted according to the number of photographs. For example, an ID photo may be arranged first, a plurality of face photographs may be simply arranged, or a plurality of photographs may be arranged side by side with the ID photo up or down. Or you could put a photo of your ID at the center and put a lot of photos around it. It will be appreciated by those of ordinary skill in the art that the manner of placement may vary.

An example of an image placement process is shown in FIG.

4 is a diagram for explaining a process of authenticating a user using a plurality of images according to the technical idea of the present invention.

4A shows an example of a first digital image 10 for a first object (e.g., ID card) on which a face 11 of the user is displayed. FIG. 4B shows an example of a face of the user, And the second digital image 20 captured by the second digital camera 20 is shown.

The application system 400 may then apply the at least one of the first face image 11 of the user included in the first digital image 10 or the second face image 21 included in the second digital image 20 Image processing can be performed. 4C shows an example in which image processing is performed on the first face image 11, but the image processing on the second face image 21 may be performed, and the two images 11 and 21 It is needless to say that the predetermined image processing may be performed for each of the plurality of image processing units.

In any case, the image processing may refer to a process in which the image attributes (e.g., size, color, brightness, and / or illumination) are changed to facilitate comparison of the two images 11 and 21 with each other.

The application system 400 may then perform an image placement process for two face images as shown in FIG. 4C.

The image placement process includes a process of placing an image so that two face images 11, 21 can be identified at the same time. For example, as shown in FIG. 4C, the first face image 11-1 after the image processing is performed is arranged in the first predetermined area, and the second face image 21-1 or the second face image 21-1 after the image processing is performed It is possible to arrange the second face image 21 in which the image processing is not performed, in the second predetermined area. The first area and the second area do not necessarily have to be arranged horizontally as shown in FIG. 4C, but may be disposed vertically or in some embodiments, the first area and the second area overlap each other. When the first region and the second region are arranged so as to overlap with each other, image processing is performed on one of the face images as transparent or translucent (or in a faint color), and the other face image is displayed on a specific portion , Eye, nose, or eye, specific point on the nose, etc.).

For example, from each of the first face image and the second face image, the editing module can determine each position indicating a specific region. Then, based on the respective positions, the first face image (or the first face image subjected to the image processing) and the second face image (or the second face image processed with the image) can be arranged to overlap with each other. Of course, any one of the face images can be displayed as transparent or translucent. In such a case, the comparison between the facial images can be easily performed depending on whether or not the specific region is displayed overlapping and how much the remaining regions overlap the same or similarly.

In any case, the first area and the second area can be arranged so that the first face image and the second face image can be easily compared with each other.

The comparison image obtained as a result of the image placement process may be transmitted by the application system 400 to the authentication system 100 and the authentication system 100 may transmit the comparison image to a predetermined employee terminal . Then, the employee can determine that the authentication of the user is successful if the two images of the face are judged to be the same person through the comparison image. Of course, the employee terminal may send a success signal to the authentication system 100. [

According to an embodiment of the present invention, the authentication system 100, which receives the comparison image obtained as a result of the image arrangement process by the application system 400, determines whether two face images are the same person It can be judged whether or not.

On the other hand, the image processing and / or image placement process may be performed by the authentication system 100. The application system 400 may send the first digital image 10 and the second digital image 20 to the authentication system 100 or the first face image 11 and the second face 20, The digital image including the image 21 may be transmitted to the authentication system 100. Also, as will be described later, at least one of the first digital image 10 or the second digital image 20 may be an illumination active image.

The authentication system 100 may then image the first face image 11 and / or the second face image 21 and perform an image placement process to generate the comparison image. For this, the authentication system 100 may include a predetermined editing module (not shown). It goes without saying that the authentication system 100 may perform only the image placement process.

On the other hand, when a user attempts to authenticate a user by using a first digital image that is an object of a user's face (for example, an ID) and a second digital image that a user's face is photographed, The face image displayed on the object may be adjusted and photographed. In this case, even if a malicious user does not photograph his / her face, the authentication system 100 may cause the user authentication to be successful.

The technical idea of the present invention provides a technical idea that can distinguish whether a predetermined digital image is an image of a real object or a two-dimensional image such as a photograph of the real object.

According to an exemplary embodiment of the present invention, the object (e.g., ID card) and the face of the user can be simultaneously photographed together with the front camera and the rear camera of the portable terminal 200 It is possible to judge that the authentication is successful only when it is photographed. That is, the application system 400 may be embodied so as to photograph the object and the face of the user together with the front camera and the rear camera for the technical idea of the present invention. In this case, the above-described problem can be solved.

Alternatively, the authentication system 100 may verify whether the image corresponding to the physical object has been captured by the two-dimensional image or has photographed the real object (e.g., a face) in an actual three-dimensional environment through a predetermined solution or method It is possible. For example, it is possible to distinguish whether the image received through machine learning or deep learning is a two-dimensional photograph or a three-dimensional real object after learning a plurality of images.

Or whether the authentication system 100 side has photographed the face image displayed on the object by the second digital image on the basis of the resolution or the image quality of the second digital image or a real object ) Is photographed.

According to an embodiment, when the second digital image is captured, the application system 400 may control a predetermined lighting device (e.g., a flash) installed in the portable terminal 200 to be activated. The application system 400 or the image acquisition module 410 captures an image by controlling the image capturing means provided in the portable terminal 200 to acquire a digital image captured through the image capturing means Of course. The lighting device may be activated automatically or may be induced to be activated by a user. The image acquisition module 410 included in the application system 400 allows the illumination device to emit light when capturing an object (e.g., a user's face or an item) through the portable terminal 200, The control unit can control to shoot the object in a state of being in a state of being in the state In the case of performing such control, the degree of reflection of light when taking a real object (for example, a face or an article) and taking a picture may differ to such a degree that the degree of light reflection can be clearly distinguished by a predetermined solution or the naked eye . That is, when reflection of light and photographing of a two-dimensional photograph are taken when a real object in a three-dimensional space is photographed on and off, reflection of light may have different image characteristics.

Of course, in order that the reflection characteristic of the light may well appear in the image, the application system 400 may guide and / or control the image capturing so that the image can be photographed while maintaining a certain distance from the object, . Or control such that an object to be imaged (e.g., ID, face, article, etc.) has a certain size on the entire image.

For example, when a photograph is photographed with a fresh light, a relatively large amount of light is reflected on the photographed photograph, or the light emission effect itself by the fresh light appears on the photograph. On the other hand, There may be no phenomenon or it may be relatively small. Therefore, the predetermined solution or staff provided in the authentication system 100 divides the difference into predetermined image recognition methods, and automatically determines whether the second digital image is a captured image of a real object or a captured image of a photo (or image) Or by visual inspection.

According to the technical idea of the present invention, even if the image acquisition module 410 photographs an image while activating the lighting device of the portable terminal 200, even if the user arbitrarily manipulates the lighting device by hand, It may be attempted to neutralize the technical idea of the present invention to distinguish the difference in the reflection characteristics of light when the image is captured and when the image is captured. That is, the image acquisition module 410 may activate the lighting device automatically or manually, but if the user physically blocks the light of the lighting device, then the image acquisition module 410 or the authentication system 100 may obtain A phenomenon in which the image is recognized as an image photographed while the illumination device is activated but the illumination device is not actually activated may appear.

To solve this problem, the image acquisition module 410 may continuously photograph at least two images. Continuous photographing means photographing at least two images successively in a relatively short time, and an action to be performed by the user in order to photograph successively may be a single photographing request (selection of a specific button or a UI) However, various embodiments may be possible. For example, if the image acquisition module 410 performs image capture automatically or manually by the user (e.g., when a particular button or UI is selected), the image acquisition module 410 may determine that the first image is an image And the second image can be photographed while the illumination device is activated. The photographing of the first image can be performed even if the user does not explicitly request the photographing. For example, the photographing of the first image may be performed automatically such that the user does not perceive the photographing. Therefore, even if the user performs only one act of photographing, the image acquisition module 410 photographs at least two images, one of which is photographed while the lighting device is not activated, and the other is photographed while the lighting device is activated . Then, the user may recognize that only one photographing has been performed while the illuminating device is activated. Generally, in order to solve a problem in which a malicious user physically shields a lighting device, in order to solve a problem in which a malicious user physically shields the lighting device, the user first photographs the lighting device in a disabled state, It may be desirable to take an image at the first time, but depending on the implementation, the lighting device may be able to take an image first in an activated state and then in an inactive state.

In this specification, the case where the illumination device continuously photographs images in the activated state and the inactivated state is mainly described, but depending on the embodiment, the illumination device may be operated in a different illumination state (e.g., It is needless to say that the technical idea of the present invention can also be applied to the case of photographing continuously such that the intensity is different or the kind of illumination is made different).

In any case, the image acquisition module 410 may continuously capture at least two images that are intended for a given object, and at least two of the captured images may be images photographed in different lighting conditions . The image acquisition module 410 can control the illumination device provided in the portable terminal 200. In such a case, if the user maliciously performs an operation of shielding the lighting device, the image characteristic due to the reflection characteristic of light may not be displayed on the inactive illumination image and the active image of illumination. In such a case, It can be judged that it is not.

In addition, when both the illumination active image and the illumination inactive image are acquired, image characteristics due to reflection of light output from the illumination device can be obtained very clearly. For example, when obtaining the difference image represented by the difference of the illumination-inactive image in the illumination-active image, the difference image may well exhibit an image characteristic representing reflection of light or the like, and through the image characteristic, It is possible to clearly distinguish whether the at least two images are an image of a real object or an image of an image by judging whether the image has a characteristic of being photographed or a characteristic of photographing a two-dimensional image.

According to an embodiment, it is possible to judge whether at least one digital image has photographed a physical object by photographing an object to be photographed at a plurality of angles. For example, the face image or the photo displayed on the ID card is usually an image that faces the front face or indicates a certain direction of the object. The application system 400 allows the user to face the face of the user, So that the plurality of images can be transmitted to the authentication system 100. In the authentication system 100, In this case, since the digital image that can be obtained from the photographed image of the physical object (e.g., the user's face) can not be acquired by the two-dimensional photograph, the above-described problem can be solved.

In some cases, an unauthorized user may have images taken at different angles with respect to a specific object, and when the unauthorized user photographs each of the images, the authentication is successful even if the real object of the specific object is not photographed It is possible.

In order to solve such a problem, the image acquisition module 410 of the application system 400 may photograph the physical object at an angle (automatically or manually), and then determine whether the mobile terminal rotates at a certain angle, It is possible to judge whether or not it is moving by a distance. The image acquisition module 410 may receive the degree of rotation or the degree of motion of the portable terminal 200 from a sensor (for example, an inertial sensor or the like) provided in the portable terminal 200. When it is determined that the movement corresponding to the specific angle or the specific distance has been performed, the image acquisition module 410 may photograph the real object again. For example, the image acquisition module 410 may guide the portable terminal 200 to rotate clockwise or counterclockwise after capturing a physical object at a predetermined angle. When the mobile terminal 200 is rotated by the specific angle or the specific distance, the user can guide the user to stop the rotation and then photograph the physical object automatically or manually.

Then, the specific angle or specific distance is controlled by the image acquisition module 410, and a plurality of images of the real object photographed may be transmitted to the authentication system 100 through the communication module. In such a case, even if an unauthorized user is holding a plurality of images photographed at a plurality of angles with respect to a specific object, it is impossible to know how the angle or distance is determined by the image acquisition module 410, . Of course, the image acquisition module 410 or the authentication system 100 may arbitrarily determine the angle or the distance each time the authentication process is performed. In such a case, the possibility that authentication is succeeded by using an image obtained by an unauthorized user by photographing a two-dimensional image as if it were photographed as if the real object is photographed may be very low.

Through the above-described technical idea, it is possible to verify a case in which a malicious user captures an image of a photograph or the like (for example, a photograph of an article or a face image displayed on an ID card) without photographing the real object, When the digital image received from the application system 400 is an image of a photograph or the like rather than a real object (for example, a face or a product of a user) photographed, the authentication system 100 authenticates the user It can be handled as a failed shooting authentication.

The technical idea of the present invention which can distinguish whether a predetermined digital image is an image of a real object or an image of a photograph or the like taken by the physical object is not only authentication of the user but also whether or not the real object has been photographed It can be widely used for authentication.

For example, when a user performs a commercial transaction such as a transaction for a used article, there is a case where an image of an article not owned by the seller is uploaded to a predetermined service page to conduct a fraudulent transaction.

In this case, the application system 400 and / or the authentication system 100 according to the technical idea of the present invention can verify whether the image is an image of a real object or an image of an image.

For example, the image acquisition module 410 of the application system 400 may transmit at least one digital image associated with a predetermined object (e.g., an article to be authenticated, etc.) to the image capturing means of the portable terminal 200 Etc.).

The communication module 430 may then transmit the at least one digital image to the authentication system 100.

The authentication system 100 receives at least one digital image from the communication module 430, and generates an image (hereinafter, referred to as " digital image " (Hereinafter, referred to as an 'image pickup image') or a two-dimensional image corresponding to the object (hereinafter referred to as an 'image pickup image'). And based on the result, authentication of the user corresponding to the object or authentication of the object photographing authentication of the object can be performed by the authentication system 100. [

At this time, the digital image obtained and transmitted by the application system 400 may be one or a plurality of digital images. An image acquired by the application system 400 and transmitted to the authentication system 100, either one or multiple, will be defined as an image for authentication.

Then, in the authentication image, an image (hereinafter, referred to as an 'illumination active image') in which the object (e.g., an article or a face, etc.) is photographed in a state in which the illumination device Quot;). To this end, the image acquisition module 410 may control the portable terminal 200 to activate the lighting device automatically or manually as described above.

According to another embodiment, the authentication image may include a plurality of images obtained by photographing the object at different angles as described above. At least one of the plurality of images may be a light-activated image, and all of the plurality of images may be an image (hereinafter, referred to as a 'light-inactive image') in a state in which the illumination device is not activated.

According to the technical idea of the present invention, the application system 400 and / or the image processing system 400 may be used to determine whether at least one digital image photographed for the object (e.g., article or face, etc.) Or the authentication system 100 may utilize a lighting active image and utilize a plurality of images photographed at different angles. To this end, the authentication system 100 may include a predetermined determination module 170.

When the illumination active image is used, the determination module 170 of the authentication system 100 determines whether or not the light received from the communication module 430 has been received from the communication module 430 in a state in which the information about the image characteristic appearing in the image- It is possible to determine whether the image characteristic appears in one image or a plurality of images.

The image characteristics that appear in the image-taking image in the active illumination state may be, for example, an image feature associated with the reflection of the illumination or the like.

For example, in the case of a live image in the active illumination state, the degree of reflection of the illumination may be small or absent, and in the case of the image taken image in the active illumination state, the degree of reflection of the illumination may be large. Or at least the actual image in the illumination active state is different between the degree of reflection of the light of the real object part and the degree of reflection of the background part, The degree of reflection of the portion of the illumination may be substantially the same. Or the live image in the active illumination state, the images of the object portion are homogeneous and clear, while the image taken image may show portions in which a specific portion of the object portion is not homogeneous or unclear. The authentication system 100 thus defines the real image in the light activated state and other image characteristics that appear in the image captured image, and thereby determines whether the digital image received from the application system 400 is a real image or an image captured image Can be determined.

The determination module 170 may include a predetermined learning module (not shown) to grasp the characteristics of the real image and the image taken image. The learning module (not shown) may receive a plurality of images and perform learning. For example, while inputting a plurality of images (image pickup image and real image) in a lighting active state with respect to a predetermined object, information on whether each image is an image pickup image or a real image can be inputted as an input parameter .

The learning module may then derive image features that appear in the image capture image in the active illumination state through various types of learning algorithms. For example, the image shown in FIG. 5A is an image pickup image in an illumination active state for a specific object (for example, a remote controller), and the image shown in FIG. 5B is a real object Image.

As can be seen in Fig. 5, the image pickup image in the active illumination state has the same or similar reflected characteristics of the illumination of the object portion (e.g., the remote control portion) and the background portion, For example, the remote control portion) and the reflected characteristics of the illumination of the background portion may be dissimilar. In addition, the real image in the active state of illumination may be such that the images of the object portion are homogeneous and clear, while the image taken image may show portions in which the specific portions of the object portion are not homogeneous and unclear. Therefore, the reflection characteristics of the illumination, such as the difference between the object part and the background part, the difference of the homogeneity and the sharpness of the object part, may be learned as the image characteristics of the image taken image in the illumination active state. It goes without saying that various image characteristics can be learned by the learning module while learning is performed in addition to these characteristics.

After the learning is performed, the determination module 170 determines whether the digital image is an image of a two-dimensional digital image or a three-dimensional real object based on the learning result of the learning module It is possible to determine whether the image is a photographed image.

The learning algorithm used by the learning module may be various types of machine learning or deep learning, but is not limited thereto. As described above, any algorithm capable of learning enough to distinguish an image captured image and a real image in an illumination- Can also be used.

On the other hand, when the image characteristic is derived through the learning as described above, the authentication system 100 may receive only one digital image from the application system 400, May be determined. However, for more precise judgment, the authentication image may include the lighting active image and the lighting inactive image for a given object (e.g., an article carried by a user or a user's face, etc.). That is, the image acquisition module 410 may obtain both the illumination active image and the illumination inactive image for the same object, and may transmit the acquired images to the authentication system 100. Then, the authentication system 100 can perform an authentication process to more clearly determine whether the received images based on the illumination active image and the illumination inactive image are a real image or an image capture image.

For example, the determination module 170 may obtain image differences between the lighting active image and the lighting inactive image. It goes without saying that the information on the image difference can more clearly indicate the reflection characteristic of the illumination. Accordingly, the determination module 170 can determine whether the received images are image-captured images by determining whether the acquired information has the image characteristics of the image-captured image have. Of course, even in this case, the image characteristic may be grasped by the authentication system 100 in advance by learning, or may be grasped in various other ways.

In addition, the illumination active image and the illumination inactive image may be continuously acquired even if the user performs only one photographing operation as described above. Of course, each of the users may perform a plurality of photographing actions. Also, depending on the implementation, the image acquisition module 410 of the application system 400 may in fact acquire a lighting inactive image continuously before or after photography of the lighting active image, even if the user perceives that only one lighting active image has been photographed Is as described above. In addition, when both the illumination active image and the illumination non-active image are used, it is possible to more clearly grasp whether the images are the real image or the image taken image, and also to solve the problem in the case where the malicious user physically shades the illumination device Is as described above.

Also, as described above, the authentication image may include a plurality of images in which the object (e.g., an article held by a user or a user's face) is photographed a plurality of times at different angles. The determination module 170 may determine whether the authentication image is a real image or an image capture image based on the plurality of images.

According to an example of determining whether the image for authentication is a real image or an image taken image based on a plurality of images, the determination module 170 determines whether or not the same object (e.g., article or face, etc.) It may be determined that the authentication process has succeeded by only receiving a plurality of images. However, as described above, if an unauthorized user has a plurality of images taken at different angles, there is a risk that wrong authentication may be performed. Accordingly, after the application system 400 photographs the object at a predetermined angle as described above, it determines whether the photographing angle of the portable terminal is changed to a specific angle through a sensor included in the portable terminal, It may control the mobile terminal 200 to photograph the object when it is determined that the object has changed to an angle. The particular angle (or specific distance) may be arbitrarily selected by the image acquisition module or the authentication system. In this case, the application system 400 and the authentication system 100 may share information about the specific angle (or a specific distance) through communication, and the authentication system 100 may perform the authentication process A process of determining whether the degree of change of the photographing angle of the received plurality of digital images corresponds to the specific angle may be included. In this case, since authentication can be determined to be successful by the authentication system 100 only when images having a difference in an arbitrarily selected angle (or distance) are received, there is an effect that an attempt of an unauthorized user can be blocked. Such an effect may exist even when the application system 400 controls to shoot the next image only when the specific angle is changed after the image is taken at a predetermined angle.

In addition, both the image (real image) in which a user's face is photographed for user authentication and the image in which an object (for example, an ID card) on which the user's face is displayed are transmitted from the application system 400 to the authentication system 100 , The image of either one of the two images may be an illumination active image.

As a result, according to the technical idea of the present invention, the application system 400 allows the authentication system 100 to transmit a digital image intended for a predetermined object (e.g., article or face, etc.) It is possible to authenticate whether or not the real object of the object has been photographed by judging whether it is the photographed real image or perform the user authentication.

According to the technical idea of the present invention, whether or not the predetermined digital image determined by the determination module 170 is a real image or an image taken image may not necessarily be performed by the authentication system 100.

According to an exemplary embodiment of the present invention, the determination process performed by the determination module 170 (i.e., determining whether a predetermined digital image is a real image or an image captured image) may be performed by the application system 400. [ The application system 400 may include a determination module 440 for this purpose.

In this case, when the image acquisition module 410 acquires at least one digital image for an object through an image photographing means (e.g., a camera) of the portable terminal 200, Based on the at least one digital image acquired through the acquisition module 410, whether the digital image is a three-dimensional object image or a two-dimensional image image. In addition, the determination module 440 may include a learning module (not shown) as described above, and image characteristics as described above may be learned by a learning module included in the application system 400. [ In some implementations, learning of image characteristics may be performed by the authentication system 100, and a learning module included in the determination module 440 may receive a result of performing the learning.

Also, as described above, the image acquisition module 410 included in the application system 400 may acquire at least one of the at least one digital image as a light active image, or may acquire a plurality The determination module 440 can determine whether the authentication image is a real image or an image taken image based on the at least one digital image thus obtained.

The application system 400 may transmit the digital image to the authentication system 100 only when the digital image is a real image as a result of the determination by the determination module 440. [

The technical idea for determining whether the digital image photographed for a predetermined object is a real image or an image photographed image as described above according to the present invention is an application system 400 installed in the portable terminal 200 ) Or the authentication system 100, as shown in FIG.

Any system having data processing capability (hereinafter, referred to as a 'digital image determination system') for realizing the technical idea of the present invention can implement the above technical idea.

A schematic configuration of the digital image judgment system is shown in Fig.

Fig. 6 shows a schematic configuration of a digital image determination system 500 according to the technical idea of the present invention.

Referring to FIG. 6, the digital image determination system 500 may include an acquisition module 510 and a determination module 520.

The digital image determination system 500 may be implemented in the application system 400 installed in the portable terminal 200 described above and may be implemented in the authentication system 100 but is not limited to any data processing system Can be implemented.

The acquisition module 510 included in the digital image determination system 500 may acquire at least one digital image (an image for authentication) that is intended for a predetermined object. The acquisition module 510 may acquire the authentication image from the image capturing means provided in the digital image determination system 500 when the digital image determination system 500 includes the image capturing means. According to an embodiment, the acquisition module 510 may obtain the authentication image through communication with the outside. Wherein the authentication image may include at least one lighting active image that targets the object as described above. According to an embodiment, the authentication image may include a plurality of images obtained by photographing the object at different angles.

Then, the determination module 520 determines whether the digital image is a three-dimensional object image or a two-dimensional image image, based on the authentication image acquired by the acquisition module 510 .

The determination process performed by the determination module 520 may be the same as that of the determination module 170 included in the authentication system 100.

3 shows an example of an application system according to an embodiment of the present invention.

Referring to FIG. 3, the application system 400 may refer to a system in which an application for implementing the technical idea of the present invention and the hardware of the portable terminal 200 are combined and implemented.

The application system 400 may include an image acquisition module 410 and a communication module 430. The application system 400 may further include a determination module 440.

The image acquisition module 410 may acquire a digital image photographed through an image photographing means (for example, a camera application and / or a camera) included in the portable terminal 200. The digital image may be an image photographed by the portable terminal 200 on a predetermined object as described above. The object may be an object designated by the authentication system 100.

The application system 400 for implementing the technical idea of the present invention may be implemented as an independent application or included in another application (e.g., an application such as a financial institution).

The communication module 430 may communicate with the authentication system 100.

The determination module 440 may determine whether at least one digital image obtained by the image acquisition module 410 is a real image of a real object or an image of a captured image. The functions or processes performed by the determination module 440 included in the application system 400 for the determination may be the same as those performed by the determination module 170 in the authentication system 100 A detailed description thereof will be omitted.

The application system 400 may be configured to determine whether a digital image obtained by the image acquisition module 410 is validated by a predetermined service server (e.g., authentication system 100 or other A system for providing wired / wireless Internet services).

The authentication system 100 or the digital image determination system 500 according to the technical idea of the present invention can be employed in various services or systems that need to prevent counterfeiting or theft of photos in addition to non-face authentication. For example, a system of an automobile insurance company that provides a service that checks the mileage or the installation of a black box and discounts insurance premiums, or a system in which a photograph of another person is taken when a used article is bought and sold, The technical idea of the present invention can also be applied to a used goods trading system for preventing the case of pretending to be as if it were the case.

On the other hand, according to an embodiment, the authentication system 100 may include a processor and a memory for storing a program executed by the processor. The processor may include a single-core CPU or a multi-core CPU. The memory may include high speed random access memory and may include non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to the memory by the processor and other components can be controlled by the memory controller. Here, when the program is executed by a processor, the program may cause the authentication system 100 according to the present embodiment to perform the above-described authentication method.

Meanwhile, the authentication method according to the embodiment of the present invention may be implemented in the form of a program-readable program command and stored in a computer-readable recording medium. Also, the control program and the target program according to the embodiment of the present invention may be stored in a computer- And the like. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Program instructions to be recorded on a recording medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of software.

Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk and a magnetic tape, optical media such as CD-ROM and DVD, a floptical disk, And hardware devices that are specially configured to store and execute program instructions such as magneto-optical media and ROM, RAM, flash memory, and the like. The above-mentioned medium may also be a transmission medium such as a light or metal wire, wave guide, etc., including a carrier wave for transmitting a signal designating a program command, a data structure and the like. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

Examples of program instructions include machine language code such as those produced by a compiler, as well as devices for processing information electronically using an interpreter or the like, for example, a high-level language code that can be executed by a computer.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

Claims (34)

1. An application system installed in a portable terminal,
An image acquiring module for acquiring at least one digital image targeted at an object through an image photographing means of the portable terminal;
And a communication module for transmitting the at least one digital image acquired by the image acquisition module to an authentication system,
Wherein, when the at least one digital image is received by the authentication system, it is judged whether the digital image is a three-dimensional object image or a two-dimensional image image based on the received at least one digital image And an authentication process of authenticating a user corresponding to the object or authenticating whether the object is photographed is performed,
Wherein the image acquisition module comprises:
Acquiring at least one of the at least one digital image as a light active image,
And acquires a plurality of images obtained by photographing the object at different angles.
The method according to claim 1,
When the illumination active image is received by the authentication system, it is determined whether or not the image characteristic that appears when the two-dimensional image is photographed with the illumination device activated is displayed in the illumination active image, and the authentication process is performed An application system characterized by.
3. The authentication system according to claim 2,
Wherein a plurality of images in which a three-dimensional object is photographed and a plurality of images in which a two-dimensional image is photographed are received in a state in which the illumination device is activated, and the image characteristic is learned through machine learning or deep learning. system.
2. The apparatus of claim 1,
Acquiring an illumination inactive image in which the object is photographed with the illumination active image and the illumination device of the portable terminal being inactivated,
Wherein the authentication system is performed to determine whether the illumination device is physically obscured based on the difference between the illumination active image and the illumination inactive image.
5. The apparatus of claim 4, wherein the image acquisition module comprises:
Wherein the illumination inactive image and the illumination active image are successively photographed even if the image capturing request input by the user is input once.
2. The apparatus of claim 1,
Controls the portable terminal to photograph a plurality of the objects at different angles,
The method comprising the steps of: capturing the object at a predetermined angle, determining whether a photographing angle of the portable terminal is changed to a specific angle through a sensor included in the portable terminal, system.
7. The method of claim 6, wherein the particular angle is selected by the image acquisition module or the authentication system,
Wherein the authentication process performed by the authentication system includes:
And determining whether the degree of change of the photographing angle of the received plurality of digital images corresponds to the specific angle.
The method according to claim 1,
Wherein the at least one digital image transmitted to the authentication system comprises:
Wherein the first image based on the user's first face image displayed on the object and the second image based on the second face image on which the user's real face is captured are obtained by the image acquisition module.
9. The application system of claim 8, wherein at least one of the first image or the second image is a lighting active image.
9. The system of claim 8,
And an editing module for arranging and comparing the first image and the second image in a first area and a second area of a predetermined UI.
9. The system of claim 8,
An editing module for determining respective positions indicating a specific region from the first face image and the second face image and arranging the first face image and the second face image so as to overlap and to make a comparison based on the respective positions, Lt; / RTI >
12. The system of claim 10 or 11,
The first face image itself; or
Using the first face image as the first image with the image processed based on the image attribute of the second face image,
Wherein the second image is an image obtained by processing the second face image itself or the second face image based on an image attribute of the first face image as the second image.
2. The apparatus of claim 1,
And acquires the first image and the second image simultaneously or within a predetermined time difference through each of a plurality of image acquiring means provided in the portable terminal.
1. An application system installed in a portable terminal,
An image acquisition module for acquiring a digital image of an object through an image photographing means of the portable terminal;
And a communication module for transmitting the digital image acquired by the image acquisition module to an authentication system,
Wherein, when the at least one digital image is received by the authentication system, it is judged whether the digital image is a three-dimensional object image or a two-dimensional image image based on the received at least one digital image And an authentication process of authenticating a user corresponding to the object or authenticating whether the object is photographed is performed,
Wherein the image acquisition module comprises:
And continuously photographs at least two digital images photographed in different illumination conditions on the object.
15. The method of claim 14,
Wherein the at least two digital images that are successively photographed include a lighting active image and a lighting inactive image.
15. The apparatus of claim 14,
Wherein at least two digital images intended for the object are continuously photographed even if an image shooting request input by the user is input once.
1. An application system installed in a portable terminal,
An image acquiring module for acquiring at least one digital image targeted at an object through an image photographing means of the portable terminal; And
When the at least one digital image is acquired through the image acquisition module, determines whether the digital image is a three-dimensional object image or a two-dimensional image image, based on the acquired at least one digital image And a determination module,
Wherein the image acquisition module comprises:
Acquiring at least one of the at least one digital image as a light active image,
And acquires a plurality of images obtained by photographing the object at different angles.
18. The apparatus of claim 17, wherein the image acquisition module comprises:
And continuously photographs at least two digital images photographed in different illumination conditions on the object.
An acquisition module for acquiring at least one digital image intended for a given object; And
A determination module for determining whether the digital image is a three-dimensional object image or a two-dimensional image image based on the at least one digital image acquired by the acquisition module,
Wherein the determination module comprises:
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image,
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on a plurality of images taken at different angles of the objects included in the at least one digital image Characterized by a digital image determination system.
20. The apparatus of claim 19,
Wherein the digital image is an image of a three-dimensional real object based on at least two images successively photographed in different illumination states on the at least one digital image, And judges whether or not the image is photographed.
20. The apparatus of claim 19,
A digital image determination system for determining whether an image characteristic that appears when a two-dimensional image is taken with a lighting device activated is present in the lighting active image.
22. The apparatus of claim 21,
A plurality of images in which a three-dimensional object is photographed and a plurality of images in which a two-dimensional image is photographed are input in a state in which the illumination device is activated, and the image characteristic is learned through machine learning or deep learning. Image judging system.
20. The apparatus of claim 19,
Acquiring the illumination active image and a lighting inactive image photographed in a state in which the illumination device of the portable terminal is inactivated,
Wherein the determination module comprises:
Wherein the determination is performed based on the illumination active image and the illumination inactive image.
In an authentication system,
An image receiving module for acquiring at least one digital image of an object from a portable terminal; And
It is determined whether the digital image is a three-dimensional object or a two-dimensional image, based on at least one digital image received by the image receiving module, And a determination module that performs an authentication process of authenticating whether or not the object is photographed,
Wherein the determination module comprises:
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image,
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on a plurality of images taken at different angles of the objects included in the at least one digital image Authentication system characterized by.
25. The apparatus of claim 24,
Wherein the digital image is an image of a three-dimensional real object based on at least two images successively photographed in different illumination states on the at least one digital image, An authentication system for determining whether or not an image has been captured.
A digital image determination system comprising: obtaining at least one digital image intended for a given object;
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on the acquired at least one digital image,
Wherein the step of determining whether the digital image captures a three-dimensional object or a two-
Wherein the digital image determination system determines whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image ; or
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on a plurality of images taken at different angles of the objects included in the at least one digital image; Wherein the digital image determination method comprises the steps of:
27. The method of claim 26, further comprising: determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image Quot;
Determining whether an image characteristic that appears when the two-dimensional image is photographed with the lighting device activated is present in the lighting active image.
28. The digital image determination method according to claim 27,
Wherein the digital image determination system receives a plurality of images from which a three-dimensional object is photographed and a plurality of images from which a two-dimensional image is photographed while the lighting apparatus is activated, and learns the image characteristics through machine learning or deep learning Further comprising the steps of:
27. The method of claim 26, wherein the at least one digital image comprises:
And a lighting inactive image photographed in a state in which the lighting device of the portable terminal is inactivated,
Wherein the step of determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least one lighting active image included in the at least one digital image,
And performing the determination based on the lighting active image and the lighting inactive image.
27. The system of claim 26, wherein the digital image determination system is adapted to determine whether the digital image has taken a three-dimensional physical object or a two-dimensional image based on at least one lighting active image included in the at least one digital image Wherein the step
Wherein the digital image is an image of a three-dimensional real object based on at least two images successively photographed in different illumination states on the at least one digital image, And judging whether or not the image is photographed.
The digital image determination system comprising the steps of: obtaining at least two images successively photographed in different illumination conditions on a predetermined object; And
Determining whether the digital image has taken a three-dimensional object or a two-dimensional image based on at least two images, or determining whether the illumination device is physically obscured at the time of shooting Wherein the digital image determination method comprises the steps of:
32. The method of claim 31,
Wherein the at least two digital images that are successively photographed include a lighting active image and a lighting inactive image.
32. The method of claim 31,
Wherein the at least two digital images for the object are continuously photographed even if an image photographing request input to the portable terminal of the user is input once.
33. A recorded computer program for performing the method of any one of claims 26 to 33, installed in a data processing apparatus.

KR1020150136452A 2015-06-26 2015-09-25 Method for digital image judging and system tereof, application system, and authentication system thereof KR20170001933A (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR1020150091172 2015-06-26
KR20150091172 2015-06-26
KR20150125090 2015-09-03
KR1020150125090 2015-09-03

Publications (1)

Publication Number Publication Date
KR20170001933A true KR20170001933A (en) 2017-01-05

Family

ID=57835639

Family Applications (5)

Application Number Title Priority Date Filing Date
KR1020150131135A KR101748136B1 (en) 2015-06-26 2015-09-16 Method for certification using digital image, application system, and authentication system thereof
KR1020150131136A KR20170001931A (en) 2015-06-26 2015-09-16 Method for certification using digital image, application system, and authentication system thereof
KR1020150136452A KR20170001933A (en) 2015-06-26 2015-09-25 Method for digital image judging and system tereof, application system, and authentication system thereof
KR1020150136552A KR101725219B1 (en) 2015-06-26 2015-09-25 Method for digital image judging and system tereof, application system, and authentication system thereof
KR1020150136451A KR20170001932A (en) 2015-06-26 2015-09-25 Method for digital image judging and system tereof, application system, and authentication system thereof

Family Applications Before (2)

Application Number Title Priority Date Filing Date
KR1020150131135A KR101748136B1 (en) 2015-06-26 2015-09-16 Method for certification using digital image, application system, and authentication system thereof
KR1020150131136A KR20170001931A (en) 2015-06-26 2015-09-16 Method for certification using digital image, application system, and authentication system thereof

Family Applications After (2)

Application Number Title Priority Date Filing Date
KR1020150136552A KR101725219B1 (en) 2015-06-26 2015-09-25 Method for digital image judging and system tereof, application system, and authentication system thereof
KR1020150136451A KR20170001932A (en) 2015-06-26 2015-09-25 Method for digital image judging and system tereof, application system, and authentication system thereof

Country Status (1)

Country Link
KR (5) KR101748136B1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190068266A (en) 2017-12-08 2019-06-18 김정구 System for measuring weight of livestocks using image analysis and method using the same

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102114997B1 (en) * 2018-07-30 2020-05-26 주식회사 로드시스템 Passport recognition terminal and method for passport recognition using the same
KR102324779B1 (en) * 2021-06-17 2021-11-11 주식회사 큐버모티브 User authentication system
WO2023172668A1 (en) * 2022-03-09 2023-09-14 Saras-3D, Inc. Authentication and security protocols for on-line instructional system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050009415A (en) 2003-07-16 2005-01-25 양기철 Method for portrait mutual certification and computer readable record medium on which program therefor is recorded

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007122400A (en) * 2005-10-27 2007-05-17 Digital Electronics Corp Authentication device, program, and recording medium
KR101175174B1 (en) * 2010-08-20 2012-08-23 주식회사에어플러그 Method and Apparatus for deliverying information using images taken from real things as an information agent

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050009415A (en) 2003-07-16 2005-01-25 양기철 Method for portrait mutual certification and computer readable record medium on which program therefor is recorded

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190068266A (en) 2017-12-08 2019-06-18 김정구 System for measuring weight of livestocks using image analysis and method using the same

Also Published As

Publication number Publication date
KR101748136B1 (en) 2017-06-28
KR20170001931A (en) 2017-01-05
KR20170001934A (en) 2017-01-05
KR101725219B1 (en) 2017-04-27
KR20170001930A (en) 2017-01-05
KR20170001932A (en) 2017-01-05

Similar Documents

Publication Publication Date Title
US10242364B2 (en) Image analysis for user authentication
KR101703714B1 (en) Method for certification using digital image, application system, and authentication system thereof
US9652663B2 (en) Using facial data for device authentication or subject identification
JP2020064664A (en) System for and method of authorizing access to environment under access control
JP5076563B2 (en) Face matching device
JP2016051482A (en) Methods of enrolling and authenticating user in authentication system, facial authentication system, and methods of authenticating user in authentication system
US11314966B2 (en) Facial anti-spoofing method using variances in image properties
KR101725219B1 (en) Method for digital image judging and system tereof, application system, and authentication system thereof
US11410460B2 (en) Dynamic lighting for image-based verification processing
JP6954355B2 (en) Information acquisition system, information acquisition method and storage medium
US20220189110A1 (en) System and method for adaptively constructing a three-dimensional facial model based on two or more inputs of a two-dimensional facial image
US20220101651A1 (en) System, device and method for authentication with use of information code
JP2021536601A (en) Anti-replay authentication system and method
WO2022222957A1 (en) Method and system for identifying target
KR102050590B1 (en) Method for digital image judging and system tereof, application system, and authentication system thereof
JP2020144692A (en) Face collation device, face collation system, face collation method, and information recording medium issuance system
KR101792011B1 (en) Multifaceted photographing apparatus checking finger vein and fingerprint at the same time
JP4845462B2 (en) Authentication device, IC card, and biometric information authentication system
TWI729679B (en) Authentication system, authentication device, and authentication method
WO2016209032A1 (en) Digital image determination method and system, application system for same, and authentication system
RU2815689C1 (en) Method, terminal and system for biometric identification
KR20170076895A (en) Method for digital image judging and system tereof, application system, and authentication system thereof