WO2021095903A1

WO2021095903A1 - User authentication device for performing user authentication by using vein, and method therefor

Info

Publication number: WO2021095903A1
Application number: PCT/KR2019/015337
Authority: WO
Inventors: 고민영; 서승규
Original assignee: 엘지전자 주식회사
Priority date: 2019-11-12
Filing date: 2019-11-12
Publication date: 2021-05-20

Abstract

A user authentication device according to an embodiment of the present invention may comprise a contact plate with which a specific area of a user's body including a vein comes in contact, and a processor, wherein the processor: acquires a first image with respect to the specific area which is spaced apart from the contact plate by a specific distance or more; acquires a second image with respect to the specific area in contact with the contact plate; identifies a change of a vein according to whether the contact plate is in contact with the specific area, on the basis of a vein image included in each of the first image and the second image; and performs user authentication on the basis of the identifying of whether the identified change of the vein corresponds to pre-stored vein change information.

Description

User authentication device and method for performing user authentication using vein

The present specification relates to a user authentication apparatus and method for performing user authentication using veins, which are the user's biometric information.

Bio-recognition is a method of recognizing an individual using human physiological or behavioral characteristics. Such biometric recognition technologies include fingerprint, iris, vein, and face recognition. Among these methods, biometric recognition technology using veins (hereinafter, vein authentication) has the advantage of having high recognition performance, less reluctance and discomfort from the user, and fast recognition time. Accordingly, the development of biometric authentication technology using vein recognition is being actively conducted.

However, in the case of vein authentication, if information on vein patterns is leaked, there may be a risk of forgery (or manipulation). Accordingly, whether the user is a living creature based on the fact that veins are biometric information. In other words, a technology to check liveness has emerged.

Vitality check may be, for example, a technique for measuring the user's pulse. However, this technique takes a rather long time since the measurement must be made during the time the pulse beats at least once.

Accordingly, there is a need for a technology for improving security but performing user authentication quickly and easily.

The problem to be solved by the present specification is to provide an apparatus and method for user authentication that is faster and with improved security by checking bioactivity based on a change in vein when user authentication is performed using a vein.

However, the subject to be solved by the present specification is not limited immediately as mentioned above, and is not mentioned, but includes the purpose that can be clearly understood by those of ordinary skill in the art from the description below. can do.

A user authentication device according to an embodiment of the present invention includes a contact plate to which a specific area of a user's body including veins comes into contact, and a processor, wherein the processor includes the specific area spaced apart from the contact plate by a specific distance or more. Acquire a first image for, obtain a second image for the specific area in contact with the contact plate, and determine whether the contact plate is in contact based on a vein image included in each of the first image and the second image. User authentication may be performed on the basis of confirming the change in the vein according to the result and confirming whether the confirmed change in the vein corresponds to the previously stored vein change information.

A user authentication method according to an embodiment of the present specification includes the steps of acquiring a first image of the at least part spaced apart by a specific distance or more from a contact plate to which a specific area of a user's body including a vein comes into contact, and Acquiring a second image of the specific area in contact, and checking a change in vein according to the presence or absence of contact with the contact plate based on vein images included in each of the first image and the second image; and And performing user authentication based on checking whether the confirmed vein change corresponds to the previously stored vein change information.

The computer-readable recording medium according to an embodiment of the present specification includes a first image of the at least part spaced apart by a specific distance or more from a contact plate in which a specific area of a user's body including a vein is in contact with a contact plate in which the palm of the user is in contact. Obtaining a second image of the specific region in contact with the contact plate, and presence or absence of contact with the contact plate based on vein images included in each of the first image and the second image It may include checking a change in vein according to and performing user authentication based on checking whether the confirmed change in vein corresponds to pre-stored vein change information.

The user authentication apparatus and method according to the exemplary embodiment of the present specification may reduce the risk of forgery related to user authentication and improve security by checking bioactivity using a change in vein.

However, the effects obtainable in the present specification are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the technical field to which the present disclosure belongs from the following description. I will be able to.

1 is a block diagram illustrating a user authentication device related to the present specification.

2 is a diagram for conceptually explaining a user authentication method according to an embodiment of the present specification.

3 is a diagram illustrating an example of a specific area of a user's body in contact with a user authentication device according to an exemplary embodiment of the present specification.

4 is a diagram for explaining information on a change in vein acquired by a user authentication device according to an embodiment of the present specification.

5 is a functional block diagram of a user authentication device according to an embodiment of the present specification.

6 is a flowchart of a user authentication method according to an embodiment of the present specification.

7 is a flowchart of a user authentication method according to another embodiment of the present specification.

8 to 11 show examples of a user authentication device according to an embodiment of the present specification.

12 to 14 are examples of screens displayed by the user authentication device according to an embodiment of the present specification.

Hereinafter, embodiments of the present specification will be described in detail with reference to the accompanying drawings.

In describing the embodiments, descriptions of technical contents that are well known in the technical field to which the present specification pertains and are not directly related to the present specification will be omitted. This is to more clearly convey the gist of the present specification by omitting unnecessary description.

For the same reason, some elements in the accompanying drawings are exaggerated, omitted, or schematically illustrated. In addition, the size of each component does not fully reflect the actual size.

Advantages and features of the present specification, and a method of achieving them will be apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present specification is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms. It is provided to fully inform the holder of the scope of the specification, and this specification is only defined by the scope of the claims. The same reference numerals refer to the same elements throughout the specification.

In this case, it will be appreciated that each block of the flowchart diagram and combinations of the flowchart diagrams may be executed by computer program instructions. Since these computer program instructions can be mounted on the processor of a general purpose computer, special purpose computer or other programmable data processing equipment, the instructions executed by the processor of the computer or other programmable data processing equipment are described in the flowchart block(s). It creates a means to perform functions. These computer program instructions can also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular way, so that the computer-usable or computer-readable memory It is also possible for the instructions stored in the flow chart to produce an article of manufacture containing instruction means for performing the functions described in the flowchart block(s). Since computer program instructions can also be mounted on a computer or other programmable data processing equipment, a series of operating steps are performed on a computer or other programmable data processing equipment to create a computer-executable process to create a computer or other programmable data processing equipment. It is also possible for instructions to perform processing equipment to provide steps for executing the functions described in the flowchart block(s).

In addition, each block may represent a module, segment, or part of code that contains one or more executable instructions for executing the specified logical function(s). In addition, it should be noted that in some alternative execution examples, the functions mentioned in the blocks may occur out of order. For example, two blocks shown in succession may in fact be executed substantially simultaneously, or the blocks may sometimes be executed in the reverse order depending on the corresponding function.

In this case, the term'~ unit' used in this embodiment refers to software or hardware components such as FPGA or ASIC, and'~ unit' performs certain roles. However,'~ part' is not limited to software or hardware. The'~ unit' may be configured to be in an addressable storage medium, or may be configured to reproduce one or more processors. Thus, as an example,'~ unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , Subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays, and variables. Components and functions provided in the'~ units' may be combined into a smaller number of elements and'~ units', or may be further separated into additional elements and'~ units'. In addition, components and'~ units' may be implemented to play one or more CPUs in a device or a security multimedia card. In addition, what is referred to as a control unit in an embodiment may include at least one processor as a component that performs an operation for controlling a corresponding device.

1 is a block diagram illustrating a user authentication device 100 related to the present specification. The user authentication device 100 may be implemented in the form of a mobile terminal, and accordingly, the user authentication device 100 will be referred to as a mobile terminal 100 below, but the present specification is not limited to such terms.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190. And the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, and thus, a mobile terminal described in the present specification may have more or fewer components than those listed above.

More specifically, among the above components, the wireless communication unit 110 is provided between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and an external server. It may include one or more modules to enable wireless communication between. In addition, the wireless communication unit 110 may include one or more modules that connect the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching of at least two broadcast channels.

The mobile communication module 112 includes technical standards or communication methods for mobile communication (for example, GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000)), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.), transmits and receives radio signals with at least one of a base station, an external terminal, and a server.

The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission and reception of text/multimedia messages.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and the like, and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) May be understood as a kind of the mobile communication module 112.

The short range communication module 114 is for short range communication, and includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC. Near field communication may be supported using at least one of (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. The short-distance communication module 114 is, between the mobile terminal 100 and a wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or a mobile terminal 100 through a wireless area network (Wireless Area Networks). ) And a network in which another mobile terminal 100 or an external server is located may support wireless communication. The local area wireless communication network may be a wireless personal area network (Wireless Personal Area Networks).

The location information module 115 is a module for obtaining a location (or current location) of a mobile terminal, and representative examples thereof include a GPS (Global Positioning System) module or a WiFi (Wireless Fidelity) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, the mobile terminal may acquire the location of the mobile terminal based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function among other modules of the wireless communication unit 110 in order to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 for inputting an audio signal, or an audio input unit, and a user input unit 123 for receiving information from a user, for example, , A touch key, a mechanical key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. Meanwhile, a plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the camera 121 forming a matrix structure as described above, various angles or focuses may be applied to the mobile terminal 100. A plurality of image information may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to obtain a left image and a right image for realizing a 3D image.

The microphone (or microphone) 122 processes an external sound signal into electrical voice data. The processed voice data may be utilized in various ways according to a function (or an application program being executed) being executed by the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123, the controller 180 can control the operation of the mobile terminal 100 to correspond to the input information. . Such, the user input unit 123 is a mechanical (mechanical) input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch (dome switch), a jog wheel, Jog switch, etc.) and a touch-type input means. As an example, the touch input means is composed of a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or a portion other than the touch screen It may be made of a touch key (touch key) arranged in the. On the other hand, the virtual key or the visual key can be displayed on the touch screen while having various forms, for example, graphic, text, icon, video, or these It can be made of a combination of.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, information on surrounding environments surrounding the mobile terminal, and user information. For example, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor (gyroscope sensor), motion sensor (motion sensor), RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint sensor (finger scan sensor), ultrasonic sensor (ultrasonic sensor) , Optical sensor (for example, camera (see 121)), microphone (microphone, see 122), battery gauge, environmental sensor (for example, barometer, hygrometer, thermometer, radiation detection sensor, It may include at least one of a heat sensor, a gas sensor, etc.), and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of the display unit 151, the sound output unit 152, the haptic module 153, and the light output unit 154. can do. The display unit 151 may implement a touch screen by forming a layer structure or integrally with the touch sensor. Such a touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user, and may provide an output interface between the mobile terminal 100 and a user.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated by the haptic module 153 may be controlled by a user's selection or setting by a controller. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output them.

The light output unit 154 outputs a signal for notifying the occurrence of an event using light from a light source of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, and information reception through an application.

The interface unit 160 serves as a passage between various types of external devices connected to the mobile terminal 100. The interface unit 160 connects a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and a device equipped with an identification module. It may include at least one of a port, an audio input/output (I/O) port, an input/output (video I/O) port, and an earphone port. The mobile terminal 100 may perform appropriate control related to the connected external device in response to the connection of the external device to the interface unit 160.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs (application programs or applications) driven by the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of delivery for basic functions of the mobile terminal 100 (eg, incoming calls, outgoing functions, message reception, and outgoing functions). Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and driven by the controller 180 to perform an operation (or function) of the mobile terminal.

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100. The controller 180 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components described with reference to FIG. 1 in order to drive the application program stored in the memory 170. Further, in order to drive the application program, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 with each other.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to each of the components included in the mobile terminal 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other in order to implement an operation, control, or control method of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170.

Referring to FIG. 2A, the user authentication device 200 may include a contact plate 220 and a camera 230. The contact plate 220 may be positioned above the camera 230. The camera 230 may be positioned under the contact plate 220 in a direction in which the lens faces the lower end of the contact plate 220.

Here, the contact plate 220 may be an object having transparency, for example, a glass plate. The camera 230 may include an infrared camera, and when the object to be photographed is a living body, the camera 230 may capture an image including information on a vein located in the object to be photographed.

The user authentication device 200 displays a part of the user's body located a specific distance away from the contact plate 220, for example, at least a part of the image of the hand 210 as shown in FIG. 2A (for example, a palm image). Can be obtained. On the other hand, a part of the user's body that can be used for user authentication by the user authentication device 200 is not limited to the hand 210, and various bodies in which veins are located, such as fingers, palms, backs of hands, wrists, insteps, or ankles. It can also be used.

The acquired image may include information on a vein of a user positioned on the hand 210, for example, information on a vein pattern (or arrangement, or distribution). For a specific example related to this, refer to FIG. 4.

According to an embodiment, the user authentication device 200 may acquire at least one image through at least one photographing through the camera 230. The image may be acquired according to the number of times of capturing. For example, when two capturing is performed, two images may be obtained. The number of times such an image is captured may be predetermined.

The user authentication device 200 may perform user authentication based on whether the acquired image corresponds to a pre-stored image. Specifically, for example, the user authentication device 200 may check whether the vein pattern of the acquired image matches the vein pattern (or vein distribution) of the previously stored image. When the vein pattern of the acquired image matches the vein pattern of the stored image, the user authentication device 200 may determine that the user authentication is successful.

Meanwhile, the previously stored image is used as a correct answer value for user authentication, and may be information acquired and stored from a user when a user is registered for user authentication.

Depending on the embodiment, a plurality of images may be obtained. In this case, the user authentication device 200 may obtain an average image of the plurality of images, and compare the images with the stored images to perform user authentication. For example, when an average image is obtained by overlapping a plurality of images, and the vein pattern of the average image matches the vein pattern of the stored image, the user authentication device 200 may determine that the user authentication is successful.

In some cases, each of the plurality of images may be compared with the stored image. In this case, user authentication may be performed based on whether the number of matching images is greater than or equal to a predetermined number. For example, if the corresponding image among the plurality of images is a majority, it may be determined that user authentication has been successful. For another example, when all of the plurality of images correspond to the stored image, it may be determined that user authentication has been successful.

In this way, the vein of the image captured while being spaced apart from the contact plate 220 by a specific distance or more may be in a state in which pressure is not applied by an external object. Accordingly, the user authentication using the image obtained in the state as shown in FIG. 2A may be authentication for identifying the identity of the user by using a vein pattern, which is a characteristic of a user.

Referring to FIG. 2B, the user authentication device 200 may acquire an image of the hand 210 in contact with the contact plate 220. Pressure may be applied to the hand 210 in contact with the contact plate 220, so that a change may occur in the vein of the hand 210, and the user authentication device 200 ) Can be acquired.

The user authentication device 200 may calculate a difference between the contact plate 220 and the image before contact, that is, the image of FIG. 2A and the image of the hand 210 in contact with the contact plate 220. Based on this, the user authentication device 200 may check changes in veins before and after contact of the contact plate 220.

The user authentication apparatus 200 may perform user authentication based on checking whether the confirmed vein change corresponds to pre-stored vein change information. Specifically, the user authentication apparatus 200 may determine that the user authentication is successful when the confirmed vein change corresponds to pre-stored vein change information. For example, the user authentication apparatus 200 may determine that the user authentication is successful when the similarity between the confirmed vein change and the previously stored vein change information is greater than or equal to a specific value.

The change in the vein may include a change in the position of the vein or a change in the thickness of the vein, and a specific example related thereto may be referred to FIG. 4.

These changes in the veins may be due to the presence of blood flowing through the veins. That is, it may be measured because the object performing user authentication is a living organism. Therefore, by using the change of vein, it is possible to check whether the user authentication target is a living being, that is, bioactivity. In other words, if the user authentication using the change of vein is used, even if the vein pattern matches, a forged fake model, that is, a dummy can be screened out, so that the security of user authentication can be improved.

3 is a diagram illustrating an example of a specific area of a user's body in contact with a user authentication device according to an exemplary embodiment of the present specification. Specifically, FIG. 3 shows an example in which the user's hand 310 is in contact with the contact plate 320.

Referring to FIG. 3, the contact plate 320 may be made of a material (eg, a glass plate) having a transparency greater than a predetermined value, and contact with one surface of the contact plate 320 (eg, an upper surface (or upper surface)) based on this. The object may be identified on the other surface (eg, the lower surface (or lower surface)) of the contact plate 320.

In this case, if further described with reference to FIG. 2, the upper surface may be a surface to which the hand 210 is in contact in FIGS. 2A and 2B, and the lower surface may be a surface on which the camera 230 is positioned.

Referring to FIG. 3, FIG. 3 shows a shape viewed from the lower surface of the contact plate 320, and the hand 310 may be in a state in contact with the upper surface of the contact plate 320. Since the contact plate 320 has transparency, the hand 310 in contact with the upper surface of the contact plate 320 can be seen also on the lower surface of the contact plate 320.

As shown in FIG. 2, a camera may be positioned in the direction of the lower surface of the contact plate 320. Accordingly, the camera may acquire an image of the hand 310 in contact with the contact plate 320.

In an embodiment, the camera may acquire an image of at least a portion of the hand 310. For example, the camera may acquire an image of the palm 330 of the hand 310 excluding the finger portion. However, the present invention is not limited thereto, and an image of a part of the palm 330 may be obtained, or an image of the palm 330 and the entire finger may be obtained.

The camera may be a device capable of photographing veins (eg, an infrared camera). Based on this, an image in which veins of the palm 330 appear may be obtained. The acquired image may include, for example, information on at least one of a vein pattern, a vein position, and a vein thickness, and a more detailed example thereof may be referred to FIG. 4 to be described later.

Meanwhile, although not shown, the camera may also acquire an image of the hand 310 or the palm 330 in a state spaced apart from the contact plate 320.

4 is a diagram for explaining information on a change in vein acquired by a user authentication device according to an embodiment of the present specification. Specifically, FIG. 4A shows an example of an image obtained when a palm is separated from a contact plate by a specific distance. FIG. 4B is a diagram for explaining changes in veins that may appear in an image obtained when a palm is in contact with a contact plate.

Referring to FIG. 4A, it can be seen that information on veins is included in the image. Specifically, FIG. 4A shows a vein image and a palm image positioned on the palm. The veins may appear as shown in the form of irregular lines.

Meanwhile, since the vein pattern (or distribution) may vary from person to person, user authentication may be performed based on the information. For example, when a vein pattern is previously registered (or stored) in the user authentication device through user registration, user authentication may be performed based on checking the similarity between the registered vein pattern and the vein pattern appearing in the image of FIG. 4A. .

Various technologies related to the determination of the similarity between images may be used, and a detailed description thereof will be omitted since it is easy for a person skilled in the art.

Referring to FIG. 4B, the first line 410 and the second line 430 of the vein are part of the vein image obtained in FIG. 4A and may be lines before change occurs. Changes may occur between the first line 410 and the second line 430 by contact with the contact plate. Specifically, the first line 410 and the second line 430 of the vein may change at least some of the position and thickness of the vein by contact with the contact plate.

For example, like the first line 410, when the palm of the hand contacts the contact plate, the position of the vein corresponding to the first line 410 may be changed as indicated by the third line 420. In the case of the second line 430, when the palm of the hand contacts the contact plate, the position and thickness of the vein corresponding to the second line 430 may be changed as shown in the fourth line 420. Although not shown, the position of the vein line does not change and only the thickness may change.

Such a change in vein occurs based on the fact that the vein is a blood vessel having elasticity or that the vein is a path through which blood flows, and may occur when the user is a living person.

In addition, since the tendency of veins to change due to contact (or pressure) (hereinafter, vein change information) is determined based on a user's unique biometric characteristics (eg, elasticity of blood vessels), it may differ from person to person.

The vein change information on the location or thickness of the vein, or the vein change pattern may be obtained and stored in advance during a user registration process for user authentication. Based on this, the user authentication apparatus may perform user authentication by checking a vein change pattern through an image acquired in the user authentication process and comparing the vein change information with the stored vein change information.

User authentication based on changes in veins caused by contact with the contact plate can be performed as long as an image is acquired, and can be performed at a faster speed (eg, 100 ms or less).

Referring to FIG. 5, the user authentication device 500 may include a contact plate 510, a camera 520, and a processor 530.

The contact plate 510 may have a configuration in which a specific area of the user's body including veins comes into contact. The contact plate 510 may have a specific value of transparency. Based on this, when a specific area of the user's body comes into contact with the contact plate 510, a specific area pressed by the contact plate 510 at an opposite portion (or an opposite portion) rather than the contacted portion may be identified. This is described above with reference to FIG. 3, and a detailed description thereof will be omitted.

The contact plate 510 may include, for example, a glass plate or an acrylic plate, but is not limited thereto and may be made of various materials having transparency.

The contact plate 510 may be a smooth and flat rectangular structure, and may have a size larger than a specific area of the user's body. For example, when a specific area of the user's body is a palm, the size of the contact plate 510 may be larger than that of the palm.

According to an embodiment, the contact plate 510 may include a sensor that senses a user's body contact. For example, the sensor may include a touch sensor. In this case, whether a specific area of the user's body is in contact with the contact plate 510 may be detected through the sensor.

In FIG. 5, the contact plate 510 is shown to be included in the user authentication device 500, but is not limited thereto, and the contact plate 510 may be implemented as a separate configuration connectable to the user authentication device 500. .

The camera 520 may generate an image by photographing a specific area of the user in contact with the contact plate 510. The camera 520 may be, for example, an infrared camera, and when a specific area is photographed based on this, veins may be revealed in the image.

For example, when the camera 520 photographs a user's wrist or palm whose veins are not observed in detail with the human's bare eye, the camera 520 may generate an image in which veins passing through the wrist or palm appear. The specific principle related to this is easy for a person skilled in the art, so a detailed description will be omitted.

The camera 520 may be positioned to be spaced apart from the contact plate 510 by a specific distance or more. The position of the camera 520 may be one end of the contact plate 510, which may face the other end of the user's specific area.

The processor 530 may acquire a first image of a specific area of the user's body spaced apart from the contact plate 510 by a specific distance or more. Specifically, the processor 530 may acquire a first image including a vein image of a specific region of the user's body spaced apart from the contact plate 510 by a specific distance or more using the camera 520. Specifically, the first image is an image for a specific area, but may be an image including information on a user's vein located in the specific area. The information on the vein at this time may be information on the pattern, location, or thickness of the vein in a basic state in which pressure is not applied.

According to an embodiment, the processor 530 may acquire a plurality of images by photographing a specific region of the user's body spaced apart from the contact plate 510 by a specific distance or more at specific time intervals.

For example, the processor 530 may acquire three images by photographing the palm of the user approaching the contact plate 510 three times. The initial photographing time may be a case that is 10 cm apart, and two more photographs may be taken at 0.1 second intervals. In this case, the first image may be a case where the palm is 10 cm apart from the contact plate 510, the second image may be 8 cm apart, and the third image may be 6 cm apart. For another example, the processor 530 may acquire three images by photographing the palm of the hand at a distance of 10 cm from the contact plate 510 three times at 0.1 second intervals.

In an embodiment, the processor 530 may check whether the first image corresponds to a pre-stored user vein image. The pre-stored user vein image may be information acquired from a user when registering a user in connection with user authentication and stored in the user authentication device 500. Like the first image, the pre-stored user vein image may be an image of a specific area of the user's body in a state that is not in contact with the contact plate 510.

When the first image and the previously stored user vein image correspond to each other, the processor 530 may determine that the user authentication is primarily successful. In an embodiment, when the user authentication is primarily successful, the processor 530 may provide a notification indicating that the user authentication is successful. For a specific example related to this, refer to FIG. 13.

In some cases, the processor 530 may perform user authentication using a vein change to be described later when primary user authentication is performed, but is not limited thereto, for example, without primary user authentication. User authentication can also be performed through authentication using vein changes.

Herein, in the present specification, a specific region of the user's body will be described as a palm, but is not limited thereto, and for example, the specific region may be at least one of a wrist, a finger, a back of a hand, an instep, and a toe.

The processor 530 may acquire a second image of a specific area of the user's body in contact with the contact plate 510. Specifically, the processor 530 may acquire a second image of a specific area of the user's body that has contacted the contact plate 510 through the camera 520.

In an embodiment, the processor may check whether a specific region of the user's body has contacted the contact plate based on the sensor of the contact plate. When a contact of a specific area on the contact plate is confirmed, the processor may acquire a second image by photographing a specific area in contact with the contact plate using a camera.

The second image may include a vein image. In this case, the vein image may be an image including information on a change in vein in the first image. Variation of the vein may include, for example, the location or thickness (or thickness) of the vein.

Specifically, a vein passes through a specific area of the user's body. When the specific area contacts the contact plate 510, pressure is applied to the vein, which may cause a change in the vein. Accordingly, the vein image included in the second image, which is an image of a specific area in contact with the contact plate 510, is for a vein located in a specific area, but may be an image of a vein whose position or thickness is changed by pressure. In this way, the change in position or thickness may be referred to as vein change information according to an embodiment.

The processor 530 may check a change in the vein according to the presence or absence of contact with the contact plate based on the vein image included in each of the first image and the second image. Specifically, the processor 530 may check a change in vein based on the difference between the first image and the second image.

In an embodiment, the processor 530 checks the change in the thickness of the vein due to contact between the contact plate 510 and a specific region using information on the vein line included in the first image and the vein line included in the second image. I can. Specifically, the processor 530 compares the position or thickness of the vein line included in the first image and the vein line included in the second image to change from a vein state represented by the first image to a vein state represented by the second image. You can check the degree.

The degree of change may include, for example, the distance of the changed position when the position is changed, and may include the length of the changed thickness when the thickness is changed, but is not limited thereto.

In addition, in some cases, the thickness or location of veins extracted from each of the first image and the second image may be an average value in order to determine the degree of change. For example, when comparing the thickness of the veins, the processor 530 may compare the average value of the thickness of the vein line included in the first image and the average value of the thickness of the vein line included in the second image. For another example, when comparing the positions of veins, the processor 530 may compare the average positions of the vein lines included in the first image and the average positions of the vein lines included in the second image.

Meanwhile, a plurality of vein lines may be included in the first image and the second image. In this case, the processor 530 may compare all of the plurality of lines, or may selectively compare some of the plurality of lines.

In an embodiment, when checking a change in a vein using the thickness of the vein, the processor 530 may calculate the thickness (hereinafter, referred to as the first thickness) of at least some of the plurality of vein lines of the first image. The processor 530 may calculate a thickness (hereinafter, referred to as a second thickness) of a vein line corresponding to a vein line whose thickness is calculated from the first image among a plurality of vein lines of the second image. The processor 530 may check the change in the thickness of the vein based on the difference between the first thickness and the second thickness.

In an embodiment, the processor 530 calculates an arrangement of coordinates of veins included in an image (eg, a first image, a second image) based on Equation 1 below based on Equations 1 to 4 to be described later. I can.

In Equation 1, Vein _total is bitmap data of the entire vein image, and VeinNodes is a function that extracts an array of coordinates (x,y) corresponding to the vein by processing the bitmap data. Node is an array of vein coordinates obtained based on the VeinNodes function.

The processor 530 may calculate a vein coordinate arrangement corresponding to the cluster from the vein coordinate arrangement based on Equation (2). The cluster may mean a plurality of vein lines that share one node of the vein.

In Equation 2, VeinCluster is a function for extracting a coordinate array of veins (or vein lines) corresponding to clusters of individual vein stems from the array of vein coordinates. Vein _cluster is an array of coordinates of veins corresponding to the cluster.

The processor 530 may extract representative values for comparison of vein changes based on Equation (3).

Is the representative values to be compared for the cluster, and SelectPoints is a function that selects n coordinates to be compared from the entire coordinate array of the vein.

The processor 530 may calculate the thickness of a vein corresponding to each of the representative values based on Equation 4 below.

Is the value in the vertical direction of the differential calculation result of the representative value corresponding to x, and x is

Corresponds to one of, and CalcThickness may be a function for calculating the thickness of a vein. Thickness may be the thickness of a vein corresponding to x calculated as a result of CalcThickness.

The processor 530 may calculate the thickness of the vein using Equation 4 for each representative value, and calculate the sum of the thickness of the vein by adding the total.

The processor 530 may calculate an average vein thickness by dividing the sum of the calculated vein thicknesses by n. The calculation of the average vein thickness may be performed for each image (eg, a first image and a second image) before and after contact with the contact plate 510. The processor 530 may compare the average vein thickness for each image before and after contacting the contact plate 510 to finally calculate the change in the thickness of the vein.

In an embodiment, the processor 530 may calculate a position (hereinafter, referred to as a first position) of at least some of the plurality of vein lines of the first image. The processor 530 may calculate a position (hereinafter, referred to as a second position) of a vein line corresponding to a vein line whose position is calculated from the first image among a plurality of vein lines of the second image. The processor 530 may check the change in the location of the vein based on at least one of a distance difference between the first location and the second location and a direction from the first location to the second location.

Meanwhile, since the functions described in Equations 1 to 4 are based on an algorithm that is easy for a person skilled in the art, detailed descriptions will be omitted.

In an embodiment, the processor 530 may calculate representative coordinates of a vein before and after contacting the contact plate 510 based on Equation 5 below.

(X,Y) is the representative coordinate of the vein, MeanShift is a function that calculates the moving average for the vein coordinate, and Vein is the data about the vein included in the image. MeanShift is a meanshift algorithm and is easy for a person of ordinary skill in the art, so a detailed description will be omitted.

The processor 530 may calculate a value for the representative coordinates of the vein based on Equation 5 for each of the images before and after the contact plate 510. The processor 530 may check the moving distance and the moving direction of the vein through a difference in representative coordinate values for each of the images before and after the contact plate 510.

The processor 530 may check whether the confirmed vein change corresponds to pre-stored vein change information. Here, the previously stored vein change information is information on the trend (or pattern) of a change occurring in a vein by contacting a specific region with the contact plate 510, for example, a change in the position of at least some of the lines constituting the vein or It may contain information about the change in thickness. In addition, the vein change information may be obtained and stored in advance in the user registration step for user authentication.

The processor 530 may determine that user authentication has succeeded when the vein change identified through the comparison of the first image and the second image corresponds to the previously stored vein change information. The processor 530 may determine that user authentication has failed (or did not succeed) when the confirmed vein change does not correspond to the previously stored vein change information.

6 is a flowchart of a user authentication method according to an embodiment of the present specification. It goes without saying that each step of the method illustrated in FIG. 6 may be performed in a different order as illustrated in the drawings depending on the case.

Referring to FIG. 6, the processor of the user authentication device may obtain a first image of a specific area of the user's body spaced apart from the contact plate by a specific distance or more (610 ). The specific area of the user's body may be a predetermined area among a part of the user's body through which veins pass. For example, the specific region may be at least one of a wrist, a palm, a back of a hand, an ankle, a sole, and a back of an instep.

The first image is an image obtained through a camera capable of capturing veins, and may be an image in which veins in a specific area appear. For example, the first image may be an infrared image for a specific area. When the specific area is the palm, the first image may be an infrared image of the palm in which veins of the palm appear. A specific example of this may refer to FIG. 4.

As described above, the vein image included in the first image may be a vein image in a general state.

The processor may acquire a second image of a specific area in which at least a portion of the contact plate is in contact (620 ). Like the first image, the second image may be an image in which veins appear. However, the second image is an image in which a specific region is in contact with the contact plate, and a vein image included in the second image may be for a vein in a specific region changed by the contact.

In an embodiment, a touch sensor may be included in the contact plate, and based on this, the processor may check whether a specific area of the user's body is in contact with the contact plate. When the contact of the specific area is confirmed, the processor may acquire the second image by photographing using the camera.

The processor may check a change in the vein according to the presence or absence of contact with the contact plate based on the vein image included in each of the first image and the second image (630 ). Specifically, the processor may compare the vein image included in the first image and the vein image included in the second image to check a change in the vein according to the contact.

The change in the vein may include at least one of a change in the position of the vein and a change in the thickness of the vein.

In an embodiment, the processor may check a change tendency of the vein according to the presence or absence of contact with the contact plate based on the vein image included in each of the first image and the second image. The vein change trend is an average pattern in which the vein changes, and the processor can check how the vein line that appears in the vein image of the first image has changed in the second image as a whole. For example, the processor may check the change tendency of the vein by checking information on at least one of a portion of a vein line whose thickness changes, a portion of a vein line whose position moves, and a degree of change in position.

The processor may perform user authentication based on checking whether the confirmed vein change corresponds to the previously stored vein change information (640 ). The vein change information may be information acquired and stored in advance when a user is registered for user authentication. Accordingly, the processor may perform user authentication by comparing the confirmed vein change (or change trend) with previously stored vein change information.

For example, the processor may determine that user authentication has been successful when the confirmed vein change is consistent with previously stored vein change information. For another example, the processor may determine that user authentication is successful when the similarity between the confirmed vein change and the previously stored vein change information is greater than or equal to a specific value.

In an embodiment, the processor may check whether the first image corresponds to a predetermined image. In this case, the predetermined image may be a vein image obtained in advance for a specific area when a user is registered in connection with user authentication. The processor may perform

steps

630 and 640 when the first image corresponds to the predetermined image.

7 is a flowchart of a user authentication method according to another embodiment of the present specification. It goes without saying that each step of the method illustrated in FIG. 7 may be performed in a different order as illustrated in the drawings depending on the case.

Referring to FIG. 7, the processor of the electronic device may acquire a first image of a specific area of the user's body spaced apart by a specific distance or more from the contact plate (operation 710). A specific area of the user's body may be, for example, a palm, and in this case, the first image may be an image of a palm located in the air away from the contact plate. Accordingly, a user's own vein pattern in a specific area may be displayed in the first image to which no pressure is applied by the contact plate.

Meanwhile, since step 710 may correspond to step 610 of FIG. 6, a description redundantly with FIG. 6 will be omitted.

The processor may check whether the first image corresponds to a pre-stored user vein image (720). The previously stored user vein image may be an image acquired and stored from a user during a user registration process performed in connection with user authentication. The user vein image is a vein image for a specific area of the user's body, and may include an image in a general state not in contact with the contact plate.

In an embodiment, the processor may check the similarity of the first image to a pre-stored user vein image. When the similarity is greater than or equal to a specific value, the processor may determine that the first image corresponds to a pre-stored user vein image. On the other hand, in connection with checking the similarity, since it is easy for a person skilled in the art, detailed description will be omitted.

In an embodiment, the processor may check whether the first image matches a previously stored user vein image. When the first image matches a pre-stored user vein image, the processor may determine that the first image corresponds to a pre-stored user vein image.

When the first image corresponds to a pre-stored user vein image, the processor may obtain a second image for a specific region in which at least a portion of the contact plate is in contact (730 ). Specifically, the processor may acquire the second image by photographing the specific area contacted with the camera based on the contact of the specific area of the user's body with the contact plate. The second image may include an image of a vein in a specific area, and a vein represented by the vein image may be in a state in which a change is made by contact.

Step 730 may correspond to step 620 of FIG. 6, and redundant descriptions in this regard will be omitted.

If the first image does not correspond to the previously stored user vein image, the processor may perform the process of step 710 again.

When the second image is acquired, the processor may check the change of the vein according to the presence or absence of contact with the contact plate based on the vein image included in each of the first image and the second image (740). The change in the vein may include a change in at least one of the thickness and location of the vein.

Based on the second image being an image acquired through contact with the contact plate, the processor may determine a change in vein due to the contact by checking a difference between the first image and the second image.

Since step 740 may correspond to step 630 of FIG. 6, redundant descriptions will be omitted.

The processor may check whether the confirmed vein change (or vein change trend) corresponds to pre-stored vein change information (750). Specifically, the processor may check whether the confirmed change in the position or thickness of the vein corresponds to the previously stored vein change information.

For example, when it is determined that the thickness of the first vein line is increased by 0.1 mm, the processor may check whether the previously stored vein change information includes an increase in the thickness of the first vein line by 0.1 mm. . When the previously stored vein change information includes increasing the thickness of the first vein line by 0.1 mm, the processor may determine that the vein change information corresponds to the previously stored vein change information.

For another example, the processor may check whether the position change value (eg, 0.05 mm) of the first vein line is included within the position change range of the previously stored vein change information. If the position change value is included within the position change range of the vein change information, the processor may confirm that the confirmed change of the vein corresponds to the previously stored vein change information.

Meanwhile, the above-described first vein line may mean a specific portion of a plurality of vein lines constituting a vein included in a specific region of the user's body. Specifically, in the case of a vein, a plurality of lines are intertwined, and the first vein line may mean a specific portion of such a vein. Since the vein is easy for a person skilled in the art, a detailed description will be omitted.

The processor may determine that the user authentication is successful when the confirmed vein change corresponds to the previously stored vein change information (760 ). If the confirmed vein change does not correspond to the previously stored vein change information, the processor may perform the process of step 710 again.

That is, when the vein pattern related to the first image corresponds to the user vein image, and the vein change related to the second image corresponds to the previously stored vein change information, the processor may determine that the user authentication is successful. If any one of a vein pattern or a vein change does not correspond to pre-stored information (eg, user vein image or vein change information), user authentication may fail.

The user identification process using the first image of the processor is a process for determining whether the user is a registered real user, i.e., confirming the identity of the user, by confirming the unique vein pattern that the user has by biometric characteristics. Can mean The user verification process using the second image to be described later uses a change in vein and may refer to a process of confirming whether a target for user authentication is a living organism, that is, a process of confirming the user's bioactivity.

Accordingly, the user authentication apparatus according to the present embodiment can check not only the identity of the user but also the viability of the user, thereby reducing the risk of forgery and improving the security of user authentication.

8 shows an embodiment in which the user authentication device 800 is implemented. Referring to FIG. 8, the user authentication device may include a guide 820 for maintaining a distance from a specific area 810 of a user's body to obtain a first image and a body 830 including a camera. .

The user authentication device 800 may acquire a first image of the specific area 810 separated by a specific distance as the specific area 810 comes into contact with the guide 820.

When the first image is acquired, the guide 820 may be unfolded based on the hinge so that the specific region 810 may contact the body 830 including the camera. Through this, the main body 830 may acquire the second image and perform the above-described user authentication process.

9 shows an embodiment when the user authentication device 900 is implemented in the form of a mobile terminal. Referring to FIG. 9, the user authentication device 900 may acquire a first image of a specific region 910 of a user's body in a state that is located a specific distance apart from the user authentication device 900.

In an embodiment, the user authentication device 900 may provide a screen guiding a user's operation for obtaining a first image, as illustrated.

In an embodiment, the acquisition of the first image may be performed through a camera disposed on the top of the user authentication device 900. However, the present invention is not limited thereto, and in some cases, it may be performed through a camera disposed on the rear of the display that is not exposed in FIG. 9.

In an embodiment, the display of the user authentication device 900 may serve as a contact plate. In this case, a second image may be obtained based on the contact of a specific area with the display. Acquisition of the second image may be acquired through a camera disposed on the rear side of the display.

In the embodiment, when the first image is acquired through a camera disposed on the top of the user authentication device 900, the second image is acquired through a camera disposed on the rear side of the display, and thus the first image and the second image are obtained. Acquisition of images can be made through different cameras.

10 shows an example in which the user authentication device 1000 is implemented in the form of a smart watch. Referring to FIG. 10, the user authentication device 1000 may acquire a first image of a specific region 1010 of a user's body in a state that is located a specific distance apart from the user authentication device 1000.

In the case of FIG. 10 as well as in the case of FIG. 9, the display of the user authentication device 1000 may serve as a contact plate. In this case, the second image may be obtained based on the contact of the specific area on the display.

In this case, two cameras arranged at different positions may be used as in FIG. 9 as a camera for acquiring the first image and the second image, but the present invention is not limited thereto.

When the user authentication apparatus 1000 acquires the first image and the second image, the user authentication may be performed based on the first image and the second image.

11 shows an example in which the user authentication device 1100 is installed in the door 1110. The user authentication device 1100 may be inserted into the door 1110 and used to determine whether to open or close the door 1110.

For example, if the user authentication is successful, the door 1110 may be opened, and if the user authentication fails, the door 1110 may not be opened.

Even in the case of FIG. 11, the user 1120 may locate the specific region 1130 of the user's body at a location separated by a specific distance. In this case, the user authentication device 1100 may acquire a first image for a specific area. Thereafter, the user 1120 may contact the specific area 1130 with the contact plate of the user authentication device 1100 to obtain a second image.

Although not specifically illustrated in FIG. 11, a camera for acquiring at least one of the first image and the second image may be disposed inside the user authentication apparatus 1100, at a location spaced apart from the contact plate by a specific distance.

Meanwhile, in FIGS. 8 to 11, a specific area of the user's body is illustrated with a palm, but the present invention is not limited thereto. For example, the specific area may be at least one of the wrist, the back of the hand, the ankle, the sole of the foot, and the back of the foot.

12 shows an example of a screen displayed on a user authentication device according to the type of user authentication. Specifically, FIG. 12A shows an example of a screen displayed in the case of unlocking a terminal for user authentication. 12B shows an example of a screen displayed when user authentication is for payment.

In the embodiment, in the case of unlocking the terminal and the case of payment, the security level may be determined differently. In this case, the user authentication method may be applied differently based on the security level. For example, if the security level of unlocking the terminal is set lower than the security level of payment, only the user authentication using the first image is performed for user authentication for unlocking the terminal, and the first image is used for user authentication for payment. And user authentication using the second image may be performed together.

13 shows an example of a screen provided after successful user authentication using the first image when user authentication using the first image and the second image is performed together.

Referring to FIG. 13, as text indicating that user authentication using the first image has been performed,'personal authentication has been completed' may be displayed. Accordingly, in order to perform user authentication using the second image, it may be required to contact the contact plate with a specific area (eg, palm) of the user's body.

Accordingly, as text for guiding the contact,'Please touch the palm for biometric authentication' may be displayed.

14 shows an example of a screen provided according to a result of user authentication using a second image. Specifically, FIG. 14A shows an example of a screen provided when user authentication is successful. 14B shows an example of a screen provided when user authentication fails.

Meanwhile, it should be noted that the screens shown in FIGS. 12 to 14 are only examples, and the present specification is not limited to these examples.

The above description is merely illustrative of the technical idea of the present specification, and those of ordinary skill in the technical field to which the present specification pertains will be able to make various modifications and variations without departing from the essential quality of the present specification. Accordingly, the embodiments disclosed in the present specification are not intended to limit the technical idea of the present specification, but to describe, and the scope of the technical idea of the present specification is not limited by these exemplary embodiments. The scope of protection of the present specification should be interpreted by the claims below, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present specification.

Claims

In the user authentication device,

A contact plate in which a specific area of the user's body including veins comes into contact,

Including a processor,

The processor,

Obtaining a first image of the specific area spaced apart from the contact plate by a specific distance or more,

Acquiring a second image of the specific area in contact with the contact plate,

Checking the change of vein according to the presence or absence of contact with the contact plate based on the vein image included in each of the first image and the second image,

Performing user authentication based on checking whether the confirmed vein change corresponds to pre-stored vein change information

User authentication device.
The method of claim 1,

The change in the vein includes a change in the thickness of the vein,

The processor,

Using information on the first plurality of vein lines included in the first image and the second plurality of vein lines included in the second image, the change in the thickness of the vein due to contact between the contact plate and the specific region is checked. doing

User authentication device.
The method of claim 2,

The processor,

Calculating a first thickness of at least a portion of the first plurality of vein lines,

Calculating a second thickness of a vein line corresponding to a position of at least a portion of the calculated first plurality of vein lines among the second plurality of vein lines,

Checking the change in thickness of the vein based on the difference between the first thickness and the second thickness

User authentication device.
The method of claim 1,

The change in the vein includes a change in the position of the vein,

The processor,

Using a vein image included in the first image and a vein image included in the second image, confirming a change in the position of the vein due to contact between the contact plate and the specific region

User authentication device.
The method of claim 4,

The processor,

Calculating a first position of at least some of the first plurality of vein lines,

Calculating a second position of a vein line corresponding to a position of at least a portion of the calculated first plurality of vein lines among the second plurality of vein lines,

Checking the change in the position of the vein based on at least one of a distance difference between the first position and the second position and a direction from the first position to the second position

User authentication device.
The method of claim 1,

The pre-stored vein change information includes information on a change in thickness of a vein or a change in position of a vein before and after contacting the contact plate in a pre-registered specific area.

User authentication device.
The method of claim 1,

The processor,

Check whether the first image corresponds to a pre-stored user vein image,

When the first image and the pre-stored user vein image correspond to each other, confirming the change in the vein

User authentication device.
The method of claim 7,

The processor,

When the first image corresponds to a pre-stored user vein image, a notification indicating that the user authentication was successful is provided,

When the first image does not correspond to a previously stored user vein image, a notification indicating that user authentication has failed is provided, and

When the confirmed vein change corresponds to the previously stored vein change information, a notification indicating that the authentication of liveness is successful is provided, and

Providing a notification indicating that the authentication of bioactivity fails when the confirmed vein change corresponds to the previously stored vein change information.

User authentication device.
The method of claim 1,

The user authentication device further comprises an infrared camera,

The processor,

Acquiring the first image and the second image using the infrared camera

User authentication device.
The method of claim 1,

The specific area,

Including at least one of palms, backs of hands, wrists, fingers, insteps, and soles of the feet

User authentication device.
In the user authentication method,

Acquiring a first image of the at least part spaced apart by a specific distance or more from a contact plate to which a specific area of the user's body including veins comes into contact;

Acquiring a second image of the specific area in contact with the contact plate,

Checking a change in a vein according to the presence or absence of contact with the contact plate based on a vein image included in each of the first image and the second image,

Comprising the step of performing user authentication based on checking whether the confirmed vein change corresponds to pre-stored vein change information

User authentication method.
The method of claim 11,

The change in the vein includes a change in the thickness of the vein,

Checking the change in the vein,

Using information on the first plurality of vein lines included in the first image and the second plurality of vein lines included in the second image, the change in the thickness of the vein due to contact between the contact plate and the specific region is checked. Comprising the step of

User authentication method.
The method of claim 12,

Checking the change in the thickness of the vein,

Calculating a first thickness of at least a portion of the first plurality of vein lines,

Calculating a second thickness of a vein line corresponding to a position of at least a portion of the calculated first plurality of vein lines among the second plurality of vein lines; and

Comprising the step of checking a change in the thickness of the vein based on the difference between the first thickness and the second thickness

User authentication method.
The method of claim 11,

The change in the vein includes a change in the position of the vein,

Checking the change in the vein,

Including the step of confirming a change in the position of the vein due to contact between the contact plate and the specific region using a vein image included in the first image and a vein image included in the second image.

User authentication method.
The method of claim 14,

Checking the change in the position of the vein,

Calculating a first position of at least some of the first plurality of vein lines,

Calculating a second position of a vein line corresponding to a position of at least a portion of the calculated first plurality of vein lines among the second plurality of vein lines; and

And checking a change in the position of the vein based on at least one of a distance difference between the first position and the second position and a direction from the first position to the second position.

User authentication method.
The method of claim 11,

The pre-stored vein change information includes information on a change in thickness of a vein or a change in position of a vein before and after contacting the contact plate in a pre-registered specific area.

User authentication method.
The method of claim 11,

Further comprising the step of checking whether the first image corresponds to a pre-stored user vein image,

Checking the change in the vein,

When the first image and the pre-stored user vein image correspond, checking a change in vein according to the presence or absence of contact with the contact plate based on vein images included in each of the first image and the second image doing

User authentication method.
The method of claim 17,

If the first image corresponds to a previously stored user vein image, providing a notification indicating that the user authentication was successful,

Providing a notification indicating that user authentication fails when the first image does not correspond to a previously stored user vein image; and

Providing a notification indicating that authentication of liveness is successful when the confirmed vein change corresponds to pre-stored vein change information, and

Providing a notification indicating that authentication of bioactivity fails when the confirmed vein change corresponds to pre-stored vein change information.

User authentication method.
The method of claim 11,

The first image and the second image are acquired through an infrared camera,

The specific area,

Including at least one of palms, backs of hands, wrists, fingers, insteps, and soles of the feet

User authentication method.
Acquiring a first image of the user's palm spaced apart by a specific distance or more from the contact plate to which the user's palm comes into contact;

Acquiring a second image of the user's palm in which at least a portion of the contact plate is in contact,

Checking a change in the vein according to the presence or absence of contact with the contact plate based on the vein image included in each of the first image and the second image,

Storing a computer program programmed to perform the step of performing user authentication based on checking whether the confirmed vein change corresponds to pre-stored vein change information

Computer-readable recording medium.