KR102082418B1 - Electronic device and method for controlling the same - Google Patents

Abstract

The present invention provides an electronic device capable of performing complex biometric authentication, by comparing a plurality of biometric sensors formed to detect different biometric information and the different biometric information and pre-registered user information. The matching score is calculated for each biometric information, the forgery probability information is calculated for each of the different biometric information in consideration of the forgery elements of the different biometric information, and the matching score and the forgery calculated for each of the different biometric information are calculated. It includes a security module for performing user authentication using probability information and a control unit for controlling the electronic device based on a result of user authentication performed in the security module.

Description

ELECTRONIC DEVICE AND METHOD FOR CONTROLLING THE SAME

The present invention relates to an electronic device capable of complex biometric authentication.

With the development of technology, functions of electronic devices are diversifying. For example, there are functions for data and voice communication, photo and video shooting through a camera, voice recording, music file playback through a speaker system, and output of an image or video to the display. In some electronic devices, an electronic game play function is added or a multimedia player function is performed. In particular, recent electronic devices can receive multicast signals that provide visual content such as broadcast and video or television programs.

As the functions of such electronic devices are diversified, for example, it is implemented in the form of a multimedia player equipped with complex functions such as taking pictures or videos, playing music or video files, and receiving games and broadcasts. have.

In order to support and increase the function of such an electronic device, it may be considered to improve the structural part and / or software part of the terminal.

As the functions of electronic devices are diversified, the importance of user authentication for enhancing security is increasing. Various methods such as a password method, a pattern method, and a biometric method may be used for user authentication.

Biometrics is a technique for performing user authentication by using unique physical features such as a user's fingerprint, face, voice, iris, retina, and blood vessel, as a method of security authentication. In the field of biometric technology, there is little risk of theft or imitation, and the convenience of use is high.

On the other hand, in recent years, in order to enhance security, multi-mode biometric authentication (Multimodal) that performs biometric authentication using a plurality of biometric identification information in a single-mode biometric authentication (Unimodal Biometric) that performs biometric authentication using a single biometric information Biometric) or complex biometric authentication is advancing technology.

When implementing such a multi-mode biometric authentication technology, it is necessary to develop various methods of utilizing multiple biometric information. The present invention proposes a method of performing biometric authentication by using a plurality of biometric information.

An object of the present invention is to implement an electronic device capable of complex biometric authentication.

In addition, another object of the present invention is to improve authentication accuracy of complex biometric authentication.

The present invention provides an electronic device capable of performing complex biometric authentication, by comparing a plurality of biometric sensors formed to detect different biometric information and the different biometric information and pre-registered user information. The matching score is calculated for each biometric information, the forgery probability information is calculated for each of the different biometric information in consideration of the forgery elements of the different biometric information, and the matching score and the forgery calculated for each of the different biometric information are calculated. It includes a security module for performing user authentication using probability information and a control unit for controlling the electronic device based on a result of user authentication performed in the security module.

In one embodiment, the security module calculates a final score combining the matching score and the forgery probability information calculated for each of the different biometric information based on a preset algorithm, and the calculated final score and a predetermined determination function Through the comparison, it is characterized in that the user authentication.

In one embodiment, the predetermined determination function is characterized in that it is generated by using at least one of the matching score and forgery probability information calculated for each of the different biometrics.

In one embodiment, the memory further includes a plurality of decision functions, and the pre-stored decision function is characterized in that any one of the plurality of decision functions is selected based on the forgery probability information.

In one embodiment, the forgery probability information includes at least one of quality information indicating attributes of the different biometric information, spoofing information indicating a forgery probability for a user, and surrounding environment information of the electronic device. It is characterized by including one.

In one embodiment, the security module is characterized in that, according to the security level of a function to be executed through the user authentication, user authentication is performed using only some of the forged probability information.

In one embodiment, when the security level of a function to be executed through the user authentication is higher than a reference level, the security module performs user authentication using spoofing information and matching information, and the security level of a function to be executed through the user authentication If it is less than the reference level, it is characterized in that user authentication is performed using the surrounding environment information.

In one embodiment, the electronic device further includes an environmental sensor that senses ambient environment information of the electronic device, and the security module is configured to generate forgery probability information by using the detected ambient environment information.

In one embodiment, the security module is characterized in that it generates the combined information combining the different biometric information, and calculates forgery probability information for the generated combined information.

In one embodiment, when performing the user authentication, the security module is characterized in that it further uses forgery probability information for the generated combined information.

In one embodiment, the plurality of biometric sensors includes a face recognition sensor that detects the user's face information and a voice recognition sensor that senses the user's voice information, and the security module includes matching information of the face information and It is characterized in that user authentication is performed by using forgery probability information, matching information of the voice information, and forgery probability information.

In one embodiment, the security module extracts mouth movements from the face information, compares the mouth movements with the voice information, generates synchronization information, and uses the face information and the voice information Thus, it is characterized in that forgery probability information for the generated synchronization information is calculated.

In a control method of an electronic device for performing complex biometric authentication according to another embodiment of the present invention, detecting different biometric information from a plurality of biometric sensors for user authentication and the different biometric information Through the comparison of pre-registered user information, calculating a matching score for each of the different biometric information and taking into account the forgery factors according to the unique characteristics of the different biometric information, the probability of forgery for each of the different biometric information It includes a step of calculating information, a user authentication using the matching score and forgery probability information calculated for each of the different biometric information, and a control unit for controlling the electronic device based on the user authentication result.

In one embodiment, in the step of performing the user authentication, based on a preset algorithm, calculating a final score obtained by fusing matching scores and forgery probability information calculated for each of the different biometric information and the final score and And performing user authentication through comparison of the pre-stored decision function.

In one embodiment, the method further comprises generating fusion information obtained by fusing the different biometric information and calculating forgery probability information for the generated fusion information.

The electronic device according to the present invention can improve the authentication accuracy of the complex biometric authentication by calculating matching scores and forgery probability information for each of the plurality of biometric identification information, and performing user authentication using the biometric authentication. .

In addition, the electronic device according to the present invention generates the forgery probability information in consideration of the surrounding environment information of the electronic device that performs biometric authentication, in consideration of the situation in which the accuracy of the biometric authentication is lowered due to the influence of the surrounding environment, the biometric authentication You can do

1 is a block diagram illustrating an electronic device related to the present invention.
2 is a conceptual diagram illustrating a single biometric authentication method.
3A to 3D are conceptual diagrams illustrating a complex biometric authentication method.
4A and 4B are graphs related to an error rate of biometric authentication.
5 is a conceptual diagram illustrating a method of performing user authentication through complex biometric authentication in an electronic device related to the present invention.
6 is a block diagram illustrating complex biometric authentication in an electronic device related to the present invention.
7 is a block diagram illustrating a forgery probability score for complex biometric authentication in an electronic device related to the present invention.
8 is a block diagram illustrating the use of sensor fusion information in an electronic device related to the present invention.
9 is a conceptual diagram illustrating an embodiment using the sensor fusion information of FIG. 8.
10 is a flowchart illustrating a method of performing complex biometric authentication according to a security level of an application.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same reference numerals will be assigned to the same or similar elements regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in describing the embodiments disclosed in this specification, detailed descriptions of related known technologies are omitted when it is determined that the gist of the embodiments disclosed in this specification may be obscured. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

When an element is said to be "connected" or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but there may be other components in between. It should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, terms such as "comprises" or "have" are intended to indicate the presence of features, numbers, steps, actions, components, parts or combinations thereof described in the specification, but one or more other features. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

Mobile electronic devices described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and slate PCs. ), Tablet PC, ultrabook, wearable device (e.g., smartwatch, smart glass, head mounted display (HMD), smart car) And the like.

However, those skilled in the art will readily appreciate that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, digital signage, etc., except when applicable only to portable electronic devices. There will be.

1 is a block diagram illustrating an electronic device related to the present invention.

Referring to FIG. 1, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, a security module 181, and a power supply unit 190 And the like. The components illustrated in FIG. 1 are not essential for implementing an electronic device, and thus, the electronic device described in this specification may have more or fewer components than those listed above.

More specifically, the wireless communication unit 110 among the components, between the electronic device 100 and the wireless communication system, between the electronic device 100 and another electronic device 100, or the electronic device 100 and an external server It may include one or more modules that enable wireless communication between. Also, the wireless communication unit 110 may include one or more modules connecting the electronic device 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 may include a camera 121 for inputting a video signal or a video input unit, a microphone for inputting an audio signal (microphone 122), or an audio input unit, a user input unit 123 for receiving information from a user, for example , A touch key, a mechanical key, and the like. The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the electronic device, surrounding environment information surrounding the electronic device, and user information. For example, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity G-sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint scan sensor, ultrasonic sensor , Optical sensor (e.g., camera (see 121)), microphone (see 122), battery gauge, environmental sensor (e.g. barometer, hygrometer, thermometer, radioactivity sensor, Thermal sensor, gas sensor, and the like), and a chemical sensor (eg, an electronic nose, a health care sensor, a biometric sensor, etc.). The biometric sensor 143 may include an iris sensor, a face recognition sensor, a PPG sensor, and a voice sensor. Meanwhile, the electronic device disclosed in this specification may combine and use information sensed by at least two or more of these sensors.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a hap tip module 153, and an optical output unit 154 can do. The display unit 151 may form a mutual layer structure with the touch sensor or may be integrally formed, thereby realizing a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the electronic device 100 and a user, and at the same time, provide an output interface between the electronic device 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the electronic device 100. The interface unit 160 connects a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port. In the electronic device 100, in response to an external device being connected to the interface unit 160, appropriate control related to the connected external device may be performed.

Also, the memory 170 stores data supporting various functions of the electronic device 100. The memory 170 may store a number of application programs or applications that are driven by the electronic device 100 and data and instructions for the operation of the electronic device 100. At least some of these applications can be downloaded from external servers via wireless communication. Also, at least some of these application programs may exist on the electronic device 100 from the time of shipment for basic functions of the electronic device 100 (for example, an incoming call, a calling function, a message reception, and a calling function). Meanwhile, the application program may be stored in the memory 170 and installed on the electronic device 100 to be driven by the controller 180 to perform an operation (or function) of the electronic device.

In addition to the operations related to the application program, the controller 180 generally controls the overall operation of the electronic device 100. The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1A to drive an application program stored in the memory 170. Furthermore, the controller 180 may operate by combining at least two or more of the components included in the electronic device 100 to drive the application program.

Under the control of the controller 180, the power supply unit 190 receives external power and internal power to supply power to each component included in the electronic device 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of an electronic device according to various embodiments described below. Also, the operation, control, or control method of the electronic device may be implemented on the electronic device by driving at least one application program stored in the memory 170.

Hereinafter, before looking at various embodiments implemented through the electronic device 100 described above, the components listed above will be described in more detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The mobile communication module 112 includes technology standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced) transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to (Long Term Evolution-Advanced).

The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the electronic device 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World) Interoperability for Microwave Access (HSDPA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology in a range including the Internet technology not listed above.

In view of the wireless Internet access through WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc., through the mobile communication network, the wireless Internet module 113 that performs wireless Internet access through the mobile communication network ) May be understood as a type of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), by using at least one of Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus) technology, it can support short-range communication. The short-range communication module 114 may be provided between the electronic device 100 and a wireless communication system, between the electronic device 100 and another electronic device 100, or the electronic device 100 through wireless area networks. ) And other electronic devices 100 or a network in which an external server is located may support wireless communication. The short-range wireless communication network may be wireless personal area networks.

Here, the other electronic device 100 is a wearable device capable of exchanging data with the electronic device 100 according to the present invention (or interoperable), for example, a smart watch, a smart glass (smart glass), HMD (head mounted display). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the electronic device 100 around the electronic device 100. Furthermore, when the sensed wearable device is a device authenticated to communicate with the electronic device 100 according to the present invention, the controller 180 may include at least a portion of data processed by the electronic device 100, and the short-range communication module ( 114) to the wearable device. Accordingly, a user of the wearable device can use data processed by the electronic device 100 through the wearable device. For example, according to this, the user performs a phone call through the wearable device when a call is received by the electronic device 100 or a message is received through the wearable device when a message is received by the electronic device 100. It is possible to check the message.

The location information module 115 is a module for acquiring a location (or current location) of an electronic device, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the electronic device utilizes a GPS module, the position of the electronic device may be acquired using a signal transmitted from a GPS satellite. As another example, when the Wi-Fi module is used as an electronic device, the location of the electronic device may be obtained based on information of a Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of other modules of the wireless communication unit 110 in order to obtain data regarding the location of the electronic device by substitution or additionally. The location information module 115 is a module used to acquire a location (or current location) of the electronic device, and is not limited to a module that directly calculates or acquires the location of the electronic device.

Next, the input unit 120 is for input of image information (or signals), audio information (or signals), data, or information input from a user. For input of image information, the electronic device 100 is one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. Meanwhile, the plurality of cameras 121 provided in the electronic device 100 may be arranged to form a matrix structure, and through the camera 121 forming the matrix structure, various angles or focuses may be applied to the electronic device 100. A plurality of image information may be input. Also, the plurality of cameras 121 may be arranged in a stereo structure to acquire left and right images for realizing a stereoscopic image.

The microphone 122 processes external sound signals as electrical voice data. The processed voice data may be used in various ways according to a function (or a running application program) being performed by the electronic device 100. Meanwhile, various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 123 is for receiving information from the user. When information is input through the user input unit 123, the controller 180 may control the operation of the electronic device 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the electronic device 100, a dome switch, a jog wheel, Jog switch, etc.) and a touch input means. As an example, the touch-type input means is made of a virtual key, a soft key or a visual key displayed on the touch screen through software processing, or a part other than the touch screen On the other hand, the virtual key or the visual key may be displayed on the touch screen while having various forms, for example, a graphic or text. ), An icon, a video, or a combination thereof.

Meanwhile, the sensing unit 140 senses at least one of information in the electronic device, surrounding environment information surrounding the electronic device, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control driving or operation of the electronic device 100 based on the sensing signal, or perform data processing, function, or operation related to an application program installed in the electronic device 100. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity using mechanical force or infrared light without mechanical contact. In the proximity sensor 141, the proximity sensor 141 may be disposed in the inner region of the electronic device wrapped by the touch screen described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of the object with a change in electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of allowing the object to be recognized as being located on the touch screen without being touched on the touch screen is called a "proximity touch", and the touch The act of actually touching an object on the screen is called "contact touch". The location where an object is in close touch on the touch screen means a location where the object is vertically corresponding to the touch screen when the object is touched in close proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). have. Meanwhile, as described above, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 141, and further, visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 180 may control the electronic device 100 such that different operations or data (or information) are processed according to whether a touch on the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. Detect.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or capacitance generated in the specific part into an electrical input signal. The touch sensor may be configured to detect a location, an area, a pressure when a touch is touched, a capacitance when a touch object is touched on the touch screen, and the like. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

As such, when there is a touch input to the touch sensor, the signal (s) corresponding to the touch is sent to the touch controller. The touch controller processes the signal (s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a separate component from the controller 180 or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object, it may be determined according to the current operating state of the electronic device 100 or an application program being executed.

On the other hand, the touch sensors and proximity sensors described above are independently or in combination, such as short (or tap) touch on the touch screen, long touch, multi touch, drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target using ultrasonic waves. Meanwhile, the control unit 180 may calculate the position of the wave generating source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generator can be calculated by using a property in which light is much faster than ultrasonic waves, that is, a time when light reaches the optical sensor is much faster than a time when ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave generator may be calculated by using a time difference from the time at which the ultrasound reaches the light as a reference signal.

On the other hand, the camera 121, which is considered as the configuration of the input unit 120, includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on a display element, which is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows / columns to scan the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the sensing object according to the change amount of light, and through this, location information of the sensing object may be obtained.

The display unit 151 displays (outputs) information processed by the electronic device 100. For example, the display unit 151 may display execution screen information of an application program driven by the electronic device 100, or user interface (UI) or graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output unit 152 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed by the electronic device 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated in the haptic module 153 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 153 may synthesize different vibrations and output them sequentially or sequentially.

In addition to vibration, the haptic module 153 is used for stimulation such as pin arrangement that vertically moves with respect to the contact surface of the skin, spray or suction force of air through a spray or intake, grazing on the skin surface, contact with an electrode, and electrostatic force Various tactile effects can be generated, such as an effect caused by an effect and an effect of reproducing a feeling of warm and cold using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 153 may be provided according to a configuration aspect of the electronic device 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the electronic device 100. Examples of events generated in the electronic device 100 may include receiving messages, receiving call signals, missed calls, alarms, schedule notifications, receiving emails, and receiving information through applications.

The signal output from the light output unit 154 is implemented as the electronic device emits light of a single color or a plurality of colors to the front or rear. The signal output may be terminated by the electronic device detecting the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the electronic device 100. The interface unit 160 receives data from an external device, receives power, and transmits data to each component in the electronic device 100, or allows data in the electronic device 100 to be transmitted to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), audio I / O (Input / Output) port, video I / O (Input / Output) port, earphone port, and the like may be included in the interface unit 160.

On the other hand, the identification module is a chip that stores various information for authenticating the use authority of the electronic device 100, a user identification module (UIM), a subscriber identity module (SIM), universal user authentication And a universal subscriber identity module (USIM). The device provided with the identification module (hereinafter referred to as 'identification device') may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160.

In addition, when the electronic device 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the electronic device 100, or is input from the cradle by a user. Various command signals may be passages to the electronic device 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the electronic device 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180, and may temporarily store input / output data (eg, a phone book, a message, a still image, a video, etc.). The memory 170 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 170 is a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EPMROM) It may include a storage medium of at least one type of -only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk. The electronic device 100 may be operated in connection with a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and generally the overall operation of the electronic device 100. For example, when the state of the electronic device satisfies a set condition, the controller 180 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input on the touch screen as text and images, respectively. Can be. Furthermore, in order to implement various embodiments described below on the electronic device 100 according to the present invention, the controller 180 may control any one or a combination of the above-described components.

The security module 181 controls security-related operations during operation of the electronic device. For example, when the biometric authentication function is executed, the security module 181 may perform control related to biometric authentication. For example, the security module 181 may perform biometric authentication using an artificial neural network algorithm and an SVM algorithm, which are algorithms for biometric authentication. In addition, the security module 181 includes Fuzzy logic, Dempster-Shafer theory, SVM, Relevance vector machine (RVM) Mean rule, Monte carlo approach, Phase stretch transform (PST), Neural Network, Principal Component Analysis , Fisherfaces, Wavelet and Elastic Matching.

The security module 181 may transmit and receive data through communication with the controller 180, thereby controlling the overall operation of the electronic device. For example, the controller 180 may receive user authentication result data from the security module 181 and control the operation of the electronic device based on the result. In addition, the security module 181 may receive a control command for performing biometric authentication from the control unit 180 and perform biometric authentication accordingly.

Meanwhile, in FIG. 1, although the security module 181 and the control unit 180 are illustrated as having separate configurations, the present invention is not limited thereto, and the security module 181 may be configured as one configuration of the control unit 180. have.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery made to be rechargeable, and may be detachably coupled to a terminal body for charging and the like.

Further, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery wirelessly without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission device or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon. Power can be delivered.

Meanwhile, various embodiments below may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

Hereinafter, a method of performing biometric authentication in the electronic device described in FIG. 1 will be described in detail. 2 is a conceptual diagram illustrating a single biometric authentication method.

Referring to FIG. 2, single biometric authentication may include the steps of obtaining 210, extracting feature points 220, matching 230, and determining 240.

In the acquisition (210, acquisition) step, biometric information may be acquired through a biometric sensor. The biometric information may include user's unique biometric information such as fingerprint, face, voice, vein, and iris.

In the feature extraction (220) step, feature points of biometric information may be extracted. The feature point is information that can recognize each person's unique characteristics for each person. For example, in the case of a fingerprint, a point indicating the unusual shape of the fingerprint can be set as a feature point. These feature points are set differently for each biometric authentication method.

In the matching step 230, a matching score between pre-registered user information and sensed biometric information may be calculated. The pre-registered user information is biometric information previously stored by the user before performing biometric authentication. The user may pre-store fingerprint information, face information, voice information, vein information, iris information, etc. in the memory 170 in the form of a template.

The matching score indicates a similarity between pre-registered user information and biometric information as a score. Various algorithms known in the art can be used as the algorithm for calculating the matching score.

In the determination step 240, user authentication may be performed using a matching score and a decision function. The determination function is a function for determining whether a user who inputs biometric information is a genuine user or an imposter user. The decision function may be set to a specific threshold value or may be set to a multidimensional function.

In the determination function, an initial default value may be set by the manufacturer of the biometric authentication function. In addition, the determination function may change the initial setting value using the biometric information of the user detected through the biometric sensor. Accordingly, as the biometric operation progresses, the electronic device can improve the speed and accuracy of the biometric recognition.

Also, the decision function may be generated differently according to information used to generate the decision function. Also, a plurality of decision functions generated differently may be stored in the memory 170. For example, the determination function may be generated using only a matching score or a matching score and a spoofing score. In this case, both decision functions may be stored in the memory 170, and biometric authentication may be performed using any one decision function as necessary.

In the above, a single biometric authentication method has been described. Hereinafter, a method for complex biometric authentication will be described. 3A to 3D are conceptual diagrams illustrating a complex biometric authentication method.

The complex biometric authentication may be divided into four methods according to a time point at which a plurality of biometric information is fusion. Here, fusion means an operation of combining a plurality of pieces of information according to a predetermined algorithm and calculating them as one piece of information, and may also be used in terms of combining, combining, fusion, and matching.

3A shows a sensor fusion scheme 310. The sensor fusion method 310 is a method of combining a plurality of biometric information obtained from different sensors in the step of obtaining biometric information. Specifically, the sensor fusion method is a method of fusion of biometric information sensed from different biometric sensors and extracting feature points from the fusion information.

3B shows a feature point fusion scheme 320. The feature point fusion method 320 is a method of extracting feature points from a plurality of biometric information obtained from different biometric sensors and combining the extracted feature points in a feature point extraction step of biometric information.

3C shows a score fusion scheme (330). The score fusion method 330 is a method of combining matching scores calculated for a plurality of biometric information in a matching step of biometric information.

3D shows a crystal fusion scheme 340. The decision fusion method 340 is a method of combining determination results calculated for a plurality of biometric information in a determination step of biometric information.

In the above, various methods of complex biometric authentication have been described. Hereinafter, an error rate of biometrics related to a determination function when authenticating a user through biometric authentication will be described. 4A and 4B are graphs related to an error rate of biometric authentication.

Graph a of FIG. 4A is a graph showing the distribution of similarity between the biometric information of the true user at the time of biometric authentication and pre-registered user information, and graph b of FIG. 4A is the similarity distribution between the biometric information of the counterfeit user and pre-registered user information It is the graph shown.

The graph a and the graph b have overlapping portions, and the electronic device 100 judges as a true user when it has a similarity higher than the threshold shown by the dotted line aa ', and if it has a similarity lower than the threshold, the counterfeit It can be judged as a user. Here, the threshold may be a value determined by a provider that provides a biometric authentication function, and means the above-described determination function.

On the other hand, the FRR (False rejection rate) shown in Figure 4a is a true user, but represents a rate determined to be a counterfeit user. The higher the FRR, the higher the threshold value, and accordingly, the probability that a user who inputs biometric information is judged to be a true user decreases, so the security of biometric authentication can be increased. The lower the FRR, the lower the threshold, and accordingly, the higher the probability that a user who inputs biometric information is judged to be a true user, the security of biometric authentication may be lowered.

FAR (False acceptance rate) represents an error determined to be a fake user but a true user. FAR is a concept contrary to FRR, and the higher the FAR, the lower the threshold, and accordingly, the greater the probability that a user who inputs biometric information is determined to be a user, the security of biometric authentication may be lowered.

4B is a graph showing the relationship between FRR and FAR. FRR and FAR can be inversely proportional to each other. The threshold value corresponding to the area of d having a high FRR and a low FAR is slow in authentication speed, but applications requiring high security may be used. For example, a threshold value of this area may be set in a payment application or a banking application that strictly judges a truly user. Conversely, a threshold value corresponding to a region of c having a low FRR and a high FAR may be used in applications requiring fast authentication and low security. For example, a threshold value corresponding to this area may be used, such as the unlock function. In this way, the threshold value (that is, the determination function) of the biometric authentication function may be determined in consideration of the security level of the functions to be executed through biometric authentication. In the above, parameters related to errors in biometric authentication have been described.

On the other hand, the present invention relates to a method for improving the authentication accuracy of the score fusion method of complex biometric authentication. Hereinafter, an algorithm that can be used in the score fusion method among the complex biometric authentication methods will be described.

In the score fusion method, various artificial intelligence algorithms that combine matching scores can be used. A combination-based score fusion algorithm, a classifier-based score fusion algorithm, and a density-based score fusion algorithm can be used as an algorithm that can be used in the score fusion method.

Combination-based score fusion algorithms can include static rules, dynamic weighting, and triangular norms. The classifier-based score fusion algorithm may include a support vector machine (SVM), AdaBoost (RS-ADA), and Dampster-Shafer (DS). The density-based score fusion algorithm may include a Liklihood feature (LF).

In addition, in the present invention, various algorithms known in the art may be used in the skew fusion method, and detailed descriptions thereof will be omitted so as not to depart from the spirit of the present invention.

The present invention relates to a method for improving authentication accuracy of a score fusion method in a composite biometric authentication method in an electronic device capable of biometric authentication. Hereinafter, the biometric authentication method of the present invention will be described in more detail with reference to the drawings.

5 is a conceptual diagram illustrating a method of performing user authentication through complex biometric authentication in an electronic device related to the present invention. 6 is a block diagram illustrating complex biometric authentication in an electronic device related to the present invention. 7 is a block diagram illustrating a forgery probability score for complex biometric authentication in an electronic device related to the present invention.

The electronic device 100 according to the present invention may include a plurality of biometric sensors 143. The plurality of biometric sensors 143 may include various sensors described in FIG. 1. For example, the plurality of biometric sensors 143 may include a face image acquisition sensor (eg, an image sensor), a voice sensor, an iris sensor, and a fingerprint sensor.

Referring to FIG. 5, the security module 181 of the electronic device 100 may detect different biometric information from a plurality of biometric sensors 143 (S510).

In the security module 181, a user request for biometric authentication is received, a preset condition is satisfied, or a biometric authentication function can be executed every predetermined period. Here, the preset condition may be various conditions such as a condition in which a request to execute a security function is received, a condition in which the electronic device is located at a specific place (or a specific time).

In addition, when the biometric authentication function is executed every predetermined period, the security module 181 may be executed in the background of the electronic device 100 so that the user does not recognize that the biometric authentication function is being executed.

When the biometric authentication function is executed, the security module 181 may receive different biometric information from a plurality of biometric sensors 143. The different biometric information may include face recognition information, fingerprint recognition information, iris recognition information, and voice recognition information.

The security module 181 may calculate a matching score for different biometric information (S520).

The security module 181 may calculate a matching score for different biometric information through comparison between pre-registered user information and the different biometric information. For example, referring to FIG. 6, the security module 181 may calculate a matching score Ma for biometric information obtained from sensor A and a matching score Mb for biometric information obtained from sensor B, respectively.

In addition, the security module 181 may calculate counterfeit probability information for different biometric information (S530).

The security module 181 may calculate counterfeit probability information for different biometric information in consideration of a forgery method according to unique characteristics of different biometric information.

Here, the counterfeit probability information is information indicating the possibility that the biometric information is counterfeit information. Forgery probability information may be calculated in consideration of a forgery method according to a unique characteristic of biometric information. The unique characteristics of biometric information are characteristics unique to each biometric information. For example, in the case of face recognition information, the position of the eyes, nose, and mouth are unique characteristics. A photo, mask, or the like may be used as a forgery of face recognition information. The forgery probability information of the face recognition information may include feature information that can distinguish a photo from a real person's face.

Therefore, the forgery probability information may vary for each unique characteristic of biometric information. Accordingly, the forgery probability information may be a preset value before the biometric authentication function is executed.

Referring to FIG. 7, at least one of quality information 710, spoofing information 720, and surrounding environment information 730 may be included in the counterfeit probability information 700.

The quality information 710 indicates the quality of the attribute of biometric information, which affects the accuracy of biometric authentication during biometric authentication. For example, it may be quality of properties such as resolution, image noise, blur, and distortion.

The spoofing information 720 is information indicating the possibility that the biometric information is counterfeit information. That is, it means the probability that the currently detected biometric information is forged information. For example, in the case of face authentication, it means the probability that face recognition information recognizes a face photo, not a human face. The spoofing information 720 may include motion detection, eye blink detection, 2D image reflectivity information, thermal image information, heart rate information, frequency spectrum information, audio and video synchronization information, and the like.

The spoofing information 720 may be generated using sensor information received from a separate sensor as well as biometric information. For example, spoofing information of face recognition information may be generated by detecting and blinking an eye (or face movement) through comparison between a plurality of face images photographed through the camera 121. As another example, spoofing information of fingerprint recognition information may be generated using heart rate information detected through a heart rate sensor.

The surrounding environment information 730 is environmental information that affects biometrics. That is, the surrounding environment information 730 is environmental information at the time of detection of the biometric information. For example, ambient light, ambient noise, and shaking of the electronic device may be included.

The surrounding environment information 730 may be sensed through a separate environment sensor, or may be generated using attributes of biometric information itself. Here, the environment sensor includes an illuminance sensor, a temperature sensor, a noise detection sensor, an acceleration sensor, a gyro sensor, and the like, and various sensors described in FIG. 1 may be included. Through such a sensor, it is possible to detect surrounding environment information.

The surrounding environment information may also be set differently according to unique characteristics of biometric information. For example, in the case of face recognition, the illuminance is set to the surrounding environment information that affects face recognition, and in the case of fingerprint recognition, the surrounding environment information that affects fingerprint recognition may be set to the degree of shaking of the device equipped with the fingerprint sensor. You can. Through this, the present invention can improve the accuracy of the complex biometric authentication by considering surrounding environment information that affects the detection of biometric information.

The following table shows examples of forgery probability information for each biometric authentication method. In addition, various biometric authentication methods may be used, and in this case, forgery probability information may be generated in the manner described above.

[Table 1]

The generated matching information and forgery probability information may be stored in the memory 170.

Referring to FIG. 5 again, the security module 181 may perform user authentication using matching scores and forgery probability information calculated for each of the different biometric information (S540).

The security module 181 may calculate the final score using the matching score and the forgery probability score generated for different biometric information.

At this time, the final score may be generated based on the algorithm used in the score fusion method. As described above, as for the algorithm of the score fusion method, conventionally known methods can be used, and a detailed description is omitted so as not to obscure the spirit of the present invention.

For example, referring to FIG. 6, the security module 181 uses the matching score Ma and the counterfeit probability information Sa calculated from the sensor A, and the matching score Mb and the counterfeit probability information Sb calculated from the sensor B, to determine the final score. Can be created.

In addition, the security module 181 may perform user authentication through comparison between the generated final score and a predetermined decision function. More specifically, when the final score is greater than a threshold value of a predetermined determination function, the security module 181 may determine that the user who inputs the biometric information is a true user. This situation can be called successful user authentication. Conversely, if the final score is less than a threshold value of a predetermined determination function, the security module 181 may determine a user who inputs biometric information as a counterfeit user. This situation can be called user authentication failure.

The predetermined determination function may be set differently according to the type of counterfeit probability information considered when calculating the final score. For example, when only the matching score and the spoofing information are used when calculating the final score, the controller 180 may also use the determination function generated using the matching score and the spoofing score.

In addition, the security module 181 may perform a score fusion method only with a matching score when it is difficult to obtain a forgery probability score due to the unique characteristics of the biometric sensor. In addition, the security module 181 may use a score fusion method by selectively using only some information according to characteristics of biometric information among various information included in the forgery probability information. This can be determined by the unique characteristics of the currently acquired biometric information.

On the other hand, although not shown, the controller 180 may receive a user authentication result from the security module 181, and control the operation of the electronic device based on this. The user authentication result is user authentication success or user authentication failure. For example, when the user authentication success result is received, the controller 180 may proceed with the payment requested by the payment application. Conversely, when the user authentication failure result is received, the controller 180 may not proceed with the payment requested by the payment application.

Meanwhile, in the previous description, a case in which user authentication is performed using the matching score and the forgery probability information has been described, but the present invention is not limited thereto, and the user authentication may be performed using only the matching score. In this case, counterfeit probability information may not be generated.

In the above, a method of performing user authentication using matching score and forgery probability information when performing complex biometric authentication in the electronic device according to the present invention has been described. Through this, according to the present invention, the authentication accuracy of the complex biometric authentication can be improved by calculating the matching score and the forgery probability information for each of the plurality of biometric authentication information, and performing user authentication using the biometric authentication.

In addition, the electronic device according to the present invention generates the forgery probability information in consideration of the surrounding environment information of the electronic device that performs biometric authentication, in consideration of the situation in which the accuracy of the biometric authentication is lowered due to the influence of the surrounding environment, the biometric authentication You can do

Hereinafter, a method of performing user authentication by using sensor coupling information in an electronic device related to the present invention will be described. 8 is a block diagram illustrating the use of sensor coupling information in an electronic device related to the present invention. 9 is a conceptual diagram illustrating an embodiment of utilizing the sensor coupling information of FIG. 8.

In the previous description, a method of performing complex biometric authentication using matching scores and forgery probability information of information collected for each sensor was described. Meanwhile, the security module 181 may combine biometric information obtained from different sensors and further calculate counterfeit probability information for the combined biometric information.

More specifically, referring to FIG. 8, the security module 181 may combine biometric information obtained from sensors A and B. At this time, the security module 181 may generate combined information combining the information in consideration of a relation between biometric information obtained from sensors.

For example, referring to FIG. 9, the security module 181 may acquire face recognition information and voice recognition information, and generate combination information through a combination between the obtained biometric information. Specifically, the security module 181 extracts the movement of the mouth shape from the face recognition information, and can generate synchronization information regarding whether synchronization between the extracted movement of the mouth shape and the voice speech time and pronunciation information is correct. have.

The security module 181 may calculate counterfeit probability information for the combined information. For example, the forgery probability information may include the synchronization information, resolution, noise, illuminance, and ambient noise.

The security module 181 may calculate the final score by using the matching score Ma of the sensor A, the forgery probability score Sa, the matching score of the sensor B Mb, the forgery probability score Sb, and the forgery probability score Sab of the sensor AB.

On the other hand, although not shown, the security module 181 may also calculate a matching score for the sensor combination information by comparing the sensor combination information and pre-registered user information. In this case, when calculating the final score, the security module 181 may also consider a matching score for the sensor combination information.

In the above, a method of performing complex biometric authentication by using sensor coupling information has been described. Through this, the present invention can improve the authentication accuracy of biometric authentication by using the sensor combination information.

Hereinafter, a description will be given of a method in which forgery probability information considered in a score fusion method of composite biometric authentication varies according to a security level of an application for which an execution request is received. 10 is a flowchart illustrating a method of performing complex biometric authentication according to a security level of an application.

In the preceding description, a method of using forgery probability information in the electronic device 100 according to the present invention for complex biometric authentication has been described. On the other hand, FRR and FAR are parameters that determine the performance of complex biometric authentication. FRR and FAR are in a trade-off relationship with each other, so if one level is high, the other level can be lowered.

According to the security level of the application, the security module 181 of the electronic device 100 according to the present invention may perform biometric authentication using only some of the forged probability information among the forged probability information in consideration of FRR and FAR. Alternatively, the security module 181 may set weights between the plurality of pieces of information included in the forgery probability information differently, and reflect them in the final score calculation.

10 is a flowchart showing such a control method. Referring to FIG. 10, the security module 181 may detect a security level of a function to be currently executed (S1010).

When a user request for execution of a specific function is received, the controller 180 can detect the security level of the specific function. Then, the control unit 180 may transmit the detected security level to the security module 181.

The security module 181 may determine some counterfeit probability information to be used for authentication among a plurality of counterfeit probability information according to the security level (S1020).

Specifically, the FRR is greatly changed according to surrounding environment information, and the FAR can be greatly changed according to spoofing information. Therefore, the security module 181 may perform biometric authentication by considering only spoofing information so that the FAR can reach a low level when the security level of the application is high (if the security level is greater than or equal to the reference level). In addition, the security module 181 may perform biometric authentication by considering only surrounding environment information so that the FRR can reach a low level when the security level of the application is low (when the security level is less than a reference level).

The security module 181 may perform user authentication using the determined forgery probability information according to the security level (S103). Accordingly, the security module 181 may perform user authentication using some counterfeit probability information, thereby performing appropriate security authentication for each application.

The electronic device according to the present invention can improve the authentication accuracy of the complex biometric authentication by calculating matching scores and forgery probability information for each of the plurality of biometric identification information, and performing user authentication using the biometric authentication. .

In addition, the electronic device according to the present invention generates the forgery probability information in consideration of the surrounding environment information of the electronic device that performs biometric authentication, in consideration of the situation in which the accuracy of the biometric authentication is lowered due to the influence of the surrounding environment, the biometric authentication You can do

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include a hard disk drive (HDD), solid state disk (SSD), silicon disk drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. This includes, and is also implemented in the form of a carrier wave (eg, transmission over the Internet). In addition, the computer may include a control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims (15)

In the electronic device capable of performing complex biometric authentication,
A plurality of biometric sensors formed to detect different biometric information;
Through comparison of the different biometric information and pre-registered user information, a matching score is calculated for each of the different biometric information,
In consideration of the forgery factors of the different biometric information, forgery probability information is calculated for each of the different biometric information,
A security module for performing user authentication using matching scores and forgery probability information calculated for each of the different biometric information; And,
On the basis of the user authentication result performed in the security module, and includes a control unit for controlling the electronic device,
The security module,
Based on a score fusion algorithm, a final score is calculated by combining only some of the matching scores calculated for each of the different biometric information and the forgery probability information for each of the different biometric information,
User authentication is performed through comparison between the calculated final score and a threshold of a predetermined decision function,
Part of the forgery probability information that is fused with the matching scores,
An electronic device characterized by being determined according to a security level of a function to be executed through the user authentication. delete According to claim 1,
The predetermined decision function
An electronic device characterized in that it is generated by using at least one of the matching score and the forgery probability information calculated for the different biometrics. According to claim 3,
Further comprising a memory for storing a plurality of decision functions,
The predetermined decision function
An electronic device characterized in that one of the plurality of decision functions is selected based on the forgery probability information. According to claim 1,
The counterfeit probability information,
An electronic device comprising at least one of quality information representing attributes of the different biometric information, spoofing information representing a forgery probability for a user, and surrounding environment information of the electronic device. delete The method of claim 5,
The security module
When the security level of a function to be executed through the user authentication is higher than a reference level, user authentication is performed using spoofing information and matching information,
If the security level of the function to be executed through the user authentication is less than the reference level, the electronic device characterized in that the user authentication is performed using the surrounding environment information. According to claim 1,
Further comprising an environmental sensor for sensing the environment information of the electronic device,
The security module
An electronic device, characterized in that forgery probability information is generated using the detected surrounding environment information. According to claim 1,
The security module
Generating the combined information by combining the different biometric information,
An electronic device, characterized in that forgery probability information for the generated combined information is calculated. The method of claim 9,
The security module
When performing the user authentication, the electronic device further characterized by using forgery probability information for the generated combined information. According to claim 1,
The plurality of biometric sensors,
A face recognition sensor that detects user's face information; And
Includes a voice recognition sensor that detects user voice information,
The security module
An electronic device performing user authentication using matching information of the face information and forgery probability information, and matching information and forgery probability information of the voice information. The method of claim 11,
The security module
Extract the movement of the mouth shape from the face information,
Compare the mouth movement and the voice information, and generate synchronization information,
An electronic device, characterized in that forgery probability information for the generated synchronization information is calculated using the face information and the voice information. In the control method of the electronic device for performing a complex biometric authentication,
Sensing different biometric information from a plurality of biometric sensors for user authentication;
Calculating a matching score for each of the different biometric information through comparison of the different biometric information and pre-registered user information;
Calculating forgery probability information for each of the different biometric information in consideration of the forgery factors according to the unique characteristics of the different biometric information;
Performing user authentication using matching scores and forgery probability information calculated for the different biometric information; And,
And controlling the electronic device based on the user authentication result.
The step of performing the user authentication,
Selecting some of the forgery probability information according to a security level of a function to be executed through the user authentication;
Calculating a final score by fusing matching scores calculated for each of the different biometric information and a selected part of the forgery probability information based on a score fusion algorithm; And,
And performing user authentication through comparison between the calculated final score and a threshold value of a predetermined determination function.
delete delete

Images