WO2021080369A1

WO2021080369A1 - User verification device using electrocardiogram data and method thereof

Info

Publication number: WO2021080369A1
Application number: PCT/KR2020/014564
Authority: WO
Inventors: 정현준
Original assignee: 삼성전자 주식회사
Priority date: 2019-10-24
Filing date: 2020-10-23
Publication date: 2021-04-29
Also published as: KR20210048930A

Abstract

An electronic device according to an embodiment disclosed in the present document may comprise: a memory for storing instructions; and a processor electrically connected to the memory, wherein the instructions, when executed, cause the processor to: authenticate a user of the electronic device on the basis of an authentication scheme using user identification information; after the user is authenticated, determine, by using a sensor, whether a state of wearing the electronic device is maintained; while the state of wearing the electronic device is maintained, acquire electrocardiogram data of the user by using an electrocardiogram sensor when a trigger event for causing execution of a function or an application of the electronic device occurs, the function or the application requiring verification of the user; generate an electrocardiogram data template by using the acquired electrocardiogram data; verify, according to similarity between the generated electrocardiogram data template and a reference electrocardiogram data template stored in the memory, whether the user is authenticated; and execute the function or the application when the verification is completed. Various other embodiments inferred from the specification are also possible.

Description

User verification device and method using ECG data

Embodiments disclosed in the present document relate to an apparatus and method for measuring electrocardiogram data through a device and verifying a user using the measured electrocardiogram data.

An electrocardiogram (ECG) is an electrical signal indicating cardiac function. This can be achieved by measuring the difference in voltage between actives using electrodes at two different biological positions. Since the shape of the signal varies depending on the structure, location, and function of the heart, the shape of the electrocardiogram differs from person to person. The shape of the electrocardiogram is different for the position of the heart, the direction it is laid, and even the rotation. Also, even if the measurement vector is different, the shape of the ECG of the same person is different. Because of these points, the shape of the heart is different for each person, so the shape of the electrocardiogram is slightly different. If you look at only 10 of the ECG templates that were experimentally measured, you can see that the shape is slightly different.

It has been argued that the electrocardiogram can be used for user verification steadily because the shape of the electrocardiogram is unique for each person, but there is a problem that the shape of the electrocardiogram may vary slightly depending on the individual, and it does not have high security strength such as fingerprints and irises. .

Accordingly, in the prior art, user verification is mainly performed through various sensors of an electronic device, and various methods having high security strength such as fingerprint, iris, and face recognition are applied. However, there is a problem in that these methods cannot be applied to an electronic device having a limited size and thus a limited number of sensors that can be embedded.

The technical problem to be achieved by the exemplary embodiment disclosed in this document is that the electronic device can verify the user using only the electrocardiogram data when the user continues to wear the electronic device after authentication of the user's high security level is performed once. It provides a method and apparatus that can be used.

In the electronic device according to an embodiment disclosed in this document, upon execution, the processor authenticates the user of the electronic device based on an authentication method using user identification information, and after the user is authenticated, the sensor A trigger event that determines whether the electronic device is in a maintenance state of the wearing state by using and executes a function or application of the electronic device that requests verification of the user while the wearing state of the electronic device is maintained is generated. When it occurs, the user's electrocardiogram is measured using the electrocardiogram sensor, an electrocardiogram data template is generated using the measured electrocardiogram data, and according to the similarity between the generated electrocardiogram data template and the reference electrocardiogram data template stored in the memory. A memory storing instructions for verifying whether the user is the authenticated user, and executing the function or application when the verification is completed, and a processor electrically connected to the memory may be included.

In addition, the method according to an embodiment disclosed in this document is an operation of authenticating a user of the electronic device based on an authentication method using user identification information when a process included in the electronic device or connected to the electronic device is executed. , After the user is authenticated, an operation of determining whether to maintain the wearing state of the electronic device using the sensor, and the electronic requesting verification of the user while the wearing state of the electronic device is maintained Measuring the user's electrocardiogram using the electrocardiogram sensor when a trigger event for executing a device function or application occurs, generating an electrocardiogram data template using the measured electrocardiogram data, and generating the generated electrocardiogram data template And verifying whether the user is the authenticated user according to the similarity of the reference electrocardiogram data template stored in the memory, and executing the function or application when the verification is completed.

According to the embodiments disclosed in this document, an electronic device having a limited size may also execute an application requiring a high security level through user verification using ECG data by using an existing authentication method having a high security strength. I can.

According to the embodiments disclosed in this document, it is possible to increase the accuracy of user verification using the electrocardiogram by providing similarity and reliability to electrocardiogram data that may change due to various environmental influences.

In addition to this, various effects that are directly or indirectly identified through this document can be provided.

1 is a block diagram of an electronic device according to an exemplary embodiment.

2 is a flowchart of a method of verifying a user using electrocardiogram data of an electronic device, according to an exemplary embodiment.

3 is an exemplary diagram for verifying a user using electrocardiogram data of an electronic device according to an exemplary embodiment.

4 is a flowchart of a method of generating an electrocardiogram data template of an electronic device according to an exemplary embodiment.

5 is an exemplary diagram of a method of generating an electrocardiogram data template of an electronic device, according to an exemplary embodiment.

6 is another flowchart of a method of verifying a user using electrocardiogram data of an electronic device, according to an exemplary embodiment.

7 is another flowchart of a method of verifying a user using electrocardiogram data of an electronic device according to an exemplary embodiment.

8 is a block diagram of an electronic device in a network environment, according to an embodiment.

9 is a block diagram illustrating a program according to an embodiment.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include various modifications, equivalents, and/or alternatives of the embodiments of the present invention.

1 is a block diagram 100 illustrating a structure of an electronic device 110 (eg, the electronic device 801 of FIG. 8) according to an exemplary embodiment.

According to an embodiment, the electronic device 110 includes a processor 111 (eg, the processor 820 of FIG. 8), a memory 113 (eg, the memory 830 of FIG. 8), and a sensor 115 (eg. : The sensor module 876 of FIG. 8), the communication circuit 117 (eg, the communication module 890 of FIG. 8) and the output device 119 (eg, the display device 860 of FIG. 8, the sound output device ( 855. However, FIG. 1 is for explaining an embodiment, and some components may be omitted or changed.

The memory 113 may store instructions for causing the processor 111 to process data or control the electronic device 110. In this specification, the operation of the processor 111 or the electronic device 110 may be understood as being performed by the processor 111 executing instructions stored in the memory 113.

The communication circuit 117 may exchange commands or data with the external device 120 or other electronic devices using GPS, Bluetooth, BLE, Wi-Fi, NFC, or the like. Alternatively, the current location may be measured based on the received or detected wireless signal. Here, the communication circuit 117 shown in FIG. 1 is shown to perform wired/wireless communication with one external device 120, but is not limited thereto, and may perform wired/wireless communication simultaneously with a plurality of external devices.

The sensor 115 includes a motion sensor, a photoplethysmogram (PPG) sensor, an electrocardiogram (ECG) sensor, and the like, and may measure a motion or a biological signal. The motion sensor may include an accelerometer, a gyro sensor, a barometer, a geomagnetic sensor, and the like, and may measure a user's movement.

In another embodiment, the electronic device 110 may further include a button for generating a trigger, and the sensor 115 may be disposed inside the button.

Photoplethysmogram (PPG) changes the blood flow in peripheral blood vessels as the heart repeats contraction and relaxation, and this changes the volume of blood vessels by measuring the amount of light transmitted using an optical sensor. It is a technique used to measure.

A photoplethysmogram (PPG) sensor is composed of one or more receivers (Receiver (photodiode)) and one or more emitters (Emitter (LED)), and the LED (LED) converts electrical energy into light energy, and a photodiode (photodiode (PD)) can convert light energy into electrical energy. Therefore, when light is transmitted from the LED to the skin, the PD can detect the remaining reflected light after being partially absorbed by the skin. LEDs have more than one wavelength, such as infrared (IR) and visible light (red, blue, green).

When a device with a built-in PPG sensor composed of PD and LED is in contact with a part of the body (for example, fingers, wrists, ears, skin, etc.) and maintains contact for a certain period of time or longer, blood in the blood vessels increases in the systolic phase of the heart. As the amount of light detected by the PD decreases and blood is drained during the diastolic phase, the amount of light detected by the PD may increase. The skin and veins do not affect the change in heart rate (DC signal), and the arteries may change, resulting in an AC signal. By processing this signal, it is possible to estimate blood pressure, blood sugar, heart rate, and blood volume.

Electrocardiogram (ECG) is a technology that measures the voltage generated by the electrical activity of the heart. The heart's muscle cells can contract/relax by the current flowing from the heart's conduction system. The ECG sensor is measured using at least two electrodes, and the voltage difference measured by the two electrodes can be used.

According to an embodiment, the processor 111 may process signals measured from the sensor 115 of the electronic device 110 and display the processed signals through the output device 119. In this case, feedback of sound/vibration may be provided to the electronic device 110 together. Alternatively, other devices may be controlled or data may be stored through the communication circuit 117. The processor 111 may be composed of at least one processor, and may be physically divided into a main processor that performs high-performance processing and a secondary processor that performs low-power processing. At this time, a PPG sensor or an ECG sensor is connected to the coprocessor to perform 24-hour monitoring.

Alternatively, one processor may switch between high performance and low power depending on the situation.

Hereinafter, the operation of the processor 111 will be described in detail.

2 is a flowchart 200 of a method of integrating and plotting physiological data between multiple devices of an electronic device according to an exemplary embodiment. According to an embodiment, in the process illustrated in FIG. 2, the processor (eg, the processor 820 of FIG. 8) of the electronic device (eg, the electronic device 801 of FIG. 8) is a memory (eg, the memory (eg, the memory (eg, the electronic device 801 of FIG. 8 )) 830)).

In operation 201, the electronic device may authenticate a user based on an authentication method using user identification information. The user identification information refers to unique information that can confirm that the user is a user. For example, the user identification information may be biometric information, PIN information, or pattern information excluding an electrocardiogram such as iris information, fingerprint information, and voiceprint (voice) of the user. The authentication may be performed directly by the electronic device, or data indicating that authentication has been performed and performed by another electronic device may be received. For example, if the electronic device is a wearable device, user authentication may be performed by performing authentication using iris information in a smart phone interlocked with the wearable device, and receiving the performed authentication result from the wearable device.

Alternatively, user authentication may be performed by directly entering a pin number on the wearable device. Through this step, the electronic device performs high-level authentication, thereby improving security and accuracy of user authentication. In addition, it is possible to make sure that the ECG data and bio-signals to be measured afterwards belong to the user.

In operation 202, the electronic device may determine whether the user keeps wearing the electronic device. The electronic device may determine whether it is in a wearing state by receiving a bio-signal through a sensor or an embedded electrode. For example, when the electronic device is a wearable device such as a smart watch, it is possible to determine whether to wear a value of a DC voltage applied to an electrode embedded in the smart watch using a comparator.

In another embodiment, the electronic device may stop all authentication steps being performed by the electronic device when it detects that the electronic device is not worn.

After the electronic device performs authentication in operation 201, if the wearing state is maintained, the electronic device may continue to maintain the authenticated state.

In operation 203, the electronic device may measure the user's electrocardiogram when a trigger event occurs in the wearing state. The trigger event refers to an event for executing a function or application of the electronic device that requests verification of a user. For example, when the hardware button in which the ECG electrode is embedded is located on the side of the electronic device, the trigger event may be an event in which the hardware button in which the ECG electrode is embedded is pressed for about 1 second. As another example, the electrocardiogram electrode may be positioned in the form of a transparent electrode on a portion of the display of the electronic device. In this case, the trigger event may be an event of pressing an application execution button provided on the display portion where the transparent electrode is located for about 1 second.

In another embodiment, the electronic device may measure the user's electrocardiogram using an electrocardiogram sensor when a trigger event of executing a payment application occurs in the wearing state.

In another embodiment, in order to measure the user's electrocardiogram, the electronic device may generate an alarm requesting electrocardiogram measurement or display a measurement request message through a display.

In operation 204, the electronic device may generate an electrocardiogram data template by using the measured electrocardiogram data. In this case, it may be determined whether the ECG data is valid data for generating the ECG data template. In another embodiment, the electronic device may use a feature point to generate an electrocardiogram data template. This will be described in detail in FIGS. 4 to 5.

In operation 205, the electronic device may verify whether the electronic device is a user according to the similarity between the ECG data template and the reference ECG data template. The reference electrocardiogram template refers to an electrocardiogram template that is a reference stored in a memory or a user account linked to the electronic device.

In another embodiment, the electronic device may determine a similarity between the generated ECG data template and the reference ECG data template using the R-square calculation method.

In another embodiment, the electronic device may continuously update the reference ECG template by measuring and authenticating the ECG template. This is to increase the accuracy of user verification. This will be described in detail in FIG. 6.

In operation 206, when verification is completed, the electronic device may execute a function or application according to a trigger event. For example, when a trigger event is a payment function execution, when a user is authenticated using electrocardiogram data, the electronic device may transmit a token including card information and the like to execute the payment function. The token may be transmitted directly from the electronic device or may be received and transmitted from an external electronic device paired with the electronic device. That is, payment can be performed without separate iris recognition for payment or input of a pin number.

Alternatively, the trigger event may be the execution of an application that handles sensitive data such as female health data. The female health data is data including sensitive information such as a woman's menstrual cycle and ovulation date.

3 is an exemplary diagram for verifying a user using electrocardiogram data of an electronic device according to an exemplary embodiment. 3 illustrates a front surface 304 and a rear surface 305 of a smart watch as an example of an electronic device.

In another embodiment, the smart watch may include two first electrodes 301, a second electrode 302 on the back side 305 of the watch and one third electrode 303 on a side surface to measure an electrocardiogram. Each of the first electrode and the third electrode serves to collect biosignals from different hands, and the second electrode may be used for reduction of in-phase component noise and biobias. In order to measure the electrocardiogram, a living body must be in contact with all three

electrodes

301, 302, and 303.

In another embodiment, the first electrode 301 (INP) and the second electrode 302 (RLD) are in contact with the skin portion of the wrist, and the third electrode 303 (INN) may be in contact with the fingers of the other hand. .

3 is an exemplary diagram of an electronic device and is not a limiting diagram. That is, the first electrode INP, the second electrode RLD, and the third electrode INN are not limited to the positions shown in FIG. 3, and the loop structure is formed by contacting the body of the user wearing the electronic device. If it can be created, it can be located anywhere.

For example, at least one of the plurality of electrodes may be positioned in the form of a transparent electrode on the display of the electronic device. As another example, at least one of the plurality of electrodes may be located on a hardware bezel of an electronic device.

The wear detection of the watch can use the output value of the DC voltage applied to the electrode by using the comparison circuit built into the AFE. For example, the RLD structure of an ECG AFE and a comparator connected to each electrode can be used. The inverting input of the RLD amp is an average of the first electrode 301 and the third electrode 303, and the noninverting input is Vcm (for example, 0.9V). If the average is greater than 0.9, the RLD amp outputs 0, and if it is small, the maximum value (for example, 1.8V) is output. Wear detection consists of the following three steps. (1) When the body is not in contact with all the electrodes (301, 302, 303) of the smart watch, (2) When worn on the wrist and no fingers are in contact, (3) When worn on the wrist, touches the finger This is when I did. (1) When all the electrodes are not in contact, 0V is applied to each electrode because the current circuit structure uses a 200 Mohm resistance right behind the electrode. (2) When worn only on the wrist, only the second electrode 302 and the first electrode 301 contact the skin. Accordingly, 0V is applied to the third electrode 303, but no matter what voltage is applied to the first electrode 301, the RLD amp outputs a maximum value because it is smaller than (RLD/2). A high DC voltage is applied to the first electrode 301 due to the high input impedance of the first electrode 301. (3) If the finger is also in contact, the RLD amp is output so that the average of the two electrodes becomes 0.9 V, and in this case, a voltage of 0.5 to 1.4 V is applied to the two electrodes. These applied voltages can activate different combinations of comparators. In the case of (1), different result values of 0101 for (INP_high, INP_low, INN_high, INN_low), 1001 for (2), and 0000 for (3) can be obtained. I can.

4 is a flowchart 400 of a method of generating an electrocardiogram data template of an electronic device according to an exemplary embodiment. According to an embodiment, in the process illustrated in FIG. 4, the processor (eg, the processor 820 of FIG. 8) of the electronic device (eg, the electronic device 801 of FIG. 8) is a memory (eg, the memory (eg, the memory (eg, the electronic device 801 of FIG. 8 )) 830)).

In operation 401, the electronic device may measure ECG data for 10 seconds. Although it is described as 10 seconds in FIG. 4, this is only an example and can be changed as much as possible. However, the electronic device may measure ECG data for a certain period of time to obtain stable data. The electronic device may measure an electrocardiogram using the three electrodes illustrated in FIG. 3.

In operation 402, the electronic device may determine whether the measured ECG data is valid. This is to first verify whether the measured ECG data is sufficient to generate an ECG data template. For example, the electronic device uses (1) the signal energy of the electrocardiogram data (2) the degree of fluctuation of the baseline of the electrocardiogram data, (3) whether the signal has a regular shape, etc. to determine whether the ECG data is valid. Can judge whether

If it is determined that the data is invalid, in operation 406, a remeasurement request message may be output. If it is determined that the data is valid, in operation 403, the electronic device may extract a feature point of the electrocardiogram data. In this case, the electronic device may determine the feature point based on a size of an electrocardiogram value included in the electrocardiogram data and a width of an electrocardiogram waveform. For example, the feature point may be an R-peak value having the largest size of an electrocardiogram and a short width.

In operation 404, the electronic device may acquire a plurality of ECG waveforms based on the feature point. For example, the electronic device may acquire (segmentation) a plurality of single ECG data having a predetermined length based on the feature point (eg, R-peak value).

In operation 405, the electronic device may generate an electrocardiogram data template. For example, the ECG data template may be generated by using an average value of the plurality of ECG waveforms. Through this, an electrocardiogram data template with less noise can be obtained. It will be described in detail with reference to FIG. 5.

The electronic device may detect an R-peak point having a largest size and a short width of the measured ECG data as the feature points 501, 502, 503, and 504. The electronic device may divide a plurality of

sections

505, 506, 507, and 508 with a predetermined length so as to include one feature point in one section based on the detected feature points 501, 502, 503, and 504.

The electronic device may acquire a plurality of

ECG data

505, 506, 507, and 508 using the divided sections. In this case, the electronic device may calculate an average value of the plurality of

electrocardiogram waveforms

505, 506, 507, and 508 based on the feature point, and generate the electrocardiogram data template 509 using the calculated average value.

The electronic device may verify the user by using the generated ECG data template. This will be described in detail with reference to FIG. 6.

6 is another flowchart of a method of verifying a user using electrocardiogram data of an electronic device, according to an exemplary embodiment. According to an embodiment, in the process illustrated in FIG. 6, the processor (eg, the processor 820 of FIG. 8) of the electronic device (eg, the electronic device 801 of FIG. 8) is a memory (eg, the memory (eg, the memory (eg, the electronic device 801 of FIG. 8 )) 830)).

In operation 601, the electronic device may obtain an electrocardiogram data template. In another embodiment, as described with reference to FIG. 5, the electronic device may obtain an electrocardiogram data template by using an average value of a plurality of electrocardiogram waveforms.

In operation 602, the electronic device may determine whether the similarity between the ECG data template and the reference ECG data template is greater than or equal to the maximum threshold value. The reference electrocardiogram template refers to an electrocardiogram template that is a reference stored in a memory or a user account linked to the electronic device. In this case, if there is no reference ECG data template, operation 604 may be performed.

In another embodiment, the electronic device may calculate a reliability as well as a similarity between the ECG data template and the reference ECG data.

In operation 602, if the similarity between the electrocardiogram data template and the reference electrocardiogram data template is greater than or equal to the maximum threshold, in operation 606, the electronic device may confirm user verification and terminate the flow chart 600.

Conversely, if the similarity between the ECG data template and the reference ECG data template is less than or equal to the maximum threshold, in operation 603, it may be determined whether the similarity between the ECG data template and the reference ECG data template is greater than or equal to the minimum threshold. If the similarity is less than or equal to the minimum threshold, in operation 607, user verification fails, and the flow chart 600 may be terminated. When the electronic device has a similarity between the ECG data template and the reference ECG data template less than or equal to the minimum threshold, it is considered that the probability of being the same person is considerably low, and thus the flow chart can be terminated.

In operation 603, if the degree of similarity is greater than or equal to the minimum threshold, in operation 604, the electronic device may output a message confirming whether the person is the same person.

In another embodiment, the electronic device may output the similarity and reliability calculated in operation 602 together. Even with the same person, different ECG data templates may be generated according to the environment or posture at the time of measurement, and in this case, this is to prevent an error in which user verification fails even with the same person.

In operation 605, when an input indicating the same person is received, in operation 6065, the electronic device may reflect the electrocardiogram data template to the reference electrocardiogram data template. In another embodiment, the electronic device may also receive an input on a posture or environment at the time of measurement and reflect the information on the same.

In operation 608, the electronic device may confirm user verification and terminate the flow chart 600. Conversely, if an input of the same person is not received in operation 605, the electronic device may confirm the user verification failure in operation 607 and terminate the flow chart 600.

7 is another flowchart 700 of a method of verifying a user using electrocardiogram data of an electronic device according to an exemplary embodiment. According to an embodiment, in the process illustrated in FIG. 7, the processor (eg, the processor 820 of FIG. 8) of the electronic device (eg, the electronic device 801 of FIG. 8) is a memory (eg, the memory (eg, the memory (eg, the electronic device 801 of FIG. 8 )) 830)).

In operation 701, the electronic device may check the user account having the reference ECG data template having the greatest similarity value to the ECG data template. For example, it is assumed that user accounts of A, B, and C using the electronic device exist. The electronic device may check a user account in which the acquired ECG data template has the largest similarity value among reference ECG data templates of A, B, and C.

In another embodiment, the electronic device may calculate the similarity by using R-square. For example, the R-square of the reference ECG data template of A and the generated ECG data template is calculated as High (0.99), and the R-square of the reference ECG data template of B and the generated ECG data template is Low (0.01). If calculated as, it can be determined as A of the ECG data template. In this case, when a plurality of reference ECG data templates are stored in the user A's account, R-squares are calculated for each of the reference ECG data templates, and then the highest value may be used as the similarity of the user A.

In operation 702, the electronic device may receive an input whether the user of the verified user account is correct. In this case, the electronic device may display a message requesting an input on the display. When an input indicating that the user of the verified user account is correct is received, operation 704 is performed.

Conversely, when an input indicating that the user is not a user of the verified user account is received or an input is not received, an input corresponding to a user of another user account may be received in operation 703. In this case, other user accounts may be sequentially displayed on the display for input reception in the order of similarity according to the calculated similarity. Alternatively, the remaining user schedule may be displayed on the display at once and an input for a corresponding user account may be received. When an input is received, in operation 704, the electronic device reflects the ECG data template to the reference ECG data template of the corresponding account. Through this operation, the reliability of the reference ECG data template of the electronic device may increase.

In operation 705, the electronic device may determine user verification confirmation.

Conversely, in operation 703, when an input corresponding to a user of another user account is not received, in operation 706, it may be determined whether to register an additional user account. When an additional user account is registered, operation 704 is performed.

Conversely, if the additional user account is not registered, in operation 707, the electronic device may determine that the user verification has failed.

This action allows multiple users to perform verification within a small group such as a family. In other words, in addition to personal authentication, it is possible to distinguish each user between registered user accounts using the ECG data template, and automatically accumulate the reference ECG data template of the account by checking the user account with the greatest similarity without separate user input. There is an effect.

8 is a block diagram of an electronic device 801 in a network environment 800 according to various embodiments. Referring to FIG. 8, in a network environment 800, the electronic device 801 communicates with the electronic device 802 through a first network 898 (for example, a short-range wireless communication network), or a second network 899 It is possible to communicate with the electronic device 804 or the server 808 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 801 may communicate with the electronic device 804 through the server 808. According to an embodiment, the electronic device 801 includes a processor 820, a memory 830, an input device 850, an audio output device 855, a display device 860, an audio module 870, and a sensor module ( 876), interface 877, haptic module 879, camera module 880, power management module 888, battery 889, communication module 890, subscriber identification module 896, or antenna module 897 ) Can be included. In some embodiments, at least one of these components (for example, the display device 860 or the camera module 880) may be omitted or one or more other components may be added to the electronic device 801. In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 876 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 860 (eg, a display).

The processor 820, for example, executes software (eg, a program 840) to perform at least one other component (eg, a hardware or software component) of the electronic device 801 connected to the processor 820. It can be controlled and can perform various data processing or operations. According to an embodiment, as at least a part of data processing or operation, the processor 820 stores commands or data received from other components (for example, the sensor module 876 or the communication module 890) to the volatile memory 832. The command or data stored in the volatile memory 832 may be processed, and result data may be stored in the nonvolatile memory 834. According to an embodiment, the processor 820 includes a main processor 821 (eg, a central processing unit or an application processor), and a secondary processor 823 (eg, a graphic processing unit, an image signal processor) that can be operated independently or together with the main processor 821 (eg, a central processing unit or an application processor). , A sensor hub processor, or a communication processor). Additionally or alternatively, the coprocessor 823 may be configured to use lower power than the main processor 821, or to be specialized for a designated function. The secondary processor 823 may be implemented separately from the main processor 821 or as a part thereof.

The secondary processor 823 is, for example, on behalf of the main processor 821 while the main processor 821 is in an inactive (eg, sleep) state, or the main processor 821 is active (eg, application execution). ), together with the main processor 821, at least one of the components of the electronic device 801 (for example, the display device 860, the sensor module 876, or the communication module 890) It is possible to control at least some of the functions or states associated with it. According to an embodiment, the coprocessor 823 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, a camera module 880 or a communication module 890). have.

The memory 830 may store various data used by at least one component of the electronic device 801 (for example, the processor 820 or the sensor module 876). The data may include, for example, software (eg, the program 840) and input data or output data for commands related thereto. The memory 830 may include a volatile memory 832 or a nonvolatile memory 834.

The program 840 may be stored as software in the memory 830, and may include, for example, an operating system 842, middleware 844, or an application 846.

The input device 850 may receive a command or data to be used for a component of the electronic device 801 (eg, the processor 820) from outside (eg, a user) of the electronic device 801. The input device 850 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 855 may output an sound signal to the outside of the electronic device 801. The sound output device 855 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

The display device 860 may visually provide information to the outside of the electronic device 801 (eg, a user). The display device 860 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display device 860 may include a touch circuitry set to sense a touch, or a sensor circuit (eg, a pressure sensor) set to measure the strength of a force generated by the touch. have.

The audio module 870 may convert sound into an electrical signal, or conversely, may convert an electrical signal into sound. According to an embodiment, the audio module 870 acquires sound through the input device 850, the sound output device 855, or an external electronic device directly or wirelessly connected to the electronic device 801 (for example, Sound may be output through the electronic device 802 (for example, a speaker or headphones).

The sensor module 876 detects an operating state (eg, power or temperature) of the electronic device 801 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to an embodiment, the sensor module 876 includes, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 877 may support one or more designated protocols that may be used to connect the electronic device 801 to an external electronic device (eg, electronic device 802) directly or wirelessly. According to an embodiment, the interface 877 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 878 may include a connector through which the electronic device 801 can be physically connected to an external electronic device (eg, the electronic device 802). According to an embodiment, the connection terminal 878 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 879 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that a user can perceive through tactile or motor sensations. According to an embodiment, the haptic module 879 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 880 may capture a still image and a video. According to an embodiment, the camera module 880 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 888 may manage power supplied to the electronic device 801. According to an embodiment, the power management module 888 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 889 may supply power to at least one component of the electronic device 801. According to one embodiment, the battery 889 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 890 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 801 and an external electronic device (eg, electronic device 802, electronic device 804, or server 808). It is possible to support establishment and communication through the established communication channel. The communication module 890 operates independently of the processor 820 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 890 is a wireless communication module 892 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 894 (eg : A local area network (LAN) communication module, or a power line communication module) may be included. Among these communication modules, a corresponding communication module is a first network 898 (for example, a short-range communication network such as Bluetooth, WiFi direct or IrDA (infrared data association)) or a second network 899 (for example, a cellular network, the Internet, or It may communicate with the external electronic device 804 through a computer network (for example, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into a single component (eg, a single chip), or may be implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 892 uses subscriber information stored in the subscriber identification module 896 (eg, International Mobile Subscriber Identifier (IMSI)) within a communication network such as the first network 898 or the second network 899. The electronic device 801 may be checked and authenticated.

The antenna module 897 may transmit a signal or power to the outside (eg, an external electronic device) or receive from the outside. According to an embodiment, the antenna module 897 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 897 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 898 or the second network 899 is, for example, provided by the communication module 890 from the plurality of antennas. Can be chosen. The signal or power may be transmitted or received between the communication module 890 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as part of the antenna module 897.

At least some of the components are connected to each other through a communication method (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI))) between peripheral devices and a signal ( E.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 801 and the external electronic device 804 through the server 808 connected to the second network 899. Each of the external electronic devices 802 and 104 may be a device of the same or different type as the electronic device 801. According to an embodiment, all or part of the operations executed by the electronic device 801 may be executed by one or more of the external electronic devices 802, 104, or 108. For example, when the electronic device 801 needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device 801 does not execute the function or service by itself. In addition or in addition, it is possible to request one or more external electronic devices to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 801. The electronic device 801 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, or client-server computing technology may be used.

9 is a block diagram 900 illustrating a program 840 according to various embodiments. According to an embodiment, the program 840 includes an operating system 842, middleware 844 for controlling one or more resources of the electronic device 801, or an application 846 executable in the operating system 842. Can include. The operating system 842 may include, for example, Android ^TM , iOS ^TM , Windows ^TM , Symbian ^TM , Tizen ^TM , or Bada ^TM . At least some of the programs 840 are, for example, preloaded on the electronic device 801 during manufacture, or when used by a user, an external electronic device (eg, electronic device 802 or 104), or a server ( 808)).

The operating system 842 may control management (eg, allocation or retrieval) of one or more system resources (eg, process, memory, or power) of the electronic device 801. The operating system 842 is, additionally or alternatively, other hardware devices of the electronic device 801, for example, the input device 850, the sound output device 855, the display device 860, the audio module 870 , Sensor module 876, interface 877, haptic module 879, camera module 880, power management module 888, battery 889, communication module 890, subscriber identification module 896, or One or more driver programs for driving the antenna module 897 may be included.

The middleware 844 may provide various functions to the application 846 so that functions or information provided from one or more resources of the electronic device 801 can be used by the application 846. The middleware 844 is, for example, an application manager 901, a window manager 903, a multimedia manager 905, a resource manager 907, a power manager 909, a database manager 911, and a package manager 913. ), a connectivity manager 915, a notification manager 917, a location manager 919, a graphic manager 921, a security manager 923, a call manager 925, or a voice recognition manager 927. I can.

The application manager 901 may manage, for example, the life cycle of the application 846. The window manager 903 may manage one or more GUI resources used on a screen, for example. The multimedia manager 905, for example, identifies one or more formats required for playback of media files, and performs encoding or decoding of a corresponding media file among the media files by using a codec suitable for the selected corresponding format. You can do it. The resource manager 907 may manage the source code of the application 846 or a memory space of the memory 830, for example. The power manager 909 manages, for example, capacity, temperature, or power of the battery 889, and may determine or provide related information necessary for the operation of the electronic device 801 using the corresponding information. . According to an embodiment, the power manager 909 may interwork with a basic input/output system (BIOS) (not shown) of the electronic device 801.

The database manager 911 may create, search, or change a database to be used by the application 846, for example. The package manager 913 may manage installation or update of an application distributed in the form of, for example, a package file. The connectivity manager 915 may manage, for example, a wireless connection or a direct connection between the electronic device 801 and an external electronic device. The notification manager 917 may provide a function for notifying the user of the occurrence of a designated event (eg, incoming call, message, or alarm), for example. The location manager 919 may manage location information of the electronic device 801, for example. The graphic manager 921 may manage, for example, one or more graphic effects to be provided to a user or a user interface related thereto.

The security manager 923 may provide, for example, system security or user authentication. The telephony manager 925 may manage, for example, a voice call function or a video call function provided by the electronic device 801. The voice recognition manager 927 transmits, for example, a user's voice data to the server 808, and a command corresponding to a function to be performed in the electronic device 801 based at least in part on the voice data, Alternatively, text data converted based at least in part on the voice data may be received from the server 808. According to an embodiment, the middleware 944 may dynamically delete some of the existing components or add new components. According to an embodiment, at least a portion of the middleware 844 may be included as a part of the operating system 842 or implemented as separate software different from the operating system 842.

The application 846 is, for example, a home 951, a dialer 953, an SMS/MMS 955, an instant message (IM) 957, a browser 959, a camera 961, and an alarm 963. , Contact (965), voice recognition (967), email (969), calendar (971), media player (973), album (975), watch (977), health (979) (e.g. Biometric information measurement), or environmental information 981 (eg, air pressure, humidity, or temperature information measurement) application may be included. According to an embodiment, the application 846 may further include an information exchange application (not shown) capable of supporting information exchange between the electronic device 801 and an external electronic device. The information exchange application may include, for example, a notification relay application configured to deliver specified information (eg, a call, a message, or an alarm) to an external electronic device, or a device management application configured to manage an external electronic device. have. The notification relay application transmits notification information corresponding to a specified event (eg, mail reception) generated by another application (eg, email application 969) of the electronic device 801 to an external electronic device. I can. Additionally or alternatively, the notification relay application may receive notification information from an external electronic device and provide it to a user of the electronic device 801.

The device management application is, for example, an external electronic device that communicates with the electronic device 801 or some components thereof (for example, the display device 860 or the camera module 880). -Off) or a function (eg, brightness, resolution, or focus of the display device 860 or the camera module 880). The device management application may additionally or alternatively support installation, deletion, or update of an application operating in an external electronic device.

An electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

Various embodiments of the present document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutes of the corresponding embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items unless clearly indicated otherwise in a related context. In this document, “A or B”, “at least one of A and B”, “at least one of A or B,” “A, B or C,” “at least one of A, B and C,” and “A Each of the phrases such as "at least one of, B, or C" may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the component from other Order) is not limited. Some (eg, first) component is referred to as “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When mentioned, it means that any of the above components may be connected to the other components directly (eg by wire), wirelessly, or via a third component.

The term "module" used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 836 or external memory 838) that can be read by a machine (eg, electronic device 801). It may be implemented as software (eg, a program 840) including them. For example, the processor (eg, the processor 820) of the device (eg, the electronic device 801) may call and execute at least one command among one or more commands stored from a storage medium. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here,'non-transient' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves). It does not distinguish between temporary storage cases.

According to an embodiment, a method according to various embodiments disclosed in the present document may be provided by being included in a computer program product. Computer program products can be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store™) or two user devices (e.g., compact disc read only memory (CD-ROM)). It can be distributed (e.g., downloaded or uploaded) directly between, e.g. smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a storage medium that can be read by a device such as a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular number or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be sequentially, parallel, repeatedly, or heuristically executed, or one or more of the operations may be executed in a different order or omitted. Or one or more other actions may be added.

Claims

In the electronic device,

A sensor including at least one optical sensor or a biometric sensor;

An electrocardiogram sensor for detecting user's electrocardiogram information;

display;

A processor operatively connected to the sensor, the electrocardiogram sensor, and the display; And

Including; a memory operatively connected to the processor,

The memory, when executed, the processor,

Based on an authentication method using user identification information, the user of the electronic device is authenticated,

After the user is authenticated, using the sensor to determine whether to maintain the wearing state of the electronic device,

In a state in which the wearing state of the electronic device is maintained, when a trigger event for executing a function or application of the electronic device requesting verification of the user occurs, the ECG of the user is measured using the ECG sensor,

Create an electrocardiogram data template using the measured electrocardiogram data, and verify whether the user is the authenticated user according to a similarity between the generated electrocardiogram data template and a reference electrocardiogram data template stored in the memory,

When the verification is complete, the electronic device stores instructions for executing the function or application.
The method according to claim 1,

The instructions, the processor,

An electronic device configured to extract a feature point of the electrocardiogram data and generate the electrocardiogram data template based on the feature point.
The method according to claim 2,

The instructions, the processor,

The electronic device configured to extract the feature point based on a size of an electrocardiogram value included in the electrocardiogram data and a width of an electrocardiogram waveform.
The method according to claim 1,

The instructions, the processor,

Acquiring a plurality of electrocardiogram waveforms from the electrocardiogram data,

An electronic device configured to generate the electrocardiogram data template by using an average value of the plurality of electrocardiogram waveforms.
The method according to claim 1,

Further comprising a button for generating the trigger event,

The electronic device, wherein the electrocardiogram sensor is disposed inside the button.
The method according to claim 1,

The instructions, the processor,

Determine whether the ECG data is valid,

When the ECG data is valid, the ECG data template is generated, and when the ECG data is not valid, a message requesting remeasurement is output.
The method according to claim 1,

The instructions, the processor,

If the similarity between the generated electrocardiogram data template and the pre-registered electrocardiogram data template is a value between the maximum threshold and the minimum threshold, it is determined whether the user of the generated electrocardiogram data template is the same person as the user of the pre-registered electrocardiogram data template. The electronic device that makes the judgment.
The method of claim 7,

The instructions, the processor,

If the user of the created ECG data template is not the same person as the user of the previously registered ECG data template, a template having the greatest similarity value with the created ECG data template is found, and the user of the template having the largest similarity value An electronic device capable of displaying a notification confirming that the same person is correct.
The method according to claim 1,

The function or the application is a payment-related function or program,

The instructions, the processor,

An electronic device that transmits a token to an external device when verified as the user.
The method according to claim 1,

The instructions, the processor,

Identifying a plurality of user accounts linked to the electronic device, and verifying whether the user is the same person for each of the plurality of user accounts using the generated ECG data template and the ECG data template stored in association with each of the plurality of user accounts and,

The electronic device configured to store the generated electrocardiogram data template in association with the user account when it is verified that the user is the same person as the user of the user account included in the plurality of user accounts.
In the method of performing the electronic device,

Authenticating a user of the electronic device based on an authentication method using user identification information;

After the user is authenticated, determining whether to maintain the wearing state of the electronic device using a sensor;

Measuring an electrocardiogram of the user using an electrocardiogram sensor when a trigger event for executing a function or application requesting verification of the user occurs while the electronic device is worn;

Generating an electrocardiogram data template using the measured electrocardiogram data, and verifying whether the user is the authenticated user according to a similarity between the generated electrocardiogram data template and a reference electrocardiogram data template stored in a memory; And

And when the verification is complete, executing the function or application.
The method of claim 11,

The method further comprising extracting a feature point of the electrocardiogram data and generating the electrocardiogram data template based on the feature point.
The method of claim 12,

The method further comprising extracting the feature point based on a size of an electrocardiogram value included in the electrocardiogram data and a width of an electrocardiogram waveform.
The method of claim 11,

Obtaining a plurality of electrocardiogram waveforms from the electrocardiogram data, and generating the electrocardiogram data template by using an average value of the plurality of electrocardiogram waveforms.
The method of claim 11,

Determining whether the ECG data is valid, generating the ECG data template when the ECG data is valid, and outputting a message requesting remeasurement when the ECG data is not valid.