KR20230068639A - Electronic device and method for estimating bio-information using the same - Google Patents

Abstract

An embodiment of the present invention discloses a method of estimating bio-information in an electronic device. The electronic device of one embodiment the present invention includes: a sensor module disposed on a first side of a main body; a display device disposed on a second side of the main body; and a processor configured to: perform calibration of the sensor module through a reference object of a charger, when the main body being placed on the charger and in charging state; guide estimation of the bio-information through a display device, depending on a progress stage after charging; and estimate bio-information based on the amount of light and calibration results measured at a first part of a subject through the sensor module.

Description

Electronic device and biometric information estimation method of the electronic device {ELECTRONIC DEVICE AND METHOD FOR ESTIMATING BIO-INFORMATION USING THE SAME}

As a technology for estimating biometric information in an electronic device, more specifically, it is related to a technology for non-invasively estimating antioxidant levels.

Active oxygen is important as a biological protection factor such as a sterilizing action of white blood cells, but excessive production of active oxygen in a living body is known to cause various tissue diseases. Common factors that generate active oxygen include stress, alcohol, peroxides, drugs, etc., and active oxygen generated by these factors can cause diseases of the cranial nerve, circulatory system, cancer, digestive tract disease, liver disease, arteriosclerosis, kidney disease, and diabetes. and aging. Living organisms have a series of oxidative protection systems to protect themselves from oxygen toxicity. In order for these systems to function normally, it is important to consume enough antioxidants. Antioxidants include vitamin E, vitamin C, carotenoids, flavonoids, and the like, and for antioxidant action, foods containing these antioxidants should be consumed as much as possible, thereby easily reducing the amount of antioxidants in the body. The need for a device that can be checked is emerging.

An electronic device that performs sensor calibration during charging and provides a measurement guide when measuring biometric information and a method for estimating biometric information in the electronic device are provided.

According to one aspect, the electronic device includes a body, a sensor module disposed on a first surface of the body, a display device disposed on a second surface of the body, and a standard object of the charger when the body is placed in a charger and is in a charging state. Performs calibration of the sensor module, guides biometric information estimation through a display device according to the progress stage after charging, and obtains biometric information based on the amount of light measured at the first part of the subject through the sensor module and the calibration result It may include a processor for estimating.

The sensor module includes a light source for radiating light to the standard object while charging is in progress, and a detector for detecting light reflected from the standard object, and the processor provides calibration information including a reference amount of light of the standard object detected through the detector can be stored in memory.

The processor may output a text message to the display device to induce the user to estimate biometric information when charging is completed or when the main body is separated from the charger.

The processor may determine a recommended estimation time point based on a user pattern, and output a text message to the display device to induce the user to estimate biometric information when the estimated recommended time point is reached.

When the first region contacts the sensor module, the processor may determine the contact position and guide the contact position based on the determination result.

The processor may include a graphic object indicating the contact position of the first part, a graphic object indicating a predefined measurement position, a graphic object inducing movement from the contact position to the measurement position, and a graphic object indicating that the contact position coincides with the measurement position. At least one of them may be output to the display device.

In the sensor module, a light source is disposed at the center, and a plurality of detectors are disposed in a predetermined shape around the light source, and the processor determines the contact position of the first part based on the absorbance measured by each of the plurality of detectors. .

When the first portion contacts the measurement position of the sensor module, the processor may output a graphic object representing contact pressure to the display device.

The processor may output a pressure gauge to an area other than the contact area of the second part when the second part of the test subject contacts and presses the display device while the first part is in contact with the sensor module.

The processor may change the color of the graphic object representing the contact pressure according to the progress stage in which the bio-signal is measured.

The processor may output a text message indicating a corresponding measurement step according to the progress step in which the biosignal is measured.

When the biometric information estimation is completed, the processor may output the estimation result to the display device.

The processor calculates absorbance for each wavelength based on the amount of light measured from the first portion and the reference amount of light measured during calibration, obtains a feature value based on the calculated absorbance for each wavelength, and obtains biometric information based on the obtained feature value. can be estimated.

The processor may obtain an antioxidant peak by combining the calculated absorbance for each wavelength and correcting the baseline of the waveform, and obtain an antioxidant value based on the obtained antioxidant peak using a predefined antioxidant estimation model.

According to one aspect, a method for estimating biometric information of an electronic device includes determining whether a main body is mounted on a charger and is in a charged state, and if the main body is in a charged state, calibration of a sensor module disposed on a first surface of the main body through a standard object of the charger performing, guiding biometric information estimation through a display device disposed on the second surface of the main body according to the progress after charging, measuring the amount of light at a first part of the subject through a sensor module, It may include estimating biometric information based on the measured amount of light and the calibration result.

Calibration may include irradiating light to the standard object by driving a light source of the sensor module while charging is in progress, detecting light reflected from the standard object through a detector of the sensor module, and detecting light reflected from the standard object. A step of storing calibration information including a reference amount of light of the standard object in a memory may be included.

In addition, the method of estimating biometric information may further include outputting a text message to the display device to induce a user to estimate biometric information when charging is completed or when the main body is separated from the charger.

At this time, in the guiding step, when the first part contacts the sensor module, the contact position may be determined, and the contact position may be guided based on the determination result.

At this time, in the guiding step, when the first portion contacts the measurement position of the sensor module, a graphic object guiding the contact pressure may be output to the display device.

The step of estimating biometric information includes calculating absorbance for each wavelength based on the amount of light measured from the first region and the reference amount of light measured during calibration, obtaining a feature value based on the calculated absorbance for each wavelength, It may include estimating biometric information based on the obtained feature value.

Accuracy of biometric information estimation can be improved by calibrating the sensor during charging and providing a measurement guide when measuring biometric information.

1 is a block diagram of an electronic device according to an exemplary embodiment.
2 is a block diagram of an electronic device according to another embodiment.
3 illustrates a smart watch-based electronic device according to an embodiment.
4 is a diagram for explaining calibration of a sensor module of an electronic device.
5 is a diagram for explaining an example of a guide for inducing biometric information estimation.
6A to 6D are diagrams for explaining an example of guiding a bio-signal measurement position.
7A to 7D are diagrams for explaining an example of guiding bio-signal measurement pressure.
8A to 8C are diagrams for explaining an example of outputting biometric information estimation results.
9 is a flowchart of a method for estimating biometric information according to an exemplary embodiment.

Details of other embodiments are included in the detailed description and drawings. The advantages and features of the described technology, and how to achieve them, will become clear with reference to the embodiments described below in detail in conjunction with the drawings. Like reference numbers designate like elements throughout the specification.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. Terms are only used to distinguish one component from another. Singular expressions include plural expressions unless the context clearly dictates otherwise. In addition, when a certain component is said to "include", this means that it may further include other components without excluding other components unless otherwise stated. In addition, terms such as “… unit” and “module” described in the specification mean a unit that processes at least one function or operation, and may be implemented as hardware or software or a combination of hardware and software.

Electronic devices according to various embodiments described below include, for example, a wearable device, a smart phone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, and a PMP ( portable multimedia player), an MP3 player, a medical device, and a camera. Wearable devices are accessories (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or headmounted-devices (HMDs)), integrated into textiles or clothing (e.g. electronic garments), or body-attached. shape (eg, skin pad or tattoo), or at least one of a bio implantable circuit, but is not limited thereto, and in addition, a television, a digital video disk (DVD) player, an audio system, a refrigerator, an air conditioner, and a vacuum cleaner. , home appliances such as ovens, microwave ovens, washing machines, air purifiers, set-top boxes, home automation control panels, security control panels, media boxes, game consoles, electronic dictionaries, electronic keys, camcorders, or electronic picture frames, or, for example, various Various medical devices such as portable medical measuring devices (blood glucose monitor, heart rate monitor, blood pressure monitor, or body temperature monitor), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), camera, or ultrasound machine, etc.) device may be included. However, it is not limited to the aforementioned devices.

1 is a block diagram of an electronic device according to an exemplary embodiment.

Referring to FIG. 1 , an electronic device 100 includes a sensor module 110 , an output device 120 and a processor 130 .

The sensor module 110 is disposed on a first surface (eg, a rear surface) of the main body of the electronic device 100 and may include a light source 111 and a detector 112 . The light source 111 may include a light emitting diode (LED), a laser diode, and a phosphor. One or more light sources may be formed, and each light source may emit light of different wavelengths (eg, red, green, blue, infrared wavelengths, etc.). For example, the measurement wavelength range may be 400 nm to 600 nm. The detector 112 may include a photodiode, a phototransistor, a complementary metal-oxide semiconductor (CMOS) image sensor, a charge-coupled device (CCD) image sensor, and the like, and may include a single detector or a plurality of detectors. Alternatively, it may be formed as a detector array. A plurality of detectors or detector arrays may be arranged in various shapes such as concentric circles, rectangles, and triangles around the light source 111 in a predetermined shape, for example, around the light source 111 .

The output device 120 may output data generated or processed by the electronic device 100 in a visual/non-visual manner. The output device 120 includes the display device 121 and may also include an audio output device, an audio module, and/or a haptic module that are not shown here.

The display device 121 may visually provide information to the outside of the electronic device 100 . The display device 121 may include a display, a hologram device, or a projector and a control circuit for controlling the device. The display device 121 may include a touch circuitry set to detect a touch and/or a sensor circuit (force sensor or pressure sensor) set to measure the intensity of force generated by the touch. In the following embodiments, the force sensor may mean a pressure sensor, and the force measured by the force sensor may also mean pressure. Conversely, the pressure sensor may mean a force sensor, and the pressure measured by the pressure sensor may also mean force.

The sound output device may output sound signals to the outside of the electronic device 100 . The sound output device may include a speaker and/or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback, and the receiver can be used to receive an incoming call. The receiver may be incorporated as a part of the speaker or implemented as an independent separate device.

The audio module may convert sound into an electrical signal or vice versa. The audio module may obtain sound through an input device or output sound through a speaker and/or headphones of another electronic device connected directly or wirelessly to the sound output device and/or the electronic device.

The haptic module may convert electrical signals into mechanical stimuli (vibration, movement, etc.) or electrical stimuli that a user can perceive through tactile or kinesthetic senses. The haptic module may include a motor, a piezoelectric element, and/or an electrical stimulation device.

The processor 130 is electrically or wirelessly connected to various components in the electronic device 100, such as the sensor module 110 and the output device 120, to control various components and to perform various data processing or calculations. .

For example, the processor 130 controls the sensor module 110 to estimate calibration and/or biometric information of the sensor module 110 using data on the amount of light received by the detector 112 of the sensor module 110. can In this case, the biometric information may be an antioxidant value including a carotenoid concentration accumulated in the skin. However, this is only an example and may include various information such as blood sugar, triglyceride, alcohol, lactate, pigment in the skin, and blood flow.

First, the processor 130 may perform calibration of the sensor module 110 using a standard object. In this case, the standard object may be a reflector that reflects light (eg, a 100% reflective mirror, a white reflector) or an object coated with a reflective material. The reflective material may be a diffuse reflection material having a reflectance of 1% to 99%, and may include, for example, barium sulfate (BaSo4) and Teflon (PTEF), but is not limited thereto.

For example, the standard object may be formed on one surface of the charger, that is, a surface facing or in contact with the first surface of the body when the body of the electronic device 100 is mounted on the charger. For example, when a user places the main body on a charger to charge the electronic device 100, the processor 130 may detect a charging state and perform calibration during charging. However, even in the charging state, calibration may not proceed if the calibration condition is not satisfied, such as when the preset calibration period is not reached or the remaining amount until fully charged is less than a threshold value (20%).

The processor 130 may drive the light source 111 of the sensor module 110 to radiate light toward the standard object of the charger, and store the reflected light amount of the standard object detected by the detector 112 as a reference light amount. This process may be repeated multiple times, and statistical values (eg, arithmetic average value, weighted average value, median value, mode value, minimum value, maximum value, etc.) In addition, when the amount of light is detected by the plurality of detectors 112 for each light source 111, statistical values (eg, arithmetic mean value, weighted average value, median value, mode value, minimum value, maximum value, etc.) of the light quantities of each detector 112 are calculated. It can be obtained with the standard light amount of the corresponding light source.

As another example, the standard object may be a user reflector that the user can conveniently use, such as white paper or a cradle that does not include a charging function, and the processor 130 may perform calibration using the user reflector according to the user's request. there is. At this time, since the reflectance may vary depending on the type of user reflector, in order to correct this, the first calibration is performed using a standard object formed in the charger at a preset period or at the user's request at the first time of using the user reflector, Then, the second calibration may be performed through the user reflector, and the second calibration may be corrected based on the first calibration result.

Then, the processor 130 determines the measurement state of the electronic device 100 and provides appropriate guide information to the user through the output device 120 disposed on the second surface of the main body step by step, Biometric information may be estimated using the measured light intensity and the calibration result detected from one part (eg, the index finger).

For example, if the processor 130 is in a state prior to estimating biometric information, the processor 130 may output visual information for inducing the user to estimate biometric information at a predefined recommendation time point for estimation. For example, when the electronic device 100 is mounted on a charger and calibration is performed during charging, an estimation recommendation text message is displayed when charging is completed or when the user removes the electronic device 100 from the charger to use the device ( 121) can be output. In this case, an estimation recommendation alarm may be additionally output in a method such as a voice signal, vibration, or tactile feeling by using a voice output device, a haptic device, or the like of the output device 120 .

Alternatively, the processor 130 analyzes a user pattern such as a preset user preference measurement time point, a case in which biometric information changes before the measurement time point, or a change in lifestyle such as drinking or exercising to determine an estimation recommendation time point, and estimate the recommended time point. When it is determined that the recommended time is reached, a text message for inducing biometric information estimation to the user may be output to the display device 121 .

Next, when the user contacts the sensor module 110 with the first part to estimate biometric information, the processor 130 may display appropriate guide information through the display device 121 for each estimation step.

First, the contact position of the first part of the object to be examined with the sensor module 110 may be determined, and the measurement position of the sensor module 110 may be guided through the display device 121 . At this time, when the light source 111 of the sensor module 110 is disposed in the center and a plurality of detectors 112 are disposed on the periphery, each detector 112 is individually based on the amount of light received by each detector 112. The absorbance may be calculated, and the contact position of the subject may be determined based on the absorbance.

For example, if the contact position of the first part does not match the measurement position, the processor 130 may include a graphic object representing the contact position, a graphic object representing the measurement position, and/or a graphic inducing movement from the contact position to the measurement position. An object or the like may be output to the display device 121 . This process may be repeatedly performed, and finally, when the contact location coincides with the measurement location or comes within a predetermined threshold range (eg, the distance between the center of the contact fingerprint of the index finger and the center point of the measurement location is less than or equal to the threshold value), the contact location and A graphic object indicating that the measurement positions match may be output to the display device 121 .

As another example, if the first part does not completely cover all surfaces of the sensor module 110 according to the characteristics of the first part, instead of repeatedly guiding the measurement position as above, based on the absorbance measured by the detector 112 The next step may be performed to determine the detector 112 to which the first part is in contact, and to measure the biosignal using the detector 112 in contact with the detector 112 . At this time, if the contact area of the first part does not satisfy the preset number of detectors 112 or does not reach a predetermined range (eg, 70%) of the sensor module 110, the measurement position can be guided as described above. .

Then, when the first part comes into contact with the set measurement position according to the guide, the processor 130 may guide the measurement pressure through the display device 121 . For example, when the user contacts the display device 121 with the second part (eg, the thumb) of the test subject in a state where the first part is brought into contact with the measurement position of the sensor module 110 and presses the second part, the second part is contacted. A graphic object (eg, a pressure gauge) representing the pressurized pressure and/or the reference pressure may be displayed on an area outside the display device 121 that is not displayed.

In this case, the color or shape of the graphic object may be differently output according to the progress stage (eg, before measurement, during measurement, or after measurement) or the pressing state. In addition, during measurement, that is, the light source 111 of the sensor module 110 radiates light to the first portion, and the detector 112 detects scattered or reflected light from the first portion, which guides the measured pressure. A text message indicating that measurement is being performed may be output on a graphic object or at another location, and/or an alarm message notifying that measurement is being performed may be output as a voice signal through an audio output device. In addition, a graphic object or text message may be flickered during measurement or when the pressurized pressure is out of the critical range of the reference pressure.

Then, when the sensor module 110 completes the measurement, the processor 130 may calculate absorbance for each wavelength based on the ratio between the amount of measured light and the amount of reference light, and extract a characteristic value using the absorbance for each wavelength. . For example, a feature value may be obtained by combining the calculated absorbance for each wavelength and correcting the reference line of the waveform. Biometric information may be obtained by applying the obtained feature value to a predefined estimation model. Equations 1 to 3 below are examples of calculating absorbance for each wavelength and determining an antioxidant level using the same.

Here, A(λ) is the absorbance per wavelength, Im is the amount of light measured at the first part of the subject for a specific wavelength, and I ₀ is the amount of standard light obtained as a result of calibration for the specific wavelength.

Here, AO represents an antioxidant peak obtained by combining absorbance for each wavelength and correcting a baseline of a waveform as an example of a feature value. λ1, λ2, and λ3 represent wavelengths, and A _λ1 , A _λ2 , and A _λ3 represent absorbances for each wavelength obtained through Equation 1. It may have a relatively long wavelength in the order of λ1, λ2, and λ3.

Here, Y represents an antioxidant level, AO represents an antioxidant peak, and a and b represent preset values. However, Equation 3 illustrates an antioxidant value estimation model defined as a linear function formula, but is not limited thereto, and may be defined as a non-linear function formula such as a log function formula or an exponential function formula.

Then, the processor 130 may provide the biometric information estimation result to the user through the output device 120 . For example, information such as an estimated biometric information value, an estimated history graph, and recommendations according to an estimated biometric information value may be displayed through the display device 121, and alarm information may be displayed using an audio output device or a haptic device. can be printed out.

2 is a block diagram of an electronic device according to another embodiment.

Referring to FIG. 2 , the electronic device 200 may include a sensor module 110, an output device 120, a processor 130, a communication module 210, and a memory 220. Since the sensor module 110, the output device 120, and the processor 130 have been described above, a detailed description thereof will be omitted.

The communication module 210 establishes a direct (wired) communication channel and/or a wireless communication channel between the electronic device 200 and another electronic device or server or sensor module in the network environment, and performs communication through the established communication channel. can support The communication module 210 may operate independently of the processor 130 and may include one or more communication processors supporting direct communication and/or wireless communication. The communication module 210 may include, for example, a cellular communication module, a short-distance wireless communication module, a wireless communication module such as a global navigation satellite system (GNSS) communication module, and/or a local area network (LAN) communication module and a power line communication module. A wired communication module may be included. As such, various types of communication modules may be integrated into a single chip or implemented as a plurality of separate chips. The wireless communication module may identify and authenticate the electronic device 200 within the communication network using subscriber information (eg, International Mobile Subscriber Identity (IMSI), etc.) stored in the subscriber identification module.

For example, when the output device 120 outputs the biometric information estimation guide information, the communication module 210 transmits necessary data so that the biometric information estimation guide information is simultaneously output from an external device (eg, a smart phone or a desktop PC). When the processor 120 completes the biometric information estimation, the biometric information estimation result may be transmitted to an external device and outputted in various ways. In addition, various data related to the operation of the electronic device 200 (eg, estimation of biometric information) may be received from the external device.

The memory 220 may store driving conditions necessary for driving the sensor device and various data required by other components of the electronic device, such as input data and/or output data for software and commands related thereto. . For example, as a calibration result, various data such as a reference amount of light, a biometric information estimation value, a biometric information estimation model, and/or user characteristic information such as the user's age, gender, and health condition may be stored.

The memory 220 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (Random Access Memory: RAM) SRAM (Static Random Access Memory), ROM (Read-Only Memory: ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It includes storage media such as disks and optical disks, but is not limited thereto.

Hereinafter, various embodiments of visually guiding in the electronic devices 100 and 200 will be described with reference to FIGS. 3 to 8C.

3 illustrates a wearable device in the form of a smart watch as an embodiment of the aforementioned electronic devices 100 and 200 .

Referring to FIG. 3 , the wearable device 300 may include a body 310 and a strap 320 . The main body 310 forms the appearance of the wearable device 300, and as shown, the display device 121 is provided on the front, including time information, received message information, biometric information estimation guide information, biometric information estimation results, etc. A variety of information may be displayed. In addition, the sensor module 110 may be disposed on the rear surface of the main body 310 . Although not shown, a force sensor may be additionally disposed at the bottom of the sensor module 110 . The force sensor may measure force applied when a user presses the sensor module with a finger. The processor 130 mounted inside the main body 310 may calculate an antioxidant value based on the light signal measured by the detector 112 when the force measured by the force sensor is equal to or greater than the threshold. As another example, the force sensor may be disposed below the display device 121 . In this case, the force sensor may measure force applied when the user presses the display device 121 .

4 is a diagram for explaining calibration of a sensor module of an electronic device.

Referring to FIGS. 3 and 4 , the wearable device 300 in the form of a smart watch may be placed on a charger 400 and charged wirelessly or wired. A standard object 410 may be placed in the charger 400 . As shown, when the body 310 of the wearable device 300 is mounted on the charger 400, the standard object 410 contacts or faces the sensor module 110 disposed on the rear surface of the body 310. can be placed. The standard object may be coated with a reflector that reflects light (eg, a reflective mirror, a white reflector) or a reflective material, for example, a diffuse reflection material having a reflectance of 1% to 99%. and barium sulfate (BaSo4) and Teflon (PTEF).

When the main body 310 of the wearable device 300 is placed in the charger 400, the processor 130 detects the charging state and displays a status bar 421 indicating the charging level on the display device 121 as shown. can be printed out. In addition, the processor 130 may perform calibration of the sensor module in the charging state and simultaneously display a text message 422 on the display device 422 informing that calibration is in progress. For example, the light source (LED) of the sensor module 110 is driven to radiate light to the standard object, and the light reflected from the standard object 410 is detected through the detector (PD), and the detected light amount is the reference light amount (I0). ) can be stored in the memory 220.

5 is a diagram for explaining an example of a guide for inducing biometric information estimation.

The processor 130 may determine the biometric information measurement state and display information recommending biometric information estimation on the display device 121 before measuring the biometric information. For example, as shown, when charging is completed while the main body 310 is mounted on the charger 400, a text message 511 recommending estimation of biometric information such as, for example, "Should I measure the antioxidant level?" may be displayed on the display device 121. Alternatively, a message 511 recommending estimation of biometric information may be output when the user separates the main body 310 from the charger 400 to use the wearable device 300 or at a predetermined interval. Alternatively, when the user performs a sudden exercise while wearing the wearable device 300 on the wrist, health-related data such as antioxidant level, alcohol level, blood pressure, blood sugar, and triglyceride level for a predetermined period is out of predetermined standards As such, when a change in user pattern is detected, a text message recommending estimation of biometric information may be output.

6A to 6D are diagrams for explaining an example of guiding a bio-signal measurement position.

As shown in FIG. 6A , when the user contacts the sensor module 110 disposed on the rear surface of the body 310 with the index finger 611 to estimate biometric information, the index finger (611) through the display device 121 611) may visually guide the measurement location by determining whether or not the sensor module 110 has accurately contacted the measurement location. Through this, when the index finger contacts the rear surface of the main body 310, the contact state can be easily checked through the display device 121 on the front without the need to turn the watch over to check the contact position.

Referring to FIG. 6B , the processor 130 (1) displays a graphic object 612 indicating an actual contact position, for example, a display device so that the index finger of a hand indicates the contact position when the contact position does not match the measurement position ( 121) can be displayed. In addition, display device 121 displaying various graphic objects 613, such as circular figures, crosses, squares, etc., indicating the measurement position, and/or graphic objects 614 that induce movement of the contact position to the measurement position, for example, an arrow. ) can be displayed. This process may be repeated until the contact position matches the measurement position. In this case, if the distance from the center of the contact position to the center of the measurement position is equal to or less than a predetermined threshold value, it may be determined that the contact position coincides with each other. Also, (2) if the contact location coincides with the measurement location, a graphic object 615 indicating that the contact location matches the measurement location may be displayed.

The processor 130 determines whether the contact position of the finger is properly contacting the measurement position based on the amount of light measured by a plurality of detectors (a plurality of PDs in the embodiment of FIG. 6C) included in the sensor module 110. can As an embodiment, referring to FIG. 6C , the sensor module 110 may have a light source (LED) disposed in the center and a plurality of detectors (PD) disposed in a concentric circle shape on the periphery of the sensor module 110 . When the index finger contacts the sensor module 110, the processor 130 calculates the absorbance for each detector (PD) as shown in Equation 1 using the amount of light detected by each detector (PD), and calculates the absorbance Based on this, the contact position can be determined. For example, FIG. 6D shows the absorbance measured at each PD for each contact position. In A1, the finger mainly contacts the upper part of the sensor module 110 in FIG. 6C, and the amount of reflected light detected in PD2 and PD3 on the lower part where the finger does not contact is relatively small, so the absorbance is relatively higher than that of other detectors. show what Similarly, A2 mainly contacts the lower part of the sensor module 110 in FIG. 6C, showing that the absorbance measured at PD6 and PD7 located at the upper part is relatively larger than that of other detectors. A3 shows the absorbance measured in each detector in a relatively accurate contact state, and it can be seen that the absorbance measured in all detectors is relatively uniform.

When calculating the absorbance for each PD to determine whether the finger contact position matches the measurement position, the processor 130 may control the light source 111 to emit only one specific wavelength band. As another example, when calculating the absorbance for each PD to determine whether the finger contact position coincides with the measurement position, the processor 130 causes the light source 111 to sequentially irradiate light of a plurality of different wavelength bands (a light source ( 111) can also be controlled. In this case, absorbance may be calculated for each PD for each wavelength band.

As an embodiment, the processor 130 may determine that the user's finger contact position properly contacts the measurement position when all of the absorbances calculated for each PD are smaller than a threshold value. In this case, the threshold may be previously set to a value smaller than 0. If the light source 111 emits light of a plurality of different wavelength bands, the threshold value to be compared with the absorbance may be different for each used wavelength band. Of course, it is also possible to determine whether the finger contact position coincides with the measurement position using the same threshold regardless of the wavelength band irradiated from the light source 111 .

As another embodiment, the processor 130 may determine that the user's finger contact position properly contacts the measurement position when all of the light quantities measured by each PD, not the absorbance, are greater than a threshold value. In this case, the threshold may be previously set to a value greater than 0.

7A to 7D are diagrams for explaining an example of guiding bio-signal measurement pressure.

The user places the thumb and index finger on the front (display device 121 part) and the back (sensor module 110 part) of the main body 310 of the watch type wearable device, respectively, as in the embodiment of FIG. 7A, When force is applied, the force or pressure applied by the user may be measured through a force sensor or a pressure sensor disposed at the bottom of the display device 121 or the bottom of the sensor module 110 .

The processor 130 may guide the contact pressure through the display device 121 when the user matches the index finger to the measurement position of the sensor module 110 according to the guide. As shown in FIG. 7A , when the user contacts the display device 121 with the thumb 712 to apply pressure to the index finger 711 that is in contact with the sensor module 110, the thumb 712 contacts the display device 121. A graphic object 713 in the form of a pressure gauge may be displayed outside the area of the display device 121 . The pressure gauge may display a scale or bar indicating a reference pressure to be applied over time and/or a scale or bar indicating an actual contact pressure according to the pressure of the thumb 712, and may be distinguished by different colors. can

7B to 7D illustrate examples of guiding a pressure to be gradually increased over time.

Referring to FIG. 7B , when the thumb contacts the first region 121a of the display device 121, the processor 130 adjusts the pressing force according to the reference pressure over time, so that the outer region ( 121b), the pressure gauges 713a, 713b, and 713c may be displayed, and the bars/scales of the gauges may increase/decrease according to the increase/decrease of the reference pressure. At this time, the color/shape of the gauge may be displayed in the same color (eg, blue)/shape regardless of the increase/decrease of the reference pressure. Alternatively, as the reference pressure gradually increases/decreases, the light/dark color may gradually change from a light/dark color to a dark/light color or other color may be changed.

In addition, as shown in the second part of FIG. 7C, when the actual contact pressure (30%) is out of the normal range (eg, ±5% range) of the reference pressure (50%), the pressure gauge 713be is set to a different color ( Example: Red)/shape or blinking for a certain period of time to provide an alarm to the user. In this case, the larger the difference between the actual contact pressure and the reference pressure, the darker the color or the faster the flashing speed. At this time, it is also possible to simultaneously provide an alarm with voice through an audio output device.

Referring to FIG. 7D , the processor 130 changes the color (eg, blue)/shape of the pressure gauge 713 to a different color (eg, yellow) when the applied pressure of the thumb reaches the target measurement pressure according to the guide. / shape, and drive the sensor module 110 to measure the optical signal from the index finger contacting the sensor module 110. At this time, as shown, a text message 721 notifying that the measurement is being performed may be output on the pressure gauge 713, and at the same time, a voice guidance may be provided through an audio output device.

According to one embodiment, the processor 130 may guide whether the user is applying an appropriate level of force through the UI shown in FIG. 7D. In this case, the processor 130 may guide the user to apply more force through the text message 721 or inform the user that an appropriate level of force is currently applied. Alternatively, the processor 130 guides the user as to whether an appropriate level of force is currently applied or whether a greater force should be applied through a color change of the graphic object 713 displayed on the outer region of the display device 121 It is also possible.

In addition, an embodiment in which the processor 130 informs the user of the progress of measuring biometric information through the UI shown in FIG. 7B is also possible. For example, when the measurement of the antioxidant level starts, a circular progress bar may gradually lengthen along the outer area of the display device 121 with the lapse of time, as shown by the graphic objects 713a, 713b, and 713c of FIG. 7B. there is. The lengthening of the progress bar may mean that the outer area of the display device 121 is gradually filled with a preset color. When the measurement of biometric information is completed, the change of the progress bar may also be stopped. In the embodiment of FIG. 7B , the graphic object 713 representing the progress bar is illustrated as starting at 9 o'clock and completing at 3 o'clock in the outer area of the display device 121, but the start and end portions are limited to this. it is not going to be For example, the graphic object 713 may start at 9 o'clock, go around the outer area of the display device 121, and end again at 9 o'clock. Changes in this embodiment may also be applied to an embodiment in which the graphic object 713 shown in FIG. 7B displays the degree of pressure. Also, the display device 121 may have a circular shape as shown in each embodiment, or may have a rectangular shape with rounded angles (not shown). When the display device 121 has a rounded rectangle shape, the graphic object 713 provided along the outer area of the display device 121 may also be displayed in a rounded rectangle shape.

8A to 8C are diagrams for explaining an example of outputting biometric information estimation results.

When the light signal is measured from the index finger, the processor 130 obtains, for example, an antioxidant value using the measured light amount and the reference light amount obtained through calibration as described through Equations 1 to 3, and as shown in FIG. 8A, for example , a pie chart 811, and/or text 812 indicating antioxidant levels, etc. may be displayed on the display device 121 so that the user can easily check the estimation result. However, the visual display method is not limited thereto. Also, referring to FIG. 8B , the processor 130 may transmit data about the degree of progress and/or the estimation result to the external device 800 through the communication module while estimating the antioxidant level and/or when the estimation is completed. In addition, the external device 800 may display a graphic object 821 indicating a progress level and/or a graphic object 822 indicating an estimation result on the display device 820 . Also, referring to FIG. 8C , the external device 800 may manage the results received from the wearable device and visually display the antioxidant value estimation history as a trend graph 823 according to a user's request.

9 is a flowchart of a method for estimating biometric information according to an exemplary embodiment.

FIG. 9 is an embodiment performed by the electronic devices 100 and 200 of FIGS. 1 and 2 , which will be briefly described to avoid redundant description.

First, the electronic device may determine whether it is in a charging state (911).

Next, when the electronic device is mounted on a charger and charging is performed, the sensor module may be calibrated using a standard object placed on the charger (912). The reference amount of light for each light source obtained as a result of the calibration may be stored in a memory.

Next, it is determined whether the electronic device is in a state of measuring biometric information (913), and if it is not in a measurement state, it may guide the electronic device to measure biometric information (914). For example, when the electronic device is mounted on a charger and calibration is performed and charging is completed, or when the user removes the electronic device from the charger to use the electronic device, an estimation recommendation text message may be output to the display device of the electronic device. Alternatively, estimation may be guided by determining a recommended estimation time point by analyzing a preset user preference measurement time point or a change in user pattern.

Then, if the result of the determination in step 913 is in the measurement state, for example, when the user contacts the sensor module with the first part of the subject to estimate biometric information, the measurement position may be guided (915). For example, the electronic device may determine the contact position of the first part of the test subject to the sensor module and guide the measurement position of the sensor module through the display device. At this time, the contact position may be determined based on the difference in the amount of light received by the plurality of detectors, and may be repeatedly performed until the contact position coincides with the measurement position.

Then, when the contact position coincides with the measurement position according to the guide (916), the measurement pressure may be guided (917). For example, when the second part of the subject is pressurized by pressing the display device while the first part of the subject is in contact with the measuring position, a pressure gauge indicating the applied pressure and/or the reference pressure is displayed on the outer area of the display device. can do. In this case, the color or shape of the graphic object may be differently output according to the progress stage (eg, before measurement, during measurement, or after measurement) or the pressing state.

Then, when the contact pressure reaches the target reference pressure according to the guide, the sensor module may be driven to measure an optical signal at the first part of the object to be examined (918).

Then, biometric information may be estimated using the amount of light measured in step 918 and the reference amount of light obtained in step 912 (919). For example, absorbance for each wavelength is calculated based on the ratio between the amount of measured light and the amount of reference light, a feature value is extracted using the absorbance for each wavelength, and biometric information is obtained by applying the acquired feature value to a predefined estimation model. can

Next, the biometric information estimation result may be provided to the user through an output device (920). For example, information such as an estimated biometric information value, an estimated history graph, and recommendations according to an estimated biometric information value may be displayed through a display device, and alarm information may be output using an audio output device, a haptic device, and the like, Result data, etc. may be transmitted to an external device to be output from the external device.

Meanwhile, the present embodiments can be implemented as computer readable codes in a computer readable recording medium. The computer-readable recording medium includes all types of recording devices in which data that can be read by a computer system is stored.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., and implementation in the form of a carrier wave (for example, transmission over the Internet) include In addition, the computer-readable recording medium may be distributed to computer systems connected through a network, so that computer-readable codes may be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present embodiments can be easily inferred by programmers in the technical field to which the present invention belongs.

Those of ordinary skill in the art to which this disclosure belongs will understand that it can be implemented in other specific forms without changing the disclosed technical idea or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not limiting.

100,200: Biometric information estimation device 110: Sensor module
111: light source 112: detector
120: output device 121: display device
130: processor 210: communication module
220: memory

Claims (20)

main body;
a sensor module disposed on a first surface of the main body;
a display device disposed on a second surface of the main body; and
When the main body is placed on the charger and is in a charged state, the sensor module is calibrated through the standard object of the charger, the biometric information estimation is guided through the display device according to the progress after charging, and the sensor module An electronic device including a processor configured to estimate biometric information based on an amount of light measured at a first part of a subject and a result of the calibration. According to claim 1,
The sensor module
A light source for irradiating light to the standard object while charging is in progress, and a detector for detecting light reflected from the standard object,
The processor
An electronic device that stores calibration information including a reference amount of light of a standard object detected through the detector in a memory. According to claim 1,
The processor
An electronic device that outputs a text message to the display device to induce a user to estimate biometric information when charging is completed or when the main body is separated from the charger. According to claim 1,
The processor
An electronic device that determines a recommended estimation time point based on a user pattern, and outputs a text message to the display device to induce the user to estimate biometric information when the estimated recommended time point is reached. According to claim 1,
The processor
An electronic device for determining a contact position when the first region contacts the sensor module and guiding the contact position based on the determination result. According to claim 5,
The processor
Of the graphic object indicating the contact position of the first part, the graphic object indicating the predefined measurement position, the graphic object inducing movement from the contact position to the measurement position, and the graphic object indicating that the contact position and the measurement position coincide. An electronic device that outputs at least one to the display device. According to claim 5,
The sensor module
A light source is disposed in the center, and a plurality of detectors are disposed in a predetermined shape on the periphery around the light source,
The processor
An electronic device that determines the contact position of the first part based on the absorbance measured by each of the plurality of detectors. According to claim 1,
The processor
An electronic device that outputs a graphic object representing the contact pressure to the display device when the first part contacts the measurement position of the sensor module. According to claim 8,
The processor
An electronic device that outputs a pressure gauge to an area other than the contact area of the second part when a second part of the object under test contacts and presses the display device in a state in which the first part is in contact with the sensor module. According to claim 8,
The processor
An electronic device that changes a color of a graphic object representing the contact pressure according to a progress stage in which a biosignal is measured. According to claim 8,
The processor
An electronic device that outputs a text message indicating a corresponding measurement step according to a progress step in which a biosignal is measured. According to claim 1,
The processor
An electronic device that outputs an estimation result to the display device when biometric information estimation is completed. According to claim 1,
The processor
Calculate absorbance for each wavelength based on the amount of light measured from the reference light amount and the first portion measured during the calibration, obtain a feature value based on the calculated absorbance for each wavelength, and obtain biometric information based on the obtained feature value An electronic device that estimates. According to claim 13,
The processor
An electronic device that obtains an antioxidant peak by combining the calculated absorbance for each wavelength and correcting a reference line of a waveform, and obtains an antioxidant value based on the obtained antioxidant peak using a predefined antioxidant estimation model. In the method of estimating biometric information of an electronic device,
Determining whether the main body is placed in a charger and is in a charging state;
performing calibration of a sensor module disposed on a first surface of the main body through a standard object of the charger when in a charged state;
guiding biometric information estimation through a display device disposed on a second surface of the main body according to a step after charging;
measuring an amount of light at a first part of the subject through a sensor module; and
and estimating biometric information based on the measured amount of light and the calibration result. According to claim 15,
The step of performing the calibration is
irradiating light to the standard object by driving a light source of the sensor module while charging is in progress;
detecting light reflected from the standard object through a detector of the sensor module; and
and storing calibration information including a reference amount of light of the detected standard object in a memory. According to claim 15,
and outputting a text message to the display device to induce a user to estimate biometric information when charging is completed or when the main body is separated from the charger. According to claim 15,
The steps to guide
The biometric information estimation method of determining the contact position when the first part contacts the sensor module and guiding the contact position based on the determination result. According to claim 15,
The steps to guide
The biometric information estimation method of outputting a graphic object guiding the contact pressure to the display device when the first part contacts the measurement position of the sensor module. According to claim 15,
The step of estimating the biometric information is
Calculating absorbance for each wavelength based on the reference amount of light measured during the calibration and the amount of light measured from the first portion; and
obtaining a characteristic value based on the calculated absorbance for each wavelength; and
and estimating biometric information based on the obtained feature values.

Images