EP4023145A1 - Vorrichtung und verfahren zur schätzung von bioinformationen - Google Patents

Vorrichtung und verfahren zur schätzung von bioinformationen Download PDF

Info

Publication number
EP4023145A1
EP4023145A1 EP21189629.5A EP21189629A EP4023145A1 EP 4023145 A1 EP4023145 A1 EP 4023145A1 EP 21189629 A EP21189629 A EP 21189629A EP 4023145 A1 EP4023145 A1 EP 4023145A1
Authority
EP
European Patent Office
Prior art keywords
pixels
light
information
processor
bio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP21189629.5A
Other languages
English (en)
French (fr)
Other versions
EP4023145B1 (de
Inventor
Jin Young Park
Myoung Hoon Jung
Sang Kyu Kim
Yoon Jae Kim
Hyun Seok Moon
Sung Mo Ahn
Kun Sun Eom
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP4023145A1 publication Critical patent/EP4023145A1/de
Application granted granted Critical
Publication of EP4023145B1 publication Critical patent/EP4023145B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062—Arrangements for scanning
    • A61B5/0064—Body surface scanning
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14532—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring glucose, e.g. by tissue impedance measurement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14546—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring analytes not otherwise provided for, e.g. ions, cytochromes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
    • A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
    • A61B5/444—Evaluating skin marks, e.g. mole, nevi, tumour, scar
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4845—Toxicology, e.g. by detection of alcohol, drug or toxic products
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4869—Determining body composition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4869—Determining body composition
    • A61B5/4872—Body fat
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4869—Determining body composition
    • A61B5/4875—Hydration status, fluid retention of the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/681—Wristwatch-type devices
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813—Specially adapted to be attached to a specific body part
    • A61B5/6825—Hand
    • A61B5/6826—Finger
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203—Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient ; user input means
    • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0233—Special features of optical sensors or probes classified in A61B5/00

Definitions

  • the disclosure relates to an apparatus and a method for estimating bio-information, and more particularly to technology for non-invasively estimating antioxidant levels.
  • Reactive oxygen species act as a biological defense factor such as white blood cells protecting the body against infections.
  • white blood cells protecting the body against infections.
  • various tissue diseases Common factors that cause the reactive oxygen species include stress, alcohol, peroxides, medicine, and the like.
  • the reactive oxygen species produced by these factors may cause cranial nerve diseases, circulatory diseases, cancer, digestive tract diseases, liver diseases, arteriosclerosis, renal diseases, diabetes, aging, and the like.
  • an apparatus for estimating bio-information including a display including unit pixels, each of the unit pixels including light sources configured to emit light having different wavelengths, and detectors configured to detect light having the different wavelengths.
  • the apparatus further includes a processor configured to:determine source pixels configured to emit light onto an object, among the unit pixels, determine detector pixels configured to detect light that is scattered or reflected from the object, among the unit pixels, control the determined source pixels and the determined detector pixels to obtain a spectrum based on the light having multiple wavelengths that is detected by the detector pixels, and estimate bio-information, based on the obtained spectrum.
  • the light sources may include a red light source, a green light source, and a blue light source.
  • the detectors may include either one or both of a photodiode and a Complementary Metal Oxide Semiconductor (CMOS) image sensor.
  • CMOS Complementary Metal Oxide Semiconductor
  • the light sources and the detectors may be disposed on a same surface of a pixel circuit board.
  • the light sources and the detectors may be patterned on the same surface of the pixel circuit board.
  • a partition wall for blocking light may be interposed between the light sources and the detectors.
  • the light sources may be disposed on a first surface of the pixel circuit board, and the detectors may be disposed on a second surface of the pixel circuit board, the second surface being opposite to the first surface.
  • the processor may be further configured to determine the source pixels and the detector pixels at different positions, among the unit pixels.
  • the processor may be further configured to determine the source pixels and the detector pixels, based on any one or any combination of a contact position of the object, a type of the bio-information, a light path, and an allowable range of Signal-to-Noise Ratio (SNR) values.
  • SNR Signal-to-Noise Ratio
  • the processor may be further configured to perform color modulation of the light sources of the determined source pixels, based on a type of the bio-information.
  • the processor may be further configured to perform the color modulation of the light sources of the determined source pixels, to include a wavelength range of 470 nm to 510 nm.
  • the processor may be further configured to extract a light intensity for each of the different wavelengths, based on Full Width Half Maximum (FWHM) characteristics of the light sources emitting light of each wavelength, and obtain the spectrum, based on the extracted light intensity for each of the different wavelengths.
  • FWHM Full Width Half Maximum
  • the bio-information may include any one or any combination of skin carotenoid, blood carotenoid, glucose, urea, lactate, triglyceride, total protein, cholesterol, and ethanol.
  • a method of estimating bio-information including, based on an object coming into contact with a display including unit pixels, each of the unit pixels including light sources emitting light having different wavelengths and detectors detecting light having the different wavelengths, determining source pixels and detector pixels, among the unit pixels, and controlling the determined source pixels to emit light of onto the object.
  • the method further includes controlling the determined detector pixels to detect light that is scattered or reflected from the object, and obtaining a spectrum based on the light having multiple wavelengths that is detected by the detector pixels, and estimating bio-information, based on the obtained spectrum.
  • the light sources may include a red light source, a green light source, and a blue light source.
  • the light sources and the detectors may be disposed on a same surface of a pixel circuit board.
  • the light sources and the detectors may be patterned on the same surface of the pixel circuit board.
  • a partition wall for blocking light may be interposed between the light sources and the detectors.
  • the light sources may be disposed on a first surface of the pixel circuit board, and wherein the detectors are disposed on a second surface of the pixel circuit board, the second surface being opposite to the first surface.
  • the determining of the source pixels and the detector pixels may include determining the source pixels and the detector pixels at different positions, among the unit pixels.
  • the determining of the source pixels and the detector pixels may include determining the source pixels and the detector pixels, based on any one or any combination of a contact position of the object, a type of the bio-information, a light path, and an allowable range of Signal-to-Noise Ratio (SNR) values.
  • SNR Signal-to-Noise Ratio
  • the controlling of the determined source pixels may include performing color modulation of the light sources of the determined source pixels, based on a type of the bio-information.
  • the controlling of the determined source pixels may include performing the color modulation of the light sources of the determined source pixels, to include a wavelength range of 470 nm to 510 nm.
  • the obtaining of the spectrum may include extracting a light intensity for each of the different wavelengths, based on Full Width Half Maximum (FWHM) characteristics of the light sources emitting light of each wavelength, and obtaining the spectrum, based on the extracted light intensity for each of the different wavelengths.
  • FWHM Full Width Half Maximum
  • an apparatus for estimating bio-information including a display including unit pixels, each of the unit pixels including light sources configured to emit light having different wavelengths, and at least one detector configured to detect light having the different wavelengths.
  • the apparatus further includes a processor configured to detect a contact position of an object on the display, determine a partial area of the display, based on the detected contact position, determine source pixels configured to emit light onto the object, among the unit pixels, based on the determined partial area, determine detector pixels configured to detect light that is scattered or reflected from the object, among the unit pixels, based on the determined partial area, control the determined source pixels and the determined detector pixels to obtain a spectrum based on the light having multiple wavelengths that is detected by the detector pixels, and estimate bio-information, based on the obtained spectrum.
  • a processor configured to detect a contact position of an object on the display, determine a partial area of the display, based on the detected contact position, determine source pixels configured to emit light onto the object, among the unit pixels, based on the determined partial area, determine detector pixels configured to detect light that is scattered or reflected from the object, among the unit pixels, based on the determined partial area, control the determined source pixels and the determined detector pixels to obtain a spectrum based on the light having multiple wavelengths that is detected
  • FIG. 1 is a block diagram of an apparatus for estimating bio-information, according to an embodiment.
  • the apparatus 100 for estimating bio-information includes a display 110 and a processor 120.
  • the display 110 may include a plurality of unit pixels capable of displaying images and/or measuring light signals.
  • the unit pixel may be an Organic Light Emitting Diodes (OLED)-based pixel that emits light by itself without having a separate backlight.
  • OLED Organic Light Emitting Diodes
  • each unit pixel may include light sources emitting red, green, and blue light, and may display images with one or a combination of the colors, or may emit light onto an object to measure an optical signal.
  • each unit pixel may include one or more detectors for detecting light.
  • the detector may detect light and may convert the detected light signal into an electric signal and output the signal.
  • the detector may be a photodiode, but is not limited thereto and may be a photo transistor (PTr) or an image sensor (e.g., Complementary Metal Oxide Semiconductor (CMOS) image sensor).
  • PTr photo transistor
  • CMOS Complementary Metal Oxide Semiconductor
  • the display 110 may include a window (e.g., glass substrate) for passing external light or light input by the light sources of the unit pixels.
  • the window may be formed as a smooth flat surface, a curved surface, etc., so that an object (e.g., finger) may come into contact therewith.
  • the processor 120 may control the light source and the detector of the unit pixel when the object comes into contact with the window of the display 110. For example, the processor 120 may determine one or more source pixels and one or more detector pixels among the plurality of unit pixels, and may measure light signals from the object by controlling light sources of the determined source pixels and detectors of the detector pixels. By considering a contact position of the object, a type of bio-information to be estimated, a light path defined for estimating bio-information, an allowable range of Signal-to-Noise Ratio (SNR) values, etc., the processor 120 may determine the source pixels and the detector pixels, in which case the processor 120 may determine the source pixels and the detector pixels at different positions.
  • SNR Signal-to-Noise Ratio
  • the processor 120 may drive the light sources of the source pixels to emit light of a predetermined wavelength.
  • a color modulation pattern may be pre-defined by considering a type of bio-information, a measurement position of the object, or the like.
  • the color modulation pattern may be defined to include a wavelength range according to the type of bio-information.
  • the color modulation pattern may be defined to include at least a wavelength range of 470 nm to 510 nm.
  • the processor 120 may sequentially or simultaneously drive multi-wavelength light sources of the source pixels.
  • the processor 120 may drive the light sources of the source pixels in an order from short to long wavelengths or vice versa, or in a predefined driving order such as a random order and the like.
  • the processor 120 may drive the plurality of source pixels simultaneously, sequentially, or in a predetermined pattern.
  • Information such as a driving order of the source pixels, power intensity and duration of the light sources, and the like may be pre-defined.
  • the processor 120 may receive signals output from the detectors of the detector pixels, and may estimate bio-information based on the received signals.
  • the processor 120 may generate a spectrum based on the intensity of light of each wavelength that is detected by the detector of the detector pixel. For example, if light of multiple wavelengths is detected by the plurality of detector pixels, the processor 120 may generate spectra for the respective detector pixels. In this case, the processor 120 may extract a light intensity for each wavelength based on Full Width Half Maximum (FWHM) characteristics of the light source that emits light in each wavelength range that is detected by the detector pixels, and may generate spectra for all of the wavelengths based on the extracted light intensity for each wavelength.
  • FWHM Full Width Half Maximum
  • the processor 120 may extract features from the generated spectra, and may estimate bio-information by using the extracted features and a pre-defined estimation model.
  • bio-information may include, for example, skin carotenoid and blood carotenoid that are associated with antioxidant levels.
  • the bio-information is not limited thereto, and may include glucose, urea, lactate, triglyceride, total protein, cholesterol, and ethanol.
  • the processor 120 may perform user authentication by using the signals detected by the detector pixels. For example, the processor 120 may detect a user's fingerprint information by analyzing the detected signals, and may perform user authentication by using the detected fingerprint information. In addition, the processor 120 may proceed to estimating bio-information for a user having been authenticated.
  • FIGS. 2A , 2B and 2C are diagrams explaining examples of a display, according to embodiments.
  • FIG. 2A is a diagram illustrating an example of an arrangement of unit pixels of a display.
  • a plurality of unit pixels of the display 110 may be arranged in a rectangular array 200.
  • the arrangement is not limited thereto, and may be a circular, rectangular, and pentagonal shape or the like and may vary according to a size, shape, and the like of the display.
  • each unit pixel may include red R, green G, and blue B light sources and the detector PD. While FIG. 2A illustrates 29 unit pixels, but the number is not limited thereto.
  • FIGS. 2B and 2C are diagrams explaining an arrangement structure of light sources and detectors of each unit pixel of the display 110.
  • each unit pixel of the display 110 may have multi-wavelength light sources R, G, and B and the detector PD that are disposed on the same surface.
  • the multi-wavelength light sources R, G, and B and the detector PD may be disposed on a top surface of a pixel circuit board 212.
  • the multi-wavelength light sources R, G, and B and the detector PD may be patterned on the same surface of the pixel circuit board 212.
  • the multi-wavelength light sources R, G, and B may be disposed in the order of red R, green G, and blue B, starting from the detector PD, but the order of arrangement is not particularly limited thereto.
  • the multi-wavelength light sources R, G, and B may be driven with multicolor modulation under the control of the processor 120, to emit light of multiple wavelengths onto the object OBJ, and light scattered or reflected from the object OBJ may be detected by the detector PD.
  • a partition wall 213 for blocking light may be disposed between the light sources R, G, and B and the detector PD.
  • the multi-wavelength light sources R, G, and B and the detectors PD may be arranged in multiple layers. As illustrated in FIG. 2C , the multi-wavelength light sources R, G, and B may be disposed on an upper end or a first surface of the pixel circuit board 212, in which case the multi-wavelength light sources R, G, and B may be patterned on the upper end of the pixel circuit board 212. Further, the detectors PD may be disposed on a lower end or a second surface of the pixel circuit board 212. The detectors PD may be disposed on the lower surface of the pixel circuit board 212 while being in contact with each other or spaced apart from each other. In this case, the pixel circuit board 212 may have a light-transmitting region so that light scattered or reflected from the object may pass through the window 211 to be directed toward the detectors PD.
  • FIGS. 3A and 3B are diagrams explaining examples of driving unit pixels and generating spectra, according to embodiments.
  • the processor 120 may determine one or more source pixels 2, 15, 21, and 26 and one or more detector pixels 5, 10, 13, and 28 in a unit pixel array 200 for measuring signals from the object. By combining light of determined source pixels 2, 15, 21, and 26 and signals of determined detector pixels 5, 10, 13, and 28 located at various distances, the processor 120 may measure signals at various positions and/or depths of the object, thereby improving accuracy in estimating bio-information.
  • the processor 120 may set a partial area for measuring a light signal in the unit pixel array 200, and may measure a light signal in the set partial area. For example, when the object comes into contact with the window of the display 110, the processor 120 may detect a contact position (e.g., fingerprint center point of a finger) of the object, and may set the partial area for determining source pixels and unit pixels based on the detected contact position of the object.
  • the partial area for measuring the light signal may be preset. In this case, the processor 120 may display an identification mark and the like, indicating the partial area, on the display 110. In this case, a position, size, and the like of the preset area may be changed by a user.
  • FIG. 3B illustrates a spectrum generated based on signals d1, d2, d3, d4, and d5 of five wavelength ranges that are detected by the detector pixels after emitting light, corresponding to the five wavelength ranges, by color modulation of light sources of source pixels.
  • the processor 120 may obtain a plurality of spectra.
  • the processor 120 may exclude an invalid spectrum by verifying validity of the spectra and the like. In this case, validity may be verified by calculating a similarity between each of the obtained plurality of spectra and a reference spectrum, and by determining a spectrum having the calculated similarity that exceeds a predetermined threshold, to be a valid spectrum.
  • a method of verifying validity is not limited thereto.
  • the processor 120 may calculate the similarity by using various similarity calculation algorithms, such as Euclidean distance, Manhattan Distance, Cosine Distance, Mahalanobis Distance, Jaccard Coefficient, Extended Jaccard Coefficient, Pearson's Correlation Coefficient, Spearman's Correlation Coefficient, and the like.
  • the processor 120 may extract features for estimating bio-information from the obtained spectra, and may estimate bio-information by using an estimation model that defines a correlation between the extracted features and bio-information.
  • the estimation model may be defined by a linear or non-linear equation, but is not limited thereto.
  • the processor 120 may extract features by combining an intensity of a signal detected in a reference wavelength range and an intensity of a signal detected in another wavelength range.
  • the reference wavelength range may be set differently according to a type of bio-information and the like.
  • the processor 120 may determine a wavelength range of approximately 470 nm to 510 nm in FIG. 3B to be the reference wavelength range, and may extract a combination (e.g., difference or ratio) of the intensity of a signal d3 detected in the reference wavelength range and the intensity of a signal (e.g., d2 and/or d4) detected in an adjacent wavelength range as a feature for estimating carotenoid.
  • FIG. 4 is a diagram explaining another example of a display, according to an embodiment.
  • the display 110 may include an image sensor CIS and a plurality of light sources LSs.
  • the light source may include a light emitting diode (LED), a laser diode (LD), a phosphor, and the like.
  • the plurality of light sources may be configured to emit light of different wavelengths, e.g., an infrared wavelength, a red wavelength, a green wavelength, a blue wavelength, a white wavelength, and the like.
  • each of the plurality of light sources may emit light of different wavelengths ⁇ 1 - ⁇ 3, or a plurality of light sources may be included for each wavelength and may be disposed at opposite positions as illustrated in FIG. 4 .
  • the image sensor may be a complementary metal-oxide semiconductor (CMOS) image sensor. As illustrated in FIG. 4 , the plurality of light sources may be disposed around the image sensor.
  • the light sources may be arranged in a linear, circular, elliptical, and polygonal shape, or the like with no particular limitation.
  • the processor 120 may sequentially drive all the plurality of light sources in a pre-defined direction, such as a clockwise direction, a counter-clockwise direction, a zigzag direction, and the like. Alternatively, the processor 120 may sequentially drive all the plurality of light sources in an order from short to long wavelengths or vice versa. Further, the processor 120 may select some of the plurality of light sources according to a measurement position or a measurement depth of the object and the like, and may sequentially drive the selected light sources in a predetermined direction or in predetermined order of wavelength. By combining the plurality of light sources, the processor 120 may measure light signals at various depths of the object.
  • the processor 120 may calculate absorbance for each pixel based on pixel data detected by the image sensor after driving the plurality of light sources, e.g., based on the intensity of light received by each pixel of the image sensor, and may estimate bio-information based on the absorbance of each pixel. For example, the processor 120 may estimate bio-information by using an estimation model that defines a correlation between the absorbance and bio-information. In this case, the processor 120 may obtain the absorbance in a proper wavelength range according to a type of bio-information, and may estimate bio-information by using the absorbance in the wavelength range.
  • FIG. 5 is a block diagram of an apparatus for estimating bio-information, according to another embodiment.
  • the apparatus 500 for estimating bio-information may include the display 110, the processor 120, a storage 510, a communication interface 520, and a sound output interface 530.
  • the display 110 and the processor 120 are described above in detail, such that the following description will be focused on non-overlapping functions.
  • the display 110 may output, for example, an interface for supporting various functions of the apparatus 500 for estimating bio-information, and may display data, such as an estimated bio-information value processed by the processor 120 and the like, through the interface. Further, by visually displaying a contact position, in which a user may be required to place an object, and the like, the display 110 may guide the user on the contact position.
  • the display 110 may include a touch circuity adapted to detect a touch, and/or sensor circuitry (e.g., pressure sensor, etc.) adapted to measure the intensity of force incurred by the touch.
  • the display 110 may detect a user's touch input by the touch circuit, and may transmit a user's request to the processor 120. Furthermore, when the object comes into contact with the window of the display 110 and applies force thereto, contact pressure may be measured by the pressure sensor and the like of the display 110.
  • the processor 120 may be electrically connected to the display 110, and may properly control the unit pixels of the display 110 to output image data (e.g., guide information for estimating bio-information, a bio-information estimation result, or other image data) and/or to measure light signals.
  • image data e.g., guide information for estimating bio-information, a bio-information estimation result, or other image data
  • the processor 120 may measure light signals or output image data by using the unit pixels of the entire area of the display 110.
  • the processor 120 may measure the light signals by using the unit pixels of the first area, and at the same time may output the image data by using the light sources of all the unit pixels of the second area.
  • the storage 510 may store data related to estimating bio-information.
  • the data may include user characteristic information, such as a user's age, gender, health condition, and the like, color modulation pattern, light source driving conditions and/or an estimation model, and the like.
  • the data may include other data processed or generated by the display 110 and/or the processor 120, application programs or algorithms for estimating bio-information and/or performing other functions, or input data and/or output data about related instructions.
  • the storage 510 may include at least one storage medium of a flash memory type memory, a hard disk type memory, a multimedia card micro type memory, a card type memory (e.g., an SD memory, an XD memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, and an optical disk, and the like, but is not limited thereto.
  • a flash memory type memory e.g., an SD memory, an XD memory, etc.
  • RAM Random Access Memory
  • SRAM Static Random Access Memory
  • ROM Read Only Memory
  • EEPROM Electrically Erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • magnetic memory a magnetic disk, and an optical disk, and the like, but is not limited thereto.
  • the communication interface 520 may communicate with an external device by using various wired and wireless communication modules.
  • the communication interface 520 may receive data for estimating bio-information from the external device, and may transmit data processed and/or processed by the display 110 or the processor 120 to the external device.
  • the external device may include an information processing device such as a smartphone, a tablet PC, a desktop computer, a laptop computer, and the like.
  • examples of the wired and wireless communication modules may include Bluetooth communication, Bluetooth Low Energy (BLE) communication, Near Field Communication (NFC), WLAN communication, Zigbee communication, Infrared Data Association (IrDA) communication, Wi-Fi Direct (WFD) communication, Ultra-Wideband (UWB) communication, Ant+ communication, WIFI communication, Radio Frequency Identification (RFID) communication, 3G, 4G, and 5G communications, and the like.
  • BLE Bluetooth Low Energy
  • NFC Near Field Communication
  • WLAN Zigbee communication
  • IrDA Infrared Data Association
  • Wi-Fi Direct Wi-Fi Direct
  • UWB Ultra-Wideband
  • Ant+ communication Zigbeet Radio Frequency Identification
  • RFID Radio Frequency Identification
  • the sound output interface 530 may output sound signals to the outside.
  • the sound output interface 530 may include a speaker and/or a receiver.
  • the processor 120 may convert the estimated bio-information result and/or guide information on the contact position or contact pressure into sound signals, and the sound output interface 530 may output the sound signals.
  • the apparatus 500 for estimating bio-information may further include an inputter.
  • the inputter may receive instructions to be used by the processor 120 and the like of the apparatus 500 for estimating bio-information and/or data from a user and the like.
  • the inputter may include a microphone, a mouse, a keyboard, and/or a digital pen (e.g., stylus pen, etc.).
  • FIG. 6 is a flowchart of a method of estimating bio-information, according to an embodiment.
  • the method of FIG. 6 is an example of a method of estimating bio-information that is performed by the apparatuses 100 and 500 for estimating bio-information according to the above embodiments, which are described above in detail and thus will be briefly described below to avoid redundancy.
  • the apparatus for estimating bio-information may determine source pixels and detector pixels among a plurality of unit pixels of the display. In this case, the apparatus for estimating bio-information may determine the source pixels and the detector pixels at different positions. By considering a contact position of the object, a type of bio-information, etc., the apparatus for estimating bio-information may determine the source pixels and the detector pixels by combining the source pixels and the detector pixels at various distances.
  • the apparatus for estimating bio-information may drive multi-wavelength light sources of the source pixels to emit light of multiple wavelengths onto the object.
  • the apparatus for estimating bio-information may detect light, scattered or reflected from the object, by detectors of the detector pixels.
  • the multi-wavelength light sources may include red, green, and blue light sources. By modulation of various colors, the apparatus for estimating bio-information may sequentially or simultaneously drive the light sources to include proper wavelength ranges for estimating bio-information.
  • the apparatus for estimating bio-information may obtain a spectrum based on light detected by the detector pixels.
  • the apparatus for estimating bio-information may estimate bio-information based on the obtained spectrum.
  • the apparatus for estimating bio-information may determine a valid spectrum by verifying validity of the spectra.
  • the apparatus for estimating bio-information may extract features from the spectra and may estimate bio-information by applying an estimation model.
  • the apparatus for estimating bio-information may extract the features by a combination, such as a difference or a ratio between a signal of a first wavelength and a signal of a second wavelength serving as a reference, and the like.
  • FIGS. 7 and 8 are diagrams illustrating examples of electronic devices having an apparatus for estimating bio-information according to embodiments.
  • the electronic device may be implemented as a wristwatch-type wearable device 700.
  • the wristwatch-type wearable device 700 is an example, and the shape is not particularly limited as long as the wearable device may be worn on the human body.
  • the wristwatch-type wearable device 700 may include a main body MB and a strap ST.
  • the main body MB may have various shapes (e.g., circle, square, etc.), and the strap ST may be made of a flexible material to be wrapped around a user's wrist so that the main body MB may be worn on the wrist.
  • a display DP is disposed on a front surface of the main body MB, and a manipulator BT for receiving a user's instruction may be disposed on a side surface of the main body MB.
  • the display DP may be an OLED-based display.
  • the electronic device may be implemented as a mobile device 800 such as a smartphone.
  • a display DP may be disposed on the front surface of a main body MB of the mobile device 800, and various modules for processing a user's instructions may be disposed on the front surface, the rear surface, and/or the side surface of the main body MB.
  • the display DP may be an OLED-based display.
  • the electronic device is not limited to the wearable device 700 or the mobile device 800 illustrated in FIGS. 7 and 8 , and examples of the electronic device may include an information processing device, such as a laptop computer having a display, or an Internet of things (IoT) device such as home appliances including a refrigerator, a TV, and the like.
  • an information processing device such as a laptop computer having a display
  • an Internet of things (IoT) device such as home appliances including a refrigerator, a TV, and the like.
  • the main body MB may include a processor, a memory, a sound output device, a sensor module, a haptic module, a camera module, a power management module, a battery, a communication module, and the like. Some of the components may be omitted from the electronic device, and other components may be added.
  • At least some of the functions of the apparatuses 100 and 500 for estimating bio-information may be implemented as single integrated circuitry to be mounted in the sensor module of the electronic devices 700 and 800, or may be distributed in different components.
  • the functions of the display 110 and the processor 120 of the aforementioned apparatuses 100 and 500 for estimating bio-information may be included in the display MB and the processor of the wearable device 700, respectively.
  • a plurality of unit pixels capable of measuring light signals from the object may be arranged in the entire area UP of the display DP.
  • the display DP is not limited thereto, and unit pixels for measuring the light signals may be arranged in a partial area MP of the display DP.
  • Each unit pixel may include light sources emitting light of red, green, and blue wavelengths, and a detector for detecting light signals.
  • the processor may determine source pixels and detector pixels among the plurality of unit pixels and may obtain various spectra by driving the source pixels and the detector pixels by combining the source pixels and the detector pixels at various distances.
  • the processor may measure light signals in a wavelength range.
  • the processor may detect a contact position of the object by sequentially driving all the unit pixels, and may also measure the light signals by using the unit pixels of a partial area (e.g., MP) based on the detected contact position.
  • the processor may output guide information in a remaining area of the display DP.
  • the processor may extract a user's fingerprint information based on the light signals detected in the partial area MP, and may perform user authentication by using the extracted fingerprint information.
  • Data generated and/or processed by the electronic devices 700 and 800 may be stored in the memory, and the data stored in the memory may be used by the processor or other components of the electronic devices 700 and 800.
  • the data generated and/or processed by the processor or other components of the electronic devices 700 and 800 may be converted into sound signals, to be output by the sound output device, and may be output by the haptic module as a mechanical stimulus (e.g., vibration, motion, etc.) or an electrical stimulus that may be recognized by a user by tactile sensation or kinesthetic sensation.
  • a mechanical stimulus e.g., vibration, motion, etc.
  • an electrical stimulus that may be recognized by a user by tactile sensation or kinesthetic sensation.
  • the communication module may support communication of the electronic devices 700 and 800 with other devices, e.g., a mobile device, a smartphone, a laptop computer, etc. that are located in a network environment.
  • the data generated and/or processed by the processor or other components of the electronic devices 700 and 800 may be transmitted to other devices through the communication module, and data for estimating bio-information and the like may be received from other devices and stored in the memory.
  • Example embodiments can be realized as a computer-readable code written on a computer-readable recording medium.
  • the computer-readable recording medium may be any type of recording device in which data is stored in a computer-readable manner.
  • Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage, and a carrier wave (e.g., data transmission through the Internet).
  • the computer-readable recording medium can be distributed over a plurality of computer systems connected to a network so that a computer-readable code is written thereto and executed therefrom in a decentralized manner.
  • Functional programs, codes, and code segments for realizing example embodiments can be easily deduced by computer programmers of ordinary skill in the art, to which example embodiments pertain.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Optics & Photonics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Emergency Medicine (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Dermatology (AREA)
  • Artificial Intelligence (AREA)
  • Physiology (AREA)
  • Psychiatry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Pharmacology & Pharmacy (AREA)
  • Toxicology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Multimedia (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
EP21189629.5A 2021-01-25 2021-08-04 Vorrichtung und verfahren zur schätzung von bioinformationen Active EP4023145B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020210010078A KR20220107439A (ko) 2021-01-25 2021-01-25 생체정보 추정 장치 및 방법

Publications (2)

Publication Number Publication Date
EP4023145A1 true EP4023145A1 (de) 2022-07-06
EP4023145B1 EP4023145B1 (de) 2024-02-21

Family

ID=77207111

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21189629.5A Active EP4023145B1 (de) 2021-01-25 2021-08-04 Vorrichtung und verfahren zur schätzung von bioinformationen

Country Status (4)

Country Link
US (1) US20220233113A1 (de)
EP (1) EP4023145B1 (de)
KR (1) KR20220107439A (de)
CN (1) CN114788697A (de)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170337413A1 (en) * 2016-05-23 2017-11-23 InSyte Systems Integrated light emitting display and sensors for detecting biologic characteristics
US20190200866A1 (en) * 2017-12-29 2019-07-04 Samsung Electronics Co., Ltd. Biological component measuring apparatus and biological component measuring method
US20190380586A1 (en) * 2018-06-19 2019-12-19 Samsung Electronics Co., Ltd. Biometric information sensing device and controlling method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170337413A1 (en) * 2016-05-23 2017-11-23 InSyte Systems Integrated light emitting display and sensors for detecting biologic characteristics
US20190200866A1 (en) * 2017-12-29 2019-07-04 Samsung Electronics Co., Ltd. Biological component measuring apparatus and biological component measuring method
US20190380586A1 (en) * 2018-06-19 2019-12-19 Samsung Electronics Co., Ltd. Biometric information sensing device and controlling method thereof

Also Published As

Publication number Publication date
CN114788697A (zh) 2022-07-26
EP4023145B1 (de) 2024-02-21
US20220233113A1 (en) 2022-07-28
KR20220107439A (ko) 2022-08-02

Similar Documents

Publication Publication Date Title
US11538272B2 (en) Apparatus and method for measuring signal and obtaining bio-information
US20200146568A1 (en) Blood pressure measuring apparatus and blood pressure measuring method
US11419529B2 (en) Apparatus and method for measuring bio-signal
EP3929565B1 (de) Vorrichtung und verfahren zur optischen analyse von objektsubstanz
CN114190933A (zh) 用于估计生物信息的设备和方法
EP3782538A1 (de) Vorrichtung und verfahren zur schätzung von bioinformationen
EP4023145A1 (de) Vorrichtung und verfahren zur schätzung von bioinformationen
EP3669781A1 (de) Antioxidanssensor und verfahren zur gewinnung von antioxidanssignalen
EP4249875A2 (de) Vorrichtung und verfahren zur schätzung einer optischen kraft
KR102564544B1 (ko) 생체 신호 측정 장치와, 혈압 측정 장치 및 방법
EP4179963A1 (de) Elektronische vorrichtung und verfahren zur schätzung von bioinformationen damit
US11513066B2 (en) Apparatus and method for estimating bio-information
US20230157645A1 (en) Apparatus and method for estimating bio-information
US11540721B2 (en) Antioxidant sensor and method of measuring antioxidant value
US11150183B2 (en) Optical sensor including a base substrate with a contact sensor and apparatus and method for estimating bio-information
KR20220075759A (ko) 분석물의 성분 추정 장치 및 방법
KR102680470B1 (ko) 광 센서, 생체 정보 추정 장치 및 방법
US12023171B2 (en) Antioxidant sensor and method of obtaining antioxidant signal
US20220233149A1 (en) Apparatus and method for estimating body component
US11971348B2 (en) Electronic device and method of estimating bio-information using the same
KR102553032B1 (ko) 생체정보 추정 장치, 다중신호 측정센서

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20221230

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230520

RIC1 Information provided on ipc code assigned before grant

Ipc: A61B 5/1455 20060101ALI20230831BHEP

Ipc: A61B 5/145 20060101ALI20230831BHEP

Ipc: A61B 5/00 20060101AFI20230831BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20231012

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602021009553

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D