EP3456247A1 - Apparatus and method for estimating glucose exposure and generating glucose exposure estimation model - Google Patents

Apparatus and method for estimating glucose exposure and generating glucose exposure estimation model Download PDF

Info

Publication number
EP3456247A1
EP3456247A1 EP18194967.8A EP18194967A EP3456247A1 EP 3456247 A1 EP3456247 A1 EP 3456247A1 EP 18194967 A EP18194967 A EP 18194967A EP 3456247 A1 EP3456247 A1 EP 3456247A1
Authority
EP
European Patent Office
Prior art keywords
raman
glucose exposure
information
peak value
depth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP18194967.8A
Other languages
German (de)
French (fr)
Other versions
EP3456247B1 (en
Inventor
Jin Young Park
Un Jeong Kim
Yun S Park
Sung Mo Ahn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3456247A1 publication Critical patent/EP3456247A1/en
Application granted granted Critical
Publication of EP3456247B1 publication Critical patent/EP3456247B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14532Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring glucose, e.g. by tissue impedance measurement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0075Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/15Devices for taking samples of blood
    • A61B5/157Devices characterised by integrated means for measuring characteristics of blood
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062Arrangements for scanning
    • A61B5/0064Body surface scanning
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • A61B5/681Wristwatch-type devices
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6898Portable consumer electronic devices, e.g. music players, telephones, tablet computers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/65Raman scattering

Definitions

  • Apparatuses and methods consistent with exemplary embodiments relate to a technology for non-invasively estimating glucose exposure, and more particularly, to estimating glucose exposure using depth-specific protein information based on a Raman spectrum and generating a glucose exposure estimation model for estimating the glucose exposure.
  • GI glycemic index
  • the glycemic index is a value given to indicate a quality of carbohydrate by taking into account the rapidity in which the carbohydrate in food is absorbed after meal consumption.
  • the glycemic index (GI) of a food may be determined by feeding a group of healthy people a portion of the food containing 50 grams of carbohydrate and then measuring the change in their blood glucose levels over the next 2 hours.
  • the glycemic index has limitations in taking into account characteristics of each individual (e.g., a degree of response to insulin and a degree of stress) or reflecting their actual dietary lifestyle because glycemic indexes are based on individual foods, but most people eat food in combinations within a meal.
  • Exemplary embodiments address at least the above problems and/or disadvantages and other disadvantages not described above. Also, the exemplary embodiments are not required to overcome the disadvantages described above, and may not overcome any of the problems described above.
  • an apparatus for estimating a glucose exposure including: a spectrometer configured to measure a plurality of Raman spectra from an object; and a processor configured to extract depth-specific protein information from the plurality of Raman spectra and estimate the glucose exposure of the object based on the depth-specific protein information.
  • the spectrometer may include a light source configured to emit a light to the object and a photodetector configured to acquire the plurality of Raman spectra by receiving the light reflected or scattered from the object.
  • the spectrometer may be configured to measure the plurality of Raman spectra at a predetermined time interval for a predetermined period of time.
  • the processor may be further configured to extract a representative Raman spectrum from the plurality of Raman spectra and extract the depth-specific protein information from the representative Raman spectrum.
  • the processor may be further configured to extract a median spectrum of the plurality of Raman spectra as the representative Raman spectrum.
  • the processor may be further configured to extract a Raman spectrum of a predetermined sample number from the plurality of Raman spectra as the representative Raman spectrum.
  • the processor may be further configured to remove background noise from the extracted representative Raman spectrum.
  • the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • the processor may be further configured to extract a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the plurality of Raman spectra and estimate the glucose exposure of the object based on the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model.
  • the glucose exposure estimation model may define a relationship between the glucose exposure and a ratio of the first Raman peak value to the second Raman peak value.
  • the processor may be further configured to generate carbohydrate intake guide information based on the glucose exposure of the object.
  • the carbohydrate intake guide information may include information indicating whether a daily amount of carbohydrate intake of the object is adequate.
  • the processor may be further configured to calculate a daily amount of the glucose exposure by monitoring the glucose exposure of the object, determine whether the calculated daily amount of the glucose exposure is within a predetermined threshold range, and generate the carbohydrate guide information based on a result of the determination of whether the calculated daily amount is within the predetermined threshold range
  • an apparatus for generating a glucose exposure estimation model including: a data collector configured to collect a Raman spectrum and glucose exposure information corresponding to the Raman spectrum; and a processor configured to extract depth-specific protein information from the Raman spectrum and generate the glucose exposure estimation model based on the depth-specific protein information and the glucose exposure information.
  • the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • the processor may be further configured to extract a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the Raman spectrum and generate the glucose exposure estimation model through regression analysis or machine learning based on a ratio of the first Raman peak value to the second Raman peak value and the glucose exposure data.
  • a method of estimating glucose exposure including: measuring a plurality of Raman spectra from an object; extracting depth-specific protein information from the plurality of Raman spectra; and estimating a glucose exposure of the object based on the depth-specific protein information.
  • the measuring the plurality of Raman spectra may include measuring the plurality of Raman spectra at a predetermined time interval for a predetermined period of time.
  • the extracting the depth-specific protein information may include extracting a representative Raman spectrum from the plurality of Raman spectra and extracting the depth-specific protein information from the representative Raman spectrum.
  • the extracting the representative Raman spectrum may include extracting a median spectrum of the plurality of Raman spectra as the representative Raman spectrum.
  • the extracting the representative Raman spectrum may include extracting a Raman spectrum of a predetermined sample number from the plurality of Raman spectra as the representative Raman spectrum.
  • the extracting the depth-specific protein information may further include removing background noise from the extracted representative Raman spectrum.
  • the depth-specific information may include intradermal collagen information and intraepidermal keratin information.
  • the extracting the depth-specific protein information may include extracting a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the plurality of Raman spectra, and wherein the estimating the glucose exposure of the object may include estimating the glucose exposure of the object using the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model.
  • the glucose exposure estimation model may define a relationship between the glucose exposure and a ratio of the first Raman peak value to the second Raman peak value.
  • the method may further include generating carbohydrate intake guide information based on the glucose exposure of the object.
  • the carbohydrate intake guide information may include information indicating whether a daily amount of carbohydrate intake of the object is adequate.
  • the generating the carbohydrate intake guide information may include calculating a daily amount of the glucose exposure by monitoring the glucose exposure of the object, determining whether the calculated daily amount of the glucose exposure is within a predetermined threshold range, and generating the carbohydrate intake guide information based on a determination of whether the calculated daily amount of the glucose exposure is within the predetermined threshold range.
  • an apparatus for measuring a glycemic index comprising: a spectrometer configured to detect an optical spectrum from a subject; a storage configured to store a relationship between a blood glucose area under a curve (AUC) and a ratio of a first reference peak value at a first wavenumber to a second reference peak value at a second wavenumber of a Raman spectrum; and a processor configured to extract a first measurement peak value at the first wavenumber and a second measurement peak value at the second wavenumber of the optical spectrum, and determine the glycemic index of the subject by applying the first measurement peak value and the second measurement peak value to the relationship between the blood glucose AUC and the ratio of the first reference peak value to the second reference peak value.
  • AUC blood glucose area under a curve
  • the first measurement peak value at the first wavenumber and the second measurement peak value at the second wavenumber of the optical spectrum may indicate information of proteins located at different depths from a skin surface of the subject.
  • each of the elements in the following description may perform a part or whole of the function of another element as well as its main function, and some of the main functions of each of the elements may be performed exclusively by other elements.
  • Each element may be realized in the form of a hardware component, a software component, and/or a combination thereof.
  • FIG. 1 is a block diagram illustrating an apparatus 100 for estimating glucose exposure according to one exemplary embodiment.
  • the apparatus 100 may estimate glucose exposure using depth-specific protein information based on Raman spectrum, and may be mounted in an electronic device.
  • the electronic device may include a mobile phone, a smartphone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, an MP3 player, a digital camera, a wearable device, and the like.
  • the wearable device may include a wristwatch type, a wristband type, a ring-type, a belt-type, a necklace type, an ankle-band type, a thigh-band type, a forearm band type, and the like.
  • the electronic device and the wearable device are not limited to the above examples.
  • the apparatus 100 includes a spectrometer 110 and a processor 120.
  • the spectrometer 110 may measure a plurality of Raman spectra from an object.
  • the spectrometer 110 may include a light source 111 and a photodetector 112, and may measure a plurality of Raman spectra at a predetermined time interval for a predetermined period of time by operating the light source 111 and the photodetector 112.
  • the spectrometer 110 may measure a Raman spectrum of the object at intervals of 5 minutes for 2 hours from when the object starts eating.
  • the light source 111 may emit a light to the object.
  • the light source 111 may emit a light of a specific wavelength, for example, in a near infrared ray (NIR) range or a mid-infrared ray (MIR) range to the object.
  • NIR near infrared ray
  • MIR mid-infrared ray
  • the wavelength of the light emitted from the light source 111 may vary according to the purpose of measurement or the type of constituent component to be measured.
  • the light source 111 may configured with a single light emitter, or a plurality of light emitters. The plurality of light-emitters may emit light of different wavelengths or light of the same wavelength.
  • the light source 111 may include, but not limited to, a light emitting diode (LED), a laser diode, or the like, which are merely illustrative examples.
  • the light source 111 may further include at least one optical element configured to direct the emitted light to a desired position of the object.
  • the photodetector 112 may acquire a Raman spectrum of the object by receiving light reflected or scattered from the object.
  • the photodetector 112 may include a photo diode, a photo transistor (PTr), a charge-coupled device (CCD), or the like.
  • the photodetector 112 may not be necessarily configured with a single element, and may be configured in the form of an array of a plurality of elements.
  • the processor 120 may extract depth-specific protein information from a plurality of measured Raman spectra, and estimate glucose exposure of the object based on the extracted depth-specific protein information.
  • the depth-specific information may include intradermal collagen information and intraepidermal keratin information, and the glucose exposure may be represented as an area under the curve (AUC) of a body glucose concentration graph.
  • processor 120 will be described in more detail with reference to FIG. 2 .
  • FIG. 2 is a block diagram illustrating a processor according to one exemplary embodiment.
  • the processor 200 of FIG. 2 may be one exemplary embodiment of the processor 120 of FIG. 1 .
  • the processor 200 includes a representative Raman spectrum extractor 210, a noise remover 220, a depth-specific protein information extractor 230, and a glucose exposure estimator 240.
  • the processor 200 may further store a glucose exposure estimation model 250 as shown in FIG. 2 , but according to another exemplary embodiment, the glucose exposure estimation model 250 may be stored in a memory located outside the processor 200 and may be retrieved from the memory and loaded to the processor 200 to perform an estimation based on the glucose exposure estimation model 250.
  • the representative Raman spectrum extractor 210 may extract a representative Raman spectrum from a plurality of Raman spectra. According to one exemplary embodiment, the representative Raman spectrum extractor 210 may extract a median spectrum from among the plurality of Raman spectra or a specific Raman spectrum having a predetermined sample number as the representative Raman spectrum. However, these are merely illustrative embodiments, and aspects of the present disclosure are not limited thereto.
  • the noise remover 220 may remove noise from the extracted representative Raman spectrum.
  • the Raman spectrum measured from a tissue or cells may include simple additive noise and background noise due to autofluorescence.
  • the noise remover 220 may remove the simple additive noise from the representative Raman spectrum using a low-band pass filter (e.g., a moving average filter).
  • the noise remover 220 may estimate a baseline of the representative Raman spectrum and remove the background noise by subtracting the baseline from the representative Raman spectrum.
  • the baseline may be estimated using a first-order differential method, a rolling ball method, or the like.
  • the first-order differential method uses characteristics of background noise exhibiting a gradual change throughout the entire range.
  • the first-order differential method is a method to estimate a baseline by differentiating a spectrum, finding a significant peak, cutting out the corresponding peak area, and performing interpolation.
  • the rolling ball method is a method of considering a trace of a highest point of a hypothetical ball that rolls underneath a spectrum as a baseline.
  • the depth-specific protein information extractor 230 may extract depth-specific protein information from the representative Raman spectrum.
  • the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • a light that is reflected from a subject may carry information about collagen in a dermal layer of the subject (hereinafter, referred to as "intradermal collagen information”) and information of keratin in an epidermal layer of the subject (hereinafter, referred to as “intraepidermal keratin information").
  • the depth-specific protein information extractor 230 may extract a Raman peak value (hereinafter, referred to as a "first Raman peak value”) of a first wave number (e.g., 1246 cm -1 ) in the representative Raman spectrum as the intradermal collagen information and extract a Raman peak value (hereinafter, referred to as a "second Raman peak value") of a second wave number (e.g., 1650 cm -1 ) as the intraepidermal keratin information.
  • the first wave number is related to the intradermal collagen information
  • the second wave number is related to the intraepidermal keratin information
  • information on the first and second wave numbers is experimentally derived in advance and stored in an internal or external database.
  • the glucose exposure estimator 240 may estimate the glucose exposure of the object using the depth-specific protein information.
  • the glucose exposure estimator 240 may determine a ratio of the first Raman peak value and the second Raman peak value and estimate the glucose exposure of the object using the ratio of the first Raman peak value and the second Raman peak value and the glucose exposure estimation model 250.
  • the glucose exposure estimation model 250 defines a relationship between the ratio of the first Raman peak value and the second Raman peak value and the glucose exposure, and may be stored in a database inside or outside the processor 200.
  • FIG. 3 is a graph for describing a relationship between Raman peak shift corresponding to intradermal collagen and glucose exposure. More specifically, FIG. 3 shows a Raman peak shift corresponding to the intradermal collagen when a predetermined amount of glucose is continuously fed to a non-human animal.
  • the Raman peak shift may be obtained by emitting a light to the non-human animal and then collecting the light when it is reflected from the non-human animal.
  • a Raman peak at a specific wave number (e.g., a region indicated by a leftmost box in FIG. 3 ) changes over time while the predetermined amount of glucose is continuously fed to the non-human animal.
  • the apparatus 100 for estimating glucose exposure may extract depth-specific protein information from the Raman spectrum using such a characteristic and estimate the glucose exposure using the extracted depth-specific protein information.
  • FIG. 4 is a block diagram illustrating a processor according to another exemplary embodiment of the present disclosure.
  • a processor 400 of FIG. 4 may be another exemplary embodiment of the processor 120 of FIG. 1 .
  • the processor 400 includes a representative Raman spectrum extractor 210, a noise remover 220, a depth-specific protein information extractor 230, a glucose exposure estimator 240, and a guide information generator 410.
  • the processor 400 may further store the glucose exposure estimation model 250 as shown in FIG. 4 , but according to another exemplary embodiment, the glucose exposure estimation model 250 may be stored in a memory located outside the processor 400 and may be retrieved from the memory and loaded to the processor 400 to perform an estimation based on the glucose exposure estimation model 250
  • the representative Raman spectrum extractor 210, the noise remover 220, the depth-specific protein information extractor 230, and the glucose exposure estimator 240 may be substantially the same as those described with reference to FIG. 2 , and thus detailed descriptions thereof will not be reiterated.
  • the guide information generator 410 may generate carbohydrate intake guide information that indicates whether a daily amount of carbohydrate intake of the object is adequate by using the glucose exposure of the object.
  • the guide information generator 410 may monitor the glucose exposure of the object to calculate daily glucose exposure and determine whether the calculated daily glucose exposure falls within a predetermined threshold range. In addition, when the daily glucose exposure is within the predetermined threshold range, the guide information generator 410 may determine that a carbohydrate intake amount is adequate. When the daily glucose exposure is less than the predetermined threshold range, the guide information generator 410 may determine that the daily amount of carbohydrate intake is insufficient, and when the daily glucose exposure is greater than the predetermined threshold range, the guide information generator 410 may determine that the daily amount of carbohydrate intake is excessive. The guide information generator 410 may generate carbohydrate intake guide information that indicates whether or not the daily amount of carbohydrate intake of the object is adequate based on the determination.
  • the predetermined threshold range may be derived through the following procedures in advance and stored in a database inside or outside the processor 400.
  • FIG. 5 shows graphs illustrating an example of carbohydrate intake guide information.
  • the guide information generator 410 may calculate a daily glucose exposure based on glucose exposure estimated at breakfast time, lunch time, and dinner time, determine whether the calculated daily glucose exposure is within a predetermined threshold range 520 of a recommended amount of glucose intake, and generate carbohydrate intake guide information 510 based on the determination of whether the calculated daily glucose exposure is within the predetermined threshold range 520.
  • the guide information generator 410 may determine that carbohydrate intake on the first day and the seventh day is excessive, and hence may generate various warning messages.
  • FIG. 6 is a block diagram illustrating an apparatus 600 for estimating glucose exposure according to another exemplary embodiment.
  • the apparatus 600 may estimate the amount of glucose exposure using depth-specific protein information based on a Raman spectrum.
  • the apparatus 600 may be mounted in an electronic device, for example, such as a mobile phone, a smartphone, a tablet computer, a notebook computer, a PDA, a PMP, a navigation system, an MP3 player, a digital camera, a wearable device, and the like.
  • the wearable device may include a wristwatch type, a wristband type, a ring-type, a belt-type, a necklace type, an ankle-band type, a thigh-band type, a forearm band type, and the like.
  • the electronic device and the wearable device are not limited to the above examples.
  • the apparatus 600 includes a spectrometer 110, a processor 120, an input interface 610, a storage 620, a communication interface 630, and an output interface 640.
  • the spectrometer 110 and the processor 120 may perform substantially the same operations as those described with reference to FIGS. 1 to 4 , and hence detailed descriptions thereof will not be reiterated.
  • the input interface 610 may receive various operation signals from a user.
  • the input interface 610 may include a keypad, a dome switch, a resistive or capacitive touch pad, a jog wheel, a jog switch, a hardware button, and the like.
  • this structure may be referred to as a touch screen.
  • Programs or instructions for operations of the apparatus 600 may be stored in the storage 620 and data input to and output from the apparatus 600 may also be stored in the storage 620.
  • a plurality of pieces of Raman spectrum data measured by the spectrometer 110, representative Raman spectrum data extracted by the processor 120, depth-specific protein information extracted by the processor 120, glucose exposure estimate data obtained by the processor 120, carbohydrate intake guide information generated by the processor 120, and a glucose exposure estimation model, and the like may be stored in the storage 620.
  • the storage may include at least one type of storage media, such as a flash memory, a hard disk type memory, a multimedia card micro type memory, a card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, and optical disk.
  • the apparatus 600 may operate an external storage medium, such as web storage providing a storage function of the storage 620.
  • the communication interface 630 may communicate with an external device.
  • the communication interface 630 may transmit the data input from the user through the input interface 610, the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, and the glucose exposure estimation model to the external device, or may receive a variety of data to estimate the glucose exposure or generating the carbohydrate guide information from the external device.
  • the external device may be a medical device that uses the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, or the glucose exposure estimation model, or a printer or a display device to output a result.
  • the external device may be a digital TV, a desktop computer, a mobile phone, a smartphone, a tablet computer, a notebook computer, a PDA, a PMP, a navigation system, an MP3 player, a digital camera, a wearable device, or the like, but is not limited thereto.
  • the communication interface 630 may communicate with the external device through various communication schemes, such as Bluetooth communication, Bluetooth low energy communication, near field communication (NFC), wireless local area network (WLAN) communication, ZigBee communication, infrared data association (IrDA) communication, radio frequency identification communication, 3 rd generation (3G) communication, 4G communication, 5G communication, and the like.
  • Bluetooth communication Bluetooth low energy communication
  • NFC near field communication
  • WLAN wireless local area network
  • ZigBee communication ZigBee communication
  • IrDA infrared data association
  • radio frequency identification communication 3 rd generation (3G) communication
  • 4G communication 4G communication
  • 5G communication and the like.
  • these are merely examples, and the communication scheme is not limited thereto.
  • the output interface 640 may output the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, or the glucose exposure estimation model.
  • the output interface 640 may output the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, or the glucose exposure estimation model in at least one of visual, audible, and tactile manners.
  • the output interface 640 may include a display, a speaker, a vibrator, and the like.
  • FIG. 7 is a block diagram illustrating an apparatus 700 for generating a glucose exposure estimation model according to one exemplary embodiment.
  • the apparatus 700 may estimate a glucose exposure estimation model to be used in the apparatus 100 of FIG. 1 and/or the apparatus of FIG. 6 for estimating glucose exposure, and may be mounted in an electronic device.
  • the electronic device may include a mobile phone, a smartphone, a tablet computer, a notebook computer, a PDA, a PMP, a navigation system, an MP3 player, a digital camera, a wearable device, and the like.
  • the wearable device may include a wristwatch type, a wristband type, a ring-type, a belt-type, a necklace type, an ankle-band type, a thigh-band type, a forearm band type, and the like.
  • the electronic device and the wearable device are not limited to the above examples.
  • the apparatus 700 may include a training data collector 710 and a processor 720.
  • the training data collector 710 may collect a Raman spectrum and glucose exposure information corresponding to the Raman spectrum as training data.
  • the Raman spectrum collected as the training data may be a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time, or a representative Raman spectrum extracted from the plurality of Raman spectra.
  • the Raman spectrum collected as the training data may be raw data from which noise has not been removed or data from which noise has removed.
  • the processor 720 may obtain depth-specific protein information from the collected Raman spectrum and may generate a glucose exposure estimation model based on the extracted depth-specific protein information and glucose exposure data corresponding to the Raman spectrum.
  • the processor 720 may obtain the glucose exposure data by calculating an area under a blood glucose response curve that is measured for two hours since food is consumed.
  • the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • the processor 720 may extract a first Raman peak value from the Raman spectrum as the intradermal collagen information and extract a second Raman peak value as the intraepidermal keratin information.
  • the processor 720 may calculate a ratio of the first Raman peak value and the second Raman peak value and generate the glucose exposure estimation model through regression analysis or machine learning using the ratio of the first Raman peak value and the second Raman peak value and the corresponding glucose exposure information.
  • a regression analysis algorithm may include a simple linear regression algorithm, a multi-linear regression algorithm, a logistic regression algorithm, a proportional Cox regression algorithm, and the like
  • a machine learning algorithm may include an artificial neural network algorithm, a decision tree algorithm, a genetic algorithm, a genetic programming algorithm, a K-nearest neighbor algorithm, a radial basis function network algorithm, a random forest algorithm, a support vector machine algorithm, and a deep learning algorithm.
  • the processor 720 may perform various preprocessing operations according to the Raman spectrum collected by the training data collector 710. For example, when the collected Raman spectrum is raw data, the processor may remove simple additive noise and/or background noise from the collected Raman spectrum. In addition, when the collected Raman spectrum data is a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time, the processor 720 may extract a representative Raman spectrum from the plurality of Raman spectra.
  • FIG. 8 shows graphs for describing a glucose exposure estimation model generation process.
  • a Raman spectrum collected as training data is a representative Raman spectrum extracted from a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time and all the noise is removed therefrom.
  • a Raman spectrum 810 may show a change in a collagen peak value according to an amount of glucose exposure.
  • Amide I and Amide III bands may be observed at approximately 1,650 and 1,246 cm -1 .
  • the measured Amide I band may reflect alpha-helix structure found in epidermal keratin, and the measured Amide III may reflect components in a dermal layer.
  • the processor 720 extracts a first Raman peak value (e.g., a Raman peak value at 1246 cm -1 ) from a Raman spectrum 810 as intradermal collagen information and extracts a second Raman peak value (e.g., a Raman peak value at 1650 cm -1 ) as intraepidermal keratin information.
  • the processor 720 calculates a ratio of the first Raman peak value to the second Raman peak value, and calculates an area under a two-hour blood glucose response curve, as a corresponding glucose exposure 820.
  • the processor 720 generates a glucose exposure estimation model 830 by performing a regression analysis of the ratio of the first Raman peak value to the second Raman peak value and the corresponding glucose exposure 820.
  • the storage 620 may store a glucose exposure estimation model that indicates a relationship between an area under the curve (AUC) of a blood glucose graph (e.g., the glucose exposure 820) and the ratio of the first Raman peak value at wavenumber 1246 cm -1 to the second Raman peak value at 1650 cm -1 of the Raman spectrum 810.
  • AUC area under the curve
  • the processor 120 may detect a first measurement peak value and a second measurement peak value at wavenumber 1246 cm -1 and wavenumber 1650 cm -1 of the detected optical spectrum, respectively, and may apply the first measurement peak value and the second measurement peak to the glucose exposure estimation model to determine a glycemic index.
  • FIG. 9 is a flowchart illustrating a method of estimating glucose exposure according to one exemplary embodiment of the present disclosure. The method of FIG. 9 may be performed by the apparatus 100 of FIG. 1 for estimating glucose exposure.
  • the apparatus 100 for estimating glucose exposure measures a plurality of Raman spectra from the object in operation 910.
  • the apparatus 100 may measure the plurality of Raman spectrum by emitting light to the object at a predetermined time interval for a predetermined period of time and receiving light reflected or scattered from the object.
  • the apparatus 100 may emit light of a specific wavelength, for example, in an NIR range or an MIR range to the object, but aspects of the present disclosure are not limited thereto.
  • the apparatus 100 extracts depth-specific protein information from the plurality of measured Raman spectra in operation 920.
  • the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • the apparatus 100 may extract a first Raman peak value related to the intradermal collagen information and a second Raman peak value related to the intraepidermal keratin information from the plurality of Raman spectra.
  • the apparatus 100 estimates glucose exposure of the object using the extracted depth-specific protein information in operation 930.
  • the apparatus 100 may estimate the glucose exposure of the object using the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model.
  • the glucose exposure estimation model may define a relationship between a ratio of the first Raman peak value and the second Raman peak value and the glucose exposure.
  • FIG. 10 is a flowchart illustrating a method of extracting depth-specific protein information according to one exemplary embodiment.
  • the method of FIG. 10 may be one exemplary embodiment of the operation 920 for extracting depth-specific protein information shown in FIG. 9 .
  • the apparatus 100 for estimating glucose exposure extracts a representative Raman spectrum from a plurality of Raman spectra in operation 1010.
  • the apparatus 100 may extract a median spectrum of the plurality of Raman spectra as the representative Raman spectrum, or extract a Raman spectrum of a predetermined sample number as the representative Raman spectrum.
  • the apparatus 100 remove noise from the extracted representative Raman spectrum in operation 1020.
  • the apparatus 100 may remove simple additive noise from the representative Raman spectrum using a low-band pass filter, or may remove noise by estimating a baseline of the representative Raman spectrum and subtracting the estimated baseline from the representative Raman spectrum.
  • the apparatus 100 extracts depth-specific protein information from the representative Raman spectrum in operation 1030.
  • the apparatus 100 may extract a first Raman peak value related to intradermal collagen information and a second Raman peak value related to intraepidermal keratin information from the representative Raman spectrum.
  • FIG. 11 is a flowchart illustrating a method of estimating glucose exposure according to another exemplary embodiment.
  • the method of FIG. 11 may be performed by the apparatus 100 of FIG. 1 for estimating glucose exposure.
  • operations 1110, 1120, and 1130 are substantially the same as operations 910, 920, and 930, and thus detailed descriptions thereof will not be reiterated.
  • the apparatus 100 for estimating glucose exposure generates carbohydrate intake guide information indicating whether or not a daily amount of carbohydrate intake of an object is adequate based on the glucose exposure estimated in operation 1130.
  • the apparatus 100 may calculate a daily glucose exposure by monitoring the glucose exposure of the object and determine whether the calculated daily glucose exposure is within a predetermined threshold range.
  • the apparatus 100 may determine that the carbohydrate intake of the object is adequate, and when the calculated daily glucose exposure is less than the predetermined threshold range, determine that the carbohydrate intake is insufficient.
  • the apparatus 100 may determine that the carbohydrate intake is excessive.
  • the apparatus 100 may generate carbohydrate intake guide information indicating whether the daily amount of carbohydrate intake of the object is adequate based on the determination.
  • FIG. 12 is a flowchart illustrating a method of generating a glucose exposure estimation model according to one exemplary embodiment. The method of FIG. 12 may be performed by the apparatus 700 of FIG. 7 for generating a glucose exposure estimation model.
  • the apparatus 700 for generating a glucose exposure estimation model collects a Raman spectrum and glucose exposure information corresponding to the Raman spectrum as training data.
  • the Raman spectrum collected as the training data may be a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time, or may be a representative Raman spectrum extracted from the plurality of Raman spectra.
  • the Raman spectrum collected as the training data may be raw data from which noise has not been removed, or data from which noise has been removed.
  • the apparatus 700 may extract depth-specific protein information from the collected Raman spectrum and generate a glucose exposure estimation model based on the extracted depth-specific protein information and glucose exposure information corresponding to the Raman spectrum data.
  • the processor 720 may obtain the glucose exposure information by calculating an area under a blood glucose response curve that is measured for two hours after food is consumed.
  • the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • the apparatus 700 may extract a first Raman peak value as the intradermal collagen information and a second Raman peak value as the intraepidermal keratin information from the Raman spectrum.
  • the apparatus 700 may generate the glucose exposure estimation model through regression analysis or machine learning using a ratio of the first Raman peak value and the second Raman peak value and the corresponding glucose exposure data,
  • the apparatus 700 may perform various preprocessing operations according to the collected Raman spectrum. For example, when the collected Raman spectrum is raw data, the apparatus 700 may remove simple additive noise and/or background noise from the Raman spectrum data. In addition, when the collected data is a plurality of Raman spectra measured at the predetermined time interval for the predetermined period of time, the apparatus 700 may extract a representative Raman spectrum from the plurality of Raman spectra.
  • FIG. 13 is a perspective view of a wrist wearable device.
  • the wrist wearable device 1300 includes a strap 1310 and a main body 1320.
  • the strap 1310 may be configured in the form of a flexible band, but this is merely an example, and aspects of the present disclosure are not limited thereto. That is, the strap 1310 may be configured with a plurality of strap members formed to be bent to surround a wrist of a user.
  • the above-described apparatus 100 or 600 for estimating glucose exposure and/or the apparatus 700 for generating a glucose exposure estimation model may be mounted in the main body 1320.
  • a battery may be embedded in the main body 1320 to supply power to the wrist wearable device 1300, the apparatus 100 or 600 for estimating glucose exposure, and the apparatus 700 for generating a glucose exposure estimation model.
  • the wrist wearable device 1300 may further include an input interface 1321 and a display 1322 which are mounted in the main body 1320.
  • the input interface 1321 may receive various operation signals from the user.
  • the display 1322 may display data processed by the wrist wearable device 1300, the apparatus 100 or 600 for estimating glucose exposure and the apparatus 700 for generating a glucose exposure estimation model and processing result data.
  • an exemplary embodiment can be embodied as computer-readable code on a computer-readable recording medium.
  • the computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.
  • the computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion.
  • an exemplary embodiment may be written as a computer program transmitted over a computer-readable transmission medium, such as a carrier wave, and received and implemented in general-use or special-purpose digital computers that execute the programs.
  • one or more units of the above-described apparatuses and devices can include circuitry, a processor, a microprocessor, etc., and may execute a computer program stored in a computer-readable medium.

Abstract

An apparatus for estimating a glucose exposure may include: a spectrometer configured to measure a plurality of Raman spectra from an object; and a processor configured to extract depth-specific protein information from the plurality of Raman spectra and estimate the glucose exposure of the object based on the depth-specific protein information.

Description

    BACKGROUND 1. Field
  • Apparatuses and methods consistent with exemplary embodiments relate to a technology for non-invasively estimating glucose exposure, and more particularly, to estimating glucose exposure using depth-specific protein information based on a Raman spectrum and generating a glucose exposure estimation model for estimating the glucose exposure.
  • 2. Description of Related Art
  • Protein response in a human body varies depending on a food source. In addition, different types of food are digested at different rates even when the same amounts are ingested. A glycemic index (GI) has been introduced as a way of expressing the rapidity with which a variety of carbohydrate sources are absorbed. The glycemic index is a value given to indicate a quality of carbohydrate by taking into account the rapidity in which the carbohydrate in food is absorbed after meal consumption. The glycemic index (GI) of a food may be determined by feeding a group of healthy people a portion of the food containing 50 grams of carbohydrate and then measuring the change in their blood glucose levels over the next 2 hours. A reference value of GI = 100 may be used to represent an equivalent amount of pure glucose.
  • However, the glycemic index has limitations in taking into account characteristics of each individual (e.g., a degree of response to insulin and a degree of stress) or reflecting their actual dietary lifestyle because glycemic indexes are based on individual foods, but most people eat food in combinations within a meal.
  • SUMMARY
  • Exemplary embodiments address at least the above problems and/or disadvantages and other disadvantages not described above. Also, the exemplary embodiments are not required to overcome the disadvantages described above, and may not overcome any of the problems described above.
  • According to an aspect of an exemplary embodiment, there is provided an apparatus for estimating a glucose exposure, including: a spectrometer configured to measure a plurality of Raman spectra from an object; and a processor configured to extract depth-specific protein information from the plurality of Raman spectra and estimate the glucose exposure of the object based on the depth-specific protein information.
  • The spectrometer may include a light source configured to emit a light to the object and a photodetector configured to acquire the plurality of Raman spectra by receiving the light reflected or scattered from the object.
  • The spectrometer may be configured to measure the plurality of Raman spectra at a predetermined time interval for a predetermined period of time.
  • The processor may be further configured to extract a representative Raman spectrum from the plurality of Raman spectra and extract the depth-specific protein information from the representative Raman spectrum.
  • The processor may be further configured to extract a median spectrum of the plurality of Raman spectra as the representative Raman spectrum.
  • The processor may be further configured to extract a Raman spectrum of a predetermined sample number from the plurality of Raman spectra as the representative Raman spectrum.
  • The processor may be further configured to remove background noise from the extracted representative Raman spectrum.
  • The depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • The processor may be further configured to extract a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the plurality of Raman spectra and estimate the glucose exposure of the object based on the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model.
  • The glucose exposure estimation model may define a relationship between the glucose exposure and a ratio of the first Raman peak value to the second Raman peak value.
  • The processor may be further configured to generate carbohydrate intake guide information based on the glucose exposure of the object.
  • The carbohydrate intake guide information may include information indicating whether a daily amount of carbohydrate intake of the object is adequate.
  • The processor may be further configured to calculate a daily amount of the glucose exposure by monitoring the glucose exposure of the object, determine whether the calculated daily amount of the glucose exposure is within a predetermined threshold range, and generate the carbohydrate guide information based on a result of the determination of whether the calculated daily amount is within the predetermined threshold range
  • According to an aspect of another exemplary embodiment, there is provided an apparatus for generating a glucose exposure estimation model, the apparatus including: a data collector configured to collect a Raman spectrum and glucose exposure information corresponding to the Raman spectrum; and a processor configured to extract depth-specific protein information from the Raman spectrum and generate the glucose exposure estimation model based on the depth-specific protein information and the glucose exposure information.
  • The depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • The processor may be further configured to extract a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the Raman spectrum and generate the glucose exposure estimation model through regression analysis or machine learning based on a ratio of the first Raman peak value to the second Raman peak value and the glucose exposure data.
  • According to an aspect of another exemplary embodiment, there is provided a method of estimating glucose exposure, the method including: measuring a plurality of Raman spectra from an object; extracting depth-specific protein information from the plurality of Raman spectra; and estimating a glucose exposure of the object based on the depth-specific protein information.
  • The measuring the plurality of Raman spectra may include measuring the plurality of Raman spectra at a predetermined time interval for a predetermined period of time.
  • The extracting the depth-specific protein information may include extracting a representative Raman spectrum from the plurality of Raman spectra and extracting the depth-specific protein information from the representative Raman spectrum.
  • The extracting the representative Raman spectrum may include extracting a median spectrum of the plurality of Raman spectra as the representative Raman spectrum.
  • The extracting the representative Raman spectrum may include extracting a Raman spectrum of a predetermined sample number from the plurality of Raman spectra as the representative Raman spectrum.
  • The extracting the depth-specific protein information may further include removing background noise from the extracted representative Raman spectrum.
  • The depth-specific information may include intradermal collagen information and intraepidermal keratin information.
  • The extracting the depth-specific protein information may include extracting a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the plurality of Raman spectra, and wherein the estimating the glucose exposure of the object may include estimating the glucose exposure of the object using the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model.
  • The glucose exposure estimation model may define a relationship between the glucose exposure and a ratio of the first Raman peak value to the second Raman peak value.
  • The method may further include generating carbohydrate intake guide information based on the glucose exposure of the object.
  • The carbohydrate intake guide information may include information indicating whether a daily amount of carbohydrate intake of the object is adequate.
  • The generating the carbohydrate intake guide information may include calculating a daily amount of the glucose exposure by monitoring the glucose exposure of the object, determining whether the calculated daily amount of the glucose exposure is within a predetermined threshold range, and generating the carbohydrate intake guide information based on a determination of whether the calculated daily amount of the glucose exposure is within the predetermined threshold range.
  • According to an aspect of another exemplary embodiment, there is provided an apparatus for measuring a glycemic index, the apparatus comprising: a spectrometer configured to detect an optical spectrum from a subject; a storage configured to store a relationship between a blood glucose area under a curve (AUC) and a ratio of a first reference peak value at a first wavenumber to a second reference peak value at a second wavenumber of a Raman spectrum; and a processor configured to extract a first measurement peak value at the first wavenumber and a second measurement peak value at the second wavenumber of the optical spectrum, and determine the glycemic index of the subject by applying the first measurement peak value and the second measurement peak value to the relationship between the blood glucose AUC and the ratio of the first reference peak value to the second reference peak value.
  • The first measurement peak value at the first wavenumber and the second measurement peak value at the second wavenumber of the optical spectrum may indicate information of proteins located at different depths from a skin surface of the subject.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and/or other aspects will be more apparent by describing certain exemplary embodiments, with reference to the accompanying drawings, in which:
    • FIG. 1 is a block diagram illustrating an apparatus for estimating glucose exposure according to one exemplary embodiment;
    • FIG. 2 is a block diagram illustrating a processor according to one exemplary embodiment;
    • FIG. 3 is a graph for describing a relationship between Raman peak shift corresponding to intradermal collagen and glucose exposure;
    • FIG. 4 is a block diagram illustrating a processor according to another exemplary embodiment;
    • FIG. 5 shows graphs illustrating an example of carbohydrate intake guide information;
    • FIG. 6 is a block diagram illustrating an apparatus for estimating glucose exposure according to another exemplary embodiment;
    • FIG. 7 is a block diagram illustrating an apparatus for generating a glucose exposure estimation model according to one exemplary embodiment;
    • FIG. 8 shows graphs for describing a glucose exposure estimation model generation process;
    • FIG. 9 is a flowchart illustrating a method of estimating glucose exposure according to one exemplary embodiment;
    • FIG. 10 is a flowchart illustrating a method of extracting depth-specific protein information according to one exemplary embodiment;
    • FIG. 11 is a flowchart illustrating a method of estimating glucose exposure according to another exemplary embodiment;
    • FIG. 12 is a flowchart illustrating a method of generating a glucose exposure estimation model according to one exemplary embodiment;
    • FIG. 13 is a perspective view of a wrist wearable device.
    DETAILED DESCRIPTION
  • Exemplary embodiments are described in greater detail below with reference to the accompanying drawings.
  • In the following description, like drawing reference numerals are used for like elements, even in different drawings. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters. Also, well-known functions or constructions are not described in detail since they would obscure the description with unnecessary detail.
  • It should be noted that in some alternative implementations, the functions/acts noted in the blocks may occur out of the order noted in the flowcharts. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
  • Terms described in below are selected by considering functions in the embodiment and meanings may vary depending on, for example, a user or operator's intentions or customs. Therefore, in the following embodiments, when terms are specifically defined, the meanings of terms should be interpreted based on definitions, and otherwise, should be interpreted based on general meanings recognized by those skilled in the art.
  • As used herein, the singular forms are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," or "includes" and/or "including" when used in this description, specify the presence of stated features, numbers, steps, operations, elements, components or combinations thereof, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, elements, components or combinations thereof.
  • Expressions such as "at least one of," when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.
  • It will also be understood that the elements or components in the following description are discriminated in accordance with their respective main functions. In other words, two or more elements may be made into one element or one element may be divided into two or more elements in accordance with a subdivided function. Additionally, each of the elements in the following description may perform a part or whole of the function of another element as well as its main function, and some of the main functions of each of the elements may be performed exclusively by other elements. Each element may be realized in the form of a hardware component, a software component, and/or a combination thereof.
  • FIG. 1 is a block diagram illustrating an apparatus 100 for estimating glucose exposure according to one exemplary embodiment. The apparatus 100 may estimate glucose exposure using depth-specific protein information based on Raman spectrum, and may be mounted in an electronic device. In particular, the electronic device may include a mobile phone, a smartphone, a tablet computer, a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, an MP3 player, a digital camera, a wearable device, and the like. The wearable device may include a wristwatch type, a wristband type, a ring-type, a belt-type, a necklace type, an ankle-band type, a thigh-band type, a forearm band type, and the like. However, the electronic device and the wearable device are not limited to the above examples.
  • Referring to FIG. 1, the apparatus 100 includes a spectrometer 110 and a processor 120.
  • The spectrometer 110 may measure a plurality of Raman spectra from an object. According to one exemplary embodiment, the spectrometer 110 may include a light source 111 and a photodetector 112, and may measure a plurality of Raman spectra at a predetermined time interval for a predetermined period of time by operating the light source 111 and the photodetector 112. For example, the spectrometer 110 may measure a Raman spectrum of the object at intervals of 5 minutes for 2 hours from when the object starts eating.
  • The light source 111 may emit a light to the object. In particular, the light source 111 may emit a light of a specific wavelength, for example, in a near infrared ray (NIR) range or a mid-infrared ray (MIR) range to the object. However, the wavelength of the light emitted from the light source 111 may vary according to the purpose of measurement or the type of constituent component to be measured. In addition, the light source 111 may configured with a single light emitter, or a plurality of light emitters. The plurality of light-emitters may emit light of different wavelengths or light of the same wavelength. According to one exemplary embodiment, the light source 111 may include, but not limited to, a light emitting diode (LED), a laser diode, or the like, which are merely illustrative examples.
  • The light source 111 may further include at least one optical element configured to direct the emitted light to a desired position of the object.
  • The photodetector 112 may acquire a Raman spectrum of the object by receiving light reflected or scattered from the object. According to one exemplary embodiment, the photodetector 112 may include a photo diode, a photo transistor (PTr), a charge-coupled device (CCD), or the like. The photodetector 112 may not be necessarily configured with a single element, and may be configured in the form of an array of a plurality of elements.
  • The processor 120 may extract depth-specific protein information from a plurality of measured Raman spectra, and estimate glucose exposure of the object based on the extracted depth-specific protein information. In this case, the depth-specific information may include intradermal collagen information and intraepidermal keratin information, and the glucose exposure may be represented as an area under the curve (AUC) of a body glucose concentration graph.
  • Hereinafter, the processor 120 will be described in more detail with reference to FIG. 2.
  • FIG. 2 is a block diagram illustrating a processor according to one exemplary embodiment. The processor 200 of FIG. 2 may be one exemplary embodiment of the processor 120 of FIG. 1.
  • Referring to FIG. 2, the processor 200 includes a representative Raman spectrum extractor 210, a noise remover 220, a depth-specific protein information extractor 230, and a glucose exposure estimator 240. The processor 200 may further store a glucose exposure estimation model 250 as shown in FIG. 2, but according to another exemplary embodiment, the glucose exposure estimation model 250 may be stored in a memory located outside the processor 200 and may be retrieved from the memory and loaded to the processor 200 to perform an estimation based on the glucose exposure estimation model 250.
  • The representative Raman spectrum extractor 210 may extract a representative Raman spectrum from a plurality of Raman spectra. According to one exemplary embodiment, the representative Raman spectrum extractor 210 may extract a median spectrum from among the plurality of Raman spectra or a specific Raman spectrum having a predetermined sample number as the representative Raman spectrum. However, these are merely illustrative embodiments, and aspects of the present disclosure are not limited thereto.
  • The noise remover 220 may remove noise from the extracted representative Raman spectrum.
  • The Raman spectrum measured from a tissue or cells may include simple additive noise and background noise due to autofluorescence.
  • According to one exemplary embodiment, the noise remover 220 may remove the simple additive noise from the representative Raman spectrum using a low-band pass filter (e.g., a moving average filter). In addition, the noise remover 220 may estimate a baseline of the representative Raman spectrum and remove the background noise by subtracting the baseline from the representative Raman spectrum. In this case, the baseline may be estimated using a first-order differential method, a rolling ball method, or the like. Here, the first-order differential method uses characteristics of background noise exhibiting a gradual change throughout the entire range. The first-order differential method is a method to estimate a baseline by differentiating a spectrum, finding a significant peak, cutting out the corresponding peak area, and performing interpolation. In addition, the rolling ball method is a method of considering a trace of a highest point of a hypothetical ball that rolls underneath a spectrum as a baseline.
  • The depth-specific protein information extractor 230 may extract depth-specific protein information from the representative Raman spectrum. In this case, the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • A light that is reflected from a subject may carry information about collagen in a dermal layer of the subject (hereinafter, referred to as "intradermal collagen information") and information of keratin in an epidermal layer of the subject (hereinafter, referred to as "intraepidermal keratin information"). According to one exemplary embodiment, the depth-specific protein information extractor 230 may extract a Raman peak value (hereinafter, referred to as a "first Raman peak value") of a first wave number (e.g., 1246 cm-1) in the representative Raman spectrum as the intradermal collagen information and extract a Raman peak value (hereinafter, referred to as a "second Raman peak value") of a second wave number (e.g., 1650 cm-1) as the intraepidermal keratin information. In this case, the first wave number is related to the intradermal collagen information, the second wave number is related to the intraepidermal keratin information, and information on the first and second wave numbers is experimentally derived in advance and stored in an internal or external database.
  • The glucose exposure estimator 240 may estimate the glucose exposure of the object using the depth-specific protein information.
  • For example, the glucose exposure estimator 240 may determine a ratio of the first Raman peak value and the second Raman peak value and estimate the glucose exposure of the object using the ratio of the first Raman peak value and the second Raman peak value and the glucose exposure estimation model 250. In particular, the glucose exposure estimation model 250 defines a relationship between the ratio of the first Raman peak value and the second Raman peak value and the glucose exposure, and may be stored in a database inside or outside the processor 200.
  • FIG. 3 is a graph for describing a relationship between Raman peak shift corresponding to intradermal collagen and glucose exposure. More specifically, FIG. 3 shows a Raman peak shift corresponding to the intradermal collagen when a predetermined amount of glucose is continuously fed to a non-human animal. The Raman peak shift may be obtained by emitting a light to the non-human animal and then collecting the light when it is reflected from the non-human animal.
  • Referring to FIG. 3, a Raman peak at a specific wave number (e.g., a region indicated by a leftmost box in FIG. 3) changes over time while the predetermined amount of glucose is continuously fed to the non-human animal.
  • Therefore, the apparatus 100 for estimating glucose exposure according to one exemplary embodiment may extract depth-specific protein information from the Raman spectrum using such a characteristic and estimate the glucose exposure using the extracted depth-specific protein information.
  • FIG. 4 is a block diagram illustrating a processor according to another exemplary embodiment of the present disclosure. A processor 400 of FIG. 4 may be another exemplary embodiment of the processor 120 of FIG. 1.
  • Referring to FIG. 4, the processor 400 includes a representative Raman spectrum extractor 210, a noise remover 220, a depth-specific protein information extractor 230, a glucose exposure estimator 240, and a guide information generator 410. The processor 400 may further store the glucose exposure estimation model 250 as shown in FIG. 4, but according to another exemplary embodiment, the glucose exposure estimation model 250 may be stored in a memory located outside the processor 400 and may be retrieved from the memory and loaded to the processor 400 to perform an estimation based on the glucose exposure estimation model 250
  • In this case, the representative Raman spectrum extractor 210, the noise remover 220, the depth-specific protein information extractor 230, and the glucose exposure estimator 240 may be substantially the same as those described with reference to FIG. 2, and thus detailed descriptions thereof will not be reiterated.
  • The guide information generator 410 may generate carbohydrate intake guide information that indicates whether a daily amount of carbohydrate intake of the object is adequate by using the glucose exposure of the object.
  • For example, the guide information generator 410 may monitor the glucose exposure of the object to calculate daily glucose exposure and determine whether the calculated daily glucose exposure falls within a predetermined threshold range. In addition, when the daily glucose exposure is within the predetermined threshold range, the guide information generator 410 may determine that a carbohydrate intake amount is adequate. When the daily glucose exposure is less than the predetermined threshold range, the guide information generator 410 may determine that the daily amount of carbohydrate intake is insufficient, and when the daily glucose exposure is greater than the predetermined threshold range, the guide information generator 410 may determine that the daily amount of carbohydrate intake is excessive. The guide information generator 410 may generate carbohydrate intake guide information that indicates whether or not the daily amount of carbohydrate intake of the object is adequate based on the determination.
  • In this case, the predetermined threshold range may be derived through the following procedures in advance and stored in a database inside or outside the processor 400.
    • Step 1: An object takes a reference food and a first glucose exposure is measured. For example, the first glucose exposure X (unit: mg-min/dL) is measured when the object takes an amount K of reference food (unit: grams (g)). Specifically, the processor 200, 400 may generate a two-hour blood glucose response curve by monitoring a blood sugar level of the object for two hours since the object consumes the K amount of the reference food. The processor 200, 400 may calculate an area under the curve (AUC) as the first glucose exposure X.
    • Step 2: A second glucose exposure corresponding to a recommended daily amount of carbohydrate intake is calculated. For example, when a recommended daily amount of carbohydrate intake is A (unit: g), the second glucose exposure R corresponding to the recommended daily amount A of carbohydrate is calculated based on the following equation: A * X / K = R unit : mg min / dL .
      Figure imgb0001
    • Step 3: A third glucose exposure incurring when all the recommended daily calories are obtained only from carbohydrates is calculated. For example, when recommended daily calories are B (unit: kcal), the third glucose exposure T incurring when all the recommended daily calories B are obtained only from carbohydrates is calculated based on the following equation: B / X / K * 4 = T unit : mg min / dL .
      Figure imgb0002
    • Step 4: The third glucose exposure is assumed as a maximum amount of carbohydrate intake, and a predetermined range from the glucose exposure corresponding to the recommended daily amount of carbohydrate intake is set to be in a predetermined threshold range. For example, the predetermined threshold range may be R-α to R+β. In this case, α may be variously set as a positive number less than R and β may be variously set as a positive number less than T-R.
  • FIG. 5 shows graphs illustrating an example of carbohydrate intake guide information.
  • Referring to FIGS. 4 and 5, the guide information generator 410 may calculate a daily glucose exposure based on glucose exposure estimated at breakfast time, lunch time, and dinner time, determine whether the calculated daily glucose exposure is within a predetermined threshold range 520 of a recommended amount of glucose intake, and generate carbohydrate intake guide information 510 based on the determination of whether the calculated daily glucose exposure is within the predetermined threshold range 520.
  • In the example shown in FIG. 5, in which the daily glucose exposure on the first day and the seventh day is out of the predetermined threshold range 520, the guide information generator 410 may determine that carbohydrate intake on the first day and the seventh day is excessive, and hence may generate various warning messages.
  • FIG. 6 is a block diagram illustrating an apparatus 600 for estimating glucose exposure according to another exemplary embodiment. The apparatus 600 may estimate the amount of glucose exposure using depth-specific protein information based on a Raman spectrum. The apparatus 600 may be mounted in an electronic device, for example, such as a mobile phone, a smartphone, a tablet computer, a notebook computer, a PDA, a PMP, a navigation system, an MP3 player, a digital camera, a wearable device, and the like. The wearable device may include a wristwatch type, a wristband type, a ring-type, a belt-type, a necklace type, an ankle-band type, a thigh-band type, a forearm band type, and the like. However, the electronic device and the wearable device are not limited to the above examples.
  • Referring to FIG. 6, the apparatus 600 includes a spectrometer 110, a processor 120, an input interface 610, a storage 620, a communication interface 630, and an output interface 640. In this case, the spectrometer 110 and the processor 120 may perform substantially the same operations as those described with reference to FIGS. 1 to 4, and hence detailed descriptions thereof will not be reiterated.
  • The input interface 610 may receive various operation signals from a user. According to one exemplary embodiment, the input interface 610 may include a keypad, a dome switch, a resistive or capacitive touch pad, a jog wheel, a jog switch, a hardware button, and the like. In particular, when a touch pad has a layered structure with a display, this structure may be referred to as a touch screen.
  • Programs or instructions for operations of the apparatus 600 may be stored in the storage 620 and data input to and output from the apparatus 600 may also be stored in the storage 620. In addition, a plurality of pieces of Raman spectrum data measured by the spectrometer 110, representative Raman spectrum data extracted by the processor 120, depth-specific protein information extracted by the processor 120, glucose exposure estimate data obtained by the processor 120, carbohydrate intake guide information generated by the processor 120, and a glucose exposure estimation model, and the like may be stored in the storage 620.
  • The storage may include at least one type of storage media, such as a flash memory, a hard disk type memory, a multimedia card micro type memory, a card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, and optical disk. In addition, the apparatus 600 may operate an external storage medium, such as web storage providing a storage function of the storage 620.
  • The communication interface 630 may communicate with an external device. For example, the communication interface 630 may transmit the data input from the user through the input interface 610, the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, and the glucose exposure estimation model to the external device, or may receive a variety of data to estimate the glucose exposure or generating the carbohydrate guide information from the external device.
  • In this case, the external device may be a medical device that uses the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, or the glucose exposure estimation model, or a printer or a display device to output a result. In addition, the external device may be a digital TV, a desktop computer, a mobile phone, a smartphone, a tablet computer, a notebook computer, a PDA, a PMP, a navigation system, an MP3 player, a digital camera, a wearable device, or the like, but is not limited thereto.
  • The communication interface 630 may communicate with the external device through various communication schemes, such as Bluetooth communication, Bluetooth low energy communication, near field communication (NFC), wireless local area network (WLAN) communication, ZigBee communication, infrared data association (IrDA) communication, radio frequency identification communication, 3rd generation (3G) communication, 4G communication, 5G communication, and the like. However, these are merely examples, and the communication scheme is not limited thereto.
  • The output interface 640 may output the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, or the glucose exposure estimation model. According to one exemplary embodiment, the output interface 640 may output the plurality of pieces of Raman spectrum data measured by the spectrometer 110, the representative Raman spectrum data extracted by the processor 120, the depth-specific protein information extracted by the processor 120, the glucose exposure estimate data obtained by the processor 120, the carbohydrate intake guide information generated by the processor 120, or the glucose exposure estimation model in at least one of visual, audible, and tactile manners. To this end, the output interface 640 may include a display, a speaker, a vibrator, and the like.
  • FIG. 7 is a block diagram illustrating an apparatus 700 for generating a glucose exposure estimation model according to one exemplary embodiment. The apparatus 700 may estimate a glucose exposure estimation model to be used in the apparatus 100 of FIG. 1 and/or the apparatus of FIG. 6 for estimating glucose exposure, and may be mounted in an electronic device. In this case, the electronic device may include a mobile phone, a smartphone, a tablet computer, a notebook computer, a PDA, a PMP, a navigation system, an MP3 player, a digital camera, a wearable device, and the like. The wearable device may include a wristwatch type, a wristband type, a ring-type, a belt-type, a necklace type, an ankle-band type, a thigh-band type, a forearm band type, and the like. However, the electronic device and the wearable device are not limited to the above examples.
  • As shown in FIG. 7, the apparatus 700 may include a training data collector 710 and a processor 720.
  • The training data collector 710 may collect a Raman spectrum and glucose exposure information corresponding to the Raman spectrum as training data. In particular, the Raman spectrum collected as the training data may be a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time, or a representative Raman spectrum extracted from the plurality of Raman spectra. In addition, the Raman spectrum collected as the training data may be raw data from which noise has not been removed or data from which noise has removed.
  • The processor 720 may obtain depth-specific protein information from the collected Raman spectrum and may generate a glucose exposure estimation model based on the extracted depth-specific protein information and glucose exposure data corresponding to the Raman spectrum. The processor 720 may obtain the glucose exposure data by calculating an area under a blood glucose response curve that is measured for two hours since food is consumed. The depth-specific protein information may include intradermal collagen information and intraepidermal keratin information.
  • For example, the processor 720 may extract a first Raman peak value from the Raman spectrum as the intradermal collagen information and extract a second Raman peak value as the intraepidermal keratin information. In addition, the processor 720 may calculate a ratio of the first Raman peak value and the second Raman peak value and generate the glucose exposure estimation model through regression analysis or machine learning using the ratio of the first Raman peak value and the second Raman peak value and the corresponding glucose exposure information. In this case, a regression analysis algorithm may include a simple linear regression algorithm, a multi-linear regression algorithm, a logistic regression algorithm, a proportional Cox regression algorithm, and the like, and a machine learning algorithm may include an artificial neural network algorithm, a decision tree algorithm, a genetic algorithm, a genetic programming algorithm, a K-nearest neighbor algorithm, a radial basis function network algorithm, a random forest algorithm, a support vector machine algorithm, and a deep learning algorithm.
  • Meanwhile, the processor 720 may perform various preprocessing operations according to the Raman spectrum collected by the training data collector 710. For example, when the collected Raman spectrum is raw data, the processor may remove simple additive noise and/or background noise from the collected Raman spectrum. In addition, when the collected Raman spectrum data is a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time, the processor 720 may extract a representative Raman spectrum from the plurality of Raman spectra.
  • In this case, a method of removing noise and a method of extracting a spectrum are substantially the same as those described with reference to FIG. 2, and hence detailed descriptions thereof will not be reiterated.
  • FIG. 8 shows graphs for describing a glucose exposure estimation model generation process. In FIG. 8, it is assumed that a Raman spectrum collected as training data is a representative Raman spectrum extracted from a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time and all the noise is removed therefrom.
  • With reference to FIG. 8, a Raman spectrum 810 may show a change in a collagen peak value according to an amount of glucose exposure. In the Raman spectrum 810, Amide I and Amide III bands may be observed at approximately 1,650 and 1,246 cm-1. The measured Amide I band may reflect alpha-helix structure found in epidermal keratin, and the measured Amide III may reflect components in a dermal layer.
  • Referring to FIGS. 7 and 8, the processor 720 extracts a first Raman peak value (e.g., a Raman peak value at 1246 cm-1) from a Raman spectrum 810 as intradermal collagen information and extracts a second Raman peak value (e.g., a Raman peak value at 1650 cm-1) as intraepidermal keratin information. The processor 720 calculates a ratio of the first Raman peak value to the second Raman peak value, and calculates an area under a two-hour blood glucose response curve, as a corresponding glucose exposure 820. In turn, the processor 720 generates a glucose exposure estimation model 830 by performing a regression analysis of the ratio of the first Raman peak value to the second Raman peak value and the corresponding glucose exposure 820.
  • With reference to FIGS. 6 and 8, the storage 620 may store a glucose exposure estimation model that indicates a relationship between an area under the curve (AUC) of a blood glucose graph (e.g., the glucose exposure 820) and the ratio of the first Raman peak value at wavenumber 1246 cm-1 to the second Raman peak value at 1650 cm-1 of the Raman spectrum 810. When the spectrometer 110 detects an optical spectrum, the processor 120 may detect a first measurement peak value and a second measurement peak value at wavenumber 1246 cm-1 and wavenumber 1650 cm-1 of the detected optical spectrum, respectively, and may apply the first measurement peak value and the second measurement peak to the glucose exposure estimation model to determine a glycemic index.
  • FIG. 9 is a flowchart illustrating a method of estimating glucose exposure according to one exemplary embodiment of the present disclosure. The method of FIG. 9 may be performed by the apparatus 100 of FIG. 1 for estimating glucose exposure.
  • Referring to FIGS. 1 and 9, the apparatus 100 for estimating glucose exposure measures a plurality of Raman spectra from the object in operation 910. For example, the apparatus 100 may measure the plurality of Raman spectrum by emitting light to the object at a predetermined time interval for a predetermined period of time and receiving light reflected or scattered from the object. In this case, the apparatus 100 may emit light of a specific wavelength, for example, in an NIR range or an MIR range to the object, but aspects of the present disclosure are not limited thereto.
  • The apparatus 100 extracts depth-specific protein information from the plurality of measured Raman spectra in operation 920. In this case, the depth-specific protein information may include intradermal collagen information and intraepidermal keratin information. For example, the apparatus 100 may extract a first Raman peak value related to the intradermal collagen information and a second Raman peak value related to the intraepidermal keratin information from the plurality of Raman spectra.
  • The apparatus 100 estimates glucose exposure of the object using the extracted depth-specific protein information in operation 930. For example, the apparatus 100 may estimate the glucose exposure of the object using the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model. In this case, the glucose exposure estimation model may define a relationship between a ratio of the first Raman peak value and the second Raman peak value and the glucose exposure.
  • FIG. 10 is a flowchart illustrating a method of extracting depth-specific protein information according to one exemplary embodiment. The method of FIG. 10 may be one exemplary embodiment of the operation 920 for extracting depth-specific protein information shown in FIG. 9.
  • Referring to FIGS. 1 and 10, the apparatus 100 for estimating glucose exposure extracts a representative Raman spectrum from a plurality of Raman spectra in operation 1010. For example, the apparatus 100 may extract a median spectrum of the plurality of Raman spectra as the representative Raman spectrum, or extract a Raman spectrum of a predetermined sample number as the representative Raman spectrum.
  • The apparatus 100 remove noise from the extracted representative Raman spectrum in operation 1020. For example, the apparatus 100 may remove simple additive noise from the representative Raman spectrum using a low-band pass filter, or may remove noise by estimating a baseline of the representative Raman spectrum and subtracting the estimated baseline from the representative Raman spectrum.
  • The apparatus 100 extracts depth-specific protein information from the representative Raman spectrum in operation 1030. For example, the apparatus 100 may extract a first Raman peak value related to intradermal collagen information and a second Raman peak value related to intraepidermal keratin information from the representative Raman spectrum.
  • FIG. 11 is a flowchart illustrating a method of estimating glucose exposure according to another exemplary embodiment. The method of FIG. 11 may be performed by the apparatus 100 of FIG. 1 for estimating glucose exposure. Here, operations 1110, 1120, and 1130 are substantially the same as operations 910, 920, and 930, and thus detailed descriptions thereof will not be reiterated.
  • In operation 1140, the apparatus 100 for estimating glucose exposure generates carbohydrate intake guide information indicating whether or not a daily amount of carbohydrate intake of an object is adequate based on the glucose exposure estimated in operation 1130. For example, the apparatus 100 may calculate a daily glucose exposure by monitoring the glucose exposure of the object and determine whether the calculated daily glucose exposure is within a predetermined threshold range. In addition, when the calculated daily glucose exposure is within the predetermined threshold range, the apparatus 100 may determine that the carbohydrate intake of the object is adequate, and when the calculated daily glucose exposure is less than the predetermined threshold range, determine that the carbohydrate intake is insufficient. In addition, when the calculated daily glucose exposure is greater than the predetermined threshold range, the apparatus 100 may determine that the carbohydrate intake is excessive. The apparatus 100 may generate carbohydrate intake guide information indicating whether the daily amount of carbohydrate intake of the object is adequate based on the determination.
  • FIG. 12 is a flowchart illustrating a method of generating a glucose exposure estimation model according to one exemplary embodiment. The method of FIG. 12 may be performed by the apparatus 700 of FIG. 7 for generating a glucose exposure estimation model.
  • Referring to FIGS. 7 and 12, the apparatus 700 for generating a glucose exposure estimation model collects a Raman spectrum and glucose exposure information corresponding to the Raman spectrum as training data. In this case, the Raman spectrum collected as the training data may be a plurality of Raman spectra measured at a predetermined time interval for a predetermined period of time, or may be a representative Raman spectrum extracted from the plurality of Raman spectra. In addition, the Raman spectrum collected as the training data may be raw data from which noise has not been removed, or data from which noise has been removed.
  • The apparatus 700 may extract depth-specific protein information from the collected Raman spectrum and generate a glucose exposure estimation model based on the extracted depth-specific protein information and glucose exposure information corresponding to the Raman spectrum data. The processor 720 may obtain the glucose exposure information by calculating an area under a blood glucose response curve that is measured for two hours after food is consumed. The depth-specific protein information may include intradermal collagen information and intraepidermal keratin information. For example, the apparatus 700 may extract a first Raman peak value as the intradermal collagen information and a second Raman peak value as the intraepidermal keratin information from the Raman spectrum. In addition, the apparatus 700 may generate the glucose exposure estimation model through regression analysis or machine learning using a ratio of the first Raman peak value and the second Raman peak value and the corresponding glucose exposure data,
  • Meanwhile, the apparatus 700 may perform various preprocessing operations according to the collected Raman spectrum. For example, when the collected Raman spectrum is raw data, the apparatus 700 may remove simple additive noise and/or background noise from the Raman spectrum data. In addition, when the collected data is a plurality of Raman spectra measured at the predetermined time interval for the predetermined period of time, the apparatus 700 may extract a representative Raman spectrum from the plurality of Raman spectra.
  • FIG. 13 is a perspective view of a wrist wearable device.
  • Referring to FIG. 13, the wrist wearable device 1300 includes a strap 1310 and a main body 1320.
  • The strap 1310 may be configured in the form of a flexible band, but this is merely an example, and aspects of the present disclosure are not limited thereto. That is, the strap 1310 may be configured with a plurality of strap members formed to be bent to surround a wrist of a user.
  • The above-described apparatus 100 or 600 for estimating glucose exposure and/or the apparatus 700 for generating a glucose exposure estimation model may be mounted in the main body 1320. In addition, a battery may be embedded in the main body 1320 to supply power to the wrist wearable device 1300, the apparatus 100 or 600 for estimating glucose exposure, and the apparatus 700 for generating a glucose exposure estimation model.
  • The wrist wearable device 1300 may further include an input interface 1321 and a display 1322 which are mounted in the main body 1320. The input interface 1321 may receive various operation signals from the user. The display 1322 may display data processed by the wrist wearable device 1300, the apparatus 100 or 600 for estimating glucose exposure and the apparatus 700 for generating a glucose exposure estimation model and processing result data.
  • While not restricted thereto, an exemplary embodiment can be embodied as computer-readable code on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Also, an exemplary embodiment may be written as a computer program transmitted over a computer-readable transmission medium, such as a carrier wave, and received and implemented in general-use or special-purpose digital computers that execute the programs. Moreover, it is understood that in exemplary embodiments, one or more units of the above-described apparatuses and devices can include circuitry, a processor, a microprocessor, etc., and may execute a computer program stored in a computer-readable medium.
  • The foregoing exemplary embodiments are merely exemplary and are not to be construed as limiting. The present teaching can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments is intended to be illustrative, and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.

Claims (15)

  1. An apparatus for estimating a glucose exposure, the apparatus comprising:
    a spectrometer configured to measure a plurality of Raman spectra from an object; and
    a processor configured to extract depth-specific protein information from the plurality of Raman spectra and estimate the glucose exposure of the object based on the depth-specific protein information.
  2. The apparatus of claim 1, wherein the spectrometer comprises:
    a light source configured to emit a light to the object; and
    a photodetector configured to acquire the plurality of Raman spectra by receiving the light reflected or scattered from the object.
  3. The apparatus of claim 1 or 2, wherein the spectrometer is further configured to measure the plurality of Raman spectra at a predetermined time interval for a predetermined period of time.
  4. The apparatus of any one of claims 1 to 3, wherein the processor is further configured to extract a representative Raman spectrum from the plurality of Raman spectra and extract the depth-specific protein information from the representative Raman spectrum.
  5. The apparatus of claim 4, wherein the processor is further configured to extract a median spectrum of the plurality of Raman spectra as the representative Raman spectrum; and/or
    wherein the processor is further configured to extract a Raman spectrum of a predetermined sample number from the plurality of Raman spectra as the representative Raman spectrum; and/or
    wherein the processor is further configured to remove background noise from the extracted representative Raman spectrum.
  6. The apparatus of any one of claims 1 to 5, wherein the depth-specific protein information comprises intradermal collagen information and intraepidermal keratin information.
  7. The apparatus of claim 6, wherein the processor is further configured to extract a first Raman peak value corresponding to the intradermal collagen information and a second Raman peak value corresponding to the intraepidermal keratin information from the plurality of Raman spectra, and estimate the glucose exposure of the object based on the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model;
    preferably, wherein the glucose exposure estimation model defines a relationship between the glucose exposure and a ratio of the first Raman peak value to the second Raman peak value.
  8. The apparatus of any one of claims 1 to 7, wherein the processor is further configured to generate carbohydrate intake guide information based on the glucose exposure of the object;
    preferably, wherein the carbohydrate intake guide information comprises information indicating whether a daily amount of carbohydrate intake of the object is adequate; and/or
    preferably, wherein the processor is further configured to determine a daily amount of the glucose exposure by monitoring the glucose exposure of the object, determine whether the calculated daily amount of the glucose exposure is within a predetermined threshold range, and generate the carbohydrate guide information based on a result of the determination of whether the calculated daily amount is within the predetermined threshold range.
  9. A method of estimating glucose exposure, the method comprising:
    measuring a plurality of Raman spectra from an object;
    extracting depth-specific protein information from the plurality of Raman spectra; and
    estimating a glucose exposure of the object based on the depth-specific protein information.
  10. The method of claim 9, wherein the measuring the plurality of Raman spectra comprises measuring the plurality of Raman spectra at a predetermined time interval for a predetermined period of time.
  11. The method of claim 9 or 10, wherein the extracting the depth-specific protein information comprises:
    extracting a representative Raman spectrum from the plurality of Raman spectra; and
    extracting the depth-specific protein information from the representative Raman spectrum.
    preferably, wherein the extracting the representative Raman spectrum comprises extracting a median spectrum of the plurality of Raman spectra as the representative Raman spectrum; and/or
    preferably, wherein the extracting the representative Raman spectrum comprises extracting a Raman spectrum of a predetermined sample number from the plurality of Raman spectra as the representative Raman spectrum; and/or
    preferably, wherein the extracting the depth-specific protein information further comprises removing background noise from the extracted representative Raman spectrum.
  12. The method of any one of claims 9 to 11, wherein the depth-specific information comprises intradermal collagen information and intraepidermal keratin information.
  13. The method of any one of claims 9 to 12, wherein the extracting the depth-specific protein information comprises extracting a first Raman peak value corresponding to intradermal collagen information and a second Raman peak value corresponding to intraepidermal keratin information from the plurality of Raman spectra, and
    wherein the estimating the glucose exposure of the object comprises estimating the glucose exposure of the object using the first Raman peak value, the second Raman peak value, and a glucose exposure estimation model;
    preferably, wherein the glucose exposure estimation model defines a relationship between the glucose exposure and a ratio of the first Raman peak value to the second Raman peak value.
  14. The method of any one of claims 9 to 13, further comprising generating carbohydrate intake guide information based on the glucose exposure of the object.
  15. The method of claim 14, wherein the carbohydrate intake guide information comprises information indicating whether a daily amount of carbohydrate intake of the object is adequate; and/or
    wherein the generating the carbohydrate intake guide information comprises:
    determining a daily amount of the glucose exposure by monitoring the glucose exposure of the object;
    determining whether the calculated daily amount of the glucose exposure is within a predetermined threshold range; and
    generating the carbohydrate intake guide information based on a determination of whether the calculated daily amount of the glucose exposure is within the predetermined threshold range.
EP18194967.8A 2017-09-18 2018-09-18 Apparatus and method for estimating glucose exposure and generating glucose exposure estimation model Active EP3456247B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020170119277A KR102408951B1 (en) 2017-09-18 2017-09-18 Apparatus and method for estimating glucose exposure, Apparatus and method for generating glucose exposure estimation model

Publications (2)

Publication Number Publication Date
EP3456247A1 true EP3456247A1 (en) 2019-03-20
EP3456247B1 EP3456247B1 (en) 2021-12-22

Family

ID=63762196

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18194967.8A Active EP3456247B1 (en) 2017-09-18 2018-09-18 Apparatus and method for estimating glucose exposure and generating glucose exposure estimation model

Country Status (5)

Country Link
US (2) US11020027B2 (en)
EP (1) EP3456247B1 (en)
JP (1) JP7165542B2 (en)
KR (1) KR102408951B1 (en)
CN (1) CN109520989A (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR112020020417A2 (en) * 2018-04-06 2021-01-12 Braskem America, Inc. METHOD FOR DETERMINING THE QUALITY OF A POLYMER BASED ON A RAMAN SPECTRUM OF THE POLYMER, MEASUREABLE BY A NON-TRANSITIONAL COMPUTER, AND A POLYMER PROPERTY COMPUTER DEVICE.
WO2021042079A1 (en) * 2019-08-30 2021-03-04 TT1 Products, Inc. Biomarker monitoring fitness system
US11284818B2 (en) 2020-08-31 2022-03-29 TT1 Products, Inc. Glucose exposure diagnostics and therapeutics related thereto
KR102532757B1 (en) * 2020-09-24 2023-05-12 서강대학교산학협력단 Apparatus for predicting dissolved gas concentration in aqueous solution based on Raman spectral signal and method therefor
CN112754479A (en) * 2020-12-21 2021-05-07 四川大学华西医院 Method and equipment for detecting blood glucose concentration
CN113317782B (en) * 2021-04-20 2022-03-22 港湾之星健康生物(深圳)有限公司 Multimode personalized monitoring method
USD1004777S1 (en) 2021-09-01 2023-11-14 TT1 Products, Inc. Wrist reader
KR102590718B1 (en) 2023-05-30 2023-10-19 주식회사 아폴론 Apparatus for measuring blood glucose continuously based on raman signal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050090750A1 (en) * 2002-04-04 2005-04-28 Ediger Marwood N. Determination of disease state using Raman Spectroscopy of tissue
US20070060806A1 (en) * 2005-04-27 2007-03-15 Martin Hunter Raman spectroscopy for non-invasive glucose measurements
WO2016034448A1 (en) * 2014-09-04 2016-03-10 Rsp Systems A/S Method and apparatus for transdermal in vivo measurement by raman spectroscopy

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7066884B2 (en) 1998-01-08 2006-06-27 Sontra Medical, Inc. System, method, and device for non-invasive body fluid sampling and analysis
US6064897A (en) 1998-06-01 2000-05-16 Abbott Laboratories Sensor utilizing Raman spectroscopy for non-invasive monitoring of analytes in biological fluid and method of use
ATE225142T1 (en) 1998-07-07 2002-10-15 Lightouch Medical Inc TISSUE MODULATION METHOD FOR QUANTITATIVE NON-INVASIVE IN VIVO SPECTROSCOPIC ANALYSIS OF TISSUE
US7395158B2 (en) 2000-05-30 2008-07-01 Sensys Medical, Inc. Method of screening for disorders of glucose metabolism
US6487429B2 (en) 2000-05-30 2002-11-26 Sensys Medical, Inc. Use of targeted glycemic profiles in the calibration of a noninvasive blood glucose monitor
US20020132279A1 (en) 2000-05-30 2002-09-19 Linda Hockersmith Formula to manipulate blood glucose via the calculated ingestion of carbohydrate
US7050842B2 (en) 2000-07-11 2006-05-23 Lightouch Medical, Inc. Method of tissue modulation for noninvasive measurement of an analyte
US20040197846A1 (en) 2001-01-18 2004-10-07 Linda Hockersmith Determination of glucose sensitivity and a method to manipulate blood glucose concentration
US20040142403A1 (en) 2001-08-13 2004-07-22 Donald Hetzel Method of screening for disorders of glucose metabolism
AU2002332915A1 (en) 2001-09-07 2003-03-24 Argose, Inc. Portable non-invasive glucose monitor
US6998247B2 (en) 2002-03-08 2006-02-14 Sensys Medical, Inc. Method and apparatus using alternative site glucose determinations to calibrate and maintain noninvasive and implantable analyzers
JP2004321325A (en) 2003-04-22 2004-11-18 Matsushita Electric Works Ltd Method of quantitating blood glucose level
ATE539674T1 (en) 2003-04-24 2012-01-15 Univ Texas NON-INVASIVE BLOOD ANALYSIS BY OPTICAL PROBING OF THE VEINS UNDER THE TONGUE
WO2005047870A2 (en) 2003-11-12 2005-05-26 Lightouch Medical, Inc. Absolute calibration process and device for a tissue modulated raman spectrometer
US20060060019A1 (en) 2004-08-23 2006-03-23 Calsonic Kansei Corporation Vehicular automatic transmission and automatic selector thereof
US9103793B2 (en) * 2005-07-22 2015-08-11 Massachusetts Institute Of Technology Intrinsic Raman spectroscopy
JP2007175242A (en) 2005-12-27 2007-07-12 Sharp Corp Measuring instrument, measuring program and computer-readable recording medium
JP5101306B2 (en) * 2006-01-31 2012-12-19 興和株式会社 Diabetes treatment
US8685952B2 (en) 2006-01-31 2014-04-01 Kowa Co., Ltd. Method for the treatment of diabetes
US7672702B2 (en) 2007-03-13 2010-03-02 Samsung Electronics Co., Ltd. Noninvasive in vivo measuring system and noninvasive in vivo measuring method by correcting influence of Hemoglobin
US7873397B2 (en) * 2007-06-19 2011-01-18 Richard Higgins Spectroscopic optical system
WO2009038908A1 (en) 2007-08-13 2009-03-26 C8 Medisensors Inc. Calibrated analyte concentration measurements in mixtures
JP2010005047A (en) 2008-06-25 2010-01-14 Panasonic Electric Works Co Ltd Method for generating calibration model for optically measuring biological component and non-invasive apparatus for measuring blood glucose value
AU2010259071B2 (en) 2009-06-09 2014-07-24 Biosensors, Inc. Non-invasive monitoring of blood metabolite levels
GB201000179D0 (en) 2010-01-07 2010-02-24 Rsp Systems As Apparatus for non-invasive in vivo measurement by raman spectroscopy
US9538943B1 (en) 2010-10-29 2017-01-10 William Howard Cross Blood glucose monitor and method of use thereof
JP5815362B2 (en) 2011-10-17 2015-11-17 シスメックス株式会社 Glucose tolerance analyzer, glucose tolerance analysis system and computer program
JP2015510423A (en) 2012-02-21 2015-04-09 アイキエ,ナタリア Formulas and methods for generating monitoring individual metabolic responses and predictive clinical indicators
US10188325B2 (en) 2012-03-09 2019-01-29 Rinat O. Esenaliev Wearable, noninvasive glucose sensing methods and systems
US9766126B2 (en) 2013-07-12 2017-09-19 Zyomed Corp. Dynamic radially controlled light input to a noninvasive analyzer apparatus and method of use thereof
WO2014116701A2 (en) * 2013-01-22 2014-07-31 Park Nicollet Institute Evaluation and display of glucose data
KR102261856B1 (en) 2014-08-12 2021-06-07 삼성전자주식회사 Non-invasive measuring device for bio-analyte and non-invasive measuring method for bio-analyte
KR102303829B1 (en) 2014-09-03 2021-09-17 삼성전자주식회사 Noninvasive apparatus for testing glycated hemoglobin and noninvasive method for testing glycated hemoglobin
KR102349961B1 (en) 2015-01-22 2022-01-11 삼성전자주식회사 Health care apparatus and method of operating of the apparatus
US10548520B2 (en) 2015-04-01 2020-02-04 Santec Corporation Non-invasive optical measurement of blood analyte
KR20160126502A (en) 2015-04-23 2016-11-02 홍충식 Non Invasive Glucose Meter Using NIR Spectroscopy
US9924894B2 (en) * 2015-06-03 2018-03-27 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Non-invasive measurement of skin thickness and glucose concentration with Raman spectroscopy and method of calibration thereof
KR20170038351A (en) 2015-09-30 2017-04-07 최규동 Continous Glucose Measuremrnt System with Flexsible Probe
RU2626672C2 (en) 2015-11-11 2017-07-31 Самсунг Электроникс Ко., Лтд. Device (versions) and method for eating habits automated monitoring

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050090750A1 (en) * 2002-04-04 2005-04-28 Ediger Marwood N. Determination of disease state using Raman Spectroscopy of tissue
US20070060806A1 (en) * 2005-04-27 2007-03-15 Martin Hunter Raman spectroscopy for non-invasive glucose measurements
WO2016034448A1 (en) * 2014-09-04 2016-03-10 Rsp Systems A/S Method and apparatus for transdermal in vivo measurement by raman spectroscopy

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANNIKA M. K. ENEJDER ET AL: "Raman spectroscopy for noninvasive glucose measurements", JOURNAL OF BIOMEDICAL OPTICS, vol. 10, no. 3, 1 January 2005 (2005-01-01), pages 031114, XP055018261, ISSN: 1083-3668, DOI: 10.1117/1.1920212 *

Also Published As

Publication number Publication date
EP3456247B1 (en) 2021-12-22
KR102408951B1 (en) 2022-06-13
JP7165542B2 (en) 2022-11-04
KR20190031621A (en) 2019-03-27
US20190083013A1 (en) 2019-03-21
US11642050B2 (en) 2023-05-09
CN109520989A (en) 2019-03-26
JP2019053061A (en) 2019-04-04
US20210244321A1 (en) 2021-08-12
US11020027B2 (en) 2021-06-01

Similar Documents

Publication Publication Date Title
US11642050B2 (en) Apparatus and method for estimating glucose exposure and generating glucose exposure estimation model
EP3657142A1 (en) Apparatus for measuring spectrum, method of correcting temperature change of light source in spectrum, and apparatus and method for estimating analyte concentration
US11197635B2 (en) Healthcare apparatus and operating method thereof
EP3598937B1 (en) Antioxidant sensor, antioxidant signal obtaining method, and antioxidant level determining method
US11564599B2 (en) Apparatus and method for obtaining individualized unit spectrum, and apparatus and method for estimating biological component
EP3607875A1 (en) Estimating analyte concentration using raman spectroscopy
EP3632309A1 (en) Apparatus and method for estimating analyte concentration
KR102640331B1 (en) Apparatus and method for estimating bio-information, and apparatus for supporting bio-information estimation
EP3782538A1 (en) Apparatus and method for estimating bio-information
US11350878B2 (en) Apparatus and method for estimating bio-information
EP3649942A1 (en) Optical sensor, method of measuring optical signal, and apparatus for estimating blood concentration of analyte
EP3632311B1 (en) Apparatus for estimating blood concentration of analyte, and method for generating model
US20240138722A1 (en) Apparatus and method for measuring triglyceride level
US11872032B2 (en) Apparatus and method for estimating analyte concentration
KR102658237B1 (en) Apparatus and method for estimating blood concentration of analyte, and apparatus and method for generating model
US20220233149A1 (en) Apparatus and method for estimating body component
US20200121230A1 (en) Apparatus and method for estimating analyte concentration
WO2023195020A1 (en) Electronic ring for monitoring blood glucose levels

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190920

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200629

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210806

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018028443

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1456543

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220322

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20211222

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1456543

Country of ref document: AT

Kind code of ref document: T

Effective date: 20211222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220322

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220323

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220422

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018028443

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220422

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

26N No opposition filed

Effective date: 20220923

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20220930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20211222

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230520

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220918

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220930

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220918

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220930

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230821

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230821

Year of fee payment: 6

Ref country code: DE

Payment date: 20230822

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180918