WO2014141001A1 - Device and method for determining the blood oxygen saturation of a subject - Google Patents
Device and method for determining the blood oxygen saturation of a subject Download PDFInfo
- Publication number
- WO2014141001A1 WO2014141001A1 PCT/IB2014/059449 IB2014059449W WO2014141001A1 WO 2014141001 A1 WO2014141001 A1 WO 2014141001A1 IB 2014059449 W IB2014059449 W IB 2014059449W WO 2014141001 A1 WO2014141001 A1 WO 2014141001A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- oxygen saturation
- blood oxygen
- skin pixels
- skin
- subject
- Prior art date
Links
- 239000008280 blood Substances 0.000 title claims abstract description 169
- 210000004369 blood Anatomy 0.000 title claims abstract description 169
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 title claims abstract description 157
- 229910052760 oxygen Inorganic materials 0.000 title claims abstract description 157
- 239000001301 oxygen Substances 0.000 title claims abstract description 157
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000008859 change Effects 0.000 claims abstract description 32
- 230000005670 electromagnetic radiation Effects 0.000 claims abstract description 25
- 230000005855 radiation Effects 0.000 claims description 26
- 238000003384 imaging method Methods 0.000 claims description 23
- 230000003595 spectral effect Effects 0.000 claims description 18
- 206010021143 Hypoxia Diseases 0.000 claims description 9
- 230000001146 hypoxic effect Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 7
- 238000012935 Averaging Methods 0.000 claims description 3
- 238000013186 photoplethysmography Methods 0.000 description 26
- 238000005259 measurement Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 11
- 238000012544 monitoring process Methods 0.000 description 6
- 230000001419 dependent effect Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000029058 respiratory gaseous exchange Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 238000010521 absorption reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 210000001061 forehead Anatomy 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 230000000541 pulsatile effect Effects 0.000 description 3
- 238000002106 pulse oximetry Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 3
- 102000001554 Hemoglobins Human genes 0.000 description 2
- 108010054147 Hemoglobins Proteins 0.000 description 2
- 238000004566 IR spectroscopy Methods 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 2
- 238000002835 absorbance Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000006213 oxygenation reaction Methods 0.000 description 2
- 230000002028 premature Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000009885 systemic effect Effects 0.000 description 2
- 230000002792 vascular Effects 0.000 description 2
- 208000018262 Peripheral vascular disease Diseases 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000037424 autonomic function Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008081 blood perfusion Effects 0.000 description 1
- 230000036772 blood pressure Effects 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 238000011088 calibration curve Methods 0.000 description 1
- 230000000747 cardiac effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 210000000624 ear auricle Anatomy 0.000 description 1
- 230000002526 effect on cardiovascular system Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000031700 light absorption Effects 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 230000010412 perfusion Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000010349 pulsation Effects 0.000 description 1
- 230000035484 reaction time Effects 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000000241 respiratory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
- A61B5/14552—Details of sensors specially adapted therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02416—Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
- G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30076—Plethysmography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
- G06T2207/30104—Vascular flow; Blood flow; Perfusion
Definitions
- the present invention relates to a device and a method for determining the blood oxygen saturation of a subject.
- the present invention relates to an unobtrusive optical measurement approach which can be used for detecting the arterial blood oxygen saturation in an observed subject, such as a person or animal.
- optical measurement refers to photoplethysmography (PPG) and, more specifically, to pulse oximetry.
- Vital signs of a person for example the heart rate (HR), the respiration rate (RR) or the blood oxygen saturation, serve as indicators of the current state of a person and as powerful predictors of serious medical events. For this reason, vital signs are extensively monitored in inpatient and outpatient care settings, at home or in further health, leisure and fitness settings.
- HR heart rate
- RR respiration rate
- blood oxygen saturation serve as indicators of the current state of a person and as powerful predictors of serious medical events. For this reason, vital signs are extensively monitored in inpatient and outpatient care settings, at home or in further health, leisure and fitness settings.
- Plethysmography generally refers to the measurement of volume changes of an organ or a body part and in particular to the detection of volume changes due to a cardio-vascular pulse wave traveling through the body of a subject with every heart beat.
- Photoplethysmography is an optical measurement technique that evaluates a time-variant change of light reflectance or transmission of an area or volume of interest.
- PPG is based on the principle that blood absorbs light more than surrounding tissue, so variations in blood volume with every heart beat affect transmission and reflectance correspondingly.
- a PPG waveform can comprise information attributable to further physiological phenomena such as the respiration.
- a typical pulse oximeter comprises a red LED and an infrared LED as light sources and one photodiode for detecting light that has been transmitted through patient tissue.
- Commercially available pulse oximeters quickly switch between measurements at a red and an infrared wavelength and thereby measure the transmissivity of the same area or volume of tissue at two different wavelengths. This is referred to as time-division- multiplexing.
- blood oxygen saturation often refers to the average blood or tissue oxygen saturation in many research and medical fields which is generally different from the arterial oxygen saturation or Sp02.
- Pulse oximeters generally do not measure tissue saturation, rather they measure the arterial oxygen saturation which is typically quite a bit higher than the average blood oxygen saturation (which also contains venous blood).
- Sp02 is the non-invasive equivalent of Sa02 where in the former 'p' refers to pulse and in the latter 'a' refers to arterial.
- blood oxygen saturation or Sp02 herein, generally the arterial blood oxygen saturation is meant.
- Remote PPG utilizes light sources or, in general radiation sources, disposed remotely from the subject of interest.
- a detector e.g., a camera or a photo detector, can be disposed remotely from the subject of interest. Therefore, remote photoplethysmographic systems and devices are considered unobtrusive and well suited for medical as well as non-medical everyday applications.
- remote PPG devices typically achieve a lower signal-to-noise ratio.
- photoplethysmographic signals can be measured remotely using ambient light and a conventional consumer level video camera.
- the system comprises a monochrome CMOS-camera and a light source with LEDs of three different wavelengths.
- the camera sequentially acquires three movies of the subject at the three different wavelengths.
- the pulse rate can be determined from a movie at a single wavelength, whereas at least two movies at different wavelengths are required for determining the oxygen saturation.
- the measurements are performed in a darkroom, using only one wavelength at a time.
- NICU neonatal intensive care unit
- a device for determining the blood oxygen saturation of a subject comprising:
- an interface for receiving a data stream derived from detected electromagnetic radiation emitted or reflected from one or more skin portions of the subject, said data stream comprising a data signal per skin pixel for a plurality of skin pixels of said one or more skin portions, a data signal representing the detected electromagnetic radiation emitted or reflected from the respective skin pixel over time,
- an analyzer for determining the change in blood oxygen saturation of said plurality of skin pixels based on the data signals of said plurality of skin pixels
- a selector for selecting a group of skin pixels comprising either the skin pixels showing the fastest change in blood oxygen saturation or said plurality of skin pixels except for skin pixels showing the slowest change in blood oxygen saturation, and
- a processor for determining the blood oxygen saturation of the subject based on the data signals of the selected group of skin pixels.
- a corresponding method for determining the blood oxygen saturation of a subject comprising:
- a data stream derived from detected electromagnetic radiation emitted or reflected from one or more skin portions of the subject comprising a data signal per skin pixel for a plurality of skin pixels of said one or more skin portions, a data signal representing the detected electromagnetic radiation emitted or reflected from the respective skin pixel over time
- a computer program which comprises program code means for causing a computer to perform the steps of the method when said computer program is carried out on a computer as well as a non- transitory computer-readable recording medium that stores therein a computer program product, which, when executed by a computer processor, causes the method disclosed herein to be performed.
- blood oxygen saturation is a systemic value (the oxygen saturation of arterial blood, pumped from the heart into the arterial system) rather than a value that is variable over the body, is has been concluded that during changes of arterial blood oxygenation, some body parts provide a blood oxygen saturation value that might differ from values at other body parts. For instance, during sudden drops of the blood oxygen saturation due to a health condition deterioration, pulse oximetry sensors on a peripheral of a body (e.g. finger oximeter) and a forehead sensor would show different blood oxygen saturation values. This is addressed in this disclosure by identifying areas that have delayed perfusion of (particularly arterial) blood and disregarding these areas, thus approaching the systemic blood oxygen saturation more responsively and accurately.
- Sp02 is supposed to be a measure of the oxygen saturation of arterial blood. It is measured from the PPG signals caused by arterial pulsations. However, arterial blood arrives faster in some body parts than in other. Similarly, even on one body part, a hand for example, some skin areas are supplied earlier with arterial blood than others.
- the remote PPG system known from the above cited disclosure of Wieringa aimed at imaging these differences rather than averaging them into one value.
- Other known non-contact PPG devices e.g. a camera based PPG device
- PPG signals also called PPG signals
- the average blood oxygen saturation is thus an average of Old' blood ('old' blood oxygen saturation) and new blood'.
- Old' blood 'old' blood oxygen saturation
- new blood' those skin pixels or even skin regions are selected that are representative of the 'new blood' only, and thus the determined blood oxygen saturation is more representative of that.
- said analyzer is configured to determine a blood oxygen saturation signal per skin pixel for said plurality of skin pixels and to determine the change in blood oxygen saturation of said plurality of skin pixels based on said blood oxygen saturation signals.
- a blood oxygen saturation signal is determined for said skin pixel, which is then preferably used in the subsequent process of selecting the optimum skin pixels and/or of determining the total blood oxygen saturation as proposed in a further embodiment according to which the processor is configured to determine the blood oxygen saturation of the subject from the blood oxygen saturation signals of the skin pixels of the selected group of skin pixels.
- Said processor is further preferably configured to determine the blood oxygen saturation of the subject by averaging the blood oxygen saturation signals of the skin pixels of the selected group of skin pixels.
- said processor is configured to average the data signals of the skin pixels of the selected group of skin pixels to obtain an averaged data signal and to determine the blood oxygen saturation of the subject from the averaged data signal. This allows reducing a noise level of blood oxygen saturation measurement, while still differentiating areas with various dynamic of blood oxygen saturation changes.
- the selected group of skin pixels comprises either the skin pixels showing the fastest change in blood oxygen saturation (i.e. a positive selection of skin pixels to use is made) or the selected group of skin pixels comprises all of said plurality of skin pixels except for skin pixels showing the slowest change in blood oxygen saturation (i.e. a negative selection of skin pixels to be excluded is made).
- said selector is configured to select said group of skin pixels by use of an upper and/or lower threshold for the blood oxygen saturation or by use of a threshold for the percentage of skin pixels of said plurality of skin pixels to be selected as said group.
- Said thresholds may be determined in advance, based on experimental data, but may also be adaptable, e.g. by the user, if it is noticed that the accuracy and/or reaction time of the determination of the blood oxygen saturation is insufficient.
- the lower thresholds can be set to a value in the range 80-95%.
- said selector is configured to select all skin pixels of said plurality of skin pixels as said group if the change in blood oxygen saturation of said plurality of skin pixels is below a predetermined minimum threshold. This particularly holds in case of no substantial changes of the blood oxygen saturation.
- said selector is configured to select all skin pixels of said plurality of skin pixels as said group in the absence of a predetermined event, in particular in the absence of a hypoxic event.
- said interface is configured in an embodiment to receive an event indication signal indicating the presence and/or absence of said predetermined event.
- Said event signal may be generated by one or more external sensors, e.g. a sensor for recognizing a hypoxic event.
- One or more of such event sensors for sensing an event indication signal indicating the presence and/or absence of said predetermined event may also be included in the proposed device itself.
- said analyzer is configured in an embodiment to determine if said predetermined event is absent or present based on one or more of said data signals, preferably acquired by said unobtrusive device of the present invention.
- the analyzer may recognize from an analysis of said data signals and, preferably, from blood oxygen saturation signals determined therefrom, that a predetermined event, e.g. a sudden drop and/or increase in the blood oxygen saturation for at least some of the pixels, appears.
- said data signals comprise at least two data signal components, wherein a first data signal component is representative of a first spectral portion, in particular a visible-light portion, and wherein a second data signal component is representative of a second indicative spectral portion, in particular an infrared portion.
- a penetration depth of radiation which is dependent on blood absorption and tissue absorption is basically also dependent on the wavelength of incident radiation.
- infrared (or near-infrared) and red light penetrates deeper into the subject's tissue than light having shorter wavelengths.
- the first spectral portion can be formed of a band or sub-band in the green portion of visible radiation.
- the proposed device further comprises an imaging unit, in particular a camera, for remotely detecting electromagnetic radiation emitted or reflected from the subject, in particular in at least two different spectral ranges.
- the imaging unit is particularly suited for remote monitoring applications.
- the imaging unit can comprise one or more imaging elements.
- the imaging unit can comprise an array of photo sensors or charge-coupled devices.
- the imaging unit comprises at least two groups of imaging elements each of which is configured for detecting a single one of the data signal components.
- the imaging unit can make use of a single group of imaging elements having a response characteristic allowing for a detection of data signal components.
- the imaging unit can be further configured for capturing a sequence of image frames alternatingly representing the data signal components.
- the proposed device further comprises a radiation source, in particular a light source, for directing electromagnetic radiation to the subject, in particular in two or more different spectral ranges.
- the radiation source can be embodied by a broadband illumination source and/or can make use of a single group or two or even more groups of radiation elements.
- the proposed device does not necessarily have to comprise radiation source, but can also make use of ambient light sources which are not connected to the device.
- Fig. 1 shows a schematic diagram of a system in which a device according to the present invention is used
- Fig. 2 shows a diagram illustrating the measured blood oxygen saturation with and without application of the proposed invention
- Fig. 3 shows diagrams illustrating the spatial distribution of blood oxygen saturation values
- Fig. 4 shows diagrams illustrating the distribution of blood oxygen saturation signal values for a plurality of pixels in various state of blood oxygen saturation
- Fig. 5 shows a flowchart of a method according to the present invention.
- Fig. 1 shows a schematic diagram of a system 10 in which a device 30 according to the present invention is used.
- the system 10 can be utilized for recording image frames representing a remote subject 12 or at least a portion 14 (a region of interest) of the subject 12 for remote PPG monitoring.
- the region of interest 14 comprises, by way of example, a forehead portion, a face portion or, more generally, one or more skin portions of the subject 12.
- the recorded data for instance, a series of image frames, can be derived from electromagnetic radiation 16 reflected by the subject 12. Possibly, under certain conditions, at least part of the electromagnetic radiation could be emitted or transmitted by the subject 12 itself. Radiation transmission may occur when the subject 12 is exposed to strong
- the subject 12 can be a human being or an animal, or, in general, a living being. Furthermore, the subject 12 can be considered a part of a human being highly indicative of a desired signal.
- a source of radiation such as sunlight 18a, an artificial radiation source 18b or a combination of several radiation sources, affects or impinges on the subject 12.
- the radiation sources 18a, 18b basically emit incident radiation 20a, 20b striking the subject 12.
- the system 10 may also comprise or make use of an internal source 22 of electromagnetic radiation 24, which emits and directs incident radiation 24 to the subject 12 and which may also be part of the device 30 in an alternative embodiment.
- the internal source 22 of radiation 24 can be configured for directing radiation having defined characteristics to the subject 12, in particular radiation belonging to a defined spectral portion. Since in accordance with an embodiment of the invention, at least two distinct spectral portions are captured and processed, according to another aspect of this embodiment it is preferred that the internal source 22 of electromagnetic radiation 24 "matches" these spectral portions.
- an imaging unit 28 For extracting physiological information from the captured data, for instance, a sequence of image frames, radiation 16 from a defined part or portion of the subject 12, such as a the region of interest 14, is detected by an imaging unit 28.
- the imaging unit 28 can be embodied, by way of example, by an optical sensor means configured to capture information belonging to at least one spectral component of the electromagnetic radiation 16.
- the imaging unit 28 is embodied by a camera or a set of cameras, such as a video camera (e.g. an RGB camera).
- the imaging unit 28 may also be part of the device 30 in an alternative embodiment.
- the device 30 can also be adapted to process input signals, namely an input data stream 26, already recorded in advance and, in the meantime, stored or buffered.
- the electromagnetic radiation 16 can contain a continuous or discrete characteristic signal which can be highly indicative of at least one vital sign parameter 26, in the context of the present invention particularly the blood oxygen saturation.
- An important field for PPG measurements is the determination of blood oxygen saturation (particularly arterial blood oxygen saturation).
- Contact pulse oximeters typically transmit red and infrared (or, more precisely, in some cases near infrared) light through a vascular tissue of the subject of interest.
- the respective light portions R/IR
- the respective spectral portions are differently absorbed by oxygenated hemoglobin (Hb0 2 ) and reduced hemoglobin (Hb)
- blood oxygen saturation eventually can be processed.
- An oxygen saturation (Sp0 2 ) estimation algorithm can make use of a ratio of the signals related to the red and the infrared portion. Furthermore, the algorithm can consider a non-pulsatile signal component.
- the PPG signal comprises a DC component and a relatively small pulsatile AC component.
- Sp02 estimation generally involves an empirically derived calibration factor applied to the processed values.
- the calibration factor (or, calibration curve) is determined upon reference measurements involving invasive arterial blood oxygen saturation measurements (Sa02).
- Sa02 invasive arterial blood oxygen saturation measurements
- One or more calibration factors are required since a PPG device basically detects a ratio of (spectral) signal portions which has to be transferred into a blood oxygen saturation value which typically involves a ratio of Hb0 2 and Hb.
- blood oxygen saturation estimation can be based on the following general equation:
- the characteristic signal is considered to contain a considerably constant (DC) portion and an alternating (AC) portion superimposing the DC portion.
- the AC portion can be extracted and, furthermore, compensated for disturbances.
- the AC portion of the characteristic signal can comprise a dominant frequency which can be highly indicative of the subject's 12 vascular activity, in particular the heart beat.
- the characteristic signal, in particular the AC portion can be indicative of further vital sign parameters.
- the detection of blood oxygen saturation is an important field of application.
- blood oxygen saturation values can be computed taking into account the behavior of the AC portion of the characteristic signal at distinct spectral portions thereof.
- a degree of blood oxygen saturation can be reflected in different radiation absorbance at blood vessels.
- one can make use of the fact that the difference in absorbance due to the grade of oxygenation also varies significantly across different spectral portions.
- the DC component represents the overall light absorption of the tissue, venous blood, and arterial blood.
- the AC component may represent the pulsatile arterial blood's absorption. Consequently, the determination of blood oxygen saturation (S p 0 2 ) can be expressed as:
- C (AC I DC) infrared where C is a calibration parameter.
- C may stand for a large variety of calibration parameters applicable to the AC/DC relationship and should therefore not be interpreted in the strict algebraic sense of equation (2).
- C represents a fixed constant value or a set of fixed constants.
- the device 30 for determining blood oxygen saturation of a subject comprises an (input) interface 32 for receiving the data stream 26 (from the imaging unit 28 or from a storage unit or buffer) derived from detected
- Said data stream 26 comprises a data signal per skin pixel for a plurality of skin pixels (preferably for all skin pixels) of said one or more skin portions 14, wherein a data signal represents the detected electromagnetic radiation 16 emitted or reflected from the respective skin pixel over time.
- An analyzer 34 is provided for determining the change in blood oxygen saturation of said plurality of skin pixels (preferably for all skin pixels) based on the data signals 26' of said plurality of skin pixels received by said interface 32 and forwarded to the analyzer 34.
- corresponding change information 35 is output from the analyzer 34 indicating the change in blood oxygen saturation of said plurality of skin pixels.
- the analyzer computes relative amplitudes in the red and infrared spectral band from the temporal skin reflectance represented by the data signals of the plurality of the skin pixels.
- the device 30 further comprises a selector 36 for selecting, based on the change information 35 fro the analyzer, a group of skin pixels 37 comprising either (only) the skin pixels showing the fastest change in blood oxygen saturation or (only) comprising (all of) said plurality of skin pixels except for skin pixels showing the slowest change in blood oxygen saturation.
- a selector 36 for selecting, based on the change information 35 fro the analyzer, a group of skin pixels 37 comprising either (only) the skin pixels showing the fastest change in blood oxygen saturation or (only) comprising (all of) said plurality of skin pixels except for skin pixels showing the slowest change in blood oxygen saturation.
- a processor 38 is provided for determining the blood oxygen saturation 39 of the subject 12 based on the data signals of the selected group of skin pixels 37.
- an (output) interface 40 can be provided to which the determined blood oxygen saturation 39 can be delivered, e.g. to provide output data 41 for further analysis and/or for display measures.
- Both interfaces 32, 40 can be embodied by the same (hardware) connectors.
- a controller 42 is provided for selectively controlling at least one of the imaging unit 28 and the radiation source 22.
- the analyzer 34, the selector 36 and the processor 38 may be implemented by a common processing unit 50 which can be considered a computing device, or at least, part of a computing device driven by respective logic commands (program code) so as to provide for desired data processing.
- the processing unit 50 may comprise several components or units which are addressed in the following. It should be understood that each component or unit of the processing unit 50 can be implemented virtually or discretely. For instance, the processing unit 50 may comprise a number of processors, such as multi-core processors or single-core processors. At least one processor can be utilized by the processing unit 50.
- Each of the processors can be configured as a standard processor (e.g., central processing unit) or as a special purpose processor (e.g., graphics processor).
- the processing unit 50 can be suitably operated so as to distribute several tasks of data processing to adequate processors.
- the processing unit 50 as well as the interfaces 32, 40 can be embodied in a common processing apparatus or housing, generally representing the proposed device 30.
- the imaging unit 28 and the radiation source 22 are generally external elements, but may also be integrated into the device 30, e.g. with a common housing with the other elements of the device 30.
- the blood oxygen saturation is generally evaluated for a plurality or all skin pixels that the imaging unit 28 (e.g. a camera) 'sees' .
- the reported blood oxygen saturation is calculated from these skin pixels only, disregarding the pixels for skin area that have a slower dynamic of changes of oxygen saturation.
- all visible skin pixels are evaluated for their blood oxygen saturation value.
- the blood oxygen saturation values for all these pixels are analyzed for clustering at each moment in time.
- all skin pixels will have low blood oxygen saturation. All skin pixels will thus be in the same cluster and the reported (total) blood oxygen saturation is an average of all of these skin pixels.
- two clusters may start to form: one cluster (A) representing skin pixels with still Old' arterial blood having a still low blood oxygen saturation, and another cluster (B) with 'fresh, new' blood having a (more accurate) higher blood oxygen saturation.
- the reported (total) blood oxygen saturation is given as that of cluster B, i.e.
- the cluster(s) is (are) used to compute the (total) blood oxygen saturation value comprising skin pixels from predominantly those skin areas that are perfused relatively early with arterial blood and thus are representative for the oxygen saturation of the arterial blood pumped out of the heart. This provides a faster and more accurate feedback, particularly after a hypoxic event.
- an upper threshold for the blood oxygen saturation value may be used, i.e. only the data signals (or blood oxygen saturation signals) of skin pixels having blood oxygen saturation value above said upper threshold is used for determining the (total) blood oxygen saturation value.
- a threshold for the percentage of skin pixels from the total number of available skin pixels may be applied for this selection. For instance, a percentage of X% (X e.g. being in the range from 20 to 80) skin pixels having the highest blood oxygen saturation value may be selected for use in the determination of the (total) blood oxygen saturation value.
- the monitoring system outputs two values of blood oxygen saturation measured from two subsets of pixels, thus providing the information about the dynamic of blood oxygen saturation changes
- the present invention may, however, not only be applied in case of a hypoxic event, but generally in case of other predetermined events as well. For instance, it may also be used to detect sudden or fast drops of the blood oxygen saturation. Also in such a situation some skin areas may quickly reflect such a sudden drop while other skin areas much slower reflect this drop. It might, however, be very essential to quickly recognize such a situation of a patient so that it is advantageous to use only skin portions that quickly reflect the drop of the blood oxygen saturation for determining the (total) blood oxygen saturation value.
- a lower threshold for the blood oxygen saturation value may be used, i.e. only the data signals (or blood oxygen saturation signals) of skin pixels having blood oxygen saturation value below said lower threshold is used for determining the (total) blood oxygen saturation value.
- the lower threshold may be identical or different from the upper threshold.
- the threshold for the percentage of skin pixels may be used in such a situation similarly as explained above.
- the selector 36 is configured to select all skin pixels of said plurality of skin pixels as said group of skin pixels for use in determining the total blood oxygen saturation value if the change in blood oxygen saturation of said plurality of skin pixels is below a predetermined minimum threshold, indicating situations without major changes of the blood oxygen saturation.
- the selector 36 is configured to select all skin pixels of said plurality of skin pixels as said group in the absence of a predetermined event, in particular in the absence of a hypoxic event.
- the interface 32 is preferably configured to receive an event indication signal 45 indicating the presence and/or absence of said predetermined event, for instance from an (optional) external event sensor 44 for sensing an event indication signal indicating the presence and/or absence of said predetermined event.
- Said event sensor 44 may also be part of the device 30 in an embodiment.
- the analyzer 34 is configured to determine if said predetermined event is absent or present based on one or more of said data signals.
- An event for possible changes of blood oxygen saturation can be detected by means of other vital body signs sensors, for instance respiratory or heart rate sensors (e.g.
- FIG. 2 shows a diagram illustrating two graphs showing the blood oxygen saturation value over time.
- the first graph SI shows the blood oxygen saturation value over time as obtained by use of a convention method (i.e. generally taking all skin pixels into account).
- the second graph S2 shows the blood oxygen saturation value over time as obtained by use of the proposed method (i.e. generally disregarding certain skin pixels). It can be seen that during some times the graphs SI and S2 are substantially identical, but that during the second graph S2 earlier and more accurately indicates a rise of the blood oxygen saturation value.
- Fig. 3 shows diagrams illustrating the spatial distribution of blood oxygen saturation values.
- Fig. 3 A shows a diagram illustrating, within a region of interest 14, for each skin pixel that ratio of red and IR data signal amplitude as indicated in equation (2).
- Fig. 3B shows a graph visually illustrating the red and IR signal amplitudes (here the straight lines with 78% and 98% represent blood oxygen saturation values; e.g. larger values for the ratio IR/red indicate high blood oxygen saturation values and vice versa).
- Three particular areas A, B, C are indicated in Figs. 3 A and 3B, wherein area A has the lowest blood oxygen saturation values and area 3 has the highest blood oxygen saturation values.
- Fig. 4 show the chronological changes from the top left diagram to the bottom right diagram.
- Fig. 4A is obtained before the experiment.
- Figs. 4B to 4D are obtained while holding the breath (leading to desaturation).
- Figs. 4E to 4H are obtained while breathing again (leading to recovery).
- Fig. 41 shows the normal state again.
- Fig. 5 shows a flowchart of a method according to the present invention.
- a data stream 26 is received that is derived from detected electromagnetic radiation 16 emitted or reflected from one or more skin portions of the subject 12, said data stream 26 comprising a data signal per skin pixel for a plurality of skin pixels of said one or more skin portions, a data signal representing the detected electromagnetic radiation 16 emitted or reflected from the respective skin pixel over time.
- the change in blood oxygen saturation of said plurality of skin pixels is determined based on the data signals of said plurality of skin pixels.
- a group of skin pixels is selected comprising either the skin pixels showing the fastest change in blood oxygen saturation or said plurality of skin pixels except for skin pixels showing the slowest change in blood oxygen saturation.
- the blood oxygen saturation of the subject is determined based on the data signals of the selected group of skin pixels.
- the present invention can be applied in the field of health care, e.g. unobtrusive remote patient monitoring, general surveillances, security monitoring and so-called lifestyle environments, such as fitness equipment, or the like.
- Applications may include monitoring of oxygen saturation (pulse oximetry), heart rate, blood pressure, cardiac output, changes of blood perfusion, assessment of autonomic functions, and detection of peripheral vascular diseases.
- a computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
- a suitable medium such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
- the term "computer” stands for a large variety of processing devices. In other words, also mobile devices having a considerable computing capacity can be referred to as computing device, even though they provide less processing power resources than standard desktop computers. Furthermore, the term “computer” may also refer to a distributed computing device which may involve or make use of computing capacity provided in a cloud environment.
Abstract
Description
Claims
Priority Applications (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2015143531A RU2652071C2 (en) | 2013-03-13 | 2014-03-05 | Device and method for determining the blood oxygen saturation of a subject |
JP2015562449A JP6537985B2 (en) | 2013-03-13 | 2014-03-05 | Device and method for determining blood oxygen saturation of a subject |
CA2905555A CA2905555A1 (en) | 2013-03-13 | 2014-03-05 | Device and method for determining the blood oxygen saturation of a subject |
MX2015011755A MX346826B (en) | 2013-03-13 | 2014-03-05 | Device and method for determining the blood oxygen saturation of a subject. |
BR112015022116A BR112015022116A2 (en) | 2013-03-13 | 2014-03-05 | device for determining an individual's blood oxygen saturation, method for determining an individual's blood oxygen saturation, and, computer program |
AU2014229387A AU2014229387A1 (en) | 2013-03-13 | 2014-03-05 | Device and method for determining the blood oxygen saturation of a subject |
CN201480014546.0A CN105009173B (en) | 2013-03-13 | 2014-03-05 | Device and method for the arterial oxygen saturation for determining object |
EP14711010.0A EP2973394B1 (en) | 2013-03-13 | 2014-03-05 | Device and method for determining the blood oxygen saturation of a subject |
ZA2015/07560A ZA201507560B (en) | 2013-03-13 | 2015-10-12 | Device and method for determining the blood oxygen saturation of a subject |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361778580P | 2013-03-13 | 2013-03-13 | |
EP13158884 | 2013-03-13 | ||
EP13158884.0 | 2013-03-13 | ||
US61/778,580 | 2013-03-13 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014141001A1 true WO2014141001A1 (en) | 2014-09-18 |
Family
ID=47912985
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2014/059449 WO2014141001A1 (en) | 2013-03-13 | 2014-03-05 | Device and method for determining the blood oxygen saturation of a subject |
Country Status (11)
Country | Link |
---|---|
US (1) | US9125606B2 (en) |
EP (1) | EP2973394B1 (en) |
JP (1) | JP6537985B2 (en) |
CN (1) | CN105009173B (en) |
AU (1) | AU2014229387A1 (en) |
BR (1) | BR112015022116A2 (en) |
CA (1) | CA2905555A1 (en) |
MX (1) | MX346826B (en) |
RU (1) | RU2652071C2 (en) |
WO (1) | WO2014141001A1 (en) |
ZA (1) | ZA201507560B (en) |
Families Citing this family (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10004411B2 (en) * | 2014-05-16 | 2018-06-26 | Mediatek Inc. | Living body determination devices and methods |
US9968285B2 (en) * | 2014-07-25 | 2018-05-15 | Christie Digital Systems Usa, Inc. | Multispectral medical imaging devices and methods thereof |
US10244987B2 (en) * | 2015-08-13 | 2019-04-02 | Pixart Imaging Inc. | Physiological detection system with adjustable signal source and operating method thereof |
US10335045B2 (en) | 2016-06-24 | 2019-07-02 | Universita Degli Studi Di Trento | Self-adaptive matrix completion for heart rate estimation from face videos under realistic conditions |
CN109328031A (en) * | 2016-06-24 | 2019-02-12 | 皇家飞利浦有限公司 | System and method for vital sign detection |
JP6853683B2 (en) * | 2016-06-27 | 2021-03-31 | 医療法人社団皓有会 | Blood oxygen saturation measuring device |
CN107550498B (en) * | 2016-06-30 | 2024-02-09 | 北京超思电子技术有限责任公司 | Blood oxygen measuring device and measuring method thereof |
US11350825B2 (en) | 2016-08-25 | 2022-06-07 | Vivonics, Inc. | Contactless system and method for measuring and continuously monitoring arterial blood pressure |
KR102417501B1 (en) * | 2016-09-12 | 2022-07-05 | 현대자동차일본기술연구소 | Apparatus and method for measuring of blood oxygen saturation in vehicle |
JP6975230B2 (en) | 2016-10-05 | 2021-12-01 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Patient monitoring system and method |
WO2018083074A1 (en) | 2016-11-03 | 2018-05-11 | Koninklijke Philips N.V. | Automatic pan-tilt-zoom adjustment to improve vital sign acquisition |
WO2018086953A1 (en) | 2016-11-11 | 2018-05-17 | Koninklijke Philips N.V. | Queue for patient monitoring |
WO2018086990A1 (en) | 2016-11-11 | 2018-05-17 | Koninklijke Philips N.V. | Patient monitoring systems and methods |
JP7107932B2 (en) | 2016-11-30 | 2022-07-27 | コーニンクレッカ フィリップス エヌ ヴェ | Patient identification system and method |
CN116269261A (en) * | 2016-12-01 | 2023-06-23 | 松下知识产权经营株式会社 | Biological information processing method and biological information processing system |
JP6853712B2 (en) * | 2017-03-29 | 2021-03-31 | 医療法人社団皓有会 | Blood oxygen saturation measuring device |
WO2018188993A1 (en) | 2017-04-14 | 2018-10-18 | Koninklijke Philips N.V. | Person identification systems and methods |
US20180311512A1 (en) | 2017-04-28 | 2018-11-01 | C-Rad Positioning Ab | Patient monitoring |
US10832035B2 (en) | 2017-06-22 | 2020-11-10 | Koninklijke Philips N.V. | Subject identification systems and methods |
US10674916B2 (en) * | 2017-07-10 | 2020-06-09 | The Florida International University Board Of Trustees | Integrated NIR and visible light scanner for co-registered images of tissues |
US11295150B2 (en) | 2017-09-13 | 2022-04-05 | Koninklijke Philips N.V. | Subject identification systems and methods |
EP3682366A1 (en) | 2017-10-27 | 2020-07-22 | Koninklijke Philips N.V. | Camera and image calibration for subject identification |
US20210164966A1 (en) * | 2017-12-12 | 2021-06-03 | Obi Aps | An improved method for estimating arterial blood values |
WO2019137886A1 (en) | 2018-01-10 | 2019-07-18 | Koninklijke Philips N.V. | Capturing subject data in dynamic environments using mobile cameras |
US11904224B2 (en) | 2018-02-20 | 2024-02-20 | Koninklijke Philips N.V. | System and method for client-side physiological condition estimations based on a video of an individual |
US10943092B2 (en) | 2018-05-23 | 2021-03-09 | ClairLabs Ltd. | Monitoring system |
WO2019223885A1 (en) | 2018-05-25 | 2019-11-28 | Koninklijke Philips N.V. | Person identification systems and methods |
KR102035172B1 (en) * | 2018-06-28 | 2019-10-22 | 계명대학교 산학협력단 | Blood oxygen saturation rate monitoring method that can identify the user and blood oxygen saturation rate monitoring system that can identify the user |
WO2020082265A1 (en) * | 2018-10-24 | 2020-04-30 | 深圳迈瑞生物医疗电子股份有限公司 | Imaging method and imaging system |
KR102242293B1 (en) * | 2019-06-19 | 2021-04-20 | 주식회사 라이즈 | Non-contact system of measuring oxygen saturation and its way to working |
CN112168180B (en) * | 2020-09-24 | 2022-01-18 | 上海交通大学 | Tissue blood oxygen imaging detection method based on two-stage space mapping |
EP4230115A1 (en) * | 2022-02-18 | 2023-08-23 | Koninklijke Philips N.V. | A system and method for tissue analysis using remote ppg |
EP4230117A1 (en) * | 2022-02-18 | 2023-08-23 | Koninklijke Philips N.V. | A system and method for tissue analysis using remote ppg |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002039873A2 (en) * | 2000-11-14 | 2002-05-23 | Applied Spectral Imaging Ltd. | System and method for functional brain mapping and an oxygen saturation difference map algorithm for effecting same |
WO2012099534A2 (en) * | 2011-01-20 | 2012-07-26 | Nitto Denko Corporation | Method and apparatus for deriving a health index for determining cardiovascular health |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5408998A (en) | 1994-03-10 | 1995-04-25 | Ethicon Endo-Surgery | Video based tissue oximetry |
EP1485009A1 (en) * | 2002-02-22 | 2004-12-15 | Datex-Ohmeda, Inc. | Monitoring physiological parameters based on variations in a photoplethysmographic signal |
BR0304716A (en) * | 2002-05-08 | 2004-07-13 | Yeda Res & Dev | Sensitized mri-bold online imaging method |
WO2005074550A2 (en) * | 2004-01-30 | 2005-08-18 | 3Wave Optics, Llc | Non-invasive blood component measurement system |
JP4656304B2 (en) | 2005-03-30 | 2011-03-23 | 花王株式会社 | Skin oxygen saturation measurement system |
DE102008056251A1 (en) * | 2008-10-07 | 2010-04-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device and method for detecting a vital parameter |
US8503712B2 (en) | 2008-12-31 | 2013-08-06 | Motorola Mobility Llc | Method and apparatus for determining blood oxygenation using a mobile communication device |
KR101040653B1 (en) | 2009-01-21 | 2011-06-10 | 서울대학교산학협력단 | Non-contact measuring devices of pulse wave and measuring devices of oxygen saturation and blood pressure in using same |
US8761853B2 (en) | 2011-01-20 | 2014-06-24 | Nitto Denko Corporation | Devices and methods for non-invasive optical physiological measurements |
GB201114406D0 (en) * | 2011-08-22 | 2011-10-05 | Isis Innovation | Remote monitoring of vital signs |
CN103764019B (en) * | 2011-09-02 | 2017-03-22 | 皇家飞利浦有限公司 | Camera for generating a biometrical signal of a living being |
-
2013
- 2013-12-20 US US14/135,644 patent/US9125606B2/en active Active
-
2014
- 2014-03-05 BR BR112015022116A patent/BR112015022116A2/en not_active IP Right Cessation
- 2014-03-05 WO PCT/IB2014/059449 patent/WO2014141001A1/en active Application Filing
- 2014-03-05 RU RU2015143531A patent/RU2652071C2/en not_active IP Right Cessation
- 2014-03-05 JP JP2015562449A patent/JP6537985B2/en active Active
- 2014-03-05 MX MX2015011755A patent/MX346826B/en active IP Right Grant
- 2014-03-05 CN CN201480014546.0A patent/CN105009173B/en active Active
- 2014-03-05 CA CA2905555A patent/CA2905555A1/en not_active Abandoned
- 2014-03-05 EP EP14711010.0A patent/EP2973394B1/en active Active
- 2014-03-05 AU AU2014229387A patent/AU2014229387A1/en not_active Abandoned
-
2015
- 2015-10-12 ZA ZA2015/07560A patent/ZA201507560B/en unknown
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002039873A2 (en) * | 2000-11-14 | 2002-05-23 | Applied Spectral Imaging Ltd. | System and method for functional brain mapping and an oxygen saturation difference map algorithm for effecting same |
WO2012099534A2 (en) * | 2011-01-20 | 2012-07-26 | Nitto Denko Corporation | Method and apparatus for deriving a health index for determining cardiovascular health |
Non-Patent Citations (2)
Title |
---|
VERKRUYSSE ET AL.: "Remote plethysmographic imaging using ambient light", OPTICS EXPRESS, vol. 16, no. 26, 22 December 2008 (2008-12-22), pages 21434 - 21445, XP007913060, doi:10.1364/OE.16.021434 |
WIERINGA ET AL.: "Contactless Multiple Wavelength Photoplethysmographic Imaging: A First Step Toward ''Sp02 Camera Technology", ANN. BIOMED. ENG., vol. 33, 2005, pages 1034 - 1041, XP019272995 |
Also Published As
Publication number | Publication date |
---|---|
CA2905555A1 (en) | 2014-09-18 |
US9125606B2 (en) | 2015-09-08 |
EP2973394B1 (en) | 2018-06-27 |
BR112015022116A2 (en) | 2017-07-18 |
RU2652071C2 (en) | 2018-04-24 |
MX2015011755A (en) | 2015-12-07 |
RU2015143531A (en) | 2017-04-20 |
MX346826B (en) | 2017-04-03 |
US20140275880A1 (en) | 2014-09-18 |
ZA201507560B (en) | 2017-11-29 |
CN105009173B (en) | 2018-08-31 |
CN105009173A (en) | 2015-10-28 |
JP6537985B2 (en) | 2019-07-03 |
AU2014229387A1 (en) | 2015-11-05 |
JP2016514992A (en) | 2016-05-26 |
EP2973394A1 (en) | 2016-01-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2973394B1 (en) | Device and method for determining the blood oxygen saturation of a subject | |
EP2967378B1 (en) | Device and method for determining vital signs of a subject | |
US10575764B2 (en) | System and method for extracting physiological information from remotely detected electromagnetic radiation | |
JP6423807B2 (en) | Apparatus and method for determining a vital sign of an object | |
JP6615176B2 (en) | Non-interfering skin tissue hydration measuring device and related method | |
US10478078B2 (en) | Device and method for determining vital signs of a subject | |
JP6270287B2 (en) | Device and method for extracting physiological information | |
US9980650B2 (en) | System and method for determining vital sign information of a subject |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14711010 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: IDP00201505492 Country of ref document: ID Ref document number: MX/A/2015/011755 Country of ref document: MX |
|
ENP | Entry into the national phase |
Ref document number: 2015562449 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2905555 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014711010 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2015143531 Country of ref document: RU Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2014229387 Country of ref document: AU Date of ref document: 20140305 Kind code of ref document: A |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112015022116 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112015022116 Country of ref document: BR Kind code of ref document: A2 Effective date: 20150909 |