CN104837404B - The medical supply or system of hemoglobin level are measured during accident using camera-projector system - Google Patents
The medical supply or system of hemoglobin level are measured during accident using camera-projector system Download PDFInfo
- Publication number
- CN104837404B CN104837404B CN201380064453.4A CN201380064453A CN104837404B CN 104837404 B CN104837404 B CN 104837404B CN 201380064453 A CN201380064453 A CN 201380064453A CN 104837404 B CN104837404 B CN 104837404B
- Authority
- CN
- China
- Prior art keywords
- hbcs
- blood
- color region
- color
- acquired image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 102000001554 Hemoglobins Human genes 0.000 title claims abstract description 74
- 108010054147 Hemoglobins Proteins 0.000 title claims abstract description 74
- 239000008280 blood Substances 0.000 claims abstract description 124
- 210000004369 blood Anatomy 0.000 claims abstract description 124
- 238000003384 imaging method Methods 0.000 claims abstract description 26
- 238000000034 method Methods 0.000 claims abstract description 16
- 238000005259 measurement Methods 0.000 claims abstract description 8
- 230000000007 visual effect Effects 0.000 claims abstract description 8
- 230000003287 optical effect Effects 0.000 claims description 19
- 230000000740 bleeding effect Effects 0.000 claims description 6
- 239000003814 drug Substances 0.000 claims description 4
- 102000004169 proteins and genes Human genes 0.000 claims description 3
- 108090000623 proteins and genes Proteins 0.000 claims description 3
- 239000007788 liquid Substances 0.000 claims description 2
- 238000012360 testing method Methods 0.000 description 11
- 206010052428 Wound Diseases 0.000 description 5
- 230000008901 benefit Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 208000027418 Wounds and injury Diseases 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 230000036541 health Effects 0.000 description 3
- 230000008520 organization Effects 0.000 description 3
- 208000030507 AIDS Diseases 0.000 description 2
- 208000034423 Delivery Diseases 0.000 description 2
- 208000032843 Hemorrhage Diseases 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000037805 labour Diseases 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 210000001215 vagina Anatomy 0.000 description 2
- 230000009677 vaginal delivery Effects 0.000 description 2
- 102000008015 Hemeproteins Human genes 0.000 description 1
- 108010089792 Hemeproteins Proteins 0.000 description 1
- 208000018525 Postpartum Hemorrhage Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000036765 blood level Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000004043 dyeing Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 208000002672 hepatitis B Diseases 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/1032—Determining colour for diagnostic purposes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/1032—Determining colour for diagnostic purposes
- A61B5/1034—Determining colour for diagnostic purposes by means of colour cards
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/14546—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring analytes not otherwise provided for, e.g. ions, cytochromes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1495—Calibrating or testing of in-vivo probes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
- A61B5/6898—Portable consumer electronic devices, e.g. music players, telephones, tablet computers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/27—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using photo-electric detection ; circuits for computing concentration
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/29—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using visual detection
- G01N21/293—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using visual detection with colour charts, graduated scales or turrets
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2505/00—Evaluating, monitoring or diagnosing in the context of a particular type of medical care
- A61B2505/01—Emergency care
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/04—Constructional details of apparatus
- A61B2560/0431—Portable apparatus, e.g. comprising a handle or case
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biophysics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Optics & Photonics (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Biochemistry (AREA)
- Dentistry (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Mathematical Physics (AREA)
- Theoretical Computer Science (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Multimedia (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Image Analysis (AREA)
- Investigating Or Analysing Materials By The Use Of Chemical Reactions (AREA)
- Investigating Or Analysing Biological Materials (AREA)
Abstract
A kind of medical system (10) and method, the hemoglobin level of measurement object (38).Hemoglobin color scale ruler (HbCS) (22) is projected in the visual field (FOV) (42) of imaging system (12).The HbCS (22) includes multiple blood color regions (26a f), and each blood color region (26a f) corresponds to a hemoglobin level and is colored as representing the color of the blood in corresponding hemoglobin level.The HbCS for gathering the image of the blood of the object (38) using the imaging system (12) and being projected.
Description
Technical field
Invention relates generally to patient-monitorings.It is specifically applied with reference to hemoglobin level is detected during accident, and
It will be described referring especially to the application.However, it is to be understood that the application is also applied to other usage scenarios, and not necessarily by
It is limited to aforementioned applications.
Background technology
Hemoglobin is used to the key parameter of blood level of the assessment object during accident.However, for measuring
The known test of hemoglobin level is either based on laboratory or needs special material so that they are unsuitable in accident
Onsite application.In addition, usually require processing to blood sample for measuring the known test of hemoglobin level.Handle blood
There is the intrinsic wind of infection blood born diseases (such as acquired immunodeficiency syndrome (AIDS), hepatitis B etc.) in sample
Danger, unless preventative action is taken --- this is impossible in the scene of the accident.
It is by the World Health Organization (WHO) for measuring the known test of one kind of hemoglobin level in low-resource environment
Design.Test uses hemoglobin color scale ruler (HbCS) --- specific examination shown in Figure 1 and for HbCS designs
Paper.One is bled and is placed on test paper to form dyeing.Clinician then be placed under the hole on HbSC by will dye and/or
The inside will be dyed compared with six kinds of colors in HbCS.However, the test faces many challenges.
WHO tests the result is that subjective and change depending on environmental condition (such as illumination variation).In addition, WHO
Test does not apply to usually to be used in the scene of the accident, because the blood of the amount of blood single drop more required than its is much higher.Greatly
The blood of amount will impregnate test paper, take this to make it difficult to hold and use.In addition, HbCS and test paper may be not easy in the scene of the accident
It obtains.
The content of the invention
The application provides new and improved method and system, which overcomes the above problem and other problems.
According on one side, a kind of medical system of the hemoglobin level for measurement object is provided.The medicine
System includes optical projection system, imaging system, at least one processor and hemoglobin module.At least one processor quilt
Programming in order to control the optical projection system hemoglobin color scale ruler (HbCS) to be projected to the visual field (FOV) of imaging system
In.The HbCS include multiple blood color regions, each blood color region correspond to a hemoglobin level and by
Color is in the color of the blood of corresponding hemoglobin level for expression.At least one processor is also programmed to control
The imaging system is to gather the image of the blood of the object and the HbCS projected.The hemoglobin module is configured
For the blood color region of the HbCS in identification acquired image；And based on the blood face of the HbCS identified
The hemoglobin level of the object is estimated in color region.
According on the other hand, a kind of medical procedures of the hemoglobin level for measurement object are provided.It is using projection
System projects to hemoglobin color scale ruler (HbCS) in the visual field (FOV) of imaging system.The HbCS includes multiple blood
Color region, each blood color region correspond to a hemoglobin level and are colored as representing in corresponding blood red
The color of the blood of protein level.The blood of the object and the figure of the HbCS projected are gathered using the imaging system
Picture.Identify the blood color region of the HbCS in acquired image, and based on the blood of the HbCS identified
Color region estimates the hemoglobin level of the object.
According on the other hand, a kind of medical system of the hemoglobin level for measurement object is provided.The department of medial science
System includes optical projection system, and hemoglobin color scale ruler (HbCS) is projected to the visual field of imaging system by the optical projection system
(FOV) in.The HbCS include multiple blood color regions, each blood color region correspond to a hemoglobin level and
It is colored as representing the color of the blood in corresponding hemoglobin level.The medical system further includes imaging system,
It gathers the blood of the object and the image of the HbCS projected.Other medical system further includes hemoglobin module,
Hemoglobin module is configured as identifying the blood color region of the HbCS in acquired image and is based on identifying
The blood color region of the HbCS estimate the hemoglobin level of the object.
One advantage measures hemoglobin level without laboratory is used.
Another advantage measures hemoglobin level without special material.
Another advantage measures hemoglobin level without processing blood sample.
Another advantage is the objective estimation to hemoglobin level.
Those of ordinary skill in the art read and understand it is described in detail below after it will be recognized that the present invention in addition will also be
The advantages of.
Description of the drawings
The present invention can take the form of the arrangement of the arrangement and each step and each step of various parts and each component.
Attached drawing is only used for the purpose of diagram preferred embodiment, and is not necessarily to be construed as limitation of the present invention.
Fig. 1 illustrates the examples for papery hemoglobin color scale ruler (HbCS) card that the World Health Organization (WHO) uses.
Fig. 2 illustrates the block diagram for being used to measure the mobile equipment of hemoglobin level of each side according to the present invention.
Fig. 3 illustrate each side according to the present invention for the method that measures hemoglobin level.
Fig. 4 illustrates the example that the HbCS of the projection of each side according to the present invention is shown.
Fig. 5 illustrates the usage scenario of the mobile equipment of Fig. 2.
Specific embodiment
Mobile equipment is just frequently used for various health-care applications, and generally includes camera.Recently, camera-throwing
Shadow machine system (for example, Nikon COOLPIX S1200PJ) has become available commercial.It is expected that camera-optical projection system quickly will
Become what can be obtained on smart mobile phone.The application proposes using camera-projector system to measure hemoglobin level, with gram
It takes in the above-mentioned limitation of the known test of measurement hemoglobin level.
With reference to figure 2, mobile equipment 10 includes camera-projector system 12,14.Mobile equipment 10 be, for example, smart mobile phone,
Personal digital assistant, digital camera, tablet computer, personal navigation equipment etc..Camera-projector system 12,14 includes imaging
Both system 12 and optical projection system 14.Imaging system 12 and optical projection system 14 are configured as being independently operated.
The generation of imaging system 12 represents the image data and/or signal of the image in visual field (FOV).For example, imaging system
12 can be focused on the light from FOV on CCD by charge coupling device (CCD) and lens forming, lens.Optical projection system 14
According to image data and/or signal from controller 16,18, project image onto in FOV.For example, optical projection system 14 can be by
The array of LED and the light from array is focused on to the lens forming in FOV.
Controller 16,18 controls camera-projector system 12,14 with the hemoglobin level of measurement object.Controller 16,
18 include at least one processor 16 and at least one program storage 18.Program storage 18 includes what is run by processor 16
Processor-executable instruction.Processor-executable instruction includes hemoglobin module 20, at 20 control of hemoglobin module
Device 16 is managed to measure the hemoglobin level of blood sample according to the method 50 of Fig. 3.
However, before start method 50, mobile equipment 10 is located such that the blood of object in imaging system 12
In FOV.For example, mobile equipment 10 can be located such that FOV is opened including (such as caused by shock or accident) object
The bleeding wound put.As another example, when object just undergoes vaginal delivery, mobile equipment 10 can be positioned as making
Obtaining FOV and be included in the blood pool flowed out after third stage of labor from vagina --- purpose is the blood that estimation loses in postpartum haemorrhage
Amount.Alternatively, the blood of object can be positioned in the FOV of imaging system 12.
With reference to figure 3, after it located the blood of mobile equipment 10 or object, control optical projection system 14 is with by hemoglobin
The projection 25 of color scale ruler (HbCS) 22 is in the FOV of imaging system 12.In general, HbCS 22 is projected as neighbouring, neighbouring object
Blood or project on the blood of object.For example, on the bleeding wound for the opening that can HbCS 22 be projected to object or
Person is projected to when object just undergoes vaginal delivery in the blood pool flowed out after third stage of labor from vagina.As another model
Example can project to HbCS 22 on the white paper of the blood of object.
HbCS 22 is stored in the storage device memory 24 of mobile equipment, and including being disposed in hemoglobin
Multiple and different blood color region 26a-f in horizontal graduated scale, are shown in FIG. 4 its example.Each blood color
Region 26a-f corresponds to the color (such as red light and shade (shade)) in different hemoglobin levels.In some embodiments
In, blood color region 26a-f is the different colours (such as different red light and shades) in R-G-B (RGB) color model
Or the different colours in colourity-saturation degree-lightness (HSV) color model.In general, HbCS 22 includes corresponding to from 4 grams often
Decilitre (g/dL) is to the different blood color region 26a-f of six kinds of the evenly spaced hemoglobin levels of 14g/dL, such as institute in Fig. 4
Show.The blood color region 26a-f of HbCS 22 is also spaced apart so that there are gaps between the 26a-f of blood color region.
Caused by due to the usually limited computing capability of for example most of mobile equipment, identify gathered HbCS's 22
The challenge of blood color region 26a-f in image.
Although not necessarily, HbCS 22 is typically the blood for being used to measure hemoglobin by the World Health Organization (WHO)
The variant of heme proteins color scale ruler (HbCS).The example for the HbCS that WHO is used is shown in FIG. 1.It is used with WHO
HbCS compares, and the HbCS 22 on storage device memory 24 is not included in the center of blood color region 26a-f
Hole.In addition, blood color region 26a-f is spaced apart so that there are gaps between the 26a-f of blood color region.
HbCS 22 can also be increased to include six more red light and shades present in the HbCS used than WHO, this
It is because mobile equipment 10 and imaging system 12 can more delicately identify different red light and shades.For example, these are additional red
Color light and shade can correspond to the average value of the hemoglobin between two neighbouring red light and shades.
Referring back to Fig. 3, after HbCS 22 is projected to FOV, control imaging system 12 with the blood of acquisition target with
And one or more images of the HbCS projected.Then the blood color region of the HbCS 22 in acquired image is identified
26a-f usually automatically uses intelligent image handling routine.Although being typically what is be performed locally, intelligent image processing example
Journey can be performed by remote computing system, and medical system is collectively formed in remote computing system and medical supply 10.Alternatively, scheming
The blood color region 26a-f of manual identification HbCS 22 as in.
When HbCS 22 is projected directly on the blood of object, one or two neighbouring blood face in HbCS 22
Color region 26a-f may match the color of the blood of object.Therefore, only remaining blood color region 26a-f will in the picture
It can be seen that it and is divided.When the blood color region for identifying the HbCS 22 in image, this should be considered.
A kind of approach for the blood color region of automatic identification HbCS 22 is the whole color areas identified in image
Domain.The color region of image can have (such as in RGB or hsv color model) solid color or color in image
Light and shade continuum.It is also contemplated that color region can be the company of (such as in RGB or hsv color model) Similar color
Continuous region.In such circumstances, monochromatic color region is identified first, and is then based on color and monochromatic color region is carried out
Cluster.Monochromatic color region in cluster is replaced by cluster color region.In general, image is being transformed into from RGB color model
Blood color region 26a-f is identified after hsv color model.Therefore, HSB color model is typically used to identify blood color
Region 26a-f's.
Can for example by by each in the monochromatic color region in image be modeled as according to RGB color model it is red,
Green and blue coordinate, to perform cluster.Then point can be clustered using any well known clustering routine.In addition, cluster
It needs to distinguish between the different colours in belonging to HbCS 22.In other words, cluster must cannot be clustered corresponding to HbCS
The monochromatic color region of color in 22.
After identifying and optionally having clustered the color region of image, by the blood color region in HbCS 22
26a-f most preferably matches the color region in image.It can be by exhaustively generating whole candidate HbCS in image, to hold
Row matching.Candidate HbCS includes the unique combinations of multiple color regions detected in image.In general, it is detected in candidate HbCS
Color region number be no more than HbCS 22 in blood color region number.In addition, the color region in candidate HbCS
Number can change within a predetermined range, to consider in HbCS 22 sightless blood color region 26a- in the picture
f。
By candidate HbCS compared with HbCS 22, and the one or more features of HbCS 22 and candidate HbCS are used,
It scores for similarity.These features can include one or more of following：1) color region in HbCS is opposite
It (that is, is laid out) in mutual arrangement；2) shape of color region；And 3) the color of color region.It for example, can be by HbCS
For 22 layout compared with the layout of candidate HbCS, higher similarity score can be assigned to that with similar arrangement
A little candidate HbCS.
Similarity score also can advantageously matching in blood color region 26a-f in matched HbCS 22 compared with
It is weighted on those more candidate HbCS.For example, it is assumed that there are two candidate HbCS.An if matching HbCS in candidate HbCS
Five blood color region 26a-f in 22, and another only matches three blood color region 26a-f in HbCS 22
Of the HbCS 22, but otherwise similarity score will be identical, match the time in five blood color regions in HbCS 22
Select the similarity score bigger of HbCS.
Using the color of blood color region 26a-f of HbCS 22 for when matching, calibration parameter to can be used for adjusting
The color of the blood color region 26a-f of HbCS 22 is saved, preferably to match the color of image, vice versa.This can be had
, because the image reproduced by imaging system 12 and/or optical projection system 14 may not be to be input into optical projection system 14
Identical color.Can be by the way that HbCS 22 be projected in FOV, the image of the projected HbCS of acquisition, in acquired image
Middle manual identification blood color region 26a-f, and in the color in the blood color region based on HbCS 22 and the image that identifies
Color region color between deviation determine calibration parameter, to perform calibration.
After all candidate HbCS are had evaluated, by most like candidate HbCS (as identified according to similarity score)
For estimating the level of hemoglobin.This includes attempting to identify one or more blood face sightless in the picture in HbCS
Color region.If there is such blood color region 26a-f, then based on these sightless blood face in HbCS 22
The associated known hemoglobin levels of color region 26a-f, to make the horizontal estimation to hemoglobin.It is for example, estimated
Hemoglobin level can be that the hemoglobin level of sightless blood color region 26a-f is averaged.
If without sightless blood color region 26a-f (for example, since HbCS 22 is projected in close to object
On the white paper of blood), then it identifies the color region of the blood in image corresponding to object, and uses color by itself and identification
The blood color region 26a-f of HbCS 22 is compared in the image gone out.Based on this, the blood of best match in identification HbCS22
Liquid color region 26a-f.It can manually or automatically identify blood.It, can be from the color region extraction detected for the latter
It indicates the feature of blood, and uses it for estimating the possibility that the color region includes blood.Such feature can include, example
Such as color, shape.The color region being most likely detected can be used for estimating hemoglobin level.
Referring back to Fig. 2, the processor-executable instruction of program storage further includes graphic user interface (GUI) 28.GUI
28 allow user's controls and/or are otherwise interacted with mobile equipment 10.For example, GUI 28 can allow for user's triggering blood red
The operation of module 20, to perform the method for Fig. 3 and/or GUI 28 can show estimation to hemoglobin level.As
Another example, GUI 28 can allow for user to identify color region (such as blood or correspondence as object in image
In HbCS 22).
In order to allow user's control and/or otherwise be interacted with mobile equipment 10, GUI 28 is in medical supply 10
Graphic element, such as icon, window, menu etc. are displayed for a user on display device 30.In addition, GUI 28 receives user's input,
It is manipulated using the user input equipment 32 of medical supply 10 and/or is otherwise interacted with graphic element.
At least one system bus 34 of medical supply 10 interconnects the component of medical supply 10.These components include imaging
System 12, optical projection system 14, program storage 18, processor 16, storage device memory 24, user input equipment 32 and aobvious
Show equipment 30.These components can further include communication unit 36 (such as wireless transmitter), and communication unit 36 allows medical supply
10 communicate with external system and/or equipment.
With reference to figure 5, it is illustrated that for the example usage scenario of medical supply 10.As shown, object 38 part (such as
Arm) include the open wound 40 bled.In addition, medical supply 10 is located such that FOV of the wound 40 in medical supply 10
In 42.The request of the hemoglobin level of object 38 is estimated in response to the user from medical supply 10, HbCS 22 is projected
To be adjacent with wound 40 and gather one or more images.Then image is analyzed as described above, to estimate the blood red egg of object 38
White level.
In one embodiment, analysis is performed by the processor of smart mobile phone, and processor as " App " by being loaded into
Software controls.In another embodiment, blood and the HbCS picture projected are electronically sent to doctor by smart mobile phone etc.
Professional is learned for evaluation.Medical professional can analyze picture with visual manner or using computer processor, calculate
Machine processor is for example programmed as described above.In another embodiment, people at the scene is based on (or directly in victim
On or in picture that is being obtained by camera or being displayed on the display screen of camera) HbCS that is projected show with
The comparison of blood, performs analysis in a manner of vision.The image collected can be also transferred to higher processing capacity
Remote computer server can analyze them and report hemoglobin level to mobile user.
Although above-described embodiment of medical supply 10 is using optical projection system 14 HbCS 20 is projected to imaging system 12
In FOV, but in another embodiment, without using optical projection system 14.In such embodiments, hemoglobin module 18 passes through examination
Figure finds the color region 26a-f of the HbCS 22 for the blood for most matching object in the picture, to run.HbCS 22 is not by can
Insight is shown in FOV, and therefore without being captured in the picture.But on the contrary, HbCS 22 is only in medical supply 10
Portion.Hemoglobin level associated with the most matched color region 26a-f of HbCS 22 is than being used as the hemoglobin to object
Estimation.
As used in this article, memory include it is following in one or more：Non-transient computer-readable media；Disk
Or other magnetic-based storage medias；CD or other optical storage mediums；Random access memory (RAM), read-only memory (ROM)
Or other electronic memory devices or chip or operational interconnection chip set；Can via the Internet/intranet or LAN from
It retrieves the Internet/intranet server of stored instruction；Etc..In addition, as used in this article, processor includes micro-
Processor, microcontroller, graphics processing unit (GPU), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) etc.
One or more in；Controller includes：1) at least one processor, with processor-executable instruction to perform control
The function of device；And 2) at least one processor, run processor-executable instruction；Display device includes liquid crystal display
(LCD), one kind in light emitting diode (LED) display, plasma display, the projection display, touch-screen display etc.
It is or a variety of.
It has referred to preferred embodiment and has described the present invention.Other people can be with after the detailed description of front is read and understood
Expect modifications and variations.Purpose is that the present invention is interpreted as including all such modifications and variations, as long as they fall into right
In the range of claim or its equivalence.
Claims (16)
1. one kind includes for the medical system (10) of the hemoglobin level of measurement object (38), the medical system (10)：
Optical projection system (14)；
Imaging system (12)；
At least one processor (16), is programmed to：
The optical projection system (14) is controlled so that hemoglobin color scale ruler HbCS (22) is projected to the imaging system (12)
Visual field FOV (42) in, the HbCS (22) include multiple blood color regions (26a-f), each blood color region (26a-
F) correspond to a hemoglobin level and be colored as representing the color of the blood in corresponding hemoglobin level；And
And
The imaging system (12) is controlled to gather the image of the blood of the object (38) and the HbCS projected；And
Hemoglobin module (20), is configured as：
Identify the blood color region (26a-f) of the HbCS (22) in acquired image；And
The described blood red of the object (38) is estimated based on the blood color region (26a-f) of the HbCS (22) identified
Protein level.
2. medical system (10) according to claim 1, wherein, at least one processor (16) is also programmed to：
The HbCS (22) is projected on the object (38) bleeding wound or aperture (36), the bleeding wound or hole
Mouth (36) is in the FOV (42).
3. the medical system (10) according to any one of claim 1-2, wherein, at least one processor (16)
It is also programmed to：
Identify the color region in acquired image；
Color region in the acquired image identified generates candidate HbCS；
By each in the candidate HbCS to score similarity compared with the HbCS (22)；And
The candidate HbCS most like with the HbCS (22) is selected based on similarity score, wherein, selected candidate
HbCS has identified the blood color region (26a-f) of the HbCS (22) in acquired image.
4. the medical system (10) according to any one of claim 1-2, wherein, at least one processor (16)
It is also programmed to：
It is invisible in acquired image to identify based on the blood color region (26a-f) of the HbCS (22) identified
The HbCS (22) blood color region (26a-f)；And
Estimated based on the blood color region (26a-f) of the sightless HbCS (22) in the acquired image identified
The hemoglobin level of the object (38).
5. the medical system (10) according to any one of claim 1-2, wherein, at least one processor (16)
It is also programmed to：
Identify the color region for the blood for corresponding to the object (38) in acquired image；
The color of the color region for the blood corresponding to the object (38) that will identify that and the HbCS (22) identified
Blood color region (26a-f) in each color be compared, to identify blood most like in the HbCS (22)
Color region (26a-f)；And
The described of the object (38) is estimated according to the most like blood color region (26a-f) of the HbCS (22)
Hemoglobin level.
6. the medical system (10) according to any one of claim 1-2, wherein, at least one processor (16)
It is also programmed to：
Calibration parameter is generated, to correct the misalignment between the color in the color and acquired image to be projected.
7. the medical system (10) according to any one of claim 1-2, further includes：
Transmitter (36), be used for the image for the object blood that will be gathered and the HbCS projected to be wirelessly transmitted to medicine special
Industry personnel.
8. the medical system (10) according to any one of claim 1-2, further includes：
For the HbCS (22) to be projected to the optical projection system (14) in the FOV (42).
9. one kind includes for the medical procedures of the hemoglobin level of measurement object (38), the medical procedures：
Using optical projection system (14), hemoglobin color scale ruler HbCS (22) is projected to the visual field FOV of imaging system (12)
(42) in, the HbCS (22) includes multiple blood color regions (26a-f), and each blood color region (26a-f) corresponds to
One hemoglobin level and the color for being colored as representing the blood in corresponding hemoglobin level；
The image of the blood of the object (38) and the HbCS projected is gathered using imaging system (12)；
Identify the blood color region (26a-f) of the HbCS (22) in acquired image；And
The described blood red of the object (38) is estimated based on the blood color region (26a-f) of the HbCS (22) identified
Protein level.
10. medical procedures according to claim 9, further include：
The HbCS (22) is projected on the bleeding wound or aperture (36) of the object (38), the bleeding wound or
Aperture (36) is in the FOV (42).
11. according to the medical procedures described in any one of claim 9-10, further include and utilize processor：
Identify the color region in acquired image, the color region is continuous color region in acquired image；
Color region in the acquired image identified generates candidate HbCS；
By each in the candidate HbCS to score similarity compared with the HbCS (22)；And
The candidate HbCS most like with the HbCS (22) is selected based on similarity score, wherein, selected candidate HbCS
Have identified the blood color region (26a-f) of the HbCS (22) in acquired image.
12. medical procedures according to claim 11, wherein, based in the HbCS (22) by the matched blood of candidate HbCS
The number of liquid color region is weighted the similarity.
13. according to the medical procedures described in any one of claim 9-10, further include：
It is invisible in acquired image to identify based on the blood color region (26a-f) of the HbCS (22) identified
The HbCS (22) blood color region (26a-f)；And
Based on the HbCS (22) identified in acquired image sightless color region (26a-f) to estimate
State the hemoglobin level of object (38).
14. according to the medical procedures described in any one of claim 9-10, further include：
Identify the color region for the blood for corresponding to the object (38) in acquired image；
The color of the color region for the blood corresponding to the object (38) that will identify that and the HbCS (22) identified
Blood color region (26a-f) in each color be compared, to identify blood most like in the HbCS (22)
Color region (26a-f)；And
The described of the object (38) is estimated according to the HbCS (22) most like blood color region (26a-f)
Hemoglobin level.
15. according to the medical procedures described in any one of claim 9-10, further include：
Calibration parameter is generated to correct the misalignment between the color in the color and acquired image to be projected.
16. at least one processor (16), is programmed to execute according to the medicine described in any one of claim 9-15
Method.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261735088P | 2012-12-10 | 2012-12-10 | |
| US61/735,088 | 2012-12-10 | ||
| PCT/IB2013/060564 WO2014091358A1 (en) | 2012-12-10 | 2013-12-02 | Medical device or system for measuring hemoglobin levels during accidents using a camera-projector system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104837404A CN104837404A (en) | 2015-08-12 |
| CN104837404B true CN104837404B (en) | 2018-05-18 |
Family
ID=49880880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201380064453.4A Active CN104837404B (en) | 2012-12-10 | 2013-12-02 | The medical supply or system of hemoglobin level are measured during accident using camera-projector system |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US9968282B2 (en) |
| EP (1) | EP2928373A1 (en) |
| JP (1) | JP6356141B2 (en) |
| CN (1) | CN104837404B (en) |
| BR (1) | BR112015013111A2 (en) |
| RU (1) | RU2652060C2 (en) |
| WO (1) | WO2014091358A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6158141B2 (en) * | 2014-07-02 | 2017-07-05 | 福田 あゆみ | Anemia checker |
| WO2016013023A2 (en) * | 2014-07-19 | 2016-01-28 | Biosense Technologies Private Ltd | Method and system for haemoglobin measurement |
| CN105534485B (en) * | 2016-02-20 | 2019-12-31 | 深圳市圣必智科技开发有限公司 | Wound bleeding monitoring system and method |
| US10874305B2 (en) | 2018-01-15 | 2020-12-29 | Microsoft Technology Licensing, Llc | Sensor device |
| KR102080920B1 (en) * | 2018-04-23 | 2020-04-23 | 연세대학교 산학협력단 | Quantitative analysis method of hemoglobin level using color image of blood droplet |
| US10991185B1 (en) | 2020-07-20 | 2021-04-27 | Abbott Laboratories | Digital pass verification systems and methods |
| WO2022043998A1 (en) * | 2020-08-23 | 2022-03-03 | My-Or Diagnostics Ltd. | Apparatus and method for determining hemoglobin levels |
| CN114838670A (en) * | 2022-03-11 | 2022-08-02 | 南京北新智能科技有限公司 | Photovoltaic panel dust detection method based on color analysis |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201043971Y (en) * | 2007-04-30 | 2008-04-02 | 中国人民解放军军事医学科学院附属医院 | Hemoglobin color matching card |
| CN101430274A (en) * | 2008-11-05 | 2009-05-13 | 赵中远 | Hemoglobin colour comparison detection apparatus |
| US8224425B2 (en) * | 2005-04-04 | 2012-07-17 | Hypermed Imaging, Inc. | Hyperspectral imaging in diabetes and peripheral vascular disease |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02269939A (en) * | 1989-04-12 | 1990-11-05 | Omron Corp | Biochemical measuring instrument |
| JPH02280033A (en) * | 1989-04-21 | 1990-11-16 | Canon Inc | Colorimetry inspecting device |
| RU2038037C1 (en) * | 1992-07-20 | 1995-06-27 | Акционерное общество закрытого типа Научно-производственное предприятие "Техномедика" | Apparatus for measuring content of bilirubin in patient's subcutaneous tissues and blood |
| JP3934253B2 (en) * | 1998-06-22 | 2007-06-20 | 株式会社資生堂 | Skin color classification system |
| JP2002269939A (en) | 2001-03-15 | 2002-09-20 | Matsushita Electric Ind Co Ltd | Disk device |
| JP4453211B2 (en) | 2001-03-22 | 2010-04-21 | 富士電機システムズ株式会社 | Waste heat treatment method and apparatus for fuel cell power generator |
| US7711403B2 (en) * | 2001-04-05 | 2010-05-04 | Rhode Island Hospital | Non-invasive determination of blood components |
| CH694883A5 (en) * | 2001-06-19 | 2005-08-31 | Alec Blanchard | Device for measuring the level of hemoglobin. |
| CA2604829C (en) | 2005-04-04 | 2018-05-15 | Hypermed, Inc. | Hyperspectral imaging in diabetes and peripheral vascular disease |
| WO2006106509A2 (en) | 2005-04-04 | 2006-10-12 | Hadasit Ltd. | Medical imaging method and system |
| WO2008050234A2 (en) | 2006-10-27 | 2008-05-02 | Hemohue Ltd | Device for measuring haemoglobin level |
| EP2340763A1 (en) | 2007-09-20 | 2011-07-06 | Biocompatibles UK Limited | Method and apparatus for measuring collagen thickness |
| US20100210931A1 (en) | 2008-04-04 | 2010-08-19 | Modulate Imaging Inc. | Method for performing qualitative and quantitative analysis of wounds using spatially structured illumination |
| RU77144U1 (en) * | 2008-04-11 | 2008-10-20 | Общество С Ограниченной Ответственностью "Новые Энергетические Технологии" | DEVICE FOR NON-INVASIVE DETERMINATION OF BLOOD PARAMETERS |
| JP2011036371A (en) | 2009-08-10 | 2011-02-24 | Tohoku Otas Kk | Medical image recording apparatus |
| US8518094B2 (en) | 2010-03-02 | 2013-08-27 | Bwt Property, Inc. | Precisely guided phototherapy apparatus |
| WO2011112559A2 (en) * | 2010-03-08 | 2011-09-15 | Bruce Adams | System, method and article for normalization and enhancement of tissue images |
| US20120259230A1 (en) * | 2011-04-11 | 2012-10-11 | Elven Riley | Tool for recording patient wound history |
| JP6151771B2 (en) | 2012-05-14 | 2017-06-21 | ガウス サージカル, インコーポレイテッドGauss Surgical, Inc. | System and method for measuring the amount of blood components in a fluid canister |
| EP4033405A1 (en) * | 2012-05-14 | 2022-07-27 | Gauss Surgical, Inc. | System and methods for managing blood loss of a patient |
-
2013
- 2013-12-02 WO PCT/IB2013/060564 patent/WO2014091358A1/en active Application Filing
- 2013-12-02 JP JP2015546127A patent/JP6356141B2/en active Active
- 2013-12-02 RU RU2015127773A patent/RU2652060C2/en not_active IP Right Cessation
- 2013-12-02 CN CN201380064453.4A patent/CN104837404B/en active Active
- 2013-12-02 US US14/647,834 patent/US9968282B2/en active Active
- 2013-12-02 EP EP13812158.7A patent/EP2928373A1/en not_active Withdrawn
- 2013-12-02 BR BR112015013111A patent/BR112015013111A2/en not_active Application Discontinuation
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8224425B2 (en) * | 2005-04-04 | 2012-07-17 | Hypermed Imaging, Inc. | Hyperspectral imaging in diabetes and peripheral vascular disease |
| CN201043971Y (en) * | 2007-04-30 | 2008-04-02 | 中国人民解放军军事医学科学院附属医院 | Hemoglobin color matching card |
| CN101430274A (en) * | 2008-11-05 | 2009-05-13 | 赵中远 | Hemoglobin colour comparison detection apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2016505301A (en) | 2016-02-25 |
| WO2014091358A1 (en) | 2014-06-19 |
| EP2928373A1 (en) | 2015-10-14 |
| US20150297119A1 (en) | 2015-10-22 |
| JP6356141B2 (en) | 2018-07-11 |
| BR112015013111A2 (en) | 2018-07-03 |
| US9968282B2 (en) | 2018-05-15 |
| RU2015127773A (en) | 2017-01-16 |
| CN104837404A (en) | 2015-08-12 |
| RU2652060C2 (en) | 2018-04-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104837404B (en) | The medical supply or system of hemoglobin level are measured during accident using camera-projector system | |
| US11709096B2 (en) | Precision luxmeter methods for digital cameras to quantify colors in uncontrolled lighting environments | |
| Dimauro et al. | A new method and a non-invasive device to estimate anemia based on digital images of the conjunctiva | |
| US11030778B2 (en) | Methods and apparatus for enhancing color vision and quantifying color interpretation | |
| AU2012328140B2 (en) | System and method for identifying eye conditions | |
| JP6545658B2 (en) | Estimating bilirubin levels | |
| US20180293350A1 (en) | Image-based disease diagnostics using a mobile device | |
| US10285624B2 (en) | Systems, devices, and methods for estimating bilirubin levels | |
| US20140016096A1 (en) | Image processing apparatus, image processing method, and program | |
| EP3666177B1 (en) | Electronic device for determining degree of conjunctival hyperemia | |
| KR101572226B1 (en) | A strip and method for urine test based on application | |
| KR20140130879A (en) | Urine Examination Method and Related Devices | |
| JP6566240B2 (en) | Information processing apparatus, information processing method, and program | |
| TWI467500B (en) | The detection method of the led of using the digital image | |
| AU2017350177A1 (en) | System and method for correcting color of digital image based on the human sclera and pupil | |
| CN113435353A (en) | Multi-mode-based in-vivo detection method and device, electronic equipment and storage medium | |
| CN107169399B (en) | Face biological feature acquisition device and method | |
| KR101957773B1 (en) | Evaluation method for skin condition using image and evaluation apparatus for skin condition using image | |
| TWI776277B (en) | Adjustment method for an analytical determination of an analyte in a bodily fluid | |
| US11974732B2 (en) | System and method for urine analysis and personal health monitoring | |
| Outlaw et al. | Smartphone colorimetry using ambient subtraction: application to neonatal jaundice screening in Ghana | |
| KR20140135921A (en) | URINE STRIP FOR Urine EXAMINATION | |
| Outlaw et al. | Smartphone screening for neonatal jaundice via ambient-subtracted sclera chromaticity: neoSCB app pilot study | |
| JP7056008B2 (en) | Physical condition analyzer and the program | |
| JP2018005268A (en) | Roll call support system and roll call support program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |