CN111145092A - Method and device for processing infrared blood vessel image on leg surface - Google Patents
Method and device for processing infrared blood vessel image on leg surface Download PDFInfo
- Publication number
- CN111145092A CN111145092A CN201911295414.0A CN201911295414A CN111145092A CN 111145092 A CN111145092 A CN 111145092A CN 201911295414 A CN201911295414 A CN 201911295414A CN 111145092 A CN111145092 A CN 111145092A
- Authority
- CN
- China
- Prior art keywords
- blood vessel
- image
- infrared blood
- infrared
- leg
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000004204 blood vessel Anatomy 0.000 title claims abstract description 282
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000012545 processing Methods 0.000 title claims abstract description 40
- 201000010099 disease Diseases 0.000 claims abstract description 15
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims abstract description 15
- 230000003287 optical effect Effects 0.000 claims description 32
- 238000011161 development Methods 0.000 claims description 9
- 230000004927 fusion Effects 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 7
- 239000012535 impurity Substances 0.000 claims description 5
- 230000002792 vascular Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 238000003672 processing method Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 3
- 238000003384 imaging method Methods 0.000 abstract description 24
- 230000000007 visual effect Effects 0.000 abstract description 12
- 230000000694 effects Effects 0.000 abstract description 11
- 238000003745 diagnosis Methods 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 11
- 210000003462 vein Anatomy 0.000 description 8
- 230000018109 developmental process Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 7
- 230000004048 modification Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 206010046996 Varicose vein Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Radiology & Medical Imaging (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Physics & Mathematics (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention discloses a method for processing an infrared blood vessel image on the surface of a leg, which comprises the following steps: acquiring images of the surface of the leg of a patient to obtain a video frame sequence; extracting the first infrared blood vessel light area image from the video frame sequence; splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image; and outputting the third infrared blood vessel light region image. The invention realizes the technical effects of enlarging the imaging area of the superficial blood vessel of the leg skin, leading a doctor to have integral visual feeling on the distribution of the blood vessel lines in a large range of the leg of a patient and improving the accuracy of disease diagnosis. Meanwhile, the invention also provides a processing device and a computer readable storage medium for the infrared blood vessel image on the surface of the leg.
Description
Technical Field
The invention relates to the technical field of medical instruments, in particular to a method and a device for processing infrared blood vessel images on the surface of a leg.
Background
Superficial vein lines on the skin surface of a human body contain a large amount of information, and the structure of a vein blood vessel of each person is different. Due to various objective factors such as skin thickness and fat, veins and veins of part of patients are difficult to evaluate, great inconvenience is brought to doctors in clinical operation, and the doctors are difficult to accurately distribute the veins of superficial veins on the skin surface. Doctors generally observe by the aid of medical instruments such as a projection type infrared blood vessel imager and the like in an auxiliary mode, so that the doctors are converted into visual vision by means of traditional touch sense, and the trend of blood vessels is clear at a glance.
A projection-type infrared blood vessel imaging instrument and other medical instruments integrate an optical technology and an ultra-sensitive detector, and realize a superficial blood vessel imaging technology of blood vessel visualization by applying an image acquisition and increasing technology. The portable vein puncture outfit has the characteristics of small size, mobility, clear and visible veins at the projection position and the like, and can well solve the problems of poor blood vessel condition, thin and discontinuous blood vessels, varicose vein assessment, difficulty in visual observation, incapability of effective puncture and the like of partial patients.
However, the imaging area of the current skin superficial layer blood vessel imaging medical instrument is too narrow, so that a doctor can only observe a small local blood vessel texture distribution condition, and cannot visually and integrally distribute the blood vessel textures of a large range on legs.
Disclosure of Invention
The embodiment of the application provides a method and a device for processing infrared blood vessel images on the surface of a leg, solves the technical problem that a skin superficial layer blood vessel imaging medical instrument in the prior art is too narrow in an imaging area, and realizes the increase of the skin superficial layer blood vessel imaging area of the leg, so that a doctor can distribute a whole visual feeling on the blood vessel lines of a patient's leg in a large range, and the technical effect of improving the accuracy of disease diagnosis is achieved.
In a first aspect, the present application provides the following technical solutions through an embodiment of the present application:
a processing method of an infrared blood vessel image on the surface of a leg is applied to an electronic device and comprises the following steps:
acquiring an image of the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment;
extracting the first infrared blood vessel light area image from the video frame sequence;
splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second moment, and the second moment is before the first moment;
and outputting the third infrared blood vessel light region image.
Preferably, after the extracting the first infrared blood vessel light region image from the video frame sequence, the method further includes:
and filtering the first infrared blood vessel light area image to remove impurity images in the first infrared blood vessel light area image.
Preferably, the stitching the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image includes:
registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on a texture registration rule to obtain a first registration image;
registering the first infrared blood vessel light area image and a background image based on a contour registration rule to obtain a second registration image;
and performing light region fusion on the first registration image and the second registration image to obtain a third infrared blood vessel light region image.
Preferably, the registering the first infrared blood vessel optical region image and the second infrared blood vessel optical region image based on the texture registration rule to obtain a first registered image includes:
identifying first texture information of a leg of a patient from the first infrared blood vessel optical zone image;
identifying second texture information of the leg of the patient from the second infrared blood vessel optical area image;
and registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on the first texture information and the second texture information to obtain a first registered image.
Preferably, the registering the first infrared blood vessel region image with a background image based on the contour registration rule to obtain a second registered image includes:
identifying first contour information of the leg of the patient from the first infrared blood vessel patch image;
identifying second contour information of the patient's leg from the background image, the background image being from the sequence of video frames;
and registering the first infrared blood vessel optical region image and the background image based on the first contour information and the second contour information to obtain a second registered image.
Preferably, after the outputting the third infrared blood vessel light region image, the method further includes:
acquiring marking operation of a user;
marking on the third infrared blood vessel light region image based on the marking operation;
and storing the third infrared blood vessel light area image carrying the marking result in a medical inquiry system.
Preferably, after the outputting the third infrared blood vessel light region image, the method further includes:
acquiring identification information of the patient;
querying, in a medical query system, historical visit information of the patient based on the identification information of the patient;
generating disease development trend information of the patient based on the historical visit information and the third infrared blood vessel light area image;
and outputting the information of the disease condition development trend.
Based on the same inventive concept, in a second aspect, the present application provides the following technical solutions through an embodiment of the present application:
a processing device of an infrared blood vessel image on the surface of a leg is applied to an electronic device and comprises:
the acquisition module is used for acquiring images of the surface of the leg of the patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel light area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment;
the extraction module is used for extracting the first infrared blood vessel light area image from the video frame sequence;
a splicing module, configured to splice the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, where the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second time, and the second time is before the first time;
and the output module is used for outputting the third infrared blood vessel light area image.
Based on the same inventive concept, in a third aspect, the present application provides the following technical solutions through an embodiment of the present application:
a device for processing an infrared blood vessel image of a leg surface, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor, when executing the program, is configured to implement the method steps of any of the above-mentioned first aspects.
Based on the same inventive concept, in a fourth aspect, the present application provides the following technical solutions through an embodiment of the present application:
a computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, is adapted to carry out the method steps of any of the embodiments of the first aspect.
One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:
in the embodiment of the application, a method for processing an infrared blood vessel image on the surface of a leg is disclosed, which comprises the following steps: acquiring an image of the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment; extracting the first infrared blood vessel light area image from the video frame sequence; splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second moment, and the second moment is before the first moment; and outputting the third infrared blood vessel light region image. Therefore, the technical problem that an imaging area of a skin superficial layer blood vessel imaging medical instrument in the prior art is too narrow is solved, the imaging area of the skin superficial layer blood vessel of the leg is enlarged, a doctor can distribute a whole visual feeling to the blood vessel lines of the leg of the patient on a large scale, and the technical effect of improving the accuracy of disease diagnosis is achieved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
FIG. 1 is a flowchart of a method for processing an infrared blood vessel image of a leg surface according to an embodiment of the present invention;
FIG. 2 is a detailed flowchart of step S103 in the embodiment of the present invention;
FIG. 3 is a schematic diagram illustrating an effect of an infrared blood vessel image on a leg surface according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a device for processing an infrared blood vessel image of a leg surface according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a device for processing an infrared blood vessel image of a leg surface according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a case where processing of an infrared blood vessel image on a leg surface is performed as a server according to an embodiment of the present invention.
Detailed Description
The embodiment of the application provides a method and a device for processing infrared blood vessel images on the surface of a leg, solves the technical problem that a skin superficial layer blood vessel imaging medical instrument in the prior art is too narrow in an imaging area, and realizes the increase of the skin superficial layer blood vessel imaging area of the leg, so that a doctor can distribute a whole visual feeling on the blood vessel lines of a patient's leg in a large range, and the technical effect of improving the accuracy of disease diagnosis is achieved.
In order to solve the technical problems, the general idea of the embodiment of the application is as follows:
a method for processing an infrared blood vessel image on the surface of a leg comprises the following steps: acquiring an image of the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment; extracting the first infrared blood vessel light area image from the video frame sequence; splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second moment, and the second moment is before the first moment; and outputting the third infrared blood vessel light region image. Therefore, the technical problem that an imaging area of a skin superficial layer blood vessel imaging medical instrument in the prior art is too narrow is solved, the imaging area of the skin superficial layer blood vessel of the leg is enlarged, a doctor can distribute a whole visual feeling to the blood vessel lines of the leg of the patient on a large scale, and the technical effect of improving the accuracy of disease diagnosis is achieved.
In order to better understand the technical solution, the technical solution will be described in detail with reference to the drawings and the specific embodiments.
First, it is stated that the term "and/or" appearing herein is merely one type of associative relationship that describes an associated object, meaning that three types of relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
In the following description, the term "plurality" as used herein generally refers to "more than two" including "two".
Example one
As shown in fig. 1, the present embodiment provides a method for processing an infrared blood vessel image on a leg surface, including:
step S101: the method comprises the steps of carrying out image acquisition on the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment.
In a specific implementation process, the method is applied to an electronic device, and the electronic device may be: a PC (Personal Computer), or a smartphone, or a tablet Computer, or a smart tv, or a server, etc. Here, the electronic device is not particularly limited in the embodiment as to what kind of device is.
In one embodiment, the electronic device has an image capture device (e.g., a camera) for capturing an image of a surface of a leg of a patient.
For example, can place in patient's shank the place ahead with tripod fixed connection electronic equipment's camera, simultaneously, the handheld projection infrared ray blood vessel imager of doctor scans patient's shank, and projection infrared ray blood vessel imager has a display screen, can export the shallow blood vessel line distribution image on the surface of shank in real time. While the doctor scans the leg of the patient by using the projection infrared blood vessel imager, the electronic device can acquire an image of the leg of the patient (including an image on a display screen of the projection infrared blood vessel imager) through the camera to obtain a video frame sequence.
In a specific implementation, after the step S101 is executed, the step S102 may be executed.
Step S102: a first infrared vessel light area image is extracted from the video frame sequence.
In the specific implementation process, the infrared blood vessel light region image in the video frame sequence transmitted by the camera can be segmented and extracted by using a difference method, skin color detection, an image segmentation algorithm and the like, so as to obtain a first infrared blood vessel light region image.
As an alternative embodiment, after step S102, the method further includes:
and filtering the first infrared blood vessel light region image to remove impurity images in the first infrared blood vessel light region image.
In the specific implementation process, because a doctor is influenced by factors such as scanning speed and illumination in the scanning process of the handheld projection type infrared blood vessel imaging instrument, some blood vessel line light region images with fuzzy degree and high overlapping degree can appear. For this, the first infrared blood vessel region image needs to be filtered (e.g., mainly overlap filtering and blur detection filtering to remove some useless region images). Specifically, the image quality detection evaluation may be performed by using a correlation algorithm of image quality detection, so as to filter the first infrared blood vessel region image.
In a specific implementation, after step S102 is executed, step S103 may be executed.
Step S103: and splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by an infrared blood vessel imager when scanning the surface of the leg of the patient at the second moment, and the second moment is before the first moment.
In a specific implementation process, the second infrared blood vessel light region image and the first infrared blood vessel light region image may be two adjacent frames of images or two non-adjacent frames of images, and the second infrared blood vessel light region image is located before the first infrared blood vessel light region image.
In a specific implementation process, the first infrared blood vessel light region image and the second infrared blood vessel light region image need to be spliced. In the splicing process, the leg shapes are required to be ensured to be consistent and complete, and the blood vessel lines are ensured to be consistent, so that a doctor provides real-time, integral and visual perception, and the accurate diagnosis and treatment of the doctor are facilitated.
As an alternative embodiment, as shown in fig. 2, step S103 includes:
step S201: registering the first infrared blood vessel light region image and the second infrared blood vessel light region image based on a texture registration rule to obtain a first registration image;
step S202: registering the first infrared blood vessel light area image and the background image based on a contour registration rule to obtain a second registration image;
step S203: and performing light region fusion on the first registration image and the second registration image to obtain a third infrared blood vessel light region image.
In step S201, first texture information of the leg of the patient may be recognized from the first infrared blood vessel optical region image; identifying second texture information of the leg of the patient from the second infrared blood vessel optical area image; and registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on the first texture information and the second texture information to obtain a first registered image.
In step S202, first contour information of the leg of the patient may be recognized from the first infrared blood vessel optical region image; identifying second contour information of the leg of the patient from the background image; and registering the first infrared blood vessel light area image and the background image based on the first contour information and the second contour information to obtain a second registered image.
Wherein the background image is from a sequence of video frames, which may be extracted in advance. When extracting the background image, the surrounding environment (such as illumination, background singleness, etc.) needs to be controlled, and a camera is used to extract a frame as the background image. The extracted background image can be registered and combined with the first infrared blood vessel light area image and/or the second infrared blood vessel light area image, and therefore a good visual effect is provided.
The physician expects the patient to be standing still throughout the scan, but the patient is inevitably subjected to minor jolts. In order to avoid the influence on the final blood vessel texture splicing caused by slight shaking of the legs when the patient stands. Here, step S201 may be performed to register the texture of the first infrared blood vessel light region image with the texture of the second infrared blood vessel light region image; simultaneously, executing step S202, and carrying out rough image registration on the leg contour of the first infrared blood vessel optical zone image and the leg contour of the background image; thus, the small error caused by the small shaking of the leg of the patient in the scanning process can be corrected. This process may be referred to as "splice correction".
In the specific implementation process, when the first infrared blood vessel light region image and the second infrared blood vessel light region image are aligned, all matching cannot be guaranteed to be completely correct. Therefore, the corrected result needs to be evaluated, and the frame which fails to be corrected is discarded in time.
Through the processing, a light region image (namely, a first infrared blood vessel light region image) with clear and reasonable texture can be obtained, and the blood vessel texture of the light region image is ensured to be consistent with that of a second infrared blood vessel light region image. Because the legs of the patient basically do not move, even if the patient slightly shakes, the error caused by the slight shaking can be made up through the correction process.
In step S203, the first registration image and the second registration image may be subjected to optical region fusion by using algorithms such as multiband fusion, poisson fusion, and the like, so as to achieve a seamless visual effect and obtain a third infrared blood vessel optical region image,
as shown in fig. 3, the first infrared blood vessel light region image a and the second infrared blood vessel light region image B may be spliced, and the spliced image may be referred to as a third infrared blood vessel light region image.
In a specific implementation process, more than two (e.g., 3, or 5, or 8, etc.) infrared blood vessel light region images can be spliced to obtain a third infrared blood vessel light region image with a larger area.
In a specific implementation, after the third infrared blood vessel patch image is obtained, it may be saved to a medical query system.
In a specific implementation, after the step S103 is executed, the step S104 may be executed.
Step S104: and outputting a third infrared blood vessel light area image.
In a specific implementation process, the electronic device further includes an image display device (e.g., a display screen), and multiple infrared blood vessel region images (e.g., a third infrared blood vessel region image) can be displayed on the image display device in parallel by using the multithreading technology, so as to provide a real-time considerable visual effect for a doctor.
As an alternative embodiment, after step S104, the method further includes:
acquiring marking operation of a user (such as a doctor); marking on the third infrared blood vessel light region image based on the marking operation; and storing the third infrared blood vessel light area image carrying the marking result in a medical inquiry system.
In the specific implementation process, the function of marking the scanned result image can be provided, and a doctor carries out labeling processing on the scanning result, highlights key parts and evaluates and scores the severity of the illness state.
In the implementation process, basic functions of adding, deleting, modifying, searching, and the like of the image (namely, the infrared blood vessel light area image) can be provided.
As an alternative embodiment, after step S104, the method further includes:
acquiring identification information of a patient; querying historical visit information of the patient in a medical query system based on the identification information of the patient; generating disease development trend information of the patient based on the historical clinic information and the third infrared blood vessel light area image; and outputting the information of the disease development trend (namely, a disease analysis report).
For example, the system can be queried according to the identification information (e.g., name, ID, identification number, etc.) of the current patient to determine whether the system has the current patient information; if so, inquiring the historical diagnosis information of the patient, carrying out statistics and summarization together with the evaluation of the current scanning result (namely, the third infrared blood vessel light area image), displaying the information of the patient condition development trend, and making a treatment decision in time by a doctor according to the condition trend; otherwise, the current scanning result is directly stored in the system.
The embodiment effectively solves the problems that the imaging area of the current skin superficial layer blood vessel imaging medical instrument is too narrow, and the observation range of the doctor on the blood vessel lines of the legs is too narrow, so that the medical diagnosis is influenced. Compared with the prior art, the method provided by the embodiment has the characteristics of flexibility, intuition and visualization, a doctor can flexibly scan a concerned area and observe the distribution of blood vessels in legs in real time, convenience is brought to subsequent analysis, processing and evaluation, and time and cost are saved. Meanwhile, the connection consistency of infrared blood vessel light zone lines and the effect of rapid display without changing leg shapes can be ensured. The technology is benefited by adopting the technologies of image splicing, image quality detection, image fusion, image registration, multi-thread display and the like. The image splicing technology provides a basis for displaying the distribution of the shallow vessels of the legs, multithreading real-time display is achieved, and a visual experience of real-time leg vessel display is provided for doctors. And the final splicing effect is ensured by the technologies of picture quality detection, image fusion, image registration and the like.
The technical scheme in the embodiment of the application at least has the following technical effects or advantages:
in the embodiment of the application, a method for processing an infrared blood vessel image on the surface of a leg is disclosed, which comprises the following steps: acquiring an image of the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment; extracting the first infrared blood vessel light area image from the video frame sequence; splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second moment, and the second moment is before the first moment; and outputting the third infrared blood vessel light region image. Therefore, the technical problem that an imaging area of a skin superficial layer blood vessel imaging medical instrument in the prior art is too narrow is solved, the imaging area of the skin superficial layer blood vessel of the leg is enlarged, a doctor can distribute a whole visual feeling to the blood vessel lines of the leg of the patient on a large scale, and the technical effect of improving the accuracy of disease diagnosis is achieved.
Example two
Based on the same inventive concept, as shown in fig. 4, the present embodiment provides a processing apparatus 200 for an infrared blood vessel image on a leg surface, applied in an electronic device, comprising:
an acquisition module 201, configured to acquire an image of a leg surface of a patient to obtain a video frame sequence, where the video frame sequence includes a first infrared vascular light zone image output by an infrared vascular imager when the leg surface of the patient is scanned at a first time;
an extraction module 202, configured to extract the first infrared blood vessel optical region image from the video frame sequence;
a stitching module 203, configured to stitch the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, where the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when the surface of the leg of the patient is scanned at a second time, and the second time is before the first time;
and the output module 204 is configured to output the third infrared blood vessel light region image.
As an alternative embodiment, the apparatus 200 further includes:
and the impurity filtering module is used for filtering the first infrared blood vessel light region image after the first infrared blood vessel light region image is extracted from the video frame sequence so as to remove the impurity image in the first infrared blood vessel light region image.
As an optional embodiment, the splicing module 203 is specifically configured to:
registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on a texture registration rule to obtain a first registration image; registering the first infrared blood vessel light area image and a background image based on a contour registration rule to obtain a second registration image; and performing light region fusion on the first registration image and the second registration image to obtain a third infrared blood vessel light region image.
As an optional embodiment, the splicing module 203 is specifically configured to:
identifying first texture information of a leg of a patient from the first infrared blood vessel optical zone image; identifying second texture information of the leg of the patient from the second infrared blood vessel optical area image; and registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on the first texture information and the second texture information to obtain a first registered image.
As an optional embodiment, the splicing module 203 is specifically configured to:
identifying first contour information of the leg of the patient from the first infrared blood vessel patch image; identifying second contour information of the patient's leg from the background image, the background image being from the sequence of video frames; and registering the first infrared blood vessel optical region image and the background image based on the first contour information and the second contour information to obtain a second registered image.
As an alternative embodiment, the apparatus 200 further includes:
the marking module is used for acquiring marking operation of a user after the third infrared blood vessel light region image is output; marking on the third infrared blood vessel light region image based on the marking operation;
and the storage module is used for storing the third infrared blood vessel light area image carrying the marking result in a medical inquiry system.
As an alternative embodiment, the apparatus 200 further includes:
the query module is used for acquiring the identification information of the patient after the third infrared blood vessel optical area image is output; querying, in a medical query system, historical visit information of the patient based on the identification information of the patient;
the generation module is used for generating the disease development trend information of the patient based on the historical clinic information and the third infrared blood vessel light area image; and outputting the information of the disease condition development trend.
Since the processing device for a leg surface infrared blood vessel image described in this embodiment is a device used for implementing the processing method for a leg surface infrared blood vessel image in the first embodiment of this application, based on the processing method for a leg surface infrared blood vessel image described in the first embodiment of this application, a person skilled in the art can understand a specific implementation manner of the processing device for a leg surface infrared blood vessel image in this embodiment and various variations thereof, and therefore, how to implement the method in the first embodiment of this application by the processing device for a leg surface infrared blood vessel image is not described in detail here. As long as the person skilled in the art implements the apparatus used in the method for processing the infrared blood vessel image on the leg surface in the embodiment of the present application, the apparatus is within the scope of the present application.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 5 is a block diagram of a leg surface infrared blood vessel image processing device according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 5, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed state of the device 800, the relative positioning of the components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or a component of the apparatus 800, the presence or absence of user contact with the apparatus 800, orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium having instructions therein which, when executed by a processor of a device 800, enable the device 800 to perform a method of processing an infrared blood vessel image of a leg surface, comprising: acquiring an image of the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment; extracting the first infrared blood vessel light area image from the video frame sequence; splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second moment, and the second moment is before the first moment; and outputting the third infrared blood vessel light region image.
Fig. 6 is a structural diagram of a leg surface infrared blood vessel image processing device as a server according to an embodiment of the present invention. The server 1900 may vary widely by configuration or performance and may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in the storage medium 1930 may include one or more modules (not shown), each of which may include a series of instructions operating on a server. Still further, a central processor 1922 may be provided in communication with the storage medium 1930 to execute a series of instruction operations in the storage medium 1930 on the server 1900.
The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is defined only by the appended claims, which are not intended to limit the present invention, and any modifications, equivalents, improvements, etc. made within the spirit and principle of the present invention should be included in the scope of the present invention.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A processing method of an infrared blood vessel image on the surface of a leg is applied to electronic equipment, and is characterized by comprising the following steps:
acquiring an image of the surface of a leg of a patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel optical area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment;
extracting the first infrared blood vessel light area image from the video frame sequence;
splicing the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, wherein the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second moment, and the second moment is before the first moment;
and outputting the third infrared blood vessel light region image.
2. The method of claim 1, wherein after said extracting the first infrared vascular patch image from the sequence of video frames, further comprising:
and filtering the first infrared blood vessel light area image to remove impurity images in the first infrared blood vessel light area image.
3. The method of claim 1, wherein the stitching the first infrared blood vessel region image and the second infrared blood vessel region image to obtain a third infrared blood vessel region image comprises:
registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on a texture registration rule to obtain a first registration image;
registering the first infrared blood vessel light area image and a background image based on a contour registration rule to obtain a second registration image;
and performing light region fusion on the first registration image and the second registration image to obtain a third infrared blood vessel light region image.
4. The method of claim 3, wherein the registering the first infrared vascular patch image with the second infrared vascular patch image based on the texture registration rule to obtain a first registered image comprises:
identifying first texture information of a leg of a patient from the first infrared blood vessel optical zone image;
identifying second texture information of the leg of the patient from the second infrared blood vessel optical area image;
and registering the first infrared blood vessel light area image and the second infrared blood vessel light area image based on the first texture information and the second texture information to obtain a first registered image.
5. The method of claim 3, wherein the registering the first infrared vessel patch image with a background image based on the contour registration rule to obtain a second registered image comprises:
identifying first contour information of the leg of the patient from the first infrared blood vessel patch image;
identifying second contour information of the patient's leg from the background image, the background image being from the sequence of video frames;
and registering the first infrared blood vessel optical region image and the background image based on the first contour information and the second contour information to obtain a second registered image.
6. The method of claim 1, wherein after outputting the third infrared blood vessel patch image, further comprising:
acquiring marking operation of a user;
marking on the third infrared blood vessel light region image based on the marking operation;
and storing the third infrared blood vessel light area image carrying the marking result in a medical inquiry system.
7. The method according to any one of claims 1 to 6, further comprising, after the outputting the third infrared blood vessel optical region image:
acquiring identification information of the patient;
querying, in a medical query system, historical visit information of the patient based on the identification information of the patient;
generating disease development trend information of the patient based on the historical visit information and the third infrared blood vessel light area image;
and outputting the information of the disease condition development trend.
8. A processing device of an infrared blood vessel image on the surface of a leg is applied to an electronic device, and is characterized by comprising:
the acquisition module is used for acquiring images of the surface of the leg of the patient to obtain a video frame sequence, wherein the video frame sequence comprises a first infrared blood vessel light area image output by an infrared blood vessel imager when the surface of the leg of the patient is scanned at a first moment;
the extraction module is used for extracting the first infrared blood vessel light area image from the video frame sequence;
a splicing module, configured to splice the first infrared blood vessel light region image and the second infrared blood vessel light region image to obtain a third infrared blood vessel light region image, where the second infrared blood vessel light region image is an infrared blood vessel light region image output by the infrared blood vessel imager when scanning the surface of the leg of the patient at a second time, and the second time is before the first time;
and the output module is used for outputting the third infrared blood vessel light area image.
9. An apparatus for processing an infrared image of a blood vessel on a leg surface, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor when executing the program is configured to perform the method steps of any one of claims 1 to 7.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, is adapted to carry out the method steps of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295414.0A CN111145092A (en) | 2019-12-16 | 2019-12-16 | Method and device for processing infrared blood vessel image on leg surface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911295414.0A CN111145092A (en) | 2019-12-16 | 2019-12-16 | Method and device for processing infrared blood vessel image on leg surface |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111145092A true CN111145092A (en) | 2020-05-12 |
Family
ID=70518447
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911295414.0A Pending CN111145092A (en) | 2019-12-16 | 2019-12-16 | Method and device for processing infrared blood vessel image on leg surface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111145092A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102831584A (en) * | 2012-08-02 | 2012-12-19 | 中山大学 | Data-driven object image restoring system and method |
| CN108198174A (en) * | 2017-12-28 | 2018-06-22 | 西安中科微光影像技术有限公司 | A kind of angiocarpy IVOCT and IVUS autoegistration methods and device |
| CN109171670A (en) * | 2018-06-25 | 2019-01-11 | 天津海仁医疗技术有限公司 | A kind of 3D blood vessel imaging algorithm based on reverse Principal Component Analysis |
| CN110473143A (en) * | 2019-07-23 | 2019-11-19 | 平安科技（深圳）有限公司 | A kind of three-dimensional MRA medical image joining method and device, electronic equipment |
-
2019
- 2019-12-16 CN CN201911295414.0A patent/CN111145092A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102831584A (en) * | 2012-08-02 | 2012-12-19 | 中山大学 | Data-driven object image restoring system and method |
| CN108198174A (en) * | 2017-12-28 | 2018-06-22 | 西安中科微光影像技术有限公司 | A kind of angiocarpy IVOCT and IVUS autoegistration methods and device |
| CN109171670A (en) * | 2018-06-25 | 2019-01-11 | 天津海仁医疗技术有限公司 | A kind of 3D blood vessel imaging algorithm based on reverse Principal Component Analysis |
| CN110473143A (en) * | 2019-07-23 | 2019-11-19 | 平安科技（深圳）有限公司 | A kind of three-dimensional MRA medical image joining method and device, electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10565763B2 (en) | Method and camera device for processing image | |
| US10346669B2 (en) | Fingerprint entry prompting method and device | |
| CN107025419B (en) | Fingerprint template inputting method and device | |
| JP2018517950A (en) | Method and system for content management of video images in anatomical regions | |
| JP6263617B2 (en) | Display control method and apparatus, electronic device | |
| CN106296570B (en) | Image processing method and device | |
| EP3979194A1 (en) | Image state determination method and device, apparatus, system, and computer storage medium | |
| US11030733B2 (en) | Method, electronic device and storage medium for processing image | |
| CN107515669B (en) | Display method and device | |
| CN112330570B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN111476808B (en) | Iris image definition evaluation method and device | |
| CN105357425A (en) | Image shooting method and image shooting device | |
| JP5822545B2 (en) | Image processing apparatus, image processing apparatus control method, and program | |
| CN111340691B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN114140616A (en) | Heart rate detection method and device, electronic equipment and storage medium | |
| CN112347911A (en) | Method and device for adding special effects of fingernails, electronic equipment and storage medium | |
| CN111340690B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN106469446B (en) | Depth image segmentation method and segmentation device | |
| CN111145092A (en) | Method and device for processing infrared blood vessel image on leg surface | |
| CN113192606A (en) | Medical data processing method and device, electronic equipment and storage medium | |
| CN112784858B (en) | Image data processing method and device and electronic equipment | |
| CN114390189A (en) | Image processing method, device, storage medium and mobile terminal | |
| CN112927275A (en) | Image processing method and device, electronic equipment and storage medium | |
| CN114663901A (en) | Image processing method, image recognition device, electronic apparatus, and medium | |
| CN113747113A (en) | Image display method and device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200512 |
|
| RJ01 | Rejection of invention patent application after publication |