CN110189296A - Eye fundus image vascular wall reflective state labeling method and equipment - Google Patents
Eye fundus image vascular wall reflective state labeling method and equipment Download PDFInfo
- Publication number
- CN110189296A CN110189296A CN201910305255.1A CN201910305255A CN110189296A CN 110189296 A CN110189296 A CN 110189296A CN 201910305255 A CN201910305255 A CN 201910305255A CN 110189296 A CN110189296 A CN 110189296A
- Authority
- CN
- China
- Prior art keywords
- image
- blood vessel
- eye fundus
- pixel
- angiosomes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30041—Eye; Retina; Ophthalmic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
Abstract
The present invention provides a kind of eye fundus image vascular wall reflective state labeling method and equipment, which comprises angiosomes are determined in eye fundus image；According to the blood vessel image fitted ellipse region in the angiosomes；The data for being used for label vascular wall reflective state are generated according to the pixel value of the pixel of the blood vessel image in the elliptic region short axle.
Description
Technical field
The present invention relates to medical images to identify field, and in particular to a kind of eye fundus image vascular wall reflective state labeling method
And equipment.
Background technique
Image segmentation, which refers to, divides the image into several mutually according to features such as gray scale, colour, spatial texture, geometries
Disjoint region so that these features show consistency or similitude in the same area, and shows between different zones
It is apparent different out.Semantic segmentation is to identify the semanteme in each piece of region on the basis of image segmentation.Image, semantic segmentation
It is an important branch in the field AI, is widely used in GIS-Geographic Information System at present, unmanned vehicle drives, medical imaging point
In the fields such as analysis, robot.
It include a large amount of and tiny blood vessel images in eye fundus image, many fundus oculi diseases are related with blood vessel state.Such as eye
Bottom blood vessel elasticity weakens, and is presented as the reflective enhancing of arterial wall, such case is presented as that brightness is higher in eye fundus image, picture
There are some differences in plain value and normal region.
The prior art may be implemented to be split the blood vessel image in eye fundus image, such as available shown in Fig. 8
Image, but due to tiny more than blood vessel image, even image shown in Fig. 8, the blood vessel feature therein for human eye
Also not obvious enough, it is difficult that observation is distinguished.
Summary of the invention
In view of this, the present invention provides a kind of eye fundus image vascular wall reflective state flag data generation method, including such as
Lower step:
Angiosomes are determined in eye fundus image；
According to the blood vessel image fitted ellipse region in the angiosomes；
It is generated according to the pixel value of the pixel of the blood vessel image in the elliptic region short axle and is used for label vascular
The data of wall reflective state.
Optionally, angiosomes are determined in eye fundus image, comprising:
Single pass eye fundus image and optical fundus blood vessel exposure mask figure are obtained according to colored eye fundus image；
Single pass optical fundus blood vessel image is obtained according to the single pass eye fundus image and the optical fundus blood vessel exposure mask figure；
The angiosomes are searched in the single pass optical fundus blood vessel image.
Optionally, the angiosomes are searched in the single pass optical fundus blood vessel image, comprising:
The pixel with max pixel value is determined in the single pass optical fundus blood vessel image；
The angiosomes are determined based on the pixel.
Optionally, circulation executes the step of searching for the angiosomes in the single pass optical fundus blood vessel image,
During circulation executes, determined angiosomes are marked, so that identified area vasculosa when executing each time
Domain is not overlapped, until reaching the termination condition of setting.
Optionally, the termination condition is according to cycle-index and/or for being compared with the max pixel value
What pixel value threshold value determined.
Optionally, the data for label vascular wall reflective state are the pixel numbers that pixel value is greater than given threshold
Amount is less than or equal to the ratio of the pixel quantity of the given threshold with pixel value.
Optionally, it is generated according to the pixel value of the pixel of the blood vessel image in the elliptic region short axle for marking
Remember the data of vascular wall reflective state, comprising:
Determine that pixel value is greater than the pixel quantity of given threshold in the short axle and pixel value is less than or equal to described set
Determine the ratio of the pixel quantity of threshold value；
According to the ratio determine the angiosomes whether be vascular wall retroreflective regions conclusion.
The present invention also provides a kind of eye fundus image vascular wall retroreflective regions labeling methods, include the following steps:
Flag data is generated according to above-mentioned eye fundus image vascular wall reflective state flag data generation method；
The flag data is added in eye fundus image on corresponding position.
Correspondingly, the present invention also provides a kind of eye fundus image vascular wall reflective state flag data generating devices, comprising: extremely
A few processor and the memory being connect at least one described processor communication；Wherein, be stored with can for the memory
The instruction executed by least one described processor, described instruction executed by least one described processor so that it is described at least
One processor executes above-mentioned eye fundus image vascular wall reflective state flag data generation method.
Correspondingly, the present invention also provides a kind of eye fundus image vascular wall retroreflective regions marking arrangements, comprising: at least one
Reason device and the memory being connect at least one described processor communication；Wherein, the memory be stored with can by it is described extremely
The instruction that a few processor executes, described instruction are executed by least one described processor, so that at least one described processing
Device executes above-mentioned eye fundus image vascular wall retroreflective regions labeling method.
The eye fundus image vascular wall reflective state flag data generation method and equipment provided according to the present invention, by
Angiosomes are determined in eye fundus image, and by the blood vessel image fitted ellipse region in angiosomes, then according to elliptic region
The pixel value of the pixel of blood vessel image in short axle generates the data for being used for label vascular wall reflective state, this flag data
The reflective situation that blood vessel can accurately be embodied, the subtle or fuzzy Content Transformation that eye fundus image is presented are intuitive label
Data can be used family and the reflective state of vascular wall be well understood, and auxiliary doctor weakens illness to optical fundus blood vessel elasticity
Diagnosis, improves the working efficiency of doctor.
The eye fundus image vascular wall retroreflective regions labeling method and equipment provided according to the present invention, intuitively expresses reflective shape
The targeted blood vessel image of state flag data makes doctor can be understood that the reflective situation of blood vessel image everywhere, Yi Shengke
With these regions of primary part observation under the prompt of flag data, to improve the specific aim and efficiency of diagosis work.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the flow chart of the eye fundus image blood vessel image dividing method in the embodiment of the present invention；
Fig. 2 is the eye fundus image in the embodiment of the present invention；
Fig. 3 is an image block in eye fundus image shown in Fig. 2；
Fig. 4 is segmentation result of the parted pattern for image block shown in Fig. 3；
Fig. 5 is the optical fundus blood vessel image for being split and splicing for image shown in Fig. 2；
Fig. 6 is the schematic diagram for obtaining image block in the embodiment of the present invention using sliding window；
Fig. 7 is the flow chart of the eye fundus image vascular wall reflective state flag data generation method in the embodiment of the present invention；
Fig. 8 is the global angiosomes image in the embodiment of the present invention；
Fig. 9 is the schematic diagram for blood vessel image fitted ellipse shown in Fig. 3 region；
Figure 10 is the schematic diagram according to elliptic region and blood vessel image selected pixels point；
Figure 11 is a kind of preferred eye fundus image vascular wall reflective state flag data generation method in the embodiment of the present invention
Flow chart；
Figure 12 is the eye fundus image for enhancing contrast in the embodiment of the present invention；
Figure 13, Figure 14 are the process schematic that angiosomes are searched in the embodiment of the present invention；
Figure 15 is the result schematic diagram for being added to flag data in the embodiment of the present invention in eye fundus image.
Specific embodiment
Technical solution of the present invention is clearly and completely described below in conjunction with attached drawing, it is clear that described implementation
Example is a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill
Personnel's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
As long as in addition, the non-structure each other of technical characteristic involved in invention described below different embodiments
It can be combined with each other at conflict.
The present invention provides a kind of eye fundus image blood vessel image dividing method, this method can be by computer and server etc.
Electronic equipment executes.This method comprises the following steps as shown in Figure 1:
S1A obtains eye fundus image.In one embodiment, to eyeground photographing device acquisition eye ground photo into
Row is cut, and is eliminated boundary and is obtained showing square eye fundus image such as Fig. 2.It in other embodiments can also be without these pre- places
The fundus photograph of eyeground photographing device acquisition can be used directly in reason.
Eye fundus image is divided into multiple images block by S2A, and the size of image block is set according to the size of eye fundus image
Fixed, for most cases, the size of the image block of division should be significantly less than the size of entire eye fundus image.Such as eye fundus image
Size be 1000*1000 (pixel), the size of the image block marked off is 100*100 (pixel).
The size of each image block can be same or different.Adjacent image block boundaries can be immediately adjacent to each other,
It can overlap.
S3A, the blood vessel image being directed in each image block respectively using parted pattern are split to obtain segmented image block.
Parted pattern specifically can be the neural networks such as FCN, SegNet, DeepLab, should use sample before using parted pattern
Data, which are trained it, makes it have certain semantic segmentation ability, and handmarking's sample of angiosomes specifically can be used
Image block training obtains.
Disaggregated model can extract the feature of image block medium vessels image, and form segmented image block according to the feature of extraction,
Blood vessel image is highlighted wherein, is specifically highlighted there are many modes, for example, by using the various pixel values for differing markedly from background
Express the position etc. where blood vessel.
As a specific citing, image block shown in Fig. 3 is inputted into parted pattern, it is available as shown in Figure 4
Segmented image block, used disaggregated model output is bianry image in this embodiment, it is using two kinds of pixel values point
Not Biao Da background and blood vessel image, intuitively highlight vessel position, and bianry image be more advantageous to it is subsequent to blood vessel image
Measurement operation.
S4A is spliced into optical fundus blood vessel image, such as image shown in fig. 5 using segmented image block.Fig. 5 is clearly expressed
Blood vessel image and background in eye fundus image, especially for the position of arrow meaning in figure, these are actually abnormal
Blood vessel image, this allows doctor to be easier to find the lesion in eyeground about blood vessel.
So-called splicing includes a variety of situations, this is depended on used in the dividing condition in step S2A and step S3A
Disaggregated model output segmented image block size.It is illustrated in case where one kind is fairly simple, if divide
Each tile size is identical, is immediately adjacent to each other there is no being overlapped, the image block of segmented image block and division that parted pattern exports
Size is consistent, then segmented image block is arranged together by the position directly according to image block in eye fundus image can form finally
Optical fundus blood vessel image.
The eye fundus image blood vessel image dividing method provided according to embodiments of the present invention, is divided into image for eye fundus image
Block, and be split using parted pattern for the blood vessel image in image block, the segmentation result corresponding to image block is obtained, so
These segmentation results are spliced into complete optical fundus blood vessel image afterwards, are achieved in the blood vessel image cutting operation of automation, and
And the accuracy of segmentation result is improved, obtained optical fundus blood vessel image can assist in doctor to optical fundus blood vessel elasticity decrease etc.
Disease is diagnosed, and the working efficiency of doctor is improved.
In order to avoid the accuracy of boundary effect Image Segmentation and splicing result, in a preferred embodiment, in step
When rapid S2A divides image block, the division mode that is overlapped using adjacent image block.Specifically, sliding window time is utilized
It goes through eye fundus image and obtains image block, the glide direction in ergodic process includes horizontal direction and vertical direction, in both direction
Sliding step be respectively less than the length and width of sliding window.
The size of sliding window is 128*128 (pixel) in the present embodiment, and the size of the image block thus obtained is
128*128 (pixel).Fig. 6 shows the process schematic of sliding window traversal eye fundus image, obtains image using sliding window
Move right window after block a, and step-length is 64 (pixels), obtains image block b, so that the adjacent image block of horizontal direction has part weight
Folded (having half overlapping in the present embodiment)；Similarly, window is moved down in vertical direction, step-length is 64 (pixels), obtains figure
It as block c, overlaps to adjacent image block vertically and (has half overlapping in the present embodiment), while image block b and image block c
Also it overlaps and (has a quarter overlapping in the present embodiment).It in this manner can be by entire eyeground figure after traversal image
As being divided into multiple images block, partly overlapping image block can eliminate boundary effect in subsequent splicing to the shadow of splicing result
It rings.It should be noted that Fig. 6 is intended merely to clearly demonstrate and the example images that provide, it should be arranged hold in actual use
The starting of row sliding window and final position, and be arranged it is suitably sized can complete traversal eye fundus image.
In the case where overlapping between image block, so that the concatenation of step S4A becomes complicated, but it can be improved
The accuracy of blood vessel image expressed by the optical fundus blood vessel image being spliced into.Specifically, eye is being spliced into using segmented image block
During the blood-vessel image of bottom, for the lap of adjacent segmented image block, take lap pixel value average value or
Person's maximum value.Such as above-mentioned image block a and image block b, parted pattern exports segmented image block a ' and segmented image block b ',
Also correspondingly there is half overlapping between them.The part being overlapped segmented image block a ' and segmented image block b ' is taken in splicing
The average value or maximum value of pixel value be all it is feasible, it is final the result is that bianry image, needs herein if necessary to guarantee
It is maximized.If pixel value is 0, the pixel value in segmented image block b ' in segmented image block a ' for same pixel
It is 255, then value is 255 in splicing result image.
The present invention provides another eye fundus image blood vessel image dividing method, and this method can be by computer and server etc.
Electronic equipment executes.This method comprises the following steps:
S1B obtains eye fundus image.It specifically can refer to the description as described in step S1A in above-described embodiment.
S2B is split using self-loopa processing mode for the blood vessel image in eye fundus image using parted pattern,
Optical fundus blood vessel image is exported when reaching the loop termination condition of setting.
During self-loopa, parted pattern is with current input data and the blood vessel extracted for current input data
Characteristic be overlapped input data as input data next time, when optical fundus blood vessel image is according to loop termination and
The image that the stack result of blood vessel characteristic obtains.
Specifically, for parted pattern when first time executing segmentation task, input data is eye fundus image, and parted pattern is practical
On be that image is considered as vector data, for eye fundus image vector data extract blood vessel characteristic, be also referred to as in the art
Be segmentation map (segmentation figure), it is a kind of vector data that this, which is a kind of not visible intermediate result,.
For ease of description, the vector data of the eye fundus image inputted for the first time is known as sm (0), parted pattern is directed to sm
(0) the blood vessel characteristic extracted is known as sm (1), self-loopa is carried out later, by sm (0)+sm (1) (the two is overlapped) conduct
New input data, parted pattern extract blood vessel characteristic sm (2) for sm (0)+sm (1)；If not reaching termination item
Part then carries out self-loopa next time, by sm (0)+sm (1)+sm (2) (three is overlapped) as new input data, divides mould
Type extracts blood vessel characteristic sm (3) for sm (0)+sm (1)+sm (2), carries out self-loopa processing by this method, until reaching
Termination condition.
Such as when parted pattern for sm (0)+sm (1)+...+sm (N-1) extract blood vessel characteristic sm (N) when reach
Termination condition, then according to sm (0)+sm (1)+...+sm (N) exports visual optical fundus blood vessel image.
Correspondingly, in this parted pattern of training, it should also it be made to handle training data by the way of self-loopa.Sample
Notebook data is eye fundus image and the annotation results to wherein blood vessel image, and loop termination condition in addition should also be arranged.
Difference with former splitting scheme is that this programme does not need to divide eye fundus image shown in Fig. 2, and
Directly as the input data of parted pattern, can be obtained as shown in Figure 5 by the self-loopa working method of parted pattern
Segmentation result.
The eye fundus image blood vessel image dividing method provided according to embodiments of the present invention makes parted pattern for eye fundus image
The blood vessel image of full figure is split, it is not necessary to be divided image block in advance, using the working method of self-loopa, be made parted pattern to blood
Pipe characteristic is repeatedly extracted, the blood vessel characteristic extracted with reference to itself is further to be divided, and is improved with this
The accuracy of final segmentation result.
In the ideal case, the expected condition as loop termination whether should be reached according to the content of output vector.Root
Illustrate that parted pattern cannot find more blood vessel characteristics again if sm (N) is null value according to the example above, because
This terminates circulation output result.More specifically, being 0 in the content of sm (N) if selecting the parted pattern of output bianry image
In the case of then terminate circulation.
But it in practical applications, is influenced by parted pattern performance, simultaneously according to above-mentioned termination condition ideally
It is different surely to obtain expected result.Because parted pattern may by it is some be not that the subtle texture of blood vessel image is mistaken for blood
Pipe.So in a preferred embodiment, loop termination condition is set by cycle-index, it will according to the experience of practical application
Cycle-index, which is set as 10-15 times, can relatively accurately be partitioned into blood vessel image, and can be improved segmentation efficiency.
One embodiment of the present of invention additionally provides a kind of eye fundus image blood vessel image segmenting device, comprising:
Acquiring unit, for obtaining eye fundus image；
Division unit, for the eye fundus image to be divided into multiple images block；
Parted pattern, the blood vessel image for being directed in each described image block respectively are split to obtain segmented image
Block；
Concatenation unit, for being spliced into optical fundus blood vessel image using segmented image block.
As a preferred embodiment, adjacent described image block overlaps.
As a preferred embodiment, division unit traverses the eye fundus image using sliding window and obtains image
Block, the glide direction in ergodic process includes horizontal direction and vertical direction, and the sliding step in two directions is small
In the length and width of the sliding window.
As a preferred embodiment, concatenation unit is in the mistake for being spliced into optical fundus blood vessel image using segmented image block
Cheng Zhong takes the average value or maximum value of lap pixel value for the lap of adjacent segmented image block.
As a preferred embodiment, the parted pattern exports bianry image block, distinguishes table with two kinds of pixel values
Up to background and blood vessel image.
One embodiment of the present of invention additionally provides another eye fundus image blood vessel image segmenting device, comprising:
Acquiring unit, for obtaining eye fundus image；
Parted pattern is split for the blood vessel image in the eye fundus image using self-loopa processing mode, is being reached
To setting loop termination condition when output optical fundus blood vessel image make the parted pattern with current during self-loopa
Input data and the blood vessel characteristic extracted for current input data are overlapped as input data next time, institute
State the image that the stack result of input data and blood vessel characteristic when optical fundus blood vessel image is according to loop termination obtains.
As a preferred embodiment, the parted pattern exports bianry image block, distinguishes table with two kinds of pixel values
Up to background and blood vessel image.
As a preferred embodiment, the loop termination condition is cycle-index.
One embodiment of the present of invention additionally provides a kind of eye fundus image blood vessel image equipment, comprising:
At least one processor and the memory being connect at least one described processor communication；Wherein, the storage
Device is stored with the instruction that can be executed by least one described processor, and described instruction is executed by least one described processor, with
At least one described processor is set to execute above-mentioned eye fundus image blood vessel image segmentation.
The present invention provides a kind of eye fundus image vascular wall reflective state flag data generation method, and this method can be by calculating
The electronic equipments such as machine and server execute.This method comprises the following steps as shown in Figure 7:
S1C determines angiosomes in eye fundus image.In eye fundus image as shown in Figure 2 comprising more blood vessel image with
And other images such as macula lutea, optic disk and background, need to extract the region based on blood vessel image, identified blood in this step
Area under control domain is, for example, angiosomes image shown in Fig. 3, or eliminates the global area vasculosa as shown in Figure 8 of other images
Area image.
It should be noted that needing to use the pixel value of blood vessel image in the next steps, therefore so-called angiosomes
At least single channel image (gray level image) or triple channel image (color image) are also feasible, but cannot be binary maps
Picture.
S2C, according to the blood vessel image fitted ellipse region in angiosomes.For the image block shown in Fig. 3, wrapped in image
Containing at least one bar shaped connected region, i.e. blood vessel image, the mode that irregular bar-shaped zone is fitted to elliptic region is had more
Kind, the present invention can be used existing form fit algorithm and obtain the elliptic region corresponding to blood vessel image.To content shown in Fig. 3
It is fitted available elliptic region 91 as shown in Figure 9, merely illustrates an elliptic region 91 in Fig. 9, when practical application
Also same way will be taken to fit corresponding elliptic region other two bar-shaped zone above image.
S3C is generated according to the pixel value of the pixel of the blood vessel image in elliptic region short axle and is used for label vascular
The data of wall reflective state.Figure 10 shows the schematic diagram of a width elliptic region and blood vessel image, in order to clearly show how
Selected pixels point, Figure 10 are illustrated using bianry image, the white bar-shaped zone (blood vessel image) when practical application in Figure 10
At least with gray scale, or colored.
The short axle 101 of elliptic region is determined first, it can be a line or a narrow region.Then it determines
Not only be in short axle 101, but also be the pixel of blood vessel image, that is, black line segment 102 in Figure 10 (can be a line or
One narrow region) on pixel.Then the pixel value of these pixels is determined respectively.
The different reflective situation of vascular wall (arterial wall) can be presented as the of different sizes of pixel value.In one embodiment,
Judged using single channel image, judgment threshold such as 100 is set, pixel value on black line segment 102 is greater than or is waited
Pixel in 100 is determined as that the pixel of reflective enhancing, the pixel by pixel value on black line segment 102 less than 100 determine
For the pixel of normal blood vessels, the quantity information of both pixels thus can be at least obtained, and using the information as being used for
The data of label vascular wall reflective state.
In one embodiment, after the quantity information for obtaining above two pixel, the ratio of the two is calculated, and should
Ratio is as the data for being used for label vascular wall reflective state.In one embodiment, above two pixel is being calculated
Ratio of number after, the conclusion of vascular wall (arterial wall) reflective enhancing whether is belonged to according to the ratio in judgement this blood vessel image,
Or whether belong to the conclusion of optical fundus blood vessel elasticity decrease, as the data for label vascular wall reflective state.Such as work as picture
The ratio of number of the pixel of quantity and pixel value less than 100 of pixel of the element value more than or equal to 100 is greater than or equal to 2:3
When, the state of this blood vessel image is judged as vascular wall (arterial wall) reflective enhancing.
The eye fundus image vascular wall reflective state flag data generation method provided according to embodiments of the present invention, by
Angiosomes are determined in eye fundus image, and by the blood vessel image fitted ellipse region in angiosomes, then according to elliptic region
The pixel value of the pixel of blood vessel image in short axle generates the data for being used for label vascular wall reflective state, this flag data
The reflective situation that blood vessel can accurately be embodied, the subtle or fuzzy Content Transformation that eye fundus image is presented are intuitive label
Data can be used family and the reflective state of vascular wall be well understood, and auxiliary doctor weakens illness to optical fundus blood vessel elasticity
Diagnosis, improves the working efficiency of doctor.
The present invention also provides a kind of preferred eye fundus image vascular wall reflective state flag data generation methods, and this method can
To be executed by electronic equipments such as computer and servers.In one embodiment, it is based on above two eye fundus image blood vessel image
Any one of dividing method searches for angiosomes and carries out subsequent processing, specific as shown in figure 11, and this method includes following step
It is rapid:
S1D obtains single pass eye fundus image and optical fundus blood vessel exposure mask figure according to colored eye fundus image.Colour therein
Eye fundus image is, for example, image as shown in Figure 2, and there are many algorithms for being converted into single channel image, such as takes triple channel picture
Average value, the pixel value for taking a certain channel etc. of plain value are all feasible.In a preferred embodiment, single channel is being obtained
Eye fundus image after, the processing to the enhancing of its degree of comparing is available as schemed by handling to highlight the difference in image
Image shown in 12.This preferred processing mode can protrude the reflective state of blood vessel, to improve the standard of subsequent processing result
True property.
In the present embodiment, optical fundus blood vessel exposure mask figure is the eye fundus image blood vessel shadow according to above two based on parted pattern
As any obtained binary map as shown in Figure 5 in dividing method.In other embodiments, other sides can also be used
Formula obtains this blood vessel exposure mask figure.In a preferred embodiment, the exposure mask figure that can also be obtained to segmentation is done further
Processing removes wherein lesser cut zone, connected region searching algorithm specifically can be used, and areas some in Fig. 5 are less than and are set
The connected region for determining threshold value is removed from figure and (pixel value is set 0).This preferred processing mode can screen out some possibility
Be mistaken for blood vessel content or tiny blood vessel image so that retain blood vessel image be artery image as far as possible.
S2D obtains single pass optical fundus blood vessel image according to single pass eye fundus image and optical fundus blood vessel exposure mask figure.It utilizes
Bianry image to single channel eye fundus image carry out mask process, can remove be not in figure blood vessel image content, obtain such as Fig. 8
Shown in gray scale global angiosomes image.
S3D searches for angiosomes in single pass optical fundus blood vessel image.So-called search is construed as intercepting, or
Person intercepts and screens.For example, by using the mode for the sliding window traversal image mentioned in above-described embodiment, from image shown in Fig. 8
Middle traversal interception image block, as interception angiosomes.And in order to improve treatment effeciency, a part can be also picked out from Fig. 8
Angiosomes rather than traversal all images block, be specifically discussed below.
S4D, respectively according to the blood vessel image fitted ellipse region in the angiosomes searched.It specifically can refer to above-mentioned reality
The description as described in step S2B in example is applied, details are not described herein again.
S5D is generated according to the pixel value of the pixel of the blood vessel image in elliptic region short axle for marking respectively
The data of vascular wall reflective state.Specifically it can refer to the description as described in step S3B in above-described embodiment, details are not described herein again.
The scheme provided according to embodiments of the present invention obtains single pass eye fundus image and eye by colored eye fundus image
Bottom blood vessel exposure mask figure, and single pass optical fundus blood vessel image is obtained using optical fundus blood vessel exposure mask figure and single pass eye fundus image,
It is possible thereby to the image other than eye fundus image medium vessels substantially completely be removed, and the color of artery-sparing image, in search blood
Accuracy and efficiency with higher when the domain of area under control, and then keep the flag data generated more accurate.
About above-mentioned steps S3D, a kind of mode of preferred search angiosomes is provided in one embodiment, below
This way of search is introduced in conjunction with Figure 13, Figure 14:
S3D1 determines the pixel with max pixel value in single pass optical fundus blood vessel image.Such as Fig. 8 institute
The single channel image stated first looks for wherein having the pixel of max pixel value (if there is the equal pixel of multiple pixel values
Point can take one of pixel at random).
S3D2 determines angiosomes based on the pixel with max pixel value.In the present embodiment, interception is preset
Having a size of m*m, after determining pixel 131, it is angiosomes that the region 1311 of a m*m is taken centered on it.
In a preferred embodiment, step cycle executes S3D1-S3D2 (or being interpreted as being performed a plurality of times), is recycling
During execution, determined angiosomes are marked, for example, first time execute when region 1311 has been determined after,
Pixel therein is all set 0 and obtains image as described in Figure 14, then being found in remaining content again has maximum pixel
The pixel of value, and the region of a m*m is taken based on the pixel again, search step is performed a plurality of times by this method, until reaching
Until the termination condition of setting.This when can make to execute each time identified angiosomes be not overlapped.
About loop termination condition, if being set to the pixel value when the pixel in image with max pixel value
Search angiosomes are terminated when being 0, since the angiosomes that background content sheet is searched as 0, once in image are denoted as 0,
So indicating that all areas are all searched when pixel value is all 0 in figure, namely realize the angiosomes of traversal full figure.
However, even if still having suitable one in eyeground there are optical fundus blood vessel wall (arterial wall) reflective enhancing
The blood vessel divided is normal, if traversing image, it would still be possible to make to calculate normal angiosomes in subsequent step, and
Increase calculation amount.Therefore in a preferred embodiment, using according to cycle-index and/or be used for and max pixel value into
The pixel value threshold value that row compares determines termination condition.Specifically, such as when search for angiosomes the step of 10-15 has been performed it
When secondary, namely while being determined 10-15 angiosomes, terminates search, or when find when in image with the picture of max pixel value
The pixel value of vegetarian refreshments terminates search when being less than or equal to 100 (threshold value), or sets termination condition according to both combined factors
It is all feasible.
Above-mentioned preferred embodiment can go out the doubtful region for vascular wall (arterial wall) reflective enhancing with preliminary screening, so that subsequent
It is calculated when generating flag data just for these doubtful regions, without being calculated for other angiosomes, by
Computational efficiency can be improved in this.
One embodiment of the present of invention additionally provides a kind of eye fundus image vascular wall reflective state flag data generating means,
Include:
Region segmentation unit, for determining angiosomes in eye fundus image；
Fitting unit, for according to the blood vessel image fitted ellipse region in the angiosomes；
Data generating unit, the pixel value of the pixel for blood vessel image of the basis in the elliptic region short axle
Generate the data for being used for label vascular wall reflective state.
As a preferred embodiment, region segmentation unit includes:
Image processing unit, for obtaining single pass eye fundus image and optical fundus blood vessel exposure mask according to colored eye fundus image
Figure；
Image acquisition unit, for obtaining single-pass according to the single pass eye fundus image and the optical fundus blood vessel exposure mask figure
The optical fundus blood vessel image in road；
Area searching unit, for searching for the angiosomes in the single pass optical fundus blood vessel image.
As a preferred embodiment, area searching unit includes:
Pixel search unit, for determining the picture with max pixel value in the single pass optical fundus blood vessel image
Vegetarian refreshments；
Region interception unit, for determining the angiosomes based on the pixel.
As a preferred embodiment, area searching unit circulation is executed in the single pass optical fundus blood vessel image
The step of middle search angiosomes, is marked determined angiosomes during recycling execution, so that
Identified angiosomes are not overlapped when executing each time, until reaching the termination condition of setting.
As a preferred embodiment, the termination condition is according to cycle-index and/or to be used for and the maximum
What the pixel value threshold value that pixel value is compared determined.
As a preferred embodiment, the data for label vascular wall reflective state be pixel value be greater than set
The pixel quantity and pixel value of determining threshold value are less than or equal to the ratio of the pixel quantity of the given threshold.
As a preferred embodiment, data generating unit includes:
Ratio calculation unit, for determining that pixel value is greater than the pixel quantity and pixel value of given threshold in the short axle
Less than or equal to the ratio of the pixel quantity of the given threshold；
Judging unit, for according to the ratio determine the angiosomes whether be vascular wall retroreflective regions conclusion.
One embodiment of the present of invention additionally provides a kind of eye fundus image vascular wall reflective state flag data generating device,
The memory for including: at least one processor and being connect at least one described processor communication；Wherein, the memory is deposited
The instruction that can be executed by least one described processor is contained, described instruction is executed by least one described processor, so that institute
It states at least one processor and executes above-mentioned eye fundus image vascular wall reflective state flag data generation method.
The present invention also provides a kind of eye fundus image vascular wall retroreflective regions labeling methods, and being used for will be according to Fig. 7 or Figure 11
Shown in the flag data that generates of method be presented in original eye fundus image, namely first with above-mentioned flag data generation side
Method obtains at least one data for label vascular wall reflective state, according to the targeted blood vessel image of these data on eyeground
Position in image is labeled in original eye fundus image on corresponding position.
It in one embodiment, is the ratio of above-mentioned pixel quantity, root for the flag data of some blood vessel image
According to the position of this blood vessel image, a dotted line frame is added in the image shown in Figure 15, and show this ratio wherein, by
This intuitively expresses the targeted blood vessel image of reflective state flag data, and doctor is made to can be understood that blood vessel shadow everywhere
The reflective situation of picture, doctor can under the prompt of flag data these regions of primary part observation, with improve diagosis work be directed to
Property and efficiency.
Figure 15 is intended merely to clearly demonstrate and the citing made, according to above-mentioned flag data generation method when practical application
The flag data of multiple blood vessel images for being directed to different location respectively may be generated, correspondingly, multiple positions of the meeting in Figure 15
It sets and shows these flag datas respectively.In addition it is also possible to these flag datas are presented using other figures such as arrow,
As long as it is feasible for capable of expressing the targeted blood vessel image of flag data.
As preferred embodiment, if generate flag data, a large amount of mark is generated for global blood vessel image
Count evidence, and doubtful blood vessel image and its mark for vascular wall (arterial wall) reflective enhancing should be selected in the flag data of generation
Numeration, specifically can be according to the content of flag data, such as above-mentioned pixel quantity ratio or the conclusion of generation according to being shown
Etc. being selected；
Or when generating flag data, just for selecting, the doubtful blood vessel image for vascular wall (arterial wall) reflective enhancing is raw
It is specific to participate in the description as described in angiosomes search in above-described embodiment at flag data.
It only shows doubtful blood vessel image and its flag data for vascular wall (arterial wall) reflective enhancing, display can be optimized
Effect, so that label content for a purpose shown in image is stronger.
One embodiment of the present of invention additionally provides a kind of eye fundus image vascular wall retroreflective regions labelling apparatus, the device packet
Data capture unit is included, for obtaining reference numerals according to above-mentioned eye fundus image vascular wall reflective state flag data generation method
According to；Marking unit, for flag data to be added in eye fundus image corresponding position.
One embodiment of the present of invention additionally provides a kind of eye fundus image vascular wall retroreflective regions marking arrangement, at least one
Processor and the memory being connect at least one described processor communication；Wherein, be stored with can be described for the memory
The instruction that at least one processor executes, described instruction executed by least one described processor, so that described at least one
Manage the above-mentioned eye fundus image vascular wall retroreflective regions labeling method of device.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right
For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or
It changes.There is no necessity and possibility to exhaust all the enbodiments.And it is extended from this it is obvious variation or
It changes still within the protection scope of the invention.
Claims (10)
1. a kind of eye fundus image vascular wall reflective state flag data generation method, which comprises the steps of:
Angiosomes are determined in eye fundus image；
According to the blood vessel image fitted ellipse region in the angiosomes；
It is generated according to the pixel value of the pixel of the blood vessel image in the elliptic region short axle anti-for label vascular wall
The data of light state.
2. the method according to claim 1, wherein determining angiosomes in eye fundus image, comprising:
Single pass eye fundus image and optical fundus blood vessel exposure mask figure are obtained according to colored eye fundus image；
Single pass optical fundus blood vessel image is obtained according to the single pass eye fundus image and the optical fundus blood vessel exposure mask figure；
The angiosomes are searched in the single pass optical fundus blood vessel image.
3. according to the method described in claim 2, it is characterized in that, in the single pass optical fundus blood vessel image described in search
Angiosomes, comprising:
The pixel with max pixel value is determined in the single pass optical fundus blood vessel image；
The angiosomes are determined based on the pixel.
4. according to the method described in claim 3, it is characterized in that, circulation executes in the single pass optical fundus blood vessel image
The step of searching for the angiosomes is marked determined angiosomes, during recycling execution so that often
Identified angiosomes are not overlapped when primary execution, until reaching the termination condition of setting.
5. according to the method described in claim 4, it is characterized in that, the termination condition is according to cycle-index and/or to be used for
What the pixel value threshold value being compared with the max pixel value determined.
6. method according to any one of claims 1-5, which is characterized in that described to be used for label vascular wall reflective state
Data be pixel value be greater than given threshold pixel quantity and pixel value be less than or equal to the given threshold pixel
The ratio of quantity.
7. method according to any one of claims 1-5, which is characterized in that according in the elliptic region short axle
Blood vessel image pixel pixel value generate be used for label vascular wall reflective state data, comprising:
Determine that pixel value is greater than the pixel quantity of given threshold in the short axle and pixel value is less than or equal to the setting threshold
The ratio of the pixel quantity of value；
According to the ratio determine the angiosomes whether be vascular wall retroreflective regions conclusion.
8. a kind of eye fundus image vascular wall retroreflective regions labeling method, which comprises the steps of:
Method according to any one of claims 1-7 generates flag data；
The flag data is added in eye fundus image on corresponding position.
9. a kind of eye fundus image vascular wall reflective state flag data generating device characterized by comprising at least one processing
Device and the memory being connect at least one described processor communication；Wherein, the memory be stored with can by it is described at least
The instruction that one processor executes, described instruction is executed by least one described processor, so that at least one described processor
Perform claim requires eye fundus image vascular wall reflective state flag data generation method described in any one of 1-7.
10. a kind of eye fundus image vascular wall retroreflective regions marking arrangement characterized by comprising at least one processor and
The memory being connect at least one described processor communication；Wherein, be stored with can be by described at least one for the memory
The instruction that device executes is managed, described instruction is executed by least one described processor, so that at least one described processor right of execution
Benefit require 8 described in eye fundus image vascular wall retroreflective regions labeling method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910305255.1A CN110189296B (en) | 2019-04-16 | 2019-04-16 | Method and equipment for marking reflecting state of blood vessel wall of fundus image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910305255.1A CN110189296B (en) | 2019-04-16 | 2019-04-16 | Method and equipment for marking reflecting state of blood vessel wall of fundus image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110189296A true CN110189296A (en) | 2019-08-30 |
| CN110189296B CN110189296B (en) | 2022-05-10 |
Family
ID=67714623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910305255.1A Active CN110189296B (en) | 2019-04-16 | 2019-04-16 | Method and equipment for marking reflecting state of blood vessel wall of fundus image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110189296B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116363132A (en) * | 2023-06-01 | 2023-06-30 | 中南大学湘雅医院 | Ophthalmic image processing method and system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101636113A (en) * | 2007-04-27 | 2010-01-27 | 株式会社日立医药 | Ultrasonic diagnostic apparatus |
| CN103169500A (en) * | 2011-12-26 | 2013-06-26 | 株式会社东芝 | Ultrasonic diagnostic apparatus, medical image diagnostic apparatus, and medical image processing method |
| CN103871043A (en) * | 2012-12-12 | 2014-06-18 | 上海联影医疗科技有限公司 | Blood vessel extraction method |
| CN105266848A (en) * | 2015-10-16 | 2016-01-27 | 深圳市恩普电子技术有限公司 | Ultrasonic spectrum Doppler automatic optimization method |
| US20160166141A1 (en) * | 2013-07-10 | 2016-06-16 | Commonwealth Scientific And Industrial Research Organisation | Quantifying a blood vessel reflection parameter of the retina |
| CN106384343A (en) * | 2016-08-24 | 2017-02-08 | 上海交通大学 | Morphological processing based hard exudation area detecting method |
| CN106447645A (en) * | 2016-04-05 | 2017-02-22 | 天津大学 | Device and method for coronary artery calcification detection and quantification in CTA image |
| CN107180421A (en) * | 2016-03-09 | 2017-09-19 | 中兴通讯股份有限公司 | A kind of eye fundus image lesion detection method and device |
| CN107613874A (en) * | 2015-03-31 | 2018-01-19 | 新加坡科技研究局 | Method and apparatus for assessing hemadostewnosis |
| CN109166124A (en) * | 2018-11-20 | 2019-01-08 | 中南大学 | A kind of retinal vascular morphologies quantization method based on connected region |
| US20190014982A1 (en) * | 2017-07-12 | 2019-01-17 | iHealthScreen Inc. | Automated blood vessel feature detection and quantification for retinal image grading and disease screening |
-
2019
- 2019-04-16 CN CN201910305255.1A patent/CN110189296B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101636113A (en) * | 2007-04-27 | 2010-01-27 | 株式会社日立医药 | Ultrasonic diagnostic apparatus |
| CN103169500A (en) * | 2011-12-26 | 2013-06-26 | 株式会社东芝 | Ultrasonic diagnostic apparatus, medical image diagnostic apparatus, and medical image processing method |
| CN103871043A (en) * | 2012-12-12 | 2014-06-18 | 上海联影医疗科技有限公司 | Blood vessel extraction method |
| US20160166141A1 (en) * | 2013-07-10 | 2016-06-16 | Commonwealth Scientific And Industrial Research Organisation | Quantifying a blood vessel reflection parameter of the retina |
| CN107613874A (en) * | 2015-03-31 | 2018-01-19 | 新加坡科技研究局 | Method and apparatus for assessing hemadostewnosis |
| CN105266848A (en) * | 2015-10-16 | 2016-01-27 | 深圳市恩普电子技术有限公司 | Ultrasonic spectrum Doppler automatic optimization method |
| CN107180421A (en) * | 2016-03-09 | 2017-09-19 | 中兴通讯股份有限公司 | A kind of eye fundus image lesion detection method and device |
| CN106447645A (en) * | 2016-04-05 | 2017-02-22 | 天津大学 | Device and method for coronary artery calcification detection and quantification in CTA image |
| CN106384343A (en) * | 2016-08-24 | 2017-02-08 | 上海交通大学 | Morphological processing based hard exudation area detecting method |
| US20190014982A1 (en) * | 2017-07-12 | 2019-01-17 | iHealthScreen Inc. | Automated blood vessel feature detection and quantification for retinal image grading and disease screening |
| CN109166124A (en) * | 2018-11-20 | 2019-01-08 | 中南大学 | A kind of retinal vascular morphologies quantization method based on connected region |
Non-Patent Citations (5)
| Title |
|---|
| GIANSANTI, ROBERTO ET AL.: "Quantitative analysis of retinal changes in hypertension", 《PROCEEDINGS OF SPIE》 * |
| SOODEH NIKAN ET AL.: "Machine Learning Application to Predict the Risk of Coronary Artery Atherosclerosis", 《2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE》 * |
| 吴辉群: "慢性病信息管理系统中视网膜图像的互操作性及其血管网络定量分析研究", 《中国优秀博硕士学位论文全文数据库(博士) 信息科技辑》 * |
| 白冰: "基于数字图像的Ⅱ型糖尿病眼底血管病变检测研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 郑筱祥等: "原发性高血压眼底血管形态与光学特性改变", 《中华物理医学杂志》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116363132A (en) * | 2023-06-01 | 2023-06-30 | 中南大学湘雅医院 | Ophthalmic image processing method and system |
| CN116363132B (en) * | 2023-06-01 | 2023-08-22 | 中南大学湘雅医院 | Ophthalmic image processing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110189296B (en) | 2022-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109493343A (en) | Medical image abnormal area dividing method and equipment | |
| CN110909780B (en) | Image recognition model training and image recognition method, device and system | |
| CN110210483B (en) | Medical image lesion region segmentation method, model training method and device | |
| CN109684981A (en) | Glaucoma image-recognizing method, equipment and screening system | |
| Akita et al. | A computer method of understanding ocular fundus images. | |
| CN110136140A (en) | Eye fundus image blood vessel image dividing method and equipment | |
| JP2019095853A (en) | Method for analyzing image, device, program, and method for manufacturing learned deep learning algorithm | |
| WO2019132589A1 (en) | Image processing device and method for detecting multiple objects | |
| CN109697716A (en) | Glaucoma image-recognizing method, equipment and screening system | |
| KR20150107579A (en) | Image processing apparatus and image processing method | |
| CN110263755B (en) | Eye ground image recognition model training method, eye ground image recognition method and eye ground image recognition device | |
| CN110428421A (en) | Macula lutea image region segmentation method and apparatus | |
| CN110599507B (en) | Tomato identification and positioning method and system | |
| US20220383661A1 (en) | Method and device for retinal image recognition, electronic equipment, and storage medium | |
| CN110929728B (en) | Image region-of-interest dividing method, image segmentation method and device | |
| CN107564048A (en) | Based on bifurcation feature registration method | |
| CN109961848A (en) | Macula lutea image classification method and equipment | |
| CN104854620A (en) | Image processing device, image processing system, and program | |
| CN108629378A (en) | Image-recognizing method and equipment | |
| CN109859836A (en) | Medical image recognition methods and equipment | |
| CN109427062A (en) | Roadway characteristic labeling method, device, computer equipment and readable storage medium storing program for executing | |
| CN109658385A (en) | Eye fundus image judgment method and equipment | |
| KR20210126485A (en) | Matching method, apparatus, electronic device, computer readable storage medium, and computer program | |
| CN110473176B (en) | Image processing method and device, fundus image processing method and electronic equipment | |
| EP4071708A1 (en) | Methods and systems for localised smoke removal and color restoration of real-time video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |