Disclosure of Invention
In order to overcome the technical problems of low identification accuracy of retinal blood vessels, high difficulty in managing the identified retinal blood vessels and low management efficiency in the prior art, the invention provides a retinal blood vessel management method and a retinal blood vessel management device.
In order to achieve the above object, the present invention provides a retinal blood vessel management method including: acquiring classification information of retinal blood vessels in a retinal image, wherein the retinal blood vessels have retinal blood vessel labeling information based on the classification information; acquiring a selection instruction of a user, and selecting a corresponding retinal blood vessel as a selected retinal blood vessel based on the selection instruction; acquiring operation information of a user, and operating the selected retinal blood vessel based on the operation information to generate updated classification information; deleting retinal vessel labeling information based on the classification information; sorting the retinal vessels based on the updated classification information to obtain a sorting result; re-labeling the retinal vessel based on the ranking result.
Preferably, the classification information comprises at least one of the following information: blood vessel category information of the retinal blood vessels, position information of the retinal blood vessels, caliber information of the retinal blood vessels, and number information of the retinal blood vessels in each blood vessel category.
Preferably, the selection instruction includes any one of a click operation, a slide operation, and a circle drawing operation, and acquiring the selection instruction of the user includes: acquiring one or more operations of a user; the selecting the corresponding retinal vessel as the selected retinal vessel based on the selection instruction includes: selecting at least one retinal blood vessel as the selected retinal blood vessel based on the selection instruction.
Preferably, the obtaining operation information of the user and operating the selected retinal blood vessel based on the operation information to generate updated classification information includes: judging the operation type of the user according to the operation information; under the condition that the operation type is to modify the blood vessel type, obtaining blood vessel type information specified by a user, and modifying the blood vessel type of the selected retina blood vessel based on the blood vessel type information; in the case that the operation type is deletion of a blood vessel, deleting the selected retinal blood vessel; under the condition that the operation type is adding a blood vessel, acquiring an adding instruction of a user, generating a new adding blood vessel in the retina image based on the adding instruction, acquiring blood vessel category information specified by the user aiming at the new adding blood vessel, and specifying a blood vessel category for the new adding blood vessel based on the category information; and newly counting the blood vessel type information of the retinal blood vessels, the position information of the retinal blood vessels, the caliber information of the retinal blood vessels and the quantity information of the retinal blood vessels in each blood vessel type, and taking the newly counted information as the updated classification information.
Preferably, the blood vessel category information includes vein blood vessels, artery blood vessels, and unidentified retina blood vessels, and the sorting of the retina blood vessels based on the updated classification information to obtain a sorting result includes: and sequencing each blood vessel in the venous blood vessels and each blood vessel in the arterial blood vessels in sequence according to the caliber based on the caliber information, and obtaining a sequencing result.
Preferably, the re-labeling the retinal vessel based on the ranking result comprises: respectively acquiring a preset number of effective vein blood vessels and effective artery blood vessels according to the sequence of the pipe diameters from large to small on the basis of the sequencing result; determining a blood vessel other than the effective vein blood vessel and the effective artery blood vessel among the retinal blood vessels as an unidentified retinal blood vessel; and acquiring a labeling instruction of a user, and carrying out distinguishing labeling on the effective vein blood vessel, the effective artery blood vessel and the unidentified retina blood vessel based on the labeling instruction.
Accordingly, the present invention also provides a retinal blood vessel management device, comprising: an acquisition unit configured to acquire classification information of retinal blood vessels in a retinal image, wherein the retinal blood vessels have retinal blood vessel labeling information based on the classification information; the selection unit is used for acquiring a selection instruction of a user and selecting a corresponding retinal blood vessel as a selected retinal blood vessel based on the selection instruction; the updating unit is used for acquiring operation information of a user and operating the selected retinal blood vessel based on the operation information to generate updated classification information; a deleting unit configured to delete retinal blood vessel labeling information based on the classification information; a sorting unit for sorting the retinal blood vessels based on the updated classification information to obtain a sorting result; and the labeling unit is used for re-labeling the retinal blood vessels based on the sequencing result.
Preferably, the classification information comprises at least one of the following information: blood vessel category information of the retinal blood vessels, position information of the retinal blood vessels, caliber information of the retinal blood vessels, and number information of the retinal blood vessels in each blood vessel category.
Preferably, the selection instruction includes any one of a click operation, a slide operation, and a circle-drawing operation, and the obtaining of the selection instruction of the user includes: acquiring one or more operations of a user; the selecting, based on the selection instruction, the corresponding retinal vessel as the selected retinal vessel includes: selecting at least one retinal blood vessel as the selected retinal blood vessel based on the selection instruction.
Preferably, the updating unit includes: the judging module is used for judging the operation type of the user according to the operation information; the modification module is used for acquiring the blood vessel type information specified by the user under the condition that the operation type is the blood vessel type modification, and modifying the blood vessel type of the selected retinal blood vessel based on the blood vessel type information; a deletion module for deleting the selected retinal vessel if the operation type is blood vessel deletion; the adding module is used for acquiring an adding instruction of a user under the condition that the operation type is adding a blood vessel, generating a new adding blood vessel in the retina image based on the adding instruction, acquiring blood vessel type information which is specified by the user aiming at the new adding blood vessel, and specifying a blood vessel type for the new adding blood vessel based on the type information; and the counting module is used for counting again the blood vessel type information of the retinal blood vessels, the position information of the retinal blood vessels, the pipe diameter information of the retinal blood vessels and the quantity information of the retinal blood vessels in each blood vessel type, and taking the newly counted information as the updated classification information.
Preferably, the blood vessel category information includes vein blood vessels, artery blood vessels, and unidentified retina blood vessels, and the sorting of the retina blood vessels based on the updated classification information to obtain a sorting result includes: and sequencing each blood vessel in the venous blood vessels and each blood vessel in the arterial blood vessels in sequence according to the sizes of the calibers based on the calibre information, and obtaining a sequencing result.
Preferably, the re-labeling the retinal vessel based on the ranking result comprises: respectively acquiring a preset number of effective vein blood vessels and effective artery blood vessels according to the sequence of the pipe diameters from large to small on the basis of the sequencing result; determining a blood vessel other than the effective vein blood vessel and the effective artery blood vessel among the retinal blood vessels as an unidentified retinal blood vessel; and acquiring a labeling instruction of a user, and performing differential labeling on the effective vein blood vessel, the effective artery blood vessel and the unidentified retina blood vessel based on the labeling instruction.
In another aspect, the present invention also provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the method provided by the present invention.
Through the technical scheme provided by the invention, the invention at least has the following technical effects:
because the accuracy of the retinal blood vessels automatically identified by the computer is poor and the management difficulty of the identified retinal blood vessels is high, in the technical scheme of the invention, a user edits or deletes the retinal blood vessels with errors or deviations on the electronic equipment by a simple operation method, and re-labels and displays the edited or deleted retinal blood vessel images without manually performing the operations of screening, identifying, modifying and the like, so that the retinal blood vessels are quickly and accurately managed, the accuracy of the identified retinal blood vessels is improved, and meanwhile, the user can conveniently and clearly identify the retinal blood vessel images to quickly obtain required information or observe wrong labels, so that the diagnosis condition or the image restoration is quickly performed, and the working efficiency of the user is improved.
Additional features and advantages of embodiments of the present invention will be described in the detailed description which follows.
Detailed Description
In order to overcome the technical problems of low identification accuracy of retinal blood vessels, high difficulty in managing the identified retinal blood vessels and low management efficiency in the prior art, the invention provides a retinal blood vessel management method and a retinal blood vessel management device.
The following describes in detail embodiments of the present invention with reference to the drawings. It should be understood that the detailed description and specific examples, while indicating embodiments of the invention, are given by way of illustration and explanation only, not limitation.
The terms "system" and "network" in embodiments of the present invention may be used interchangeably. The "plurality" means two or more, and in view of this, the "plurality" may also be understood as "at least two" in the embodiments of the present invention. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" generally indicates that the preceding and following related objects are in an "or" relationship, unless otherwise specified. It is to be understood that the terms first, second, etc. used in the description of the embodiments of the invention are used for distinguishing between similar elements and not necessarily for describing a sequential or chronological order.
Referring to fig. 1, the present invention provides a retinal blood vessel management method, including:
s10) obtaining classification information of retinal blood vessels in a retinal image, wherein the retinal blood vessels have retinal blood vessel labeling information based on the classification information;
s20) acquiring a selection instruction of a user, and selecting a corresponding retinal blood vessel as a selected retinal blood vessel based on the selection instruction;
s30) acquiring operation information of a user, and operating the selected retinal blood vessel based on the operation information to generate updated classification information;
s40) deleting the retinal vessel labeling information based on the classification information;
s50) sorting the retinal blood vessels based on the updated classification information to obtain a sorting result;
s60) re-labeling the retinal vessel based on the sorting result.
In an embodiment of the present invention, the classification information includes at least one of the following information: blood vessel category information of the retinal blood vessels, position information of the retinal blood vessels, caliber information of the retinal blood vessels, and number information of the retinal blood vessels in each blood vessel category.
Further, in this embodiment of the present invention, the selecting instruction includes any one of a click operation, a slide operation, and a circle drawing operation, and acquiring the selecting instruction of the user includes: acquiring one or more operations of a user; the selecting the corresponding retinal vessel as the selected retinal vessel based on the selection instruction includes: selecting at least one retinal blood vessel as the selected retinal blood vessel based on the selection instruction.
For better management of retinal blood vessels in the retinal image, please refer to fig. 2, in one possible embodiment, after obtaining the retinal blood vessels in the retinal image, the user directly observes 6 arterial blood vessels (corresponding to numbers 1, 3, 5, 9, 10, 12 in the figure) and 6 venous blood vessels (corresponding to numbers 2, 4, 6, 13, 16, 19 in the figure) which are automatically counted by the computer through the current window, 7 unidentified blood vessels (corresponding to numbers 7, 8, 11, 14, 15, 17, 18 in the figure) and corresponding caliber information of each retinal blood vessel, and observes the labeled form and labeled position of each retinal blood vessel in the current retinal image. In the observation process, the user finds that the labeling type of a certain unidentified blood vessel is wrong (the unidentified blood vessel is actually an arterial blood vessel), so that the unidentified blood vessel is selected by clicking the unidentified blood vessel through a mouse, and in the subsequent observation process, the user finds that the labeling types of the other 3 arterial blood vessels are also wrong, so that the 3 arterial blood vessels can be simultaneously selected through multiple clicks.
Referring to fig. 3, in another possible embodiment, during the process of observing the retinal image through the tablet computer, the user finds that 5 adjacent blood vessels in a certain area have errors, so that by drawing a circle directly on the touch screen with a finger, the drawn circle intersects with the 5 blood vessels with the errors, and the computer automatically selects the 5 blood vessels that intersect with the drawn circle. It should be noted that the circle drawn by the user may be a regular circle, such as a circle, a square circle, an elliptical circle, or an irregular circle, such as a closed circle formed by multiple segments, all of which belong to the protection scope of the embodiment of the present invention, and are not described herein in detail.
In the embodiment of the invention, the user only needs to quickly select the retinal vessels through simple operation, and can conveniently select a plurality of retinal vessels, so that the operation flow of the user is greatly optimized, the operation complexity of the user is simplified, and the working efficiency of the user is improved.
In an embodiment of the present invention, the acquiring operation information of a user and operating the selected retinal blood vessel based on the operation information to generate updated classification information includes: judging the operation type of the user according to the operation information; under the condition that the operation type is to modify the blood vessel type, obtaining blood vessel type information specified by a user, and modifying the blood vessel type of the selected retina blood vessel based on the blood vessel type information; in the case that the operation type is deletion of a blood vessel, deleting the selected retinal blood vessel; under the condition that the operation type is adding a blood vessel, acquiring an adding instruction of a user, generating a new adding blood vessel in the retina image based on the adding instruction, acquiring blood vessel category information specified by the user aiming at the new adding blood vessel, and specifying a blood vessel category for the new adding blood vessel based on the category information; and newly counting the blood vessel type information of the retinal blood vessels, the position information of the retinal blood vessels, the caliber information of the retinal blood vessels and the quantity information of the retinal blood vessels in each blood vessel type, and taking the newly counted information as the updated classification information.
Referring to fig. 4, in one possible embodiment, the user finds that the arterial blood vessels No. 1 and No. 3 in the retinal image are actually venous blood vessels; the No. 2-5 unidentified blood vessels are arterial blood vessels, so the user firstly selects the No. 1 and No. 3 arterial blood vessels by clicking multiple times and designates the blood vessel types of the two arterial blood vessels as venous blood vessels, for example, by clicking a right mouse button and selecting a 'venous blood vessel' option in a pop-up menu option to designate the arterial blood vessels as venous blood vessels.
In another possible embodiment, the user selects unidentified blood vessel No. 2-5 via the tablet computer, and then selects the "arterial blood vessel" option in the option menu to designate unidentified blood vessel No. 2-5 as an arterial blood vessel by long-pressing the current screen to pop up the option menu. After the user determines that the screening of the current retinal image is finished, the computer re-counts the information of each blood vessel according to the re-determined retinal blood vessel and the category of each retinal blood vessel, for example, the number of retinal blood vessels in each category, the position information of each retinal blood vessel, the caliber information of each retinal blood vessel, and the like are re-counted according to the category information of each retinal blood vessel, and the re-counted information is used as updated classification information.
In the embodiment of the invention, the user can quickly operate and manage the classification information of the retinal blood vessels through simple operation, so that the working convenience of the user is greatly optimized, the working efficiency of the user is improved, and the user experience is improved.
In an embodiment of the present invention, the blood vessel category information includes vein blood vessels, artery blood vessels, and unidentified retina blood vessels, and the sorting of the retina blood vessels based on the updated classification information to obtain a sorting result includes: and sequencing each blood vessel in the venous blood vessels and each blood vessel in the arterial blood vessels in sequence according to the caliber based on the caliber information, and obtaining a sequencing result.
Further, in an embodiment of the present invention, the re-labeling the retinal blood vessels based on the sorting result includes: respectively acquiring a preset number of effective vein blood vessels and effective artery blood vessels according to the sequence of the pipe diameters from large to small on the basis of the sequencing result; determining a blood vessel other than the effective vein blood vessel and the effective artery blood vessel among the retinal blood vessels as an unidentified retinal blood vessel; and acquiring a labeling instruction of a user, and carrying out distinguishing labeling on the effective vein blood vessel, the effective artery blood vessel and the unidentified retina blood vessel based on the labeling instruction.
Referring to fig. 5, in a possible embodiment, after obtaining the updated classification information, 8 arterial blood vessels (the 8 arterial blood vessels are numbered 3, 6, 8, 11, 14, 17, 18, 19) and the corresponding vessel diameter information of the 8 arterial blood vessels are 3 (1.07), 6 (1.56), 8 (1.62), 11 (1.31), 14 (1.64), 17 (1.48), 18 (1.05), 19 (0.86) respectively are obtained according to the updated classification information, and at this time, the 8 arterial blood vessels are sorted again in the descending order of vessel diameters, so that the new sorting of the 8 arterial blood vessels is obtained as 14 (1.64), 8 (1.62), 6 (1.56), 17 (1.48), 11 (1.31), 3 (1.07), 18 (1.05), 19 (0.86), i.e., the sorting result is obtained. At this time, further, according to the sorting result, effective arterial blood vessels are obtained, and in the embodiment of the present invention, the first 6 arterial blood vessels of the 8 arterial blood vessels are obtained as effective arterial blood vessels in the order from large to small in caliber. Based on the same principle, 7 venous blood vessels and the corresponding pipe diameter information of the 7 venous blood vessels are obtained according to the updated classification information, and the 7 venous blood vessels are sorted again according to the sequence of pipe diameters from large to small, so that new sorting of the 7 venous blood vessels is obtained as a sorting result. Further, according to the sequencing result, the first 6 vein vessels in the 7 vein vessels are obtained as effective vein vessels according to the sequence of the vessel diameters from large to small. Since other blood vessels are temporarily not used as effective blood vessels for subsequent calculation, blood vessels other than the effective arterial blood vessels and the effective venous blood vessels are used as unidentified retinal blood vessels. The computer further obtains a labeling instruction of the user, for example, the user selects to label retinal blood vessels of different types in a color labeling mode, and labels edge lines of the retinal blood vessels of different types with different colors to display the retinal blood vessels of different types in a distinguishing mode.
In the embodiment of the present invention, labeling methods for labeling different types of retinal blood vessels further include, but are not limited to, labeling by setting different line segment types (for example, types such as a dot-dash line, a dotted line, a solid line, and a curved line), color filling (filling different types of retinal blood vessels with different colors), and other methods, so as to implement a function of labeling different types of retinal blood vessels differently, and all of the methods belong to the protection scope of the embodiment of the present invention.
In the embodiment of the invention, the retinal vessels under each category are automatically sequenced through the computer, and doctors do not need to manually rearrange and sequence the caliber information of each retinal vessel under the adjusted retinal category, so that the working content of the doctors is greatly optimized. Meanwhile, the computer can automatically distinguish and label the retinal blood vessels of different types according to the labeling types set by the user, so that doctors can conveniently observe the retinal blood vessels of different types, wrong retinal blood vessels can be found in time and corrected in time, or the doctors are assisted to diagnose the state of an illness more quickly, and therefore the accuracy of identifying the retinal blood vessels is improved, and the diagnosis efficiency of the doctors is improved.
The retinal blood vessel management device provided by the present invention will be described below with reference to the drawings.
Referring to fig. 6, based on the same inventive concept, the present invention provides a retinal blood vessel management device, including: an acquisition unit configured to acquire classification information of retinal blood vessels in a retinal image, wherein the retinal blood vessels have retinal blood vessel labeling information based on the classification information; the selection unit is used for acquiring a selection instruction of a user and selecting a corresponding retinal blood vessel as a selected retinal blood vessel based on the selection instruction; the updating unit is used for acquiring operation information of a user and operating the selected retinal blood vessel based on the operation information to generate updated classification information; a deleting unit configured to delete retinal blood vessel labeling information based on the classification information; a sorting unit configured to sort the retinal blood vessels based on the updated classification information to obtain a sorting result; and the labeling unit is used for re-labeling the retinal blood vessels based on the sequencing result.
In an embodiment of the present invention, the classification information includes at least one of the following information: blood vessel category information of the retinal blood vessels, position information of the retinal blood vessels, caliber information of the retinal blood vessels, and number information of the retinal blood vessels in each blood vessel category.
In this embodiment of the present invention, the selection instruction includes any one of a click operation, a slide operation, and a circle drawing operation, and the obtaining of the selection instruction of the user includes: acquiring one or more operations of a user; the selecting, based on the selection instruction, a corresponding retinal blood vessel as a selected retinal blood vessel includes: selecting at least one retinal vessel as the selected retinal vessel based on the selection instruction.
In an embodiment of the present invention, the update unit includes: the judging module is used for judging the operation type of the user according to the operation information; the modification module is used for acquiring the blood vessel type information specified by the user under the condition that the operation type is the blood vessel type modification, and modifying the blood vessel type of the selected retinal blood vessel based on the blood vessel type information; a deletion module for deleting the selected retinal vessel if the operation type is blood vessel deletion; the adding module is used for acquiring an adding instruction of a user under the condition that the operation type is adding a blood vessel, generating a new adding blood vessel in the retina image based on the adding instruction, acquiring blood vessel type information which is specified by the user aiming at the new adding blood vessel, and specifying a blood vessel type for the new adding blood vessel based on the type information; and the counting module is used for counting again the blood vessel type information of the retinal blood vessels, the position information of the retinal blood vessels, the pipe diameter information of the retinal blood vessels and the quantity information of the retinal blood vessels in each blood vessel type, and taking the newly counted information as the updated classification information.
In an embodiment of the present invention, the blood vessel category information includes vein blood vessels, artery blood vessels, and unidentified retina blood vessels, and the sorting of the retina blood vessels based on the updated classification information to obtain a sorting result includes: and sequencing each blood vessel in the venous blood vessels and each blood vessel in the arterial blood vessels in sequence according to the sizes of the calibers based on the calibre information, and obtaining a sequencing result.
In an embodiment of the present invention, the re-labeling the retinal vessel based on the sorting result includes: respectively acquiring a preset number of effective vein blood vessels and effective artery blood vessels according to the sequence of the pipe diameters from large to small on the basis of the sequencing result; determining a blood vessel other than the effective vein blood vessel and the effective artery blood vessel among the retinal blood vessels as an unidentified retinal blood vessel; and acquiring a labeling instruction of a user, and performing differential labeling on the effective vein blood vessel, the effective artery blood vessel and the unidentified retina blood vessel based on the labeling instruction.
Further, the present invention also provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the method of the present invention.
Although the embodiments of the present invention have been described in detail with reference to the accompanying drawings, the embodiments of the present invention are not limited to the details of the above embodiments, and various simple modifications can be made to the technical solutions of the embodiments of the present invention within the technical idea of the embodiments of the present invention, and the simple modifications all belong to the protection scope of the embodiments of the present invention.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, the embodiments of the present invention do not describe every possible combination.
Those skilled in the art can understand that all or part of the steps in the method according to the above embodiments may be implemented by a program, which is stored in a storage medium and includes several instructions to enable a single chip, a chip, or a processor (processor) to perform all or part of the steps in the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
In addition, any combination of various different implementation manners of the embodiments of the present invention is also possible, and the embodiments of the present invention should be considered as disclosed in the embodiments of the present invention as long as the combination does not depart from the spirit of the embodiments of the present invention.