CN111816281B - Ultrasonic image inquiry device - Google Patents
Ultrasonic image inquiry device Download PDFInfo
- Publication number
- CN111816281B CN111816281B CN202010581882.0A CN202010581882A CN111816281B CN 111816281 B CN111816281 B CN 111816281B CN 202010581882 A CN202010581882 A CN 202010581882A CN 111816281 B CN111816281 B CN 111816281B
- Authority
- CN
- China
- Prior art keywords
- image
- ultrasonic
- diagnosed
- matching
- ultrasonic image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012216 screening Methods 0.000 claims abstract description 26
- 238000003745 diagnosis Methods 0.000 claims abstract description 20
- 238000002604 ultrasonography Methods 0.000 claims description 48
- 238000013528 artificial neural network Methods 0.000 claims description 42
- 230000003902 lesion Effects 0.000 claims description 12
- 238000007689 inspection Methods 0.000 claims description 11
- 238000012549 training Methods 0.000 claims description 9
- 238000003062 neural network model Methods 0.000 claims description 6
- 239000003550 marker Substances 0.000 claims description 3
- 238000012285 ultrasound imaging Methods 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 4
- 238000000034 method Methods 0.000 description 11
- 238000012986 modification Methods 0.000 description 7
- 230000004048 modification Effects 0.000 description 7
- 239000000463 material Substances 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 210000004556 brain Anatomy 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 210000000056 organ Anatomy 0.000 description 3
- 230000000644 propagated effect Effects 0.000 description 3
- 239000000523 sample Substances 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 2
- 210000000038 chest Anatomy 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 239000003814 drug Substances 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 210000002216 heart Anatomy 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 210000004291 uterus Anatomy 0.000 description 2
- 241000579895 Chlorostilbon Species 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000010976 emerald Substances 0.000 description 1
- 229910052876 emerald Inorganic materials 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000010977 jade Substances 0.000 description 1
- 210000004185 liver Anatomy 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- ZLIBICFPKPWGIZ-UHFFFAOYSA-N pyrimethanil Chemical compound CC1=CC(C)=NC(NC=2C=CC=CC=2)=N1 ZLIBICFPKPWGIZ-UHFFFAOYSA-N 0.000 description 1
- 239000010979 ruby Substances 0.000 description 1
- 229910001750 ruby Inorganic materials 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
The invention relates to the technical field of ultrasonic image processing, in particular to an ultrasonic image query device. Comprising the following steps: the image acquisition unit is used for acquiring an ultrasonic image to be diagnosed, wherein the type of the ultrasonic image to be diagnosed comprises an ultrasonic image or an ultrasonic video; the image matching unit is used for matching the ultrasonic image to be diagnosed with a plurality of matching images containing marking information in an image database and calculating an image matching degree value; the screening unit is used for determining a matched image with the image matching degree value exceeding a preset matching degree value in the image database as a target ultrasonic image according to the image matching degree value; and the determining unit is used for determining the diagnosis information of the ultrasonic image to be diagnosed at least according to the mark information contained in the target ultrasonic image. The invention can quickly and directly obtain the diagnostic information of the ultrasonic image to be diagnosed in a searching and matching mode.
Description
Technical Field
The invention relates to the technical field of ultrasonic image processing, in particular to an ultrasonic image query device.
Background
The ultrasonic diagnostic apparatus has wide application in clinical medicine, and can perform ultrasonic image inspection and diagnosis on various parts of the body from head to foot. At present, many primary hospitals lack specialized doctors combining the ultrasonic department and the clinical department, when a patient diagnoses the ultrasonic image obtained by scanning for the primary doctor, the primary doctor has the condition that the corresponding scanned organ of the ultrasonic image cannot be judged, whether a focus exists or not, and how to get down a diagnosis conclusion under the condition that the focus exists, and the doctor cannot quickly and timely get out the ultrasonic diagnosis conclusion.
Disclosure of Invention
The invention aims to overcome the defects in the prior art and provides an ultrasonic image query device capable of rapidly assisting a doctor to rapidly and timely send out ultrasonic diagnosis conclusions.
In particular, the present invention provides an ultrasound image query apparatus, comprising:
The image acquisition unit is used for acquiring an ultrasonic image to be diagnosed, wherein the type of the ultrasonic image to be diagnosed comprises an ultrasonic image or an ultrasonic video;
The image matching unit is used for matching the ultrasonic image to be diagnosed with a plurality of matching images containing marking information in an image database and calculating an image matching degree value;
the screening unit is used for determining a matched image with the image matching degree value exceeding a preset matching degree value in the image database as a target ultrasonic image according to the image matching degree value;
And the determining unit is used for determining the diagnosis information of the ultrasonic image to be diagnosed at least according to the mark information contained in the target ultrasonic image.
Further, the display unit is further included, and the display unit is configured to:
displaying the ultrasonic image to be diagnosed and the target ultrasonic image, wherein the displayed target ultrasonic image comprises the corresponding marking information;
and displaying the image matching degree value of the ultrasonic image to be diagnosed and the target ultrasonic image.
Further, the system further comprises a history inquiry unit, wherein the history inquiry unit is configured to:
acquiring inspection object information corresponding to an ultrasonic image to be diagnosed;
inquiring historical diagnostic ultrasonic images of the inspection object according to the inspection object information corresponding to the ultrasonic images to be diagnosed, wherein the historical diagnostic ultrasonic images are stored in the image database;
When the historical diagnostic ultrasonic images exist, the diagnostic time of the historical diagnostic ultrasonic images is used as a reference basis for determining diagnostic information of the ultrasonic images to be diagnosed by the determining unit.
Further, the system also comprises a homogeneous query unit, wherein the homogeneous query unit is configured to:
Determining focus information according to the diagnosis information of the ultrasonic image to be diagnosed;
inquiring matching images corresponding to similar focuses in the image database according to the focus information;
And taking the mark information of the matched image corresponding to the similar focus as a reference basis for determining the diagnostic information of the ultrasonic image to be diagnosed by the determining unit.
Further, the marking information at least comprises scanning position information, focus information and treatment information corresponding to the ultrasonic image to be diagnosed.
Further, the image matching unit calculates and obtains an image matching degree value of the ultrasonic image to be diagnosed and each matching image through a cosine similarity algorithm.
Further, the image matching unit calculates and obtains an image matching degree value of the ultrasonic image to be diagnosed and each matching image through a trained matching neural network model.
Further, the matching neural network model includes:
The first neural network is used for identifying the scanning part of the ultrasonic image to be diagnosed, and is obtained through ultrasonic image training of a plurality of marked scanning part categories;
the second neural network is used for identifying focus information of the ultrasonic image to be diagnosed, and the first neural network is obtained through ultrasonic image training of a plurality of marked focus information;
screening a neural network, and screening corresponding matched images according to the scanned part of the ultrasonic image to be diagnosed and focus information;
and the matching neural network is used for calculating the matching degree value of the ultrasonic image to be diagnosed and the matching image screened by the screening neural network.
Further, the preset matching degree value set by the screening unit enables at least one matching image to be determined as the target ultrasonic image.
Further, the image database is: one or more of a local image database, a hospital allied image database and a cloud image database.
According to the ultrasonic image query device, the image matching unit can be used for rapidly matching the ultrasonic image to be diagnosed with a plurality of matching images containing the marking information in the image database and calculating the image matching degree value, then the matching images with the image matching degree value exceeding the preset matching degree value in the image database are determined to be the target ultrasonic image according to the screening unit, and the diagnosis information of the ultrasonic image to be diagnosed is determined according to the marking information contained in the target ultrasonic image. The diagnostic information of the ultrasonic image to be diagnosed can be directly obtained in a searching and matching mode.
Drawings
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification, illustrate the invention and together with the description serve to explain, without limitation, the invention.
Fig. 1 is a schematic structural diagram of an ultrasound image query apparatus according to an embodiment of the invention.
Fig. 2 is a schematic structural diagram of an ultrasound image query apparatus according to another embodiment of the present invention.
Fig. 3 is a schematic structural diagram of an ultrasound image query apparatus according to another embodiment of the present invention.
Fig. 4 is a schematic structural diagram of an ultrasound image query apparatus according to another embodiment of the present invention.
Fig. 5 is a flow chart of the ultrasonic image query method of the present invention.
Detailed Description
The application will be described in further detail below with reference to the drawings by means of specific embodiments. Wherein like elements in different embodiments are numbered alike in association. In the following embodiments, numerous specific details are set forth in order to provide a better understanding of the present application. However, one skilled in the art will readily recognize that some of the features may be omitted, or replaced by other elements, materials, or methods in different situations. In some instances, related operations of the present application have not been shown or described in the specification in order to avoid obscuring the core portions of the present application, and may be unnecessary to persons skilled in the art from a detailed description of the related operations, which may be presented in the description and general knowledge of one skilled in the art. Furthermore, the described features, operations, or characteristics of the description may be combined in any suitable manner in various embodiments.
At present, many primary hospitals lack specialized doctors combining the ultrasonic department and the clinical department, when an examination object diagnoses the ultrasonic image obtained by scanning for the primary doctors, the primary doctors have the condition that the corresponding scanned organ of the ultrasonic image cannot be judged, whether a focus exists or not, and how to get down a diagnosis conclusion under the condition that the focus exists, and the doctor cannot quickly and timely get out the ultrasonic diagnosis conclusion.
As an aspect of the present invention, as shown in fig. 1, the present invention provides an ultrasound image query apparatus, including: an image acquisition unit 100, an image matching unit 200, a screening unit 300, and a determination unit 400. The image acquisition unit 100 is configured to acquire an ultrasonic image to be diagnosed, where the type of the ultrasonic image to be diagnosed includes an ultrasonic image or an ultrasonic video; the image matching unit 200 is configured to match the ultrasound image to be diagnosed with a plurality of matching images containing marking information in an image database, and calculate an image matching degree value, where the image database is pre-established and is configured to store a plurality of ultrasound images marked with marking information by a doctor or an artificial intelligence model, as matching images matched with the ultrasound image to be diagnosed, and the matching images at least include one or more of matching ultrasound images, matching CT images, matching MR images, and matching PET images; the screening unit 300 is configured to determine, according to the image matching degree value, a matching image in the image database, where the image matching degree value exceeds a preset matching degree value, as a target ultrasound image; the determining unit 400 is configured to determine diagnostic information of the ultrasound image to be diagnosed according to at least marking information included in the target ultrasound image, where the diagnostic information includes at least one or more of scan site information, lesion information, and treatment information.
The ultrasonic image query device can quickly search through the image matching unit 200, match an ultrasonic image to be diagnosed with a plurality of matching images containing marking information in an image database, calculate an image matching degree value, determine the matching image with the image matching degree value exceeding a preset matching degree value in the image database as a target ultrasonic image according to the screening unit 300, and determine the diagnosis information of the ultrasonic image to be diagnosed according to the marking information contained in the target ultrasonic image. The diagnostic information of the ultrasonic image to be diagnosed can be directly obtained in a searching and matching mode.
In an embodiment, the image acquisition unit 100 of the present invention may directly acquire an ultrasonic image to be diagnosed by scanning a scanning site with an ultrasonic probe of an ultrasonic apparatus; if the examination object needs to visit across hospitals, for example, a special hospital is called an expert clinic, the ultrasound image to be diagnosed can be stored in a storage medium, and the ultrasound image can be various computer readable storage media such as a USB flash disk, a mobile hard disk, a Read-Only Memory (ROM), an optical disk or a cloud disk, and the like, which can store program codes. It is to be understood that the ultrasound image to be diagnosed of the present invention may be one or more of a single frame ultrasound image, a multi-frame ultrasound image, or an ultrasound video. The "scanning site" in the present invention may include a person, an animal, a portion of a person, or a portion of an animal. For example, the subject may include organs or blood vessels such as the liver, heart, uterus, brain, chest, abdomen, etc. In addition, the term "scan site" may include an artificial model. The artificial model represents a material having a volume very close to the density and effective atomic number of an organism and may comprise a spherical artificial model having a mood similar to a human body.
In order to provide a diagnosis reference basis for a doctor rapidly, the invention matches an ultrasonic image to be diagnosed with a plurality of matching images containing marking information in an image database in a search mode, and then screens the matching image with high matching degree with the ultrasonic image to be diagnosed as a target ultrasonic image by calculating an image matching degree value. The doctor can use the marking information of the target ultrasonic image as a diagnosis reference basis. The marking information at least comprises scanning position information, focus information and treatment information corresponding to the ultrasonic image to be diagnosed. It should be understood that the image database of the present invention is: one or more of a local image database, a hospital allied image database and a cloud image database.
In an embodiment, the image matching unit 200 of the present invention obtains the image matching degree value of the ultrasound image to be diagnosed and each of the matching images through cosine similarity algorithm calculation. The cosine similarity algorithm measures the similarity between the ultrasonic image to be diagnosed and the matched images by calculating the cosine value of the included angle between the image feature vector representing the ultrasonic image to be diagnosed and the inner product space of a plurality of matched images in the image database.
In order to further improve the speed and accuracy of searching and matching, in another embodiment, the image matching unit 200 of the present invention calculates and obtains the image matching degree value of the ultrasound image to be diagnosed and each of the matching images through a trained matching neural network model. The matched neural network model includes: the system comprises a first neural network, a second neural network, a screening neural network and a matching neural network.
The first neural network is used for identifying the scanning part of the ultrasonic image to be diagnosed, and is obtained through ultrasonic image training of a plurality of marked scanning part categories; the first neural network is a convolutional neural network and comprises an input layer, an implicit layer and an output layer; wherein the hidden layer comprises a plurality of convolution layers, a downsampling layer and an upsampling layer; the input ultrasonic image to be diagnosed is subjected to convolution operation and downsampling operation through a plurality of convolution layers and downsampling layers, and then subjected to convolution operation and upsampling operation through a plurality of convolution layers and upsampling layers; the input layer and the hidden layer, the hidden layers and the output layer of the first neural network are connected through weight parameters; the convolution layer in the first neural network is used for automatically extracting the characteristic vector in the ultrasonic image to be diagnosed. After training is carried out through a plurality of ultrasonic images marked with the category of the scanned part, the scanned part corresponding to the ultrasonic image to be diagnosed can be rapidly identified after the ultrasonic image to be diagnosed is input into the first neural network. It will be appreciated that when the acquired ultrasound images are stored in the local image database, the hospital allied image database or the cloud image database, the hospital stores the ultrasound images in a classified manner, for example, all the ultrasound images related to "heart" are stored in a subset. The image database establishes corresponding sub-image sets according to different scanned parts such as uterus, brain, chest, abdomen and the like. According to the invention, the first neural network can be used for rapidly identifying the scanned part of the ultrasonic image to be diagnosed, so that the amount of search matching can be reduced, and the speed of search matching is improved. It should be understood that the first neural network can rapidly identify the scanning location of the ultrasonic image to be diagnosed, and can be used as a determining unit to determine the diagnostic information of the ultrasonic image to be diagnosed, for example, when the information is the scanning location information, the first neural network can identify the scanning location, and then the reference and the confirmation are performed by combining the scanning location information in the marking information contained in the target ultrasonic image.
In order to further increase the matching speed of the image matching unit 200, the second neural network is used for identifying the focus information of the ultrasonic image to be diagnosed, and the second neural network is obtained through ultrasonic image training of a plurality of marked focus information; the second neural network of the present invention is also a convolutional neural network. Lesion information is predicted by a second neural network. It should be appreciated that the lesion information identified by the second neural network is the outline of the lesion, i.e., the shape of the lesion. The training method of the second neural network is specifically as follows: inputting a plurality of ultrasonic image samples marked with focus information into a second neural network to predict focus areas in the ultrasonic image samples; determining a target lesion area corresponding to the predicted lesion area by using the predicted lesion area; and determining the sampling weight of the ultrasonic image sample according to the focus information of the ultrasonic image sample and the predicted focus area, so as to obtain a trained second neural network. The focus area of the ultrasonic image to be diagnosed can be rapidly identified through the second neural network. It can be appreciated that the image database can create corresponding sub-image sets according to different lesion areas of the same scan site. The "focal region" herein may be understood as the shape contour of the lesion. According to the invention, the quantity of search matching can be reduced after the focus information of the ultrasonic image to be diagnosed is rapidly identified through the second neural network, and the speed of search matching is improved.
Screening a neural network, and screening corresponding matched images according to the scanned part of the ultrasonic image to be diagnosed and focus information; and the matching neural network is used for calculating the matching degree value of the ultrasonic image to be diagnosed and the matching image screened by the screening neural network. The specific training method of the screening neural network and the matching neural network is similar to that of the first neural network and the second neural network, and will not be described herein.
The screening unit 300 is configured to determine, according to the image matching degree value, a matching image in the image database, where the image matching degree value exceeds a preset matching degree value, as a target ultrasound image; the preset matching degree value set by the screening unit 300 enables at least one matching image to be determined as the target ultrasonic image. The operator can set a preset matching value through an input unit, and the input unit is used for inputting a control instruction of the operator. The input unit may be at least one of a keyboard, a trackball, a mouse, a touch panel, a handle, a dial, a joystick, and a foot switch. The input unit may also input a non-contact signal, such as a sound, gesture, line of sight, or brain wave signal. The operator may set a specific preset matching value, for example, 95%, and more than 95% of the matching images in the image database may be screened by the screening unit 300. The screening unit 300 may also perform screening according to the degree of the image matching degree value by setting screening to determine several matching ultrasonic images as target ultrasonic images.
The determining unit 400 of the present invention determines the diagnostic information of the ultrasound image to be diagnosed at least according to the marker information contained in the target ultrasound image. Diagnostic information of the ultrasound image to be diagnosed is inferred and determined by the marker information contained in the target ultrasound image. The marking information at least comprises scanning position information, focus information and treatment information corresponding to the ultrasonic image to be diagnosed.
According to the invention, the real cases corresponding to the ultrasonic images to be diagnosed are searched in a searching and matching mode to serve as the basis for diagnosis, so that the speed is high, the accuracy is high, and misdiagnosis is avoided.
As shown in fig. 2, the present invention further includes a display unit 500, the display unit 500 being configured to: displaying the ultrasonic image to be diagnosed and the target ultrasonic image, wherein the displayed target ultrasonic image comprises the corresponding marking information; and displaying the image matching degree value of the ultrasonic image to be diagnosed and the target ultrasonic image. The display unit 500 in this embodiment is a display, and the number of the displays is not limited. The displayed ultrasound image to be diagnosed, the target ultrasound image, the image matching degree value and the like may be displayed on one display or may be displayed on a plurality of displays at the same time, and the embodiment is not limited thereto. In addition, the display is provided for a graphical interface for human-computer interaction of a user while displaying, one or more controlled objects are arranged on the graphical interface, and an operator is provided with the controlled objects to control the controlled objects by utilizing a human-computer interaction device to input operation instructions, so that corresponding control operation is executed. Such as projection, VR glasses, but of course the display may also include input devices such as a touch-input display screen, motion-sensitive projector VR glasses. Icons displayed on the display can be operated by using the man-machine interaction device to execute specific functions.
In order to query the historical data of the inspection object corresponding to the ultrasonic image to be diagnosed, the historical data is compared with the historical ultrasonic image (the closest ultrasonic image) to obtain trend judgment or distinguishing information judgment. As shown in fig. 3, the present invention further includes a history inquiry unit 600, where the history inquiry unit 600 is configured to: acquiring inspection object information corresponding to an ultrasonic image to be diagnosed; inquiring historical diagnostic ultrasonic images of the inspection object according to the inspection object information corresponding to the ultrasonic images to be diagnosed, wherein the historical diagnostic ultrasonic images are stored in the image database; when there is a history diagnostic ultrasound image, the diagnostic time of the history diagnostic ultrasound image is used as a reference basis for determining diagnostic information of the ultrasound image to be diagnosed by the determining unit 400. Trend determinations or discrimination information determinations may be obtained.
As shown in fig. 4, the present invention further includes a similar query unit 700, which can obtain diagnosis results, medication records, diagnosis and treatment effects of the disease information of the examination object under the similar ultrasound images. The homogeneous query unit 700 is configured to:
Determining focus information according to the diagnosis information of the ultrasonic image to be diagnosed;
inquiring matching images corresponding to similar focuses in the image database according to the focus information;
The marking information of the matching images corresponding to the similar lesions is used as a reference basis for determining the diagnostic information of the ultrasonic image to be diagnosed by the determining unit 400.
As a second aspect of the present invention, as shown in fig. 5, the present invention further provides an ultrasound image query method, including:
s100, acquiring an ultrasonic image to be diagnosed, wherein the type of the ultrasonic image to be diagnosed comprises an ultrasonic image or an ultrasonic video;
S200, matching the ultrasonic image to be diagnosed with a plurality of matched images containing marking information in an image database, and calculating an image matching degree value;
S300, according to the image matching degree value, determining a matching image with the image matching degree value exceeding a preset matching degree value in the image database as a target ultrasonic image;
s400, determining diagnosis information of the ultrasonic image to be diagnosed at least according to the marking information contained in the target ultrasonic image.
According to the ultrasonic image query method, the ultrasonic image to be diagnosed and a plurality of matched images containing the marking information in the image database can be rapidly matched, the image matching degree value is calculated, then the matched images with the image matching degree value exceeding the preset matching degree value in the image database are determined to be target ultrasonic images, and the diagnosis information of the ultrasonic image to be diagnosed is determined according to the marking information contained in the target ultrasonic images. The diagnostic information of the ultrasonic image to be diagnosed can be directly obtained in a searching and matching mode.
As a third aspect of the present invention, there is provided a computer storage medium storing a program for executing an ultrasound image query method of the foregoing.
While the basic concepts have been described above, it will be apparent to those skilled in the art that the foregoing detailed disclosure is by way of example only and is not intended to be limiting. Although not explicitly described herein, various modifications, improvements, and adaptations to the present disclosure may occur to one skilled in the art. Such modifications, improvements, and modifications are intended to be suggested within this specification, and therefore, such modifications, improvements, and modifications are intended to be included within the spirit and scope of the exemplary embodiments of the present invention.
Meanwhile, the specification uses specific words to describe the embodiments of the specification. Reference to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic is associated with at least one embodiment of the present description. Thus, it should be emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various positions in this specification are not necessarily referring to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of the present description may be combined as suitable.
Furthermore, those skilled in the art will appreciate that the various aspects of the specification can be illustrated and described in terms of several patentable categories or circumstances, including any novel and useful procedures, machines, products, or materials, or any novel and useful modifications thereof. Accordingly, aspects of the present description may be performed entirely by hardware, entirely by software (including firmware, resident software, micro-code, etc.), or by a combination of hardware and software. The above hardware or software may be referred to as a "data block," module, "" unit, "" component, "or" system. Furthermore, aspects of the specification may take the form of a computer product, comprising computer-readable program code, embodied in one or more computer-readable media.
The computer storage medium may contain a propagated data signal with the computer program code embodied therein, for example, on a baseband or as part of a carrier wave. The propagated signal may take on a variety of forms, including electro-magnetic, optical, etc., or any suitable combination thereof. A computer storage medium may be any computer readable medium that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code located on a computer storage medium may be propagated through any suitable medium, including radio, cable, fiber optic cable, RF, or the like, or a combination of any of the foregoing.
The computer program code necessary for operation of portions of the present description may be written in any one or more programming languages, including an object oriented programming language such as Java, scala, smalltalk, eiffel, JADE, emerald, C ++, c#, vb net, python, and the like, a conventional programming language such as C language, visual Basic, fortran2003, perl, COBOL2002, PHP, ABAP, a dynamic programming language such as Python, ruby, and Groovy, or other programming languages, and the like. The program code may execute entirely on the user's computer or as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or processing device. In the latter scenario, the remote computer may be connected to the user's computer through any form of network, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet), or the use of services such as software as a service (SaaS) in a cloud computing environment.
Furthermore, the order in which the elements and sequences are processed, the use of numerical letters, or other designations in the description are not intended to limit the order in which the processes and methods of the description are performed unless explicitly recited in the claims. While certain presently useful inventive embodiments have been discussed in the foregoing disclosure, by way of various examples, it is to be understood that such details are merely illustrative and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements included within the spirit and scope of the embodiments of the present disclosure. For example, while the system components described above may be implemented by hardware devices, they may also be implemented solely by software solutions, such as installing the described system on an existing processing device or mobile device.
Likewise, it should be noted that in order to simplify the presentation disclosed in this specification and thereby aid in understanding one or more inventive embodiments, various features are sometimes grouped together in a single embodiment, figure, or description thereof. This method of disclosure does not imply that the subject matter of the present description requires more features than are set forth in the claims. Indeed, less than all of the features of a single embodiment disclosed above.
Each patent, patent application publication, and other material, such as articles, books, specifications, publications, documents, etc., referred to in this specification is incorporated herein by reference in its entirety. Except for application history documents that are inconsistent or conflicting with the content of this specification, documents that are currently or later attached to this specification in which the broadest scope of the claims to this specification is limited are also. It is noted that, if the description, definition, and/or use of a term in an attached material in this specification does not conform to or conflict with what is described in this specification, the description, definition, and/or use of the term in this specification controls.
Finally, it should be understood that the embodiments described in this specification are merely illustrative of the principles of the embodiments of this specification. Other variations are possible within the scope of this description. Thus, by way of example, and not limitation, alternative configurations of embodiments of the present specification may be considered as consistent with the teachings of the present specification. Accordingly, the embodiments of the present specification are not limited to only the embodiments explicitly described and depicted in the present specification.
Claims (8)
1. An ultrasound image query apparatus, comprising:
The image acquisition unit is used for acquiring an ultrasonic image to be diagnosed, wherein the type of the ultrasonic image to be diagnosed comprises an ultrasonic image or an ultrasonic video;
The image matching unit is used for matching the ultrasonic image to be diagnosed with a plurality of matching images containing marking information in an image database and calculating an image matching degree value;
the screening unit is used for determining a matched image with the image matching degree value exceeding a preset matching degree value in the image database as a target ultrasonic image according to the image matching degree value;
a determining unit for determining diagnostic information of the ultrasound image to be diagnosed at least according to the marking information contained in the target ultrasound image;
The image matching unit calculates and obtains an image matching degree value of the ultrasonic image to be diagnosed and each matching image through a trained matching neural network model; the matching neural network model comprises a first neural network for identifying the scanning part of the ultrasonic image to be diagnosed, a second neural network for identifying the focus shape, a screening neural network for screening the corresponding matching image according to the scanning part of the ultrasonic image to be diagnosed and the focus shape, and a matching neural network for calculating the matching degree value of the ultrasonic image to be diagnosed and the matching image screened by the screening neural network.
2. The ultrasound image query device of claim 1, further comprising a display unit configured to:
displaying the ultrasonic image to be diagnosed and the target ultrasonic image, wherein the displayed target ultrasonic image comprises the corresponding marking information;
and displaying the image matching degree value of the ultrasonic image to be diagnosed and the target ultrasonic image.
3. The ultrasound image query device of claim 1, further comprising a history query unit configured to:
acquiring inspection object information corresponding to an ultrasonic image to be diagnosed;
inquiring historical diagnostic ultrasonic images of the inspection object according to the inspection object information corresponding to the ultrasonic images to be diagnosed, wherein the historical diagnostic ultrasonic images are stored in the image database;
When the historical diagnostic ultrasonic images exist, the diagnostic time of the historical diagnostic ultrasonic images is used as a reference basis for determining diagnostic information of the ultrasonic images to be diagnosed by the determining unit.
4. The ultrasound image query device of claim 1, further comprising a homogeneous query unit configured to:
Determining focus information according to the diagnosis information of the ultrasonic image to be diagnosed;
inquiring matching images corresponding to similar focuses in the image database according to the focus information;
And taking the mark information of the matched image corresponding to the similar focus as a reference basis for determining the diagnostic information of the ultrasonic image to be diagnosed by the determining unit.
5. The ultrasound image query apparatus of claim 1, wherein the marker information includes at least scan site information, lesion information, and treatment information corresponding to the ultrasound image to be diagnosed.
6. The ultrasound imaging query apparatus of claim 1, wherein,
The first neural network is obtained through ultrasonic image training of a plurality of marked scanning part categories; the second neural network is obtained through ultrasonic image training of a plurality of marked focus shapes.
7. The ultrasound image query apparatus of any of claims 1 to 5, wherein the preset matching degree value set by the screening unit is such that at least one matching image is determined as the target ultrasound image.
8. The ultrasound image query device of any one of claims 1 to 5, wherein the image database is: one or more of a local image database, a hospital allied image database and a cloud image database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010581882.0A CN111816281B (en) | 2020-06-23 | 2020-06-23 | Ultrasonic image inquiry device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010581882.0A CN111816281B (en) | 2020-06-23 | 2020-06-23 | Ultrasonic image inquiry device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111816281A CN111816281A (en) | 2020-10-23 |
| CN111816281B true CN111816281B (en) | 2024-05-14 |
Family
ID=72845931
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010581882.0A Active CN111816281B (en) | 2020-06-23 | 2020-06-23 | Ultrasonic image inquiry device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111816281B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112381006A (en) * | 2020-11-17 | 2021-02-19 | 深圳度影医疗科技有限公司 | Ultrasonic image analysis method, storage medium and terminal equipment |
| CN112837790B (en) * | 2021-01-27 | 2024-04-19 | 海纳医信（北京）软件科技有限责任公司 | Method and device for displaying image inspection information |
| CN113409924A (en) * | 2021-07-01 | 2021-09-17 | 上海市第一人民医院 | Artificial intelligence-based lung examination image auxiliary marking method and system |
| CN113553460B (en) * | 2021-08-13 | 2022-06-28 | 北京安德医智科技有限公司 | Image retrieval method and device, electronic device and storage medium |
| CN114549458A (en) * | 2022-02-20 | 2022-05-27 | 湖南康润药业股份有限公司 | Ultrasonic scanning normative evaluation method and system |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101714153A (en) * | 2009-11-16 | 2010-05-26 | 杭州电子科技大学 | Visual perception based interactive mammography image searth method |
| CN103942337A (en) * | 2014-05-08 | 2014-07-23 | 北京航空航天大学 | Video search system based on image recognition and matching |
| WO2014141247A1 (en) * | 2013-03-11 | 2014-09-18 | Tylerton International Holdings Inc. | Modeling the autonomous nervous system and uses thereof |
| CN106779084A (en) * | 2016-09-30 | 2017-05-31 | 广州英康唯尔互联网服务有限公司 | Machine learning system and method |
| CN107644419A (en) * | 2017-09-30 | 2018-01-30 | 百度在线网络技术（北京）有限公司 | Method and apparatus for analyzing medical image |
| CN107820138A (en) * | 2017-11-06 | 2018-03-20 | 广东欧珀移动通信有限公司 | Video broadcasting method, device, terminal and storage medium |
| CN108345909A (en) * | 2018-02-27 | 2018-07-31 | 广东欧珀移动通信有限公司 | It is a kind of to search the method, apparatus of picture personage, computer readable storage medium |
| CN108717709A (en) * | 2018-05-24 | 2018-10-30 | 东北大学 | Image processing system and image processing method |
| CN109034380A (en) * | 2018-06-08 | 2018-12-18 | 四川斐讯信息技术有限公司 | A kind of distributed image identification system and its method |
| EP3528179A1 (en) * | 2018-02-15 | 2019-08-21 | Koninklijke Philips N.V. | Training a neural network |
| CN110197722A (en) * | 2019-05-31 | 2019-09-03 | 贵州精准健康数据有限公司 | AI-CPU system platform |
| CN110310271A (en) * | 2019-07-01 | 2019-10-08 | 无锡祥生医疗科技股份有限公司 | Property method of discrimination, storage medium and the Vltrasonic device of carotid plaques |
| CN110584714A (en) * | 2019-10-23 | 2019-12-20 | 无锡祥生医疗科技股份有限公司 | Ultrasonic fusion imaging method, ultrasonic device, and storage medium |
| CN110648327A (en) * | 2019-09-29 | 2020-01-03 | 无锡祥生医疗科技股份有限公司 | Method and equipment for automatically tracking ultrasonic image video based on artificial intelligence |
| CN111079802A (en) * | 2019-12-02 | 2020-04-28 | 易思维（杭州）科技有限公司 | Matching method based on gradient information |
| CN111292298A (en) * | 2020-01-21 | 2020-06-16 | 无锡祥生医疗科技股份有限公司 | Breast cancer pathological typing determination method, device and storage medium |
| CN111292301A (en) * | 2018-12-07 | 2020-06-16 | 北京市商汤科技开发有限公司 | Focus detection method, device, equipment and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU765657B2 (en) * | 1999-01-14 | 2003-09-25 | Motorola Australia Pty Ltd | A method and apparatus for quantising and dequantising data |
-
2020
- 2020-06-23 CN CN202010581882.0A patent/CN111816281B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101714153A (en) * | 2009-11-16 | 2010-05-26 | 杭州电子科技大学 | Visual perception based interactive mammography image searth method |
| WO2014141247A1 (en) * | 2013-03-11 | 2014-09-18 | Tylerton International Holdings Inc. | Modeling the autonomous nervous system and uses thereof |
| CN103942337A (en) * | 2014-05-08 | 2014-07-23 | 北京航空航天大学 | Video search system based on image recognition and matching |
| CN106779084A (en) * | 2016-09-30 | 2017-05-31 | 广州英康唯尔互联网服务有限公司 | Machine learning system and method |
| CN107644419A (en) * | 2017-09-30 | 2018-01-30 | 百度在线网络技术（北京）有限公司 | Method and apparatus for analyzing medical image |
| CN107820138A (en) * | 2017-11-06 | 2018-03-20 | 广东欧珀移动通信有限公司 | Video broadcasting method, device, terminal and storage medium |
| EP3528179A1 (en) * | 2018-02-15 | 2019-08-21 | Koninklijke Philips N.V. | Training a neural network |
| CN108345909A (en) * | 2018-02-27 | 2018-07-31 | 广东欧珀移动通信有限公司 | It is a kind of to search the method, apparatus of picture personage, computer readable storage medium |
| CN108717709A (en) * | 2018-05-24 | 2018-10-30 | 东北大学 | Image processing system and image processing method |
| CN109034380A (en) * | 2018-06-08 | 2018-12-18 | 四川斐讯信息技术有限公司 | A kind of distributed image identification system and its method |
| CN111292301A (en) * | 2018-12-07 | 2020-06-16 | 北京市商汤科技开发有限公司 | Focus detection method, device, equipment and storage medium |
| CN110197722A (en) * | 2019-05-31 | 2019-09-03 | 贵州精准健康数据有限公司 | AI-CPU system platform |
| CN110310271A (en) * | 2019-07-01 | 2019-10-08 | 无锡祥生医疗科技股份有限公司 | Property method of discrimination, storage medium and the Vltrasonic device of carotid plaques |
| CN110648327A (en) * | 2019-09-29 | 2020-01-03 | 无锡祥生医疗科技股份有限公司 | Method and equipment for automatically tracking ultrasonic image video based on artificial intelligence |
| CN110584714A (en) * | 2019-10-23 | 2019-12-20 | 无锡祥生医疗科技股份有限公司 | Ultrasonic fusion imaging method, ultrasonic device, and storage medium |
| CN111079802A (en) * | 2019-12-02 | 2020-04-28 | 易思维（杭州）科技有限公司 | Matching method based on gradient information |
| CN111292298A (en) * | 2020-01-21 | 2020-06-16 | 无锡祥生医疗科技股份有限公司 | Breast cancer pathological typing determination method, device and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| "基于卷积神经网络的左心室超声图像特征点定位";周玉金等;《计算机应用》;20190520;1201-1207 * |
| 杨长兴等.《医学计算机应用基础》.中国铁道出版社,2014,(第1版),第314页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111816281A (en) | 2020-10-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111816281B (en) | Ultrasonic image inquiry device | |
| JP5222082B2 (en) | Information processing apparatus, control method therefor, and data processing system | |
| Tadeusiewicz et al. | Medical image understanding technology | |
| CN105163684B (en) | The through transport of surgical data is synchronous | |
| JP5100285B2 (en) | MEDICAL DIAGNOSIS SUPPORT DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM | |
| CN102844761B (en) | For checking method and the report viewer of the medical report describing radiology image | |
| US8630467B2 (en) | Diagnosis assisting system using three dimensional image data, computer readable recording medium having a related diagnosis assisting program recorded thereon, and related diagnosis assisting method | |
| KR102289277B1 (en) | Medical image diagnosis assistance apparatus and method generating evaluation score about a plurality of medical image diagnosis algorithm | |
| US7548639B2 (en) | Diagnosis assisting system and storage medium having diagnosis assisting program stored therein | |
| JP5309187B2 (en) | MEDICAL INFORMATION DISPLAY DEVICE, ITS OPERATION METHOD, AND MEDICAL INFORMATION DISPLAY PROGRAM | |
| CN110021014A (en) | Nerve fiber recognition methods, system and storage medium neural network based | |
| JP2019532390A (en) | Update of disease probability based on annotation of medical images | |
| KR20200000820A (en) | Video clip selector for medical imaging and diagnosis | |
| JP7080932B2 (en) | Methods and systems for workflow management | |
| US20220059227A1 (en) | Method for displaying ultrasonic image, ultrasonic diagnostic device, and computer program product | |
| CN111657997A (en) | Ultrasonic auxiliary guiding method, device and storage medium | |
| JP6755192B2 (en) | How to operate the diagnostic support device and the diagnostic support device | |
| CN111223556B (en) | Integrated medical image visualization and exploration | |
| KR102222015B1 (en) | Apparatus and method for medical image reading assistant providing hanging protocols based on medical use artificial neural network | |
| JP7102509B2 (en) | Medical document creation support device, medical document creation support method, and medical document creation support program | |
| US11830607B2 (en) | Systems and methods for facilitating image finding analysis | |
| JP5539478B2 (en) | Information processing apparatus and information processing method | |
| KR102360615B1 (en) | Medical image diagnosis assistance apparatus and method using a plurality of medical image diagnosis algorithm for endoscope images | |
| JP2005533578A (en) | System and method for assigning computer-aided detection applications to digital images | |
| JP2015097127A (en) | Diagnosis support device, control method of diagnosis support device, program, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |