WO2018070285A1 - 画像処理装置、及び画像処理方法 - Google Patents

画像処理装置、及び画像処理方法 Download PDF

Info

Publication number
WO2018070285A1
WO2018070285A1 PCT/JP2017/035787 JP2017035787W WO2018070285A1 WO 2018070285 A1 WO2018070285 A1 WO 2018070285A1 JP 2017035787 W JP2017035787 W JP 2017035787W WO 2018070285 A1 WO2018070285 A1 WO 2018070285A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
learning
image feature
image processing
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/035787
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
子盛 黎
昌宏 荻野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Publication of WO2018070285A1 publication Critical patent/WO2018070285A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03—Computed tomography [CT]

Definitions

  • the present invention relates to an image processing apparatus, and more particularly to an image processing technique for processing medical images.
  • the captured three-dimensional medical image is re-created as a continuous two-dimensional section.
  • the image is interpreted by observing the two-dimensional cross-sectional image.
  • the three-dimensional resolution of the generated three-dimensional medical image is also improved, and the data size tends to increase.
  • the two-dimensional cross-section generation interval described above can be made finer, and more detailed observation of the lesion appearing on the medical image is possible.
  • the number of two-dimensional sections is also increasing.
  • the CT apparatus it has become possible to capture a high-quality three-dimensional medical image with a low dose, and the number of CT image capturing opportunities tends to increase.
  • CAD Computer Aided Detection
  • This CAD aims to automatically or semi-automatically apply image processing technology to detect shadows, measure sizes, identify normal / abnormal shadows, and distinguish between types of abnormal shadows using a computer.
  • CAD aims to present shadows with high suspicion of lesions based on image features. Since the purpose of this CAD is to prevent a doctor from overlooking it, it is often desirable to present all shadows with a high suspicion of lesions. However, on the other hand, if there are too many shadows to present, there is a problem that the burden on the doctor who examines each suspicion increases. Therefore, there is a need for a method for presenting suspected shadows in a form desired by a doctor and reducing the burden on the doctor.
  • Non-Patent Document 1 CAD data is improved by continuously collecting and re-learning diagnostic data of facilities using CAD systems developed by machine learning. A method for achieving this has been proposed.
  • a formula that defines the suspicion of a lesion is generally set using a feature amount obtained from an image, and a shadow having a high suspicion of the lesion is presented.
  • the image feature quantity of the lesion shadow is unique, the feature quantity extraction method set based on the CAD development data set cannot be applied to the image quality and findings of the actual operation. The estimation performance of the suspicion of the lesion is not obtained.
  • the contribution rate of which feature amount is high in the method of adjusting the threshold of the suspicion of the shadow to be presented and the method of calculating the suspicion
  • the image feature extraction processing cannot be adjusted.
  • An object of the present invention is to provide an image processing apparatus and an image processing method that enable adjustment of image feature amount extraction processing of a lesion shadow and reduce a burden on a user when interpreting a medical image. It is in.
  • an image processing apparatus that presents a suspected lesion area image detected from image data, and that performs learning for classifying image feature labels related to the suspected lesion area image
  • a feature label learning unit an image feature amount extraction unit that extracts an image feature amount of a suspicious lesion region image using a learning parameter of an image feature label obtained by learning of the image feature label learning unit, and a suspicious lesion region image are displayed
  • An image processing apparatus having a display unit, a user input unit, and an image feature label learning update unit that updates a learning parameter in response to an input from the user input unit.
  • a processing method of an image processing apparatus that includes a display unit and a user input unit, and presents a suspected lesion area image detected from image data. Learns to classify the image feature labels related to the suspicious lesion region image, extracts the image feature amount of the suspicious lesion region image using the learning parameters of the image feature label obtained by learning, and extracts the suspicious lesion region image.
  • an image processing method configured to display on a display unit and update a learning parameter in accordance with an input from a user input unit.
  • FIG. 1 is a block diagram illustrating an example of the overall configuration of an image processing apparatus according to Embodiment 1.
  • FIG. 3 is a flowchart illustrating a flow of machine learning processing in the image processing apparatus according to the first embodiment.
  • FIG. 3 is a flowchart illustrating a flow of a suspicious area malignancy estimation process in the image processing apparatus according to the first embodiment.
  • FIG. 3 is a flowchart illustrating a flow of image feature amount extraction processing in the image processing apparatus according to the first embodiment.
  • FIG. FIG. 3 is a schematic diagram illustrating an example of a plurality of image feature labels according to the first embodiment.
  • FIG. 3 is a diagram illustrating an example of a configuration of an image label learning device for classifying image feature labels according to the first embodiment.
  • FIG. 6 is a diagram illustrating an example of image feature amount extraction processing of a suspected lesion area image according to the first embodiment. Explanatory drawing which shows an example of the display part which displays image data and a lesion suspicious area image based on Example 1, and the user interface which selects an image feature label and malignancy right / wrong information.
  • FIG. 6 is a block diagram illustrating an example of the overall configuration of an image processing apparatus according to a second embodiment.
  • FIG. 10 is a flowchart illustrating a flow of image feature amount extraction processing in the image processing apparatus according to the second embodiment.
  • FIG. 10 is a diagram illustrating an example of a configuration of an image label learning device for classifying image feature labels according to the second embodiment.
  • an image feature amount extraction process related to a suspected lesion area image according to an input from the user 1 is an example of an image processing apparatus capable of adjusting the image quality.
  • an image processing apparatus that presents a suspected lesion area image detected from image data, an image feature label learning unit that performs learning for classifying image feature labels related to a suspected lesion area image, and an image feature label learning unit
  • An image feature amount extraction unit that extracts an image feature amount of a suspicious lesion region image using a learning parameter of an image feature label obtained by learning, a display unit that displays a suspicious lesion region image, a user input unit, and a user
  • a processing method of an image processing apparatus that includes a display unit and a user input unit and presents a suspected lesion area image detected from image data, wherein the image processing apparatus classifies image feature labels related to a suspected lesion area image. For learning, using the learning parameters of the image feature label obtained by learning, extracting the image feature amount of the suspicious lesion region image, displaying the suspicious lesion region image on the display unit, and inputting it from the user input unit Accordingly, the embodiment is an embodiment of an image processing method configured to update learning parameters.
  • a reconstructed three-dimensional medical image obtained by a CT medical image photographing apparatus will be described as an example.
  • the structure of this embodiment is an image process based on data obtained by another medical image photographing apparatus.
  • the apparatus can also be applied.
  • the data is obtained by an MRI imaging apparatus or the like, it is applicable to obtain a three-dimensional image that can be expressed as a stack of a plurality of two-dimensional cross sections, and that are supposed to show lesion characteristics in the pixel distribution. Can do.
  • the suspected lesion area in the present embodiment refers to a point and an area with a high suspected lesion, which are determined based on the medical knowledge of the interpreting doctor, the medical evidence (evidence) for the disease diagnosis, and the like.
  • the target lesion is highly likely to be judged from the difference in luminance from the surrounding area, that is, the region with low suspicion of the lesion, or the difference in luminance value distribution when it appears on the medical image.
  • the CT value appears on the CT image as a region including many pixels higher than the surrounding air region.
  • FIG. 1 is a diagram illustrating an example of a system configuration including an image processing apparatus according to the first embodiment.
  • the image processing apparatus 100 includes a user input unit 10, an image feature label learning unit 21, an image feature label learning parameter storage unit 22, an image feature amount extraction unit 23, and a lesion suspected area malignancy learning.
  • the image processing apparatus 100 is configured by a normal computer, the display unit 11 is a display thereof, the storage unit is configured by a memory thereof, and each functional block such as the image feature amount extraction unit 23 is a central processing unit (CPU).
  • CPU central processing unit
  • the medical image DB 20, the diagnostic image, and the suspected lesion area image 27 are realized by the external storage device or the like.
  • the image feature quantity extraction unit 23 is shown as three blocks, but these are functional blocks that execute the same process of extracting the feature quantity from each input target image.
  • the middle block of the three blocks corresponds to step S203 in FIG. 2, which will be described later, the right block corresponds to step S302 in FIG. 3, and the left block corresponds to step S502 in FIG.
  • FIG. 2 is a flowchart showing an operation process of extracting an image feature amount by learning an image feature label and learning of a suspected lesion region malignancy estimation using the extracted image feature amount for a suspected lesion region image. . These operation processes are executed by the image feature label learning unit 21, the image feature amount extraction unit 23, and the suspected lesion area malignancy learning unit 24.
  • the image feature label learning unit 21 receives information on a suspected lesion region image and the corresponding image feature label from the medical image DB 20.
  • the image feature label refers to the type of image feature related to the suspected lesion area, such as the size of the area of the shadow area, the brightness, the presence / absence of contact with the surrounding existing structure, the occurrence site, and the shape.
  • FIG. 6 shows image feature labels 61 to 66 as an example of such image feature labels of the suspicious lesion area.
  • the image feature label learning unit 21 performs machine learning for classifying the image feature labels 70, and generates learning parameters thereof.
  • the CNN Convolutional Neural Network
  • FIG. 7 shows an example of the configuration of a learning device (network) using the CNN method.
  • an input learning image is identified by repeating a convolution layer 71 that performs a number of image filtering processes and a pooling layer 72 that samples from the output of the convolution layer. It is possible to automatically generate an image feature amount that optimally expresses the feature of the image, that is, as accurately as possible.
  • the last layer of the CNN network configuration shown in FIG. 7 is an identification layer (Classification layerer) 73.
  • the probability (score) that an input image belongs to a preset type (class) is calculated and the result (Result) ) 74, that is, a process of classifying (identifying) the input image.
  • six types of image feature labels 61 to 66 shown in FIG. 6 are set so as to identify large area area, small area area, sternal contact type, luminance intensity, luminance intensity, and tubular. It is also possible to change settings such as the type of image feature label and the number of types depending on the feature of the target image in the suspected lesion area.
  • a CNN network is set for each class of the image feature label 70.
  • Input learning images for learning each CNN network are positive sample data that is an image belonging to the image feature label class and negative sample data that is an image belonging to another image feature label class. That is, the image feature label learning unit 21 sets a CNN network for each class of image feature labels.
  • the image feature label learning parameter storage unit 22 acquires the parameters of each convolution layer 71, the pooling layer 72, and the identification layer 73 from the image feature label learning unit 21, and uses them as image feature label learning parameters. save.
  • the image feature label learning parameter is a parameter related to the configuration of a convolution layer or a pooling layer in a known CNN method, for example, the total number of convolution layers or pooling layers (2 in the case of FIG. 7) or a convolution operation. It is a parameter such as the coefficient and size of the convolution filter of time.
  • the purpose of identifying the type of the image feature label 70 is to extract the image feature amount of the highly unique lesion suspicious area image in a form that can be automatically adjusted with high accuracy.
  • FIG. 8 shows an example of image feature amount extraction processing of a suspected lesion area image by the image feature amount extraction unit 23.
  • the image feature quantity extraction unit 23 receives the image feature label learning parameters from the image feature label learning parameter storage unit 22, and samples them from the convolution layer 81 shown in FIG. 8 and the output of the convolution layer.
  • An image feature amount of the input suspicious region image 80 is extracted using a CNN network constituted by repetition of a pooling layer 82 and a classification layer 83.
  • an output vector of any pooling layer 82 of the CNN network or an identification score vector obtained by concatenating results (Result) 84 that are identification scores of networks of each class may be used as the image feature amount.
  • a vector concatenated with the output vector of the pooling layer 72 and the identification score vector may be used.
  • the image feature amount extraction unit 23 can identify the type of the image feature label related to the suspected lesion region image using the learning parameter.
  • the suspected lesion malignancy learning unit 24 generates an estimated parameter of the suspected lesion malignancy using machine learning in order to calculate the malignancy of the suspected lesion region.
  • the suspected lesion area malignancy learning unit 24 receives the image feature amount of the suspected lesion area image obtained by the processing of FIG. 8 from the image feature amount extraction unit 23. Further, the suspected lesion area malignancy learning unit 24 acquires malignancy information corresponding to the suspected lesion area image from the medical image DB 20.
  • the suspicious lesion area malignancy learning unit 24 creates a learning device that estimates the suspicious area malignancy using the image feature amount of the suspicious area image and the corresponding malignancy information.
  • the suspected lesion malignancy estimation parameter storage unit 25 receives and stores the suspected lesion malignancy estimation parameter from the suspected lesion malignancy learning unit 24.
  • the lesion suspicious area malignancy estimation parameter is a parameter in a known machine learning method such as the SVM method.
  • the parameter is a boundary line or a boundary surface for classification, for example, a straight line.
  • step S ⁇ b> 301 the image feature quantity extraction unit 23 receives a diagnostic image and a lesion suspected area image 27.
  • step S302 the image feature amount extraction unit 23 receives the image feature label learning parameter from the image feature label learning parameter storage unit 22, and extracts the image feature amount of the input suspicious region image using the CNN network. This is the same process as the process of FIG. 8 described in step S203.
  • the suspected lesion malignancy estimation unit 26 receives the suspected lesion malignancy estimation parameter stored in the suspected lesion malignancy estimation parameter storage unit 25. Further, the suspected lesion area malignancy estimation unit 26 receives the image feature amount of the suspected lesion area image previously extracted from the image feature amount extraction unit 23. The suspected lesion area malignancy estimation unit 26 calculates the malignancy of the suspected lesion area in the suspected lesion area image using the suspected lesion area malignancy estimation parameter.
  • the display unit 11 receives the diagnostic image, the suspected lesion area image 27, and the corresponding suspected lesion area malignancy, and displays them as the diagnosis result of the image processing apparatus. When there are a plurality of suspected lesion area images, they can be ranked and displayed based on the malignancy estimation result. A detailed display method will be described later using the display screen example shown in FIG.
  • step S401 the image feature label learning update unit 28 receives a displayed suspicious lesion area image.
  • step S ⁇ b> 402 the image feature label learning update unit 28 receives from the user input unit 10 an image feature label corresponding to the suspected lesion region image input by the user.
  • the image feature label learning update unit 28 determines whether to update the image feature amount extraction process. For example, when the image feature label learning update unit 28 acquires a predetermined number of suspected lesion area images, the image feature amount extraction processing may be updated. Further, the image feature amount extraction process may be updated when a predetermined accumulation period has elapsed. Further, the image feature amount extraction process may be updated in accordance with a user instruction. That is, when the image feature label learning update unit 28 acquires a predetermined number of suspected lesion area images, when the acquired suspected lesion area image has passed a predetermined accumulation period, or when a user instruction is input from the user input unit 10 If it has been done, the image feature quantity extraction unit 23 updates the image feature quantity extraction process.
  • the image feature label learning update unit 28 receives the image feature label learning parameter from the image feature label learning parameter storage unit 22.
  • the image feature label learning update unit 28 updates the learning parameters of the CNN network related to the image feature label.
  • the image feature label learning parameter storage unit 22 receives and stores the updated image feature label learning parameter. This makes it possible to automatically adjust the image feature amount extraction process more appropriately for a new lesion-suspicious area image.
  • the image feature amount extraction unit 23 can extract the image feature amount of the suspicious lesion region image again using the image feature label learning parameter updated by the image feature label learning update unit 28.
  • the image processing apparatus includes the suspected lesion malignancy learning update unit 29 that updates the suspected lesion malignancy estimation parameter in accordance with the input from the user input unit 10 for each suspected lesion image. ing.
  • the suspected lesion malignancy learning update unit 29 receives from the user input unit 10 correctness / incorrectness information of malignancy corresponding to the displayed suspected lesion region image input by the user.
  • the image feature amount extraction unit 23 receives the displayed suspicious lesion region image, further receives the image feature label learning parameter from the image feature label learning parameter storage unit 22, and uses the CNN network to input the lesion. Extract the image feature amount of the suspicious area image. This is the same processing as step S203.
  • the lesion suspicious area malignancy learning update unit 29 receives the extracted image feature amount.
  • the suspicious lesion malignancy learning update unit 29 determines whether to update the suspected lesion malignancy.
  • the suspected lesion area malignancy may be updated. Further, the suspected lesion area malignancy may be updated after a predetermined accumulation period. Further, the suspicious lesion area malignancy may be updated in accordance with a user instruction.
  • the suspected lesion malignancy learning update unit 29 receives the suspected lesion malignancy estimation parameter storage unit 25 from the suspected lesion malignancy estimation parameter storage unit 25.
  • the suspected lesion malignancy learning update unit 29 performs learning again in order to calculate a new lesion suspected region malignancy estimation parameter.
  • a known online learning method may be used.
  • the suspected lesion malignancy estimation parameter storage unit 25 receives and stores the updated suspected lesion malignancy estimation parameter.
  • the suspected lesion malignancy estimation unit 26 receives the updated lesion suspected region malignancy estimation parameter, updates the malignancy estimation result regarding the displayed suspected lesion region image, and displays the result. Output to. That is, in the image processing apparatus of the present embodiment, the suspected lesion area malignancy estimation unit 26 uses the suspected lesion area malignancy learning update unit 29 to update the suspected lesion area image. The malignancy of the suspicious area is estimated and displayed again.
  • FIG. 9 shows an example of a user interface 91 that displays diagnostic images, diagnosis results using the image processing apparatus 100, image feature label presentation for user input, malignancy correctness information, and the like.
  • the display unit 11 receives the diagnostic image and the suspected lesion area image 27. Further, the display unit 11 receives image feature labels corresponding to the respective suspected lesion area images from the image feature amount extraction unit 23. Further, the display unit 11 receives from the suspected lesion malignancy estimation unit 26 the malignancy estimation result and the estimated score corresponding to each suspected lesion image.
  • the user interface 91 displays a diagnostic image, a suspected lesion area image area 92, an image feature label presentation selection area 94, a malignancy degree correct / incorrect information selection area 95, and the like.
  • the diagnostic image and suspected lesion area image area 92 of the user interface 91 display a diagnostic image and a suspected lesion area image. At that time, it is possible to rank and display the suspected lesion region images using the malignancy estimation result. That is, the display unit 11 displays the image data, the suspected lesion area image, and the identification result of the image feature label corresponding to the suspected lesion area image, ranks the estimated score of the suspected lesion area malignancy, It is possible to rearrange the suspected lesion region images in descending order of malignancy. In addition, a location corresponding to the selected suspicious lesion image 93 can be displayed on the diagnostic image using a mark or the like.
  • the image feature label presentation selection area 94 of the user interface 91 displays an image example of a predetermined image feature label, presents an image feature label corresponding to the selected suspicious lesion region image, and selects it for the image feature user. Or can be modified.
  • the user interface 91 can display the image of the image feature label and the identification result of the image feature label corresponding to the suspected lesion area image, and allow the user to select the correct image feature label corresponding to the suspected lesion area image. Therefore, a check box is arranged below a predetermined image feature label displayed in the image feature label presentation selection area 94.
  • the malignancy correctness / incorrectness information selection area 95 of the user interface 91 the correctness / incorrectness information TP, FP, TN, FN of the malignancy corresponding to the selected suspicious lesion region image is displayed, and the user can select any one of four types. Can be selected. That is, the user interface 91 can allow the user to select correct / incorrect information corresponding to the suspected lesion area image.
  • the user interface 91 can allow the user to add a new image feature label in addition to the predetermined image feature label displayed in the image feature label presentation selection area 94.
  • the user interface 91 can cause the user to newly add a suspected lesion area image in addition to a suspected lesion area image, and select an image feature label and correct / incorrect information corresponding to the image.
  • the image feature label learning unit 21 of the image processing apparatus adds the type of the image feature label according to the image feature label newly added from the user input unit 10 regarding the suspected lesion area image, Learning parameters can be updated.
  • the user can add a new suspected lesion area image by using the diagnostic image and the diagnostic image displayed in the suspected lesion area image area 92, and can select malignancy correctness / incorrectness information corresponding thereto. .
  • the image processing apparatus 100 does not include a medical image capturing apparatus.
  • the image processing apparatus 100 may include a medical image capturing apparatus, and the image processing apparatus 100 is one of the medical image capturing apparatuses. It may function as a part.
  • image processing that enables adjustment of the extraction process of the image feature amount of the lesion shadow and can reduce the burden on the interpreter who is the user when interpreting a large amount of three-dimensional medical images.
  • An apparatus and a medical image photographing apparatus can be provided.
  • a user in addition to a predetermined image feature label, a user defines and adds a new image feature label, and further adds a suspected lesion area image corresponding to the newly added image feature label to the image DB.
  • It is an Example of an image processing apparatus provided with DB update part.
  • FIG. 10 shows an example of a system configuration including the image processing apparatus according to the second embodiment.
  • the image processing apparatus 100 includes a user input unit 10, an image feature label learning unit 21, an image feature label learning parameter storage unit 22, an image feature amount extraction unit 23, and a suspected lesion.
  • step S601 the medical image DB update unit 30 receives the displayed suspected lesion area image.
  • step S ⁇ b> 602 the medical image DB update unit 30 receives an image feature label corresponding to the suspected lesion region image added by the user from the user input unit 10.
  • step S ⁇ b> 603 the suspected lesion malignancy learning update unit 29 receives from the user input unit 10 correctness / wrongness information of malignancy corresponding to the displayed lesion suspected region image input by the user.
  • step S ⁇ b> 604 the medical image DB update unit 30 updates the medical image DB 20 using the displayed diagnostic image, suspected lesion area image, and a newly added image feature label corresponding thereto.
  • step S605 it is determined whether to update the image feature amount extraction process.
  • the image feature amount extraction processing may be updated when the medical image DB update unit 30 acquires a predetermined number of images. Further, the image feature amount extraction process may be updated when a predetermined accumulation period has elapsed. Further, the image feature amount extraction process may be updated in accordance with a user instruction.
  • the image feature label learning unit 21 performs machine learning for classifying the image feature label including the added image feature label, and sets the learning parameter. Generate. This is the same as the processing in step S202.
  • the learning of the image feature label in step S606 may use a network configuration using the CNN method shown in FIG. Further, the network configuration shown in FIG. 12 may be used. That is, as shown in the network configuration of FIG. 12, for each class of image feature label 120, one multi-class image feature using one convolution layer 121, pooling layer 122, identification layer 123, and result 124. A CNN network for identifying the label may be set.
  • a user in addition to a predetermined image feature label, a user defines and adds a new image feature label to new clinical data, and further, a lesion suspected region image corresponding to the newly added image feature label Can be added to the image DB.
  • this invention is not limited to the above-mentioned Example, Various modifications are included.
  • the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described.
  • a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment.
  • each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit.
  • Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor.
  • Information such as programs, tables, and files for realizing each function can be stored in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.
  • An image processing apparatus that presents a suspected lesion image detected from image data, An image feature amount extraction unit that extracts an image feature amount of the suspected lesion region image using a learning parameter of the image feature label obtained by learning for classifying image feature labels related to the suspected lesion region image; Using the image feature amount extracted by the image feature amount extraction unit, using the parameter for estimating the malignancy level of the suspected lesion area obtained by learning for estimating the malignancy level of the suspected lesion area, the malignancy of the suspected lesion area A suspected lesion malignancy estimation unit for calculating An image processing apparatus comprising:
  • Example 2 An image processing apparatus described in Example 1, A display unit for displaying a suspected lesion image; A user input section; An image feature label learning update unit that updates the learning parameter in response to an input from the user input unit; An image processing apparatus.
  • Example 3 An image processing apparatus described in Example 2, When the image feature label learning update unit has acquired a predetermined number of suspected lesion area images, or when the acquired suspected lesion area image has passed a predetermined accumulation period, or when the user's instruction is input, The image feature amount extraction unit updates the image feature amount extraction process. An image processing apparatus.
  • Example 4 An image processing apparatus described in Example 2, The image feature label is a type of image feature related to the suspected lesion area. An image processing apparatus.
  • Example 5 An image processing apparatus described in Example 4, The image feature label is the size of the shadow area of the suspected lesion area, the brightness, the presence or absence of contact with the surrounding existing structure, the occurrence site, and the shape. An image processing apparatus.
  • An image processing method of an image processing apparatus for presenting a suspected lesion area image detected from image data The image processing device Learning to classify image feature labels related to the suspected lesion image, Using the learning parameter of the image feature label obtained by the learning, extract the image feature amount of the suspected lesion image, Using the extracted image feature amount, learn the suspicious lesion malignancy for estimating the malignancy of the suspicious region, Using the lesion suspicious area malignancy estimation parameter obtained by learning the lesion suspicious area malignancy, calculating the malignancy of the suspected lesion area, An image processing method.
  • Example 7 An image processing method described in Example 6,
  • the image feature label is the size of the area of the shadow region, which is the type of the image feature related to the suspected lesion region, the brightness, the presence or absence of contact with the surrounding existing structure, the occurrence site, or the shape.
  • An image processing method is the size of the area of the shadow region, which is the type of the image feature related to the suspected lesion region, the brightness, the presence or absence of contact with the surrounding existing structure, the occurrence site, or the shape.
  • Example 8 An image processing method described in Example 6,
  • the image processing apparatus includes a display unit and a user input unit, Displaying the suspected lesion area image and the malignancy of the suspected lesion area on the display unit; Updating the learning parameter in response to an input from the user input unit; An image processing method.
  • Example 9 An image processing method described in Example 8, When the image processing apparatus acquires a predetermined number of suspected lesion area images, when the acquired suspected lesion area image has passed a predetermined accumulation period, or when an instruction from the user is input, the image feature Update quantity extraction process, An image processing method.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Engineering & Computer Science (AREA)
  • Radiology & Medical Imaging (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Analysis (AREA)
PCT/JP2017/035787 2016-10-14 2017-10-02 画像処理装置、及び画像処理方法 Ceased WO2018070285A1 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-202782 2016-10-14
JP2016202782A JP2018061771A (ja) 2016-10-14 2016-10-14 画像処理装置、及び画像処理方法

Publications (1)

Publication Number Publication Date
WO2018070285A1 true WO2018070285A1 (ja) 2018-04-19

Family

ID=61905580

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/035787 Ceased WO2018070285A1 (ja) 2016-10-14 2017-10-02 画像処理装置、及び画像処理方法

Country Status (2)

Country Link
JP (1) JP2018061771A (https=)
WO (1) WO2018070285A1 (https=)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020035991A1 (ja) * 2018-08-14 2020-02-20 キヤノン株式会社 医用情報処理装置及び医用情報処理方法、プログラム
JP2020062340A (ja) * 2018-10-19 2020-04-23 キヤノンメディカルシステムズ株式会社 画像処理装置及びプログラム
WO2020099986A1 (ja) * 2018-11-15 2020-05-22 株式会社半導体エネルギー研究所 コンテンツの分類方法
CN112334070A (zh) * 2018-06-28 2021-02-05 富士胶片株式会社 医用图像处理装置和方法、机器学习系统、程序以及存储介质
CN112862741A (zh) * 2019-11-12 2021-05-28 株式会社日立制作所 医用图像处理装置及医用图像处理方法、医用图像处理程序
CN116645485A (zh) * 2023-06-02 2023-08-25 中交一公局第二工程有限公司 一种基于无人机倾斜摄影的古建筑模型构建方法
US11914918B2 (en) 2018-08-14 2024-02-27 Canon Kabushiki Kaisha Medical information processing apparatus, medical information processing method, and non-transitory computer-readable storage medium

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7321671B2 (ja) 2018-04-20 2023-08-07 キヤノン株式会社 情報処理装置、情報処理方法、情報処理システムおよびプログラム
EP3564961A1 (en) 2018-05-03 2019-11-06 Koninklijke Philips N.V. Interactive coronary labeling using interventional x-ray images and deep learning
EP3806746B1 (en) * 2018-06-14 2022-03-02 Kheiron Medical Technologies Ltd Second reader suggestion
JP7210175B2 (ja) * 2018-07-18 2023-01-23 キヤノンメディカルシステムズ株式会社 医用情報処理装置、医用情報処理システム及び医用情報処理プログラム
WO2020110774A1 (ja) 2018-11-30 2020-06-04 富士フイルム株式会社 画像処理装置、画像処理方法、及びプログラム
JP7127785B2 (ja) * 2018-11-30 2022-08-30 オリンパス株式会社 情報処理システム、内視鏡システム、学習済みモデル、情報記憶媒体及び情報処理方法
JP7170868B2 (ja) * 2019-06-28 2022-11-14 富士フイルム株式会社 学習装置、方法およびプログラム、医用画像処理装置、方法およびプログラム、並びに判別器
JP7394588B2 (ja) * 2019-11-07 2023-12-08 キヤノン株式会社 情報処理装置、情報処理方法、および撮像システム
US12394511B2 (en) 2019-11-18 2025-08-19 Fujifilm Healthcare Americas Corporation Methods and systems for remote analysis of medical image records
JP7408361B2 (ja) 2019-11-29 2024-01-05 富士フイルムヘルスケア株式会社 医用画像診断支援システム及び医用画像処理装置、医用画像処理方法
WO2022112165A1 (en) * 2020-11-30 2022-06-02 Koninklijke Philips N.V. Switching between neural networks based on scout scan analysis
KR102358050B1 (ko) * 2020-12-23 2022-02-08 주식회사 뷰노 의료 영상 기반의 병변 분석 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007527743A (ja) * 2004-02-03 2007-10-04 シーメンス　メディカル　ソリューションズ　ユーエスエー　インコーポレイテッド 心臓関連の病気及び状態のための自動診断及び意思決定支援用システム及び方法
JP2014534822A (ja) * 2011-10-14 2014-12-25 富士フイルム株式会社 モデルに基づいた冠動脈のカルシウムスコアリング
JP2015116319A (ja) * 2013-12-18 2015-06-25 パナソニックＩｐマネジメント株式会社 診断支援装置、診断支援方法、および診断支援プログラム
JP2016007270A (ja) * 2014-06-23 2016-01-18 東芝メディカルシステムズ株式会社 医用画像処理装置
JP2016016265A (ja) * 2014-07-10 2016-02-01 株式会社東芝 画像処理装置、画像処理方法及び医用画像診断装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007527743A (ja) * 2004-02-03 2007-10-04 シーメンス　メディカル　ソリューションズ　ユーエスエー　インコーポレイテッド 心臓関連の病気及び状態のための自動診断及び意思決定支援用システム及び方法
JP2014534822A (ja) * 2011-10-14 2014-12-25 富士フイルム株式会社 モデルに基づいた冠動脈のカルシウムスコアリング
JP2015116319A (ja) * 2013-12-18 2015-06-25 パナソニックＩｐマネジメント株式会社 診断支援装置、診断支援方法、および診断支援プログラム
JP2016007270A (ja) * 2014-06-23 2016-01-18 東芝メディカルシステムズ株式会社 医用画像処理装置
JP2016016265A (ja) * 2014-07-10 2016-02-01 株式会社東芝 画像処理装置、画像処理方法及び医用画像診断装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
NOMURA, YUKIHIRO ET AL.: "CIRCUS: an MDA platform for clinical image analysis in hospitals", TRANSACTIONS ON MASS-DATA ANALYSIS OF IMAGES AND SIGNALS, vol. 2, no. 1, September 2010 (2010-09-01), pages 112 - 127, XP055502121 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12009104B2 (en) 2018-06-28 2024-06-11 Fujifilm Corporation Medical image processing apparatus, medical image processing method, machine learning system, and program
CN112334070A (zh) * 2018-06-28 2021-02-05 富士胶片株式会社 医用图像处理装置和方法、机器学习系统、程序以及存储介质
CN112334070B (zh) * 2018-06-28 2024-03-26 富士胶片株式会社 医用图像处理装置和方法、机器学习系统以及存储介质
WO2020035991A1 (ja) * 2018-08-14 2020-02-20 キヤノン株式会社 医用情報処理装置及び医用情報処理方法、プログラム
US12131235B2 (en) 2018-08-14 2024-10-29 Canon Kabushiki Kaisha Medical information processing apparatus, medical information processing method, and non-transitory computer-readable storage medium
US11914918B2 (en) 2018-08-14 2024-02-27 Canon Kabushiki Kaisha Medical information processing apparatus, medical information processing method, and non-transitory computer-readable storage medium
JP7325942B2 (ja) 2018-10-19 2023-08-15 キヤノンメディカルシステムズ株式会社 画像処理装置及びプログラム
JP2020062340A (ja) * 2018-10-19 2020-04-23 キヤノンメディカルシステムズ株式会社 画像処理装置及びプログラム
JPWO2020099986A1 (ja) * 2018-11-15 2021-11-04 株式会社半導体エネルギー研究所 コンテンツの分類方法
WO2020099986A1 (ja) * 2018-11-15 2020-05-22 株式会社半導体エネルギー研究所 コンテンツの分類方法
US12387146B2 (en) 2018-11-15 2025-08-12 Semiconductor Energy Laboratory Co., Ltd. Content classification method
CN112862741A (zh) * 2019-11-12 2021-05-28 株式会社日立制作所 医用图像处理装置及医用图像处理方法、医用图像处理程序
CN116645485A (zh) * 2023-06-02 2023-08-25 中交一公局第二工程有限公司 一种基于无人机倾斜摄影的古建筑模型构建方法
CN116645485B (zh) * 2023-06-02 2024-02-27 中交一公局第二工程有限公司 一种基于无人机倾斜摄影的古建筑模型构建方法

Also Published As

Publication number Publication date
JP2018061771A (ja) 2018-04-19

Similar Documents

Publication Publication Date Title
WO2018070285A1 (ja) 画像処理装置、及び画像処理方法
US11850021B2 (en) Dynamic self-learning medical image method and system
US11250048B2 (en) Control method and non-transitory computer-readable recording medium for comparing medical images
US10222954B2 (en) Image display apparatus, display control apparatus and display control method using thumbnail images
JP6318739B2 (ja) 画像処理装置、およびプログラム
US20170308661A1 (en) Diagnosis support apparatus and method of controlling the same
JP5661890B2 (ja) 情報処理装置、情報処理方法及びプログラム
JP6824845B2 (ja) 画像処理システム、装置、方法およびプログラム
JP2013192624A (ja) 医用画像診断支援装置、医用画像診断支援方法ならびにコンピュータプログラム
US11836923B2 (en) Image processing apparatus, image processing method, and storage medium
JP6362061B2 (ja) 診断支援システム、その作動方法、およびプログラム
CN113496478B (zh) 医学影像辨识方法及医学影像辨识装置
JP4911029B2 (ja) 異常陰影候補検出方法、異常陰影候補検出装置
JP7413011B2 (ja) 医用情報処理装置
CN104507392A (zh) 图像处理装置及图像处理方法
US10307124B2 (en) Image display device, method, and program for determining common regions in images
CN117015799A (zh) 检测x射线图像中的异常
JP2007151645A (ja) 医用画像診断支援システム
JP6309417B2 (ja) 検出器生成装置、方法およびプログラム並びに画像検出装置
JP7807656B2 (ja) 画像識別プログラム、画像識別方法、画像識別装置および情報処理システム
CN114271837B (zh) 图像诊断辅助装置和图像处理方法
Lensink et al. Segmentation of pulmonary opacification in chest ct scans of covid-19 patients
JP5533198B2 (ja) 医用画像表示装置及びプログラム
WO2021246013A1 (ja) 画像診断方法、画像診断支援装置、及び計算機システム
JP6313741B2 (ja) 画像処理装置及び画像処理装置の作動方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17860923

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17860923

Country of ref document: EP

Kind code of ref document: A1