US10930385B2 - Report generation support apparatus and report reading apparatus - Google Patents
Report generation support apparatus and report reading apparatus Download PDFInfo
- Publication number
- US10930385B2 US10930385B2 US14/483,984 US201414483984A US10930385B2 US 10930385 B2 US10930385 B2 US 10930385B2 US 201414483984 A US201414483984 A US 201414483984A US 10930385 B2 US10930385 B2 US 10930385B2
- Authority
- US
- United States
- Prior art keywords
- image
- display
- medical image
- report
- support apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 230000002596 correlated effect Effects 0.000 claims description 40
- 230000000875 corresponding effect Effects 0.000 claims description 39
- 239000000284 extract Substances 0.000 claims description 18
- 238000009966 trimming Methods 0.000 claims description 8
- 230000011218 segmentation Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 30
- 238000000034 method Methods 0.000 description 23
- 230000008569 process Effects 0.000 description 19
- 238000002059 diagnostic imaging Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 238000002591 computed tomography Methods 0.000 description 3
- 238000003708 edge detection Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000003902 lesion Effects 0.000 description 3
- 238000002595 magnetic resonance imaging Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 206010028980 Neoplasm Diseases 0.000 description 1
- 208000007536 Thrombosis Diseases 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H15/00—ICT specially adapted for medical reports, e.g. generation or transmission thereof
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/032—Transmission computed tomography [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/46—Arrangements for interfacing with the operator or the patient
- A61B6/461—Displaying means of special interest
- A61B6/463—Displaying means of special interest characterised by displaying multiple images or images and diagnostic data on one display
Definitions
- the embodiments of the present invention relate to a report generation support apparatus and a report reading apparatus.
- the medical industry is subdivided into specialized fields. Therefore, it is widely carried out to ask medical specialists (physicians) to interpret medical images obtained by medical imaging apparatuses (X-ray CT apparatus, MRI apparatus, and the like).
- medical imaging apparatuses X-ray CT apparatus, MRI apparatus, and the like.
- the physician performs, as checking medial images of interpret targets, collecting findings therefrom to generate a diagnostic report.
- a report generation apparatus is used to generate the diagnostic report.
- the physician checks the medial images displayed on a display of the report generation apparatus, and finds a finding to generate the diagnostic report. The physician then inputs the findings to a finding input field displayed on the display.
- the physician correlates the medical image used for the determination of the finding (hereinafter, it may be referred to as a “key image”) with the diagnostic report.
- the part to be the ground of the finding is a lesion site, such as a thrombus, a tumor, for example.
- the physician performs an operation for adding a shape, such as a circle and a polygon, called an annotation, to the key image.
- the physician additionally generates an attention image showing the attention site, apart from the medical image obtained from the medical imaging apparatus.
- the physician also correlates the attention image, as well as the key image, with the diagnostic report. It is complicated for the physician to implement the work for generating the attention image and correlating the image with the diagnostic report for every interpretation. Further, it had been a problem that this work results deterioration of interpretation efficiency.
- the present embodiments are intended to solve the above mentioned problem, and the object is to provide a report generation support apparatus and a report reading apparatus which are able to easily generate a diagnostic report.
- FIG. 1 It is an overall view of a medical information system according to a first embodiment.
- FIG. 2 It is a diagram illustrating a report generation apparatus according to the first embodiment.
- FIG. 3A It is a diagram illustrating an example of medical images according to the first embodiment.
- FIG. 3B It is a diagram illustrating an example of the medical images according to the first embodiment.
- FIG. 3C It is a diagram illustrating an example of the medical images according to the first embodiment.
- FIG. 3D It is a diagram illustrating an example of the medical images according to the first embodiment.
- FIG. 3E It is a diagram illustrating an example of the medical images according to the first embodiment.
- FIG. 3F It is a schematic diagram schematically illustrating an operation for correlating an expanded image with a diagnostic report.
- FIG. 3G It is a schematic diagram schematically illustrating a process for correlating the expanded image with the diagnostic report.
- FIG. 3H It is a schematic diagram schematically illustrating another process for correlating the expanded image with the diagnostic report.
- FIG. 4A It is a diagram illustrating another example of the medical images according to the first embodiment.
- FIG. 4B It is a diagram illustrating another example of the medical images according to the first embodiment.
- FIG. 4C It is a diagram illustrating another example of the medical images according to the first embodiment.
- FIG. 4D It is a diagram illustrating another example of the medical images according to the first embodiment.
- FIG. 4E It is a diagram illustrating another example of the medical images according to the first embodiment.
- FIG. 4F It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 4G It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 4H It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 4I It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 4J It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 4K It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 4L It is a schematic diagram illustrating an outline of a medical image and an expanded image to be displayed with the diagnostic report.
- FIG. 5 It is a flowchart illustrating an operation of the report generation apparatus according to the first embodiment.
- FIG. 6 It is a diagram illustrating an example of medical images according to a modified example.
- FIG. 7 It is an overall view of a medical information system according to a second embodiment.
- FIG. 8 It is a diagram illustrating a report reading apparatus according to the second embodiment.
- FIG. 9 It is a flowchart illustrating an operation of the report reading apparatus according to the second embodiment.
- the report generation support apparatus of the embodiments comprises a display, a specifying part, and a generator.
- the display configures to display a diagnostic report and a first medical image.
- the specifying part configures to specify a predetermined region or a predetermined position in the first medical image displayed on the display.
- the generator configures to generate a second medical image, based on the predetermined region or position specified by the specifying part, as well as the first medical image.
- a medical information system 1 comprises a medical imaging apparatus 2 , a medical image archive apparatus 3 , the report generation apparatus 4 , and a report archive apparatus 5 .
- These apparatuses are communicatably connected each other via a network N, such as LAN (Local Area Network).
- the communication between those apparatuses may conform to DICOM (Digital Imaging and Communications in Medicine) which is the medical image standard. Other standard rules, however, may be applied as the communication therebetween.
- TCP/IP Transmission Control Protocol/Internet Protocol
- data is transferred between those apparatuses by packet (basic unit for transferring information) communication via the network N.
- the medical imaging apparatus 2 is, for example, an X-ray imaging apparatus, an X-ray CT (Computed Tomography) apparatus, a MRI (Magnetic Resonance Imaging) apparatus, or the like.
- the medical imaging apparatus 2 images a subject, and as a result, medical images may be obtained.
- the obtained medical images are sent to the medical mage archive apparatus 3 , for example, in a file format which conforms to DICOM.
- the medical image to be send includes image correlation information accessory to the medical image, such as the date the image is obtained, imaging conditions, and the like. “Image” and “image data” correspond one to one, so that these may be treated as the same thing in the present embodiment.
- the image archive apparatus 3 is an apparatus to archive the medical images sent from the medical imaging apparatus 2 .
- the medical archive apparatus 3 is a so-called computer, and comprises inside a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Read Only Memory), and mass storing devices, and the like. The drawings of those CPU, ROM, RAM, and storing devices are omitted.
- the report generation apparatus 4 records findings related to the medical image displayed on a display 43 (described later), based on an instruction from the physician, and the like.
- the report generation apparatus 4 also generates a diagnostic report. The detail description of the report generation apparatus 4 will be described later.
- the report archive apparatus 5 archives the diagnostic reports generated by the report generation apparatus 4 and the medical images (key images) referred when the diagnostic reports are generated.
- the report archive apparatus 5 is a so-called computer, and comprises inside a CPU, ROM, RAM, mass storing devices, and the like. Drawings of those CPU, ROM, RAM, and mass storing devices are omitted.
- the medical image archive apparatus 3 and the report archive apparatus 5 may be configured as a single apparatus. Otherwise, the report generation apparatus 4 and the report archive apparatus 5 may be configured as a single apparatus.
- FIG. 2 is a block diagram illustrating the detail description of the report generation apparatus 4 according to the present embodiment.
- the report generation apparatus 4 comprises an input part 41 , a CPU 42 , and the display 43 .
- the input part 41 in the report generation apparatus 4 is used to input various instructions.
- the input device 41 is, for example, a keyboard, a mouse, a trackball, a joystick, or the like.
- GUI Graphic User Interface
- the input part 41 includes a pointing device which is able to designate at least any position within a medical image.
- the CPU 42 functions as an acquiring part 421 , a report generator 422 , a processer 423 , a correlating part 424 , and a display controller 425 .
- the acquiring part 421 acquires medical images from the medical image archive apparatus 3 .
- the medical images are referred when the physician and the like generate a diagnostic report.
- the acquiring part 421 reads the medical images corresponding to the test ID from the medical image archive apparatus 3 .
- the report generator 422 causes content of findings to display in a finding input field displayed on the display 43 , based on the instruction from the input part 41 or the like. Specifically, when the input part 41 is a keyboard, the report generator 422 records the character corresponding to the character key pressed by the physician, in the finding input field, as electric data. The report generator 422 then reflects the data of the recorded character to the finding input field.
- the processor 423 implements various kinds of processing on the medical image obtained by the acquiring part 421 .
- the processor 423 in the present embodiment comprises an annotation part 423 a , a specifying part 423 b , an extracting part 423 c , and an expanding part 423 d .
- the expanding part 423 d corresponds to an example of a “generator”.
- the annotation part 423 a adds annotations to the medical image displayed on the display 43 , based on the instruction from the input part 41 or the like.
- An annotation is, for example, a shape, such as an arrow pointing an attention site (lesion site, and the like), a circle, an ellipse, and a polygon surrounding the attention site, and a line drawn by freehand, delineated on the medical image.
- the physician selects an annotation of a circle shape, and instructs to surround the attention site in the medical image using the input part 41 , such as a mouse.
- the annotation part 423 a causes an annotation A of the circle shape to be displayed on the target part in the medical image (see FIG. 3A ).
- a plural number of annotations may be added to a single medical image.
- the specifying part 423 b specifies an image region in the medical image displayed on the display 43 . Any well-known methods may be used to specify the image region. A specific example is described with reference to FIG. 3A .
- the specifying part 423 b detects a circumference (perimeter) of the annotation A by implementing edge detection processing or the like for the medical image to which the annotation A has been added.
- the specifying part 423 b also specifies the circumference and a part (plane) within the circumference, as an image region.
- the specifying part 423 b implements the above mentioned processing to each of the annotations on each of the medical images.
- the processing by the specifying part 423 b may be started by the instruction from the input part 41 or the like. Otherwise, the processing may be started automatically in accordance with detection by the specifying part 423 b , the detection being the detecting the addition of the annotation to the medical image.
- the image region is not limited to the plane mentioned in the specific example.
- the image region may be any of a point, a line, and a solid. That is, the image region may be any of zero-dimensional (point) to three-dimensional (solid) shapes.
- the specifying part 423 b may specify a part indicating the tip-end of the arrow (point P; see in FIG. 4B ), as the image region.
- the image region specified by the specifying part 423 b dose not have to include the all of the annotations.
- the specifying part 423 b may specify the designated range as the image region.
- the image region described above corresponds to an example of a “predetermined region” or a “predetermined position”.
- the extracting part 423 c extracts an image of a predetermined range including the image region specified by the specifying part 423 b .
- a predetermined range including the image region specified by the specifying part 423 b .
- the extracting part 423 c determines a rectangle R (quadrangle in the embodiment) circumscribing to the specified image region (see FIG. 3B ).
- the extracting part 423 c determines the range expanded by a predetermined length evenly from each vertex of the rectangle R, as a predetermined range PR (see FIG. 3C ).
- the extracting part 423 c extracts the image of the predetermined range PR by trimming (see FIG. 3D ).
- the range expanded from the predetermined range PR or the rectangle R may be set with a predetermined value in advance. Otherwise, those ranges may be arbitrarily set every time in accordance with the image region specified by the specifying part 423 b . Further, the range expanded from the rectangle R may not be evenly expanded from each vertex of the rectangle R.
- the extracting part 423 c implements the above mentioned processing to each of the specified image regions.
- the extracting part 423 c may cause the display 43 to display the predetermined range PR.
- This processing makes it possible for the report generation apparatus 4 to present the range to extract to the physician and the like. As a result, the physician and the like are able to understand the range to be extracted.
- the display screen for the predetermined range PR may be configured such that the physician and the like can perform edit operation thereto via the input part 41 or the like.
- the extracting part 423 c changes the predetermined range PR displayed on the display 43 . In this case, the extracting part 423 c implements extraction processing on the predetermined region PR after the change.
- the same processing as above may be processed. That is, the extracting part 423 c determines a rectangle circumscribing to the polygon or the shape drawn by freehand specified by the specifying part 423 b . The extracting part 423 c then determines the range expanded evenly from each vertex of the rectangle as a predetermined range. Lastly, the extracting part 423 c extracts the image of the predetermined range by trimming.
- the extracting part 423 c determines the range, including the specified point P (image region), expanded evenly from the point P in the predetermined directions, as a predetermined range PR′ (see FIG. 4C ). The extracting part 423 c then extracts the image of the predetermined region PR′ by trimming (see FIG. 4D ).
- the expanding part 423 d generates an expanded image corresponding to the image extracted by the extracting part 423 c .
- the generated expanded image is displayed on the display 43 .
- the expanded image may be generated based on either the medical image used to add the annotation, or the extracted image.
- the expanding part 423 d implements processing to expand the region corresponding to the predetermined range PR in the medical image. It is possible to degradation in image quality of the expanded image by generating the expanded image from the medial image.
- the expanding part 423 d expands the image at a predetermined magnification (see FIG.
- FIG. 3E by using an interpolation method which interpolates an estimated pixel between pixels forming the image, or the like.
- the image is expanded to the same size as the original medical image ( FIG. 3A ).
- a predetermined rate may be set in advance, or a rate may be set every time by an operator.
- the expanding part 423 d implements the above described processing on each extracted image (see FIG. 4E ).
- the correlating part 424 correlates the expanded image generated by the expanding part 423 d with a diagnostic report after receiving the instruction via the input part 41 .
- a specific example of the correlation processing is described with reference to FIG. 3F and FIG. 3G .
- FIG. 3F is a schematic diagram schematically illustrating an operation to correlate an expanded image M 1 with a diagnostic report RA.
- FIG. 3G is a schematic diagram schematically illustrating a process to correlate the expanded image M 1 with the diagnostic report RA.
- the correlating part 424 receives an instruction in accordance with the operation. Also, as shown in FIG. 3G , the correlating part 424 correlates, according to the instruction, the expanded image M 1 with an arbitrary part in the diagnostic report RA.
- the expanded image corresponds to an example of a “second image”. Further, the original medical image of the expanded image corresponds to an example of a “first medical image”.
- processing for “correlating an image with a diagnostic report” described above may be explained as processing which pastes image data to diagnostic report data.
- the correlating part 424 converts a DICOM image into a general-purpose file format, such as JPEG.
- the correlating part 424 then implements processing for embedding the converted image to the diagnostic report data.
- the diagnostic report and the image data of the embedded expanded image are read out.
- both the diagnostic report and the expanded image are displayed on the display of the PC or the like.
- the correlation processing by the correlating part 424 also includes processing such that the correlating part 424 correlates the expanded image with the diagnostic report and stores in a storing device or the like.
- the medical information system 1 may be configured such that the expanded image is correlated with the original medical image and stored in the medical mage archive apparatus 3 .
- the correlating part 424 correlates the image data of the expanded image with an image ID of the image data of the original medical image, or an ID (report ID, patient ID, or the like) for identifying storage positional information of the image data of the original medical image the diagnostic report, to store in the medical mage archive apparatus 3 .
- the correlating part 424 implements processing for embedding image data link information of the expanded image to the diagnostic report data.
- the diagnostic report As well as the image data link information of the expanded image are read out from the doctor's PC. In accordance with the link information, the image data is read out. Through those respective processes, the diagnostic report and the expanded image are displayed on the display of the PC or the like.
- the image data of the expanded image may be a DICOM image, or general-purpose image data, such as JPEG.
- the correlation processing by the correlating part 424 also includes processing such that the correlating part 424 correlates image processing conditions when the expanded image is generated with the diagnostic report, to store in a storing device or the like.
- the medical information system 1 may be configured such that the image processing conditions of the expanded image is correlated with the original medical image and stored in the medical mage archive apparatus 3 .
- the correlating part 424 obtains the image processing conditions of the expanded image from the expanding part 423 d or the like.
- the image processing conditions include, in the original medical image, positional information (coordinate information), resolution, magnification, conditions for the interpolation, and the like.
- the correlating part 424 also correlates the image processing conditions with the image ID or the storing positional information of the image data of the original medical image, or the ID (report ID, patient ID, or the like) for identifying the storing positional information or the diagnostic report, to store in the medical mage archive apparatus 3 . Further, the correlating part 424 implements processing for embedding link information of the image processing conditions to the diagnostic report data. When the test requesting doctor brows the diagnostic report, the diagnostic report as well as the image data of the original medical image correlated with the diagnostic report and the embedded link information of the image processing conditions of the expanded image are read out from the doctor's PC. In accordance with the link information, the image processing conditions are read out.
- the test requesting doctor's PC implements image processing for the image data of the original medical image, based on the read out image processing conditions. As a result, the PC generates image data of the expanded image. Through those respective processes, the diagnostic report and the expanded image are displayed on the display of the PC or the like.
- the image data of the expanded image is a DICOM image or the like.
- the correlating part 424 may also implements processing such as correlating the diagnostic report with expanded image position (displaying position) information, expanded image size information, as well as a display mode for the expanded image or the medial image therein.
- the correlating part 424 may correlate the expanded image M 1 as well as a medical image I which is a source of the expanded image M 1 with the diagnostic report RA. It is also possible for the correlating part 424 to correlate the other medical images or the like displayed on the display 43 with the diagnostic report. Alternatively, when a plurality of expanded images is displayed on the display 43 , it is possible for the correlating part 424 to correlate each of the expanded images with a single diagnostic report, in accordance with the operation. The display mode for the images after reading out from the test requesting doctor's PC or the like will be described later.
- the display controller 425 implements display control for the display 43 .
- the display controller 425 controls so as to cause the display 43 to display the medical image obtained by the acquiring part 421 , the diagnostic report, and the like (see FIG. 4E ).
- the display 43 is a display to display diagnostic reports and medical images.
- a dual display having two of the display 43 is used.
- the diagnostic reports are displayed on one side of the displays 43 , and the medical images are displayed on the other side thereof.
- the display 43 may be caused to display all of the medical images.
- the specifying part 423 b , the correlating part 424 , and the display 43 are an example of a “report generation support apparatus”.
- the input part 41 , the extracting part 423 c , and the expanding part 423 d may also be included as the example of the “report generation support apparatus”.
- the report generation apparatus 4 is activated by the operator.
- the display controller 425 causes the display 43 to display a diagnostic report generation screen including the finding input field (S 10 ), after the report generation apparatus 4 is activated.
- the acquiring part 421 acquires the medical image related to the test ID from the medical image archive apparatus 3 .
- the display controller 425 causes the display 43 to display the medical image acquired (S 11 ).
- the physician observes the medical image displayed on the display 43 , and finds findings.
- the physician then implements an operation to input the findings to the diagnostic report generation screen displayed on the display 43 via the input part 41 .
- the physician may implement an operation to add annotations, using the input part 41 , to any part within the medical image referred at the time of generating the diagnostic report.
- the annotation part 423 a adds annotations to the medical image (S 12 ).
- S 12 the case when the operation in which the circle annotation A is added by the physician is implemented is described (see FIG. 3A ).
- the specifying part 423 b detects the circumference of the circle annotation A by the edge detection.
- the specifying part 423 b further specifies the circumference and the part within the circumference as the image region (S 13 ).
- the extracting part 423 c determines the rectangle R (quadrangle) circumscribing to the specified image region (see FIG. 3B ). The extracting part 423 c then determines the predetermined range PR expanded by a predetermined length evenly from each vertex of the rectangle R (see FIG. 3C ). The extracting part 423 c further extracts the image of the predetermined range PR by trimming (S 14 ; see FIG. 3D ).
- the expanding part 423 d generates an expanded image corresponding to the image extracted in S 14 (S 15 ; see FIG. 3E ).
- a plurality of annotations is added. That is, for example, there is a case when a plurality of annotations is added to a single medical image or a case when an annotation is added to each of a plurality of medical images.
- the report generation apparatus 4 implements processing from S 13 to S 15 for each of the annotations.
- the display controller 425 causes the display 43 to display the expanded image generated in S 15 (S 16 ).
- the physician instructs, via the input part 41 , to correlate the expanded image displayed in S 16 with the diagnostic report (see FIG. 3F ).
- the correlating part 424 correlates the expanded image generated in S 15 with the diagnostic report (S 17 ) (see FIG. 3G ).
- the diagnostic report correlated with the medical image is generated based on these processes (S 18 ).
- the diagnostic report correlated with the expanded image is stored, for example, with the report ID and the like, in a storage storing diagnostic reports.
- the diagnostic report corresponding to the request is send to the terminal.
- the diagnostic report is stored in the report archive apparatus 5 in the medical information system 1 .
- display modes for the diagnostic report are described.
- the test requesting doctor and the like for example, input an arbitrarily report ID and the like, and make a diagnostic report acquisition request via a PC terminal connected to the medical information system 1 and the like.
- the report archive apparatus 5 receives the acquisition request and the report ID, and sends the diagnostic report corresponding to the report ID to the PC terminal.
- the PC terminal which is used to make the request receives the diagnostic report data.
- the PC terminal causes a display (not shown) to display the diagnostic report and the expanded image correlated therewith, based on the information embedded to the diagnostic report.
- the PC terminal when the image data of the expanded image is embedded to the diagnostic report, the PC terminal causes the display to display the expanded image to be displayed, based on the embedded image data.
- the PC terminal acquires the image data corresponding to the link information from the medical image archive apparatus 3 , based on the link information of the embedded image.
- the PC terminal further causes the expanded image corresponding to the image data as well as the diagnostic report to be displayed.
- the PC terminal acquires the image data corresponding to the link information from the medical image archive apparatus 3 , based on the link information of the embedded image. Further, the PC terminal implements the embedded image processing conditions to the medical image corresponding to the image data to generate the expanded image. The PC terminal then causes the diagnostic report and the generated expanded image to be displayed.
- the PC terminal acquires the image data corresponding to the link information from the medical image archive apparatus 3 , based on the link information of the embedded image. Further, the PC terminal acquires the image processing conditions based on the link information of the image processing conditions for the expanded image from any of storing apparatuses in the medial information system 1 . The PC terminal then applies the acquired image processing conditions to the medical image corresponding to the image data to generate the expanded image. Further, the PC terminal causes the diagnostic report and the generated expanded image to be displayed. In this example, the image data for the medical image may be embedded to the diagnostic report.
- the PC terminal may be caused to acquire the medical image which is the source of the expanded image. Also, as an embodiment in which the PC terminal acquires the expanded image, the above described examples are not limited thereto. Further, the expanded image correlated with the diagnostic report may be corresponded to the information of the diagnostic report arranging position in the image display field and the information related to display modes for the source medical image.
- FIG. 4F to FIG. 4I are schematic diagrams each illustrating an outline of the medial image and the expanded image displayed with the diagnostic report.
- FIG. 4F to FIG. 4L each displays the expanded image or medical image in different display modes from each other. Each of these display modes are displayed in accordance with the information related to the display of the image correlated with the diagnostic report.
- the diagnostic report may be correlated with the information related to the arranging position and the display mode for the expanded image and the arranging position and the display mode for the source medical image, in the image display field in the diagnostic report.
- the PC terminal Based on the correlated information, the PC terminal causes the display or the like to display the expanded image and the source medical image, for example, in the following display modes.
- a first example of the display modes is described with reference to FIG. 4F .
- the display controller (not shown) of the PC terminal causes the expanded image and the source medical image to be displayed side by side on an image display region in the diagnostic report, based on the information correlated therewith.
- the display sizes of the expanded image and the source medical image may be different from each other.
- the correlating part 424 configures the diagnostic report to vary the display sizes of the expanded image and the source of the medical image, these sizes may be changed by using an operating part and the like.
- the display order of the expanded mage and the source medical image is followed the layout of the diagnostic report, and not limited to the example in FIG. 4F .
- FIG. 4G A second example of the display modes is described with reference to FIG. 4G and FIG. 4H .
- the PC terminal causes the expanded image and the source medical image to be displayed side by side in the image display region of the diagnostic report, based on the information correlated therewith. Further, in the second example, the positional information indicating the expanded image position is displayed in the source medical image to be displayed.
- the display controller of the PC terminal refers supplementary information of the expanded image and the like, and extracts the positional information (coordinate information, and the like), which corresponds to the expanded image in the source medical image, from the supplementary information. Further, the display controller specifies, in the source medical image, a region corresponding to the expanded image, based on the extracted positional information. The display controller may specify only the outer edge positional information of the region corresponding to the specified expanded image. Furthermore, in the source medical image, the display controller makes the display mode for the region corresponding to the expanded image different from the display mode for the circumference thereof, based on the specified expanded image positional information.
- the display controller implements drawing processing for drawing an outer edge of the region corresponding to the expanded image with a broken line. Further, as other example, the display controller implements processing which makes the region corresponding to the expanded image distinguishable by making the display color of the region different from the others'. Furthermore, as other example, the display controller implements processing for inversing the gradation display for the region corresponding to the expanded image to the gradation display for the others. Also, as other example, the display controller implements processing which makes the visibility of the region corresponding to the expanded image distinguishable by making the visibility of the region different from the others'.
- the display controller draws the outer edge of the region corresponding to the expanded image with a real line, a broken line, and the like.
- the display controller also implements processing for drawing a line connecting the outer edge of the region corresponding to the expanded image and the outer edge of the expanded image (balloon display processing).
- the PC terminal causes either the expanded image or the source medical image to be selectively displayed in the image display region of the diagnostic report.
- the display controller causes a switching button to be displayed in the diagnostic report, as shown in FIG. 4I and FIG. 4J .
- the display controller implements switching processing for switching the display from the source medical image to the expanded image (from FIG. 4I to FIG. 4J ).
- the display controller implements switching processing for switching the display from the source medical image to the expanded image (from FIG. 4J to FIG. 4I ).
- the display controller When there is a plurality of expanded images correlated with the diagnostic report, the display controller displays each of the expanded image file names and the like and each of the source medical image file names, instead of the switching button. Further, when an operation of selecting one of file names is performed via the operation part of the PC terminal or the like, the display controller implements processing for displaying the image having the file name corresponding to the operation.
- the display controller causes one or more images among the plurality of expanded images to be displayed with the source medical image side by side.
- the display controller also causes the expanded image file names to be selectably displayed in the image display region of the diagnostic report. Further, when the operation of selecting one of file names is performed via the operation part of the PC terminal or the like, the display controller implements processing for displaying the expanded image having the file name corresponding to the operation with the source medical image side by side.
- the display controller causes one or more images among the plurality of expanded images to be displayed with the source medical image side by side.
- the display controller also implements processing for making the display mode for each of the expanded image positions in the source medical image (see the following fourth example) different from the display mode for the circumference thereof.
- the display controller implements processing for displaying the expanded image corresponding to the position according to the operation with the source medical image side by side.
- a fourth example of the display modes is described with reference to FIG. 4K .
- the PC terminal causes the plurality of expanded images and the source medical image to be displayed side by side on the image display region of the diagnostic report, based on the information correlated therewith. It is not necessary for the display controller to display all of the plurality of expanded images with the source medical image side by side, but implement processing for displaying a number of expanded images in accordance with a setting and the source medical image side by side.
- the PC terminal causes the plurality of expanded images and the source medical image to be displayed side by side on the image display region of the diagnostic report, based on the information correlated therewith.
- the display controller also causes a button for performing non-display processing of the expanded image to be displayed somewhere on image in which the diagnostic report is displayed. Further, when the operation of selecting the button is performed via the operation part of the PC terminal or the like, the display controller implements processing for displaying only the source medical image on the image display region, and not displaying any of the expanded images. In a case that the expanded images are non-displayed, the display region for the source medical image may be expanded.
- a sixth example of the display modes is described with reference to FIG. 4L .
- the PC terminal causes the expanded image superposed on the source medical image to be displayed on the image display region of the diagnostic report, based on the information correlated therewith.
- This sixth example and the third example above may be combined.
- the display controller causes the switching button to be displayed in the image display region of the diagnostic report, based on the information correlated therewith.
- the display controller implements processing for displaying only the source medical image on the image display region, and not displaying the expanded image.
- the display controller When there is a plurality of expanded images correlated with the diagnostic report, the display controller causes each of the expanded image file names and the like and each of the source medical image file names to be displayed, instead of the switching button. Further, when the operation of selecting one of file names is performed via the operation part of the PC terminal or the like, the display controller implements processing for displaying the image having the file name corresponding to the operation.
- the display controller may cause the positions corresponding to each of the expanded images to be displayed on the source medical image (see FIG. 4K ), and implement processing for displaying while superposing only the selected expanded image on the source medical image and not displaying the other expanded images, in accordance with the operation of selecting any of the positions.
- the display modes corresponding to the diagnostic report, the expanded image, and the source medical image it is possible to reserve the display region even if the display region is limited to the display of the PC terminal of the test requesting doctor and the like. It is also possible to clarify the positional relationship between the source medical image and the expanded image.
- the report generation apparatus 4 specifies a predetermined region in the medical image displayed on the display 43 .
- the report generation apparatus 4 also generate an image of a predetermined range including the region. For example, the report generation apparatus 4 generates an expanded image corresponding to the predetermined range.
- the predetermined region is specified, for example, by the specifying par 423 b , based on a shape drawn on the medical image.
- This shape may be an arrow pointing an attention site, or a shape surrounding the attention site, in the medical image.
- This shape includes at least any of shapes, such as a circle, an ellipse, a polygon, and a shape drawn freehand.
- a predetermined range including a predetermined position in the medical image may be extracted.
- the extracting part 423 c extracts an image of a predetermined range including a tip-point of the arrow.
- the extracting part 423 c specifies the shape as an image region to extract an image of a predetermined range.
- the following is an example of extracting processing.
- the specifying part 423 b detects the circumference of an annotation which is added to the medical image.
- the specifying part 423 b specifies the circumference and the part within the circumference as an image region.
- the extracting part 423 c determines a shape circumscribing to the specified image region.
- the extracting part 423 c specifies the shape as a predetermined range, and extracts the specified range from the medical image.
- the report generation apparatus 4 automatically extracts an image of a predetermined range including a specified image region from the medical image, and expands the extracted image. According to such the configuration, it is not necessary for the physician to generate expanded images every time a diagnostic report is generated. Therefore, the physician can generate a diagnostic report by only selecting an arbitrary image from the expanded images and implementing an operation for correlating the selected image to the finding input field. That is, it is possible to generate the diagnostic report easily by the report generation apparatus 4 according to the present embodiment.
- the correlating part 424 can correlate the expanded image and the medical image which is the source of the expanded image, with the diagnostic report.
- the diagnostic report is correlated with not only the expanded image but also the medical image, it is possible for the doctor and the like who later confirm the diagnostic report to easily understand that the expanded image is corresponded to which part of the medical image.
- a method for specifying an image region is not limited to the method described in the first embodiment. That is, it is not limited to the configuration in which an image region is specified based on an annotation.
- the specifying part 423 b it is possible for the specifying part 423 b to specify an image region, based on a drag operation by the operator using the input part 41 , such as a mouse. That is, without implementing the operation for adding a shape display, such as an annotation for specifying an attention site, and the like, the physician and the like perform a drag operation while designating the attention site using the input part 41 or the like, such as a mouse pointer. Thereby, the specifying part 423 b specifies the attention site as an image region including a designated point designated by the drag operation.
- FIG. 6 is a diagram illustrating an example of medical images according to a modified example. In FIG. 6 , in order to easily find the designated point when the drag operation is performed by the operator, a partially expanded diagram is also shown.
- the physician either operates a pointer B displayed on a medical image by using a mouse to designate the attention site, or performs the drag operation to include the attention site.
- the specifying part 423 b specifies a designated point E as the image region. Otherwise, the specifying part 423 b specifies a plane designated through the drag operation as the image region.
- the extracting part 423 c or the like implements the similar processes as the above embodiment, such as extraction of a predetermined range, and generation of expanded images. By these processing, it is possible to display the expanded image including the designated point E or plane on the display 43 .
- the specifying part 423 b it is possible for the specifying part 423 b to specify the attention site designated in the medical image as the image region.
- an analyzing part implements image analysis on the medical image displayed on the display 43 .
- the analyzing part acquires positional information of an attention site of a lesion site or the like by the image analysis.
- the analyzing part designates the attention site by the above process.
- the specifying part 423 b determines the region of the attention site, based on the designated attention site positional information.
- the specifying part 423 b specifies the determined region as an image region.
- the extracting part 423 c or the like implements the similar processes as the above embodiment, such as extraction of a predetermined range, and generation of expanded images. It is possible to display the expanded image including the attention site designated by those processes.
- the modified example 1 or the modified example 2 it is possible to automatically extract and expand the image of the predetermined range including the image region. According to such the configuration, it is not necessary for the physician to generate expanded images every time a diagnostic report is generated. Therefore, the physician can generates a diagnostic report by only selecting an arbitrary image from the expanded images and correlating the selected image with the finding input field. That is, it is possible for the diagnostic report generating work to be done easily.
- the medical information system 1 comprises the medical imaging apparatus 2 , the medical image archive apparatus 3 , the report generation apparatus 4 , the report archive apparatus 5 , and a report reading apparatus 6 .
- the report reading apparatus 6 is an apparatus for reading the diagnostic report generated by the report generation apparatus 4 . Hereinafter, detail descriptions of the report reading apparatus 6 is described.
- FIG. 8 is a block diagram illustrating the detail descriptions of the report reading apparatus 6 according to the present embodiment.
- the report reading apparatus 6 comprises an input part 61 , a CPU 62 , and a display 63 .
- the input part 61 is used for instructing a various instructions of the report reading apparatus 6 .
- the input part 61 may be, for example, a keyboard, a mouse, a trackball, a joystick, or the like.
- GUI displayed on the display 63 may also be used.
- the CPU 62 functions as a report acquiring part 621 , a processer 622 , and a display controller 623 .
- the report acquiring part 621 acquires diagnostic reports from the report archive apparatus 5 .
- the diagnostic reports are referred by the doctor and the like. Specifically, when a patient ID is input via the input part 61 , the report acquiring part 621 reads the diagnostic report corresponding to the patient ID out from the report archive apparatus 5 .
- the processor 622 implements various kinds of processing on either one or both of the diagnostic report acquired by the report acquiring part 621 and the medical image correlated therewith.
- the processor 622 in the present embodiment comprises a determination part 622 a , an extracting part 622 b , and an expanding part 622 c.
- the determination part 622 a determines whether the medical image correlated with the diagnostic report includes a shape indicating an attention site. Specifically, the determination part 622 a implements edge detection processing or the like on the medical image to determine whether the shape (annotation or the like) is added or not. When a plurality of medical images is correlated with the diagnostic report, the determination part 622 a implements the above processing on each of the plurality of medical images. The determination part 622 a may start the processing by the instruction via the input part 61 or the like (manually). Otherwise, the determination part 622 a may start the processing automatically in response to the acquisition of the diagnostic report by the report acquiring part 621 .
- the extracting part 622 b extracts an image of a predetermined range including at least a part of the shape. Specifically, in a case that a circle annotation is added to the medical image correlated with the diagnostic report is described. Firstly, the extracting part 622 b determines a rectangle circumscribing to the circle annotation. Next, the extracting part 622 b determines a range expanded by a predetermined length evenly from each vertex of the rectangle, and specifies an image of the range as a predetermined range. Lastly, the extracting part 622 b extracts the image of the predetermined range by trimming.
- the extracting part 622 b implements the above processing for each of the shapes. Further, when the rectangle including a part of the annotation is designated by the instruction via the input part 61 or the like, it is possible for the extracting part 622 b to extract the image of the predetermined range including a part of the annotation by implementing the above processing on the rectangle.
- the expanding part 622 c generates an expanded image corresponding to the image extracted by the extracting part 622 b .
- the generated expanded image is displayed on the display 63 .
- a specific example of the process by the expanding part 622 c is the same as that of the expanding part 423 d in the first embodiment.
- the display controller 623 implements display control for the display 63 .
- the display controller 623 controls for displaying the expanded image expanded by the expanding part 622 c on the display 63 .
- the display 63 is a display to display a diagnostic report.
- the report reading apparatus in the present embodiment may include at least the determination part 622 a , the extracting part 622 b , the expanding image 622 c , the display controller 623 , and the display 63 , among the above configuration.
- the report reading apparatus 6 is activated by the operator.
- the doctor and the like then input a patient ID using the input part 61 .
- the report acquiring part 621 acquires a diagnostic report correlated with the patient ID from the report archive apparatus 5 .
- the display controller 623 causes the display 63 to display the acquired diagnostic report (S 20 ).
- the determination part 622 a determines whether a shape indicating an attention site in the medical image correlated with the diagnostic report display in S 20 exists or not (S 21 ).
- the extracting part 622 b When it is determined that there exits such the shape (S 21 ; Y), the extracting part 622 b generates a rectangle circumscribing to the shape. The extracting part 622 b then designated the range expanded by a predetermined length evenly from each vertex of the rectangle, as a predetermined range. Further, the extracting part 622 b extracts an image of the predetermined range by trimming (S 22 ). When it is determined that there exists no shape therein (S 21 ; N), the processes after S 22 are not implemented.
- the expanding part 622 c generates an expanded image corresponding to the image extracted in S 22 (S 23 ).
- S 22 and S 23 are implemented on each of the shapes.
- the display controller 623 causes the display 63 to display the expanded image generated in S 23 (S 24 ).
- the report reading apparatus 6 in the present embodiment comprises the display 63 , the determination part 622 a , the extracting part 622 b , the expanding part 622 c , and the display controller 623 .
- the display 63 displays a diagnostic report correlated with a medical image.
- the determination part 622 a determines whether there exists a shape indicating an attention site in the correlated medical image.
- the extracting part 622 b extracts an image of a predetermined range including at least a part of the shape.
- the expanding part 622 c generates an expanded image corresponding to the extracted image.
- the display controller 623 causes the display 63 to display the expanded image.
- the report reading apparatus 6 automatically extracts and expands the image of the predetermined range including the attention site in the medical image correlated with the diagnostic report. According to such the configuration, it is possible for the doctor and the like to easily interpret the diagnostic report. In addition, it is not necessary for the physician to generate expanded images every time a diagnostic report is generated. Therefore, the physician can generates a diagnostic report by only correlating the medical image, which is a source of findings, with the finding input field. That is, according to the report reading apparatus of the present embodiment, it is also possible to do easily the diagnostic report generating work.
- the processes from FIG. 3A to FIG. 3D in the first embodiment that is, the processes of S 10 to S 14 in the flowchart in FIG. 5 is the same as that of the first embodiment.
- S 10 is the display process for displaying a diagnostic report generating screen
- S 14 is the process for extracting a predetermined range from a source medical image.
- the report generating apparatus 4 comprises a segment image generator (not shown) for generating a segment image without changing the display magnification of the extracted image.
- the display controller 425 causes the display 43 to display the generated segment image.
- the physician performs an instruction to correlate the displayed segment image with a diagnostic report via the input part 41 (same as in FIG. 3F ).
- the correlating part 424 correlates the generated segment image with the diagnostic report (same as in FIG. 3G ).
- the diagnostic report correlated with the segment image is generated, based on such the processes.
- the diagnostic report is correlated with the information related to the arranging positions and the display modes of the expanded image and the source medical image in the image display field of the diagnostic report. Based on the correlated information, for example, the segment image and the source medical image are displayed with the diagnostic report in the PC terminal used by the test requesting doctor and the like, same as the example of each display mode in the first embodiment.
- the report generation apparatus 4 specifies a predetermined region in the medical image displayed on the display 43 .
- the report generation apparatus 4 also generates a segment image of a predetermined range including the region.
- the predetermined region is specified, for example, by the specifying part 423 b , based on a shape drawn in the medical image. Also, in order to generate an expanded image, there may be a case that a predetermined range including a predetermined position in the medical image is extracted. Further, when the shape is a shape surrounding an attention site, the extracting part 423 c specifies the shape as an image region to extract an image of the predetermined range.
- the report generation apparatus 4 automatically extracts the image of the predetermined range including the image region extracted from the medical image, and generates a segment image of the extracted region. According to such the configuration, it is not necessary for the physician to generate segment images every time a diagnostic report is generated. Therefore, the physician can generate a diagnostic report by only selecting an arbitrary image from the segment image and implementing the operation for correlating the selected image with the finding input field. That is, it is possible for the diagnostic report generating work to be done easily by the report generation apparatus 4 according to the present embodiment.
- the correlating part 424 it is possible for the correlating part 424 to correlate the segment image and the medical image which is the source thereof with the diagnostic report.
- the diagnostic report is correlated with not only the segment image but also the medical image, it is possible for the doctor and the like who later confirm the diagnostic report to easily understand that the segment image is corresponded to which part of the medical image.
- an image of a predetermined range of a medical image can be automatically extracted. According to such the configuration, it is not necessary for the physician to generate expanded images or segment images of the medical image correlated with the diagnostic report. That is, it is possible for the diagnostic report generating work to be done easily.
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
Description
Claims (32)
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JPJP2012-054131 | 2012-03-12 | ||
JP2012054131 | 2012-03-12 | ||
JP2012-054131 | 2012-03-12 | ||
PCT/JP2013/056874 WO2013137280A1 (en) | 2012-03-12 | 2013-03-12 | Report creation assistance device, and report browsing device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/056874 Continuation WO2013137280A1 (en) | 2012-03-12 | 2013-03-12 | Report creation assistance device, and report browsing device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20140379382A1 US20140379382A1 (en) | 2014-12-25 |
US10930385B2 true US10930385B2 (en) | 2021-02-23 |
Family
ID=49161186
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/483,984 Active 2036-08-12 US10930385B2 (en) | 2012-03-12 | 2014-09-11 | Report generation support apparatus and report reading apparatus |
Country Status (4)
Country | Link |
---|---|
US (1) | US10930385B2 (en) |
JP (1) | JP6214887B2 (en) |
CN (1) | CN104025148B (en) |
WO (1) | WO2013137280A1 (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015215740A (en) * | 2014-05-09 | 2015-12-03 | キヤノン株式会社 | Information processing device, information processing method and program |
JP6074455B2 (en) * | 2015-05-14 | 2017-02-01 | キヤノン株式会社 | DIAGNOSIS SUPPORT DEVICE, DIAGNOSIS SUPPORT DEVICE CONTROL METHOD, PROGRAM, AND DIAGNOSIS SUPPORT SYSTEM |
JP6556503B2 (en) * | 2015-06-02 | 2019-08-07 | キヤノンメディカルシステムズ株式会社 | Interpretation report system |
WO2017068905A1 (en) * | 2015-10-19 | 2017-04-27 | オリンパス株式会社 | Medical information recording device |
JP2017099616A (en) * | 2015-12-01 | 2017-06-08 | ソニー株式会社 | Surgical control device, surgical control method and program, and surgical system |
US10679343B2 (en) | 2016-03-03 | 2020-06-09 | Nidek Co., Ltd. | Ophthalmic image processing apparatus and ophthalmic image processing program |
JP6702024B2 (en) * | 2016-06-27 | 2020-05-27 | 株式会社ニデック | Ophthalmic image processing device, ophthalmic image processing program |
FR3050857B1 (en) * | 2016-05-02 | 2018-06-15 | Keen Eye Technologies | METHOD AND ELECTRONIC SYSTEM FOR PROCESSING A SET OF SAMPLE IMAGES, METHOD AND ELECTRONIC SYSTEM FOR CONTROLLING A GENERATED RATIO, ASSOCIATED COMPUTER PROGRAMS |
KR102192164B1 (en) * | 2018-08-08 | 2020-12-16 | 주식회사 딥바이오 | System for biomedical image diagnosis, method for biomedical image diagnosis and terminal performing the same |
US20210225471A1 (en) * | 2020-01-21 | 2021-07-22 | Canon Medical Systems Corporation | Medical reporting assistance apparatus and medical reporting assistance method |
CN112057094A (en) * | 2020-09-24 | 2020-12-11 | 上海联影医疗科技股份有限公司 | Image display method and device, angiography equipment and storage medium |
Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0838433A (en) | 1994-07-31 | 1996-02-13 | Shimadzu Corp | Medical image diagnostic device |
JPH09198453A (en) | 1996-01-23 | 1997-07-31 | Hitachi Ltd | Shadow read report preparation supporting method |
JP2002028154A (en) | 2000-07-18 | 2002-01-29 | Fuji Photo Film Co Ltd | Image display method, image display system, and abnormal shadow candidate detection system |
JP2002200048A (en) | 2001-01-09 | 2002-07-16 | Hitachi Medical Corp | Diagnosis support system |
US20040085443A1 (en) * | 2000-12-13 | 2004-05-06 | Kallioniemi Olli P | Method and system for processing regions of interest for objects comprising biological material |
JP2004187980A (en) | 2002-12-12 | 2004-07-08 | Fuji Photo Film Co Ltd | Medical image processor and medical image processing method |
US20040151358A1 (en) | 2003-01-31 | 2004-08-05 | Akiko Yanagita | Medical image processing system and method for processing medical image |
JP2004230001A (en) | 2003-01-31 | 2004-08-19 | Konica Minolta Holdings Inc | Medical image processor and medical image processing method |
US20070211930A1 (en) * | 2006-03-09 | 2007-09-13 | Terry Dolwick | Attribute based image enhancement and display for medical imaging applications |
JP2008006169A (en) | 2006-06-30 | 2008-01-17 | Konica Minolta Medical & Graphic Inc | Medical image display system for small-scale institution |
US20090076853A1 (en) | 2007-09-14 | 2009-03-19 | Fujifilm Corporation | System, apparatus and method of making image interpretation report |
US20090087047A1 (en) | 2007-09-28 | 2009-04-02 | Yoshiyuki Moriya | Image display device and image display program storage medium |
US20090087049A1 (en) | 2007-09-27 | 2009-04-02 | Fujifilm Corporation | Medical reporting system, apparatus and method |
US20090087048A1 (en) * | 2007-09-27 | 2009-04-02 | Fujifilm Corporation | Medical report system, and medical report making apparatus and method |
US20090208076A1 (en) | 2008-02-14 | 2009-08-20 | Fujifilm Corporation | Medical network system, and image-interpretation support apparatus and method |
CN101546361A (en) | 2008-03-25 | 2009-09-30 | 株式会社东芝 | Report generation support system |
US20090248441A1 (en) | 2008-03-27 | 2009-10-01 | Fujifilm Corporation | Medical report system, medical report viewer, medical report program, and method of editing and displaying medical report |
CN101561848A (en) | 2008-04-18 | 2009-10-21 | 株式会社东芝 | System for assisting preparation of medical-image reading reports |
JP2010015504A (en) | 2008-07-07 | 2010-01-21 | Toshiba Corp | Medical information forming device and medical information display device |
CN101645111A (en) | 2008-08-06 | 2010-02-10 | 株式会社东芝 | Report generation support apparatus, report generation support system, and medical image referring apparatus |
US7764817B2 (en) * | 2005-08-15 | 2010-07-27 | Siemens Medical Solutions Usa, Inc. | Method for database guided simultaneous multi slice object detection in three dimensional volumetric data |
JP2010167144A (en) | 2009-01-23 | 2010-08-05 | Toshiba Corp | Medical image diagnosis support system |
JP2010237930A (en) | 2009-03-31 | 2010-10-21 | Fujifilm Corp | Case image retrieval device, method, and program |
US20110066635A1 (en) | 2009-09-16 | 2011-03-17 | Fujifilm Corporation | Medical image information display apparatus, medical image information display method, and recording medium on which medical image information display program is recorded |
US20110075913A1 (en) | 2009-09-30 | 2011-03-31 | Fujifilm Corporation | Lesion area extraction apparatus, method, and program |
US7945083B2 (en) * | 2006-05-25 | 2011-05-17 | Carestream Health, Inc. | Method for supporting diagnostic workflow from a medical imaging apparatus |
US20110144482A1 (en) | 2009-12-11 | 2011-06-16 | Fujifilm Corporation | Image display device and method, as well as program |
US20110218425A1 (en) | 2010-03-04 | 2011-09-08 | Fujifilm Corporation | Medical image generating apparatus, medical image display apparatus, medical image generating method and program |
US8199985B2 (en) * | 2006-03-24 | 2012-06-12 | Exini Diagnostics Aktiebolag | Automatic interpretation of 3-D medicine images of the brain and methods for producing intermediate results |
-
2013
- 2013-03-12 JP JP2013049569A patent/JP6214887B2/en active Active
- 2013-03-12 WO PCT/JP2013/056874 patent/WO2013137280A1/en active Application Filing
- 2013-03-12 CN CN201380004578.8A patent/CN104025148B/en active Active
-
2014
- 2014-09-11 US US14/483,984 patent/US10930385B2/en active Active
Patent Citations (44)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0838433A (en) | 1994-07-31 | 1996-02-13 | Shimadzu Corp | Medical image diagnostic device |
JPH09198453A (en) | 1996-01-23 | 1997-07-31 | Hitachi Ltd | Shadow read report preparation supporting method |
JP2002028154A (en) | 2000-07-18 | 2002-01-29 | Fuji Photo Film Co Ltd | Image display method, image display system, and abnormal shadow candidate detection system |
US20040085443A1 (en) * | 2000-12-13 | 2004-05-06 | Kallioniemi Olli P | Method and system for processing regions of interest for objects comprising biological material |
JP2002200048A (en) | 2001-01-09 | 2002-07-16 | Hitachi Medical Corp | Diagnosis support system |
JP2004187980A (en) | 2002-12-12 | 2004-07-08 | Fuji Photo Film Co Ltd | Medical image processor and medical image processing method |
US20040151358A1 (en) | 2003-01-31 | 2004-08-05 | Akiko Yanagita | Medical image processing system and method for processing medical image |
JP2004230001A (en) | 2003-01-31 | 2004-08-19 | Konica Minolta Holdings Inc | Medical image processor and medical image processing method |
US7764817B2 (en) * | 2005-08-15 | 2010-07-27 | Siemens Medical Solutions Usa, Inc. | Method for database guided simultaneous multi slice object detection in three dimensional volumetric data |
US20070211930A1 (en) * | 2006-03-09 | 2007-09-13 | Terry Dolwick | Attribute based image enhancement and display for medical imaging applications |
US8199985B2 (en) * | 2006-03-24 | 2012-06-12 | Exini Diagnostics Aktiebolag | Automatic interpretation of 3-D medicine images of the brain and methods for producing intermediate results |
US7945083B2 (en) * | 2006-05-25 | 2011-05-17 | Carestream Health, Inc. | Method for supporting diagnostic workflow from a medical imaging apparatus |
JP2008006169A (en) | 2006-06-30 | 2008-01-17 | Konica Minolta Medical & Graphic Inc | Medical image display system for small-scale institution |
US20090076853A1 (en) | 2007-09-14 | 2009-03-19 | Fujifilm Corporation | System, apparatus and method of making image interpretation report |
JP2009070201A (en) | 2007-09-14 | 2009-04-02 | Fujifilm Corp | Diagnostic reading report generation system, diagnostic reading report generation device, and diagnostic reading report generation method |
US20090087048A1 (en) * | 2007-09-27 | 2009-04-02 | Fujifilm Corporation | Medical report system, and medical report making apparatus and method |
JP2009086765A (en) | 2007-09-27 | 2009-04-23 | Fujifilm Corp | Medical report system, medical report creating device, and medical report creating method |
JP2009082227A (en) | 2007-09-27 | 2009-04-23 | Fujifilm Corp | Medical report system, and medical report making apparatus and method |
US20090087049A1 (en) | 2007-09-27 | 2009-04-02 | Fujifilm Corporation | Medical reporting system, apparatus and method |
JP2009082465A (en) | 2007-09-28 | 2009-04-23 | Fujifilm Corp | Image display device and image display program |
US20090087047A1 (en) | 2007-09-28 | 2009-04-02 | Yoshiyuki Moriya | Image display device and image display program storage medium |
US20090208076A1 (en) | 2008-02-14 | 2009-08-20 | Fujifilm Corporation | Medical network system, and image-interpretation support apparatus and method |
JP2009189541A (en) | 2008-02-14 | 2009-08-27 | Fujifilm Corp | Diagnostic reading support apparatus, method and medical network system |
US20090248447A1 (en) | 2008-03-25 | 2009-10-01 | Kabushiki Kaisha Toshiba | Report generation support system |
JP2009230629A (en) | 2008-03-25 | 2009-10-08 | Toshiba Corp | Report preparation support system |
CN101546361A (en) | 2008-03-25 | 2009-09-30 | 株式会社东芝 | Report generation support system |
US20090248441A1 (en) | 2008-03-27 | 2009-10-01 | Fujifilm Corporation | Medical report system, medical report viewer, medical report program, and method of editing and displaying medical report |
JP2009238037A (en) | 2008-03-27 | 2009-10-15 | Fujifilm Corp | Medical report system, medical report viewer, medical report program, and method of viewing medical report |
CN101561848A (en) | 2008-04-18 | 2009-10-21 | 株式会社东芝 | System for assisting preparation of medical-image reading reports |
US20090262995A1 (en) | 2008-04-18 | 2009-10-22 | Hikaru Futami | System for assisting preparation of medical-image reading reports |
JP2010015504A (en) | 2008-07-07 | 2010-01-21 | Toshiba Corp | Medical information forming device and medical information display device |
US20100034442A1 (en) * | 2008-08-06 | 2010-02-11 | Kabushiki Kaisha Toshiba | Report generation support apparatus, report generation support system, and medical image referring apparatus |
CN101645111A (en) | 2008-08-06 | 2010-02-10 | 株式会社东芝 | Report generation support apparatus, report generation support system, and medical image referring apparatus |
JP2010167144A (en) | 2009-01-23 | 2010-08-05 | Toshiba Corp | Medical image diagnosis support system |
JP2010237930A (en) | 2009-03-31 | 2010-10-21 | Fujifilm Corp | Case image retrieval device, method, and program |
US20110066635A1 (en) | 2009-09-16 | 2011-03-17 | Fujifilm Corporation | Medical image information display apparatus, medical image information display method, and recording medium on which medical image information display program is recorded |
JP2011062283A (en) | 2009-09-16 | 2011-03-31 | Fujifilm Corp | Medical image information display apparatus, method, and program |
US20110075913A1 (en) | 2009-09-30 | 2011-03-31 | Fujifilm Corporation | Lesion area extraction apparatus, method, and program |
JP2011092684A (en) | 2009-09-30 | 2011-05-12 | Fujifilm Corp | Lesion area extraction apparatus, method, and program |
US20110144482A1 (en) | 2009-12-11 | 2011-06-16 | Fujifilm Corporation | Image display device and method, as well as program |
JP2011120747A (en) | 2009-12-11 | 2011-06-23 | Fujifilm Corp | Image display device, method, and program |
CN102138827A (en) | 2009-12-11 | 2011-08-03 | 富士胶片株式会社 | Image display device and method, as well as program |
US20110218425A1 (en) | 2010-03-04 | 2011-09-08 | Fujifilm Corporation | Medical image generating apparatus, medical image display apparatus, medical image generating method and program |
JP2011182808A (en) | 2010-03-04 | 2011-09-22 | Fujifilm Corp | Medical image generating apparatus, medical image display apparatus, medical image generating method and program |
Non-Patent Citations (7)
Title |
---|
Combined Chinese Office Action and Search Report dated Jul. 4, 2016 in Patent Application No. 201380004578.8 (with English language translation of categories of cited documents). |
Google patents search, Dec. 11, 2019 (Year: 2019). * |
Google patents search, May 8, 2019 (Year: 2019). * |
International Search Report dated Jun. 18, 2013 for PCT/JP2013/056874 filed on Mar. 12, 2013 with English Translation. |
ip.com search, Oct. 15, 2020 (Year: 2020). * |
Office Action dated May 30, 2017 in Japanese Patent Application No. 2013-049569. |
Office Action dated Nov. 1, 2016 in Japanese Patent Application No. 2013-49569. |
Also Published As
Publication number | Publication date |
---|---|
WO2013137280A1 (en) | 2013-09-19 |
US20140379382A1 (en) | 2014-12-25 |
JP6214887B2 (en) | 2017-10-18 |
JP2013215563A (en) | 2013-10-24 |
CN104025148B (en) | 2019-01-04 |
CN104025148A (en) | 2014-09-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10930385B2 (en) | Report generation support apparatus and report reading apparatus | |
JP6827706B2 (en) | Information processing equipment and its methods, information processing systems, computer programs | |
US9710146B2 (en) | System and method for image display control | |
JP2007282656A (en) | Medical image display | |
US10181187B2 (en) | Information processing apparatus, method thereof, information processing system, and computer-readable storage medium that display a medical image with comment information | |
US11093699B2 (en) | Medical image processing apparatus, medical image processing method, and medical image processing program | |
JP6004875B2 (en) | MEDICAL IMAGE DISPLAY DEVICE, MEDICAL IMAGE DISPLAY METHOD, AND PROGRAM | |
JP2009005906A (en) | Medical image observation system and medical image observation device | |
JP5036368B2 (en) | Medical image display apparatus and method | |
JP3989896B2 (en) | Medical image processing apparatus, region of interest extraction method, and program | |
JP5317558B2 (en) | Medical information creation device | |
JP7430249B2 (en) | Image processing device, image display system, image processing method and program | |
JP2005124617A (en) | Medical image diagnosis support system | |
JP2010131239A (en) | Device and program for displaying medical image | |
JP2014149689A (en) | Report preparation support system and report preparation support program | |
JP6327966B2 (en) | MEDICAL IMAGE DISPLAY DEVICE, DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, PROGRAM | |
JP2006187412A (en) | Medical image-based diagnosis supporting apparatus | |
JP2016001372A (en) | Information processing device, information processing method and program | |
JP5936826B2 (en) | Medical image processing device | |
CN109727662B (en) | Display method and device for medical image detection, equipment and non-transient storage medium | |
JP6146249B2 (en) | Image display device and image display method | |
JP2018110944A (en) | Medical image display device, display control device, display control method, and program | |
JP2005173818A (en) | Medical image diagnostic support system | |
CN112150573B (en) | Image display method, device, electronic equipment and storage medium | |
JP2003290218A (en) | Medical image display device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MORISHIMA, HIROSHIZU;MINAKUCHI, MAKI;YOSHIDA, TAKAFUMI;SIGNING DATES FROM 20140219 TO 20140220;REEL/FRAME:033724/0706 Owner name: TOSHIBA MEDICAL SYSTEMS CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MORISHIMA, HIROSHIZU;MINAKUCHI, MAKI;YOSHIDA, TAKAFUMI;SIGNING DATES FROM 20140219 TO 20140220;REEL/FRAME:033724/0706 |
|
AS | Assignment |
Owner name: TOSHIBA MEDICAL SYSTEMS CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KABUSHIKI KAISHA TOSHIBA;REEL/FRAME:039099/0626 Effective date: 20160316 |
|
AS | Assignment |
Owner name: TOSHIBA MEDICAL SYSTEMS CORPORATION, JAPAN Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE SERIAL NUMBER FOR 14354812 WHICH WAS INCORRECTLY CITED AS 13354812 PREVIOUSLY RECORDED ON REEL 039099 FRAME 0626. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:KABUSHIKI KAISHA TOSHIBA;REEL/FRAME:039609/0953 Effective date: 20160316 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
AS | Assignment |
Owner name: CANON MEDICAL SYSTEMS CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:TOSHIBA MEDICAL SYSTEMS CORPORATION;REEL/FRAME:049879/0342 Effective date: 20180104 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |