JP6415830B2 - Medical image processing apparatus and medical image diagnostic apparatus - Google Patents

Description

  Embodiments described herein relate generally to a medical image processing apparatus and a medical image diagnostic apparatus.

  X-ray CT (Computed Tomography) apparatus, ultrasound diagnostic apparatus, MRI (Magnetic Resonance Imaging) apparatus, X-ray diagnostic apparatus, PET (Positron Emission Tomography) apparatus and other images obtained by a medical image diagnostic apparatus A medical image processing apparatus that displays thumbnails on a display unit such as a monitor is known.

  In the conventional medical image processing apparatus, when a plurality of images are displayed as thumbnails, the plurality of images are two-dimensionally arranged and displayed as thumbnails based on a predetermined arrangement condition. Each of the plurality of images is accompanied by additional information such as an imaging type, an imaging time, a slice position, and a cardiac phase. For example, the medical image processing apparatus sets the slice position as the array condition in the horizontal direction and the imaging type (contrast imaging, non-contrast imaging, and scanography) as the array condition in the vertical direction, and the object acquired by the X-ray CT apparatus. A plurality of images of the specimen were arranged two-dimensionally and displayed as thumbnails. The medical image processing apparatus displays in detail the image designated by the user among the images displayed as thumbnails. Thereby, the user can designate a desired image among the images displayed as thumbnails and visually recognize the details of the image.

JP 2009-148422 A JP 2007-37781 A JP 2008-73301 A JP 2012-20174 A

  However, in recent years, there are a wide variety of types of images acquired by the medical image diagnostic apparatus, and accordingly, there are a wide variety of arrangement conditions used for thumbnail display. As a result, there are cases in which a wide variety of images cannot be displayed as a list in thumbnail display using a two-dimensional array. For example, when the medical image processing apparatus sets the slice position as the array condition in the horizontal direction and the shooting type as the array condition in the vertical direction and causes the thumbnail display to be displayed on the display unit, images having different shooting times at the same slice position In some cases, it was not possible to list each other.

  The problem to be solved by the present invention is to provide a medical image processing apparatus and a medical image diagnostic apparatus capable of improving the listability of a plurality of medical images.

The medical image processing apparatus according to the embodiment includes a reading unit, a related unit, and a display control unit. The reading unit reads a plurality of image data with accompanying information. The related part has information of 3D coordinates and types of incidental information, receives instructions from the operation unit to select the types of incidental information and axes of the three-dimensional coordinates, and types of incidental information and three-dimensional coordinates indicated by the instructions By selecting the axis, the type of incidental information is associated with each axis of the three-dimensional coordinates. The display control unit arranges images of a plurality of image data in a three-dimensional coordinate space and displays them on the display unit based on the type of incidental information associated with each axis of the three-dimensional coordinate. In addition, the related unit stores the type of incidental information selected in the past and the number of times the type has been selected, and operates an instruction to select the type of incidental information and the axis of the three-dimensional coordinate based on the stored number of selections. When the information is received from the section, the type of the incidental information and the axis of the three-dimensional coordinate are selected based on the number of times of selection, thereby associating the type of the incidental information with each axis of the three-dimensional coordinate.

In addition, the medical image diagnostic apparatus according to the embodiment includes an imaging unit, a reading unit, a related unit, and a display control unit. The imaging unit generates a plurality of image data of the subject with the accompanying information. The reading unit reads a plurality of image data. The related part has information of 3D coordinates and types of incidental information, receives instructions from the operation unit to select the types of incidental information and axes of the three-dimensional coordinates, and types of incidental information and three-dimensional coordinates indicated by the instructions By selecting the axis, the type of incidental information is associated with each axis of the three-dimensional coordinates. The display control unit arranges images of a plurality of image data in a three-dimensional coordinate space and displays them on the display unit based on the type of incidental information associated with each axis of the three-dimensional coordinate. In addition, the related unit stores the type of incidental information selected in the past and the number of times the type has been selected, and operates an instruction to select the type of incidental information and the axis of the three-dimensional coordinate based on the stored number of selections. When the information is received from the section, the type of the incidental information and the axis of the three-dimensional coordinate are selected based on the number of times of selection, thereby associating the type of the incidental information with each axis of the three-dimensional coordinate.

1 is a block diagram illustrating a configuration of a medical image processing apparatus according to an embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. 6 is a flowchart illustrating the operation of the medical image processing apparatus according to the embodiment. 1 is a block diagram illustrating a configuration of a medical image processing apparatus according to an embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. 6 is a flowchart illustrating the operation of the medical image processing apparatus according to the embodiment. 1 is a block diagram illustrating a configuration of a medical image processing apparatus according to an embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. 6 is a flowchart illustrating the operation of the medical image processing apparatus according to the embodiment. 1 is a block diagram illustrating a configuration of a medical image processing apparatus according to an embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. The schematic diagram showing the outline of the medical image processing apparatus of embodiment. 6 is a flowchart illustrating the operation of the medical image processing apparatus according to the embodiment. The block diagram showing the composition of the medical image diagnostic device of an embodiment.

<First Embodiment>
[Constitution]
FIG. 1 is a block diagram showing the configuration of the medical image processing apparatus 1a of this embodiment. The medical image processing apparatus 1 a includes a reading unit 2, a related unit 3, a display control unit 4, a system control unit 5, a display unit 6, and an operation unit 7.

(Reading unit 2)
The reading unit 2 reads a plurality of image data with accompanying information. For example, the reading unit 2 reads a plurality of image data with additional information from the image storage unit 8 outside the medical image processing apparatus 1a via a general communication interface. The accompanying information is meta information representing additional information about the attached image data, and includes, as its type, an imaging type, an imaging time, a slice position, a cardiac phase, a tube voltage, and the like. The imaging type is incidental information indicating the imaging type such as scan imaging by the X-ray CT apparatus, non-contrast volume scan imaging, contrast volume scan imaging, helical scan, and conventional scan. The shooting time is incidental information representing the time when an image was shot or the elapsed time from a predetermined shooting start time. The slice position is supplementary information representing the slice position in a predetermined direction such as the body axis direction of the subject. The cardiac phase is incidental information representing the cardiac phase in electrocardiographic synchronization imaging. The tube voltage is incidental information representing tube voltage related to the image data when the tube voltage of the X-ray tube is changed to a plurality of conditions and an image is acquired. For example, the reading unit 2 receives the designation of the subject from the operation unit 7, searches for image data acquired for the subject, and reads a plurality of searched image data from the image storage unit 8. Usually, a subject ID for identifying the subject is attached to the image data. For example, the reading unit 2 receives designation of the subject ID by the user, and reads a plurality of image data based on the subject ID. The reading unit 2 outputs the read plurality of image data to the display control unit 4 together with the accompanying information. Further, the incidental information may include summary information of only a character string such as subject information, predetermined imaging information data, and the like.

(Related part 3)
The association unit 3 has information on three-dimensional coordinates, and associates the types of incidental information for each axis of the three-dimensional coordinates. In addition, the association unit 3 associates arrangement order information indicating the arrangement order by the display control unit 4 for each type of incidental information. In addition, the association unit 3 has information of three-dimensional coordinates and types of incidental information, and associates the types of incidental information selected from the types of incidental information for each axis of the three-dimensional coordinates. The association unit 3 includes a coordinate information unit 32 and a selection unit 31.

(Coordinate information part 32)
The coordinate information unit 32 has three-dimensional coordinate information. For example, the three-dimensional coordinates are predetermined in the coordinate information unit 32 as an orthogonal coordinate system. The three-dimensional coordinates may be determined in advance in the coordinate information unit 32 as an oblique coordinate system. The coordinate information unit 32 has three-dimensional coordinate information and incidental information types. Here, in this specification, the axes of the three-dimensional coordinates are referred to as an x-axis, a y-axis, and a z-axis, respectively. Moreover, the coordinate information part 32 has the kind of incidental information. For example, the coordinate information unit 32 stores types such as shooting type, shooting time, slice position, cardiac phase, tube voltage, and the like. The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4.

(Selection unit 31)
The selection unit 31 associates the type of incidental information selected from the types of incidental information in the coordinate information unit 32 for each axis of the three-dimensional coordinate. For example, the selection unit 31 receives an instruction to select the type of incidental information and an axis of a three-dimensional coordinate from the operation unit 7, and selects the type of incidental information by selecting the type and axis of the incidental information indicated by the received instruction. Associate with axis of dimensional coordinate. As a result, the type of incidental information is individually associated with each of the axes of the three-dimensional coordinates.

  In addition, the selection unit 31 associates arrangement order information indicating the arrangement order by the display control unit 4 for each type of incidental information. For example, the selection unit 31 selects the ascending order or the descending order as the array order information for each type of the auxiliary information when the type of the auxiliary information is a rank scale such as an imaging time, a slice position, a cardiac phase, and a tube voltage, The selected sequence order information is associated with the type of the accompanying information. In addition, when the type of the incidental information is a nominal scale such as a shooting type, the selection unit 31 selects, for example, an ascending or descending order as a sequence scale information for a rank scale such as a shooting time, and selects the selected sequence order information. Associate with the type of the associated information.

  Here, an incidental information selection screen, which is a display screen for receiving an instruction for the selection unit 31 to select the type of incidental information and an axis of three-dimensional coordinates, will be described. FIG. 2 is a schematic diagram showing the incidental information selection screen P1. The display control unit 4 causes the display unit 6 to display the incidental information selection screen P1. On the incidental information selection screen P1, the window Tx is a window for selecting the type of incidental information associated with the x-axis. The window Ty is a window for selecting the type of incidental information associated with the y axis. The window Tz is a window for selecting the type of incidental information associated with the z axis. The window Sx is a window for selecting arrangement order information associated with the x axis. The window Sy is a window for selecting arrangement order information associated with the y-axis. The window Sz is a window for selecting arrangement order information associated with the z axis. For example, the window Tx, the window Ty, and the window Tz are configured to be able to display a list of types of incidental information using a pull-down menu or the like. The window Sx, the window Sy, and the window Sz are configured to be able to display a list of arrangement order information using a pull-down menu or the like. The selection unit 31 receives a selection instruction from the operation unit 7 by the user via the window Tx, the window Ty, and the window Tz, and associates the type of incidental information based on the selection instruction with each of the axes of the three-dimensional coordinates. The selection unit 31 receives a selection instruction from the operation unit 7 by the user via the window Sx, the window Sy, and the window Sz, and associates the arrangement order information based on the selection instruction with each of the axes of the three-dimensional coordinates. The selection unit 31 outputs to the display control unit 4 related information representing the type of incidental information associated with each of the axes of the three-dimensional coordinates and the arrangement order information.

(Display control unit 4)
The display control unit 4 arranges images of a plurality of image data in a three-dimensional coordinate space and displays them on the display unit 6 based on the type of incidental information associated with each axis of the three-dimensional coordinate. At this time, the display control unit 4 receives the three-dimensional coordinates from the coordinate information unit 32. The display control unit 4 receives a plurality of image data from the reading unit 2. In addition, the display control unit 4 receives related information from the selection unit 31. For example, the display control unit 4 collates the types of incidental information associated with the related information, the axis and arrangement order information, and the incidental information of a plurality of image data, and arranges the plurality of image data in a three-dimensional coordinate space. .

  FIG. 3 is a schematic diagram showing a display screen P2 on which images of arranged image data are displayed. Here, for the sake of explanation, the scan image n1 acquired by the X-ray CT apparatus, the tomographic image n2 acquired by performing the volume scan, and the contrast scan are administered, and the volume scan is performed at regular time intervals. An example in which the acquired time-series contrast tomographic images n3 are arranged is shown. In the x-axis direction associated with the slice position as the type of incidental information, tomographic images of image data are arranged in the order from the head side to the foot side of the subject. In the y-axis direction associated with the shooting type as the type of incidental information, an image of image data is arranged for each shooting type. In the z-axis direction associated with the imaging time as the type of incidental information, the time-series images of the time-series contrast tomographic image n3 are arranged in time order. In this way, the display control unit 4 causes the display unit 6 to display images of a plurality of arranged image data, thereby performing a time-series contrast tomographic image acquired by performing a volume scan at regular time intervals and other images. Images including the image of the imaging type can be displayed on the display unit 6 in a list based on the slice position, the imaging time, and the imaging type.

(System controller 5)
The system control unit 5 controls each unit of the medical image processing apparatus 1a. For example, the system control unit 5 stores in advance a computer program for executing the function of each unit of the medical image processing apparatus 1a. The system control unit 5 implements the functions of each unit by executing the stored computer program.

(Display unit 6, operation unit 7)
The display unit 6 displays an image based on the image data. A display device such as a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display) is used. In response to an operation by the user, the operation unit 7 inputs a signal and information corresponding to the content of the operation to each unit of the apparatus. The operation unit 7 is configured by, for example, a keyboard, a mouse, a touch panel, and the like.

[Operation]
FIG. 4 is a flowchart showing the operation of the medical image processing apparatus 1a of this embodiment.

(S001)
The reading unit 2 reads a plurality of image data with accompanying information. The reading unit 2 outputs the read plurality of image data to the display control unit 4 together with the accompanying information.

(S002)
The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4. In addition, the selection unit 31 associates the type of incidental information selected from the types of incidental information in the coordinate information unit 32 for each axis of the three-dimensional coordinate. In addition, the selection unit 31 associates arrangement order information indicating the arrangement order by the display control unit 4 for each type of incidental information. The selection unit 31 outputs to the display control unit 4 related information representing the type of incidental information associated with each of the axes of the three-dimensional coordinates and the arrangement order information.

(S003)
The display control unit 4 receives three-dimensional coordinates from the coordinate information unit 32, receives a plurality of image data from the reading unit 2, and receives related information from the selection unit 31. The display control unit 4 collates the types, axes, and order of the incidental information associated with the related information with the incidental information of the plurality of image data, and arranges the plurality of image data in a three-dimensional coordinate space.

(S004)
The display control unit 4 causes the display unit 6 to display images of a plurality of arranged image data.

[effect]
The effect of the medical image processing apparatus 1a of this embodiment will be described. The medical image processing apparatus 1 a includes a reading unit 2, a related unit 3, and a display control unit 4. The reading unit 2 reads a plurality of image data with accompanying information. The association unit 3 has information on three-dimensional coordinates, and associates the types of incidental information for each axis of the three-dimensional coordinates. The display control unit 4 arranges images of a plurality of image data in a three-dimensional coordinate space and displays them on the display unit 6 based on the type of incidental information associated with each axis of the three-dimensional coordinate. Accordingly, it is possible to provide the medical image processing apparatus 1a that improves the listability of a plurality of medical images.

<Modification 1 of the first embodiment>
[Constitution]
FIG. 5 is a block diagram showing the configuration of the medical image processing apparatus 1b of this modification. The medical image processing apparatus 1b of this modification is different from the medical image processing apparatus 1a of the first embodiment in the configuration of the related unit 3. Hereinafter, description of matters similar to those of the medical image processing apparatus 1a of the first embodiment may be omitted.

  The association unit 3 stores the type of incidental information selected in the past and the number of times of selection of the type, and associates the type of incidental information for each axis of the three-dimensional coordinate based on the number of selections. The related unit 3 includes a number storage unit 33. The number storage unit 33 stores in advance the type of incidental information selected by the selection unit 31 in the past and the number of selections for selecting the type. The selection unit 31 associates the types of incidental information with the axes of the three-dimensional coordinates by selecting the types of incidental information and the axes of the three-dimensional coordinates based on the number of selections stored in the number-of-times storage unit 33. For example, the selection unit 31 selects three types of incidental information and three-dimensional coordinate axes in the descending order of selection, and outputs the selected information to the display control unit 4 as related information.

  Here, the selection unit 31 selects from the number-of-times storage unit 33 when receiving an instruction from the operation unit 7 to select the type of incidental information and the axis of the three-dimensional coordinate based on the number of selections stored by the number-of-times storage unit 33. The number of times is read, and the type of incidental information and the axis of three-dimensional coordinates are selected. FIG. 6 is a schematic diagram showing an automatic setting screen P3 which is a display screen when the selection unit 31 receives this instruction. The display control unit 4 causes the display unit 6 to display the automatic setting screen P3. The window A1 and the click area A2 are windows for the selection unit 31 to receive an instruction to select incidental information based on the number of selections. When the selection unit 31 receives a click operation on the click area A2 or a command input from the operation unit 7 such as a pull-down menu of the window A1 or a keyboard, the selection unit 31 selects the type of incidental information based on the number of selections.

  In addition, the selection unit 31 outputs a signal indicating the type of the selected supplementary information and the axis of the three-dimensional coordinate to the number storage unit 33. The number-of-times storage unit 33 newly adds and stores the number of incidental information represented by the signal and the axis of the three-dimensional coordinate.

[Operation]
FIG. 7 is a flowchart showing the operation of the medical image processing apparatus 1b according to this modification.

(S101)
The reading unit 2 reads a plurality of image data with accompanying information. The reading unit 2 outputs the read plurality of image data to the display control unit 4 together with the accompanying information.

(S102)
When the selection unit 31 receives an instruction from the operation unit 7 to select the type of incidental information and the axis of the three-dimensional coordinate based on the number of selections stored in the number storage unit 33 (S102; YES), the process proceeds to S103. . When the selection unit 31 does not receive an instruction to select the type of incidental information and the axis of the three-dimensional coordinate based on the number of selections stored in the number storage unit 33 (S102; NO), the process proceeds to S105.

(S103)
The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4. The selection unit 31 associates the type of incidental information with the axis of the three-dimensional coordinate by selecting the type of incidental information and the axis of the three-dimensional coordinate based on the number of selections stored in the number-of-times storage unit 33. The selection unit 31 outputs to the display control unit 4 related information representing the type of incidental information associated with each of the axes of the three-dimensional coordinates and the arrangement order information.

(S104)
The selection unit 31 outputs a signal representing the type of the selected incidental information and the axis of the three-dimensional coordinate to the number storage unit 33. The number-of-times storage unit 33 newly adds and stores the number of incidental information represented by the signal and the axis of the three-dimensional coordinate.

(S105)
The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4. In addition, the selection unit 31 associates the type of incidental information selected from the types of incidental information in the coordinate information unit 32 for each axis of the three-dimensional coordinate. In addition, the selection unit 31 associates arrangement order information indicating the arrangement order by the display control unit 4 for each type of incidental information. The selection unit 31 outputs to the display control unit 4 related information representing the type of incidental information associated with each of the axes of the three-dimensional coordinates and the arrangement order information.

(S106)
The display control unit 4 receives three-dimensional coordinates from the coordinate information unit 32, receives a plurality of image data from the reading unit 2, and receives related information from the selection unit 31. The display control unit 4 collates the types, axes, and order of the incidental information associated with the related information with the incidental information of the plurality of image data, and arranges the plurality of image data in a three-dimensional coordinate space.

(S107)
The display control unit 4 causes the display unit 6 to display images of a plurality of arranged image data.

[effect]
The effect of the medical image processing apparatus 1b of this modification will be described. The medical image processing apparatus 1b stores the type of incidental information selected in the past and the number of times the type has been selected, and associates the type of incidental information for each axis of the three-dimensional coordinate based on the number of selections. Accordingly, it is possible to provide a medical image processing apparatus 1b that easily receives an instruction to arrange a plurality of medical images in an arrangement that has been frequently used in the past, and improves the listability of the plurality of medical images.

<Modification 2 of the first embodiment>
FIG. 8 is a block diagram showing a configuration of a medical image processing apparatus 1c according to this modification. A medical image processing apparatus 1c of this modification is different from the medical image processing apparatus 1a of the first embodiment in the configuration of the related unit 3. Hereinafter, description of matters similar to those of the medical image processing apparatus 1a of the first embodiment may be omitted.

  The association unit 3 receives incidental information from the reading unit 2 and associates the type of incidental information for each axis of the three-dimensional coordinate based on the incidental information. The related unit 3 has an accompanying information processing unit 34. The incidental information processing unit 34 acquires incidental information of a plurality of image data from the reading unit 2. The incidental information processing unit 34 outputs three types of incidental information to the selection unit 31 based on the acquired plurality of incidental information. For example, the incidental information processing unit 34 stores in advance related information that associates specific incidental information with the type of incidental information. The incidental information processing unit 34 searches whether the incidental information received from the reading unit 2 includes specific incidental information stored in advance. When the incidental information received from the reading unit 2 includes specific incidental information stored in advance, the incidental information processing unit 34 outputs the type of incidental information associated with the specific incidental information to the selection unit 31. Here, a case will be described in which the incidental information processing unit 34 stores in advance related information associating electrocardiographic synchronized imaging as specific incidental information with a cardiac phase, a slice position, and an imaging type. The incidental information processing unit 34 searches whether the incidental information received from the reading unit 2 includes ECG synchronous imaging. When the incidental information received from the reading unit 2 includes ECG synchronous imaging, the incidental information processing unit 34 outputs the cardiac phase, slice position, and imaging type associated with the ECG synchronous imaging to the selection unit 31. The selection unit 31 selects three types of supplementary information received from the supplementary information processing unit 34 and associates them with the axes of the three-dimensional coordinates. The selection unit 31 outputs the associated information type and the axis of the three-dimensional coordinates to the display control unit 4 as related information.

  Here, when the selection unit 31 receives an instruction from the operation unit 7 to associate the type of the auxiliary information for each axis of the three-dimensional coordinates based on the auxiliary information by the reading unit 2, the auxiliary information received from the auxiliary information processing unit 34. Select the type. FIG. 9 is a schematic diagram showing a display screen when the selection unit 31 receives this instruction. The display control unit 4 causes the display unit 6 to display the automatic setting screen P3. The window A1 and the click area A2 are windows for receiving an instruction for the selection unit 31 to select the type of incidental information to be associated with the three-dimensional coordinate axis based on the incidental information of the image data. When the selection unit 31 receives a click operation on the click area A2 or a command input from the operation unit 7 such as a pull-down menu of the window A1 or a keyboard, the selection unit 31 sets the incidental information associated with the axis of the three-dimensional coordinate based on the incidental information of the image data. Select the type.

  The association unit 3 may further include a frequency storage unit 33, and may associate the types of the incidental information for each axis of the three-dimensional coordinates based on the incidental information and the number of selections. For example, when the selection unit 31 receives an instruction “selection number (heart phase priority)” via the window A 1, the selection unit 31 outputs a control signal representing the instruction to the auxiliary information processing unit 34. The incidental information processing unit 34 searches whether the incidental information received from the reading unit 2 includes incidental information representing a cardiac phase. When the incidental information indicating the cardiac phase is included in the incidental information received from the reading unit 2, the incidental information processing unit 34 outputs the cardiac phase that is the type of incidental information to the selection unit 31. The selection unit 31 associates the cardiac phase with the axis of the three-dimensional coordinate. Further, the selection unit 31 selects two types of incidental information in descending order of the number of selections stored in the number storage unit and associates them with the axes of the three-dimensional coordinates. Further, when the incidental information received from the reading unit 2 does not include incidental information representing a cardiac phase, the incidental information processing unit 34 outputs a control signal representing a search result not included to the selection unit 31. At this time, like the first modification of the first embodiment, the selection unit 31 selects three types of incidental information and three-dimensional coordinate axes based on the number of selections, and outputs them to the display control unit 4 as related information. To do.

  FIG. 10 is a flowchart showing the operation of the medical image processing apparatus 1c according to this modification.

(S201)
The reading unit 2 reads a plurality of image data with accompanying information. The reading unit 2 outputs the read plurality of image data to the display control unit 4 together with the accompanying information.

(S202)
When the selection unit 31 receives an instruction from the operation unit 7 to associate the types of the incidental information for each axis of the three-dimensional coordinates based on the incidental information by the reading unit 2 (S202; YES), the process proceeds to S203. When the selection unit 31 does not receive an instruction to associate the types of the incidental information for each axis of the three-dimensional coordinates based on the incidental information by the reading unit 2 (S202; NO), the process proceeds to S204.

(S203)
The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4. The incidental information processing unit 34 acquires incidental information of a plurality of image data from the reading unit 2. The incidental information processing unit 34 outputs three types of incidental information to the selection unit 31 based on the acquired plurality of incidental information. The selection unit 31 selects three types of supplementary information received from the supplementary information processing unit 34 and associates them with the axes of the three-dimensional coordinates. The selection unit 31 outputs the associated information type and the three-dimensional coordinate axis to the display control unit 4 as related information.

(S204)
The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4. In addition, the selection unit 31 associates the type of incidental information selected from the types of incidental information in the coordinate information unit 32 for each axis of the three-dimensional coordinate. In addition, the selection unit 31 associates arrangement order information indicating the arrangement order by the display control unit 4 for each type of incidental information. The selection unit 31 outputs to the display control unit 4 related information representing the type of incidental information associated with each of the axes of the three-dimensional coordinates and the arrangement order information.

(S205)
The display control unit 4 receives three-dimensional coordinates from the coordinate information unit 32, receives a plurality of image data from the reading unit 2, and receives related information from the selection unit 31. The display control unit 4 collates the types, axes, and order of the incidental information associated with the related information with the incidental information of the plurality of image data, and arranges the plurality of image data in a three-dimensional coordinate space.

(S206)
The display control unit 4 causes the display unit 6 to display images of a plurality of arranged image data.

[effect]
The effect of the medical image processing apparatus 1c according to this modification will be described. The medical image processing apparatus 1c associates the types of the incidental information for each axis of the three-dimensional coordinates based on the incidental information of the image data. Accordingly, it is possible to provide the medical image processing apparatus 1c that easily associates the types of the incidental information with the axes of the three-dimensional coordinates according to the plurality of read image data and improves the listability of the plurality of medical images.

<Modification 3 of the first embodiment>
FIG. 11 is a block diagram showing a configuration of a medical image processing apparatus 1d according to this modification. The medical image processing apparatus 1d of this modification is different from the medical image processing apparatus 1a of the first embodiment in the configuration of the related unit 3. Hereinafter, description of matters similar to those of the medical image processing apparatus 1a of the first embodiment may be omitted.

  The association unit 3 newly associates the type of incidental information for each axis of the three-dimensional coordinates. The association unit 3 includes a selection change unit 35. Upon receiving an input from the operation unit 7, the selection change unit 35 changes the type of incidental information selected by the selection unit 31 and the axis of the three-dimensional coordinate. The selection unit 31 outputs the changed type of incidental information and the three-dimensional coordinate axis to the display control unit 4 as new related information.

  The display control unit 4 arranges images of a plurality of image data in a three-dimensional coordinate space and newly displays them on the display unit 6 based on the newly associated type of incidental information. At this time, the display control unit 4 collates the type of incidental information and the axis of the three-dimensional coordinate associated with the new related information received from the selection unit 31 with the incidental information of the plurality of image data received from the reading unit 2. A plurality of image data are newly arranged in a three-dimensional coordinate space. The display control unit 4 causes the display unit 6 to display images of a plurality of newly arranged image data.

  Here, the input content from the operation unit 7 and the change content by the selection change unit 35 are preset in a one-to-one relationship. For example, when the operation unit 7 receives a horizontal drag operation by the user, the selection unit 31 receives the input content representing the operation, and the type of incidental information associated with the x-axis and the incidental information associated with the z-axis Swap the type of and newly associate. For example, when the operation unit 7 receives a drag operation in the vertical direction by the user, the selection unit 31 receives the input content representing the operation and associates the type of incidental information associated with the y axis and the z axis. Swap the type of incidental information and make a new association. 12A and 12B are schematic diagrams showing images of image data newly arranged. FIG. 12A shows the display screen P2 after the type of incidental information associated with the x-axis and the type of incidental information associated with the z-axis are switched from the display screen P2 shown in FIG. In the x-axis direction, the time-series contrast tomographic images n3 are arranged in order of time. In the z-axis direction, tomographic images of image data are arranged in the order from the head side to the foot side of the subject. FIG. 12B shows the display screen P2 after the type of incidental information associated with the y-axis and the type of incidental information associated with the z-axis are switched from the display screen P2 shown in FIG. In the y-axis direction, time-series contrast tomographic images n3 are arranged in time order. In the z-axis direction, images of image data are arranged for each shooting type. In this way, a plurality of images can be displayed appropriately corresponding to various purposes of diagnosis and interpretation by displaying images while receiving a simple operation and changing the arrangement.

  Note that the selection changing unit 35 may change the arrangement order information of the type of incidental information associated with the axis of the three-dimensional coordinate. At this time, the selection changing unit 35 outputs the changed arrangement order information to the display control unit 4. The display control unit 4 collates the arrangement order information received from the selection change unit 35 with the incidental information of the image data, and newly arranges a plurality of image data in a three-dimensional coordinate space. The display control unit 4 causes the display unit 6 to display images of a plurality of newly arranged image data. 13A and 13B are schematic diagrams illustrating images of image data in which the arrangement order information is changed. For example, the selection changing unit 35 receives an instruction to arrange a predetermined imaging time on the foreground in the time-series contrast tomographic image n3 and changes the arrangement order information. At this time, the arrangement order information may be changed together with the scanogram n1 and the tomographic image n2 as shown in FIG. 13A, or the arrangement order information of only the time-series contrast tomographic image n3 may be changed as shown in FIG. 13B.

  The related unit 3 stores a plurality of the image data by the reading unit 2 in a data structure of a multidimensional array in which the type of incidental information is set to a dimension of 4 dimensions or more, and among the dimensions of the multidimensional array, The types of incidental information set in the three dimensions may be associated with the axes of the three-dimensional coordinates. At this time, the association unit 3 receives the image data from the reading unit 2, and stores the image data in a data structure of a multidimensional array having four or more dimensions. This data structure is a multidimensional array in which the type of incidental information is set as a dimension. In the association unit 3, each image data is arranged at each address of the multidimensional array based on the accompanying supplementary information. Here, the related unit 3 receives the designation of the type of the incidental information from the operation unit 7, and sets the designated type of the incidental information as the dimension of the multidimensional array. The association unit 3 refers to the incidental information of the plurality of image data and the type of incidental information set in the dimension of the multidimensional array, and arranges each image data at each address of the multidimensional array. The association unit 3 stores a multidimensional array in which image data is arranged in this way. Note that the upper limit of the number of dimensions of the multidimensional array may be set as appropriate based on the specifications of the hardware mounted on the medical image processing apparatus 1d.

  The association unit 3 receives, from the operation unit 7, designation of the type of incidental information associated with the axis of the three-dimensional coordinate among the types of incidental information set for the dimensions of the multidimensional array. The association unit 3 outputs the specified type of incidental information to the selection unit 31. The selection unit 31 associates the type of incidental information received from the association unit 3 with a three-dimensional coordinate axis. The display control unit 4 refers to the multidimensional array by the association unit 3 and the type of incidental information by the selection unit 31. At this time, the display control unit 4 refers to the dimension of the multidimensional array in which the type of the incidental information by the selection unit 31 is set. The display control unit 4 three-dimensionally arranges a plurality of image data with the referenced dimension as the dimension of the three-dimensional arrangement.

  In addition, the association unit 3 stores in advance the associated information type together with related order information indicating the order of newly associating with each axis of the three-dimensional coordinates, and the type of the accompanying information for each axis of the three-dimensional coordinates based on the related order information. May be newly associated. In this case, the selection changing unit 35 stores the type of the incidental information together with the related order information in advance. For example, when receiving the input from the operation unit 7, the selection changing unit 35 outputs the type of incidental information corresponding to the next order of the types of incidental information already associated to the selection unit 31. The selection unit 31 associates the type of the incidental information with the axis of the three-dimensional coordinate and newly outputs it to the display control unit 4 as related information. The display control unit 4 collates the types of incidental information and the axes of the three-dimensional coordinates associated with the newly received related information with the incidental information of the plurality of image data received from the reading unit 2, and displays the plurality of image data. A new arrangement is made in a three-dimensional coordinate space. The display control unit 4 causes the display unit 6 to display images of a plurality of newly arranged image data.

  Here, an example will be described in which the association unit 3 associates the imaging type, the slice position, the imaging time, and the cardiac phase with the dimensions of the multidimensional array as the types of incidental information. For example, the association unit 3 uses the slice information as the type of incidental information associated with the axis of the three-dimensional coordinate among the imaging type, slice position, imaging time, and cardiac phase, which are types of incidental information set in the dimensions of the multidimensional array. It receives designations that associate the position, shooting type, and shooting time. The association unit 3 outputs the specified type of incidental information to the selection unit 31. The selection unit 31 associates the type of incidental information received from the association unit 3 with a three-dimensional coordinate axis. For example, the selection unit 31 associates the slice position with the x axis, the imaging type with the y axis, and the imaging time with the z axis. The display control unit 4 refers to the dimension of the multidimensional array in which the slice position, the imaging type, and the imaging time, which are the types of incidental information by the selection unit 31, are set. The display control unit 4 three-dimensionally arranges a plurality of image data, with the referenced slice position, photographing type, and photographing time dimension as the dimensions of the three-dimensional array.

  Further, the selection changing unit 35 performs imaging in the following order in which the slice position is associated with the x axis, the imaging type is associated with the y axis, and the imaging time is associated with the z axis, with the cardiac phase as the x axis and the slice position as the y axis. A description will be given of an example in which related order information in which the time is associated with the z-axis and is associated information is stored in advance. When receiving the input from the operation unit 7, the selection changing unit 35 is a type of incidental information corresponding to the next order of the slice position, the imaging type, and the imaging time, which are already associated types of incidental information. The slice position and the imaging time are output to the selection unit 31. The selection unit 31 associates the cardiac phase with the x-axis, the slice position with the y-axis, the imaging time with the z-axis, and newly outputs the related information to the display control unit 4. The display control unit 4 newly arranges a plurality of image data in the coordinates of the three-dimensional space based on the newly received related information. The display control unit 4 causes the display unit 6 to display images of a plurality of newly arranged image data.

  The selection changing unit 35 may output the type of incidental information corresponding to the next related order information to the selection unit 31 every time an input from the operation unit 7 is received. At this time, each time the selection unit 31 receives the type of the incidental information from the selection change unit 35, the selection unit 31 associates the type of the incidental information with the axis of the three-dimensional coordinate and newly outputs the associated information to the display control unit 4. . Each time the display control unit 4 receives the related information from the selection unit 31, the type of the auxiliary information associated with the received related information and the axes of the three-dimensional coordinates and the auxiliary of the plurality of image data received from the reading unit 2 The information is collated, a plurality of image data are newly arranged in a three-dimensional coordinate space, and images of the arranged plurality of image data are displayed on the display unit 6.

  In addition, the display control unit 4 receives the input from the operation unit 7 and displays the projected image of the three-dimensional space displayed on the display unit until the display unit 6 displays a plurality of newly arranged image data. Alternatively, it may be displayed in a specific display mode. The specific display mode visually represents a change in the arrangement of a plurality of image data. For example, an animation display that rotates a three-dimensional space is an example of this display mode. Thereby, the user can visually recognize the change operation of the arrangement by the medical image processing apparatus 1d.

  FIG. 14 is a flowchart showing the operation of the medical image processing apparatus 1d according to this modification.

(S301)
The reading unit 2 reads a plurality of image data with accompanying information. The reading unit 2 outputs the plurality of read image data to the display control unit 4.

(S302)
The coordinate information unit 32 outputs the determined three-dimensional coordinates to the display control unit 4. In addition, the selection unit 31 associates the type of incidental information selected from the types of incidental information in the coordinate information unit 32 for each axis of the three-dimensional coordinate. In addition, the selection unit 31 associates arrangement order information indicating the arrangement order by the display control unit 4 for each type of incidental information. The selection unit 31 outputs to the display control unit 4 related information representing the type of incidental information associated with each of the axes of the three-dimensional coordinates and the arrangement order information.

(S303)
The display control unit 4 receives three-dimensional coordinates from the coordinate information unit 32, receives a plurality of image data from the reading unit 2, and receives related information from the selection unit 31. The display control unit 4 collates the types, axes, and order of the incidental information associated with the related information with the incidental information of the plurality of image data, and arranges the plurality of image data in a three-dimensional coordinate space.

(S304)
The display control unit 4 causes the display unit 6 to display images of a plurality of arranged image data.

(S305)
The selection changing unit 35 receives an input from the operation unit 7 and changes the type of incidental information selected by the selection unit 31 and the axis of the three-dimensional coordinate. The selection unit 31 outputs the changed type of incidental information and the three-dimensional coordinate axis to the display control unit 4 as new related information.

(S306)
The display control unit 4 collates the types of incidental information and the axes of the three-dimensional coordinates associated with the new related information received from the selection unit 31 with the incidental information of the plurality of image data received from the reading unit 2. Are newly arranged in a three-dimensional coordinate space.

(S307)
The display control unit 4 causes the display unit 6 to display images of a plurality of newly arranged image data.

[effect]
The effect of the medical image processing apparatus 1d according to this modification will be described. The medical image processing apparatus 1d newly associates types of incidental information for each axis of three-dimensional coordinates, and arranges images of a plurality of image data in a three-dimensional coordinate space based on the types of newly associated incidental information. Then, it is newly displayed on the display unit 6. Further, the medical image processing apparatus 1d stores in advance the associated information type together with related order information indicating the order of newly associating with each axis of the three-dimensional coordinate, and adds incidental information for each axis of the three-dimensional coordinate based on the related order information. The types may be newly associated sequentially. Accordingly, it is possible to provide the medical image processing apparatus 1d that easily associates the types of the incidental information with the axes of the three-dimensional coordinates according to the plurality of read image data and improves the listability of the plurality of medical images.

Second Embodiment
[Constitution]
FIG. 15 is a block diagram showing the configuration of the medical image diagnostic apparatus 10 of this embodiment. The medical image diagnostic apparatus 10 includes an imaging unit 9, a reading unit 2, a related unit 3, a display control unit 4, a system control unit 5, a display unit 6, and an operation unit 7. The medical image diagnostic apparatus 10 of this embodiment is different from the medical image processing apparatus 1a of the first embodiment in the configuration of the imaging unit 9. Hereinafter, description of matters similar to those of the medical image processing apparatus 1a of the first embodiment may be omitted.

  The imaging unit 9 generates a plurality of image data of the subject with the accompanying information. For example, the imaging unit 9 scans the subject with X-rays, collects data, and processes the collected data with a computer, thereby generating image data obtained by imaging the inside of the subject (X-ray CT). Shooting). The imaging unit 9 may generate image data obtained by imaging the biological information of the subject by transmitting an ultrasonic wave into the subject using an ultrasonic probe and receiving a reflected wave thereof ( Ultrasound imaging). The imaging unit 9 may generate image data obtained by imaging the inside of the subject using a magnetic resonance phenomenon (magnetic resonance imaging). Further, the imaging unit 9 may detect X-rays transmitted through the subject and generate image data obtained by imaging the inside of the subject (X-ray imaging). The imaging unit 9 also generates image data representing the functional distribution of the subject by simultaneously counting and calculating gamma rays emitted from the subject to which the compound labeled with the positron emitting nuclide is administered. (PET photography). The imaging unit 9 attaches incidental information to the image data. For example, the photographing unit 9 attaches incidental information to the image data as header information.

  The reading unit 2 reads a plurality of image data. At this time, the reading unit 2 reads a plurality of image data with accompanying information from the photographing unit 9. The reading unit 2 outputs the read plurality of image data to the display control unit 4 together with the accompanying information. The association unit 3 has information on three-dimensional coordinates, and associates the types of incidental information for each axis of the three-dimensional coordinates. The related unit 3 outputs related information representing the type of incidental information associated with each of the three-dimensional coordinates to the display control unit 4. The display control unit 4 arranges images of a plurality of image data in a three-dimensional coordinate space and displays them on the display unit 6 based on the type of incidental information associated with each axis of the three-dimensional coordinate.

  As described above, the medical image diagnostic apparatus 10 includes the imaging unit 9, the reading unit 2, the related unit 3, and the display control unit 4. The imaging unit 9 generates a plurality of image data of the subject with the accompanying information. The reading unit 2 reads a plurality of image data. The association unit 3 has information on three-dimensional coordinates, and associates the types of incidental information for each axis of the three-dimensional coordinates. The display control unit 4 arranges images of a plurality of image data in a three-dimensional coordinate space and displays them on the display unit 6 based on the type of incidental information associated with each axis of the three-dimensional coordinate. Accordingly, it is possible to provide the medical image diagnostic apparatus 10 that improves the listability of a plurality of medical images.

<Effects common to the embodiments>
According to the medical image processing apparatus or the medical image diagnostic apparatus of at least one embodiment described above, an image of a plurality of image data is converted into three-dimensional coordinates based on the type of incidental information associated with each axis of the three-dimensional coordinates. It is possible to improve the listability of a plurality of medical images by arranging them in the space and displaying them on the display unit.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1a, 1b, 1c, 1d Medical image processing apparatus 2 Reading part 3 Related part 4 Display control part 5 System control part 6 Display part 7 Operation part 8 Image memory | storage part 9 Imaging part 10 Medical image diagnostic apparatus 31 Selection part 32 Coordinate information part 33 Number of times storage part 34 Attached information processing part 35 Selection change part

Claims (8)

A reading unit for reading a plurality of image data with accompanying information;
3D coordinate information and the accompanying information type are received from the operation unit when an instruction to select the accompanying information type and the 3D coordinate axis is received from the operation unit, and the accompanying information type and the 3D By selecting a coordinate axis, an associated part that associates the type of the incidental information for each axis of the three-dimensional coordinate;
A display control unit configured to arrange a plurality of images of the image data in the space of the three-dimensional coordinates and display the images on a display unit based on the type of the incidental information associated with each axis of the three-dimensional coordinates. ,
The related part is
The type of the supplementary information selected in the past and the number of selections of the type selected are stored, and the instruction to select the type of the supplementary information and the axis of the three-dimensional coordinate based on the stored selection number is the operation When the information is received from a section, the type of the incidental information and the axis of the three-dimensional coordinate are selected based on the number of selections, thereby associating the type of the incidental information for each axis of the three-dimensional coordinate. Medical image processing apparatus.   The medical image processing apparatus according to claim 1, wherein the association unit associates arrangement order information indicating the order of the arrangement for each type of the incidental information.   The association unit includes the information of the three-dimensional coordinate and the type of the incidental information, and associates the type of the incidental information selected from the type of the incidental information for each axis of the three-dimensional coordinate. Item 2. The medical image processing apparatus according to Item 1. 2. The medical image processing according to claim 1, wherein the association unit receives the incidental information from the reading unit and associates the type of the incidental information for each axis of the three-dimensional coordinate based on the incidental information. apparatus. The related unit stores a plurality of the image data by the reading unit in a data structure of a multidimensional array in which the type of the auxiliary information is set to a dimension of 4 dimensions or more, and among the dimensions of the multidimensional array, 3 The medical image processing apparatus according to claim 1, wherein the types of incidental information set in one dimension are associated with the axes of the three-dimensional coordinates. The association unit newly associates the type of the incidental information for each axis of the three-dimensional coordinates,
The display control unit arranges a plurality of images of the image data in the space of the three-dimensional coordinates based on the newly associated type of incidental information, and causes the display unit to newly display the images. The medical image processing apparatus according to claim 1 . The related unit stores in advance, together with related order information indicating an order of newly associating the type of the incidental information for each axis of the three-dimensional coordinate, and the incidental information for each axis of the three-dimensional coordinate based on the related order information. The medical image processing apparatus according to claim 1, wherein new types of information are sequentially associated with each other. An imaging unit for generating a plurality of image data of a subject with accompanying information;
A reading unit for reading a plurality of the image data;
3D coordinate information and the accompanying information type are received from the operation unit when an instruction to select the accompanying information type and the 3D coordinate axis is received from the operation unit, and the accompanying information type and the 3D By selecting a coordinate axis, an associated part that associates the type of the incidental information for each axis of the three-dimensional coordinate;
A display control unit configured to arrange a plurality of images of the image data in the space of the three-dimensional coordinates and display the images on a display unit based on the type of the incidental information associated with each axis of the three-dimensional coordinates. ,
The related part is
The type of the supplementary information selected in the past and the number of selections of the type selected are stored, and the instruction to select the type of the supplementary information and the axis of the three-dimensional coordinate based on the stored selection number is the operation When the information is received from a section, the type of the incidental information and the axis of the three-dimensional coordinate are selected based on the number of selections, thereby associating the type of the incidental information for each axis of the three-dimensional coordinate. Medical image diagnostic device.

Images