JP2011078527A - Medical image management device and medical image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique permitting the learning of special operations to be supported by permitting a special modifying operation for medical images which is previously carried out to be stored and modifications to be reproduced together with the result of image processing based on the operation. <P>SOLUTION: The medical image management device records the detail of a changing operation at a prescribed interval at the time when an image display mode is changed on the basis of the amount of change of a display mode in accordance with the movement direction of a specified position on a display screen and a unit amount of movement. Furthermore, a control means displays the detail of the record and the progress of the change of the display mode in parallel. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a medical image management apparatus including a medical image display apparatus used for browsing medical images, and more particularly to a technique for storing and reproducing and displaying a change processing operation of a display mode of medical images.

  Conventionally, in the medical field, various medical image diagnostic apparatuses such as an X-ray diagnostic apparatus, an X-ray CT (Computed Tomography: X-ray computed tomography) apparatus, an MRI (Magnetic Resonance Imaging), and an ultrasonic diagnostic apparatus have been used. Many medical institutions have introduced such medical image diagnostic apparatuses. Diagnosis using images generated by each of these medical image diagnostic apparatuses is actively performed.

  A medical image or the like generated by such a medical image diagnostic apparatus is not always used immediately for image interpretation or image diagnosis when it is generated. For example, it may be used for interpretation and image diagnosis at different times and places from the generation of medical images. Corresponding to this situation, image data of medical images is commonly managed in medical institutions such as hospitals.

  Data handled in a medical institution such as this image data is operated by a PACS (Picture Archiving and Communication System) so that each device and each device can communicate with each other through a network in the medical institution. Yes.

  The PACS is a system that has a medical image server and a medical image display device (viewer) and can digitally store, communicate, and display medical image data obtained by various types of image diagnostic equipment.

  The medical image display apparatus is provided with a function for supporting interpretation work for a medical image to be interpreted. For example, various types of image processing can be executed as a function of the medical image display apparatus. For example, enlargement, reduction, rotation, or gradation processing of the displayed medical image, annotation addition to the medical image, ROI setting in the medical image, or analysis of the set ROI can be performed.

  When a doctor or the like performs image processing when interpreting a medical image, the doctor or the like operates an operation means such as a mouse to perform various processes on the medical image displayed on the screen. When this image processing is, for example, gradation processing, a window level (WL / Window Level) and a window width (WW / Window Width) are set by the operating means.

  As an example of an operation related to such image processing, there is a mouse operation performed under conditions of a preset mouse mode. In one mouse mode, what kind of processing is performed for various mouse operations is set. When the mouse mode is switched, the processing associated with the mouse operation is changed. The mouse operation includes general mouse operations such as left click, right click, double click, drag and drop, wheel rotation, or a combination of click and keyboard operations. In this mouse mode, various image processes are assigned and set in advance for each single operation or combination of operations of the mouse (for example, Patent Document 1).

  After two medical images are displayed on the medical image display screen, the medical image displayed in the other display area is transferred to the display area side of one medical image by a mouse operation, that is, drag and drop, etc. A medical image display apparatus having a function of executing various image processes is proposed (for example, Patent Document 2). In this medical image display device, a new tomographic image data in the same cross-sectional direction as the medical image of the drag-and-drop source is generated by the drag-and-drop operation of the mouse under the set condition, or the drag-and-drop source It is possible to reflect the annotation suitable for the medical image of the drag and drop destination.

  Image processing operations for assisting image interpretation in such a medical image display apparatus are not shared. For example, there are settings for each medical image display device, and there are also settings specific to a doctor who performs image processing when there are a plurality of settings for each medical image display device. Such an image processing operation can be performed quickly and smoothly by experience by an experienced doctor or the like. However, for those who are not familiar with the specific image processing operation, it is impossible to perform the operation, or even if the operation is possible, the operation is difficult and the image processing and the interpretation work are difficult. .

  Therefore, conventionally, in order to reproduce the image processing operation of a skilled doctor, the image processing operation performed in the medical image display device has been stored as a program such as a macro. The stored macro or the like can be read later to reproduce the process. A person who is not used to image processing has been proposed to perform image processing without performing a specific image processing operation performed in advance by processing the stored macro or the like.

JP 2005-296156 A JP 2007-282656 A

  However, for those who have little experience in image processing operations, it is not possible to understand the actual operation only by executing a stored macro or the like for a specific image processing operation set for each medical image display device or for each doctor. There is a case. For example, in the case of mouse operations, the distinction between left and right clicks, double clicks, and drags cannot be understood simply by executing a macro, etc., and changes in various parameters related to medical images can be made only by reproducing the macro. It is difficult to grasp.

  In particular, a person who has little experience in image processing operation may not be able to obtain necessary information by reproducing a macro or the like for a specific image processing operation set for each medical image display device and each doctor. Therefore, it has been difficult to learn a specific image processing operation by reproducing a macro or the like.

  The present invention has been made in view of the above problems, and its purpose is to learn operation processing by storing change processing operations performed on medical images and making the operations reproducible. It is to provide a technology that can support this.

In order to achieve the above object, the invention described in claim 1 is capable of displaying a medical image on a screen, a plurality of types of operations, and indicating each coordinate position on the screen. Operation setting information associating operation means, operation types of the plurality of types of operations, types of change processing of a plurality of types of display modes of medical images, and movement directions of designated positions on the screen by the operation means. The medical image displayed on the display unit on the basis of the selected operation setting information by executing the selection of the operation setting information, the operation, and the movement of the designated position by the storage unit storing in advance Display change processing means for changing the display mode, and when the display mode is changed by the display change processing means, an operation for each operation type by the operation means and the indicated position are determined. Recording means for recording at the timing, and control means for reproducing and displaying the change in the display mode of the medical image and the recording result in parallel on the display means based on the recording result and the operation setting information by the recording means And a medical image management apparatus.
In order to achieve the above object, the invention described in claim 8 includes a display unit for displaying a medical image, a plurality of pieces of processing information indicating contents of a plurality of types of display change processing for the displayed medical image, respectively. , Operation setting storage means for storing operation information indicating a plurality of types of operation contents for performing each display change process in association with each other, an operation means used for the plurality of types of operations, and the operation means When at least one of the plurality of types of operations is executed, the operation information corresponding to the operation is specified, the processing information corresponding to the operation information is read from the operation setting storage unit, and the medical Display change processing means for executing the display change processing on the displayed medical image according to the read processing information with respect to the image;
When the display change process is performed on the medical image by the display change processing unit, the operation information related to the executed operation and the process information related to the executed display change process are recorded in association with each other at predetermined time intervals. And an operation content recording means for performing, after the recording, reproducing and displaying the change in the display mode of the medical image by the display change processing on the display means, and simultaneously recording the recording result by the operation content recording means with the reproduction display. And a control means for displaying on the display means.

  According to the present invention, when the medical image is interpreted, the reproduction display of the change process of the display mode of the medical image and the recorded operation content can be displayed in parallel, so that the operation of the medical image display device such as a doctor can be performed. Can support acquisition.

It is a schematic block diagram which shows the outline | summary of the whole structure of the medical image management apparatus concerning embodiment of this invention. It is a schematic block diagram which shows the outline | summary of a function structure of the medical image display apparatus and the medical image storage apparatus in the medical image management apparatus concerning embodiment of this invention. It is the schematic which shows an example of the operation means in a medical image display apparatus. It is the schematic which shows the outline | summary of the operation setting table memorize | stored in the medical image display apparatus of the medical image management apparatus concerning 1st Embodiment of this invention. It is the schematic which shows the outline | summary of the operation history preservation | save table memorize | stored in the medical image storage apparatus of the medical image management apparatus concerning 1st Embodiment of this invention. It is the schematic which shows the outline | summary of an example of the operation means in the medical image display apparatus of the medical image management apparatus concerning this Embodiment, a display means, and a process operation reproduction image. 5 is a flowchart showing an outline of an operation from the display of an examination list to the selection of a mouse mode in an operation for changing an image display mode such as image processing by the medical image display apparatus according to the first embodiment of the present invention. is there. In the operation of changing the display mode of an image such as image processing by the medical image display apparatus according to the first embodiment of the present invention, an outline of the operation from when a mouse operation is received under the mouse mode until the operation history is stored is shown. It is a flowchart to show. It is the schematic which shows the outline | summary of the operation history preservation | save table memorize | stored in the medical image storage apparatus of the medical image management apparatus concerning the 1st modification of embodiment of this invention. It is the schematic which shows the image search screen for searching the process operation reproduction image concerning the 2nd modification of embodiment of this invention. It is the schematic which shows the outline | summary of the process operation reproduction image and operation content display area which were displayed on the medical image display apparatus of the medical image management apparatus concerning the 3rd modification of embodiment of this invention.

  Hereinafter, an exemplary embodiment of the present invention will be described with reference to FIGS.

[First Embodiment]
(overall structure)
An outline of the overall configuration of the medical image management apparatus 1 according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic block diagram showing an outline of the overall configuration of a medical image management apparatus 1 according to an embodiment of the present invention.

  As shown in FIG. 1, a medical image management apparatus 1 is connected to medical image diagnostic apparatuses 50 and 60 via a network N such as a LAN (Local Area Network), and medical images photographed by the medical image diagnostic apparatus 50 or the like. The image data is managed, stored, displayed, and communicated, and image processing is performed. The medical image management apparatus 1 also stores medical image display apparatuses (viewers) 100 and 101 used by doctors and the like for interpretation, and image data of captured medical images and medical images that have undergone image processing. The medical image storage apparatuses 300 and 301 are included. In the medical image management apparatus 1, the medical image display apparatuses 100 and 101 and the medical image storage apparatuses 300 and 301 are connected to each other via a network N and can communicate with each other. In FIG. 1, two medical image display apparatuses 100 and 101 are shown for convenience, but in the actual medical image management apparatus 1, the number of medical image display apparatuses varies depending on the medical institution.

  The medical image diagnostic apparatuses 50 and 60 perform imaging based on an examination order, and generate a medical image by the imaging. As the medical image diagnostic apparatuses 50 and 60, various modalities such as an X-ray diagnostic apparatus, an X-ray CT apparatus, an MRI, an ultrasonic diagnostic apparatus, and a nuclear medicine diagnostic apparatus are used. Further, the medical image image data taken by the medical image diagnostic apparatuses 50 and 60 is added with the examination ID, patient information, examination date and time, photographing condition information, etc. concerning the medical image, for example, as a DICOM image file. It is sent to the devices 300 and 301 and stored. In FIG. 1, two medical image diagnostic apparatuses 50 and 60 are shown for convenience, but the actual number of medical image diagnostic apparatuses varies depending on the medical institution.

(Medical image display device)
Next, the medical image display apparatuses 100 and 101 in the medical image management apparatus 1 of the present embodiment will be described with reference to FIGS. FIG. 2 is a schematic block diagram showing an outline of functional configurations of the medical image display device 100 and the medical image storage device 300 in the medical image management device 1 according to the embodiment of the present invention. FIG. 3 is a schematic diagram illustrating an example of the operation unit 120 in the medical image display apparatus 100. FIG. 4 is a schematic diagram showing an outline of the operation setting table 80 stored in the medical image display apparatus 100 of the medical image management apparatus 1 according to the embodiment of the present invention. FIG. 5 is a schematic diagram showing an outline of the operation history storage table 90 stored in the medical image storage apparatus 300 of the medical image management apparatus 1 according to the embodiment of the present invention. 2 shows the medical image display apparatus 100, the medical image display apparatus 101 has the same configuration as the medical image display apparatus 100 shown in FIG. Similarly, the medical image storage apparatus 301 has the same configuration as the medical image storage apparatus 300 shown in FIG.

[Constitution]
As shown in FIG. 2, the medical image display apparatus 100 includes a transmission / reception unit 110, an operation unit 120, a main control unit 130, a display unit 140, a storage unit 150, and a change processing control unit 160. Composed. Among these, the transmission / reception means 110 is an interface (I / F) for transmitting / receiving data and control signals to / from the medical image storage apparatus 300 and the like. For example, the medical image display apparatus 100 transmits a control signal requesting image data of a medical image to the medical image storage apparatus 300 via the transmission / reception unit 110, and receives image data corresponding to the request. As the transmission / reception means 110, a network adapter such as a LAN card, a communication device such as a modem for connecting to the Internet, or a combination thereof can be used.

  The operation unit 120 is used in the medical image display device 100 for a medical image display operation, an image processing operation, and the like (hereinafter, also referred to as “image display mode change processing operation”). Here, the operation unit 120 in this embodiment needs to include at least a pointing device capable of designating an input position and coordinates on the screen of the display unit 140. For example, the operation unit 120 can perform various operations of the medical image display apparatus 100 by moving a cursor (pointer) on the screen of the display unit 140 and instructing icons, tabs, and scroll bars on the screen. Is possible. The cursor is a pictorial symbol or the like indicating the current coordinate position on the screen of the display unit 140.

  Further, the operation unit 120 performs not only the movement of the cursor on the screen of the display unit 140 but also a selection operation and a determination operation, and an image display mode change processing operation as shown in an operation setting table 80 (FIG. 4) described later. It is necessary for the configuration to be able to execute the operation event related to. For example, a mouse having a plurality of operation buttons that can be pressed can be used. As the other operation means 120, an arbitrary operation device such as a keyboard, a trackball, a trackpad, a joystick, or a digitizer or an input device can be used. One of these can be adopted, and a combination of a plurality of types of operation devices such as a combination of a mouse and a keyboard may be used.

  The main control unit 130 controls each unit in the medical image display apparatus 100 such as the transmission / reception unit 110, the display unit 140, the storage unit 150, and the change processing control unit 160. The main control means 330 includes an arithmetic control device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The change processing control unit 160 also has a configuration according to the hardware configuration of the main control unit 130. The control contents of the change processing control means 160 will be described later.

  The main control unit 130 displays an examination list, a medical image, a processing operation reproduction image, which will be described later, and the like on the display unit 140 based on data stored in the storage unit 150, the medical image storage apparatus 300, and the like. As the display unit 140, an LCD (Liquid Crystal Display), a CRT display (Cathode Ray Tube Display), or the like is used, and the display unit 140 can be configured as a multi-monitor such as a dual display.

  In the medical image display apparatus 100 shown in FIG. 2, the display unit 140 and the operation unit 120 are individually provided. A touch panel type LCD, tablet, or the like that integrates these units is used as the display operation unit. It is also possible to use it.

  The storage unit 150 temporarily stores an operation history (operation history storage table 90 in FIG. 5) and the like necessary for reproducing and displaying the change processing operation in the medical image display apparatus 100. Further, the storage unit 150 includes a GUI (Graphical User Interface / not shown) screen format used for the operation of the medical image display apparatus 100, a screen format of the above-described medical image display screen, a screen format of a reproduction image display screen described later, and a change process. The data (operation setting table 80 in FIG. 4) and the like necessary for the data are stored in a readable manner. The storage unit 150 includes a main storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk: Hard disk drive), and the like. The contents of the operation setting table 80 stored in advance in the storage unit 150 and the operation history storage table 90 temporarily stored will be described later.

[Operation means]
Next, an example of the operation means 120 used for the image display mode changing process for interpreting the medical image in the medical image management apparatus 1 of this embodiment will be described. In this description, a case where a mouse is included as the operation means 120 will be described. As shown in FIG. 3, the mouse here is provided with a main body held by an operator of the medical image display apparatus 100 and a right click button R, a mouse wheel W, and a left click button L arranged in order on one end side. ing. In addition to the mouse shown in FIG. 3, click buttons may be further provided on other parts such as the side of the mouse.

  The mouse as the operation means 120 in the present embodiment is a general mouse operation, that is, an operation of pressing the right click button R with the mouse stopped (hereinafter referred to as “right click”), and the left with the mouse stopped. An operation of pressing the click button L (hereinafter referred to as “left click”), an operation of rotating the mouse wheel W in the forward / reverse direction, and an operation of moving the mouse forward / backward / left / right while maintaining the state of pressing the right click button R. (Hereinafter, referred to as “right drag”), an operation according to the configuration of the mouse, such as an operation of moving the mouse in the front / rear and left / right directions while keeping the left click button L pressed (hereinafter referred to as “left drag”). It can be carried out. When these mouse operations are performed, a signal corresponding to the pressed button and a signal corresponding to the operation amount are sent to the main control means 130 as an operation signal. The mouse operation described here corresponds to an example of “plural types of operation” and “plural types of operation content” of the present invention.

[Operation setting table]
Next, an operation setting table 80 (FIG. 4) used for processing for interpreting a medical image in the medical image management apparatus 1 of this embodiment will be described. In the medical image management apparatus 1 of this embodiment, the main control unit 130 and the change processing control unit 160 are operated by the medical image storage apparatus 300 by performing an operation according to the operation setting table 80 set in advance by an operator or the like. The display mode of the medical image can be changed by performing various processes on the image data of the medical image read from the above. As a result, it is possible to support the interpretation operation of the viewer of the medical image and to reflect the result of the interpretation and image diagnosis performed there on the medical image subjected to the processing.

  The processing content by the change processing control unit 160 here is a change process of the display mode of the image, and includes, for example, movement, rotation, filtering, enlargement, reduction, gradation processing of the image on the screen of the display unit 140, Furthermore, settings of volume rendering, MIP (Maximum Intensity Projection) processing, MPR (Multi Planer Reconstruction) processing, and the like are included. This processing includes processing such as series synchronization, differential image generation, approximate cross-sectional image selection, fusion image generation, and the like, and further includes annotation / measurement result attachment processing. Processing such as display image switching and parallel display of images for performing these processes is also included in the processing content according to the operation setting table 80. Note that the processing content of the change processing of the operation setting table 80 described here corresponds to an example of “multiple types of change processing” and “multiple types of display change processing” of the present invention.

  As shown in FIG. 4, the operation setting table 80 includes identification ID information for each terminal of the medical image display device 100 and the like, and has a plurality of mouse modes MM1 to MMn for the identification ID. Further, each of the plurality of mouse modes MM1 to MMn has individual information. As the individual information, the operation content of the operation means 120 and the image display mode change processing content (change processing name) executed when the operation content is performed in the operation state of each mouse mode MM1 to MMn. There is. Further, as the information, there are specific processing contents associated with each mouse movement direction at the time of execution of the operation contents and a change amount of the specific processing contents according to the unit movement amount of the mouse cursor on the screen. These operation contents, change process contents, specific process contents, and change amounts are stored in association with the mouse modes MM1 to MMn of the operation setting table 80, respectively.

  Note that “the amount of change in the specific processing content according to the amount of unit movement of the mouse cursor” herein refers to, for example, an image display mode in which the coordinate position indicated by the mouse cursor has moved by a predetermined pixel. For example, increase / decrease of a numerical value indicating how much is changed (rotation angle, luminance, etc.). In the example shown in FIG. 4, the CT value for the window level and the window width increases or decreases by 10 HU (Hounsfield Unit) with respect to the movement of 3 pixels. Further, the mouse modes MM1 to MMn in this embodiment correspond to an example of “operation setting information” in the present invention. In addition, the “change amount of the specific processing content according to the unit movement amount” in the above corresponds to an example of “the change amount of the display mode according to the unit movement amount” of the present invention. Further, the contents of change processing in the operation setting table 80 (FIG. 4) correspond to an example of “plural processing information” of the present invention.

  The contents of the change process of the image display mode of the medical image that can be executed based on the operation setting table 80 are as described above. Note that “mouse movement ↑” in the operation setting table 80 in FIG. 4 is the movement direction of the mouse cursor C (see FIG. 5) on the displayed screen, and the actual movement direction of the mouse on the desk is forward. . Similarly, “mouse movement ↓” is the moving direction of the mouse cursor C on the displayed screen, and the actual moving direction of the mouse is backward. Further, the vertical direction, the front-rear direction, and the left-right direction shown here indicate directions in a state in which the viewer of the medical image is facing the screen of the display unit 140 (see FIG. 6) that is erected vertically. It is what. The movement direction of the mouse cursor C is obtained by comparing the current coordinate position of the mouse cursor C on the screen with the previous coordinate position. Note that the coordinate position indicated by the mouse cursor C in this embodiment corresponds to an example of the “designated position on the screen” of the present invention.

[Control of image display mode change processing]
Next, as an example of the processing for changing the image display mode of the medical image of the main control unit 130 and the change processing control unit 160 based on the operation setting table 80, the terminal identification ID “ Processing contents based on “mouse mode MM1” in “PC-A” will be described.

  The medical image display screen displayed on the display unit 140 is provided with a display (tab, drop-down menu, etc.) for selecting the mouse mode MM used for the image display mode change processing. When the mouse mode MM1 to MMn is selected on the medical image display screen by an operator such as a doctor, the medical image displayed on the display unit 140 is subjected to processing for changing the image display mode for interpretation. It becomes possible. Here, it is assumed that the mouse mode MM1 shown in FIG. 4 has been selected.

  When the mouse mode MM1 is selected, the main control unit 130 acquires information on the selected mouse mode MM1 from the operation setting table 80 (FIG. 4) of the storage unit 150 and transmits the information to the change processing control unit 160. . In the mouse mode MM1, when the operator performs a “right drag” + “move mouse cursor C” operation on the mouse as the operation unit 120, the change processing control unit 160 performs “gradation processing” of the medical image. Executed. For example, as shown in FIG. 4, when “right drag” and the moving direction of the mouse cursor C on the screen is “↑”, the change processing control means 160 changes the window level, that is, the median value of the luminance. A numerical value such as an assigned CT value increases.

  That is, when the operation is performed from the mouse after the selection operation of the mouse mode MM1, the main control unit 130 receives information on the operation amount of the mouse and an operation signal such as click / drag from the mouse. The main control means 130 moves and displays the position of the mouse cursor C on the screen of the display means 140 based on the operation amount information. Further, the main control means 130 changes the operation signals of “mouse mode MM1”, “information on the movement amount of the coordinate position” of the mouse cursor C, and the movement directions “↑” and “right drag” from the operation amount information. Transmit to means 160. Upon receiving these pieces of information, the change processing control means 160 confirms that the display mode change processing content corresponding to the operation is a gradation operation based on the acquired information of the mouse mode MM1 and the information “right drag”. recognize. Further, the change processing control means 160 recognizes that the operation is to increase the window level equivalent to the median luminance from the information of the moving direction “↑”.

  Further, the change processing control unit 160 performs the change processing on the image data of the medical image based on the recognized content of the change processing of the image display mode and the information on the movement amount of the mouse cursor C received from the main control unit 130. Do. Similarly, when the movement direction “↓” and “right drag” are operated, the change processing control means 160 decreases the window level of the image data based on the operation setting table 80, and the movement direction “←” and “right drag”. Is increased, the window width of the image data, that is, a value indicating a range such as a CT value for gradation display based on the window level is increased. Similarly, when the movement direction “→” and “right drag” are operated, the change processing control means 160 decreases the value indicating the window width of the image data.

  Information such as numerical values, pictograms, and character information of the image data to be changed by the change processing control unit 160 is added to the additional data of the image data received by the medical image display device 100 from the medical image storage devices 300 and 301 and the like. It may be included information. For example, when the image data of a medical image is a DICOM (Digital Imaging and Communication in Medicine) image file, the DICOM tag information is the additional data.

  As described above, the operator can perform processing for changing the image display mode for interpretation by adjusting each numerical value applied to the image data via the operation unit 120 such as a mouse. When the operator reselects the mouse modes MM1 to MMn, for example, the mouse mode MM2, the main control unit 130 stores information on the mouse mode MM2 corresponding to the selection in the operation setting table 80 of the storage unit 150 (FIG. 4). ) And the change processing content of the change processing control means 160 is switched. In addition, depending on the mouse mode MM1 to MMn, it is possible to execute processing for generating one medical image based on two or more medical images, such as image synthesis, and reflecting information in one medical image on other medical images. In addition, switching of display images, parallel display of display images, and the like can be performed by operating the mouse modes MM1 to MMn. The change processing control means 160 in the present embodiment corresponds to an example of “display change processing means” in the present invention.

  As described above, the medical image display apparatus 100 according to the present embodiment has a configuration in which the change processing control unit 160 or the like receives the operation of the operation unit 120 and executes the process according to the operation setting table 80 (FIG. 4). Further, in the operation setting table 80 in the medical image display apparatus 100, processing contents are assigned for each operation of the operation means 120 for each of the mouse modes MM1 to MMn. The same processing content can be assigned to different operations depending on the settings of the mouse modes MM1 to MMn in the operation setting table 80. Further, depending on a specific mouse mode MM, the same type of processing content is assigned to all operations, but it is also possible to configure the amount of change in processing by each operation to be different. Moreover, you may comprise so that one or more mouse modes MM1-MMn can be combined together.

  The selection of the mouse mode MM is not limited to the configuration performed on the medical image display screen (not shown). For example, when the keyboard is included as the operation unit 120, the mouse mode MM is selected by the function key of the keyboard. May be. Further, the operation for performing the image display mode changing process by the mouse mode MM includes not only the mouse operation but also the combination of the mouse operation and the keyboard operation. For example, as shown in FIG. 4, in the mouse mode MMn, the change processing control means 160, for example, parallelizes the currently displayed image and the next image by a combination operation of the left click and the control key “ctrl” on the keyboard. Process to display.

[Recording control of image display mode change processing history]
Next, an example of an operation history recording process related to an image display mode change process of the medical image display apparatus 100 according to the present embodiment will be described with reference to FIG. The change processing control means 160 of the medical image display apparatus 100 according to the present embodiment records a history of image display mode change processing operations performed on image data of medical images performed by an operator such as a doctor.

  In the medical image display apparatus 100, the display mode of the medical image can be changed as described above. Furthermore, the medical image display apparatus 100 responds to the selection operation of the mouse modes MM1 to MMn, and the data indicating the mouse mode MM, the content changed by the change processing control means 160, and the content of the operation related to the processing (hereinafter “operation content”). Information ”) and the history of the coordinate position of the mouse cursor C on the screen are associated with each other and recorded in the storage means 150 at predetermined time intervals (see FIG. 5). These recorded contents are recorded in association with an identification ID as identification information of a device that executes the change process.

  Here, an example of specific control of the recording process will be described. When an operator such as a doctor performs the selection operation of the mouse mode MM1 as described above via the operation unit 120 of the medical image display device 100, the main control unit 130 controls the operation setting table 80 (FIG. 4) based on the operation. ) To obtain information relating to the mouse mode MM1 and send it to the change processing control means 160. When the change processing control unit 160 obtains information related to the mouse mode MM1 from the main control unit 130, the change processing control unit 160 starts recording the history of the image display mode change processing operation. For example, the change processing control unit 160 records the following contents as the operation history storage table 90 as shown in FIG. In FIG. 5, the vertical axis indicates the passage of time.

  First, the change processing control means 160 uses the “identification ID” for each terminal or doctor as the record name of the change processing of the medical image display mode in the operation history, and the “examination ID” and “image ID” of the medical image related to the processing. "Mouse mode MM" acquired from the main control means 130, "operation event name" indicating the operation content of the operation means 120 under the condition of the mouse mode MM1, and the mouse cursor on the current display means 140 screen The current coordinate position (X, Y) of C is stored in association with the current date and the current time in units of thousandths of a second. The change processing control means 160 executes this recording at an interval of 1/1000 second. Here, the recording does not necessarily have to be performed at an interval of 1 / 1000th of a second, and the coordinates and the like can be set at an interval that can reliably record the movement of the mouse cursor C by the mouse, that is, at an interval slightly shorter than the interval of the movement. Record it.

  When the change processing control unit 160 receives the processing contents for each operation event and each mouse movement direction as information of the mouse mode MM1 from the main control unit 130, the change processing control unit 160 stores the operation history in the operation history storage table 90 as shown in FIG. Recording of the above-mentioned image ID “CT-001”, “mouse mode MM1”, the coordinate position (X, Y) = (0, 0) of the mouse cursor C, etc. is started. In addition, when the change processing control unit 160 receives an operation signal related to the change process from the main control unit 130, the image display mode change process is executed on the image data based on these information, and the operation history storage table 90 is displayed. The operation event “right drag” and the moved coordinate position (X, Y) = (0, 10) are recorded.

  As described above, when the change processing control unit 160 starts recording in the operation history storage table 90, the identification information such as the image ID, the current time, the current mouse mode MM, and the mouse cursor, for example, at 1/1000 second intervals. The coordinate position is continuously recorded, and every time there is an operation event and a mouse movement in the current mouse mode MM, a preset change process is performed and a history of the operation is continuously recorded.

  The change processing control means 160 continues to record until the operation signal indicating that the change processing of the image display mode is completed after the selection operation of the mouse mode MM as described above. However, the operation history recording stop or end trigger is not limited to the configuration in which the operation signal indicating that the image display mode change process has been completed is received. The arrival of a condition such as detection of an operation signal that triggers termination can be arbitrarily set. For example, the trigger for stopping the recording of the operation history is “when the mouse mode MM is released”, “when the recording stop operation is received”, “a predetermined time has elapsed since the operation unit 120 was not operated. Etc. ".

  Similarly, the trigger for starting the recording of the operation history is not limited to the configuration in which the mouse mode MM selection signal is received. That is, it is possible to arbitrarily set the arrival of a condition such as detection of an operation signal that triggers the start of recording of the history. For example, the trigger for starting the recording of the operation history can be “when the mouse mode MM is selected”, “when the recording start operation is received”, or the like. Further, the trigger for starting the recording may be a time point when various change processing operations (such as a rotation operation of the mouse wheel W) are actually performed after the mouse mode MM is selected.

  In order to enable each of the operations described above, a soft key or the like is provided in the format of the medical image display screen displayed on the display unit 140, or a program for changing the image display mode of the medical image In addition, a function for generating a trigger signal corresponding to the operation of a hard key such as a keyboard is provided.

  Further, as described above, the change processing control unit 160 stores the operation history storage table 90 (FIG. 5) in the storage unit 150. The main control unit 130 transmits the operation history storage table 90 to the medical image storage device 300 via the transmission / reception unit 110. Further, when transmitting the operation history storage table 90 to the medical image storage device 300, the main control unit 130 transmits the operation history storage table 90 in association with the image data before the image display mode change processing. The storage unit 150 and the change processing control unit 160 in this embodiment correspond to an example of “recording unit” in the present invention.

  The operation history storage table 90 in this embodiment corresponds to an example of “recording result” in the present invention. The operation event in the operation history storage table 90 corresponds to an example of “operation information related to an executed operation” in the present invention.

[Reproduction display control of image display mode change processing operation]
Next, display control of a processing operation reproduction image in the medical image display apparatus 100 of the present embodiment will be described with reference to FIGS. As an example, the reproduction display of the gradation processing operation of the medical image based on the operation history storage table 90 shown in FIG. 5 will be described. FIG. 6 is a schematic diagram illustrating an outline of examples of the operation unit 120, the display unit 140, and the processing operation reproduction image in the medical image display apparatus 100 of the medical image management apparatus 1 according to the embodiment of the present invention.

  When a doctor or the like browses a medical image, the examination list is displayed on the display unit 140 of the medical image display apparatus 100 as described above, and a desired medical image is selected and displayed. When the medical image displayed here has been subjected to the display mode change processing, the medical image management apparatus 1 according to the present embodiment can display the processing operation reproduction image on the display unit 140. A doctor or the like can grasp by what operation the display mode of the displayed medical image has been changed by browsing the processing operation reproduction image. The display control of this processing operation reproduction image is as follows.

  An operation for selecting a reproduction image of a desired processing operation from the reproduction image list displayed on the screen of the display unit 140 via the operation unit 120 in order for a doctor or the like to view the reproduction image of the image display mode change process. If it does, the main control means 130 will request | require the said image data etc. in response to the said selection operation. That is, the main control unit 130 transmits a control signal for requesting data necessary for displaying the reproduced image of the selected processing operation to the medical image storage device 300 or the like via the transmission / reception unit 110. Here, the necessary data includes operation history recording and image data before the display mode change processing. In response to the control signal from the main control means 130, the medical image display apparatus 100 or the like records the operation history read from the operation history storage table 90 (FIG. 5) via the transmission / reception means 110, and changes the display mode. Receives pre-processed image data.

  When the main control unit 130 receives the operation history or the like, the main control unit 130 reads the screen format of the display screen of the processing operation reproduction image as shown in FIG. Further, the main control unit 130 assigns the received unprocessed image data to the screen format. Here, the main control means 130 further reads the operation setting table 80 (FIG. 4). The main control means 130 refers to the read operation setting table 80, and controls the image display mode change processing on the image data before processing based on the received operation history record. The control here is executed according to the control of the change processing of the image display mode by the change processing control means 160 based on the above-mentioned operation of the doctor or the like. That is, the main control means 130 receives the received operation history as shown in FIG. 5 instead of acquiring the selection information of the mouse modes MM1 to MMn by the mouse and the information of the operation signals such as the moving direction and the operation amount of the mouse in real time. The information of “mouse mode MM1”, operation event “right drag”, and “cursor position” is read out from the recording at the predetermined time interval recorded. As a result, the main control unit 130 performs an image display mode change process on the read image data before the change process based on the various information read and by referring to the operation setting table 80.

  As a result of the main control means 130 reading the operation history at predetermined time intervals (in this case, 1/1000 second intervals) and executing the change process on the image data before the change process, the image data transmitted to the display means 140 is The display mode is changed at the same flow and the same interval as when the operation history is recorded. Furthermore, the main control unit 130 in the medical image management apparatus 1 according to the present embodiment displays the operation history of the operation for changing the display mode of the medical image based on the record of the operation history as a processing operation reproduction image (FIG. 6 / operation contents). Displayed in parallel with the display area T). Further, the main control means 130 performs a process of changing and displaying the coordinate position of the mouse cursor C on the screen based on the record of the operation history. The main control means 130 associates and displays all of the above “display change of image display mode”, “display of operation history”, and “movement display of mouse cursor C”. For this reason, for example, the processing of these main control means 130 is simultaneously performed in parallel at predetermined time intervals. For example, in the processing operation reproduction image shown in FIG. 6, an operation content display area T and a mouse cursor C for displaying an operation history in characters are displayed on the screen.

  The main control means 130 continues the reproduction display from the start of the reproduction display of the change operation of the image display mode as described above until the end of the operation history is recorded and various processes are completed. And The reproduction display is also stopped when the reproduction display is stopped by the viewer. Further, when the viewer of the reproduced image performs an operation for displaying the reproduced image list again, the reproduction display is stopped. For this reproduction display, for example, if the display mode change process based on the operation history is not performed for a predetermined frame, or for a predetermined time, skip to the frame with the next change process or the time when the change process exists. It is also possible to display it. The main control means 130 in this embodiment corresponds to an example of “control means” in the present invention.

  Further, the main control unit 130 starts reproduction display of the image display mode changing operation through the operation of the operation unit 120, and then performs “pause”, “slow playback”, “fast forward”, “winding” of the display. It is possible to perform “return” or the like. For example, when a temporary stop operation is performed, the main control unit 130 first stops reading the operation history and executing the change process. Further, the main control means 130 continues to display the image and the operation history record that were displayed immediately before the operation of pause. When an operation for canceling (reproducing) the pause is performed, the main control unit 130 resumes the reading of the operation history and the execution of the change process. For example, the temporary stop operation may be performed when the operator performs some mouse operation during reproduction display by the main control unit 130. In addition, a soft key for temporarily stopping the reproduction display screen may be provided. Moreover, the structure which pauses by operation of the other operation means 120 (keyboard etc.) may be sufficient.

  When the slow reproduction operation is performed, the main control unit 130 performs reproduction display at an interval longer than a predetermined time interval. When a fast-forward operation is performed, the main control unit 130 performs reproduction display at an interval shorter than a predetermined time interval. For slow playback and fast forward, the main control means 130 may adjust the length of the operation history readout interval, may adjust the interval of execution of the change processing, and read / change processing at normal intervals. Alternatively, the display interval may be adjusted.

  When the rewinding operation is performed, the main control unit 130 reads the operation history retroactively from the time of the operation. Further, the main control means 130 executes the change process in accordance with it and reproduces and displays it. At this time, the main control means 130 may perform reproduction display at intervals shorter than a predetermined time interval. The main control unit 130 may be configured to perform fast forward and rewind for each series of “operation events” performed or for each selected “mouse mode MM” based on the operation history. For example, the main control unit 130 fast-forwards a series of operations of the right drag operation in the mouse mode MM1 in the operation history in response to the fast-forward operation. Further, when the reading reaches the portion of the operation history where the operation event is switched to the next operation event, the main control unit 130 returns to the predetermined speed again and performs the reproduction display. It is also possible to perform so-called cueing.

  The main control unit 130 may be configured to display the name of the next operation event in the operation history while displaying a reproduction image of the image display mode change process. That is, the main control means 130 reads the operation history at predetermined time intervals, executes the change process on the image data, and changes the display mode of the image, and at the same time, the next operation event in the recording of the operation history The name and mouse mode MM are read in advance. The read next operation event name and mouse mode MM display the next operation in parallel with the operation content display area T of the processing operation reproduction image (FIG. 6). At this time, the content of the change process corresponding to the next operation event may be displayed together with the name of the next operation event. Further, not only the next operation event but also the moving direction of the mouse cursor may be displayed in parallel.

  As described above, in the medical image management apparatus 1 according to the present embodiment, the medical image display apparatus 100 records the history of operations related to the image display mode change processing, and further changes the image display mode from the recording of the operation history. It is possible to reproduce processing operations. Therefore, a doctor or the like who interprets a medical image learns a specific operation set for each medical image display device or each doctor by browsing and referring to the operation reproduction image of the displayed change process. Can do. As a result, the medical image management apparatus 1 according to the present embodiment is capable of improving the interpretation efficiency as well as improving the interpretation technique of doctors and the like by supporting the interpretation operation by doctors and the like.

(Medical image storage device)
Next, the medical image storage apparatuses 300 and 301 in the medical image management apparatus 1 of the present embodiment will be described with reference to FIG. Here, a configuration example of the medical image storage apparatus 300 will be described.

  As shown in FIG. 2, the medical image storage apparatus 300 includes a transmission / reception unit 320, a main control unit 330, an image data storage unit 340, and an operation information storage unit 350. The transmission / reception means 320 transmits / receives information to / from the medical image diagnostic apparatuses 50 and 60, each device included in the medical image management apparatus 1, and HIS, RIS, and the like. For example, when the medical image storage apparatus 300 receives image data and additional data of medical images from the medical image diagnostic apparatuses 50 and 60, or transmits image data in response to a read request for image data, transmission / reception means as an interface Transmission / reception is performed via 320. As the transmission / reception means 320, a network adapter such as a LAN card, a communication device such as a modem for connecting to the Internet, or a combination thereof can be used.

  The main control unit 330 stores various data received by the transmission / reception unit 320 in each storage unit (340, 350, etc.). The main control unit 330 performs control to read data from each storage unit and transmit it to the requesting device based on various data read requests received via the transmission / reception unit 320. The main control means 330 includes an arithmetic control device such as a CPU or MPU.

  Both the image data storage unit 340 and the operation information storage unit 350 are configured to include a storage device such as an HDD. Among these, the image data storage unit 340 receives image data / additional data of medical images received from the medical image diagnostic apparatuses 50 and 60 via the transmission / reception unit 320, and image data subjected to display mode change processing such as image processing. The image data before the change process associated with the record of the operation history is stored in a readable manner. The image data stored in the image data storage unit 340 is associated with information such as “patient ID”, “patient name”, “patient gender”, “examination date”, “examination type”, and the like. It is remembered.

  Further, the operation information storage unit 350 stores the data of the operation history storage table 90 (FIG. 5) received from the medical image display device 100 or the like via the transmission / reception unit 320 so as to be readable. The main control unit 330 executes control for storing various data in the image data storage unit 340 and the operation information storage unit 350. Further, various types of data are read out by the main control unit 330 receiving the control signal for the data transmission request from the medical image display device 100 or the like by the medical image storage device 300 or the like. This is executed in response to the request from the means 350. Further, the main control unit 330 transmits the data read out via the transmission / reception unit 320 to the device that requested the data.

  The medical image storage device 301 can have the same configuration as the medical image storage device 300. In addition, at least one of the medical image storage device 300 and the medical image storage device 301 can be configured as an HDD or NAS (Network Attached Storage).

(Operation)
Next, the operation of the medical image management apparatus 1 in the first embodiment described above will be described with reference to FIGS. FIG. 7 shows the operation of changing the image display mode such as image processing by the medical image display apparatus 100 according to the first embodiment of the present invention until the mouse modes MM1 to MMn are selected after the examination list is displayed. It is a flowchart which shows the outline | summary of operation | movement. FIG. 8 shows an operation history stored after accepting a mouse operation under the mouse mode MM in an image display mode changing operation such as image processing by the medical image display apparatus 100 according to the first embodiment of the present invention. It is a flowchart which shows the outline of operation | movement until.

  First, an operation until an operation history is stored in an operation for changing an image display mode such as image processing by the medical image display apparatus 100 according to the present embodiment will be described with reference to FIGS.

(Step 01)
When a doctor or the like performs an operation for selecting a desired examination from the list of examination lists displayed on the screen of the display unit 140 via the operation unit 120 in order to view a desired medical image, the selection operation is received. The main control unit 130 transmits a control signal for requesting image data of the selected medical image to the medical image storage apparatus 300 or the like via the transmission / reception unit 110. As a result, the medical image display device 100 or the like receives image data and additional data corresponding to the image data from the medical image storage device 300 or the like via the transmission / reception unit 110.

(Step 02)
The main control unit 130 reads out the screen format of the display screen of the medical image from the storage unit 150, assigns the received image data and the like to the screen format, and displays a list of medical images or medical images (thumbnail display) (both not shown). Is displayed on the display means 140.

(Step 03)
Here, the main control means 130 confirms whether or not a mouse mode MM1 to MMn has been selected by an operator such as a doctor via the operation means 120, depending on whether or not an operation signal has been received. If there is no selection operation (step 03; No), this confirmation is continued until the selection operation is performed.

(Step 04)
When the mouse mode MM1 to MMn is selected (step 03; Yes), the mode is switched to the selected mouse mode MM. That is, the main control unit 130 acquires information on the selected mouse mode MM1 from the operation setting table 80 (FIG. 4) of the storage unit 150 and transmits it to the change processing control unit 160. Further, the change processing control means 160 is in a state where the image display mode change processing based on the acquired mouse mode MM information is possible.

(Step 05)
When the operation unit 120 such as a mouse is operated, an operation signal is transmitted from the operation unit 120 to the main control unit 130. Based on the operation signal, the main control means 130 moves the position of the mouse cursor C on the screen of the display means 140 to display it. Further, the main control means 130 receives an operation signal including “mouse mode MM”, “operation amount information” such as “movement amount information of the coordinate position”, “movement direction” and dragging of the mouse cursor C from the information of the operation amount. It transmits to the change process control means 160.

(Step 06)
Further, the change processing control means 160 recognizes the type of display mode change processing (operation event; for example, “gradation processing”) from the information on the operation event (for example, “right drag”) based on the acquired information on the mouse mode MM1. In addition, it is recognized from the information on the moving direction of the mouse cursor C by the operation means 120 that the operation is to execute specific change processing contents (for example, increase the window level) in the type of the change processing. Further, the change processing control means 160 performs the change processing on the image data of the medical image based on information on the operation amount of the mouse or the like.

(Step 07)
The change processing control means 160 starts recording the history of the change processing operation from the time when the information related to the mouse mode MM1 is acquired. That is, the change processing control unit 160 stores the “mouse mode MM” and “operation event name” acquired from the main control unit 130 and the coordinates of the mouse cursor C on the screen in the operation history storage table 90 (FIG. 5) of the storage unit 150. The position (X, Y) or the like is stored in correspondence with the current date and the current time in units of thousandths of a second.

(Step 08)
When the change processing control unit 160 receives an operation signal indicating that the image display mode change processing has been completed from the operation unit 120 via the main control unit 130, the change processing control unit 160 completes the recording. In addition, the change processing control means 160 is “when the mouse mode MM is released”, “when a recording stop operation is received”, “when a predetermined time has passed since the operation means 120 is not operated”, etc. Complete the record.

(Step 09)
When the change process control unit 160 completes the recording and the content of the change process is confirmed, the main control unit 130 transmits the operation history storage table 90 to the medical image storage apparatus 300 or the like via the transmission / reception unit 110. In the medical image storage apparatus 300, the operation control storage table 90 is stored in the operation information storage unit 350 or the like by the main control unit 330.

  Next, the operation until the reproduction display of the change processing operation of the display mode of the medical image is performed in the interpretation operation of the medical image by the medical image display apparatus 100 according to the present embodiment will be described.

  A doctor or the like performs a selection operation of a reproduction image from the reproduction image list in order to view the reproduction image of the image display mode change process. In response to the selection operation, the main control unit 130 transmits a control signal for requesting the recording of the operation history and the image data before the display mode change process to the medical image storage apparatus 300 or the like.

  In response to the control signal from the main control means 130, the medical image display apparatus 100 or the like records the operation history read from the operation history storage table 90 (FIG. 5) via the transmission / reception means 110, and changes the display mode. Receives pre-processed image data. When receiving the operation history or the like, the main control means 130 displays a processing operation reproduction image (FIG. 6) and reads the operation setting table 80 (FIG. 4). Further, the main control means 130 refers to the read operation setting table 80 and executes an image display mode change process on the image data before the processing based on the received operation history record. The main control unit 130 sequentially displays the image data on which the change process has been performed on the display unit 140, displays the change state of the processing operation reproduction image, and displays the mouse mode MM, operation history, The processing contents are simultaneously displayed in parallel (see FIG. 6).

(Action / Effect)
The operation and effect of the medical image management apparatus 1 according to the above-described embodiment will be described.

  In the medical image management apparatus 1 according to the present embodiment described above, when a medical image is interpreted by the medical image display apparatus 100, the processing for changing the display mode of the medical image for interpretation can be performed by a preset operation. . Further, the history of operation of the change process is recorded at a predetermined interval according to the process content.

  Further, the medical image management apparatus 1 displays the operation history based on the recorded operation history, the image data before the change process, and the operation setting table 80 (FIG. 4) in which the operation content and the processing content are associated with each other. It is possible to display, in parallel, the reproduction display of the operation related to the processing for changing the display mode of the medical image and the information (for example, character information) indicating the operation content.

  Therefore, in the medical image management apparatus 1 of the present embodiment, when a medical image is read, information indicating the operation content displayed in parallel and the reproduction display of the operation related to the change process of the display mode of the medical image by the doctor or the like is displayed. By referencing, it is possible to learn about a specific operation set for each medical image display device or each doctor. As a result, the medical image management apparatus 1 according to the present embodiment can support an interpretation operation by a doctor or the like.

[Second Embodiment]
Next, the configuration of the medical image management apparatus 1 according to the second embodiment of the present invention will be described. The second embodiment differs from the first embodiment described above in the recording content recorded by the change processing control means 160 during the change process of the medical image display mode. Furthermore, the medical image management apparatus 1 according to the second embodiment differs in data used to display a processing operation reproduction image as shown in FIG. Other parts in the medical image management apparatus 1 according to the second embodiment are the same as those in the first embodiment. Hereinafter, the medical image management apparatus 1 according to the second embodiment will be described with a focus on differences from the first embodiment.

[Recording control of image display mode change processing history]
First, a description will be given of control related to recording of a history of operation for changing the image display mode in the medical image management apparatus 1 according to the second embodiment.

  Also in the medical image management apparatus 1 according to the second embodiment, the medical image display apparatus 100 can perform the processing for changing the display mode of the medical image as described above. Similarly to the first embodiment, when the mouse mode MM selection operation is performed, the change processing control unit 160 associates the identification ID and the like with the operation content information and the history of the coordinate position of the mouse cursor C on the screen. In addition, the storage unit 150 stores the operation history storage table 90 (FIG. 5) at predetermined time intervals. Here, the change processing control means 160 according to the second embodiment associates these operation history storage tables 90 with the process of changing the display mode of the medical image displayed on the display means 140 by the change processing. The image data is stored in the storage unit 150 continuously or intermittently as image data.

  The image showing the process of changing the display mode (hereinafter referred to as “change display image”) is operated by the change processing control means 160 at the same interval (for example, 1/1000 second) as the operation history related to the change processing. The information is stored in the storage unit 150 in association with the history.

  The change display image starts to be stored at the same timing as the operation history related to the change process, and the storage ends at the same timing. However, only the storage of this image may be started at a timing earlier than the recording of the operation history. Similarly to the first embodiment, it is not always necessary to end the storage of the image when the recording of the operation history is ended.

  The change display image stored in the storage unit 150 by the change processing control unit 160 in this way is stored in the medical image storage device 300 or the like in association with the operation history storage table 90. That is, the main control unit 130 associates the change display image with the operation history storage table 90 via the transmission / reception unit 110 and transmits it to the medical image storage device 300 or the like. The medical image storage apparatus 300 or the like stores the change display image received via the transmission / reception unit 320 by the main control unit 330 or the like in the image data storage unit 340. At this time, the main control unit 330 stores the operation history storage table 90 in the operation information storage unit 350 in association with the change display image.

[Reproduction display control of image display mode change processing operation]
Next, reproduction display control such as change processing operation in the medical image management apparatus 1 according to the second embodiment will be described.

  Also in the medical image management apparatus 1 according to the second embodiment, it is possible to reproduce and display an image display mode change processing operation using a processing operation reproduction image as shown in FIG. However, the control content for displaying the processing operation reproduction image according to the second embodiment and the data to be handled are different from those of the first embodiment. That is, when a doctor or the like performs an operation of selecting a reproduction image of a desired processing operation from the reproduction image list via the operation unit 120, the main control unit 130 receives the selection operation from the medical image storage device 300 or the like. The image data of the change display image and the operation history storage table 90 (FIG. 5) associated with the image data are acquired.

  When the main control means 130 receives the image data and the like, it reads the screen format of the display screen of the processing operation reproduction image as shown in FIG. Further, the main control unit 130 assigns the received image data before processing. These controls by the main control means 130 are the same as in the first embodiment. Here, in the medical image display apparatus 100 of the second embodiment, the operation setting table 80 (FIG. 4) is not used for the main control unit 130 to display the processing operation reproduction image (FIG. 6). That is, the main control unit 130 of the medical image display apparatus 100 in the second embodiment displays the processing operation reproduction image only by the process of assigning the change display image indicating the process of change of the display mode stored in advance to the screen format. .

  Also in the medical image display apparatus 100 according to the second embodiment, the main control unit 130 processes the operation history of the operation for changing the display mode of the medical image as shown in FIG. 6 based on the record of the operation history. Display on the operation reproduction image. Further, the main control means 130 performs a process of changing and displaying the coordinate position of the mouse cursor C on the screen based on the record of the operation history. These points are the same as in the first embodiment. However, when the movement of the mouse cursor C is also recorded in the change display image, that is, when the mouse cursor C is stored as a part of the change display image, the process is not performed.

(Action / Effect)
Also by the medical image management apparatus 1 of the second embodiment described above, similar to the first embodiment, a doctor or the like reproduces the operation related to the processing for changing the display mode of the medical image and displays the operation contents displayed in parallel. By referring to the information to be shown, it is possible to learn about a specific operation set for each medical image display device or each doctor. As a result, the medical image management apparatus 1 according to the present embodiment can support an interpretation operation by a doctor or the like.

  In addition, the medical image management apparatus 1 according to the second embodiment performs processing such as recording of a change display image and storing and reading of image data of the image as compared with the first embodiment. However, in the processing operation reproduction image display processing, it is only necessary to perform processing for assigning image data to the screen format.

[Third embodiment]
Next, the configuration of the medical image management apparatus 1 according to the third embodiment of the present invention will be described. In the third embodiment, the configuration and control contents overlap with those of the first or second embodiment described above. However, in the third embodiment, based on the operation history storage table 90 (FIG. 5), the time required for each of the image display mode change processing operations (hereinafter simply referred to as “each processing operation”) is aggregated, and the statistics Display as information.

  When receiving the operation history storage table 90 as shown in FIG. 5 from the medical image display device 100, the medical image storage device 300 or the like stores the operation history storage table 90 in the operation information storage unit 350. Based on the operation history storage table 90 stored in the operation information storage unit 350 and the additional data added to the image data of the medical image, the main control unit 330 such as the medical image storage device 300 according to the third embodiment. The time required for each processing operation is aggregated to generate statistical information. For example, the main control unit 330 collects information about each processing operation, processing contents, and required time from the stored operation history storage table 90. Further, the main control unit 330 refers to the additional data based on the image data associated with each processing operation. The main control unit 330 collects information such as “modality of the medical image diagnostic apparatus”, “imaging method”, “image type”, “imaging site”, and “imaging condition” from the referenced additional data.

  The main control unit 330 of the medical image storage apparatus 300 performs what kind of various change processing is performed on the medical image under what conditions (imaging conditions, etc.) from these various pieces of related information, and the requirements for the change processing. A process of taking statistics from each viewpoint for each collected information is performed. For example, the main control unit 330 selects the operation history related to the window conversion process for the angiographic image of the head by the X-ray CT apparatus from the operation history information of all stored operation history storage tables 90. It is possible to identify the information and total the time required for the processing. Further, the main control unit 330 can display the collected information in a list or a graph, for example.

(Action / Effect)
In the medical image management apparatus 1 according to the third embodiment described above, what kind of change processing is performed on what kind of medical image, and the time required for the change processing is determined for each collected information. Performs processing to collect statistics from the viewpoint. Therefore, doctors and the like refer to the information obtained from the statistics in a form such as a graph display, so that it takes time to change which of the unique operations set for each medical image display device or each doctor. Or which change processing operations are prioritized. As a result, the medical image management apparatus 1 according to the present embodiment can support interpretation work by a doctor or the like.

  Further, according to the medical image management apparatus 1 in the third embodiment, doctors who have little experience in interpretation work, time required for the image display mode change processing operation, doctors who have a lot of interpretation experience, etc. The time required for the operation can be compared.

[First modification]
Next, a first modification of the medical image management apparatus 1 according to the above embodiment will be described with reference to FIG. FIG. 9 is a schematic diagram showing an outline of the operation history storage table 90 stored in the medical image display device 100 of the medical image management device 1 according to the first modification of the embodiment of the present invention.

  As shown in FIG. 9, if the processing content assigned to the operation event in the mouse mode MM (for example, “gradation processing”) and the change processing of the image display mode at the time of recording are performed, the change processing result is also obtained. In addition, it is also possible to adopt a configuration in which recording is performed in association with each other.

  Here, in the case of gradation processing, the change processing result is information indicating at least one of “current window level value”, “window level increase / decrease value”, and the like. In the case of the “mouse mode MM1” and the operation event “right drag”, the processing content “gradation operation” assigned to the operation “right drag” in the mouse mode MM1 and the moved coordinate position (X, Y) = (0, 10) and the change processing result “WL82 (WL increase)” based on the moving direction of the mouse are recorded. In addition, at least one of “processing content” and “change processing result” recorded in the operation history storage table 90 in this modification is an example of “processing information related to executed display change processing” of the present invention. It corresponds to.

  In this first modification, the main control means 130 of the medical image display apparatus 100 performs the following processing when displaying the processing operation reproduction image (FIG. 6). When the main control unit 130 acquires the operation history information and the image data of the unprocessed medical image, the main control unit 130 refers to the operation history information. Further, the main control means 130 executes the change process on the image data at a predetermined interval based on the change process result information in the referenced operation history information. The image data subjected to this change process is displayed on the display means 140. That is, the first modified example also has a configuration in which the main control unit 130 does not use the operation setting table 80 (FIG. 4) in order to display the processing operation reproduction image (FIG. 6), as in the second embodiment.

[Second modification]
Next, a second modification of the above embodiment will be described with reference to FIG. FIG. 10 is a schematic diagram showing an image search screen 78 for searching for a processing operation reproduction image (FIG. 6) according to a second modification of the embodiment of the present invention.

  In the medical image management apparatus 1 in the second modification, an image search screen 78 as shown in FIG. 10 is used to search for a processing operation reproduction image. The image search screen 78 is stored in the medical image display device 100, for example. As shown in FIG. 10, the image search screen 78 has at least an “operator ID / terminal ID” selection area, an “image type” selection area, and an “imaging site” selection area. In this modification, by selecting at least one of the items on the image search screen 78, it is possible to read the operation history and image data relating to the selected item and display the processing operation reproduction image. For example, when the doctor or the like selects the ID “AAA” of the operator who performed the image display mode change processing on the image search screen 78 by the operation unit 120 of the medical image display apparatus 100 or the like, the main control unit 130 The operator ID “AAA” identifies the corresponding operation history and image data. Further, when the doctor or the like selects the modality “MRI”, the modality is further specified from the operation history specified by the information “AAA”. Furthermore, if an imaging method “SE”, an image “T1-weighted image”, an imaging region “brain”, or the like is selected, search results such as operation history can be further narrowed down. The search query used for the image search screen 78 is based on the operation history storage table 90 and additional data added to the image data of the medical image.

  In the second modified example, a person who has little experience in changing the image display mode for interpretation, that is, a person who is not familiar with the operation of the specific mouse modes MM1 to MMn, tries to learn the change process from the processing operation reproduction image. In this case, the image search can be performed based on the image type and the imaging region. Therefore, when searching for a processing operation reproduction image based on a modality, an image type, and an imaging part, the search is easy.

[Third Modification]
Next, a third modification of the medical image management apparatus 1 according to the above embodiment will be described with reference to FIG. FIG. 11 is a schematic diagram showing an outline of the processing operation reproduction image and the operation content display area displayed on the medical image display device 100 of the medical image management device 1 according to the third modification of the embodiment of the present invention. In the medical image management apparatus 1 according to the above embodiment, the main control unit 130 of the medical image display apparatus 100 displays character information indicating an operation history or the like in the operation content display area T of the processing operation reproduction image (see FIG. 6). ). However, the medical image management apparatus according to the present invention is not limited to this configuration. For example, as shown in FIG. 11, it is possible to display a combination of the figure showing the operation means 120 and the character information. If the operation history recorded in the operation history storage table 90 is the gradation processing in the mouse mode MM1 shown in the above embodiment, the operation history is displayed as a processing operation reproduction image shown in FIG. In other words, the processing operation reproduction image shows a mouse figure, and distinguishes and emphasizes from other parts by changing the color of the part of the mouse button or the like that is performing an operation such as pressing or rotating during the processing. Is displayed. For example, as shown in FIG. 11, in the operation content display area T in the processing operation reproduction image of this modified example, instead of the information indicated by the characters “right drag” in the above embodiment, a mouse is shown and the right The color display of the part of the click button R is changed and displayed while maintaining the state.

  In the third modified example, when it is desired to learn the change processing of the image display mode for interpretation by the processing operation reproduction image, it is possible to more intuitively understand the operation related to the change processing.

  The same effects as those of the above-described embodiment can also be realized by the configuration of the medical image management apparatus according to the first to third modifications described above.

DESCRIPTION OF SYMBOLS 1 Medical image management apparatus 50, 60 Medical image diagnostic apparatus 78 Image search screen 80 Operation setting table 90 Operation history storage table 100, 101 Medical image display apparatus 110, 320 Transmission / reception means 120 Operation means 130, 330 Main control means 140 Display means 150 Storage means 160 Change processing control means 300, 301 Medical image storage device 340 Image data storage means 350 Operation information storage means C Mouse cursor L Left click button N Network R Right click button W Mouse wheel T Operation content display area

Claims (8)

Display means for displaying medical images on the screen;
A plurality of types of operations, and an operation means capable of designating each coordinate position on the screen;
Storage that stores in advance operation setting information in which the operation types of the plurality of types of operations, the types of change processing of the plurality of types of display modes of the medical image, and the movement direction of the designated position on the screen by the operation unit are associated Means,
Display for changing the display mode of the medical image displayed on the display unit based on the selected operation setting information by executing the selection of the operation setting information, the operation, and the movement of the designated position Change processing means;
When the display mode is changed by the display change processing unit, a recording unit that records the operation for each operation type by the operation unit and the designated position at a predetermined timing;
Based on the recording result by the recording unit and the operation setting information, a control unit that reproduces and displays the change in the display mode of the medical image and the recording result in parallel on the display unit;
A medical image management apparatus comprising: In the operation setting information in the storage means, in addition to the operation type, the type of change processing, and the movement direction of the designated position, the change amount of the display mode corresponding to the movement amount of the designated position Are also associated,
The medical image management apparatus according to claim 1. The control means reads the operation setting information from the storage means, refers to the operation setting information, and based on the movement direction and the operation type information obtained from the recorded movement of the indicated position, Displaying a change in the display mode of the medical image;
The medical image management apparatus according to claim 1. The recording unit further records the change in the display mode of the medical image by the display processing unit at the timing together with the operation for each operation type.
The medical image management apparatus according to claim 1, wherein the control unit displays a change in the display mode of the medical image based on the recorded change in the display mode.   The medical image management apparatus according to claim 1, wherein the control unit is characterized by the recording result. The control means searches for a period during which the indicated position does not move in the recording result when displaying the recording result of the recording means and the change in the display form of the medical image according to the operation setting information in parallel. And if there is a period, omit the display of the period,
The medical image management apparatus according to claim 1. The control means takes statistics of the recording results and displays them on the display means;
The medical image management apparatus according to claim 1. Display means for displaying medical images;
A plurality of pieces of processing information indicating the contents of a plurality of types of display change processing for the displayed medical image and operation information indicating the types of operations for performing each display change processing are stored in association with each other. Operation setting storage means;
Operating means used for the plurality of types of operations;
When at least one of the plurality of types of operations is executed on the operation unit, the operation information corresponding to the operation is specified, and the processing information corresponding to the operation information is stored from the operation setting storage unit. A display change processing means for reading and executing the display change processing on the displayed medical image according to the read processing information with respect to the medical image;
When the display change process is performed on the medical image by the display change processing unit, the operation information related to the executed operation and the process information related to the executed display change process are recorded in association with each other at predetermined time intervals. Operation content recording means to perform,
After the recording, control for causing the display means to reproduce and display the change in the display mode of the medical image due to the display change processing, and to display the recording result by the operation content recording means on the display means in parallel with the reproduction display. Means,
A medical image display device comprising: