JP2015173667A - Medical apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a medical apparatus which can appropriately extract a disparity between image data obtained by an examination and examination procedure.SOLUTION: A medical apparatus has a storage part and an abnormality detection part. The storage part stores information showing progress situations of a support program that supports work to examine a subject by using an examination part in the way that it is performed in a prescribed order and progresses as an operator operates it. The abnormality detection part can extract parts to be corrected in an order of alignment of a plurality of image data generated on the basis of information showing a result of examination in accordance with the information showing the progress situations of the support program stored to the storage part.

Description

  Embodiments described herein relate generally to a medical device.

2. Description of the Related Art There is known an ultrasonic diagnostic apparatus that scans an object with ultrasonic waves, generates image data based on a reception signal obtained by the scanning, and displays the image data on a display unit. In this type of ultrasonic diagnostic apparatus, the inspection procedure is displayed on the display unit so that the inspection work can be realized in accordance with the protocol expressing the inspection procedure.
However, in the conventional technique, when the inspection is not performed according to the displayed inspection procedure, the image data that is sequentially stored is not generated according to the inspection procedure, so that the correspondence between the image data and the inspection procedure is established. There was a problem that it was difficult to understand.
In particular, when the same examination is performed on a large number of patients as in a group examination, there is a problem that it is difficult to confirm the images because the arrangement of images of some patients is different from other patients.

JP 2013-52248 A

  The problem to be solved by the present invention is to provide a medical device that can appropriately extract a portion requiring correction in an array of image data obtained by inspection.

  The medical device according to the embodiment includes a storage unit and an abnormality detection unit. The storage unit is a support program that supports the work of inspecting the subject using the inspection unit in a predetermined order, and indicates the progress of the support program that progresses according to the operation of the operator Information is stored. The abnormality detection unit is configured to determine a position to be corrected in the arrangement order of the plurality of image data generated based on the information indicating the result of the inspection according to the information indicating the progress status of the support program stored in the storage unit. Extractable.

It is a figure showing an example of medical system 1 concerning a 1st embodiment. 3 is a block diagram illustrating an example of a functional configuration of the medical apparatus 10. FIG. It is a figure which shows an example of the assistance screen when a certain protocol is running. It is a flowchart which shows an example of the flow of the process for setting a protocol. It is a figure which shows an example of the execution order of operation, and the information produced | generated in connection with this. It is a flowchart which shows an example of the flow of the process for performing a support program. It is a flowchart which shows an example of the flow of the process for extracting the location which should be corrected and correcting the extracted location. It is the figure which illustrated the image attribute table before and behind correction, and the image comment area | region when operation is performed in the order illustrated in FIG. It is a figure which shows the other example of the execution order of operation, and the information produced | generated in connection with this. It is the figure which illustrated the image attribute table before and behind correction, and the image comment area | region when operation is performed in the order illustrated in FIG. It is a figure which shows the other example of the execution order of operation, and the information produced | generated in connection with this. It is the figure which illustrated the image attribute table before and behind correction, and an image comment area | region when operation is performed in the order illustrated in FIG. It is a figure which shows the other example of the execution order of operation, and the information produced | generated in connection with this. It is the figure which illustrated the image attribute table before and behind correction, and the image comment area | region when operation is performed in the order illustrated in FIG. 12 is a flowchart illustrating an example of a flow of display processing of an image file 146 executed by the image storage device 20. It is the figure which illustrated the display mode of the image file 146 produced | generated based on the execution order of operation shown in FIG. It is the figure which illustrated the display mode of the image file 146 produced | generated based on the execution order of operation shown in FIG. It is the figure which illustrated the display mode of the image file 146 produced | generated based on the execution order of operation shown in FIG. It is the figure which illustrated the display mode of the image file 146 produced | generated based on the execution order of operation shown in FIG.

  Hereinafter, a medical system according to an embodiment will be described with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a medical system 1 according to the embodiment. The medical system 1 according to the present embodiment includes a medical device 10 and an image storage device 20 that are connected to each other via a network. The medical apparatus 10 includes, for example, an X-ray apparatus, a computed tomography (CT), an imaging apparatus (MRI: magnetic resonance imaging) using a nuclear magnetic resonance imaging method, an ultrasonic diagnostic apparatus, and the like. Hereinafter, in the present embodiment, an example in which the medical apparatus 10 is an ultrasonic diagnostic apparatus will be described. The medical device 10 includes a medical image diagnostic device having a function of making a diagnosis based on an image, and a medical image display device that displays a medical image used for diagnosis by a doctor or the like. The image storage device 20 is also an example of a medical image diagnostic device or a medical image display device.

The medical device 10 includes an examination unit 11, an examination operation unit 12, an operation unit 13, a storage unit 14, a control unit 15, a display unit 16, and an image transfer unit 17.
The inspection unit 11 is operated by, for example, an operator who performs inspection work. The examination unit 11 outputs information indicating the examination result obtained by examining the subject to the control unit 15 or the like. In the present embodiment, the inspection unit 11 is an ultrasonic probe that outputs information based on a reception signal indicating a reflected wave of ultrasonic waves applied to a subject as an inspection result. The inspection unit 11 that is an ultrasonic probe acquires a reception signal indicating a reflected wave of the ultrasonic wave irradiated to the target part every time the target part of the subject is imaged, and outputs information based on the received signal to the control unit 15 and the like. To do.

  The inspection operation unit 12 receives an operation on the inspection unit 11 from an operator who operates the inspection unit 11. The inspection operation unit 12 outputs information indicating the received operation content to the inspection unit 11. The inspection operation unit 12 includes, for example, dedicated buttons, various switches, and the like.

  The operation unit 13 receives an operation on the medical device 10 (particularly, the control unit 15) from an operator who performs the inspection work by the inspection unit 11. The operation unit 13 outputs information indicating the received operation content to the control unit 15. The operation unit 13 includes, for example, a keyboard, a mouse, a touch panel, various switches, and the like.

  The storage unit 14 stores a support program, information indicating the progress status of the support program, and the like. The support program is a work that is performed using the inspection unit 11, and is a computer program that supports work in which an inspection procedure is predetermined. The progress status of the support program includes the progress status of the support program that progresses according to the operation of the operator, and the progress status of the support program that automatically progresses according to the inspection by the inspection unit 11.

  The control unit 15 writes information indicating the progress status of the support program in the storage unit 14 based on information input from the operation unit 13 or the inspection unit 11 when the support program is executed. In addition, the control unit 15 acquires information indicating the inspection result from the inspection unit 11 and writes the information in the storage unit 14 together with information indicating the arrangement order reflecting the acquisition order. The information indicating the arrangement order reflecting the acquisition order includes, for example, a sequential number assigned in accordance with the order in which the information indicating the inspection result is acquired. Further, the control unit 15 generates image data based on the information indicating the inspection result and writes the image data in the storage unit 14.

  Further, the control unit 15 refers to the information indicating the progress status of the support program, and extracts a portion to be corrected according to the progress status of the support program in the arrangement order of the image data. And the control part 15 corrects the location which should be corrected according to a support program. As a result of performing the above correction, the control unit 15 writes information indicating the arrangement order reflecting the acquisition order and information indicating the correction contents obtained by correcting the portion to be corrected as supplementary information in the storage unit 14.

The display unit 16 displays support information generated by the control unit 15 in response to the execution of the support program. The support information includes information indicating the order of the inspection process, information indicating the progress of the inspection process, information indicating the inspection result, and the like.
The image transfer unit 17 is connected to the image storage device 20 via a network. The image transfer unit 17 transmits the image data generated based on the information indicating the inspection result by the inspection unit 11 and the accompanying information to the image storage device 20 via the network.

The image storage device 20 includes a communication unit 21 (image data acquisition unit), a control unit 22, a display unit 23, a storage unit 24, and an operation unit 25.
The communication unit 21 is connected to the medical device 10 via a network. The communication unit 21 receives image data and incidental information from the medical device 10 and outputs them to the control unit 22.
The control unit 22 writes the image data and incidental information input from the communication unit 21 in the storage unit 24. The control unit 22 causes the display unit 23 to display the image data and incidental information input from the communication unit 21 or the image data and incidental information read from the storage unit 24. The control unit 22 displays the images side by side according to the information indicating the arrangement order included in the incidental information. When the information indicating the correction content is included in the incidental information, the control unit 22 may display the images side by side in an array corrected based on the information indicating the content to be corrected.

The display unit 23 displays image data under the control of the control unit 22.
The storage unit 24 stores image data and incidental information in association with each other.
The operation unit 25 receives an operation on the image storage device 20. The operation unit 25 outputs information indicating the received operation content to the control unit 22. The operation unit 25 includes, for example, a keyboard, a mouse, a touch panel, various switches, and the like.

Next, the functional configuration of the medical device 10 will be specifically described with reference to FIG. FIG. 2 is a block diagram illustrating an example of a functional configuration of the medical device 10.
The storage unit 14 of the medical device 10 stores a support program 141 including a main program 142, protocol information 143, and an activity program 144, incidental information 145, and an image file 146.
The main program 142 reads the protocol information 143 that defines the operation sequence in the medical apparatus 10 and calls and executes the activity program 144 in the order (protocol) defined by the protocol information 143. The protocol information 143 further includes information indicating the type of activity defined by each protocol. The operation sequence is determined according to the examination procedure executed by the medical device 10.

  The activity program 144 supports a plurality of activities that can be executed in the medical device 10. The activity program 144, for example, creates an activity for generating image data (hereinafter referred to as an inspection activity) based on information indicating an inspection result by the inspection unit 11 and file the generated image data for each execution of the protocol. Activity (hereinafter referred to as “save activity”).

  In the present embodiment, the activity program 144 can execute, for example, activities A, B, C, D, and E, which are inspection activities, and activity S, which is a saved activity. Each activity A, B, C, D, E supports the execution of multiple tests in a predetermined order. Here, “support” is performed next when, for example, an inspection procedure to be performed is displayed on the display unit 16 and the operator performs an input operation indicating that the current inspection included in the inspection procedure is completed. This refers to guiding the operator so that the inspection is performed according to the procedure, such as displaying the inspection procedure to be performed on the display unit 16. For example, activity A supports scans 1, 2, and 3 being executed in this order. Activity B supports scans 4, 5, and 6 being executed in this order. Activity C supports scans 7, 8, and 9 being performed in this order. For example, each of the scans 1 to 9 is a scan with different scanning conditions and a target body part.

The incidental information 145 stored in the storage unit 14 includes various types of information indicating the result of the operation of the medical device 10. For example, the incidental information 145 includes information indicating the progress status when each activity is executed by executing the main program 142 (that is, the progress status of the support program 141). For example, the incidental information 145 includes a progress status table in which information indicating the execution order executed by the medical apparatus 10 is associated with each examination included in the operation sequence defined by the protocol (see FIG. 9 and the like described later). May be included.
The supplementary information 145 may include information indicating that when a plurality of image data is generated for the same examination, the plurality of generated image data are images corresponding to the same examination. For example, the incidental information 145 may include image link information (see FIG. 9 and the like described later) in which pieces of information indicating a plurality of image data corresponding to the same examination are associated with each other.
Further, the incidental information 145 may include information in which attribute information indicating image data attributes are associated with each other. For example, the auxiliary information 145 includes an image attribute table (see FIG. 8 and the like described later) in which image generation date and time indicating when image data is generated is associated with image order information indicating the arrangement order of each image data. May be included. The image order information is information used to determine a display position when image data is reproduced. The image order information can be arbitrarily set according to the screen configuration or the like on the image reproduction side. In the present embodiment, the playback screen displays nine images at the same time, and the image order information 1, 2, and 3 are displayed on the upper left, center, and right in the playback screen, and the middle, left, center in the playback screen. Assume that image order information 4, 5, and 6 are assigned to the right, and image order information 7, 8, and 9 are assigned to the lower left, center, and right of the playback screen, respectively.

  The image file 146 is a collection of image data generated based on information indicating the inspection result by the inspection unit 11. In the present embodiment, image data generated during the execution of one protocol is temporarily stored in the storage unit 14 as one image file 146. In the present embodiment, one protocol execution is performed on the same subject (that is, the same person). Therefore, one image file 146 is a data file in which a plurality of image data obtained by the examination of the examination unit 11 is filed with the execution of one protocol for the same subject. That is, in the present embodiment, one image file 146 is a data file in which a plurality of image data for one subject is filed. A plurality of image files 146 corresponding to a plurality of people generated by executing a plurality of protocols may be stored in the storage unit 14 at the same time.

  The control unit 15 of the medical device 10 includes a support unit 151, an activity execution unit 152, an incidental information generation unit 153, an image file generation unit 154, a display control unit 155, an abnormality detection unit 156, and an incidental information update unit. (Correction unit) 157 and a transfer image determination unit 158 are provided.

  The support unit 151 reads the main program 142 corresponding to the protocol specified by the operator or the like from the support program 141 and executes it. For example, the protocol information 143 defines a plurality of protocols that can be selected by an operator or the like. In response to the execution of the main program 142, the support unit 151 reads the activity defined by the protocol from the activity program 144 and activates the activity execution unit 152. The support unit 151 controls the activity execution unit 152 to execute the activities in the order defined by the protocol, and generates support information that supports the operation of the operator according to the determined operation sequence, and performs display control. Output to the unit 155. In the present embodiment, when a certain protocol P1 is designated, the support unit 151 reads the activities A, B, C, and S from the activity program 144 and activates the activity execution unit 152. The support unit 151 controls the activity execution unit 152 to execute the activities A, B, C, and S in this order.

  Under the control of the support unit 151, the activity execution unit 152 executes the types of activities defined by the protocol among the activities stored in the activity program 144 according to the order defined by the protocol. In the present embodiment, the activity execution unit 152 executes activities A, B, C, and S in this order. The activity execution unit 152 executes the scans 1, 2, and 3 in this order while the activity A is being executed. The activity execution unit 152 starts executing the activity B after executing the activity A, and executes the scans 4, 5, and 6 in this order. The activity execution unit 152 starts executing the activity C after executing the activity B, and executes the scans 7, 8, and 9 in this order. The activity execution unit 152 executes the activity S after the execution of the activity C, and files the image data generated after the execution of the scans 1 to 9.

  The activity execution unit 152 accepts an operation such as skipping or redoing the operation sequence while the activity is being executed. More specifically, when the activity execution unit 152 is instructed to move (skip) to the inspection out of the sequence of the operation sequence during the activity execution, the activity execution unit 152 uses the inspection of the instructed movement destination as a starting point. Execute the specified activities according to the order specified in the protocol. For example, when the execution of the scan 4 is instructed after the scan 2, the activity execution unit 152 can execute the scans 4, 5, 6. In addition, when the activity execution unit 152 is instructed to re-execute a test that has already been executed during or after the activity is executed, the activity execution unit 152 starts the test specified in the re-execution and displays the activity defined in the protocol as a starting point. Execute according to the order specified in.

The incidental information generation unit 153 generates information indicating the progress status of the support program 141 executed by the activity execution unit 152 and writes the information in the incidental information 145. For example, when each inspection is executed by the activity execution unit 152, the incidental information generation unit 153 generates information indicating the execution order of each inspection after each inspection is executed, and the progress status included in the incidental information 145 Write to the table.
Further, when a plurality of pieces of image data are generated for the same examination, the incidental information generation unit 153 performs the examination corresponding to the order in which each image data is generated with respect to the progress status table included in the incidental information 145. In addition to writing the order, information in which pieces of information indicating a plurality of image data are associated with each other is written in the image link area included in the incidental information 145.
Further, the incidental information generation unit 153 generates attribute information indicating the attribute of the image data and writes the attribute information in the incidental information 145. For example, when the image data is generated by the image file generation unit 154, the incidental information generation unit 153 generates image generation date / time information indicating when the image data is generated, and the image attribute table included in the incidental information 145 includes the image generation date / time information. Write. When image data is generated by the image file generation unit 154, the incidental information generation unit 153 generates image order information indicating the reproduction position of each image data, and writes it in the image attribute table included in the incidental information 145. For example, the image file generation unit 154 generates a sequential number as the image order information in the order in which the image data is generated.

  The image file generation unit 154 generates image data that is the basis of the image file 146 based on the information indicating the inspection result output from the inspection unit 11. The image file generation unit 154 gives identification information (hereinafter referred to as an image ID) indicating image data to the generated image data. When the execution of one protocol is completed, the image file generation unit 154 converts all the image data obtained by the execution of the protocol into a file together with the image ID, and stores the file as the image file 146 in the storage unit 14.

  Based on the support information generated by the support unit 151, the display control unit 155 causes the display unit 16 to display a support screen for supporting the operation of the operator according to the determined operation sequence.

  The abnormality detection unit 156 refers to the information stored in the progress status table of the incidental information 145, and responds to the progress status of the support program 141 in the arrangement order of the plurality of image data generated by the image file generation unit 154. To determine whether there is a part to be corrected. As described above, in the medical device 10 of the present embodiment, skipping and redoing operations are accepted, and the examination may be performed in an order different from the order according to the originally scheduled examination procedure. In this case, the inspection procedure and the arrangement order of the image data do not match, and when referring to the image data later, the correspondence between the inspection procedure and the image data may be difficult to understand. Further, the operation of manually correcting the arrangement order is complicated for the operator, and when such an operation is imposed, the convenience of the apparatus is lowered.

  When it is determined that there is a part to be corrected, the abnormality detection unit 156 extracts the part to be corrected and instructs the incidental information update unit 157 to correct the part to be corrected. In the present embodiment, the abnormality detection unit 156 extracts a part of the execution order stored in the progress status table of the storage unit 14 that deviates from the operation sequence defined by the protocol. More specifically, the abnormality detection unit 156 includes a test performed in an order different from the order defined by the support program 141, and a test performed two or more times among the tests defined by the support program 141. By extracting at least one of them, a portion to be corrected is extracted. In order to find the former inspection, the abnormality detection unit 156 detects that the inspection has not been executed in accordance with a predetermined inspection procedure, and whether there is a portion to be corrected according to the state of the inspection that has been executed. Judge whether or not. For example, when an intermediate inspection in the inspection procedure is skipped and executed after the original inspection procedure, the abnormality detection unit 156 detects that the skip operation has been executed. In this case, the abnormality detection unit 156 determines that the order of the image data obtained by the inspection skipped by the skip operation should be corrected to the order determined in the inspection procedure. In addition, in order to find the latter inspection, the abnormality detection unit 156 performs at least a part of the inspection again when at least a part of the inspection is executed again after all the inspections are executed according to the inspection procedure. Detect that. In this case, the abnormality detection unit 156 determines that the order of the image data obtained by the redo inspection should be corrected to the order determined in the inspection procedure.

  The incidental information updating unit 157 corrects the location to be corrected in the incidental information 145 of the storage unit 14 according to the instruction of the abnormality detection unit 156 according to the support program 141. In the present embodiment, the incidental information update unit 157 corrects the image order information of the image data determined to be corrected by the abnormality detection unit 156 so as to match the original order planned by the support program 141. To do.

  In accordance with an image transfer instruction from the operation unit 13, the transfer image determination unit 158 reads the designated image file 146 and incidental information 145 corresponding to the image file 146 from the storage unit 14 and outputs it to the image transfer unit 17.

  Next, an example of the support screen will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of a support screen when a certain protocol is being executed. In the present embodiment, the display unit 16 of the medical device 10 is integrally configured with an operation unit 13 that is a touch panel, and an icon displayed on the support screen functions as a part of the operation unit 13. The present invention is not limited to this, and an operation for designating each icon is input by clicking an icon displayed on the support screen by the operation unit 13 such as a keyboard, a mouse, a touch panel, and various switches. There may be.

As illustrated in FIG. 3, the support screen includes, for example, an operation sequence area 31, an operation panel area 32, an image data area 33, and a preview area 34.
In the operation sequence area 31, icons indicating the examinations arranged along the operation sequence are displayed. In the operation sequence of the protocol being executed, it is determined that the activities A, B, and C and the activity S are executed in this order as described above. In the operation sequence of activity A, it is determined that scans 1, 2, and 3 are executed in this order. In the operation sequence of activity B, it is determined that scans 4, 5, and 6 are executed in this order. In the operation sequence of activity C, it is determined that scans 7, 8, and 9 are executed in this order. In the illustrated example, the colors of the icons of scans 1 and 2 are inverted. This display mode means, for example, that image data has been generated by the scans 1 and 2 inspection.

  The operation panel area 32 is provided with various software switches (icons) for receiving operation inputs. In the present embodiment, the operation panel area 32 includes a character input switch 321, a part designation switch 322, a skip switch 323, a save switch 324, a preview switch 325, a decision switch 326, and a return switch 327. A switch 328 is provided.

  Character input switch 321 accepts a character input start instruction. The site designation switch 322 accepts designation of a site to be examined for the subject. The skip switch 323 receives an instruction to move to an inspection that is out of the sequence of the operation sequence. Hereinafter, an instruction to move to an examination out of the sequence of the operation sequence is referred to as a skip operation. The save switch 324 receives an instruction to save an image file acquired by inspection. The preview switch 325 accepts an instruction to display a list of all image data acquired by inspection in the image data area 33. The decision switch 326 receives an instruction to move to the previous operation or the subsequent operation designated by the return switch 327 or the forward switch 328. The return switch 327 receives an instruction to move to an operation prior to the current operation. The forward switch 328 accepts an instruction to move to an operation after the current operation.

In the image data area 33, image data generated based on information indicating the inspection result by the inspection unit 11 is displayed. In the illustrated example, an image of the image data generated by the scan 2 is displayed.
In the preview area 34, for example, a reduced image of the image data generated by executing the protocol once is displayed. In the illustrated example, a reduced image of the data image generated by the scans 1 and 2 is displayed. In the present embodiment, the examination name is displayed near each reduced image.

Next, an example of processing for setting a protocol will be described with reference to FIG. FIG. 4 is a flowchart illustrating an example of a flow of processing for setting a protocol.
First, the support unit 151 of the control unit 15 receives a protocol setting instruction from the operation unit 13 and starts processing for setting the protocol (step ST101). The support unit 151 controls the display control unit 155 to display a screen for executing processing for setting a protocol on the display unit 16. This screen includes, for example, an input column for inputting a protocol name, a column for specifying the type of activity specified by the protocol, a column for specifying the order of activities specified by the protocol, and the like.
Next, the support unit 151 determines whether or not the type of activity specified by the protocol is specified (step ST102).

When the type of activity is specified via the operation unit 13 (step ST102: YES), the support unit 151 determines the execution order of the specified activity (step ST103). For example, the support unit 151 determines the execution order in the protocol according to the order in which the types of activities are specified. When the designation of activity A is accepted as the first activity, the support unit 151 determines that the execution order of activity A is the first. Subsequently, when the designation of activities B and C is received in this order, the support unit 151 determines the execution order of activities B, C, and S as Nos. 2, 3, and 4.
The support unit 151 stores information indicating the types of designated activities A, B, C, and S and information indicating the execution order 1, 2, 3, and 4 of the activities A, B, C, and S. 14 is temporarily stored (step ST104).

On the other hand, when the type of activity is not designated via the operation unit 13 (step ST102: NO), it is determined whether or not an instruction to end the protocol setting is given (step ST105).
When the end of the protocol setting is instructed via the operation unit 13 (step ST105: YES), the support unit 151 reads the information temporarily stored in the storage unit 14, and determines the activity type and the execution order. Is created (step ST106). For example, the support unit 151 creates a protocol that specifies that the activities A, B, and C are executed in this order.
Next, the support unit 151 registers the created protocol with a name (step ST107). For example, the support unit 151 sets the name of the protocol that specifies that the activities A, B, C, and S are executed in this order as the protocol P1. The support unit 151 may create protocol attribute information such as date and time of creation, creator, and examination name, and register them in association with each other.

  Next, with reference to FIG. 5, an example (first example) of the execution order of operations when the protocol P1 is executed and information generated by the operations will be described. FIG. 5 is a diagram illustrating an example of an operation execution order and information generated accordingly.

  In the execution order of the operations shown in FIG. 5A, the scans 4, 5, 6 of the activity B and the scans 7, 8, 9 of the activity C are executed after the scans 1 and 2 of the activity A. Thereafter, scan 3 of activity A is executed, and finally activity S is executed. As a result, image data D1 and D2 are generated by scans 1 and 2, image data D3, 4, and 5 are generated by scans 4, 5, and 6, and image data D6, 7, and 8 are generated by scans 7, 8, and 9. The image data D9 is generated by the scan 3. When the image data D1 to D9 are stored as the image file 146, they are arranged in this order. In addition, when generating the image data D1 to D9, the image file generation unit 154 assigns image IDs: 001 to 009, which are identification information of the image data, respectively. In the present embodiment, the image file generation unit 154 assigns, as an image ID, a 3-digit decimal number that is counted up by one according to the order of generation.

When the operation is executed in the order shown in FIG. 5A, the incidental information generation unit 153 writes information indicating the execution order as shown in FIG. 5B for each examination in the progress status table. More specifically, the incidental information generation unit 153 writes execution orders 1 and 2 in association with scans 1 and 2, writes execution order 9 in association with scan 3, and executes them in association with scans 4 to 9. Write in order 3-8.
In addition, when a plurality of image data is generated for the same examination, the incidental information generation unit 153 displays information indicating that the generated plurality of image data is an image corresponding to the same examination. Write to the image link area. Since a plurality of pieces of image data are not generated for the same examination in the execution order of the operations shown in FIG. 5A, no information is written in the image link area shown in FIG.

Next, an example of a process for executing the support program 141 will be described with reference to FIG. FIG. 6 is a flowchart illustrating an example of a flow of processing for executing the support program 141.
First, the support unit 151 of the control unit 15 receives an instruction to execute the support program 141 from the operation unit 13, and starts processing for executing the support program 141 (step ST201). The support unit 151 controls the display control unit 155 to display a screen for executing the support program 141 on the display unit 16. This screen includes, for example, a selection field for selecting a protocol to be executed from the protocols stored in the protocol information 143.
The support unit 151 reads out the protocol information 143 of the designated protocol from the storage unit 14, and activates the activity execution unit 152 corresponding to the activity defined by the designated protocol (step ST202). For example, when the protocol P1 is selected as the protocol to be executed from now on, the support unit 151 reads information for executing the protocol P1 from the protocol information 143, and executes the activities corresponding to the activities A, B, C, and S. The unit 152 is activated.
The display control unit 155 generates a support screen indicating the operation sequence of the protocol P1, and displays it on the display unit 16 (step ST203).

  The support unit 151 receives input of attribute information related to the subject to be examined by the protocol P1, and temporarily stores it in the storage unit 14 (step ST204). For example, the support unit 151 includes the subject “Taro Yamada”, the examination name “ultrasound diagnosis of the abdomen”, the examination date and time “○ month ○ day, ○ hour ○ minute”, the examination place “XX hospital”, and the examiner “ Attribute information such as “Ichiro Suzuki” is temporarily stored in the storage unit 14.

  Next, the support unit 151 determines whether or not the “next operation” defined in the protocol is an operation involving an inspection by the inspection unit 11 (step ST205). For example, immediately after the protocol P1 is specified in step ST202 and the protocol P1 is executed, the first operation, scan 1, is the “next operation”. As described above, when the “next operation” is an operation accompanied by the inspection by the inspection unit 11 (step ST205: YES), the activity execution unit 152 can execute the scan 1 of the activity A, which is the first inspection. Transition to the state. Here, the display control unit 155 displays a support screen indicating that the next operation is a scan 1 inspection in accordance with an instruction from the support unit 151, for example, by a display mode such as turning on the scan 1 icon. This is displayed on the part 16. Thereby, the operator can confirm that the next operation is scan 1. Then, the operator executes the scan 1 inspection according to the operation sequence on the support screen. When the inspection operation unit 12 is operated by the operator and the inspection by the inspection unit 11 is executed, the inspection unit 11 outputs information indicating the inspection result to the image file generation unit 154.

  When the “next operation” is an operation involving an inspection by the inspection unit 11 (step ST205: YES), the image file generation unit 154 generates image data based on the information indicating the input inspection result, It is stored in the storage unit 14 as a part of the image file 146 (step ST206). For example, the image file generation unit 154 generates the image data D1 based on the information indicating the inspection result of the scan 1 and stores it in the storage unit 14 as a part of the image file 146.

  Next, the incidental information generation unit 153 generates information indicating the progress status of the support program 141 and stores the information in the storage unit 14 as a part of the incidental information 145 (step ST207). For example, the incidental information generation unit 153 writes that the execution order of scan 1 is No. 1 in the progress information table included in the incidental information 145. Here, the display control unit 155 displays a support screen indicating that the operation of the scan 1 has been completed according to an instruction from the support unit 151, for example, in a display mode such as inverting the color of the icon of the scan 1. 16 may be displayed.

Next, the support unit 151 determines whether or not an operation to skip to an operation other than the operation following the operation that obtained the inspection result has been input (step ST208).
If an operation to skip to other than the next operation is not input (step ST208: NO), the activity execution unit 152 moves to the next operation on the protocol (step ST209). The activity execution unit 152 returns to step ST205 and repeats the process for the next operation on the moved protocol.

  For example, immediately after the scan 1 of the activity A is executed, the “next operation” defined in the protocol is the scan 2, so that the inspection by the inspection unit 11 is performed in step ST 205, which is the movement destination from step ST 209. (Step ST205: YES). In this case, the activity execution unit 152 makes a transition to a state in which the scan 2 of the activity A can be performed. In accordance with an instruction from the support unit 151, the display control unit 155 displays a support screen indicating that the next operation is the scan 2 operation on the display unit 16 by a display mode such as turning on the scan 2 icon. Display. Thereby, the operator can confirm that the next operation is scan 2. Then, the operator executes the scan 2 inspection according to the operation sequence on the support screen. When the inspection operation unit 12 is operated by the operator and the inspection by the inspection unit 11 is executed, the inspection unit 11 outputs information indicating the inspection result to the image file generation unit 154. The image file generation unit 154 generates image data D2 based on information indicating the inspection result of the scan 2, and stores it in the storage unit 14 as a part of the image file 146 (step ST206). The incidental information generation unit 153 writes that the execution order of scan 2 is No. 2 in the progress information table included in the incidental information 145 (step ST207). In accordance with an instruction from the support unit 151, the display control unit 155 displays a support screen indicating that the operation of the scan 2 is completed on the display unit 16 by a display mode such as, for example, reversing the color of the scan 2 icon. It may be displayed.

  On the other hand, when an operation to skip to the next operation is input (step ST208: YES), the activity execution unit 152 moves to the designated operation (step ST210). The activity execution unit 152 returns to step ST205 and repeats the process for the designated operation.

  For example, if the scan 4 operation switch displayed in the operation sequence area 31 is touched after the scan of activity A scan 2 is performed, the “next operation” is scan 4, and therefore, from step ST210 In step ST205, which is the movement destination, it is determined that the operation involves an inspection by the inspection unit 11 (step ST205: YES). In this case, the activity execution unit 152 makes a transition to a state in which the inspection B scan 4 can be executed. The display control unit 155 displays, on the display unit 16, a support screen indicating that the next operation is an operation of the scan 4 according to an instruction from the support unit 151, for example, by a display mode such as turning on an icon of the scan 4. Display. Thereby, the operator can confirm that the next operation is scan 4. Then, the operator executes the scan 4 inspection according to the operation sequence on the support screen. When the inspection operation unit 12 is operated by the operator and the inspection by the inspection unit 11 is executed, the inspection unit 11 outputs information indicating the inspection result to the image file generation unit 154. The image file generation unit 154 generates image data D3 based on information indicating the inspection result of the scan 4, and stores it in the storage unit 14 as a part of the image file 146 (step ST206). The incidental information generation unit 153 writes that the execution order of scan 4 is No. 3 in the progress information table included in the incidental information 145 (step ST207). The display control unit 155 may cause the display unit 16 to display that the operation of the scan 4 has been completed on the support screen by, for example, a display mode in which the color of the icon of the scan 4 is reversed.

  In the execution order of the operations illustrated in FIG. 5, after the scan 4 inspection is executed, the scans 5 to 9 are subsequently executed. Immediately after the scan 9 inspection is executed, the “next operation” defined in the protocol is the activity S. Therefore, in step ST205, which is the movement destination from step ST209, the operation is not an operation accompanied by the inspection by the inspection unit 11. Determination is made (step ST205: NO). In this case, the activity execution unit 152 makes a transition to a state in which the activity S defined as the next operation of the scan 9 can be executed on the protocol P1. The display control unit 155 displays, on the display unit 16, a support screen indicating that the next operation is an operation of the store 1 according to an instruction from the support unit 151, for example, by turning on an icon of the store 1. Display. Thereby, the operator can confirm that the next operation is the store 1.

  When it is determined that the operation is not an operation involving the inspection by the inspection unit 11 (step ST205: NO), the activity execution unit 152 determines whether or not the operator has instructed execution of a process other than the inspection (step ST211). For example, when the save switch 324 on the support screen is not touched by the operator, the activity execution unit 152 determines that the operator is not instructed to execute a process other than the inspection (step ST211: NO). Then, the activity execution unit 152 determines whether or not the operator has instructed the end of the execution of the current protocol (step ST213). Here, the display control unit 155 may superimpose a sub-screen for confirming whether or not to end the currently executing protocol on the support screen and display the sub-screen on the display unit 16. For example, when the support screen determination switch 326 is touched by the operator, the activity execution unit 152 determines that the operator has instructed the end of the execution of the current protocol (step ST213: YES), and executes the protocol. finish.

In step ST213, the end of execution of the current protocol is not instructed by the operator. For example, when the operator touches the scan 3 icon on the support screen, the activity execution unit 152 determines that the end of execution of the current protocol is It is determined that no instruction is given by the person (step ST213: NO), and the process returns to step ST205.
As described above, when the scan 3 icon on the support screen is touched by the operator, the “next operation” defined in the protocol is scan 2, so that the activity execution unit 152 is the destination from step ST 213. In a certain step ST205, it is determined that the operation is accompanied by an inspection by the inspection unit 11 (step ST205: YES), and a transition is made to a state where the inspection of scan 3 of activity A can be performed. The display control unit 155 displays, on the display unit 16, a support screen indicating that the next operation is an operation of the scan 3 according to an instruction from the support unit 151, for example, by a display mode such as turning on an icon of the scan 3. Display. Thereby, the operator can confirm that the next operation is scan 3. Then, the operator executes the scan 3 inspection according to the operation sequence on the support screen. When the inspection operation unit 12 is operated by the operator and the inspection by the inspection unit 11 is executed, the inspection unit 11 outputs information indicating the inspection result to the image file generation unit 154. The image file generation unit 154 generates image data D9 based on the information indicating the inspection result of the scan 3, and stores it in the storage unit 14 as a part of the image file 146 (step ST206). The incidental information generation unit 153 writes that the execution order of scan 3 is No. 9 in the progress information table included in the incidental information 145 (step ST207). In accordance with an instruction from the support unit 151, the display control unit 155 displays a support screen indicating that the operation of the scan 3 is completed on the display unit 16 by a display mode such as, for example, reversing the color of the scan 3 icon. It may be displayed.
In this way, the activity execution unit 152 executes all the inspections of the scans 1 to 9 included in the protocol P1.

  After executing the last scan 3, the activity execution unit 152 returns to step ST205 and repeats the process. In this case, since the “next operation” defined in the protocol is the store 1, in step ST205, which is the movement destination from step ST209, the activity execution unit 152 determines that the operation is not an operation involving inspection by the inspection unit 11. (Step ST205: NO), transition is made to a state where the process of the store 1, which is the next operation, can be executed. In this case, the activity execution unit 152 determines whether or not the operator has instructed execution of processes other than the inspection (step ST211). When the save screen 324 on the support screen is touched by the operator, the activity execution unit 152 determines that the operator has instructed execution of processing other than the inspection (step ST211: YES), and executes the instructed processing. (Step ST212). When the save switch 324 is touched, the activity execution unit 152 reads all the image data D1 to D9 generated by the execution of the current protocol from the image file 146 in the storage unit 14, and the image data is generated in the order of generation. One arranged image file 146 is generated.

  Next, an example of processing performed by the abnormality detection unit 156 and the accompanying information update unit 157 will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of a process flow for extracting a portion to be corrected and correcting the extracted portion.

  The abnormality detection unit 156 determines whether or not the execution order of each examination stored in the progress status table of the incidental information 145 is in accordance with the order specified by the protocol (step ST301). For example, when the execution order of each examination stored in the progress information table does not match the order specified in the protocol, the abnormality detection unit 156 determines that the order is not in accordance with the order specified in the protocol. To do. Further, when the number of examinations stored in the progress information table is different from the number of examinations specified in the protocol, the abnormality detection unit 156 determines that the order is not in accordance with the protocol. May be.

  When the execution order stored in the progress situation table does not follow the order specified by the protocol (step ST302: NO), the abnormality detection unit 156 specifies the execution order in the image data arrangement order by the protocol. The part corresponding to the inspection that does not follow the order is extracted as the part to be corrected (step ST303). The abnormality detection unit 156 instructs the incidental information update unit 157 to correct the extracted location to be corrected. In the execution order of the operations illustrated in FIG. 5, the scans 4 to 9 are executed after the scans 1 and 2, and then the scan 3 is returned. In this case, the abnormality detection unit 156 extracts a portion corresponding to the scan 3 in the arrangement order of the image data as a portion to be corrected. In addition, the abnormality detection unit 156 displays the reproduction position of the image data D9 (see FIG. 5) generated by the scan 3 inspection, the image data D2 generated by the scan 2 inspection, and the image generated by the scan 4 inspection. The auxiliary information update unit 157 is instructed to correct the position to the position between the data D3.

  The incidental information update unit 157 corrects the image order information corresponding to the portion to be corrected in accordance with the instruction from the abnormality detection unit 156 (step ST304). In the present embodiment, the incidental information update unit 157 sets “9” as the image order information associated with the image ID “009” indicating the image data D9 corresponding to the scan 3 in the image attribute table of the incidental information 145. To "3". In addition, the incidental information update unit 157 includes an image order associated with image IDs “003” to “008” indicating image data D3 to D8 corresponding to scans 4 to 9 in the image attribute table of the incidental information 145, respectively. The information is corrected so as to be lowered from “3-8” to “4-9”, respectively. An example of the image attribute table before and after correction is shown in FIG. FIG. 8 is a diagram illustrating an image attribute table before and after correction and an image comment area when operations are performed in the order illustrated in FIG. As shown in the figure, the incidental information update unit 157 may write information indicating the correction contents in the image comment area of the incidental information 145.

  In addition, the process by the abnormality detection part 156 or the incidental information update part 157 is not restricted to this. For example, the incidental information update unit 157 may correct the image generation date and time corresponding to the location to be corrected in accordance with the instruction from the abnormality detection unit 156. For example, the incidental information update unit 157 sets the image generation date and time associated with the image ID “009” indicating the image data D9 corresponding to the scan 3 in the image attribute table of the incidental information 145 to the image corresponding to the scan 2. At the time between the image generation date and time associated with the image ID “002” indicating the data D2 and the image generation date and time associated with the image ID “003” indicating the image data D3 corresponding to the scan 4 It may be corrected. In this case, the incidental information update unit 157 may write the image generation date and time before correction and the image generation date and time after correction in the image comment area of the incidental information 145.

Next, the incidental information update unit 157 determines whether or not other information included in the incidental information 145 is changed or added (step ST305). When other information included in the incidental information 145 is changed or added (step ST305: YES), the incidental information update unit 157 updates the corresponding information (step ST306).
When it is determined for all the image files stored in the image file 146 that there is a portion to be corrected (step ST307: YES), the abnormality detection unit 156 ends the process. When that is not right (step ST307: NO), the abnormality detection part 156 returns to step ST301 and repeats a process.

FIG. 8 is a diagram illustrating an image attribute table before and after correction and an image comment area when operations are performed in the order illustrated in FIG.
As shown in FIG. 8, information immediately after the image data is generated by the image file generation unit 154 is stored in the pre-update image attribute table. On the other hand, the updated image attribute table stores information immediately after the location to be corrected is extracted by the abnormality detection unit 156 and then corrected by the incidental information update unit 157.
In the image attribute table before update, image order information 1 to 9 is stored in association with image IDs 001 to 009, respectively. On the other hand, in the updated image attribute table, the image order information 1 and 2 are stored in the image ID: 001, 002, the image order information 3 is stored in the image ID: 009, and the image order information 4 through 9 are stored in the image IDs 003 to 009. Are stored in association with each other.
No information is written in the image comment area before update. On the other hand, information indicating the contents of correction is written in the updated image comment area. Specifically, the image order information “9” of the image ID: 009 is corrected to “3”, and the image order information “3-8” of the image ID: 003-008 is corrected to “4-9”. Is written in the image comment area as information indicating the correction contents.

  Next, another example (second example) of the execution order of operations when the protocol P1 is executed and information generated by this operation will be described with reference to FIG. FIG. 9 is a diagram illustrating another example of the execution order of operations and information generated along with this.

  In the execution order of the operations shown in FIG. 9A, after scans 1 to 9 of activity A, scan 3 is executed once again. As a result, the image file generation unit 154 generates image data D1 to D9 based on the inspection results of the scans 1 to 9, and generates image data D10 based on the inspection result of the second scan 3. The image file generation unit 154 assigns sequential image IDs: 001 to 010 in the order of generation to the image data D1 to D10, arranges them in this order, and stores them in the image file 146.

When the operation is executed in the order shown in FIG. 9A, the incidental information generation unit 153 writes information indicating the execution order as shown in FIG. 9B for each examination in the progress status table. More specifically, the incidental information generation unit 153 writes execution orders 1 and 2 in association with scans 1 and 2, writes execution orders 3 and 10 in association with scan 3, and associates with scans 4 to 9. Write the execution order 4-9.
In addition, when a plurality of image data is generated for the same examination, the incidental information generation unit 153 displays information indicating that the generated plurality of image data is an image corresponding to the same examination. Write to the image link area. According to the execution order of the operation shown in FIG. 9A, a plurality of pieces of image data D3 and D10 are generated for the inspection of scan 3, and therefore, the image data in the image link area shown in FIG. Information associating the image ID “003” of D3 with the image ID “010” of the image data D10 is written.

When the confirmation of the arrangement order of the image data is instructed, the abnormality detection unit 156 determines that the execution order of each examination stored in the progress status table shown in FIG. 9B is in accordance with the order specified by the protocol. It is determined whether or not.
In the example of FIG. 9, as described above, the scan 3 is executed twice. In this case, the abnormality detection unit 156 determines that the order specified by the protocol is not met. In addition, the abnormality detection unit 156 changes the arrangement order of the image data generated by the last inspection among the plurality of image data generated corresponding to the scan 3 to the arrangement order corresponding to the order of the scan 3 on the protocol. Determine that it should be corrected. Therefore, the abnormality detection unit 156 extracts the first and second scans 3 as locations to be corrected. In addition, the abnormality detection unit 156 corrects the exchange of the reproduction position of the image data D10 generated by the second scan 3 inspection and the reproduction position of the image data D3 generated by the first scan 3 inspection. An instruction is given to the incidental information update unit 157.

FIG. 10 is a diagram illustrating an image attribute table before and after correction and an image comment area when operations are performed in the order illustrated in FIG. 9.
In the image attribute table before update, image order information 1 to 10 is stored in association with image IDs 001 to 010, respectively. On the other hand, in the updated image attribute table, the image order information 1 and 2 are stored in the image IDs 001 and 002, the image order information 10 is stored in the image ID 003, and the image order information 4 and 9 are stored in the image IDs 004 to 009. The image order information 3 is stored in association with the image ID: 010, respectively.
No information is written in the image comment area before update. On the other hand, in the updated image comment area, the image order information “3” of the image ID: 003 has been corrected to “10”, and the image order information “10” of the image ID: 010 has been corrected to “3”. Is written as information indicating the contents of correction.

  The incidental information update unit 157 sets the image order information associated with the image ID “003” indicating the image data D3 corresponding to the first scan 3 in the image attribute table before update illustrated in FIG. To "10". Further, the incidental information update unit 157 stores the image order information associated with the image ID “010” indicating the image data D10 corresponding to the second scan 3 in the pre-update image attribute table illustrated in FIG. Correct from “10” to “3”. Further, the incidental information update unit 157 writes information indicating the correction contents in the image comment area of the incidental information 145.

  As described above, when the same inspection is executed twice or more, the abnormality detection unit 156 selects the image data generated by the last inspection among the plurality of image data generated corresponding to the same inspection, It is determined that the sequence should be corrected in accordance with the order of the examination in the protocol.

Next, with reference to FIG. 11, another example (third example) of the execution order of operations when the protocol P1 is executed, and information generated by this operation will be described. FIG. 11 is a diagram illustrating another example of the execution order of operations and information generated accordingly.
In the execution order of the operations shown in FIG. 11A, after scans 1 to 9 of activity A, scans 4 to 5 of activity B are executed once again. As a result, the image file generation unit 154 generates image data D1 to D9 based on the inspection results of the scans 1 to 9, and generates image data D10 to D12 based on the inspection results of the second scans 4 to 6. The image file generation unit 154 assigns sequential image IDs: 001 to 012 in the order of generation to the image data D1 to D12, arranges them in this order, and stores them in the image file 146.

  When the operation is executed in the order shown in FIG. 11A, the incidental information generation unit 153 writes information indicating the execution order as shown in FIG. 11B for each examination in the progress status table. More specifically, the incidental information generation unit 153 writes execution orders 1 to 3 in association with scans 1 to 3, writes execution orders 4 and 10 in association with scan 4, and executes them in association with scan 5. Orders 5 and 11 are written, execution orders 6 and 12 are written in association with scan 6, and execution orders 7-9 are written in association with scans 7-9.

  In addition, when a plurality of image data is generated for the same examination, the incidental information generation unit 153 displays information indicating that the generated plurality of image data is an image corresponding to the same examination. Write to the image link area. According to the execution order of the operation shown in FIG. 11A, since a plurality of pieces of image data D4 and D10 are generated for the scan 4 inspection, the image link area shown in FIG. Information in which the image ID “004” of the data D4 is associated with the image ID “010” of the image data D10 is written. In addition, since a plurality of image data D5 and D11 are generated for the inspection of scan 5, the image ID “005” of the image data D5 and the image data D11 are included in the image link area shown in FIG. Is associated with the image ID “011”. Since a plurality of pieces of image data D6 and D12 are generated for the scan 6 inspection, the image ID “006” of the image data D6 and the image data D12 are displayed in the image link area shown in FIG. Information associated with ID “012” is written.

When the confirmation of the arrangement order of the image data is instructed, the abnormality detection unit 156 determines that the execution order of each examination stored in the progress status table shown in FIG. 11B is in accordance with the order specified by the protocol. It is determined whether or not.
In the example of FIG. 11, as described above, each of scans 4, 5, and 6 is executed twice. In this case, the abnormality detection unit 156 determines that the order specified by the protocol is not met. In addition, the abnormality detection unit 156 includes, in a plurality of image data generated corresponding to each of the scans 4, 5, 6, the arrangement order of the image data generated by the last inspection of each of the scans 4, 5, 6. Are to be corrected in the order of arrangement according to the order of scans 4, 5, and 6 in the protocol. Therefore, the abnormality detection unit 156 extracts the first and second scans 4, 5, and 6 as locations to be corrected. Further, the abnormality detection unit 156 is generated by the reproduction position of the image data D10, D11, D12 generated by the second scan 4, 5, 6 and the first scan 4, 5, 6 inspection. The auxiliary information update unit 157 is instructed to correct the exchange of the reproduction positions of the image data D10, D11, and D12.

FIG. 12 is a diagram illustrating an image attribute table before and after correction and an image comment area when operations are performed in the order illustrated in FIG. 11.
In the image attribute table before update, image order information 1 to 12 is stored in association with image IDs 001 to 012, respectively. On the other hand, in the updated image attribute table, image order information 1 to 3 is stored in image IDs 001 to 003, image order information 10 to 12 is stored in image IDs 004 to 006, and image order information is stored in image IDs 007 to 009. 7 to 9 are stored in association with the image IDs: 010 to 012 and the image order information 4 to 6, respectively.
No information is written in the image comment area before update. On the other hand, in the updated image comment area, the image order information “4-6” of the image IDs: 004 to 006 has been corrected to “10-12”, respectively, and the image order information “10” of the image IDs: 010 to 012 "-12" has been corrected to "4-6", respectively, is written as information indicating the correction contents.

  The incidental information update unit 157 includes image IDs “004”, “005”, and image IDs D4, D5, and D6 corresponding to the first scans 4, 5, and 6 in the pre-update image attribute table illustrated in FIG. The image order information associated with “006” is corrected from “4” to “10”, from “5” to “11”, and from “6” to “12”. Also, the incidental information update unit 157 has image IDs “010” and “011” indicating the image data D10, D11, and D12 corresponding to the second scans 4, 5, and 6 in the image attribute table before update shown in FIG. ”And“ 012 ”are corrected from“ 10 ”to“ 4 ”, from“ 11 ”to“ 5 ”, and from“ 12 ”to“ 6 ”, respectively. Further, the incidental information update unit 157 writes information indicating the correction contents in the image comment area of the incidental information 145.

  As described above, when the same inspection is executed twice or more, the abnormality detection unit 156 selects the image data generated by the last inspection among the plurality of image data generated corresponding to the same inspection, It is determined that the sequence should be corrected in accordance with the order of the examination in the protocol. Thereby, it can be determined that the arrangement order of the image data generated by the reexamined inspection should be corrected in the arrangement order corresponding to the inspection order on the protocol.

Next, another example (fourth example) of the execution order of operations when the protocol P1 is executed and information generated by this operation will be described with reference to FIG. FIG. 13 is a diagram illustrating another example of the execution order of operations and information generated along with this.
In the execution order of the operations shown in FIG. 13A, scans 7 to 9 of activity C are executed after scans 1 to 3 of activity A. Thereafter, scans 4 to 6 of activity B are executed. As the inspection result according to the execution order of this operation, the image file generation unit 154 generates image data D1 to D3 based on the inspection results of scans 1 to 3, and the image data D7 to D9 based on the inspection results of scans 4 to 6. The image data D4 to D6 are generated based on the inspection results of the scans 7 to 9. The image file generation unit 154 assigns sequential image IDs: 001 to 009 to the generated image data D1 to D9, arranges them in this order, and stores them in the image file 146.

When the operation is executed in the order shown in FIG. 13A, the incidental information generation unit 153 writes information indicating the execution order as shown in FIG. 13B for each examination in the progress status table. More specifically, the incidental information generation unit 153 writes execution orders 1 to 3 in association with scans 1 to 3, writes execution orders 7 to 9 in association with scans 4 to 6, and scans 7 to 9 Corresponding execution orders 4 to 6 are written.
In addition, when a plurality of image data is generated for the same examination, the incidental information generation unit 153 displays information indicating that the generated plurality of image data is an image corresponding to the same examination. Write to the image link area. Since a plurality of pieces of image data are not generated for the same examination in the execution order of the operations shown in FIG. 13A, no information is written in the image link area shown in FIG.

When the confirmation of the arrangement order of the image data is instructed, the abnormality detection unit 156 determines that the execution order of each examination stored in the progress situation table shown in FIG. 13B is in accordance with the order specified by the protocol. It is determined whether or not.
In the example of FIG. 13, as described above, the process skips after scans 1 to 3, executes scans 7 to 9, and then returns to scans 4 to 6. In this case, the abnormality detection unit 156 determines that the order specified by the protocol is not met. Then, the abnormality detection unit 156 determines that the arrangement order of the image data D7-9 generated by the skipped scans 4-6 should be corrected in the arrangement order corresponding to the order of the scans 4-6 on the protocol. To do. The abnormality detection unit 156 determines the arrangement order of the image data D7 to 9 generated by the inspections of the scans 4 to 6, the image data D3 generated by the inspection of the scan 3 and the image data D7 generated by the inspection of the scan 7 The auxiliary information update unit 157 is instructed to correct the position between the two.

FIG. 14 is a diagram illustrating an image attribute table before and after correction and an image comment area when operations are performed in the order illustrated in FIG.
In the image attribute table before update, image order information 1 to 9 is stored in association with image IDs 001 to 009, respectively. On the other hand, in the updated image attribute table, image order information 1 to 3 is stored in image IDs 001 to 003, image order information 7 to 9 is stored in image IDs 004 to 006, and image order information is stored in image IDs 007 to 009. 4 to 6 are stored in association with each other.
No information is written in the image comment area before update. On the other hand, in the updated image comment area, the image order information “4-6” of the image IDs: 004 to 006 has been corrected to “7-9”, respectively, and the image order information “7 of image IDs: 007 to 009”. "-9" is corrected to "4-6" is written as information indicating the correction contents.

  The supplementary information update unit 157 includes image IDs “004”, “005”, and “006” indicating the image data D4, D5, and D6 corresponding to the scans 7, 8, and 9 in the pre-update image attribute table illustrated in FIG. The image order information associated with is corrected from “4” to “7”, from “5” to “8”, and from “6” to “9”. Further, the incidental information update unit 157 has image IDs “007”, “008”, ““ indicating the image data D7, D8, D9 corresponding to the scans 4, 5, 6 in the image attribute table before update shown in FIG. The image order information associated with “009” is corrected from “7” to “4”, from “8” to “5”, and from “9” to “6”. Further, the incidental information update unit 157 writes information indicating the correction contents in the image comment area of the incidental information 145.

  As described above, after the inspection is performed by skipping the order in the protocol, when the skipped inspection is executed, the abnormality detection unit 156 skips the image data generated by the inspection that is skipped and executed later. It is determined that the reproduction position should be corrected to the reproduction position according to the order of the examination in the protocol.

Next, display processing of the image file 146 will be described with reference to FIG. FIG. 15 is a flowchart illustrating an example of a flow of display processing of the image file 146 executed by the image storage device 20. Note that such processing may be similarly executed in the medical apparatus 10 with the display unit 16 as a control target.
The control unit 22 reads the image file whose display is designated by the operation unit 25 and the accompanying information 145 (step ST401). For example, the control unit 22 transmits information indicating the designated image file 146 to the medical device 10 via the communication unit 21. Based on the information indicating the received image file 146, the medical device 10 reads the specified image file 146 and a part of the incidental information 145 associated with the image file 146, and transmits it to the image storage device 20. . Here, the medical device 10 reads information that can recognize the correspondence between the plurality of pieces of image data and the examination as supplementary information 145 associated with the image file 146 from the storage unit 14, and stores the information in the image storage device 20. Send. The image storage device 20 receives the image file 146 and the accompanying information 145 from the medical device 10.

  Information that can recognize the correspondence between a plurality of image data and inspection includes, for example, information stored in the image link area or information stored in the progress table, etc. Information indicating a plurality of image data generated based on the result is included. In addition, information that can recognize the correspondence between a plurality of image data and examinations includes image data corresponding to each examination such as image order information or information stored in an image comment area. Information to be displayed in the order of is included. That is, the information that can recognize the correspondence between the plurality of image data and the inspection is not limited to the information that directly indicates the correspondence between the image data and the inspection, but the relationship between the image data or the arrangement of the image data Thus, information indicating the correspondence between the image data and the inspection indirectly is also included.

The control unit 22 determines whether or not the number of image data included in the read image file exceeds the number of images according to the protocol (step ST402).
When it is determined that the number of image data included in the read image file exceeds the number of images according to the protocol (step ST402: YES), the control unit 22 displays an image based on the image data, and a representative image for duplicate images. Are displayed on the display unit 23 in an arrangement corresponding to the image order information (step ST403). Here, the overlapping image refers to a plurality of images related to the same examination in one image file 146. The representative image refers to one image selected from overlapping images. In addition, the control unit 22 causes the display unit 23 to display the display mode of the overlapping image in a mode that can be distinguished from an image that is not an overlapping image (that is, an image that has only one image data for one examination). .

  For example, when the image file 146 and the accompanying information 145 received by the control unit 22 are the image file 146 and the accompanying information 145 generated based on the execution order of the operations illustrated in FIG. 9, the image included in the accompanying information 145 In the link area, image data D3 (image ID: “003”) and image data D10 (image ID: “010”) are associated with each other. In this case, the control unit 22 may display the image data D10 generated last on the display unit 23 as a representative image at the display position where the scan 3 is displayed, or display the image data D3 as a representative image. 23, or the image data D3 and the image data 10 may be alternately displayed on the display unit 23 as a representative image. As an example of “displaying on the display unit 23 in a manner distinguishable from non-overlapping images”, a frame line having a different color, brightness, blinking, etc. from the non-overlapping image is given to the representative image, It is possible to apply effects to brightness and color. According to the example of FIG. 9, the control unit 22 changes the display mode of the representative image representing the image data D3 and the image data D10 that are overlapping images to other images (images based on the image data D1, D2, D4 to D9). ).

  When it is determined that the number of image data included in the read image file 146 is equal to or less than the number of images according to the protocol (step ST402: NO), the control unit 22 determines all the image data included in the read image file 146. An image based on the image data is displayed on the display unit 23 in an arrangement corresponding to the image order information (step ST404). In this case, since the duplicate image should not exist, the process of displaying the representative image is not performed.

FIG. 16 is a diagram illustrating a display mode of the image file 146 generated based on the execution order of the operations illustrated in FIG.
As shown in FIG. 16, the display unit 23 displays a playback screen in which the display area is divided by a plurality of examinations (for example, 9) executed by the protocol P1 in one screen. As described above, the image order information 1, 2, and 3 are displayed at the upper left, center, and right in the playback screen, and the image order information 4, 5, and 6 are displayed at the left, center, and right in the playback screen. Image order information 7, 8, and 9 is assigned to the left, center, and right of the lower part of the image, respectively.

  Based on the image order information included in the supplementary information 145, the control unit 22 sets the image data D1, D2, and D9 to the left, center, and right in the upper stage in the playback screen, and the image data D3, D4, and D5 in the playback screen. The image data D6, D7, and D8 are displayed on the left, center, and right of the lower stage in the reproduction screen, respectively, on the left, center, and right of the middle. As a result, the images generated by scans 1, 2, and 3 are generated at the upper left, center, and right in the playback screen, and the scans 4, 5, and 6 are generated at the left, center, and right in the playback screen. The images generated by the scans 7, 8, and 9 are displayed on the lower left, center, and right of the reproduction screen, respectively. Therefore, images arranged in a predetermined order of the inspection procedure are displayed at predetermined display positions on the reproduction screen. Therefore, even if the inspection is not performed according to the predetermined inspection procedure, the inspection screen is arranged in the order of the predetermined inspection procedure on the reproduction screen.

FIG. 17 is a diagram illustrating a display mode of the image file 146 generated based on the execution order of the operations illustrated in FIG. 9.
Based on the image order information included in the auxiliary information 145, the control unit 22 sets the image data D1, D2, and D10 to the upper left, center, and right in the playback screen, and the image data D4, D5, and D6 to the playback screen. The image data D7, D8, and D9 are displayed on the left, center, and right of the lower stage in the reproduction screen, respectively, in the middle, left, center, and right. As a result, the images generated by scans 1, 2, and 3 are generated at the upper left, center, and right in the playback screen, and the scans 4, 5, and 6 are generated at the left, center, and right in the playback screen. The images generated by the scans 7, 8, and 9 are displayed on the lower left, center, and right of the reproduction screen, respectively.

In addition, the control unit 22 displays the image data D10 in a display mode in which a representative image of a predetermined overlapping image is displayed in the upper right image area of the reproduction screen. For example, the control unit 22 surrounds the image area on the right side of the upper stage of the reproduction screen with a colored frame, and displays the image data D10 to be switchable to the image data D3.
In addition to the frame color, the control unit 22 may display an icon or the like so that it can be identified that there is a duplicate image.
When the control unit 22 switches between the image data D10 and the image data 3, the control unit 22 may display the two images as a moving image (or slide show) that is continuously played back, and the image switching is input via the operation unit 25. You may make it switch in the case of. In this case, the control unit 22 may display the image data 10 generated last with priority. As an example of preferential display, the image based on the image data D10 is switched or displayed at the beginning of the slide show, and the image based on the image data D10 is made to have higher image quality than the image based on the image data D3. For example, the size of the image is larger than the image based on the image data D3, or the image is displayed on the upper side when superimposed.
As a result, images arranged in the order of the predetermined inspection procedure are displayed at predetermined positions on the reproduction screen. Further, even when a plurality of image data are generated by the same examination, the image after the redo can be displayed preferentially and the image before the redo can be displayed preliminarily.

FIG. 18 is a diagram illustrating a display mode of the image file 146 generated based on the execution order of the operations illustrated in FIG.
Based on the image order information included in the auxiliary information 145, the control unit 22 sets the image data D1, D2, and D10 to the upper left, center, and right in the playback screen, and sets the image data D10, D11, and D12 in the playback screen. The image data D7, D8, and D9 are displayed on the left, center, and right of the lower stage in the reproduction screen, respectively, in the middle, left, center, and right. As a result, the images generated by scans 1, 2, and 3 are generated at the upper left, center, and right in the playback screen, and the scans 4, 5, and 6 are generated at the left, center, and right in the playback screen. The images generated by the scans 7, 8, and 9 are displayed on the lower left, center, and right of the reproduction screen, respectively.
In addition, the control unit 22 displays the image data D10, D11, and D12 in a display mode in which a representative image of a predetermined overlapping image is displayed in the left, center, and right image regions where the reproduction screen is interrupted. For example, the control unit 22 can switch the image data D11 to the image data D5 and the image data D10 to be switched to the image data D3 by surrounding the left, center, and right image areas in the middle of the reproduction screen with a colored frame. In addition, the image data D12 is displayed so as to be switched to the image data D6. Note that the details of the processing related to the display of the representative image are the same as those in the above-described example of FIG.

FIG. 19 is a diagram illustrating a display mode of the image file 146 generated based on the execution order of the operations illustrated in FIG.
Based on the image order information included in the supplementary information 145, the control unit 22 sets the image data D1, D2, and D3 to the upper left, center, and right in the playback screen, and sets the image data D7, D8, and D9 in the playback screen. The image data D4, D5, and D6 are respectively displayed on the left, center, and right of the lower stage in the reproduction screen. As a result, the images generated by scans 1, 2, and 3 are generated at the upper left, center, and right in the playback screen, and the scans 4, 5, and 6 are generated at the left, center, and right in the playback screen. The images generated by the scans 7, 8, and 9 are displayed on the lower left, center, and right of the reproduction screen, respectively.

  According to the embodiment described above, the abnormality detection unit 156 extracts a portion to be corrected according to the progress of the support program 141 in the arrangement order of the image data generated based on the inspection result of the inspection unit 11. As a result, it is possible to appropriately extract a correction required portion in the arrangement of the image data obtained by the inspection.

  In addition, according to the embodiment, the abnormality detection unit 156 is executed twice or more among the inspections performed in an order different from the order prescribed by the support program 141 and the examinations prescribed by the support program 141. By finding at least one of the inspections, the location to be corrected is extracted, so even if the inspection procedure is different from the original procedure or the inspection is re-executed Thus, it is possible to appropriately extract a portion requiring correction in the array of image data obtained by the above.

  Moreover, according to the embodiment, the location to be corrected is appropriately corrected by including the incidental information update unit 157 that corrects the location to be corrected extracted by the abnormality detection unit 156 along the support program 141. Can do.

  Further, according to the embodiment, image data based on the last inspection among a plurality of image data generated from the result of the same inspection being executed a plurality of times is executed in the order determined by the support program 141. By providing the incidental information update unit 157 for correcting the portion to be corrected so as to be handled as image data based on the inspection, the latest image data can be reflected in the processing result.

  Further, according to the embodiment, image data representing a plurality of image data corresponding to the same examination is displayed on the display unit in a manner that can be distinguished from image data having only one image data corresponding to the same examination. By providing the control unit 22 to be displayed, the person who viewed the display unit can immediately recognize that re-execution is performed in the same examination and a plurality of pieces of image data are generated.

In the above embodiment, the following changes / replacements can be made.
For example, in the above embodiment, the image storage device 20 displays the image data received from the medical device 10 via the network. However, the image data transmitted from the medical device 10 to the image storage server connected to the network. May be stored and the image storage device 20 may read the image data from the image storage server.

  Further, in the above-described embodiment, the overlapping image is described as a plurality of images related to the same examination in one image file 146, but is not limited thereto. For example, the overlapping images may be a plurality of images manually associated by the operator via the operation unit 13. Further, the change of the arrangement order of overlapping images may be manually set by the operator via the operation unit 13. In this case, the control unit 15 of the medical device 10 stores information indicating a correspondence relationship in which a plurality of images associated by the operator via the operation unit 13 are a plurality of images corresponding to the same examination. Remember me. The control unit 15 refers to the information indicating the correspondence relationship stored in the storage unit 14, and, as described above, for example, the image region displaying the overlapping image is colored with the plurality of images associated with the operator. You may display on the display part 16 with the display mode which displays an overlapping image, such as enclosing with a frame and displaying a several image so that switching is possible. Similarly, the control unit 22 of the image storage device 20 displays a plurality of images associated by the operator based on the information indicating the correspondence acquired from the storage unit 14 and displays the above-described overlapping images. May be displayed on the display unit 23.

  In the above embodiment, the medical device 10 is moved to the next examination or the like when an operator's operation is input. However, when the medical device 10 determines that the execution of the examination is completed, It may automatically move to a state where the next inspection or the like is possible. In this case, the control unit 15 may write, as information indicating the progress status of the support program 141, information indicating the progress status of the support program 141 that automatically proceeds in accordance with the inspection of the inspection unit 11 in the storage unit 14. In addition, when the execution of the inspection is incomplete due to the skip operation or the like, the support unit 151 may automatically return to the inspection that has not been performed after the final inspection is performed.

  In the above embodiment, the medical device 10 includes the abnormality detection unit 156 and the incidental information update unit 157. However, the image storage device 20 may include these functions.

  In the above embodiment, the incidental information generation unit 153 generates attribute information indicating the attribute of the image data and writes the attribute information in the incidental information 145. However, the attribute information is generated by the image file generation unit 154, and the image data It may be written in a header or the like. In this case, the incidental information update unit 157 may correct the attribute information written in the header or the like instead of the image order information.

  In the above embodiment, the incidental information generation unit 153 stores the progress status table and the image attribute table as part of the incidental information 145. However, the image file generation unit 154 executes these processes. Also good.

  According to at least one embodiment described above, in the arrangement order of the image data generated based on the inspection result of the inspection unit 11, the abnormality detection unit 156 that extracts a portion to be corrected according to the progress of the support program 141. Therefore, it is possible to appropriately extract a correction required portion in the image data array obtained by the inspection.

  The medical device 10 and the image storage device 20 of the above-described embodiment include, for example, a processing device such as a CPU (Central Processing Unit), and each of them is executed by executing a program stored in the storage unit 14 or 24 or the like. Various functions (support unit 151, activity execution unit 152, auxiliary information generation unit 153, image file generation unit 154, display control unit 155, abnormality detection unit 156, auxiliary information update unit 157, transfer image determination unit 158, and control unit 22 Etc.). This program may be prepared in advance when the medical device 10 or the image storage device 20 is shipped, or may be downloaded by starting a network from another computer, or a program stored in a recording medium is installed. May be. The recording medium may take any form as long as the recording medium can store the program and can be read by the apparatus, such as an optical disk or a USB memory. Further, the function obtained by installing or downloading in advance may be realized in cooperation with an OS (operating system) or the like inside the apparatus. Also, some or all of the various functions described above may be realized by hardware such as LSI (Large Scale Integration) or ASIC (Application Specific Integrated Circuit).

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 10 ... Medical device, 11 ... Examination part, 12 ... Examination operation part, 13 ... Operation part, 14 ... Memory | storage part, 15 ... Control part, 16 ... Display part, 17 ... Image transfer part, 20 ... Image storage apparatus, 21 ... Communication unit, 22 ... Control unit, 23 ... Display unit, 24 ... Storage unit, 25 ... Operation unit, 141 ... Support program, 142 ... Main program, 143 ... Protocol information, 144 ... Activity program, 145 ... Additional information, 146 ... Image file 151... Support unit 152. Activity execution unit 153. Additional information generation unit 154. Image file generation unit 155. Display control unit 156. Abnormality detection unit 157. Image determination unit

Claims (7)

A support program that assists the examination of the subject using the examination unit in a predetermined order, and information indicating the progress status of the assistance program that progresses according to the operation of the operator is stored. A storage unit;
Abnormality detection capable of extracting a portion to be corrected in the arrangement order of the plurality of image data generated based on the information indicating the result of the inspection according to the information indicating the progress of the support program stored in the storage unit And
A medical device comprising:   The medical apparatus according to claim 1, wherein the plurality of pieces of image data from which the abnormality detection unit extracts portions to be corrected in the arrangement order are a plurality of pieces of image data obtained by examining the same subject.   The abnormality detection unit performs at least one of inspections performed in an order different from the order specified by the support program and inspections executed twice or more of the inspections specified by the support program. The medical device according to claim 1, wherein the portion to be corrected is extracted by discovery.   The medical device according to any one of claims 1 to 3, further comprising a correction unit that corrects the portion to be corrected extracted by the abnormality detection unit in accordance with the support program.   The correction unit performs inspections performed on the image data based on the last inspection among the plurality of image data generated from the result of the same inspection being executed a plurality of times in the order determined by the support program. The medical device according to claim 4, wherein the portion to be corrected is corrected so as to be treated as image data based on the data. An image data acquisition unit for acquiring a plurality of image data generated based on a result of inspecting a subject using an inspection unit, and information capable of recognizing a correspondence relationship between the plurality of image data and the inspection,
Based on the plurality of image data acquired by the image data acquisition unit and information capable of recognizing the correspondence relationship, image data corresponding to each inspection is displayed in a predetermined order and corresponds to the same inspection. A control unit that causes an image representing a plurality of image data to be displayed on the display unit in a manner distinguishable from an image when there is only one image data corresponding to the same examination;
A medical device comprising:   The control unit is capable of discriminating a plurality of images corresponding to the same examination associated by the operator via the operation unit from images when there is only one image data corresponding to the same examination. The medical apparatus according to claim 6, which is displayed on a display unit.

Images