JP2018061659A - Ultrasonic inspection system, functional image sequence generation device, and inspection protocol creation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily create an inspection protocol based on an already performed ultrasonic inspection in an ultrasonic inspection system.SOLUTION: A plurality of pieces of operation information indicating a plurality of operations executed during an ultrasonic inspection are embedded in an image sequence, and a functional image sequence is thereby generated and recorded. The plurality of pieces of operation information is taken out of the reproduced functional image sequence, and an inspection protocol is created based on them. The inspection protocol is data that defines an operation condition in each process constituting the ultrasonic inspection.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an ultrasonic inspection system, a functional image sequence generation device, and an inspection protocol creation device, and more particularly to recording and reproduction of an ultrasonic image and creation of an inspection protocol.

  An ultrasonic diagnostic apparatus is an apparatus that forms an ultrasonic image by transmitting and receiving ultrasonic waves. Known operation modes (ultrasonic diagnostic modes) in the ultrasonic diagnostic apparatus include B mode, M mode, Doppler mode, CFM (color flow mapping) mode, and the like. A harmonic imaging mode, a two-screen simultaneous display mode, and the like are also known.

  The procedure of ultrasonic examination is determined according to the examination purpose and the diagnostic organ. For example, in the ultrasonic examination of the heart, a series of steps (image acquisition step) constituting the heart is determined in advance, and the individual steps are executed in order. In the first stage of each process, operating conditions including an ultrasonic diagnostic mode are generally set manually. In the final stage of each process, generally, an ultrasonic diagnostic apparatus is set in a frozen state, and then an ultrasonic image (a still image or a moving image) is stored (stored) manually. Usually, the operation mode is switched between processes. One process or a plurality of measurements (distance measurement on an ultrasonic image, area measurement, etc.) may be included in one process. Note that the freeze state is a state in which transmission / reception is generally stopped and new image data is not written to the image memory.

  An operation assist function is provided as a technique for assisting user operations during ultrasonic inspection. According to the function, the operation conditions in each process constituting the ultrasonic inspection are automatically set according to the inspection protocol, and the operation mode is automatically changed for each process. In general, an inspection protocol is configured by data defining an operation mode, a mode execution condition, a display condition, an image storage condition, and the like for each process. Each process is also called a view from the viewpoint of image observation. The inspection protocol includes the definition of the execution order of a plurality of processes. An operation condition such as an operation mode is automatically set at the start of each process, each process is ended by a predetermined operation (for example, release of freeze after saving an image), and execution of the next process is automatically started.

  Patent Document 1 describes an ultrasonic diagnostic apparatus that operates according to an inspection protocol. Patent Document 2 describes matters related to automatic generation of an inspection protocol. Patent Document 3 discloses a technique related to operation history recording. However, these patent documents do not disclose creation of an inspection protocol based on an ultrasonic image.

JP-A-9-84786 JP, 2015-116331, A JP 2008-23008 A

  The inspection protocol is generally created by an inspector such as a doctor or laboratory technician, or by a person who replaces it (a medical staff, a service person, etc.). Although it is possible to create an inspection protocol while performing an actual ultrasonic inspection, it is difficult to concentrate on the ultrasonic inspection in that case. For this reason, in the situation where there is no subject, an inspection protocol is often created while specifically imagining an actual ultrasonic inspection. In any case, a burden is generated on the creator of the inspection protocol. In particular, when another person prepares an inspection protocol on behalf of the inspector, it is necessary to prepare the inspection protocol in accordance with the inspector's own procedure or in accordance with his / her wishes. A big burden arises.

  An object of the present invention is to make it possible to easily create an inspection protocol. Alternatively, an object of the present invention is to realize a mechanism capable of creating an inspection protocol based on an already performed ultrasonic inspection.

(1) The ultrasonic inspection system according to the present invention adds a plurality of pieces of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by the ultrasonic inspection, Thereby, a functional image sequence generating means for generating a functional image sequence, and an inspection protocol creating means for taking out the plurality of operation information by reproducing the functional image sequence and creating an inspection protocol based on the plurality of operation information And inspection protocol execution means for setting operating conditions in each step constituting the ultrasonic inspection according to the inspection protocol.

  According to the above configuration, a functional image sequence (an image sequence having a function or a role for realizing a specific purpose) is generated by adding a plurality of pieces of operation information to the image sequence. A plurality of pieces of operation information are extracted in the process of reproducing the functional image sequence. They represent a plurality of operations performed in the ultrasonic inspection process. An inspection protocol is automatically or semi-automatically created based on the extracted operation information, or the extracted operation information is provided to a person who creates, edits or modifies the inspection protocol.

  Therefore, an inspection protocol can be created based on a plurality of operations performed in the ultrasonic inspection while reproducing the ultrasonic inspection already performed as an image. This greatly reduces the burden on the creator when creating the inspection protocol. In particular, it is possible to create an inspection protocol reflecting the ultrasonic inspection by a person different from the person who performed the ultrasonic inspection.

  The above image sequence is preferably a moving image in which the entire process of ultrasonic examination is continuously recorded, but the image sequence is configured as an image set including images at the time when each operation is performed. May be. Although all operations performed in the course of ultrasonic examination may be reflected in the functional image sequence, only major or partial operations among all operations performed in the ultrasonic examination process are functional image sequences. May be reflected. It may be specified in advance whether or not the operation should be recorded from the viewpoint of creating the inspection protocol. Whether the operation should be reflected in the inspection protocol at the time of reproduction may be determined after the fact. The operation information may include an operation type, a set value, a state value, and the like. When adding operation information to an image, it is desirable to embed the operation information as part of the image or as the content of the image. According to such a configuration, it is possible to record a functional image sequence in various general-purpose image recording devices. However, it is also conceivable to add the operation information to the image in a state where the image and the operation information can be separated from each other. Even in the frozen state, it is desirable to generate a functional image sequence, that is, to add operation information. According to such a configuration, an operation performed in the freeze state can be recorded and reproduced.

  In the above configuration, preferably, each operation information is embedded as code information in a predetermined area in the image. The code information is visible information or invisible information. In general, the code information is unreadable for humans, but it may be configured as readable information.

  In the above configuration, preferably, each operation information is embedded in the image sequence at a timing when each operation is performed. This can avoid unnecessary embedding. The same operation information may be continuously added over a predetermined time immediately after the operation timing. Operation information may be added intermittently at regular intervals.

  In the above configuration, preferably, the inspection protocol creating means includes means for extracting the plurality of pieces of operation information by referring to a predetermined area in each image constituting the reproduced functional image sequence.

  In the above configuration, preferably, the inspection protocol creation means includes a means for defining a plurality of chapters corresponding to a plurality of steps constituting the ultrasonic inspection with respect to the plurality of operation information, and 1 in each chapter. Or a means for defining an operation condition for a process corresponding to the chapter based on a plurality of operations. One chapter corresponds to one process (image acquisition process). In other words, a plurality of segments or sections for a plurality of operations arranged in chronological order so that operation conditions (operation mode, mode execution condition, display condition, recording method, etc.) can be set for each process. Are defined.

  In the above configuration, preferably, each operation is an operation that affects the contents of the inspection protocol among all operations performed by the user. If operation information is recorded and reproduced for at least such an operation, it is possible to automatically capture all or the main part of the contents of the inspection protocol. It is desirable to embed information representing the operation conditions at the start of execution of each operation mode and the applied preset (parameter set) in the image sequence so that they can be specified.

  In the above-described configuration, it is desirable to include at least an ultrasonic diagnostic apparatus that functions as the functional image sequence generation unit and the examination protocol execution unit. The above configuration preferably includes an image recording apparatus that records and reproduces the functional image sequence as digital information or analog information. In the above configuration, preferably, the ultrasonic diagnostic apparatus further functions as the examination protocol creation means. The above configuration preferably includes an information processing apparatus that is different from the ultrasonic diagnostic apparatus and includes the examination protocol creating means.

(2) The ultrasonic diagnostic apparatus according to the present invention adds a plurality of pieces of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination, This includes a functional image sequence generating means for generating a functional image sequence, and a means for outputting the functional image sequence to an image recording apparatus, and the functional image sequence comprises each of the ultrasonic examinations. It is an image sequence for creating an inspection protocol that defines an operation condition in a process. The ultrasonic diagnostic apparatus may further include an inspection protocol execution function.

(3) The inspection protocol creation device according to the present invention extracts a plurality of pieces of operation information embedded in the functional image sequence by means for inputting a functional image sequence from the image recording device, An examination protocol creating means for creating an examination protocol based on the functional image sequence, wherein the functional image sequence is a plurality of operations performed in an acquisition process on an image sequence composed of a plurality of images obtained by ultrasonic examination. The inspection protocol is composed of data for setting operation conditions on behalf of the user in each step constituting the ultrasonic inspection. It is characterized by that. The inspection protocol creation device is configured by an ultrasonic diagnostic device, an information processing device, and the like.

(4) The functional image sequence generation method according to the present invention adds a plurality of pieces of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination. And a step of generating a functional image sequence and a step of outputting the functional image sequence, wherein the functional image sequence defines operating conditions in each step constituting the ultrasonic examination. It is an image sequence for creating an inspection protocol to be performed. This functional image sequence generation method is realized as a function of a program, and the program is installed in the ultrasonic diagnostic apparatus or the information processing apparatus via a portable storage medium or a network.

(5) An inspection protocol creation method according to the present invention includes a step of inputting a functional image sequence, a plurality of operation information embedded in the functional image sequence, and an inspection protocol based on the plurality of operation information. The functional image sequence includes a plurality of pieces of operation information representing a plurality of operations performed in the acquisition process on the image sequence composed of a plurality of images acquired by ultrasonic examination. In the image sequence generated by adding, the inspection protocol is configured by data for setting operation conditions on behalf of the user in each step constituting the ultrasonic inspection. This inspection protocol generation method is realized as a function of a program, and the program is installed in the ultrasonic diagnostic apparatus or the information processing apparatus via a portable storage medium or a network.

  According to the present invention, an inspection protocol can be easily created. Alternatively, an object of the present invention is to automatically create an inspection protocol based on an already performed ultrasonic inspection.

1 is a block diagram showing an embodiment of an ultrasonic diagnostic apparatus according to the present invention. It is a conceptual diagram which shows the structural example of a test | inspection protocol. It is a conceptual diagram which shows the production | generation / recording of a functional image sequence, and reproduction | regeneration / inspection protocol preparation of a functional image sequence. It is a figure which shows the example of embedding operation information. It is a figure which shows the functional image sequence by which the operation information was embedded intermittently. It is a figure which shows the functional image sequence by which the operation information was embedded sequentially. It is a figure which shows an example of the image for test | inspection protocol preparation. FIG. 10 is a diagram showing a first operation example related to creation of an inspection protocol. It is a figure which shows the 2nd operation example which concerns on test protocol preparation. It is a figure for demonstrating preparation of the test | inspection protocol in information processing apparatus. It is a figure which shows the embedding of the operation information to a non-display area | region. It is a figure which shows embedding of invisible operation information.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described with reference to the drawings.

  FIG. 1 shows a preferred embodiment of an ultrasonic inspection system according to the present invention. This ultrasonic inspection system is a system that is installed in a medical institution such as a hospital and forms an ultrasonic image based on reception data obtained by transmitting and receiving ultrasonic waves to and from a living body.

  In FIG. 1, the ultrasonic inspection system includes an ultrasonic diagnostic apparatus 10 and an image recording device 12 in the illustrated example. As will be described in detail below, the ultrasonic diagnostic apparatus 10 functions as a functional image sequence generation apparatus, an inspection protocol creation apparatus, and an inspection protocol execution apparatus. Examples of the ultrasound image displayed on the ultrasound diagnostic apparatus include a B-mode image, an M-mode image, a CFM (color flow mapping) image, a Doppler image, a harmonic image, and a three-dimensional image. In order to form such an image, the ultrasonic diagnostic apparatus has various operation modes (ultrasonic diagnostic modes). Examples of the operation mode include B mode, M mode, CFM mode, PW mode, CW mode, harmonic component imaging mode, and three-dimensional mode.

  The ultrasonic diagnostic apparatus 10 includes an apparatus main body 14, a probe 16, an operation panel 18, and a display 20. The apparatus main body 14 and the probe 16 will be described later. The operation panel 18 has input devices such as a trackball, a switch, and a keyboard. The operation panel 18 also has a sub-display that is not shown. The display 20 has a large screen, which is constituted by, for example, an LCD panel or an organic EL panel. The ultrasonic diagnostic apparatus 10 is configured as, for example, a cart type apparatus or a portable apparatus.

  The probe 16 is an ultrasonic transducer. Specifically, the probe 16 includes a probe head, a cable, and a connector. The connector is detachably attached to the apparatus main body 14. The probe head has an array transducer composed of a plurality of transducer elements arranged one-dimensionally. An ultrasonic beam is formed by the array transducer, and a beam scanning surface is formed by electronically scanning the ultrasonic beam. The beam scanning plane is a two-dimensional data capturing area. A 2D array transducer may be provided in the probe head, thereby obtaining three-dimensional data (volume data). The probe head is brought into contact with the living body surface. An intracorporeal probe may be used.

  The apparatus main body 14 includes a control unit 24 and a processing unit 26. The processing unit 26 is a controlled unit as viewed from the control unit 24, and is hardware including an electronic circuit, a processor, a buffer memory, and the like. A processor that performs a program operation may be included therein. The processing unit 26 will be specifically described below.

  The transmission circuit 28 is an electronic circuit that functions as a transmission beam former. At the time of transmission, a plurality of transmission signals are supplied from the transmission circuit 28 to the array transducer. As a result, a transmission beam is formed. At the time of reception, when a reflected wave from the living body is received by the array transducer, a plurality of reception signals are output to the reception circuit 30 therefrom. The receiving circuit 30 is an electronic circuit that functions as a receiving beam former. It has a plurality of amplifiers, a plurality of A / D converters, a plurality of delay circuits, an addition circuit, and the like. In the receiving circuit 30, a plurality of received signals are phased and added to form beam data corresponding to the received beam. One beam scanning plane corresponds to one received frame data. One reception frame data is composed of a plurality of beam data arranged in the electronic scanning direction. Each beam data is composed of a plurality of echo data arranged in the depth direction.

  The beam data processor 32 is means for applying various processes to the beam data. The processing includes detection, logarithmic conversion, correlation processing, and the like. The image forming processor 34 is a unit that forms an ultrasonic image in accordance with the selected operation mode. Ultrasonic image data (moving image data and still image data) formed by the image forming processor 34 is sent to the display 20 via the display processor 36. An ultrasonic image is displayed on the screen. In the present embodiment, moving image data is also output from the display processor 36 to the image recording device 12. That is, moving image data is recorded in order to grasp the entire ultrasonic inspection process later. This will be specifically described below.

  The display processor 36 has an image composition function, a color processing function, and the like. The display processing processor 36 of this embodiment has a function of executing an image composition process for adding operation information generated by an image generation unit 44 described later to an image sequence. The operation information is information indicating the type of user operation and the setting value based on it. In the non-frozen state, the image forming processor 34 generates an image sequence (moving image) composed of a plurality of images arranged in chronological order. The display processor 36 generates a functional image sequence by embedding a plurality of pieces of operation information (code image) in the image sequence. Data or a signal representing a functional image sequence is output to the image recording device 12. It is a digital signal or an analog signal. In the present embodiment, a functional image sequence is displayed on the display 20. However, a simple image sequence (an image sequence not including operation information) may be displayed.

  In the present embodiment, the image generation unit 44 generates a graphic image that is superimposed or synthesized into an ultrasonic image, and the image generation unit 44 embeds a code image as a part of the graphic image. Such a graphic image is synthesized by the display processor 36 into an image to be synthesized. By repeating such processing, a functional image sequence is configured as an inspection protocol creation image sequence. The control unit 24 may perform image synthesis.

  As will be described later, a functional image sequence (moving image) recorded in the image recording device 12 is reproduced when the inspection protocol is created. The read image data or video signal is input to the display processor 36. The display processor 36 passes the functional image sequence to the control unit 24. The display processor 36 functions as an I / F circuit or an image input / output circuit. In the present embodiment, the functional image sequence is normal image data or a video signal, and can be recorded in a general or general-purpose image recording apparatus.

  The control unit 24 includes a CPU and an operation program. The control unit 24 functions as protocol execution control means, operation information addition means, protocol creation means, and the like. The operation program includes a program that realizes an operation assist function, and a program that realizes an operation information embedding function and an inspection protocol creation function. The control unit 24 sets operating conditions for the processing unit 26 and controls the operation of the processing unit 26.

  Specifically, the control unit 24 includes a protocol execution unit 42, an image generation unit 44, and a protocol creation unit 40 as shown in the figure. The protocol execution unit 42 sets operating conditions in each step constituting the ultrasonic inspection according to the inspection protocol stored on the memory 45, that is, sets parameters on behalf of the user. In the present embodiment, the protocol execution unit 42 performs the freeze release operation after the image store operation on the assumption that all of the predetermined measurements have been completed in the n-th step (where n = 1, 2, 3,...). If there is, the processing unit 26 is controlled so that the n-th process is terminated and at the same time the execution of the (n + 1) -th process is started. However, various conditions can be adopted as process end conditions. In addition, you may make it receive a user's process sending operation and process returning operation. When execution of the last process is completed, a list of unexecuted processes and measurements may be displayed.

  During the execution of the operation assist function, for example, an operation mode is automatically selected only by performing a normal operation, and an execution condition or the like for executing the operation mode is automatically set. Multiple measurement functions are activated in sequence by simply operating the measurement activation buttons in sequence. Further, an image is stored in a predetermined image recording format simply by performing a store operation. A data set for realizing such an operation assist function is an inspection protocol.

  The image generation unit 44 generates a graphic image in the present embodiment. A graphic image is an image synthesized with an ultrasonic image, and is an image including figures, symbols, characters, and the like. It includes code information as operation information. In this embodiment, the code information is composed of one or a plurality of barcodes. It represents the operation type and the set value as codes. A one-dimensional barcode, a two-dimensional barcode, or the like can be used as the code information. A symbol F in FIG. 1 represents transfer of a graphic image including operation information from the image generation unit 44 to the display processing processor 36.

  When the user performs an operation to be recorded (target operation) in the ultrasonic inspection (target ultrasonic inspection) that forms the basis for creating the inspection protocol, code information as operation information representing the content of the target operation is displayed each time. The code information is generated and embedded as a part of the graphic image. Such a graphic image is combined with the ultrasonic image to form a functional image. That is, when the target operation is performed, a functional image reflecting the content of the target operation is generated immediately after that, and is recorded and displayed. You may comprise so that the same code | symbol information may be embedded over several images per operation. In the present embodiment, an image sequence including an image in which code information is embedded and an image in which code information is not embedded is referred to as a functional image sequence. A functional image sequence is recorded in the image recording device 12 during the target ultrasonic examination. As part of the operation information, operation status, setting status, attribute information, and other information may be embedded in the ultrasound image. The code information may be composed of a plurality of barcodes. In that case, a bar code representing an operation mode, a bar code representing a measurement type, a bar code representing an image recording format, and the like may be included. A single barcode with all the necessary information may be used. An encoded image other than the barcode may be embedded.

  The protocol creation unit 40 has a function of creating an inspection protocol automatically or semi-automatically while reproducing a functional image sequence. In FIG. 1, the symbol R represents the reading of a functional image sequence during reproduction. The protocol creation unit 40 has an operation information analysis unit 46. At the time of reproducing the functional image sequence, the protocol creation unit 40 analyzes each image and cuts out a partial image of a predetermined area in the image. Next, by analyzing the partial image, particularly by decoding the code information included therein, the operation type and the set value at the time of the target ultrasonic examination are restored. The protocol creation unit 40 sets or provisionally sets operating conditions of individual processes constituting the ultrasonic examination based on such analysis results.

  As described above, by reproducing the functional image sequence, the operation mode, execution condition, display condition, image recording format, presence / absence of measurement, contents of measurement, and the like are read as operation conditions for each process. Thereby, an inspection protocol is created. However, it is also possible to save the corrected inspection protocol after manually correcting the contents of the inspection protocol. In the present embodiment, there are provided a mode in which it is possible to determine whether registration is necessary in units of chapters, and a mode in which all chapters in a certain section are registered in a lump. This will be described in detail later.

  The upper stage 62 in FIG. 2 shows a process at the time of image recording, and the lower stage 64 in FIG. 2 shows a process at the time of image reproduction. At the time of image recording, the operation content (or setting content) is converted into a code, and code information is generated from the code (66). A graphic image including the code information is generated (68). On the other hand, an ultrasound image is generated based on the received data according to the selected operation mode (70). By combining the ultrasound image and the graphic image (72), a functional image is generated. A functional image sequence is generated by repeating such processing. The functional image sequence is recorded on the image recording device (74).

  On the other hand, at the time of reproduction of the functional image sequence (76), the code information is cut out from the image in the functional image sequence, and the code is restored by decoding it (78). By analyzing the code (80), the operation content is specified. By repeating such processing, an inspection protocol is created (82). Specifically, the analyzed operation content is fetched (84), and the operation condition is defined for each process based on the operation content. The content is confirmed or modified by the creator (86).

  FIG. 3 shows a configuration example of the inspection protocol. The inspection protocol has a protocol name 52 and a plurality of data blocks 54. Each data block 54 corresponds to each process (each view) constituting the ultrasonic examination. Specifically, each data block 54 includes information such as a process number 55, a process name (view name) 56, an operation condition 58, measurement presence / absence 60, measurement content 61, and the like. The operation condition 58 represents an operation mode, display condition, image storage condition, preset number, and the like. The preset number is an identifier that identifies a parameter set designated as default data. The measurement presence / absence 60 indicates whether or not the measurement is included in the process. When the measurement is included, one or a plurality of measurement identifiers are described as the measurement contents 60 in the execution order. The configuration shown in FIG. 2 is merely an example, and various types of inspection protocols can be adopted.

  FIG. 4 illustrates an image 88 in which code information is embedded. The image 88 includes an ultrasonic image (tomographic image) 92 and includes peripheral regions 94a to 94f. The peripheral areas 94a to 94f are areas where patient names, examination dates and times, measurement conditions, thumbnail images, operation icons, and the like are displayed. In the illustrated example, a horizontally long gap is formed between the display area 90 and the peripheral area 94a, and an embedded information area 96 is set in the gap. It is a horizontally long rectangular area. The embedded information area 96 has a width Xa from x1 to x2 in the horizontal direction (x direction) and a width Ya from y1 to y2 in the vertical direction (y direction). An embedded information area is set as a predetermined area in the image 88.

  In the embedded information area 96, two barcodes 98 and 100 are embedded in the illustrated example. They constitute code information, that is, operation information. A single barcode or more than two barcodes may be embedded. A two-dimensional barcode may be embedded instead of the one-dimensional barcode. If the code information is visible information, it is desirable to embed it in a position where it is as inconspicuous as possible and where no reading error occurs. As will be described later, the code information may be configured as invisible information or low-luminance information that can hardly be read by humans as long as reading by image processing can be performed reliably.

  FIG. 5 shows an example of a functional image sequence. The functional image sequence 102 is a frame sequence, and code information 104 is embedded in some of the frames F1 and F4. Code information is not embedded in the other frames F2, F3, and F5. Thus, the code information 104 may be embedded according to the operation timing or intermittently. FIG. 6 shows another example of the functional image sequence. The functional image sequence 106 includes a plurality of frames F1 to F5, and code information 104 is embedded in all of them.

  FIG. 7 illustrates an image for setting an inspection protocol. An ultrasonic image 110 is included in the display screen 108. The ultrasonic image 110 is an image being reproduced and is a moving image or a paused image.

  A box 112 is displayed next to the ultrasound image 110. Box 112 has a protocol name 114. The protocol name 114 is entered by the creator or automatically. Box 112 includes a view list 116. In the view list 116, one or a plurality of items corresponding to one or a plurality of views (one or a plurality of steps) specified by the analysis so far are automatically generated. Each item includes a view number 118 and a view name 120. They are set automatically. However, the view name and view order can be modified by the creator. Currently, the third view is being analyzed, and in the example shown in the figure, the analysis result is displayed in a box 122 corresponding to that view. Specifically, the operation conditions specified by the analysis are automatically entered sequentially in the box 112. The operation condition includes an operation mode, a mode execution condition (execution parameter), and the like.

  When the measurement is included in the view, the measurement list 124 is automatically generated. In the illustrated example, two measurements are included in the third view, and therefore, two items are included in the measurement list 124. Each item includes a measurement number 126 and a measurement name 128. As the playback of the functional image progresses or the analysis progresses, individual information is identified and the information is reflected in the box 112. The information in the box 112 can be corrected at an appropriate timing thereafter.

  An operation bar is provided below the box 112. In the illustrated example, the operation bar includes a return button, a play button, a forward button, a pause button, a view registration button, a protocol save button, and the like. These buttons are configured as icons. The illustrated operation bar is an example, and other configurations can be adopted.

  As a result of the above analysis, a temporary inspection protocol is created, and after the contents are confirmed and corrected, when the creator operates the save protocol button, the corrected inspection protocol is saved in the memory. . However, after the temporary inspection protocol is stored in the memory, the contents thereof may be corrected manually.

  Next, an operation example of the inspection system shown in FIG. 1 will be described. FIG. 8 shows a first operation example. The left side of FIG. 8 (see reference numeral 132) shows a flow of generating and recording a functional image while performing an ultrasonic examination, and the right side of FIG. 8 (see reference numeral 134) reproduces a functional image sequence. The flow of creating an inspection protocol is shown.

  In FIG. 8, each mark indicated by reference numeral 136 indicates a target operation to be recorded. However, the target operation with the mark is an example. Reference numeral 138 indicates an index string (flag string) that is automatically assigned when the mode is selected. Between two adjacent indexes is a chapter, which corresponds to a view or process.

  At the start of the ultrasonic inspection, the B mode is selected in S10. In S12, the range (diagnosis distance) is changed. In addition, although not shown, necessary operations (settings) are performed. In S14, a freeze operation is executed prior to measurement. Thereafter, in S16, measurement a is selected from the measurement menu, and measurement a is executed. For distance measurement, two points are designated by two markers. Subsequently, measurement b is selected from the measurement menu, and measurement b is executed. In the case of area measurement, for example, the tissue contour is manually traced. During the freeze, the ultrasonic image becomes a still image, but the graphic image including the operation information is continuously updated. Therefore, operation information indicating an operation being frozen is also embedded in the functional image sequence. As a result, operations during freezing can be recorded and reproduced in the same manner as operations during non-freezing (real-time operation). In S20, a store operation is executed. As a result, the image after measurement is saved. In this example, a still image is stored. Usually, the measurement value is also stored together with the image. Thereafter, the freeze release operation is performed in S22, and the CF mode is selected in S24. As a result, a color blood flow image is synthesized and displayed on the black and white B-mode image.

  A second index is assigned when the CF mode is selected. That time is the end of the first chapter. In configuring an actual inspection protocol, if there is a freeze release operation in the previous process, the next process is immediately executed. Thus, the freeze release operation virtually coincides with the end of the process.

  In S26, a region of interest (ROI) for flow is set. Thereafter, through various operations, the PW mode is selected in S28. At that time, a third index is assigned. In S30, the freeze operation is executed, and thereafter, in steps S32 and S34, the measurements c and d are sequentially executed as described above. In S36, a store operation is performed, and in S38, a freeze release operation is performed. In S40, the CW mode is selected. At that time, a fourth index is assigned.

  As described above, when a target operation occurs, operation information is generated each time and is embedded in a moving image as a recorded image in a timely manner. In the above operation example, the operation information is generated only for the target operation among all the operations performed in the process of the target ultrasonic examination. But you may make it comprise the functional image sequence in which all operation was reflected. Further, in the above operation example, chapters are defined using mode selection as an index, that is, preprocessing for defining a view or a process is executed.

  The left side of FIG. 8 shows the operation 134 at the time of reproduction, that is, the operation 134 at the time of creating the inspection protocol as described above. In S50, playback start is input. In S52, for example, a feeding operation is performed. It is a jump operation, fast-forward operation, etc. In the operation example shown in FIG. 8, the operations in each chapter are analyzed simultaneously with the reproduction as shown in S54. At that time, the analysis results may be displayed sequentially. It is also conceivable to display the analysis results collectively at the end of the analysis. In S56, the content of the displayed view is confirmed, and registration is executed. That is, in the operation example shown in FIG. 8, the inspection protocol is registered in view units.

  In S58, the feed operation is executed, and then the analysis is executed simultaneously with the reproduction of the chapter 2 and the analysis results are sequentially displayed. In S60, the feed operation is executed. This means a registration postponement for chapter 2. Thereafter, the analysis is performed on the chapter 3, and the analysis results are sequentially displayed in S62. In S64, the reproduction and analysis are paused, and in S66, necessary correction of the analysis result is executed. In S68, the inspection protocol corresponding to chapter 3 is registered. Such a process is repeated, and finally the inspection protocol is stored in S70. In the operation example shown in FIG. 8, the necessity of registration is determined in view units.

  FIG. 9 shows a second operation example of the ultrasonic inspection system shown in FIG. The contents shown on the left side of FIG. 9 are the same as the contents shown on the left side of FIG. Therefore, in the following, the examination protocol creation (see reference numeral 134) based on the content on the right side of FIG.

  In S50, a functional image sequence reproduction operation is performed. In S52, a feeding operation is performed. In S80, the start timing is designated as the start end of the analysis target range. In S82, end timing is designated as the end of the analysis target range. In the illustrated example, chapters 1 to 3 are designated as analysis targets. In S84, chapters 1 to 3 are analyzed, that is, the operation conditions are automatically read for each chapter (view) corresponding to the chapter from the operation content there. In the analysis, the playback speed is set to N times speed. When the analysis is completed, a list of the analysis results, that is, the operation conditions set for the three views is displayed in S86. Of course, the operation conditions may be individually displayed for each view.

  In S88, the creator makes necessary modifications to the contents of the three views. Thereafter, the three modified views are registered in S90, and the inspection protocol created as described above is stored in S92.

  According to the operation example shown in FIG. 9, batch registration can be performed over a plurality of views. If analysis or registration of some chapters is unnecessary, the first operation example may be adopted. If it is more efficient to perform analysis and registration for the whole of a plurality of chapters, the second operation example may be adopted.

  FIG. 10 shows another configuration example of the ultrasonic inspection system. The ultrasonic inspection system includes an ultrasonic diagnostic apparatus 136, an image recording device 140, and a PC 142 as an information processing apparatus. The ultrasonic diagnostic apparatus 136 functions as a functional image sequence generation apparatus. It has an operation information embedding unit 138. The PC 142 has a protocol creation unit 144, and the protocol creation unit 144 has an operation information analysis unit 146. The PC 142 functions as an operation protocol creation device.

  During the ultrasonic examination, a functional image sequence is generated by the ultrasonic diagnostic apparatus 136 and recorded in the image recording device 140. The functional image sequence is reproduced by the protocol creation unit 144 in the PC 142, and in the process, the operation information analysis unit 146 specifies the operation content from each embedded information. This creates a test protocol, which is sent to the ultrasound diagnostic device 136 as needed.

  FIG. 11 shows a modification related to embedding operation information. The image 150 includes a display area 152 and a surrounding area 153. The surrounding area 153 is usually an area that is not displayed. The code information 154 may be embedded in the surrounding area 153. According to such a configuration, it can be avoided that the code information 154 becomes obstructive.

  FIG. 12 shows another modification example related to embedding operation information. Invisible code information 158 is embedded in the image 156. It is a 2D barcode. Instead, code information having low luminance that is difficult to read by human eyes may be embedded. The embedding position is outside the ultrasonic image, and it is avoided that the code information 158 adversely affects image processing (for example, in the creation of a pixel value histogram).

  In the above embodiment, the functional image sequence is used for generating the inspection protocol. However, an application example in which an operation is reproduced from the functional image sequence is also conceivable. According to the above-described embodiment, an inspection protocol can be easily created based on an already performed ultrasonic inspection. In particular, it is possible to create an inspection protocol based on a person who is different from the person who performed the ultrasonic inspection.

DESCRIPTION OF SYMBOLS 10 Ultrasonic diagnostic apparatus, 12 Image recording apparatus, 14 Apparatus main body, 16 Probe, 24 Control part, 26 Processing part, 40 Protocol preparation part, 42 Protocol execution part, 44 Image generation part (operation information embedding part), 46 operation Information analysis department.

Claims (14)

A functional image sequence for generating a functional image sequence by adding a plurality of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination Generating means;
Inspection protocol creating means for extracting the plurality of operation information by reproducing the functional image sequence and creating an inspection protocol based on the plurality of operation information;
Inspection protocol execution means for setting operating conditions in each step constituting the ultrasonic inspection according to the inspection protocol;
An ultrasonic inspection system comprising: The system of claim 1, wherein
Each operation information is embedded as code information in a predetermined area in the image.
An ultrasonic inspection system characterized by that. The system of claim 1, wherein
Each operation information is embedded in the image sequence at the timing when each operation is performed.
An ultrasonic inspection system characterized by that. The system of claim 2, wherein
The inspection protocol creating means includes means for extracting the plurality of pieces of operation information by referring to a predetermined area in each image constituting the reproduced functional image sequence.
An ultrasonic inspection system characterized by that. The system of claim 4, wherein
The inspection protocol creation means includes:
Means for defining a plurality of chapters corresponding to a plurality of steps constituting the ultrasonic inspection for the plurality of operation information;
Means for defining operating conditions for a step corresponding to the chapter based on one or more operations in each chapter;
An ultrasonic inspection system comprising: The system of claim 1, wherein
Each of the operations is an operation that affects the contents of the inspection protocol among all operations performed by the user.
An ultrasonic inspection system characterized by that. The system of claim 1, wherein
An ultrasonic diagnostic apparatus that functions as at least the functional image sequence generation means and the examination protocol execution means,
An ultrasonic inspection system characterized by that. The system of claim 7, wherein
Including an image recording apparatus for recording and reproducing the functional image sequence as digital information or analog information,
An ultrasonic inspection system characterized by that. The system of claim 7, wherein
The ultrasonic diagnostic apparatus further functions as the inspection protocol creation means,
An ultrasonic inspection system characterized by that. The system of claim 7, wherein
Including an information processing apparatus that is different from the ultrasonic diagnostic apparatus and includes the examination protocol creation means;
An ultrasonic inspection system characterized by that. A functional image sequence for generating a functional image sequence by adding a plurality of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination Generating means;
Means for outputting the functional image sequence to an image recording device;
Including
The functional image sequence is an image sequence for creating an inspection protocol that defines an operation condition in each step constituting the ultrasonic inspection.
A functional image sequence generation device. Means for inputting a functional image sequence from an image recording device;
A plurality of pieces of operation information embedded in the functional image sequence, and inspection protocol creation means for creating an inspection protocol based on the plurality of pieces of operation information;
Including
The functional image sequence is an image sequence generated by adding a plurality of pieces of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination. And
The inspection protocol is constituted by data for setting operating conditions on behalf of the user in each step constituting the ultrasonic inspection,
An inspection protocol creation device characterized by that. A program for executing a functional image sequence generation method in an ultrasound diagnostic apparatus,
The functional image sequence generation method includes:
Adding a plurality of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination, thereby generating a functional image sequence;
Outputting the functional image sequence;
Including
The functional image sequence is an image sequence for creating an inspection protocol that defines an apparatus operating condition in each step constituting the ultrasonic inspection.
A program characterized by that. A program for executing an inspection protocol creation method in an information processing apparatus,
The inspection protocol creation method includes:
Inputting a functional image sequence;
Extracting a plurality of operation information embedded in the functional image sequence, and creating an inspection protocol based on the plurality of operation information;
Including
The functional image sequence is an image sequence generated by adding a plurality of pieces of operation information representing a plurality of operations performed in the acquisition process to an image sequence composed of a plurality of images acquired by ultrasonic examination. And
The inspection protocol is constituted by data for setting operating conditions on behalf of the user in each step constituting the ultrasonic inspection,
A program characterized by that.