JP5678706B2 - Ultrasonic diagnostic system, ultrasonic diagnostic apparatus and program - Google Patents

Description

  The present invention relates to an ultrasonic diagnostic system, an ultrasonic diagnostic apparatus, and a program.

  Conventionally, breast examination using an ultrasonic diagnostic apparatus has been performed as one of breast cancer examinations. In general, in imaging using an ultrasonic diagnostic apparatus, a moving image over a certain period is recorded and used for diagnosis. However, if all the images during the examination are recorded, images that are not necessary for diagnosis are also saved, and not only a wasteful area increases in the recording medium, but also the work load on the observer is great.

  Therefore, for example, in Patent Document 1, a representative image serving as an index for search is automatically generated using an event such as a print execution operation, a still image saving operation, or a freeze operation as a trigger, and corresponds to the representative image. A technique for reproducing a moving image of an ultrasonic image on the basis of a frame image is described.

JP 2006-141997 A

  By the way, in mammary gland inspection using ultrasonic waves, it takes about 10 minutes per person, so it is difficult for a diagnostician to perform an examination in the current examination environment. Therefore, if a photographer such as a radiographer observes the breast in real time using an ultrasonic diagnostic apparatus and finds a part that seems to be necessary for diagnosis, such as an area suspected of being abnormal, it uses the freeze operation to detect the ultrasound at that part. The image is taken in as a diagnostic image and provided to the diagnostician. Alternatively, a moving image of an entire ultrasonic image captured in an examination or a moving image in which a representative image based on an event by a photographer's operation as described in Patent Document 1 is provided is provided to a diagnostician.

  When providing a moving image to a diagnostician, the diagnostician can identify a point that is objectively necessary for diagnosis, such as an abnormal shadow candidate or a portion that is similar to an abnormal shadow but is normal (referred to as a normal candidate). It is necessary to find out the included images suitable for diagnosis. However, it is not easy to find an image suitable for diagnosis from a large number of moving images.

  In the technique described in Patent Document 1, for example, video playback is started from a frame image corresponding to a representative image based on an event by a photographer's operation, but because a photographer and a diagnostician are different in breast examination, Images that are objectively suitable for diagnosis are not always included after the frame image emphasized by the photographer. Therefore, it does not necessarily lead to an efficient diagnosis.

  An object of the present invention is to enable a diagnostician to easily find an image suitable for diagnosis, including a portion necessary for diagnosis, from a plurality of ultrasonic images when the photographer of the ultrasonic image is different from the diagnostician. Is to do.

In order to solve the above-mentioned problem, an ultrasonic diagnostic system according to claim 1 is provided.
Ultrasonic image acquisition means for acquiring ultrasonic images by outputting transmission ultrasonic waves toward the subject by the ultrasonic probe and receiving reflected ultrasonic waves from the subject;
Display means for sequentially displaying ultrasonic images acquired by the ultrasonic image acquisition means on a screen;
Temporary storage means for temporarily storing a plurality of temporally continuous ultrasonic images acquired by the ultrasonic image acquisition means;
Operation means for inputting an instruction to hold the display of the ultrasonic image displayed on the display means on the screen;
An ultrasonic image acquired within a predetermined time range before and / or after the timing at which the operation means is operated is read out from the temporary storage means, and the read-out ultrasonic image Among them, search means for searching as a search target an ultrasonic image including an abnormal shadow candidate, an ultrasonic image including a normal candidate, an ultrasonic image including at least one of an abnormal shadow candidate or a normal candidate,
Control means for giving index information indicating that the ultrasonic image is a noticeable image to the ultrasonic image searched by the search means;
Reproducing means for reproducing a part or all of the plurality of temporally continuous ultrasonic images including the ultrasonic image to which the index information is assigned,
Reproduction control means for controlling reproduction of the plurality of temporally continuous ultrasonic images in the reproduction means, based on the ultrasonic image to which the index information is given,
Is provided.

The invention according to claim 2 is the invention according to claim 1,
The reproduction control unit causes the reproduction unit to perform moving image reproduction of the plurality of temporally continuous ultrasonic images, and pauses the reproduction unit when reaching the position of the ultrasonic image to which the index information is assigned. Let it be done.

The invention according to claim 3 is the invention according to claim 1,
The reproduction control means sequentially reproduces only the ultrasonic images to which the index information is added.

The invention according to claim 4 is the invention according to claim 2 or 3,
Frame operation means for instructing frame advance or frame return based on the ultrasound image to which the index information is added,
The reproduction control unit causes the reproduction unit to execute frame advance or frame return based on an ultrasound image to which the index information is added, in accordance with an operation of the frame operation unit.

The invention according to claim 5 is the invention according to any one of claims 1 to 4,
The reproduction control means also displays identification information indicating that the image is provided with the index information when reproducing the ultrasonic image provided with the index information in the reproduction means.

The ultrasonic diagnosis support apparatus according to the invention described in claim 6
An ultrasonic image acquisition means for acquiring an ultrasonic image by outputting a transmission ultrasonic wave toward the subject by an ultrasonic probe and receiving a reflected ultrasonic wave from the subject;
Display means for sequentially displaying ultrasonic images acquired by the ultrasonic image acquisition means on a screen;
Temporary storage means for temporarily storing a plurality of temporally continuous ultrasonic images acquired by the ultrasonic image acquisition means;
Operation means for inputting an instruction to hold the display of the ultrasonic image displayed on the display means on the screen;
An ultrasonic image acquired within a predetermined time range before and / or after the timing at which the operation means is operated is read out from the temporary storage means, and the read-out ultrasonic image Among them, search means for searching as a search target an ultrasonic image including an abnormal shadow candidate, an ultrasonic image including a normal candidate, an ultrasonic image including at least one of an abnormal shadow candidate or a normal candidate,
Control means for giving index information indicating that the ultrasonic image is a noticeable image to the ultrasonic image searched by the search means;
Output means for outputting to the reproduction means a plurality of temporally continuous ultrasonic images including the ultrasonic image to which index information is given by the control means;
Is provided.

The program of the invention described in claim 7 is:
Computer
The ultrasonic image acquired by the ultrasonic image acquisition means for acquiring the ultrasonic image by outputting the transmission ultrasonic wave toward the subject by the ultrasonic probe and receiving the reflected ultrasonic wave from the subject. Display means for sequentially displaying on the screen;
Temporary storage means for temporarily storing a plurality of temporally continuous ultrasonic images acquired by the ultrasonic image acquisition means;
Operation means for inputting an instruction to hold the display of the ultrasonic image displayed on the display means on the screen;
An ultrasonic image acquired within a predetermined time range before and / or after the timing at which the operation means is operated is read out from the temporary storage means, and the read-out ultrasonic image Among them, a search means for searching as a search target an ultrasonic image including an abnormal shadow candidate, an ultrasonic image including a normal candidate, an ultrasonic image including at least one of an abnormal shadow candidate or a normal candidate,
Control means for providing index information indicating that the ultrasonic image is a noticeable image to the ultrasonic image searched by the search means;
Output means for outputting to the reproducing means a plurality of temporally continuous ultrasonic images including the ultrasonic image to which index information is given by the control means;
To function as.

  According to the present invention, when an ultrasonic image photographer and a diagnostician are different, a diagnostician can easily find an image suitable for diagnosis including a portion necessary for diagnosis from a plurality of ultrasonic images. Is possible.

It is a figure which shows the example of whole structure of the ultrasonic diagnosing system in this Embodiment. It is a flowchart which shows the key frame search process performed by the control part of an ultrasonic diagnosing device. It is a figure which shows an example of an image classification selection screen. It is a figure for demonstrating the calculation method of the shape of an edge. It is a flowchart which shows the ultrasonic image reproduction | regeneration control process A performed by the control part of a terminal device in 1st Embodiment. It is a figure which shows an example of a reproduction | regeneration screen. It is a flowchart which shows the ultrasonic image reproduction | regeneration control process B performed by the control part of a terminal device in 2nd Embodiment.

[First Embodiment]
(Configuration of ultrasonic diagnostic system 100)
Hereinafter, a first embodiment of the present invention will be described.
First, the configuration will be described.
FIG. 1 shows a system configuration of an ultrasonic diagnostic system 100 in the present embodiment.

  As shown in FIG. 1, an ultrasonic diagnostic system 100 is configured by connecting an ultrasonic diagnostic apparatus 1 and a terminal apparatus 2 so as to be able to transmit and receive data via a communication network N such as a LAN (Local Area Network). ing.

As shown in FIG. 1, the ultrasonic diagnostic apparatus 1 includes an ultrasonic diagnostic apparatus main body 10 and an ultrasonic probe P.
The ultrasonic probe P transmits ultrasonic waves (transmission ultrasonic waves) to a subject such as a living body (not shown) and receives reflected waves (reflected ultrasonic waves: echoes) reflected by the subject. To do. Then, the ultrasound probe P acquires a received signal that is an electrical signal from the received reflected ultrasound and outputs it to the ultrasound diagnostic apparatus body 10.
The ultrasonic diagnostic apparatus main body 10 is connected to the ultrasonic probe P via a cable or the like, and transmits a transmission signal of an electrical signal to the ultrasonic probe P to the subject to the ultrasonic probe P. Or transmitting and displaying the internal state of the subject as an ultrasonic image based on the received signal received from the ultrasonic probe P.

  As shown in FIG. 1, the ultrasonic diagnostic apparatus main body 10 includes a control unit 11, a transmission unit 12, a reception unit 13, an image processing unit 14, a memory unit 15, a display unit 16, a storage unit 17, an operation unit 18, and communication control. The unit 19 and the like are provided, and each unit is connected via the bus 101.

  The control unit 11 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), and the like, and executes various processes in cooperation with various programs stored in the storage unit 17. The operation of 1 is comprehensively controlled. For example, the control unit 11 executes a key frame search process (see FIG. 2) in cooperation with a program stored in the storage unit 17 to realize functions as a search unit and a control unit.

  The transmission unit 12 supplies a transmission signal to the ultrasonic probe P via a cable or the like, and causes the ultrasonic probe P to generate ultrasonic waves. The transmission unit 12 includes, for example, a high-voltage pulse generator that generates a high-voltage pulse, and supplies a pulse as a transmission signal to the ultrasonic probe P.

  The reception unit 13 includes an amplifier, a logarithmic converter, an envelope detection circuit, an A / D converter, and the like, receives a reception signal from the ultrasonic probe P via a cable or the like, and receives the converted reception signal. The electric signal is electrically amplified, subjected to signal processing such as digital conversion, and output to the image processing unit 14.

  The image processing unit 14 generates a B-mode image based on the digital reception signal output from the reception unit 13. A B-mode image represents the intensity of a received signal by luminance. The B-mode image generated in this way is output to the memory unit 15 as an ultrasonic image.

The memory unit 15 includes a frame memory 151, a cine memory 152, a temporary storage unit 153, and the like.
The frame memory 151 stores the ultrasonic image output from the image processing unit 14 in units of frame images. When the ultrasonic image is output from the image processing unit 14, the control unit 11 overwrites the output ultrasonic image on the frame memory 151 in units of frames and causes the display unit 16 to display the image.
For example, the cine memory 152 temporarily stores a plurality of ultrasonic images (a plurality of frame images) acquired in the last few minutes so that a moving image can be reproduced.
The temporary storage unit 153 stores ultrasonic images (a plurality of frame images) acquired within a time range set as a search target time in a key frame search process described later. If a time that can be recorded in the cine memory 152 is set as the search target time, the cine memory 152 may function as the temporary storage unit 153 and the ultrasound image stored in the cine memory 152 may be used for the search of the diagnostic image. good.

  The display unit 16 includes an LCD (Liquid Crystal Display), a CRT (Cathode-Ray Tube) display, an organic EL (Electronic Luminescence) display, a plasma display, or the like, and is stored in the frame memory 151 according to control from the control unit 11. The ultrasonic images being displayed are sequentially displayed sequentially, and various operation screens are displayed on the screen.

  The storage unit 17 includes, for example, an HDD (Hard Disk Drive), a semiconductor nonvolatile memory, or the like. The storage unit 17 stores various programs and data necessary for executing the programs.

  The operation unit 18 includes various switches, function buttons, a trackball, a mouse, a keyboard, and the like, and outputs an operation signal to the control unit 11. For example, the operation unit 18 includes a freeze button 181. The freeze button 181 is a button for performing a freeze operation. That is, the button is used to stop overwriting the image in the frame memory 151 and to input an instruction to hold the display of the ultrasonic image currently displayed on the display unit 16 on the screen. For example, when the photographer finds a shadow suspected of being a lesion, the photographer operates the freeze button 181 so that the image displayed at the timing of the freeze operation is held on the screen and the shadow is set as a still image. It can be observed in detail.

  The communication control unit 19 is configured by a LAN card or the like, and transmits and receives data to and from an external device such as the terminal device 2 connected to the communication network N via a switching hub.

The terminal device 2 is a device that receives an ultrasonic image from the ultrasonic diagnostic apparatus 1 and reproduces it for a doctor's diagnosis.
As shown in FIG. 1, the terminal device 2 includes a control unit 21, an operation unit 22, a display unit 23, a communication control unit 24, a storage unit 25, and the like, and each unit is connected via a bus 26. .

  The control unit 21 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), and the like, and executes various processes in cooperation with various programs stored in the storage unit 25. Control the overall operation. For example, the control unit 21 executes an ultrasonic image reproduction control process A (see FIG. 5) in cooperation with a program stored in the storage unit 25, and realizes a function as a reproduction control unit.

  The operation unit 22 includes a keyboard having character input keys, numeric input keys, various function keys, and the like, and a pointing device such as a mouse, and a key pressing signal pressed by the keyboard and an operation signal by the mouse. Are output to the control unit 21 as an input signal.

  The display unit 23 includes a monitor such as a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display), for example, and displays various screens according to instructions of a display signal input from the control unit 21. The display unit 23 is a reproducing unit that reproduces a series of ultrasonic images transmitted from the ultrasonic diagnostic apparatus 1.

  The communication control unit 24 is configured by a LAN card or the like, and transmits / receives data to / from an external device such as the ultrasonic diagnostic apparatus 1 connected to the communication network N via a switching hub.

  The storage unit 25 includes, for example, an HDD (Hard Disk Drive), a semiconductor nonvolatile memory, or the like. The storage unit 25 stores various programs as described above.

(Operation of the ultrasonic diagnostic system 100)
Next, the operation in the ultrasonic diagnostic system 100 will be described.
FIG. 2 is a flowchart showing key frame search processing executed by the control unit 11 of the ultrasonic diagnostic apparatus 1. The key frame search process is executed in cooperation with a program stored in the control unit 11 and the storage unit 17 in response to an instruction to start an inspection from the operation unit 18.

  Here, in general, in an ultrasound diagnosis of a breast, a photographer such as a radiographer applies the ultrasound probe P to the breast and captures an ultrasound image of the breast on the display unit 16 in real time. Observe and perform the freeze operation when an area that seems to be necessary for diagnosis (specifically, an abnormal shadow candidate or a normal candidate) appears, and hold the ultrasound image at that timing on the screen in detail. Observing. That is, it is considered that the ultrasonic image displayed at the timing when the freeze operation is performed is an image that the photographer has determined to be a noticeable image suitable for diagnosis. However, the ultrasonic probe P may move during the freeze operation, or a time lag may occur between the timing when the freeze operation is actually performed and the timing when the freeze operation is detected. Further, the image displayed at the timing when the photographer performs the freeze operation is not necessarily an image to be noted (called a key frame) that is objectively suitable for diagnosis. However, since the photographer performs a freeze operation when finding some kind of shadow, there is an image suitable for diagnosis, that is, an image in which an abnormal shadow candidate or a normal candidate is drawn around the timing of the freeze operation. Conceivable.

  Therefore, the ultrasonic diagnostic apparatus 1 performs a key frame search process described below, and an ultrasonic wave captured within a predetermined search target time from the timing when the freeze operation (pressing the freeze button 181) is performed. Index information that automatically searches for an ultrasonic image of a type selected from the images (for example, a frame image in which an abnormal shadow candidate exists) and indicates that the searched ultrasonic image is a frame image to be noted. Is granted. Then, by transmitting a series of ultrasonic images including the frame image acquired by the examination to the terminal device 2 in a moving image format, the diagnostician can efficiently find an image suitable for diagnosis from a large number of moving images. Support.

  First, a setting screen (not shown) for the user to set the search target time for the diagnostic image is displayed on the display unit 16, and the search target time is set according to the input of the operation unit 18 from the setting screen. (Step S1). The search target time is, for example, (1) the time from the start of image acquisition to the timing at which the freeze operation is performed (the time from the timing at which the freeze operation is performed to the image acquisition start time), and (2) the cine memory 152 The recordable time (the time when an image can be recorded in the cine memory 152 retroactively from the timing when the freeze operation is performed, (3) the time range specified by the user based on the timing when the freeze operation is performed, etc. can be set. In (3), not only before the freeze operation is performed, but also after the freeze operation and / or the time range including before and after the freeze operation can be set. If a time range that includes images is set, the ultrasound image acquired within the time range set after the freeze operation Storage in the storage unit 153 is continued.

  Next, an ultrasonic image is acquired. That is, an ultrasonic wave is supplied from the ultrasonic probe P to the subject, an ultrasonic image is generated by the image processing unit 14 based on the received signal received from the subject, and the generated ultrasonic image is stored in the memory. It is stored in each memory of the unit 15 (step S2). Until the freeze button 181 is pressed (until the freeze operation is performed), acquisition of ultrasonic images is repeated.

When pressing of the freeze button 181 is detected (step S3; YES), an image type selection screen 161 for the user to select an image type to be presented to the diagnostician is displayed on the display unit 16 (step S4).
FIG. 3 shows an example of the image type selection screen 161. As shown in FIG. 3, the image type selection screen 161 includes a patient information display field 161a, an abnormality button 161b, a normal button 161c, a normal / abnormal button 161d, a search execution button 161e, a freeze result display field 161f, and a key frame display field. 161g, an image transmission button 161h, and the like are provided.
The patient information display column 161a is a column for displaying information on a patient to be diagnosed. The abnormal button 161b is a button for selecting an image including an abnormal shadow candidate as an image type to be presented to a diagnostician as a key frame. The normal button 161c is a button for selecting an image including a normal candidate as an image type to be presented to the diagnostician as a key frame. The normal / abnormal button 161d is a button for selecting an image including at least one of an abnormal shadow candidate and a normal candidate as an image type to be presented to a diagnostician as a key frame. The search execution button 161e is a button for instructing execution of a search for an image of a type selected from the abnormal button 161b, the normal button 161c, and the normal / abnormal button 161d. The freeze result display column 161f is a column for displaying the ultrasonic image that was displayed when the freeze operation was performed. The key frame display column 161g is a column for displaying an image searched as a key frame. The image transmission button 161 h is a button for instructing transmission of a series of ultrasonic images acquired by the inspection to the terminal device 2.

When the operation unit 18 instructs to search for an image including an abnormal shadow candidate by pressing the abnormal button 161b and the search execution button 161e (step S5; YES), the search stored in the temporary storage unit 153 is performed. A plurality of ultrasonic images acquired within the target time are read, and an ultrasonic image including an abnormal shadow candidate is searched from the read ultrasonic images (step S6).
When the operation unit 18 presses the normal button 161c and the search execution button 161e to instruct the search for an image including normal candidates (step S5; NO, step S7; YES), the temporary storage unit 153 stores the image. The plurality of ultrasonic images acquired within the search target time are read, and an ultrasonic image including normal candidates is searched from the read ultrasonic images (step S8).
When the normal / abnormal button 161d and the search execution button 161e are pressed by the operation unit 18, an instruction to search for an image including at least one of a normal candidate and an abnormal shadow candidate is given (step S7; NO, step S9; YES), an ultrasonic image acquired within the search target time stored in the temporary storage unit 153 is read out, and at least one of an abnormal shadow candidate and a normal candidate from the read out plural ultrasonic images Is searched for an ultrasonic image that includes (step S10).

Search for an image including an abnormal shadow candidate and a normal candidate can be performed using a technique such as a CAD (Computer-Aided Diagnosis) technique or a similar image search technique.
Search using CAD technology can be performed as follows, for example.
(1) First, an area suspected of being abnormal is identified. For an area suspected of being abnormal, for example, the area detected by edge detection by the canny method and then divided by the wartershed method, the area, the average density, the position of the center of gravity, and the density difference from the surrounding area. It can be specified by calculating feature values such as aspect ratio and comparing the calculated feature values with a predetermined threshold (Daisuke Fukuoka, “CAD System in Breast Ultrasound Images” The Japanese Society of Radiological Technology) Magazine, December 2007).
(2) Next, for an area identified as suspected of being abnormal (referred to as a primary candidate), feature amounts such as edge shape, internal non-uniformity, aspect ratio, and shape of the lesion edge are calculated. .
For example, as shown in FIG. 4, the shape of the edge can be obtained by dividing the shortest distance dmin from the center of gravity of the primary candidate region to the edge by the longest distance dmax.
The aspect ratio can be obtained by calculating the ratio of 1/2 of the vertical axis of the ellipse circumscribing the primary candidate region to 1/2 of the horizontal axis.
The internal non-uniformity can be obtained by calculating entropy represented by the following equation.
The shape of the lesion edge can be obtained by calculating the fractal dimension shown in the following equation.
(3) Next, the four feature amounts calculated in (2) are applied to different four-dimensional axes, and a vector x composed of these quaternary elements is set.
(4) Next, a vector x composed of the elements of the above four feature values for each of a large number of previously collected abnormal shadow patterns (known abnormal shadow patterns) and normal shadow patterns is calculated. An average vector u is calculated for each of the pattern and the normal shadow pattern. Then, by applying x and u to the formula [Equation 3] below, the Mahalanobis distance D _M 1 (x) from the primary candidate to the abnormal shadow pattern, and the Mahalanobis distance D _M 2 from the primary candidate to the normal shadow pattern (X) is calculated.
(5) The primary candidate of Mahalanobis distance D _M 1 (x)> D _M 2 (x) is extracted as an abnormal shadow candidate, and the primary candidate of Mahalanobis distance D _M 2 (x) ≧ D _M 1 (x) is a normal candidate. Extracted as
In addition, by assigning numbers (or sorting) in ascending order of Mahalanobis distance, images can be displayed in descending order of importance during diagnosis.

  The search using the similar image search technique can use, for example, a technique disclosed in Japanese Patent Application Laid-Open No. 2004-5364. For example, an image showing a known abnormal shadow, an image showing a normal area are stored in a database, and an image showing an abnormal shadow stored in the database from each ultrasonic image taken at the search target time; An ultrasound image having a similarity degree of similarity determination items (for example, the shape of the shadow, the size of the shadow, the direction of the shadow, and the characteristics of the shading pattern) can be acquired as an image including an abnormal shadow candidate. Similarly, an ultrasound image in which the similarity between the image indicating the normal region and the similarity determination item is greater than or equal to a predetermined value can be acquired as an image including normal candidates.

  When the image search is completed, index information indicating that the ultrasonic image is a key frame is assigned (associated) to the searched ultrasonic image (step S11) and displayed on the display unit 16. Is displayed in the key frame display field 161g of the image type selection screen 161 (step S12). For example, index information indicating that the frame is a key frame is written in the header information of the key frame, whereby the index information is given to the key frame. Then, in response to a transmission instruction from the operation unit 18, a series of ultrasonic images acquired by the current examination (imaging) is transmitted (output) to the terminal device 2 by the communication control unit 19 in a moving image format (step S13). ).

  In the terminal device 2, when a series of ultrasonic images for each examination is received from the ultrasonic diagnostic apparatus 1 by the communication control unit 24, the received ultrasonic images are stored in the storage unit 25. Then, in accordance with an instruction from the operation unit 22, the following ultrasonic image reproduction control process A is executed.

  FIG. 5 is a flowchart showing the ultrasonic image reproduction control process A executed by the control unit 21 of the terminal device 2. The ultrasonic image reproduction control process A is executed in cooperation with a program stored in the control unit 21 and the storage unit 25 in response to an instruction from the operation unit 22.

First, the playback screen 231 is displayed on the display unit 23 (step S21).
FIG. 6 shows an example of the playback screen 231 displayed on the display unit 23 in step S21. As shown in FIG. 6, the playback screen 231 includes an image playback field 231a, a frame display field 231b, a playback button 231c, a frame advance / return button 231d, a capture button 231e, and the like.
The image reproduction field 231a is an area for sequentially reproducing (moving image reproduction) the frame images of a series of ultrasonic images for each examination in the shooting order. When the playback screen 231 is initially displayed, the top frame image is displayed in a still image state. When index information indicating that the frame image is displayed is a key frame, an index A1 indicating that the image is a key frame is displayed.
The frame display field 231b is an area in which thumbnail images of a series of frame images are arranged in the shooting order and displayed as a still image. For images to which index information is assigned, an index B1 indicating a key frame is displayed. In addition, the frame image currently being reproduced is highlighted by being surrounded by a thick colored frame or the like.
The playback button 231c is a button for instructing the start of moving image playback of a series of frame images. The frame advance / return button 231d is used to instruct the image reproduction field 231a to advance the frame image to be reproduced by one frame or to return one frame when the reproduction of the image reproduction field 231a is paused. Button. The capture button 231e is a button for instructing to capture the frame image displayed in the image reproduction field 231a as a still image.

  When the reproduction button 231c is pressed by the operation unit 22 on the reproduction screen 231 and an instruction to start reproduction is given (step S22; YES), a series of ultrasonic image reproduction starts (step S23).

  In moving image reproduction, first, it is determined whether or not the frame image to be reproduced is the final frame image (step S24). If it is determined that the current frame image to be reproduced is not the final frame image (step S24; NO), it is determined whether or not index information indicating that the frame image is a key frame is attached (step S24; NO). Step S25). If it is determined that the index information is not attached to the frame image (step S25; NO), the frame image to be reproduced is switched (step S26), and the process returns to step S24.

  If it is determined that the index information is attached to the frame image currently being reproduced (step S25; YES), the frame image (that is, the key frame) is reproduced in the state displayed in the image reproduction column 231a. Is temporarily stopped (step S27). Next, it is determined whether or not the frame advance / frame return button 231d has been pressed by the operation unit 22, and if it is determined that it has been pressed (step S28; YES), frame advance or frame return is performed according to the operation of the operation unit 22. Is executed (step S29), and the process proceeds to step S30. If it is determined by the operation unit 22 that the frame advance / frame return button 231d has not been pressed (step S28; NO), the process proceeds to step S30.

  In step S30, it is determined whether or not the capture button 231e has been pressed by the operation unit 22. If it is determined that the capture button 231e has been pressed (step S30; YES), the frame image currently being reproduced is captured as a still image. And stored in the storage unit 25 (step S31), and the process proceeds to step S32. If it is determined that the capture button 231e has not been pressed (step S30; NO), the process proceeds to step S32.

  In step S32, it is determined whether or not the reproduction button 231c has been pressed by the operation unit 22 (step S32). If it is determined that the playback button 231c has not been pressed (step S32; NO), the process returns to step S28. If it is determined that the playback button 231c has been pressed (step S32; YES), the frame image to be played back is switched (step S33), and the process returns to step S24.

  Steps S24 to S33 are repeatedly executed until it is determined in step S24 that the current frame image to be reproduced is the final frame image. If it is determined in step S24 that the current frame image to be reproduced is the final frame image (step S24; YES), the ultrasonic image reproduction control process A ends.

  As described above, in the terminal device 2 of the ultrasonic diagnostic system 100 according to the first embodiment, index information is added in the ultrasonic diagnostic apparatus 1 during moving image reproduction of the ultrasonic image transmitted from the ultrasonic diagnostic apparatus 1. When the key frame that is the frame image is reached, playback is paused. The key frame is a frame including at least one of an abnormal shadow candidate, a normal candidate, or an abnormal shadow candidate and a normal candidate, which is searched from the points acquired within a predetermined time range based on the timing when the photographer performs a freeze operation. It is an image. Therefore, the diagnostician can easily search for a frame image searched as an image necessary for diagnosis objectively from a large number of frame images to be reproduced as a moving image, so that the interpretation can be made more efficient. In addition, since frame advance and frame return from the key frame are possible, the diagnostician can display images acquired before and after the key frame and easily find an image more suitable for diagnosis for the diagnostician. It becomes possible.

[Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described. Since the configuration of the ultrasonic diagnostic system 100 and the operation of the ultrasonic diagnostic support apparatus 1 in the second embodiment are the same as those described in the first embodiment, the description is incorporated. Hereinafter, the operation of the terminal device 2 will be described.

  FIG. 7 is a flowchart showing the ultrasonic image reproduction control process B executed by the control unit 21 of the terminal device 2. The ultrasonic image reproduction control process B is executed in cooperation with the program stored in the control unit 21 and the storage unit 25 in response to an instruction from the operation unit 22.

First, the playback screen 231 is displayed on the display unit 23 (step S41).
The reproduction screen 231 is the same as that described with reference to FIG. 6 in the first embodiment.

  In the playback screen 231, when the playback button 231c is pressed by the operation unit 22 and playback start is instructed (step S42; YES), the number of frame images to which index information is assigned in a series of ultrasonic images, that is, The number of key frames is totaled and set to the variable i (step S43). Next, 1 is set to the variable n (step S44), and it is determined whether n> i is satisfied (step S45).

  If it is determined that n> i is not satisfied (step S45; YES), the nth key frame to which the index information is assigned is reproduced in the image reproduction field 231a (step S46), and n is incremented by 1 (step S47). ).

  Next, it is determined whether or not the frame advance / frame return button 231d has been pressed by the operation unit 22, and if it is determined that it has been pressed (step S48; YES), frame advance or frame return is performed according to the operation of the operation unit 22. Is executed (step S49), and the process proceeds to step S50. If the operation unit 22 determines that the frame advance / frame return button 231d has not been pressed (step S48; NO), the process proceeds to step S50.

  In step S50, it is determined whether or not the capture button 231e has been pressed by the operation unit 22. If it is determined that the capture button 231e has been pressed (step S50; YES), the frame image currently being reproduced is captured as a still image. And stored in the storage unit 25 (step S51), and the process proceeds to step S52. If it is determined that the capture button 231e has not been pressed (step S50; NO), the process proceeds to step S52.

  In step S52, it is determined whether or not the reproduction button 231c is pressed by the operation unit 22 (step S52). If it is determined that the playback button 231c has not been pressed (step S52; NO), the process returns to step S48. If it is determined that the playback button 231c is pressed (step S52; YES), the process returns to step S45.

  Until it is determined in step S45 that n> i, the processes in steps S45 to S52 are repeatedly executed. If it is determined in step S45 that n> i (step S45; YES), the ultrasonic image reproduction control process B ends.

  As described above, in the terminal device 2 of the ultrasonic diagnostic system 100 according to the second embodiment, key frames to which index information is assigned are sequentially reproduced from the ultrasonic images transmitted from the ultrasonic diagnostic device 1. To go. The key frame is a frame including at least one of an abnormal shadow candidate, a normal candidate, or an abnormal shadow candidate and a normal candidate, which is searched from the points acquired within a predetermined time range based on the timing when the photographer performs a freeze operation. It is an image. Therefore, the diagnostician can easily search for a frame image searched objectively necessary for diagnosis from a large number of frame images to be reproduced as a moving image, so that the interpretation can be made more efficient. In addition, since frame advance and frame return from the key frame are possible, the diagnostician can display images acquired before and after the key frame and easily find an image more suitable for diagnosis for the diagnostician. It becomes possible.

As described above, according to the ultrasonic diagnostic system 100 according to the present invention, the control unit 11 of the ultrasonic diagnostic apparatus 1 is based on the ultrasonic reception signal from the ultrasonic probe P and the image processing unit 14. When the ultrasonic image is generated by the above, the generated ultrasonic image is sequentially stored in the temporary storage unit 153. When the freeze button 181 is operated, an ultrasonic image acquired within a predetermined time range before and / or after the timing at which the freeze button 181 is operated is read from the temporary storage unit 153 , and From the read ultrasound image, a search is performed using any one of an ultrasound image including an abnormal shadow candidate, an ultrasound image including a normal candidate, and an ultrasound image including at least one of an abnormal shadow candidate and a normal candidate as a search target. Then, index information indicating that the ultrasonic image is a key frame is added to the searched ultrasonic image, and a series of ultrasonic images including the key frame are output to the terminal device 2 by the communication control unit 19. When receiving a series of ultrasound images from the ultrasound diagnostic apparatus 1, the control unit 21 of the terminal device 2 controls the reproduction of the received series of ultrasound images based on the key frame to which the index information is assigned.

Accordingly, in the terminal device 2, for example, based on the key frame, only the key frame is sequentially reproduced on the display unit 23, a series of ultrasonic images is reproduced as a moving image, and the reproduction is temporarily stopped when the key frame is reached. When the photographer and the diagnostician are different from each other by performing reproduction control such as displaying an identification display indicating that it is a key frame when reproducing the Therefore, it is possible to easily find out the key frames searched for objectively for diagnosis, so that the interpretation diagnosis work can be made efficient.
In addition, since frame advance and frame return from the key frame are possible, the diagnostician can display images acquired before and after the key frame and easily find an image more suitable for diagnosis for the diagnostician. It becomes possible.
In addition, because the search for abnormal shadow candidates and normal candidates is performed on an ultrasound image acquired within a predetermined search target time based on the timing of the freeze operation, the key frame search processing time is reduced. It becomes possible to suppress to the minimum necessary.
In addition, since the timing of the freeze operation is the base point of the key frame search process, as a result of observing the entire inside of the breast by the photographer, it is possible to provide the diagnostic doctor as a key frame with a point determined to be important for diagnosis. It is possible to improve the efficiency of the diagnosis work.

  In addition, the description content in the said embodiment is a suitable example of this invention, and is not limited to this.

  For example, in the above-described embodiment, it has been described that an ultrasound image including a key frame is played back in a terminal device 2 different from the ultrasound diagnostic device 1. However, in the ultrasound diagnostic device 1, a diagnostician captures an ultrasound image. The present invention can also be applied to the case of playing a moving image.

  In the above embodiment, the tab-shaped indexes A1 and B1 are displayed together as identification information indicating the key frame when the key frame is reproduced on the display unit 23 of the terminal device 2. The display mode of the identification information indicating that it is a key frame is not limited to this. For example, the key frame may be displayed surrounded by a thick frame of a predetermined color, or an index image having a mode different from A1 and B1 may be displayed.

  In the above description, an example in which a hard disk, a semiconductor nonvolatile memory, or the like is used as a computer-readable medium of the program according to the present invention is disclosed, but the present invention is not limited to this example. As another computer-readable medium, a portable recording medium such as a CD-ROM can be applied. A carrier wave is also applied as a medium for providing program data according to the present invention via a communication line.

  In addition, the detailed configuration and detailed operation of each device constituting the ultrasonic diagnostic system can be changed as appropriate without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 100 Ultrasonic diagnostic system 1 Ultrasonic diagnostic apparatus 10 Ultrasonic diagnostic apparatus main body 11 Control part 12 Transmission part 13 Reception part 14 Image processing part 15 Memory part 151 Frame memory 152 Cine memory 153 Temporary storage part 16 Display part 17 Storage part 18 Operation part 181 Freeze button 19 Communication control unit 101 Bus P Ultrasonic probe 2 Terminal device 21 Control unit 22 Operation unit 23 Display unit 24 Communication control unit 25 Storage unit 26 Bus

Claims (7)

Ultrasonic image acquisition means for acquiring ultrasonic images by outputting transmission ultrasonic waves toward the subject by the ultrasonic probe and receiving reflected ultrasonic waves from the subject;
Display means for sequentially displaying ultrasonic images acquired by the ultrasonic image acquisition means on a screen;
Temporary storage means for temporarily storing a plurality of temporally continuous ultrasonic images acquired by the ultrasonic image acquisition means;
Operation means for inputting an instruction to hold the display of the ultrasonic image displayed on the display means on the screen;
An ultrasonic image acquired within a predetermined time range before and / or after the timing at which the operation means is operated is read out from the temporary storage means, and the read-out ultrasonic image Among them, search means for searching as a search target an ultrasonic image including an abnormal shadow candidate, an ultrasonic image including a normal candidate, an ultrasonic image including at least one of an abnormal shadow candidate or a normal candidate,
Control means for giving index information indicating that the ultrasonic image is a noticeable image to the ultrasonic image searched by the search means;
Reproducing means for reproducing a part or all of the plurality of temporally continuous ultrasonic images including the ultrasonic image to which the index information is assigned,
Reproduction control means for controlling reproduction of the plurality of temporally continuous ultrasonic images in the reproduction means, based on the ultrasonic image to which the index information is given,
An ultrasonic diagnostic system comprising:   The reproduction control unit causes the reproduction unit to perform moving image reproduction of the plurality of temporally continuous ultrasonic images, and pauses the reproduction unit when reaching the position of the ultrasonic image to which the index information is assigned. The ultrasonic diagnostic system according to claim 1 to be performed.   The ultrasonic diagnostic system according to claim 1, wherein the reproduction control unit sequentially reproduces only the ultrasonic image to which the index information is added. Frame operation means for instructing frame advance or frame return based on the ultrasound image to which the index information is added,
4. The reproduction control unit according to claim 2 or 3, wherein the reproduction control unit causes the reproduction unit to perform frame advance or frame return based on an ultrasound image to which the index information is added, in accordance with an operation of the frame operation unit. Ultrasound diagnostic system.   The reproduction control means, when reproducing the ultrasonic image to which the index information is assigned in the reproduction means, displays the identification information indicating that the image has the index information. The ultrasonic diagnostic system according to any one of 4. An ultrasonic image acquisition means for acquiring an ultrasonic image by outputting a transmission ultrasonic wave toward the subject by an ultrasonic probe and receiving a reflected ultrasonic wave from the subject;
Display means for sequentially displaying ultrasonic images acquired by the ultrasonic image acquisition means on a screen;
Temporary storage means for temporarily storing a plurality of temporally continuous ultrasonic images acquired by the ultrasonic image acquisition means;
Operation means for inputting an instruction to hold the display of the ultrasonic image displayed on the display means on the screen;
An ultrasonic image acquired within a predetermined time range before and / or after the timing at which the operation means is operated is read out from the temporary storage means, and the read-out ultrasonic image Among them, search means for searching as a search target an ultrasonic image including an abnormal shadow candidate, an ultrasonic image including a normal candidate, an ultrasonic image including at least one of an abnormal shadow candidate or a normal candidate,
Control means for giving index information indicating that the ultrasonic image is a noticeable image to the ultrasonic image searched by the search means;
Output means for outputting to the reproduction means a plurality of temporally continuous ultrasonic images including the ultrasonic image to which index information is given by the control means;
An ultrasonic diagnostic support apparatus comprising: Computer
The ultrasonic image acquired by the ultrasonic image acquisition means for acquiring the ultrasonic image by outputting the transmission ultrasonic wave toward the subject by the ultrasonic probe and receiving the reflected ultrasonic wave from the subject. Display means for sequentially displaying on the screen;
Temporary storage means for temporarily storing a plurality of temporally continuous ultrasonic images acquired by the ultrasonic image acquisition means;
Operation means for inputting an instruction to hold the display of the ultrasonic image displayed on the display means on the screen;
An ultrasonic image acquired within a predetermined time range before and / or after the timing at which the operation means is operated is read out from the temporary storage means, and the read-out ultrasonic image Among them, a search means for searching as a search target an ultrasonic image including an abnormal shadow candidate, an ultrasonic image including a normal candidate, an ultrasonic image including at least one of an abnormal shadow candidate or a normal candidate,
Control means for providing index information indicating that the ultrasonic image is a noticeable image to the ultrasonic image searched by the search means;
Output means for outputting to the reproducing means a plurality of temporally continuous ultrasonic images including the ultrasonic image to which index information is given by the control means;
Program to function as.