JP5486449B2 - Ultrasonic image generating apparatus and method of operating ultrasonic image generating apparatus - Google Patents

Description

The present invention relates to an ultrasonic image generation apparatus and an operation method of the ultrasonic image generation apparatus, and more particularly to an ultrasonic image generation apparatus that displays a puncture instrument on a screen together with a living tissue and an operation method of the ultrasonic image generation apparatus .

  In the medical field, ultrasonic image generation apparatuses are widely used for examinations and examinations. An ultrasonic image generation device is used together with an ultrasonic probe, irradiates a subject with ultrasonic waves from the ultrasonic probe, and a signal derived from the echo (echo) (hereinafter referred to as an echo signal). An apparatus that generates an ultrasonic tomographic image (hereinafter referred to as an ultrasonic image) of a subject.

  The ultrasonic probe has a piezoelectric element array composed of a plurality of piezoelectric elements arranged in an array, and irradiates the subject with ultrasonic waves from the piezoelectric element array and receives echoes from the subject. . The ultrasonic image generating device generates an ultrasonic image of the subject based on an echo signal output from the ultrasonic probe that has received the echo, and displays the ultrasonic image on the monitor.

  In addition, the ultrasonic image generation device is used as a puncture device, for example, when performing a puncture operation in which a puncture needle is punctured at a desired site to collect a tissue sample for cell tissue diagnosis.

  In puncture, it is important that the puncture needle can be confirmed on the monitor, that is, on the image, and that the puncture needle reaches the target. In order to ensure that the puncture needle reaches the target object, it is necessary to insert the puncture needle along a predetermined insertion path (path through which the puncture needle is inserted into the subject) while viewing the ultrasonic image. is there. It is also important to leave an image in which a puncture needle is inserted into a target object in a definitive diagnosis of cancer such as cell tissue diagnosis by biopsy or the like.

  As a device that displays puncture guidelines that serve as a guide for inserting the puncture needle, the angle at which the puncture needle travels is calculated from an ultrasonic echo signal on a straight line of a predetermined length or longer, and the puncture guideline according to the progress angle is displayed. An ultrasonic diagnostic apparatus that superimposes and displays on a B-mode image that is an ultrasonic image generated from an echo signal is disclosed (see Patent Document 1).

  Also, an ultrasonic image of the puncture needle is detected by detecting the amount of deviation between the puncture route through which the puncture needle is inserted and a predetermined puncture guideline, and moving the guideline from the reference locus corresponding to the reference position of the puncture needle. An ultrasonic diagnostic apparatus that displays a puncture guideline in which a deviation is corrected by matching the guideline with the guideline is disclosed (see Patent Document 2).

JP 2006-346477 A JP-A-8-299344

  However, in the conventional ultrasonic diagnostic apparatus, it is difficult to depict the puncture needle on the ultrasonic image, and there is a problem that the puncture needle is displayed in an intermittent manner and the exact position of the puncture needle is unclear. There are various causes for this problem. For example, since the surface of the puncture needle is smooth and scattering of ultrasonic waves does not occur easily, the puncture needle inserted obliquely with respect to the ultrasonic irradiation direction is changed from the probe to the probe. It is conceivable that there are only a few echoes returning.

  The ultrasonic diagnostic apparatuses described in Patent Document 1 and Patent Document 2 only display puncture guidelines, and do not consider the point at which the puncture needle is interrupted. In particular, Patent Document 1 does not have a function of correcting the ultrasound image of the puncture needle and the guideline, and Patent Document 2 does not update the reference position. For this reason, even when the puncture guideline is displayed, there may be a problem that the puncture needle is not drawn along the puncture guideline because the puncture needle is bent in the process of inserting a hard tissue. . In addition, although both show guidelines for insertion routes, they do not consider the case of leaving them as evidence images, and do not indicate which luminance on the ultrasonic image is the luminance representing the needle. Absent.

The present invention has been made in view of the above-described facts, and an ultrasonic image generation apparatus and an ultrasonic image generation capable of generating an image for informing a user of the position of a puncture device such as a puncture needle accurately and reliably. The object is to provide a method of operating the device .

To achieve the above object, an ultrasonic image generating apparatus according to the present invention, the ultrasonic waves irradiated from the probe to a subject puncture device is pierced, it is reflected from the object及beauty puncture puncturing instrument An ultrasonic image generation device that receives an echo with a probe and generates an ultrasonic image from an echo signal output from the probe, and extracts a candidate point for a puncture device based on the ultrasonic image An extraction means, a puncture instrument existing area specifying means for specifying a puncture instrument existing area where a puncture instrument may be present in an ultrasonic image from the distribution of a plurality of candidate points extracted by the candidate point extraction means, and a puncture instrument based on the intensity distribution on the straight line including the puncture device in the puncture device existence region identified by the presence region specifying unit, and the puncture instrument tip position specifying means for specifying the position of the tip of the puncture device, comprising a puncture instrument tip localization Stage based on the maximum and minimum values of the straight line intensity distribution, including puncture device in the puncture device existing region, that identifies the position of the tip of the puncture device.
Further, the ultrasonic image generating apparatus according to the present invention irradiates the subject into which the puncture device is inserted with ultrasonic waves from the probe, and the echo reflected from the subject and the puncture device is detected by the probe. An ultrasound image generation device that generates an ultrasound image from an echo signal received and output from a probe, a candidate point extraction unit that extracts a candidate point of a puncture device based on the ultrasound image, and a candidate point From the distribution of a plurality of candidate points extracted by the extraction means, the puncture instrument existing area specifying means for specifying the puncture instrument existing area where the puncture instrument may exist in the ultrasonic image, and the puncture instrument existing area specifying means are specified. A puncture device tip position specifying means for specifying the tip position of the puncture device based on the intensity distribution on the straight line including the puncture device in the region where the puncture device is present, and the puncture device can be inserted in an ultrasonic image. A predictive insertion region setting means for setting a predictive insertion region having a high probability, and a tip position storage means for storing a plurality of tip positions in the past of the puncture device specified by the puncture device tip position specifying means. The puncture area setting means estimates the advancing direction of the puncture instrument from the plurality of tip positions of the puncture instrument stored by the tip position storage means, and sets an area in the advancing direction of the puncture instrument as the predicted puncture area. The candidate point extracting means extracts puncture device candidate points from the area set by the predicted insertion area setting means.

The operation method of the ultrasonic diagnostic apparatus according to the present invention is to irradiate the subject into which the puncture device is inserted from the probe and receive the echo reflected from the subject and the puncture device with the probe. A method for operating an ultrasonic image generating device that generates an ultrasonic image from an echo signal output from a probe, a candidate point extracting step for extracting a candidate point of a puncture device based on the ultrasonic image, and a candidate A puncture device presence region specifying step for identifying a puncture device presence region where a puncture device may be present in an ultrasonic image from the distribution of a plurality of candidate points extracted in the point extraction step, and a puncture device presence region specifying step A puncture device tip position specifying step for specifying the tip position of the puncture device based on the maximum value and the minimum value of the intensity distribution on the straight line including the puncture device in the specified puncture device presence region.
In addition, the method for operating the ultrasonic diagnostic apparatus according to the present invention includes irradiating a subject into which a puncture device is inserted with ultrasonic waves from a probe, and detecting echoes reflected from the subject and the puncture device. A method for operating an ultrasonic image generation device that generates an ultrasonic image from an echo signal received by a child and output from a probe, and extracts candidate points for extracting a candidate point of a puncture device based on the ultrasonic image A puncture device presence region identifying step for identifying a puncture device presence region where a puncture device may be present in an ultrasonic image from the distribution of a plurality of candidate points extracted in the step and the candidate point extraction step, and a puncture device presence The puncture device tip position specifying step for specifying the tip position of the puncture device based on the intensity distribution on the straight line including the puncture device in the region where the puncture device is specified in the region specifying step, and the ultrasonic image A predicted insertion region setting step for setting a predicted insertion region where the puncture device is likely to be inserted, and a tip position for storing a plurality of past tip positions of the puncture device specified in the puncture device tip position specifying step A predicting insertion region setting step, wherein the advancing direction of the puncture device is estimated from a plurality of tip positions of the puncture device stored in the tip position storage step, and an area in the advancing direction of the puncture device is determined. The candidate point extraction step is set as a predicted insertion region, and the candidate point extraction step extracts candidate points of the puncture device from the region set in the prediction insertion region setting step.

ADVANTAGE OF THE INVENTION According to this invention, the image for notifying a user of the position of puncture instruments, such as a puncture needle, can be produced | generated correctly and reliably, and the exact position of puncture instruments, such as a puncture needle, can be specified reliably. .
Further, according to the present invention, since the feature points on the puncture needle that is the puncture device can be detected and these can be connected by a line such as a straight line or a curve, the puncture needle can be displayed even if the puncture needle is displayed broken. The connection can be made easy to understand.
In addition, according to the present invention, the line of the puncture needle, which is a puncture device, can be corrected in time series, so that the puncture route has changed due to bending of the puncture needle, presence of hard tissue, probe displacement, etc. Even in this case, the line of the puncture needle can be accurately depicted.
Further, according to the present invention, since the connected line can be displayed in gradation with reference to the luminance of the ultrasonic image, the connection of the puncture needle that is the puncture device is retained while leaving the luminance information of the ultrasonic image. Can be easily understood.

1 is a functional block diagram of an ultrasonic image generation apparatus according to Embodiment 1 of the present invention. FIG. 2 is a functional block diagram showing a detailed configuration of a puncture needle region specifying unit and a puncture needle tip position specifying unit of the ultrasonic image generating apparatus shown in FIG. 1. (A) is a diagram showing an example of a B-mode image in the present invention, (B) is a diagram showing an edge image after threshold processing is performed on the B-mode image shown in (A), and (C) is ( FIG. 5B is a diagram showing an edge image in which a straight line identified by performing Hough transform is superimposed on the edge image shown in FIG. 5B, and FIG. 4D is an edge image in which a puncture needle presence area is superimposed on the edge image shown in FIG. FIG. (A) is a schematic diagram showing a tip position specifying method in the puncture needle presence region shown in FIG. 3 (D), and (B) is a straight line connecting the tip position of the puncture needle and the start point of the puncture needle according to (A). It is a schematic diagram showing. 5 is a flowchart showing a flow of a series of processes related to an operation of superimposing and displaying a puncture needle image in the ultrasonic image generating apparatus according to the first embodiment. 5 is a flowchart showing a procedure of extraction processing of candidate puncture needle points of the ultrasonic image generating apparatus according to the first embodiment. (A) is a schematic diagram showing a puncture guideline in a B-mode image, (B) is a schematic diagram showing a predicted insertion area when the predicted insertion area is set to a narrow range, and (C) is a prediction FIG. 4D is a schematic diagram showing the predicted insertion area when the insertion area is set to the average range, and FIG. 4D is a schematic diagram showing the prediction insertion area when the prediction insertion area is set in a wide range. It is a schematic diagram showing the attention area | region in a B mode image. (A) is a diagram in which a straight line representing a puncture needle is superimposed and displayed on a B-mode image, (B) is a diagram in which a straight line representing a puncture needle is translucently displayed and superimposed on a B-mode image, and (C) is a puncture FIG. 5D is a diagram in which needle candidate points are colored and superimposed on a B-mode image, and FIG. 4D is a diagram in which an outline representing a puncture needle is superimposed and displayed on a B-mode image. (A) is the figure which showed the case where a prediction insertion area | region was determined based on the tip position of the past 3 puncture needles, (B) is the prediction insertion based on the tip position of the past four puncture needles It is the figure which showed the case where an area | region is determined. (A) is a diagram in which the puncture needle candidate straight line is expanded by the same vertical width to create a puncture needle presence region, (B) is a diagram in which the puncture needle presence region is shifted upward, and (C) is a puncture needle presence region. (D) is a diagram showing a case where the inclination of the puncture needle candidate straight line is different from the inclination of the puncture needle presence area.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a functional block diagram showing the main configuration of an ultrasonic image generation apparatus 100 according to Embodiment 1 of the present invention.
The ultrasonic image generation apparatus 100 shown in the figure includes a transmission / reception control unit 102, an image generation unit 104, a puncture needle candidate point extraction unit 106, a puncture needle information storage unit 108, a candidate point position storage unit 110, and a puncture needle region specification unit 112. A puncture needle tip position specifying unit 114, a puncture needle image generation unit 116, an image composition unit 118, and an image display control unit 120. The ultrasonic image generating apparatus 100 is used by being electrically connected to the probe 122 and the image display unit 124.

  Although not shown, the probe 122 includes a plurality of piezoelectric elements, transmits ultrasonic waves from the plurality of piezoelectric elements to the subject, and receives echoes reflected from the subject. The piezoelectric element generates an echo signal when receiving the echo. The probe 122 outputs an echo signal to the transmission / reception control unit 102.

  Although not shown, the transmission / reception control unit 102 includes a pulser that generates a high-voltage electrical signal, an amplifier that amplifies the echo signal input from the probe 122, a low-pass filter that cuts high-frequency components of the echo signal, and an analog signal digitally. An A / D converter that converts the signal is provided. An ultrasonic wave is transmitted from the probe 122 by applying a high voltage electric pulse signal generated by the pulsar to the piezoelectric element in the probe 122.

  The transmission control unit 102 amplifies the echo signal output from the probe 122 with an amplifier, cuts high frequency components with a low-pass filter, performs A / D conversion, and outputs the result to the image generation unit 104.

  Although not shown, the image generation unit 104 includes a delay circuit, an adder circuit, and an STC (Sensitivity Time Control) circuit. The image generation unit 104 adds the echo signals output from the transmission / reception control unit 102 with a delay in accordance with the position of the piezoelectric element, thereby forming a sound ray signal. The image generation unit 104 generates B-mode image data after correcting the attenuation of the sound ray signal by the distance according to the depth of the reflection position of the ultrasonic wave by the STC circuit. Here, the B-mode image data is so-called ultrasonic image data, which is image data in which the amplitude of the sound ray signal is represented by luminance, and the B-mode image is a so-called ultrasonic image.

  The puncture needle information storage unit 108 is a storage unit that stores information related to a puncture needle that is a puncture device. Here, the information about the puncture needle includes the type, thickness, insertion position (position where the puncture needle is inserted into the subject), and insertion angle (the puncture needle is inserted into the subject). Angle) and insertion route. The puncture needle information storage unit 108 acquires and stores information related to the puncture needle by input from the user or the like.

  The puncture needle candidate point extraction unit 106 extracts feature points of the puncture needle using the information regarding the puncture needle stored in the puncture needle information storage unit 108 and the B-mode image data generated by the image generation unit 104. Specifically, an edge extraction filter is applied to B-mode image data, CFAR (Constant False Alarm Rate) processing is performed, threshold processing is performed to create edge image data, and edge processing is performed. Candidate points of the puncture needle are extracted from the image data as feature points on the puncture needle. Since the puncture needle has a smooth surface and is difficult to scatter ultrasonic waves, the puncture needle is displayed in an intermittent manner in the B-mode image. Therefore, if threshold processing is performed on B-mode image data in which a puncture needle is present, points representing a part of the puncture needle that has been interrupted can be extracted. The time interval for extracting the candidate points for the puncture needle can be changed by the user. In the B-mode image, there are also high-luminance points derived from other than the puncture needle such as tissue, so that the feature points extracted by the threshold processing are not only those derived from the puncture needle. The puncture needle candidate point derived from the tissue or the like becomes noise when the position of the puncture needle is specified based on the edge image. The extraction of candidate points for the puncture needle may be detected from one frame or a plurality of frames may be detected. When detecting a plurality of frames, the number of frames to be used is about five, and a new one overwritten may be used.

  The candidate point position storage unit 110 stores the positions of all the puncture needle candidate points extracted by the puncture needle candidate point extraction unit 106 and outputs the positions of the puncture needle candidate points to the puncture needle region specifying unit 112.

  The puncture needle region specifying unit 112 generates a straight line (puncture needle candidate straight line) representing an extension line of the puncture needle and the puncture needle based on the distribution of the plurality of puncture needle candidate points stored in the candidate point position storage unit 110. The puncture needle region specifying unit 112 specifies a region including the generated straight line as a region where the puncture needle is present.

  The puncture needle tip position specifying unit 114 specifies the tip position of the puncture needle based on the luminance information of the region where the puncture needle specified by the puncture needle region specifying unit 112 is likely to exist, and punctures the specified tip position. The image is output to the needle image generation unit 116.

The puncture needle image generation unit 116 is based on the puncture needle generated by the puncture needle region specifying unit 112 and a straight line representing the extension line of the puncture needle and the tip position of the puncture needle specified by the puncture needle tip position specifying unit 114. Then, an image representing the puncture needle is generated and output to the image composition unit 118. The image representing the puncture needle can be selected by the user from various forms. For example, there are a form in which the puncture needle is represented by a straight line, a form in which the outline of the puncture needle is represented, a form in which the puncture needle is represented as a set of points, and the like. When expressing the outline of the puncture needle, the outline of the puncture needle is generated by reading out the puncture needle information from the puncture needle information storage unit 108. Also, the user can set the color, brightness, etc. of the image representing the puncture needle. For example, the user may set a favorite color, or the color may be translucent. The luminance of the image representing the puncture needle may be the luminance that the user likes, or may be the same level as the luminance of the portion that appears to be the puncture needle in the B-mode image.
The puncture needle candidate point extraction unit 106, the puncture needle information storage unit 108, the candidate point position storage unit 110, the puncture needle region specification unit 112, the puncture needle tip position specification unit 114, and the puncture needle image generation unit 116 described above are A needle detection circuit is configured.

  The image composition unit 118 generates composite B-mode image data in which the B-mode image data output from the image generation unit 104 and the image representing the puncture needle generated by the puncture needle image generation unit 116 are superimposed and displayed. The image composition unit 118 outputs the composite B-mode image data to the image display control unit 120.

  The image display control unit 120 includes a DSC (digital scan converter). The image display control unit 120 converts the synthesized B-mode image data synthesized by the image synthesizing unit 118 into image data according to a normal television signal scanning method by DSC, and performs necessary image processing such as gradation processing. And output to the image display unit 124. The ultrasonic image generation apparatus 100 creates an image representing the puncture needle by specifying the tip position of the puncture needle from the B-mode image, combines it with the B-mode image, and causes the image display unit 124 to display the image.

  In the above, the transmission / reception control unit 102, the image generation unit 104, the puncture needle candidate point extraction unit 106, the candidate point position storage unit 110, the puncture needle region specification unit 112, the puncture needle tip position specification unit 114, the puncture needle image generation unit 116, The image composition unit 118 and the image display control unit 120 may be configured by a central processing unit (CPU) and software (program) for causing the CPU to perform various processes.

  FIG. 2 is a functional block diagram showing a more detailed configuration of the puncture needle region specifying unit 112 and the puncture needle tip position specifying unit 114 shown in FIG.

  The puncture needle region specifying unit 112 includes a puncture needle straight line generation unit 126 and a puncture needle region generation unit 128.

  The puncture needle straight line generation unit 126 performs Hough transform on the puncture needle candidate points distributed in the B-mode image output from the candidate point position storage unit 110, and generates a puncture needle candidate straight line. The puncture needle candidate straight line is a straight line that passes through the most puncture needle candidate points. The puncture needle straight line generation unit 126 outputs the position coordinates of the points on the generated puncture needle candidate straight line to the puncture needle region generation unit 128.

  The puncture needle region generation unit 128 expands the puncture needle candidate straight line generated by the puncture needle straight line generation unit 126 to a predetermined width, and the region included in the puncture needle candidate straight line is a region where the puncture needle exists (puncture needle presence region). As specified. The puncture needle region generation unit 128 outputs the position coordinates of the points included in the specified puncture needle presence region to the puncture needle tip position specifying unit 114.

  The puncture needle tip position specifying unit 114 includes an average luminance calculation unit 130, a maximum luminance specification unit 132, a minimum luminance specification unit 134, and a puncture needle tip position calculation unit 136.

3 (A) to 3 (D) and FIGS. 4 (A) to 4 (B), the ultrasonic image generating apparatus 100 generates a method for obtaining the tip position of the puncture needle from the B-mode image and an image representing the puncture needle. The method will be described in more detail, and the function of each component of the puncture needle tip position specifying unit 114 will also be described.
In FIG. 3A, XY with the upper left corner of the B mode image as the origin, the horizontal axis from the upper left corner to the upper right corner as the X axis, and the vertical axis from the upper left corner to the lower left corner as the Y axis. Consider a case where an image is located in an orthogonal coordinate system. The direction from the upper left end of the B mode image to the upper right end is the positive direction of the X axis, and the direction from the upper left end of the B mode image to the lower left end of the B mode image is the positive direction of the Y axis. Hereinafter, unless otherwise specified, the definition of the XY orthogonal coordinate system for images is the same.

  FIG. 3A shows a B-mode image of a subject including a puncture needle. The puncture needle in FIG. 3 (A) is displayed in an intermittent manner, and it is difficult for the user to know the exact position of the puncture needle. Therefore, the ultrasonic image generating apparatus 100 first identifies an area where the puncture needle is likely to exist from the B-mode image as shown in FIG. 3A, and the linear intensity including the puncture needle in the area. The tip position of the puncture needle is specified from the distribution. In addition, the ultrasonic image generating apparatus 100 generates an image representing the puncture needle based on the tip position of the puncture needle and displays it on the image display unit 124 together with the B-mode image. That is, the ultrasonic image generating apparatus 100 displays the image of the puncture needle generated by specifying the position of the puncture needle together with the B-mode image in which the puncture needle is difficult for the user to see, so that the accurate position of the puncture needle can be determined. Let me grasp.

  The puncture needle candidate point extraction unit 106 applies an edge extraction filter (weighted addition filter) according to the puncture angle of the puncture needle to the B-mode image shown in FIG. Improve the image connection in the angular direction. The puncture needle candidate point extraction unit 106 performs layer structure removal processing such as CFAR processing, and removes bright lines extending in the X-axis direction at the bottom of the drawing. Further, the puncture needle candidate point extraction unit 106 performs threshold processing on the B-mode image to which the edge extraction filter is applied, and an edge image (only a feature point (puncture needle candidate point) having a luminance equal to or higher than the threshold remains white. (See FIG. 3B). The puncture needle straight line generation unit 126 obtains the position of the puncture needle candidate straight line from the distribution of puncture needle candidate points in the edge image.

  In the edge image shown in FIG. 3B, a plurality of puncture needle candidate points displayed with high brightness in the B-mode image are distributed. Each puncture needle candidate point distributed in the edge image is a point derived mainly from the puncture needle that appears at the position where the puncture needle exists, and appears on the entire screen regardless of the position where the puncture needle exists. Is a point derived from other than the puncture needle such as tissue. The puncture needle candidate point derived from the tissue or the like becomes noise when the position of the puncture needle is specified based on the edge image. Therefore, the puncture needle straight line generation unit 126 performs Hough transform on the edge image including noise as shown in FIG. 3B, and the puncture needle candidate straight line that passes the most puncture needle candidate points derived from the puncture needle. Is generated. Even if the edge image contains noise, the puncture needle candidate points derived from the puncture needle have a linear connection, so a straight line along the linear connection by the puncture needle candidate point derived from the puncture needle is generated by the Hough transform. it can. An image obtained by superimposing the generated puncture needle candidate straight line 138 on the edge image data is shown in FIG. A puncture needle candidate straight line 138 in FIG. 3C represents the puncture needle and an extension line of the puncture needle.

  The puncture needle candidate straight line 138 representing the puncture needle and the extension of the puncture needle has an unknown boundary between the puncture needle and the portion that is not the puncture needle, so the boundary between the puncture needle and the portion that is not the puncture needle The position, that is, the tip position of the puncture needle is obtained. FIG. 3D shows an edge image in which the puncture needle candidate straight line 138 generated by the Hough transform is expanded to a predetermined width by the puncture needle region generation unit 128 and the region 140 is superimposed and displayed. Region 140 is a region including puncture needle candidate straight line 138. The puncture needle region generation unit 128 identifies the region 140 as a puncture needle presence region where a puncture needle is present. Since the puncture needle candidate straight line 138 extracted by the Hough transform is a straight line that passes through many puncture needle candidate points derived from the puncture needle, an area including the many puncture needle candidate points is specified as the puncture needle existence area 140. The ultrasonic image generating apparatus 100 creates the area 140 in this way, and narrows down the area where the puncture needle is highly likely to exist. Here, the predetermined width for expanding the puncture needle candidate straight line 138 may be the thickness of the puncture needle read from the puncture needle information storage unit 108, or may be set by the user while viewing the B-mode image or the edge image. good.

  Next, the average luminance calculation unit 130 of the puncture needle tip position specifying unit 114 rotates the edge image shown in FIG. 3D until the longitudinal direction of the region 140 becomes horizontal, and the longitudinal direction of the region 140 is changed to the X ′ axis. The X′Y ′ orthogonal coordinate system is defined with the short direction of the region 140 as the Y ′ axis. The average luminance calculation unit 130 performs addition averaging of points arranged in the Y ′ coordinate direction (points having the same X ′ coordinate value) in the region 140. FIG. 4A shows a method for specifying the tip position from the region 140, and therefore, the region 140 in the edge image and a straight line including the puncture needle in the region 140 (the value of the X ′ coordinate in the region 140 is the same). It is the figure which matched and drawn the graph which shows distribution of the average brightness | luminance of the area | region 140) which became one-dimensional as a result of carrying out the addition average of the point. The graph shown in FIG. 4A is a graph showing an average luminance distribution viewed from the scanning direction (X ′ direction) in the region 140 with the horizontal axis as the position on the X ′ coordinate and the vertical axis as the average luminance. The maximum brightness specifying unit 132 and the minimum brightness specifying unit 134 obtain the maximum value and the minimum value of the average brightness based on the graph shown in FIG. Note that the graph shown in FIG. 4A is simplified for easy understanding.

  The puncture needle tip position calculation unit 136 moves from the maximum value side of the X ′ coordinate to the origin side with respect to the graph representing the relationship between the position on the X ′ coordinate and the average luminance in the region 140 shown in FIG. The value of the average luminance is examined toward the tip, and the tip position of the puncture needle is specified. Specifically, the puncture needle tip position calculation unit 136 first increases the average brightness, which indicates a value near the minimum value because there is no puncture needle, greatly increasing the difference between the maximum value and the minimum value. A point 142 having a relatively high luminance is specified as the tip position of the puncture needle. Here, the reason for examining from the maximum value side of the X ′ coordinate is that a significant change in luminance can be specified as the tip position of the puncture needle by examining from the side where the puncture needle is expected not to exist. . When examined from the origin side, there is a possibility that the average luminance shows a value near the minimum value at a position where the puncture needle is interrupted, and then the point where the puncture needle is detected is identified as the tip. Here, 80% of the difference between the maximum value and the minimum value is empirically desirable as the point at which the tip of the puncture needle can be substantially specified. It may not be 80%. However, if a point that is very close to the minimum value side of the average brightness is set, noise may be set as the tip position. Therefore, a point that is 50% or more of the difference between the maximum value and the minimum value of the average brightness is desirable.

  Within the area 140, the average luminance of the area where no puncture needle is present is approximately zero. Therefore, when the average luminance value is examined from the maximum value side of the X ′ coordinate where there is no puncture needle toward the 0 side, the value near 0 continues for a while. When entering the region where the puncture needle is present from the region where the puncture needle is not present, the average luminance increases rapidly. This is because the puncture needle is detected with high brightness. The puncture needle tip position calculation unit 136 identifies the point 142 that is the tip position of the puncture needle based on such a change in average luminance due to the presence or absence of the puncture needle. The puncture needle tip position calculation unit 136 that identifies the point 142 that is the tip position of the puncture needle converts the X′Y ′ orthogonal coordinate system to the XY orthogonal coordinate system, and obtains the X coordinate and Y coordinate of the point 142.

  The puncture needle image generation unit 116 generates a straight line representing the puncture needle based on the puncture needle candidate straight line 138 and the tip position 142 of the puncture needle. Specifically, the puncture needle candidate straight line 138 is punctured as a line segment from the position of the X coordinate 0 to the point 144 on the puncture needle candidate straight line 138 having the same X coordinate as the X coordinate of the tip position 142 of the puncture needle. A line segment 148 that is a straight line representing the needle is generated. FIG. 4B is a schematic diagram depicting a line segment 148 generated by the puncture needle image generation unit 116. A point 146 in FIG. 4B is a point where the puncture needle candidate straight line 138 intersects the left side of the edge image.

  The ultrasonic image generating apparatus 100 repeats detection of the tip position of the puncture needle and generation of an image representing the puncture needle at predetermined time intervals, and displays an image representing the most recently generated puncture needle on the image display unit 124. The ultrasonic image generation device 100 specifies the tip position of the puncture needle, and displays the generated puncture needle image (an image representing the puncture needle) on the B-mode image so that the position of the puncture needle is easily understood by the user. can do.

Below, with reference to FIG. 5, the effect | action of the ultrasonic image generation apparatus of this invention and the operating method of the ultrasonic image generation apparatus of this invention are demonstrated.
FIG. 5 is a flowchart showing a flow of a series of processes related to the operation of superimposing and displaying the puncture needle image in the ultrasonic image generating apparatus 100 that implements the operating method of the ultrasonic image generating apparatus of the present invention. After acquisition of the ultrasound image, in step ST400, the user sets a time interval for detecting a puncture needle candidate point. In step ST402, puncture needle candidate point extraction unit 106 extracts puncture needle candidate points, and in step ST404, coordinates of puncture needle candidate points are stored in candidate point position storage unit 110. In step ST406, the puncture needle region specifying unit 112 specifies a puncture needle candidate straight line representing the puncture needle and an extension line of the puncture needle based on the distribution of puncture needle candidate points. In step ST408, the puncture needle tip position specifying unit 114 performs puncture. The tip position of the needle is specified. In step ST410, the puncture needle image generation unit 116 generates an image representing the puncture needle, in step ST412, the image composition unit 118 performs composition of the B mode image and the image representing the puncture needle, and the image display control unit 120 performs the B mode. The image display unit 124 is caused to superimpose an image and an image representing the puncture needle.

  In step ST414, the user is asked whether to change the superimposed display method. If Yes, the process returns to step ST410, and the image representing the puncture needle whose superimposed display method is changed and the B-mode image are superimposed and displayed. If the superimposed display method is not changed in step ST414, the process proceeds to step ST416. In step ST416, the user is asked whether to change the time interval for extracting puncture needle candidate points. If Yes, the process returns to step ST400, and a new extraction time interval is set to extract puncture needle candidate points. If the change of the time interval for extracting the puncture needle candidate point is No in step ST416, the process proceeds to step ST418. In step ST418, the user is asked whether to continue processing for the next frame. If Yes, the process returns to step ST400. If NO in step ST418, the process ends.

  FIG. 6 is a flowchart illustrating the operation of step ST402 in more detail. In step ST500, the user is asked whether to set a predicted insertion area (area estimated to be inserted with a puncture needle). If yes, the process proceeds to step ST502 to set the predicted insertion area, and to step ST504. move on. If the predicted insertion area is not set in step ST500, the process proceeds to step ST504. In step ST504, the user is asked whether to improve the image quality of an area that the user wants to see in detail (hereinafter referred to as an attention area). If yes, the process proceeds to step ST506, where the user sets the attention area, and in step ST508 Processing for improving the image quality of the attention area is performed, and the process proceeds to step ST510. If it is determined in step ST504 that the region of interest is not subjected to high image quality processing, the process proceeds to step ST510. An edge extraction filter is applied in step ST510, and threshold processing is performed in step ST512. A puncture needle candidate point is extracted from the edge image subjected to the threshold processing in step ST514, and the process proceeds to step ST402.

  The setting of the predicted insertion area in step ST502 will be described with reference to FIGS. 7A to 7D, the left upper end of the image is the origin, the horizontal axis from the upper left end to the upper right end is the X axis, and the vertical axis from the upper left end to the lower left end is the Y axis. Consider the case where the B-mode image 151 is located in the XY orthogonal coordinate system. In FIG. 7A, a broken line 150 represents a puncture guideline. The puncture needle candidate point extraction unit 106 sets a predicted puncture region based on the puncture guideline 150. When the puncture adapter is attached to the probe, the puncture guideline is determined to some extent by the puncture adapter, so that the puncture guideline can be displayed.

  In the present embodiment, the user can select the predicted insertion area from three areas. The shape of the predicted insertion region is a shape that is widened in the Y-axis direction with reference to the puncture guideline. For example, when puncturing a shallow part such as breast cancer, a narrow region (a region having a width of the puncture guideline), an average region (a region expanded by +0.5 cm in the vertical direction around the puncture guideline) , And a wide region (a region widened by +1 cm vertically in the Y-axis direction with the puncture guideline as the center). A plurality of pieces of straight line information that is separated from the puncture guideline by a predetermined distance is stored in the upper and lower directions in the Y axis direction of the puncture guideline, and a predicted insertion region is generated using an image region sandwiched between the plurality of straight lines as a predicted insertion region. Since the puncture needle is more likely to be displaced with respect to the puncture guideline and the amount of deviation increases as the puncture is performed on the deeper portion, the area of the predicted puncture region may be increased. For example, in the wide area, it is assumed that the area is widened by 1.5 cm up and down around the puncture guideline.

  FIG. 7B shows a case where the predicted insertion area is set to a narrow range. In FIG. 7B, a region 152 represents a predicted insertion region.

  FIG. 7C shows the case where the predicted insertion area is set to the average range. In FIG. 7C, a region 154 represents a predicted insertion region. The region 154 is a region wider than the region 152.

  FIG. 7D shows a case where the predicted insertion area is set in a wide range. In FIG. 7D, an area 156 represents a predicted insertion area. The region 156 is a region wider than the region 154.

  When a predicted insertion area is set, puncture needle candidate point extraction unit 106 performs threshold processing only on the predicted insertion area and extracts puncture needle candidate points from the predicted insertion area. When the puncture needle candidate points are extracted only from the predicted puncture area, the puncture needle candidate points derived from the tissue or the like are reduced in the edge image generated from the predicted puncture area, and the puncture needle derived points for all puncture needle candidate points are derived. Since the ratio of puncture needle candidate points increases, a puncture needle candidate straight line can be generated with higher accuracy.

  The setting of the attention area to be improved in image quality described in step ST506 will be described with reference to FIG. The user looks at the B-mode image 162 and confirms the position of the puncture needle 158 to set a region of interest. Specifically, the user visually confirms the position of the puncture needle 158 and sets an area including the entire puncture needle 158 as the attention area 160. In FIG. 8, the puncture needle 158 is drawn without interruption for easy understanding. Here, the user sets the attention area, but the user does not necessarily need to do it. For example, the ultrasonic image generating apparatus 100 may automatically set an area including all the images representing the puncture needle generated by the puncture needle image generation unit 116 as an attention area.

  The transmission / reception control unit 102 performs an image quality enhancement process on the attention area. More specifically, the probe 122 performs the sound ray increasing process for the attention area, and performs the image quality enhancement process in which the attention area has a higher image quality than the area other than the attention area. The sound ray increasing process is a process of acquiring an echo signal more finely by narrowing a distance interval for irradiating ultrasonic waves. A high-definition image can be obtained in the region subjected to the sound ray increasing process. Although the sound ray increasing process is performed on the attention area here, the image quality enhancement process of the attention area is not limited to the sound ray increasing process. For example, steer beam processing (processing to increase the echo reflected by the puncture needle by irradiating ultrasonic waves in a direction perpendicular to the long axis direction of the puncture needle), frequency compound processing (transmission and reception signals) A process of reducing speckle noise by forming a plurality of images by dividing the bandwidth into several bands to form a plurality of images and averaging the images may be performed.

  By setting the attention area in advance and extracting the puncture needle candidate points from the attention area on which the image quality enhancement processing has been performed, the Hough transformation can be performed using the puncture needle candidate points with reduced noise. The accuracy of specifying the position of the needle is improved. For example, if frequency compounding is performed, speckle noise can be reduced. Therefore, when threshold processing is performed, the ratio of puncture needle candidate points derived from the puncture needle increases. In FIG. 8, for ease of explanation, the frame line of the attention area 160 and the frame line of the B-mode image 162 are drawn so as not to overlap, but the attention area 160 is outside the B-mode image 162. It goes without saying that it does not include it.

  A modification of the method for displaying the B-mode image and the puncture needle image in a superimposed manner will be described with reference to FIGS. 9A to 9D show different display methods for the puncture needle superimposed on the B-mode image. The user can select a desired display method from the display methods of the image representing the puncture needle shown in FIGS. In this modification, a straight line, a line segment, or a point representing a puncture needle superimposed and displayed on the B-mode image is colored in a predetermined color, for example, green. In (D), a colored straight line, line segment, or point representing a puncture needle superimposed on the B-mode image is indicated by a black line, a black line segment, or a black dot.

  FIG. 9A shows a puncture needle with a line segment having saturation (indicated by a dark black line segment in FIG. 9A), unlike the gray scale used for the B-mode image. It is the figure superimposed and displayed on the image. When displayed in this way, a straight line representing the puncture needle can be displayed in a mode clearly different from the B-mode image, and the position of the puncture needle can be easily informed to the user.

  FIG. 9 (B) is a transmission process performed on the straight line representing the puncture needle in FIG. 9 (A) and is displayed in a semi-transparent manner (indicated by a thin black line in FIG. 9 (B)). For example, the transmission ratio is set to 50% for display. Thus, when the puncture needle is made translucent and displayed on the B-mode image, the B-mode image is not hidden by the straight line representing the puncture needle, so that the user can see both the puncture needle and the B-mode image.

  In FIG. 9C, the image representing the puncture needle is not made a straight line, but the puncture needle candidate point is displayed in a color different from the B-mode image and superimposed on the B-mode image (in FIG. 9C, a thin black dot is displayed). Is shown). The puncture needle candidate points displayed in a superimposed manner are only puncture needle candidate points having an X coordinate equal to or less than the X coordinate of the point 144 that is the position of the straight tip representing the puncture needle among the puncture needle candidate points existing in the puncture needle presence region. It is. In this way, when the puncture needle is not represented by a straight line but only the puncture needle candidate point is colored and superimposed on the B-mode image, the straight line does not impair the rendering of the B-mode image.

  FIG. 9D shows an image representing a puncture needle by fitting an outline representing the shape of the puncture needle to a straight line representing the puncture needle (shown by a dark black line in FIG. 9C). Is. Thus, when the outline representing the shape of the puncture needle is superimposed on the B-mode image, the user can intuitively grasp the shape of the needle. If the thickness or shape of the puncture needle is known as the puncture needle information stored in the puncture needle information storage unit 108, the contour of the puncture needle may be a contour having that thickness or shape. It may be set by the user.

  As described above, according to the ultrasonic image generating apparatus 100 according to Embodiment 1 of the present invention, the puncture needle candidate points are extracted from the B-mode image, and the Hough transform is performed, whereby the puncture needle and the puncture needle. A puncture needle candidate straight line representing an extension line can be specified. Furthermore, the ultrasonic image generating apparatus 100 identifies the region including the identified puncture needle candidate straight line as the puncture needle presence region, and identifies the tip position of the puncture needle based on the luminance information in the puncture needle presence region, The tip position of the puncture needle in the B-mode image can be specified. In addition, the ultrasonic image generating apparatus 100 displays the exact position of the puncture needle in an easy-to-understand manner for the user by superimposing and displaying the image representing the puncture needle and the B-mode image based on the specified position of the puncture needle. can do.

  In the present embodiment, the position of the puncture guideline is determined based on the puncture adapter in setting the predicted puncture area. However, in the present invention, the puncture adapter does not necessarily have to be used. For example, a user may create a puncture guideline by himself or create a puncture guideline by obtaining an angle or a position at which the puncture needle is inserted into a subject by taking a frame difference of an ultrasonic image. good. In this case, the predicted insertion area is determined along the newly created puncture guideline. In addition, a storage unit that stores the tip position of the past puncture needle is provided to store the tip position and detection timing of the past puncture needle, and a predicted insertion area is set based on the tip position and detection timing of the past puncture needle You may do it. Further, not only the tip position of the puncture needle but also an image representing the puncture needle may be stored.

FIGS. 10A and 10B are diagrams showing a method of determining a predicted insertion region using a plurality of tip positions of past puncture needles. Also in FIG. 10, XY orthogonal coordinates with the upper left corner of the image as the origin, the horizontal axis from the upper left corner to the upper right corner of the image as the X axis, and the vertical axis from the upper left corner to the lower left corner as the Y axis. Consider the case where an image is located in the system. The direction from the upper left corner of the image to the upper right corner is the positive direction of the X axis, and the direction from the upper left corner of the image to the lower left corner is the positive direction of the Y axis.
In FIG. 10A, consider a case where there are a plurality of points 174, 176, and 178 representing the past tip position of the puncture needle in the B-mode image 172. Here, the point 174 is the tip position of the puncture needle identified most recently. Point 176 is the tip position of the puncture needle detected next to point 174, and point 178 is the tip position of the newest puncture needle. Since the point 174, the point 176, and the point 178 are arranged on the straight line 182a, the tip position of the next puncture needle is predicted to be on the broken line 182b that is an extension of the straight line passing through the three points. .

  Therefore, an area 180 including a broken line 182b and having a size set in consideration of the bending width of the puncture needle is determined as a predicted insertion area below the point 178 having the largest Y coordinate in FIG. . Here, the shape of the region 180 is a parallelogram shape in which the broken line 182b is expanded in the X-axis direction. The distance interval between the points 178 and 181 where the broken line 182b touches the upper side and the lower side of the region 180 (the difference between the y coordinates of the point 178 and the point 181) is the distance interval between the tip positions of the past puncture needles (for example, the point 176 and the point 181 2 to 3 times the distance interval with 178). Here, the reason for determining the size of the region 180 based on the distance interval (position) of the tip position of the past puncture needle is that the speed and angle at which the puncture needle has been inserted in the past are confirmed, and the puncture needle This is to estimate the direction of travel. If the speed and angle at which the puncture needle has been inserted in the past are confirmed, the puncture needle is inserted at a speed and angle that is not significantly different from the past at the next tip position detection timing (ie, the previous tip position). Therefore, the traveling direction of the puncture needle can be estimated. Here, a slight margin is given to make the distance interval of the tip position of the past puncture needle 2 to 3 times, but it is not necessarily 2 to 3 times.

  The puncture needle candidate point extraction unit 106 extracts puncture needle candidate points in the region 180. Thus, when the predicted puncture area is determined using a plurality of tip positions of past puncture needles, the size of the predicted puncture area can be further reduced, and the puncture needle derived from the puncture needle in the predicted puncture area Since the ratio of candidate points can be further increased, a puncture needle candidate straight line can be generated with high accuracy. The shape of the region 180 is not limited to a parallelogram, and may be, for example, a trapezoidal shape that expands in the X coordinate direction as the Y coordinate decreases.

  FIG. 10B is a diagram showing a method for determining a predicted insertion area when the tip position of the puncture needle is detected at the next timing of FIG. FIG. 10B is a diagram in which a point 184 representing the latest tip position of the puncture needle is added to the B-mode image 190 with respect to FIG. Also in this case, the region 186 including the broken line 188b that is an extension of the straight line 188a passing through the points 174, 176, 178, and 184 is set as the predicted insertion region. Thus, even if the stored tip positions of past puncture needles increase, the predicted insertion area can be set based on those positions. In addition, even when the puncture needle is deflected due to the presence of hard tissue or the probe is displaced, the puncture needle candidate straight line can be detected with high accuracy even when the puncture needle is displaced from the initial predicted puncture area during puncture.

  In FIGS. 10A and 10B, the case where a plurality of tip positions of past puncture needles are aligned is described as an example. However, a plurality of tip positions of past puncture needles are not necessarily aligned. There is no need to line up. For example, a plurality of tip positions of past puncture needles may be connected like a line graph, and the next predicted insertion area may be set based on the slope of a straight line connecting the two most recent points. Alternatively, the prediction area may be set by obtaining the slope of a straight line by performing the least square method or the like.

  Further, the width of the predicted insertion area may be determined in advance according to the deviation width of the puncture needle with respect to the puncture guideline, or the width prepared in advance may be adjustable. Even during acquisition of an ultrasound image, the width of the predicted insertion area may be adjustable. In that case, it is desirable to assign a function for adjusting the width of the predicted insertion area to a function key or the like of the main body.

  Moreover, in this Embodiment, although the setting of the width | variety of a prediction insertion area | region was three steps, it is not necessarily restricted to three steps. If it can be set more finely, the user can set a range that suits his / her wishes.

  In this embodiment, when a predicted insertion area is set, threshold processing is performed on the predicted insertion area. However, threshold processing is performed on the entire image and the prediction insertion area is within the predicted insertion area. It is good also as an aspect which performs Hough conversion using only a puncture needle candidate point. In this manner, the Hough transform operation is facilitated.

  In the present embodiment, the puncture needle candidate straight line generated by the puncture needle straight line generation unit 126 is expanded to a predetermined width, and the region on the puncture needle candidate straight line is defined as the puncture needle presence region. The method of obtaining is not limited to this method, and the user may manually determine a region including the puncture needle candidate straight line. For example, it can also be determined as shown in FIGS.

  FIG. 11A shows a case where there is a puncture needle candidate straight line 194 in the B-mode image 192 and the puncture needle presence area 196 is created by widening the width of the puncture needle candidate straight line 194. Also in FIG. 11, the upper left corner of the B-mode image 192 is the origin, the horizontal axis from the upper left corner to the upper right corner is the X axis, and the vertical axis from the upper left corner to the lower left corner is the Y axis. Consider a case where the B-mode image 192 is located in the XY orthogonal coordinate system. The direction from the upper left end of the B mode image 192 to the upper right end is defined as the positive direction of the X axis, and the direction from the upper left end of the edge image to the lower left end of the edge image is defined as the positive direction of the Y axis. FIG. 11B shows a case where the user creates the puncture needle presence region 198 by moving the puncture needle presence region 196 in the direction in which the Y coordinate decreases based on FIG. 11A. FIG. 11C shows a case where the user creates the puncture needle presence area 200 by moving the puncture needle presence area 196 in the direction in which the Y coordinate increases based on FIG. 11A. FIG. 11D shows a case where the user has created a puncture needle presence area 202 having a different inclination from the puncture needle candidate straight line 194. FIG. In this way, the puncture needle presence region may be adjustable by the user. If the puncture needle presence area can be adjusted by the user, the user can manually set an area including many puncture needle candidate points that are considered to represent the puncture needle as the puncture needle presence area while viewing the edge image. . The accuracy of detecting the tip position of the puncture needle can be improved by obtaining the average luminance for the puncture needle presence region set by the user and detecting the tip position of the puncture needle.

  In the present embodiment, the direction for examining the change in average luminance is determined based on a graph representing the relationship between the position on the X ′ coordinate and the average luminance, but puncture is generally attached to the probe. Since the puncture is often performed from the direction in which the probe mark (mark indicating the scanning direction) is present, the region of interest may be set to the one having the probe mark.

  In this embodiment, the attention area is set by specifying the tip position of the puncture needle. However, it is not always necessary to specify the tip position of the puncture needle and set the attention area. For example, the user may visually confirm the position of the puncture needle in the B-mode image, and the user may set the area including the puncture needle as the attention area.

  In the present embodiment, a straight line representing a puncture needle using a puncture needle candidate straight line 138 and a point 144 on the puncture needle candidate straight line 138 having the same X coordinate as the point 142 specified as the tip position of the puncture needle. Although generated, the straight line representing the puncture needle is not necessarily generated in this way. For example, the point 142 that is the tip position of the puncture needle may be set as the end point, the start point may be determined by the user, and a line segment may be generated from the start point and the end point.

  In the present embodiment, four variations of the display method for displaying the image representing the puncture needle superimposed on the B-mode image are shown, but the display method is not limited to these. For example, a straight line representing a puncture needle and a puncture needle candidate point may be displayed at the same time, or the puncture needle candidate point may be displayed after being subjected to a transmission process. Further, the color of the straight line representing the puncture needle need not be a uniform color. For example, it may be displayed in gradation or may be expressed in two colors.

  Further, it is desirable that the thickness of the straight line representing the puncture needle can be selected by the user. For example, it may be possible to select from preset thicknesses such as thin, average, and thick, or the user may input the thickness by himself / herself. When the thickness of the used puncture needle is known, a straight line may be displayed with the same thickness as the thickness of the puncture needle.

  In addition, it is desirable that the user can set the transmission rate for the transmission processing of the straight line representing the puncture needle. For example, a function is assigned to an input button prepared on a control panel or the like so that the user can freely set the transmission ratio.

  Further, the luminance of the straight line representing the puncture needle may be determined by automatic calculation by the ultrasonic image generating apparatus. For example, the maximum luminance in the B-mode image before threshold processing is used, normalized by a gradation value (for example, 100), and added to the luminance representing the B-mode image.

  Further, the luminance of the image representing the puncture needle may be automatically set by the ultrasonic image generating apparatus. For example, the brightness of the image representing the puncture needle can be automatically set using the average value of several pixels around the B-mode image on which the image representing the puncture needle is superimposed and displayed.

  Further, it is preferable that the user can set a predetermined time interval for detecting the tip position of the puncture needle and generating an image representing the puncture needle. For example, it is selected from fine (1 second interval), normal (2 second interval), coarse (3 second interval), and the like. These time intervals may be set in advance by system settings, or functions may be assigned to buttons prepared on a control panel or the like. Since the speed at which the puncture needle is inserted into the subject varies depending on the user, detection of the tip position of the puncture needle and generation of an image representing the puncture needle are performed at time intervals that match the speed at which the puncture needle is inserted. The user can set it. When the user sets a desired time interval so that the tip position of the puncture needle is detected and an image representing the puncture needle is generated at a time interval that matches the speed at which the puncture needle is inserted, the position of the puncture needle does not change much. Sometimes the detection of the tip position of the puncture needle is reduced, and the processing load on the apparatus can be reduced.

  In the present embodiment, threshold processing or the like is performed on the B-mode image in which the echo signal is represented by luminance information to identify the tip position of the puncture needle, but threshold processing or the like is not necessarily performed on the B-mode image. There is no need.

  Each configuration in the present embodiment is mainly configured by a central processing unit (CPU) and software for causing the CPU to perform various processes. However, these may be configured by a digital circuit or an analog circuit. . The software is stored in an internal memory (not shown).

In addition, the algorithm of the operation method of the ultrasonic image generation apparatus according to the present invention is described in a programming language, compiled as necessary, and the ultrasonic image generation method program is stored in a memory (recording medium) to store other apparatus If executed by the information processing means, the same function as the ultrasonic diagnostic apparatus according to the present invention can be realized. That is, a program for causing a computer (CPU) to execute the operation method of the ultrasonic image generation apparatus of the present invention or a recording medium recording the program are included in the embodiments of the present invention. Needless to say.

The embodiment according to the present invention described above shows an example of the present invention and does not limit the configuration of the present invention. The ultrasonic image generation apparatus and the operation method of the ultrasonic image generation apparatus according to the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the object of the present invention.

The ultrasonic image generation apparatus and the operation method of the ultrasonic image generation apparatus according to the present invention can be used when acquiring a tomographic image of a subject into which a puncture device is inserted using ultrasonic waves.

DESCRIPTION OF SYMBOLS 100 Ultrasonic image generation apparatus 104 Image generation part 106 Puncture needle candidate point extraction part 110 Candidate point position memory | storage part 112 Puncture needle area | region specification part 114 Puncture needle tip position specification part 116 Puncture needle image generation part 126 Puncture needle straight line generation part 130 Average Luminance calculator 136 Puncture needle tip position calculator

Claims (22)

An ultrasonic wave is irradiated from a probe to a subject into which a puncture device is inserted, and echoes reflected from the subject and the puncture device are received by the probe and output from the probe. An ultrasonic image generation device that generates an ultrasonic image from an echo signal,
Candidate point extracting means for extracting candidate points for the puncture device based on the ultrasound image;
A puncture device existing region specifying unit for specifying a puncture device existing region where the puncture device may be present in the ultrasonic image from the distribution of a plurality of candidate points extracted by the candidate point extracting unit;
Puncture device tip position specifying means for specifying the tip position of the puncture device based on a linear intensity distribution including the puncture device in the puncture device presence region specified by the puncture device presence region specifying means; ,
The puncture device tip position specifying means,
The puncture the in instrument existing region based on the maximum and minimum values of the straight line intensity distribution, including puncture device, an ultrasonic image generating apparatus characterized that you identify the position of the tip of the puncture device. Further, a puncture device image generating means for generating a puncture device image representing the puncture device based on the tip position of the puncture device specified by the puncture device tip position specifying means;
Image synthesis means for superimposing and displaying the puncture instrument image generated by the puncture instrument image generation means on the ultrasonic image;
The ultrasonic image generating apparatus according to claim 1, comprising: The puncture device presence area specifying means includes
A puncture device candidate straight line is generated from a plurality of candidate points extracted by the candidate point extraction means, and a region including the puncture device candidate straight line is specified as the puncture device existence region,
The puncture device image generation means includes
The ultrasonic image generating apparatus according to claim 2, wherein the puncture device image is generated from a tip position of the puncture device and the puncture device candidate straight line. Furthermore, a puncture device information storage means for storing information of the puncture device is provided,
The ultrasonic wave according to claim 2 or 3, wherein the puncture device image generation means determines the shape of the puncture device image using information related to the puncture device stored in the puncture device information storage means. Image generation device. The intensity distribution on the straight line including the puncture device in the puncture device existing area is a distribution of average luminance on the straight line including the puncture instrument in the puncture instrument existing area,
In the graph showing the relationship between the longitudinal position of the puncture device presence area and the average brightness, the puncture device presence area specifying means has an average brightness that indicates a value near the minimum value because the puncture needle is not present. The point at which the brightness is increased to 80% for the first time with respect to the difference between the maximum value and the minimum value is specified as the tip position of the puncture needle. Ultrasound image generation device. The puncture device presence area specifying means includes
The ultrasonic image according to any one of claims 1 to 5, wherein a puncture device candidate straight line is generated by performing a Hough transform on a plurality of candidate points extracted by the candidate point extraction means. Generator. The candidate point extracting means includes:
The ultrasonic image generation apparatus according to claim 1, wherein a candidate point of the puncture device is extracted by performing threshold processing on the ultrasonic image. Furthermore, it comprises a predicted insertion area setting means for setting a predicted insertion area where the puncture device is likely to be inserted in the ultrasonic image,
The ultrasound image according to any one of claims 1 to 7, wherein the candidate point extracting unit extracts candidate points of the puncture device from the region set by the predicted insertion region setting unit. Generator. Furthermore, it comprises a predicted insertion area setting means for setting a predicted insertion area where the puncture device is likely to be inserted in the ultrasonic image,
The puncture device presence area specifying means includes the candidate points included in the predicted insertion area set by the predicted insertion area setting means among the candidate points of the puncture apparatus extracted by the candidate point extraction means. The ultrasonic image generating apparatus according to claim 1, wherein the puncture device existing area is specified.   The ultrasound image according to claim 8 or 9, wherein the predicted insertion region setting means sets the predicted insertion region based on an angle and / or position at which the puncture device is inserted into the subject. Generator. Furthermore, a tip position storage means for storing a plurality of tip positions in the past of the puncture device specified by the puncture device tip position specifying means,
The predicted insertion area setting means includes
Advancing direction of the puncture device is estimated from a plurality of tip positions of the puncture device stored by the tip position storage means, and a region in the traveling direction of the puncture device is set as the predicted insertion region. The ultrasonic image generating apparatus according to claim 8. Furthermore, attention area setting means for setting an attention area where the puncture device exists;
Image quality enhancement processing means for performing image quality enhancement processing on the area of interest set by the area of interest setting means for areas other than the area of interest;
An ultrasonic image generating apparatus according to claim 1, comprising: An ultrasonic wave is irradiated from a probe to a subject into which a puncture device is inserted, and echoes reflected from the subject and the puncture device are received by the probe and output from the probe. An ultrasonic image generation device that generates an ultrasonic image from an echo signal,
Candidate point extracting means for extracting candidate points for the puncture device based on the ultrasound image;
A puncture device existing region specifying unit for specifying a puncture device existing region where the puncture device may be present in the ultrasonic image from the distribution of a plurality of candidate points extracted by the candidate point extracting unit;
Puncture device tip position specifying means for specifying the tip position of the puncture device based on a linear intensity distribution including the puncture device in the puncture device presence region specified by the puncture device presence region specifying means;
A predicted insertion area setting means for setting a predicted insertion area where the puncture device is likely to be inserted in the ultrasonic image;
Bei example the tip position storing means for storing a plurality of tip position, the in the past identified the puncture device by said lance tip position specifying means,
The predicted insertion area setting unit estimates a traveling direction of the puncture device from a plurality of distal end positions of the puncture device stored by the distal position storage unit, and predicts an area in the traveling direction of the puncture device Set it as the insertion area,
The candidate point extraction means, the prediction insertion region ultrasonic image generating device for the set region, wherein that you extracted candidate points of the lance by the setting means. Further, a puncture device image generating means for generating a puncture device image representing the puncture device based on the tip position of the puncture device specified by the puncture device tip position specifying means;
  Image synthesis means for superimposing and displaying the puncture instrument image generated by the puncture instrument image generation means on the ultrasonic image;
The ultrasonic image generating apparatus according to claim 13, comprising: The puncture device presence area specifying means includes
  A puncture device candidate straight line is generated from a plurality of candidate points extracted by the candidate point extraction means, and a region including the puncture device candidate straight line is specified as the puncture device existence region,
The puncture device image generation means includes
The ultrasonic image generating apparatus according to claim 14, wherein the puncture device image is generated from a tip position of the puncture device and the puncture device candidate straight line. Furthermore, a puncture device information storage means for storing information of the puncture device is provided,
The ultrasonic wave according to claim 14 or 15, wherein the puncture device image generation means determines the shape of the puncture device image using information related to the puncture device stored in the puncture device information storage means. Image generation device. The puncture device presence area specifying means includes
The ultrasound image according to any one of claims 13 to 16, wherein a puncture device candidate straight line is generated by performing a Hough transform on a plurality of candidate points extracted by the candidate point extraction means. Generator. The candidate point extracting means includes:
The ultrasonic image generating apparatus according to claim 13, wherein a candidate point of the puncture device is extracted by performing threshold processing on the ultrasonic image. 14. The ultrasonic image generating apparatus according to claim 13, wherein the predicted insertion area setting means sets the predicted insertion area based on an angle and / or position where the puncture device is inserted into the subject. . Furthermore, attention area setting means for setting an attention area where the puncture device exists;
Image quality enhancement processing means for performing image quality enhancement processing on the area of interest set by the area of interest setting means for areas other than the area of interest;
An ultrasonic image generating apparatus according to any one of claims 13 to 19. An ultrasonic wave is irradiated from a probe to a subject into which a puncture device is inserted, and echoes reflected from the subject and the puncture device are received by the probe and output from the probe. An operation method of an ultrasonic image generating device for generating an ultrasonic image from an echo signal,
A candidate point extracting step of extracting candidate points of the puncture device based on the ultrasound image;
A puncture device presence region specifying step for specifying a puncture device presence region in which the puncture device may be present in the ultrasonic image from the distribution of a plurality of candidate points extracted in the candidate point extraction step;
The tip position of the puncture device that specifies the tip position of the puncture device based on the maximum value and the minimum value of the intensity distribution on the straight line including the puncture device in the puncture device presence area specified in the puncture device presence area specifying step Specific steps,
A method for operating an ultrasonic image generating apparatus . An ultrasonic wave is irradiated from a probe to a subject into which a puncture device is inserted, and echoes reflected from the subject and the puncture device are received by the probe and output from the probe. An operation method of an ultrasonic image generating device for generating an ultrasonic image from an echo signal,
A candidate point extracting step of extracting candidate points of the puncture device based on the ultrasound image;
A puncture device presence region specifying step for specifying a puncture device presence region in which the puncture device may be present in the ultrasonic image from the distribution of a plurality of candidate points extracted in the candidate point extraction step;
A puncture device tip position specifying step for specifying a tip position of the puncture device based on a linear intensity distribution including the puncture device in the puncture device presence region specified in the puncture device presence region specifying step;
A predicted insertion area setting step for setting a predicted insertion area where the puncture device is likely to be inserted in the ultrasonic image; and
A tip position storing step for storing a plurality of tip positions in the past of the puncture device specified in the puncture device tip position specifying step;
Equipped with a,
The predicted insertion region setting step estimates a traveling direction of the puncture device from a plurality of tip positions of the puncture device stored in the distal position storing step, and predicts a region in the traveling direction of the puncture device Set it as the insertion area,
The method for operating an ultrasonic image generating apparatus, wherein the candidate point extracting step extracts candidate points of the puncture device from the region set in the predicted insertion region setting step .