JP2020062290A - Ultrasonic diagnostic device and program - Google Patents

Abstract

To perform the observation support, operation support and setting support in a case of displaying a real-time tomographic image using a 3D probe.SOLUTION: A transmission/reception control unit 42 controls the electronic scan of an ultrasonic beam in accordance with a composite scan sequence corresponding to a selected support mode. The composite scan sequence includes a plurality of basic scans executed intermittently on a temporal axis and a plurality of auxiliary scans executed intermittently between the basic scans. A tomographic image formation unit 20 forms a real-time tomographic image on the basis of a plurality of pieces of cross-sectional data sequentially acquired by the plurality of basic scans. An observation support image generation unit 30, an operation support image generation unit 34 and a setting support image generation unit 36 generate an observation support image, an operation support image and a setting support image on the basis of the reference data acquired by the plurality of auxiliary scans.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an ultrasonic diagnostic apparatus and a program, and particularly to control of electronic scanning and processing of data obtained by electronic scanning.

  In the field of ultrasonic diagnosis, an ultrasonic probe provided with a two-dimensional vibrating element array (hereinafter referred to as 3D probe) is used. The 3D probe is used when acquiring volume data from a three-dimensional space in a living body by two-dimensional electronic scanning of an ultrasonic beam. It is also used when acquiring cross-section data from an observation cross section in a three-dimensional space.

  For example, in an ultrasonic examination of a fetus in obstetrics, a 3D probe is used to perform measurement on the abdomen, head, and the like of the fetus. At that time, the observation section (scanning surface) of the 3D probe is aligned with the target section (measurement target section) of the fetus. Then, the measurement for determining the distance, the area, etc. is executed on the displayed tomographic image.

  Patent Document 1 discloses an ultrasonic diagnostic apparatus capable of specifying the orientation of a fetus based on volume data acquired from a three-dimensional space in a living body. Specifically, in the ultrasonic diagnostic apparatus, when there is a guide display request from the user, the two-dimensional ultrasonic image at that time is continuously displayed, and in parallel with that, volume data is acquired and The orientation of the fetus is specified based on the volume data. After that, a guide showing the orientation of the identified fetus is displayed.

  Note that Patent Document 2 discloses an ultrasonic diagnostic apparatus that can determine the orientation of the fetus based on a plurality of measurement results for the fetus. Patent Document 3 discloses an ultrasonic diagnostic apparatus capable of searching a target cross section from search volume data.

JP, 2014-124269, A JP, 2005-171476, A JP, 2017-104248, A

  Assuming that the real-time tomographic image as a moving image is continuously displayed using the 3D probe, the user can support the observation of the tissue, the user can operate the 3D probe, or the user can set the scanning condition. Is desired. For example, in obstetrics, when performing measurements on a fetus, it is desirable to support the user so that a plurality of target sections of the fetus can be displayed smoothly and sequentially. It should be noted that none of Patent Documents 1 to 3 describes two-dimensional electronic scanning control based on the continuous display of real-time tomographic images.

  An object of the present invention is to support the user by utilizing the function of the 3D probe when displaying a real-time tomographic image using the 3D probe.

  An ultrasonic diagnostic apparatus according to the present invention includes a 3D probe that forms an ultrasonic beam that is electronically scanned in a three-dimensional space in a living body, a plurality of basic scans that are intermittently performed on a time axis, and an interval between them. And a control unit for controlling electronic scanning of the ultrasonic beam, and a plurality of basic scans sequentially acquired from an observation cross section in the three-dimensional space according to a composite scanning sequence including a plurality of auxiliary scans An image forming unit that forms a real-time tomographic image based on a plurality of cross-sectional data, and reference data that is obtained from all or part of the three-dimensional space by the plurality of auxiliary scans, and is obtained from other than the observation cross-section. A support information generation unit that generates support information provided to the user together with the real-time tomographic image based on reference data including data. And it is characterized in and.

  A program according to the present invention is executed by an ultrasonic diagnostic apparatus, and the program includes a plurality of basic scans intermittently executed on a time axis and a plurality of intermittently executed between them. According to a composite scanning sequence including auxiliary scanning, a function of controlling electronic scanning of an ultrasonic beam in a three-dimensional space, and a plurality of cross-sectional data sequentially acquired from observation cross sections in the three-dimensional space by the plurality of basic scans On the basis of the above, reference data including a function of forming a real-time tomographic image and reference data obtained from the whole or a part of the three-dimensional space by the plurality of auxiliary scans and data obtained from other than the observation cross section. A function of generating support information provided to the user together with the real-time tomographic image based on the above. It is.

  According to the present invention, it becomes possible to provide assistance information to a user when a real-time tomographic image is displayed using a 3D probe.

It is a block diagram which shows the ultrasonic diagnosing device which concerns on embodiment. 3 is a flowchart showing an operation example of the ultrasonic diagnostic apparatus shown in FIG. 1. It is a figure which shows the 1st example of compound scanning. It is a figure which shows the 2nd example of compound scanning. It is a figure which shows a compound scanning sequence. It is a figure which shows the 1st structural example of an observation assistance image generation part. It is a figure which shows the 1st example of an observation assistance image. It is a figure which shows the 2nd example of an observation assistance image. It is a figure which shows the 2nd structural example of an observation assistance image generation part. It is a figure which shows the structural example of an operation assistance image generation part. It is a figure showing the 1st example 3 of the 3rd example of compound scanning. It is a figure which shows the operation assistance images 1 to 3. It is a figure which shows the 4th example of compound scanning. It is a figure which shows a compound scanning sequence. It is a figure which shows the 1st example of a setting assistance image. It is a figure which shows the modification about the 1st example of a setting assistance image. It is a figure which shows the 2nd example of a setting assistance image. It is a figure which shows the modification about the 2nd example of a setting assistance image.

  Hereinafter, embodiments will be described with reference to the drawings.

(1) Outline of Embodiment The ultrasonic diagnostic apparatus according to the embodiment includes a 3D probe, a control unit, an image forming unit, and a support information generating unit. The 3D probe is an ultrasonic probe that forms an ultrasonic beam that is electronically scanned in a three-dimensional space in a living body. The control unit controls the electronic scanning of the ultrasonic beam according to a composite scanning sequence including a plurality of basic scans intermittently executed on the time axis and a plurality of auxiliary scans intermittently executed between them. . The image forming unit forms a real-time tomographic image based on a plurality of cross-sectional data sequentially acquired from an observation cross section in a three-dimensional space by a plurality of basic scans. The support information generation unit, based on reference data including reference data acquired from all or part of the three-dimensional space by a plurality of auxiliary scans and data acquired from other than the observation cross section, a user with a real-time tomographic image to the user. Generate the assistance information provided.

  According to the above configuration, the electronic scanning control based on the composite scanning sequence makes it possible to provide the support information to the user while displaying the real-time tomographic image. Generally, when forming and displaying a real-time tomographic image using a 3D probe, it is not necessary to acquire data from other than the observation cross section. On the other hand, the above-mentioned configuration acquires reference data including data from other than the observation cross section in a time division manner, and uses the reference data for user support.

  The reference data is, for example, volume data, multi-frame data, or the like. Part of the reference data may include data acquired from the observation cross section. The support information is preferably image information. However, the support information may be configured by sound, light, or the like. The real-time tomographic image is a moving image that represents the state and structure of the cross section in the living body in real time. Of course, such a moving image may be saved and the saved moving image may be played back. It is desirable that the support information is provided even during the reproduction. When performing measurement, a display frame selected from a plurality of display frames forming a moving image is normally displayed as a still image.

  In the embodiment, each basic scan forms a plurality of ultrasonic beams with a high beam density, and each auxiliary scan forms a plurality of ultrasonic beams with a low beam density lower than the high beam density. When volume data is acquired in a plurality of auxiliary scans, a low beam density is set for each of the first scanning direction and the second scanning direction.

  In order to secure the image quality of a real-time tomographic image, it is desired to realize a high beam density in a plurality of basic scans, and also to secure a certain frame rate. On the other hand, since the plurality of auxiliary scans are for generating auxiliary support information, the beam density can be reduced in the plurality of auxiliary scans, and the volume rate or It is possible to reduce the frame rate. From such a viewpoint, the above-described configuration sets different scanning conditions for the plurality of basic scans and the plurality of auxiliary scans.

  In the embodiment, the assistance information generation unit includes an orientation determination device that determines the orientation of the target tissue in the three-dimensional space based on the reference data, and an observation assistance image that generates an observation assistance image that represents the orientation of the target tissue as the assistance information. And a generator. Usually, it is difficult to determine the orientation of the target tissue appearing in the tomographic image. For example, when performing a plurality of measurements in stages, it is difficult to determine the direction in which the 3D probe should be moved from the tomographic image. Although it is possible to try moving the 3D probe on a trial basis, for example, in ultrasonic diagnosis for a fetus, the orientation of the fetus itself is different, and the target tissue in the fetus is very small. If the 3D probe is moved randomly, the target tissue may be lost. According to the above configuration, the orientation of the target tissue can be recognized through the observation of the observation support image, and thus it is possible to provide the user with an indication of the direction in which the 3D probe is to be moved. The observation support image directly supports the observation of the ultrasonic image, but indirectly supports the operation of the 3D probe.

  In the embodiment, the support information generation unit assists a calculator that calculates a shift of the observation cross section with respect to the target cross section based on the reference data and a change of the position and orientation of the observation cross section as support information based on the shift of the observation cross section. And an operation support image generator that generates an operation support image. According to this configuration, the operation load of the 3D probe is reduced by observing the operation support image. That is, it becomes possible to easily determine the direction in which the 3D probe should be moved. Other operation support information may be provided together with the generation of the operation support image.

  In the embodiment, the calculator analyzes a plurality of displacement components as the displacement of the observation cross section, and the operation support image generator generates a plurality of component-based operation support images corresponding to the plurality of displacement components as the operation support image. A plurality of component-based operation support images may be displayed in stages, or a plurality of component-based operation support images may be displayed simultaneously.

  In the embodiment, the operation support image generation unit includes an orthogonal image generator that generates an orthogonal image having an orthogonal relationship with the observation cross section based on the reference data, and a range marker that represents the orthogonal image and the ultrasonic beam scanning range as the support information. And a setting assistance image generator that generates a setting assistance image including and. According to this configuration, the scanning range can be confirmed by referring to the range marker with information that does not appear in the real-time tomographic image as the background.

  In the embodiment, the support information generation unit determines the orientation of the target tissue in the three-dimensional space based on the first reference data as the reference data, and as one of the support information, the observation support that represents the orientation of the target tissue. The displacement of the observation cross section is calculated based on the means for generating an image and the second reference data as the reference data, and the position and orientation of the observation cross section is changed based on the displacement of the observation cross section as one of the support information. An orthogonal image having an orthogonal relationship with the observation cross section is generated based on the means for generating an operation assistance image for assisting and the third reference data as the reference data, and the orthogonal image and the ultrasonic beam scanning are used as one of the assistance information. A means for generating a setting assistance image including a range marker representing a range, and a means for selectively displaying the observation assistance image, the scanning assistance image and the setting assistance image are included.

  The operation method of the ultrasonic diagnostic apparatus according to the embodiment, according to a composite scanning sequence including a plurality of basic scans that are intermittently performed on the time axis and a plurality of auxiliary scans that are intermittently performed between them, A step of controlling electronic scanning of the ultrasonic beam in the three-dimensional space, and a step of forming a real-time tomographic image based on a plurality of cross-sectional data sequentially acquired from observation cross sections in the three-dimensional space by a plurality of basic scans; , Support information provided to the user together with the real-time tomographic image based on reference data including reference data acquired from all or part of the three-dimensional space by a plurality of auxiliary scans and data other than the observation cross section And a step of generating.

  The above operation method can be realized as a function of hardware or as a function of software. In the latter case, the program for executing the above operating method is installed in the ultrasonic diagnostic apparatus via a portable storage medium or via a network.

(2) Details of Embodiment FIG. 1 shows an ultrasonic diagnostic apparatus according to an embodiment. The ultrasonic diagnostic apparatus is a medical apparatus that is installed in a medical institution such as a hospital and that forms an ultrasonic image based on data obtained by transmitting and receiving ultrasonic waves to and from a living body. The ultrasonic diagnostic apparatus according to the embodiment is an apparatus for performing ultrasonic diagnostics on a fetus in obstetrics. However, the ultrasonic diagnostic apparatus illustrated in the ultrasonic diagnosis of other tissues (for example, liver) may be used.

  In FIG. 1, the 3D probe 10 is an ultrasonic probe that transmits and receives ultrasonic waves in the state of being in contact with the surface of the living body in the illustrated example. The 3D probe 10 includes a two-dimensional vibrating element array. The two-dimensional vibrating element array is composed of hundreds, thousands, tens of thousands or more of vibrating elements arranged in the first direction and the second direction. The first direction and the second direction are directions orthogonal to the probe central axis, and the first direction and the second direction are orthogonal to each other. One or both of the first direction and the second direction may be curved.

  An ultrasonic beam is formed by the two-dimensional vibrating element array. The ultrasonic beam is considered as a combined transmission / reception beam that combines a transmission beam and a reception beam. In reality, a transmission beam is formed in the transmission process, and a reception beam is formed in the subsequent reception process. However, the reception beam is actually electronically formed by phasing addition (delay addition) of a plurality of reception signals. When forming the reception beam, reception dynamic focus is applied. In addition, parallel reception, which forms a plurality of reception beams per transmission beam, is applied as necessary.

  In the embodiment, the ultrasonic beam is electronically scanned by an electronic linear scanning method, an electronic sector scanning method, or the like. When acquiring volume data, the ultrasonic beam is two-dimensionally scanned. As a result, a three-dimensional space (three-dimensional data capturing area) 12 is formed in the living body. In the illustrated example, the first electronic scanning direction is the θ direction and the second electronic scanning direction is the φ direction. The depth direction is the d direction. In the illustrated example, the three-dimensional space 12 is an assembly of a plurality of frames F1, F2, F3, ..., Fn arranged in the φ direction. Each frame F1, F2, F3, ..., Fn corresponds to a scanning plane. A plurality of frame data are acquired from the plurality of frames F1, F2, F3, ..., Fn. Volume data is formed by these frame data. The individual frame data is composed of a plurality of beam data arranged in the θ direction, and the individual beam data is composed of a plurality of echo data arranged in the d direction.

  When displaying a tomographic image (real-time tomographic image), the scanning plane 14 is repeatedly formed at a fixed position. The scanning plane 14 corresponds to an observation section as a two-dimensional data acquisition area. Usually, the position where the scanning surface 14 is formed is the intermediate point (origin) in the φ direction, that is, the scanning surface 14 is the center scanning surface. However, the scanning surface 14 may be formed at another position.

  The ultrasonic diagnostic apparatus according to the embodiment has three support modes in order to provide support information to the user when displaying a real-time tomographic image. That is, it has an observation support mode, an operation support mode, and a setting support mode. In order to realize the three support modes, three or more composite scanning sequences are prepared. Depending on the selected mode, the composite scanning sequence to be actually used is selected from the plurality of composite scanning sequences, and the electronic scanning of the ultrasonic beam is controlled accordingly. Each composite scan sequence includes a plurality of basic scans which are intermittently executed on the time axis and a plurality of auxiliary scans which are intermittently executed between them. That is, each composite scanning sequence is composed of a plurality of scanning units that are time-divisionally executed with a predetermined pattern on the time axis. The plurality of basic scans are for forming a real-time tomographic image, and thereby a plurality of slice data are sequentially acquired from the observation slice. The plurality of auxiliary scans are for forming an assisting image as assisting information, whereby reference data is acquired from the three-dimensional space 12.

  As described later, the scanning conditions are different between the basic scanning and the auxiliary scanning, and specifically, the beam density is different. In the basic scanning, a plurality of ultrasonic beams are formed with high beam density to form a high quality tomographic image. In the auxiliary scanning, a plurality of ultrasonic beams are formed with a low beam density as long as an auxiliary image can be generated. Depending on the purpose or situation, the composition or time allocation of the individual composite scanning sequences can be changed. A C-MUT (Capacitive Micro-machined Ultrasound Transducer) may be used as the two-dimensional vibrating element array.

  The transmitter 16 is a transmission beamformer that supplies a plurality of transmission signals in parallel to the two-dimensional vibrating element array during transmission, and is configured as an electronic circuit. The reception unit 18 is a reception beamformer that performs phasing addition (delay addition) on a plurality of reception signals output in parallel from the two-dimensional vibrating element array during reception, and is configured as an electronic circuit. The receiver 18 includes a plurality of A / D converters, a detection circuit, and the like. Beam data is generated by phasing addition of a plurality of reception signals in the reception unit 18. When parallel reception is applied, for example, 16 reception beams that spread two-dimensionally are simultaneously formed per transmission / reception, that is, 16 beam data are obtained at the same time. The beam data processing unit in the subsequent stage of the receiving unit 18 is omitted in the drawing.

  The tomographic image forming unit 20 functions in any of the three support modes, and it processes a plurality of frame data sequentially obtained by a plurality of basic scans. In the embodiment, the tomographic image forming unit 20 includes a digital scan converter (DSC). The DSC has a coordinate conversion function, a pixel interpolation function, a frame rate conversion function, and the like. More specifically, the tomographic image forming unit 20 is based on a plurality of frame data (a plurality of sectional data) sequentially acquired from an observation cross section by repeating basic scanning, and a tomographic image (moving image) including a plurality of display frames ( Real-time tomographic image). The data of the tomographic image is sent to the display processing unit 24.

  The cine memory 22 stores a plurality of frame data acquired in chronological order, if necessary. The cine memory 22 is configured as a ring buffer, for example. During data reproduction, a plurality of frame data sequentially read from the cine memory 22 is input to the tomographic image forming unit 20. The cine memory may be provided in the subsequent stage of the tomographic image forming unit 20. Alternatively, an image storage unit equivalent to a cine memory may be connected to the display processing unit 24.

  The 3D memory 26 is a memory for storing volume data. In the embodiment, volume data as reference data is acquired from the three-dimensional space 12 by executing a plurality of auxiliary scans in the observation support mode and the setting support mode, and the volume data is stored in the 3D memory 26. Volume data may be acquired from the entire three-dimensional space, or volume data may be acquired from a part of the three-dimensional space. One example of such volume data is orthogonal data described later. Coordinate conversion is executed when data is written in the 3D memory 26. Alternatively, the coordinate conversion is executed when the data is read from the 3D memory 26. The coordinate conversion is, for example, a conversion from the dθφ coordinate system to the xyz coordinate system.

  The observation support image generation unit 30 functions in the observation support mode. The observation support image generation unit 30 generates an observation support image based on the volume data read from the 3D memory. The observation support image is an auxiliary or additional image showing the orientation of the fetus (for example, the side where the head is present). The observation support image will be described in detail later. The data of the observation support image is sent to the display processing unit 24.

  The memory 28 functions in the operation support mode, and in the embodiment, the memory 28 stores the frame data set (multi-frame data) obtained from the cross-section set in the three-dimensional space 12. The cross section set is composed of an observation cross section and a plurality of cross sections having a predetermined spatial relationship with respect to the observation cross section. In the embodiment, the cross-section set is composed of three cross-sections that are in a parallel relationship or a cross relationship, as will be described later. The frame data set may be stored in the 3D memory 26 without providing the memory 28. Like the volume data, the frame data set is also an aspect of reference data for generating support information.

  In the operation support mode, the operation support image generation unit 34 calculates a deviation (or deviation direction) of the observation cross section from the target cross section based on the frame data set read from the memory 28, and performs 3D based on the deviation. An operation support image that supports the operation of the probe is generated. The operation support image will be described in detail later. The data of the operation support image is sent to the display processing unit 24.

  In the setting support mode, the setting support image generation unit 36 generates a setting support image based on the volume data read from the 3D memory 26 and the scan range setting value designated by the user. The setting support image is an image for supporting the setting of the scanning range in the φ direction or the setting of both scanning ranges in the θ direction and the φ direction in the embodiment. The setting support image will be described in detail later. The data of the setting support image is sent to the display processing unit 24.

  It should be noted that the reference data acquired when generating the support information (specifically, the observation support image, the operation support image, and the setting support image) includes data acquired at least from other than the observation cross section in the three-dimensional space. . Part of the reference data may include data obtained from the observation cross section.

  A rendering unit and an MPR (Multi-Planar Reconstruction) image forming unit may be provided between the 3D memory 26 and the display processing unit 24. The rendering unit is a module that forms a three-dimensional ultrasonic image based on the volume data in the 3D memory 26. Volume rendering method, surface rendering method, and the like are known as rendering methods. The MPR image forming unit is a module that forms an MPR image based on the volume data in the 3D memory 26.

  The display processing unit 24 has a display image generation function, an image combination function, a color processing function, a graphic image generation function, and the like. The display image generated by the display processing unit 24 is displayed on the display unit 38. The display unit 38 is composed of an LCD, an organic EL display device, or the like.

  The tomographic image forming unit 20, the observation support image generation unit 30, the operation support image generation unit 34, the setting support image generation unit 36, and the display processing unit 24 described above are each configured by a processor, for example. Those functions may be realized by a single processor. Those functions may be realized by the CPU described below.

  The control unit 40 includes a CPU and an operation program. The control unit 40 controls the operation of each component shown in FIG. The control unit 40 has a transmission / reception control (electronic scanning control) function, which is represented as a transmission / reception control unit 42 in FIG. 1. The transmission / reception control unit 42 executes special transmission / reception control for simultaneously displaying the real-time tomographic image and the support image. Specifically, as described below, the transmission / reception control unit 42 controls the electronic scanning of the ultrasonic beam according to the composite scanning sequence corresponding to the assistance mode selected by the user. The operation panel 44 connected to the control unit 40 is an input device, which has a plurality of switches, a plurality of buttons, a trackball, a keyboard, and the like.

  FIG. 2 is a flowchart showing the general operation of the ultrasonic diagnostic apparatus shown in FIG. The content also shows the control of the control unit. The specific content of each step will be described later in detail.

  In FIG. 2, when the execution of the support mode is instructed, the type of the support mode is selected in S10. Specifically, one of the support modes is selected by the user from the observation support mode, the operation support mode, and the setting support mode. The support mode may be automatically selected depending on the situation.

  When the observation support mode is selected in S10, transmission / reception control according to the first composite scanning sequence is started in S12. In S14, the real-time tomographic image is displayed, and together with this, the observation support image is displayed. In that case, a real-time tomographic image is formed based on a plurality of frame data obtained from the observation cross section by a plurality of basic scans, and an observation assistance image is formed based on the volume data obtained by a plurality of auxiliary scans. . In S16, it is determined whether or not to terminate the observation support mode. If it is determined to continue the observation support mode, the step of S14 is repeatedly executed. If it is determined in S16 that the observation support mode has ended, it is determined in S18 whether or not to switch the support mode, and if so, the steps from S10 are executed.

  When the operation support mode is selected in S10, the transmission / reception control according to the second composite scanning sequence is started in S20. In S22, the real-time tomographic image is displayed, and along with that, the operation support image is displayed. In that case, a real-time tomographic image is formed based on a plurality of frame data obtained from the observation cross section by a plurality of basic scans, and an operation assistance image is formed based on a frame data set obtained by a plurality of auxiliary scans. It In S24, it is determined whether or not to end the operation support mode, and when it is determined that the operation support mode should be continued, the step of S22 is repeatedly executed.

  When the setting support mode is selected in S10, transmission / reception control according to the third composite scanning sequence is started in S26. In S28, the real-time tomographic image is displayed, and along with that, the setting support image is displayed. In that case, a real-time tomographic image is formed based on a plurality of frame data obtained from an observation cross section by a plurality of basic scans, and volume data (actually partial volume data) obtained by a plurality of auxiliary scans and A setting assistance image is formed based on the set value of the scanning range. In S30, it is determined whether or not to end the setting support mode. If it is determined that the setting support mode is to be continued, the process of S28 is repeatedly executed.

  According to the above operation example, an arbitrary support mode can be executed, or a plurality of support modes can be executed stepwise, depending on the situation. In addition, when performing measurement, generally, after a freeze operation (transmission / reception stop operation), a frame data sequence (a plurality of cross-sectional data arranged in chronological order) stored in a cine memory is reproduced, and a tomographic image suitable for measurement is selected. . Then, the measurement is executed using the selected tomographic image. Alternatively, the measurement is performed using the tomographic image as the still image displayed after the freeze operation.

  In the embodiment, a plurality of cross-sectional data obtained by a plurality of basic scans and reference data (one or a plurality of reference data) obtained by a plurality of auxiliary scans are stored while being associated with each other. This makes it possible to reuse the reference data associated with a plurality of cross-section data when they are reproduced. The real-time tomographic image as a moving image and the support image as a moving image may be stored while being associated with each other. With such a configuration, it becomes possible to reproduce the support image when reproducing the real-time tomographic image.

  Next, the observation support mode will be specifically described with reference to FIGS. 3 to 9. In the following, the focus is on the receive beam under parallel reception.

  FIG. 3 schematically shows a first example of the first compound scan executed in the observation support mode. In FIG. 3, the three-dimensional space 12A is represented as a plan view or a projection view. Each reception beam in the three-dimensional space 12A is specified by the θ direction coordinate and the φ direction coordinate. In the illustrated example, one scanning plane 14A is configured by one basic scan. The substance of the basic scanning is one-dimensional electronic scanning of the transmission beam and the reception beam. The scanning surface 14A is composed of a plurality of reception beams 52 arranged in the θ direction, as shown in a partially enlarged view of FIG. 14B. The pitch between the reception beams is indicated by Δθ1. Parallel reception may be applied when forming the scanning surface 14A.

  On the time axis, a plurality of basic scans are intermittently and sequentially executed at a predetermined frame rate. There is a temporal gap between two adjacent basic scans on the time axis, and the auxiliary scan is executed in each of the gaps. That is, on the time axis, a plurality of auxiliary scans are intermittently executed between the plurality of basic scans.

  In the embodiment, volume data is acquired by a plurality of auxiliary scans. Reference numeral 50 indicates one beam data array which is a unit of volume data. One beam data array corresponds to one transmission / reception, and it is specifically composed of 16 beam data. In the embodiment, two beam data arrays are acquired by one auxiliary scan. One volume data is composed of n beam data arrays 3D1 to 3Dn. Assuming that, one volume data can be obtained by 2 / n times of auxiliary scanning. However, the data acquired by one auxiliary scan can be arbitrarily determined. For example, one beam data array may be acquired or three or more beam data arrays may be acquired per auxiliary scan.

  As shown in the partial enlarged view 50A, 16 receive beams 54 aligned in the θ direction and the φ direction are formed per parallel reception. That is, 16 beam data are acquired by one transmission / reception, and one beam data array 50 is configured by them. In other words, 16 receive beams 54 form a receive beam array. The pitch of the receive beam array in the θ direction is indicated by Δθ2, and the pitch of the receive beam array in the φ direction is indicated by Δφ2. Δθ2 is larger than Δθ1 and is, for example, several times, 10 times, or 20 times of Δθ1. Δφ2 is also larger than Δθ1 and is, for example, several times, 10 times, 20 times or 30 times of Δθ1. As indicated at 56, the receive beam array is raster scanned over the three dimensional space 12A. And then it repeats. A volume rate is defined as an acquisition interval of a plurality of volume data on the time axis. The volume rate is higher than the frame rate and is, for example, tens of times, hundreds of times or more. Each numerical value described in the present specification is an example, and each numerical value may change depending on a specific situation.

  FIG. 4 schematically shows a second example of the first compound scan executed in the observation support mode. Similarly to the above, the scanning surface 14A is repeatedly formed by performing a plurality of intermittent basic scans. A plurality of auxiliary scans are intermittently executed between the executions of the plurality of basic scans.

  In the illustrated example, four frames are simultaneously formed by one-dimensional scanning of the reception beam array in the θ direction, that is, four frame data are simultaneously acquired. A frame data set (for example, 3D1) is composed of four frame data. The structural unit of the frame data set is the beam data array 50.

  In the illustrated example, the volume data is composed of n frame data sets 3D1 to 3Dn arranged in the φ direction. By the way, two frame data sets are obtained per one auxiliary scan. Of course, one frame data set may be obtained or three or more frame data sets may be obtained per one auxiliary scanning. The beam density conditions are the same as those shown in FIG. Also in this second example, the frame rate is considerably faster than the volume rate.

  FIG. 5 schematically shows the first compound scanning sequence 58 executed in the observation support mode. The horizontal axis in the upper part of FIG. 5 is the time axis. Reference numeral 60 indicates one basic scan, and reference numeral 62 indicates one auxiliary scan. In the embodiment, one B-mode scan is performed by one basic scan 60, and one frame data is obtained by this. Two data (for example, 3D1 and 3D2) are obtained by one auxiliary scan 62. The individual data is, for example, a beam data array or a frame data set as described above. By changing the configuration of the first composite scan sequence 58, the frame rate and the volume rate change.

  A plurality of frame data obtained by executing a plurality of basic scans form a frame data string 64 arranged on the time axis. A real-time tomographic image is formed based on the frame data sequence 64. Volume data 66 is formed by executing a plurality of (specifically, n / 2 times) auxiliary scans. An observation support image is generated based on the volume data 66. Although the xyz coordinate system after the coordinate conversion is shown in FIG. 5, it is merely for convenience.

  FIG. 6 shows a first configuration example of the observation support image generation unit 30 shown in FIG. The observation support image generation unit 30 includes a calculator 68, a memory 70, and an observation support image generator 72. The calculator 68 functions as the cross-section recognizer 76 and the orientation determiner 78. A plurality of templates 80, 82, 84 are stored in the memory 70. The cross section recognizer 76 searches the input volume data 66, for example, for two cross sections that match the two specific templates 80 and 82. At that time, a pattern matching method or the like is used. For example, as shown in the lower right part of FIG. 6, in the volume data 66, a cross section (for example, an abdominal cross section) 80A that matches the template 80 and a cross section (for example, the head cross section) 82A that matches the template 82 are formed. Specified. The orientation determiner 78 identifies the orientation of the tissue, in the embodiment, the orientation 86 of the body axis of the fetus from the positional relationship between the two cross sections 80A and 82A. It represents the orientation of the head as viewed from the observation cross section 74 (the side or orientation in which the head is present as viewed from the observation cross section 74). The observation support image generator 72 generates an observation support image in which the orientation of the head of the fetus is reflected.

  The template 84 corresponds to, for example, the sagittal plane (longitudinal section) of the fetus. By using such a template 84, the orientation of the head can be determined by itself without using any other template. For example, as the templates 80 and 82, ones corresponding to the measurement section may be prepared. A machine learning type cross-section estimator may be used as the cross-section recognizer 76.

  FIG. 7 shows a first example of the observation support image displayed when the observation support mode is executed. The display image 88 includes a real-time tomographic image 90 and an observation support image 94. The mark 92 indicates the electronic scanning direction or the electronic scanning start end in the basic scanning. In the real-time tomographic image 90, for example, a cross section of the abdomen or head of the fetus is shown. The observation support image 94 is a relatively small image that is additionally or additionally displayed. Specifically, the observation support image 94 includes the probe mark 96, the scanning plane mark 98, and the arrow 100 and the characters of the head. It is composed of 102. The scanning plane mark 98 indicates an observation cross section, and the position, direction, or side of the head viewed from the observation cross section is represented by a graphic arrow 100 and a character 102. The position and direction of the arrow 100 and the position of the character 102 are determined based on the determination result of the direction determiner. The observation support image 94 also includes a mark 104 indicating the electronic scanning direction or the electronic scanning start end.

  According to the observation support image 94, it is possible to obtain information about in which direction the 3D probe should be moved when it is desired to move the observation cross section to the head side. Therefore, the measurement can be efficiently performed. Alternatively, it is possible to reduce the possibility of losing the target tissue. A figure other than the arrow 100 may be adopted. The characters 102 may be displayed as needed. It is desirable to use three-dimensionally expressed marks as the probe mark 96 and the scanning plane mark 98. For example, the tomographic image data and the observation support image data may be transferred from the ultrasonic diagnostic apparatus to the information processing apparatus. The observation support image 94 can be useful even when reproducing a tomographic image.

  FIG. 8 shows a second example of the observation support image. The same elements as those shown in FIG. 7 are designated by the same reference numerals, and the description thereof will be omitted. This also applies to each of the drawings starting from FIG.

  In this second example, the observation support image 106 has a fetus model (object) 108 as a three-dimensional abstract figure in addition to the probe mark 96 and the scanning plane mark 98. The fetus model 108 includes a head 108a simulating a head and a body 108b simulating a trunk. In the illustrated example, the scanning plane mark 98 is crossed by the body 108b, and a three-dimensional representation is adopted. If the model is used instead of the arrow in this way, it becomes easier to intuitively recognize the orientation of the fetus.

  FIG. 9 shows a second configuration example of the observation support image generation unit. The observation support image generation unit 110 includes an integrator 112, an orientation determination unit 114, a memory 116, and an observation support image generator 118. The integrator 112 applies, for example, an integration process in the x direction to the input volume data 66, thereby generating an integrated image 120. In addition, the integrator 112 applies an integration process in the y direction, for example, to the volume data 66, thereby generating an integrated image 122.

  The template group 124 stored in the memory 116 is composed of a plurality of templates to be compared with the integrated image 120. The template group 126 stored in the memory 116 is composed of a plurality of templates to be compared with the integrated image 122. Information that specifies the orientation of the head of the fetus is added to each template. Reference numeral 128 indicates an example of the template in the template group 124, and, for example, the reference numeral 130 abstractly represents the information specifying the orientation. Similarly, reference numeral 132 indicates an example of the template in the template group 126, and, for example, the reference numeral 134 abstractly represents the information specifying the orientation.

  The orientation determiner 114 identifies the template having the highest similarity to the integrated image 120 from the template group 124, and at the same time identifies the template having the highest similarity to the integrated image 122 from the template group 126. To do. Subsequently, the orientation determiner 114 identifies the orientation of the head based on the observation cross section based on the two identified templates or the template having a higher degree of similarity. The observation support image generator 118 generates the observation support image shown in FIG. 7 or 8 based on the specified orientation. A machine learning type estimator may be used as the orientation determiner 114.

  Next, the operation support mode will be specifically described with reference to FIGS. FIG. 10 shows a configuration example of the operation support image generation unit 34 shown in FIG.

  The operation support image generation unit 34 has a function of generating three operation support images. In order to generate the three operation support images, three sectional data sets corresponding to the three sectional sets are sequentially acquired as shown in FIG. 11. They are input to the three similarity calculators 136, 138, 140. Each of the similarity calculators 136, 138, 140 is a module that compares the three cross-section data with the teacher data and calculates three similarities (similarity sets). Different teaching data is prepared for each of the similarity calculators 136, 138, 140 (and for each target cross section). They are stored in the memory 142.

  The similarity calculator 136 calculates a similarity set for determining the parallel movement direction, and the similarity set is input to the parallel movement direction determiner 144. The parallel movement direction determiner 144 determines the 3D probe parallel movement direction for matching the observation cross section with the target cross section. The similarity calculator 138 calculates a similarity set for determining the tilt direction, and the similarity set is input to the tilt direction determiner 146. The tilt direction determiner 146 determines the 3D probe tilt direction for matching the observation cross section with the target cross section. The similarity calculator 140 calculates a similarity set for determining the rotation direction, and the similarity set is input to the rotation direction determiner 148. The tilt direction determiner 146 determines the 3D probe rotation direction for matching the observation section with the target section.

  One similarity calculator may calculate three similarity sets. Similarly, one determining device may determine the parallel movement direction, the inclination direction, and the rotation direction. The operation support image generator 150 generates three operation support images based on the determined parallel movement direction, inclination direction, and rotation direction.

  FIG. 11 shows the second composite scans 1 to 3 in the three-dimensional space. The second composite scan sequence executed in the operation support mode is composed of a plurality of basic scans and a plurality of auxiliary scans, and in each individual basic scan, cross-sectional data is sequentially acquired from the observation cross-section in order to form a real-time tomographic image. To be done. In each of the auxiliary scans, a cross section set including, for example, three cross sections is set in the three-dimensional space. FIG. 11 shows three types of cross-section sets.

  When generating the operation support image 1 showing the parallel movement direction of the 3D probe, the cross-section set 152 is set in the three-dimensional space 12B. The cross section set 152 includes a cross section 154 corresponding to an observation cross section, a cross section 156 existing on one side of the cross section 154, and a cross section 158 existing on the other side of the observation cross section 154. The three cross sections 154, 156, 158 are arranged in a parallel movement direction or in a φ direction with a parallel relationship. The distance between the cross sections is, for example, 5 mm. A cross section data set, that is, a frame data set is acquired from the three cross sections 154, 156, and 158. A low beam density is set in the three cross sections 154, 156 and 158.

  When generating the operation support image 2 showing the tilt direction (tilt direction) of the 3D probe, the cross-section set 160 is set in the three-dimensional space 12B. The cross-section set 160 includes a cross-section 162 corresponding to an observation cross-section, a cross-section 164 defined by rotating the cross-section 162 around the horizontal axis 168 by a predetermined angle, and a cross-section 162 around the horizontal axis 168 on the other side. And a cross section 166 defined by being rotated by a predetermined angle. The three cross sections 162, 164, 166 are arranged side by side around the horizontal axis 168, that is, in the inclination direction. The angular interval between them is, for example, 5 degrees. A cross section data set, that is, a frame data set is acquired from the three cross sections 162, 164, and 166. A low beam density is set in the three cross sections 162, 164, 166.

  When generating the operation support image 3 showing the rotation direction of the 3D probe, the cross-section set 170 is set in the three-dimensional space 12B. The cross-section set 170 includes a cross-section 172 corresponding to an observation cross-section, a cross-section 174 defined by rotating the cross-section 172 around the vertical axis (center axis) 178 by a predetermined angle, and a cross-section 172 of the vertical axis 178. And a cross section 176 defined by rotating the other side by a predetermined angle. The three cross-sections 172, 174, 176 are aligned around the vertical axis 178, that is, in the rotational direction. The angular interval between them is, for example, 5 degrees. A cross section data set, that is, a frame data set is acquired from the three cross sections 172, 174, and 176. A low beam density is set in the three cross sections 172, 174 and 176. The frame data corresponding to the cross sections 154, 162, 172 may be generated by converting the resolution of the frame data obtained from the observation cross section.

  For each frame data set acquired as described above, three similarities are calculated by comparing individual frame data constituting the frame data set with teacher data (teacher image) representing the target cross section. For example, when the three cross sections A1, A2, A3 are arranged in that order, the three similarities are expressed as α1, α2, α3. Here, if the condition of α1 <α2 <α3 is satisfied, it is determined that the 3D probe should be moved so that the observation cross section approaches the cross section A3. On the contrary, if the condition of α1> α2> α3 is satisfied, it is determined that the 3D probe should be moved so that the observation cross section approaches the cross section A1. If the degree of similarity α2 is the highest, it is determined that the observed cross section matches the target cross section, that is, the posture of the 3D probe should be maintained. In the embodiment, the directionality for three types of displacement (three types of displacement components) is determined, but the directionality for one or two types of displacement may be determined. The order of judgment can be set arbitrarily. The cross section set may be made up of five cross sections or may be made up of more cross sections.

  FIG. 12 shows operation support images Nos. 1 to 3 (180, 184, 188). In the illustrated example, first, the operation support image 1 (180) is displayed, and the user performs a parallel movement operation. After the completion, the operation support image No. 2 (184) is displayed, and the tilt operation is performed by the user. After the completion, the operation support image 3 (188) is displayed, and the rotating operation is performed by the user.

  Specifically, the operation support image 1 (180) includes the probe mark 96, the scanning plane mark 98, the fetus model 108, and further has the operation direction mark 182. The operation direction mark 182 is constituted by a linear arrow indicating the parallel movement direction of the 3D probe. Furthermore, the operation support image 1 (180) also includes the measurement name (AC measurement). The operation support image 2 (184) has an operation direction mark 186. The operation direction mark 186 is constituted by an arc-shaped arrow indicating the tilting direction (tilting movement direction) of the 3D probe. The operation support image 3 (188) has an operation direction mark 190. The operation direction mark 190 is constituted by an annular arrow indicating the rotation direction of the 3D probe. Each of the operation direction marks 182, 186, 190 is an example, and marks having other forms can be adopted. Other operation support information such as voice may be provided.

  When performing the specific measurement, when the operation support mode is selected at the time when the observation cross section is close to the measurement cross section, the operation support images 1 to 3 (180, 184, 188) shown in FIG. 12 are obtained. Displayed in order. By referring to them and operating the 3D probe, the position and orientation of the 3D probe are gradually optimized. That is, the observed cross section is fitted to the target cross section. Even in the process of such an operation, the real-time tomographic image can be observed at any time. Actually, by observing the real-time tomographic image, it is possible to obtain auxiliary information for adjusting the position and orientation of the 3D probe by observing the operation support image in the process of matching the observed cross section with the target cross section. It will be possible. The operation support images 1 to 3 (180, 184, 188) include the fetus model 108 as described above. The fetus model 108 may be automatically generated by the simultaneous execution of the observation support mode. The fetal model 108 may be generated by other methods.

  Next, the setting support mode will be specifically described with reference to FIGS. FIG. 13 shows an example of the third compound scan in the three-dimensional space. The third composite scan sequence executed in the setting support mode is composed of a plurality of basic scans and a plurality of auxiliary scans, and in each individual basic scan, cross-section data is acquired from an observation cross-section for forming a real-time tomographic image. To be done. Partial volume data is acquired from the partial space 191 in the three-dimensional space 12C by a plurality of auxiliary scans. The illustrated partial space 191 is a space that has a relationship orthogonal to the observation cross section 14C and spreads over a certain range in the θ direction with the midpoint of the θ direction as the center. The partial space 191 is composed of a plurality of frames F1 to Fn arranged in the θ direction. Each frame F1 to Fn corresponds to a scanning plane. The partial volume data is composed of a plurality of frame data acquired from a plurality of frames F1 to Fn.

  The aggregate of the frame data spreads in the d direction and the φ direction and constitutes orthogonal data when viewed with the observation cross section 14C as a reference. Orthogonal data spread in the θ direction and the φ direction may be acquired. An integrated image is formed by integrating the orthogonal data in the thickness direction.

  FIG. 14 shows the third compound scanning sequence. It consists of a plurality of intermittent basic scans 194 and a plurality of intermittent auxiliary scans 196 between them. A plurality of basic scans sequentially acquire a plurality of cross-section data at a constant frame rate, and a real-time tomographic image is formed on the basis of these. A plurality of auxiliary scans 196 sequentially acquire partial volume data at a constant volume rate. Based on the individual partial volume data and the designation of the scanning range in the θ direction, the setting support image described in detail below is generated.

  FIG. 15 shows the setting support image No. 1. The display image 198 includes a real-time tomographic image 200 and a setting support image 202. The setting support image 202 includes an integrated image 204, a scanning range marker 208, and an observation section marker 206. The integrated image 204 is generated by integrating the partial volume data in the θ direction (thickness direction). The scanning range marker 208 indicates the currently set θ-direction scanning range. For example, when a three-dimensional region of interest (3D-ROI) is set for 3D image formation, measurement, or other reasons, the range (scanning range) of the three-dimensional region of interest in the θ direction (scanning range) is referred to by the user while referring to the scanning range marker 208. Adjusted by. The range in the θ direction may be automatically calculated based on the integrated image 204. Note that a marker indicating the range (scanning range) of the three-dimensional region of interest in the φ direction may be displayed on the real-time tomographic image 200. With such a display, the range in the φ direction can be accurately determined. After setting the three-dimensional region of interest, the scanning range is actually changed if necessary. The scan area marker 208 may be used for other purposes. The scanning range in the θ direction is also displayed as a numerical value in the setting support image 216 shown in FIG. 17 (see reference numeral 216).

  FIG. 16 shows a modification of the setting support image No. 1. The setting support image 213 includes a box-shaped marker 214 indicating a three-dimensional region of interest limited in the depth direction. The marker 214 indicates the range in the θ direction and the range in the depth direction of the three-dimensional region of interest.

  FIG. 17 shows the setting support image No. 2. The setting support image 216 includes an integrated image 218, a scanning range marker 220, and an observation cross section marker 222. The integrated image 218 is generated by integrating partial volume data spread in the θ direction and the φ direction in the d direction (thickness direction). The marker 220 has a rectangular shape indicating the range in the θ direction and the range in the φ direction of the three-dimensional region of interest. The marker 224 indicates a reference end or a start end of electronic scanning in the θ direction. The range in the θ direction is displayed as a numerical value 216. The marker 220 may be used for other purposes.

  FIG. 18 shows a modification of the setting support image No. 2. The setting support image 226 includes a box-shaped marker 228 indicating a three-dimensional region of interest. The marker 228 indicates the range in the θ direction and the range in the φ direction in the three-dimensional region of interest.

  According to the above embodiment, the electronic scanning control based on the composite scanning sequence can provide the support information to the user while displaying the real-time tomographic image. Specifically, reference data including data from other than the observation cross section can be acquired in a time division manner, and the reference data can be used to assist the user. In the above embodiment, a plurality of support modes may be executed simultaneously. Each support mode has its own value, that is, each support mode can be adopted independently.

Reference numeral 10 3D probe, 12 three-dimensional space, 14 scanning plane (observation cross section), 20 tomographic image forming unit, 24 display processing unit, 30 observation assistance image generating unit, 34 operation assistance image generating unit, 36 setting assistance image generating unit.

Claims (8)

A 3D probe that forms an ultrasonic beam that is electronically scanned in a three-dimensional space in a living body;
A control unit for controlling electronic scanning of the ultrasonic beam according to a composite scanning sequence including a plurality of basic scans intermittently executed on the time axis and a plurality of auxiliary scans intermittently executed between them. ,
An image forming unit that forms a real-time tomographic image based on a plurality of cross-sectional data sequentially acquired from an observation cross section in the three-dimensional space by the plurality of basic scans,
It is provided to the user together with the real-time tomographic image based on reference data including reference data acquired from all or part of the three-dimensional space by the plurality of auxiliary scans and data acquired from other than the observation cross section. A support information generation unit for generating support information,
An ultrasonic diagnostic apparatus comprising: The ultrasonic diagnostic apparatus according to claim 1,
In each of the basic scanning, a plurality of ultrasonic beams are formed with a high beam density,
In each of the auxiliary scanning, a plurality of ultrasonic beams are formed with a low beam density lower than the high beam density,
An ultrasonic diagnostic apparatus characterized by the above. The ultrasonic diagnostic apparatus according to claim 1,
The support information generation unit,
An orientation determiner that determines the orientation of the target tissue in the three-dimensional space based on the reference data,
An observation support image generator that generates an observation support image representing the orientation of the target tissue as the support information,
An ultrasonic diagnostic apparatus comprising: The ultrasonic diagnostic apparatus according to claim 1,
The support information generation unit,
A calculator for calculating the deviation of the observation cross section with respect to the target cross section based on the reference data,
An operation assistance image generator that generates an operation assistance image that assists in changing the position and orientation of the observation cross section as the assistance information based on the deviation of the observation cross section,
An ultrasonic diagnostic apparatus comprising: The ultrasonic diagnostic apparatus according to claim 4,
The arithmetic unit analyzes a plurality of displacement components as the displacement of the observation cross section,
The operation support image generator generates a plurality of component-specific operation support images corresponding to the plurality of displacement components as the operation support image,
An ultrasonic diagnostic apparatus characterized by the above. The ultrasonic diagnostic apparatus according to claim 1,
The operation support image generation unit,
An orthogonal image generator that generates an orthogonal image having an orthogonal relationship with the observation cross section based on the reference data,
A setting support image generator that generates a setting support image including the orthogonal image and a range marker representing an ultrasonic beam scanning range as the support information,
An ultrasonic diagnostic apparatus comprising: The ultrasonic diagnostic apparatus according to claim 1,
The support information generation unit,
A means for determining the orientation of the target tissue in the three-dimensional space based on the first reference data as the reference data and generating an observation assistance image representing the orientation of the target tissue as one of the assistance information; ,
The shift of the observation cross section is calculated based on the second reference data as the reference data, and as one of the support information, the change of the position and the posture of the observation cross section is supported based on the shift of the observation cross section. Means for generating an operation support image,
An orthogonal image having an orthogonal relationship with the observation cross section is generated based on the third reference data as the reference data, and as one of the support information, the orthogonal image and a range marker representing an ultrasonic beam scanning range. Means for generating a setting support image including
Means for selectively displaying the observation assistance image, the scanning assistance image and the setting assistance image,
An ultrasonic diagnostic apparatus comprising: A program executed in an ultrasonic diagnostic apparatus,
Controlling electronic scanning of an ultrasonic beam in a three-dimensional space according to a composite scanning sequence including a plurality of basic scans that are intermittently performed on a time axis and a plurality of auxiliary scans that are intermittently performed between them. Function to
A function of forming a real-time tomographic image based on a plurality of cross-sectional data sequentially acquired from an observation cross section in the three-dimensional space by the plurality of basic scans,
Based on reference data including reference data obtained from all or part of the three-dimensional space by the plurality of auxiliary scans and data obtained from other than the observation section, the reference data is provided to the user together with the real-time tomographic image. Function to generate support information
A program characterized by including.