JP2012157608A - Ultrasonic image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem of difficulty in grasping the three dimensional position of each section, when observing bull's eye image expressed in one or more sections defined on three sections set for the heart.SOLUTION: A schema image set 104 is displayed together with a synthetic image 100 and a bull's eye image 102. The schema image set 104 consists of three schema images 116, 118, 120 corresponding to three sections. The same processing as color display processing applied to bull's eye image 102 and overlay image 101B is applied to each schema image set 104. That is, the same color is given on each image for three sections mutually having correspondency relations. A frame marker 112 expresses a chosen section as a B-mode image. It is also possible to apply color display processing only to the schema image corresponding to the chosen section or only for the schema images.

Description

  The present invention relates to an ultrasonic image processing apparatus, and more particularly to an apparatus that displays a developed image such as a Bullseye display image.

  Ultrasound diagnostic apparatuses are used in the medical field. An ultrasonic diagnostic apparatus is an apparatus that displays an ultrasonic image by transmitting and receiving ultrasonic waves to and from a living body. As the ultrasonic image, a two-dimensional tomographic image or the like is well known, and is displayed as a moving image or a still image. Various measurements are performed on the basis of ultrasound images, and in particular in the field of circulatory organs, the function of the heart, particularly the left ventricle, is evaluated on the basis of ultrasound images. For example, the two-dimensional movement of each observation point is analyzed between adjacent images in a plurality of tomographic images (or frame sequences) existing on the time axis, and the movement of the myocardium is displayed from the analysis result. A pattern matching method is used to analyze the two-dimensional movement of the observation point. For example, on the reference frame, a plurality of observation points are specified along the inner and outer edges of the left ventricular myocardium (observation points may be automatically added between these observation points), and the subsequent frames Pattern matching is performed for each observation point in between, and two-dimensional movement between frames is analyzed for each observation point. In each frame, a plurality of segments (segments) are defined by inner edge trace lines and outer edge trace lines. Each section corresponds to an individual area where the motion evaluation value is observed. As the inter-frame pattern matching proceeds, a motion evaluation value is calculated for each frame (for each time phase) and for each section. The motion evaluation value is a strain, a strain rate, an angle, or the like, and represents a motion of a local site in the myocardium.

JP 2008-142568 A

  By the way, the motion evaluation value obtained for each time phase for the heart, particularly the left ventricle, is provided to the user as a numerical value. However, since it is difficult to grasp the overall movement and local movement in numerical observation, a technique for expressing all the sections as in a development view and applying a coloring process (color processing) to each section is becoming widespread. The image displayed in this way is also called a bullseye display image (see Patent Document 1). In the field of ultrasonic diagnosis, three cross sections are set for the left ventricle, and a bullseye display image is configured as an aggregate of a plurality of sections defined on each cross section. More specifically, three cross sections orthogonal to or intersecting each other are set with reference to the long axis of the left ventricle, or three cross sections parallel to each other are set as the short axis image of the left ventricle. The movement of the myocardium is observed for each cross section. In the bullseye display image, individual areas defined by a plurality of concentric lines such as multiple rings and a plurality of radial lines correspond to individual sections. Each section is colored by the hue and brightness corresponding to the motion evaluation value obtained for each section.

  Such a bullseye display image has a coordinate system in which the left ventricle is viewed from the inside of the left ventricle to the outside and is expanded two-dimensionally. While it is possible to see and grasp multiple compartment rows on multiple sections at the same time, which section on which cross section the individual compartments displayed there are, especially where each compartment is in the left ventricle It is difficult to intuitively understand whether it corresponds to. Conventionally, when displaying a bullseye display image, a two-dimensional tomographic image representing a specific cross-section selected by the user from among three cross-sections is displayed. The value is represented by color. However, it is difficult to recognize the correspondence between individual sections on the bullseye display image and individual sections on the tomographic image. Or the recognition requires skill.

  An object of the present invention is to make it possible to intuitively recognize the correspondence between individual sections and tissue parts in a developed image when the developed image is displayed. Or, conversely, it is intended to make it possible to intuitively recognize where a specific cross section corresponds to the developed image.

  The present invention relates to an ultrasonic image processing apparatus that processes a plurality of frame sequences corresponding to a plurality of cross-sections set for a moving tissue in a living body, wherein the plurality of frames constituting each frame sequence are arranged in a time axis direction. Calculation means for calculating a motion evaluation value for each section and for each time phase with respect to a plurality of sections defined on each section by sequentially analyzing, and a three-dimensional array of sections defined on the plurality of sections Means for generating a developed image representing a first section, a first image generating means for performing a first section-specific display process on all or a part of the developed image, a tissue form on each cross section, and a plurality of sections Means for generating a simulated image set representing a section, wherein the first image generating means performs a second section-specific display process on all or a part of the simulated image set. The display processing for each section and the second display processing for each section are processes for changing the display mode of each section according to the motion evaluation value calculated for each section and for each time phase. The simulated image set after the second section display process is displayed together with the developed image after the separate display process.

  According to the above configuration, the simulated image set that has been subjected to the second divisional display process is displayed together with the developed image after the first divisional display process. Since a part-by-part display process is performed for a part or all of the simulated image set, each part in the developed image is determined from the correspondence between the part-by-part display process result in the developed image and the part-by-part display process result in the simulated image. Can be intuitively recognized as to which part of the living tissue corresponds, or the recognition can be supported. In this way, the simulated image set is a bridge between the developed image and the real space (real organization). Each simulated image is preferably a schema image representing an outline of the tissue form. However, it may be a detailed view such as an anatomical chart. The number of sections set on the plurality of cross sections may match the number of sections appearing on the developed image, or may not match. The motion evaluation value is preferably a value for evaluating the local region in the section or the entire motion. The movement amount, the tangential strain, and the direction intersecting the tangential direction (orthogonal direction, muscle tissue thickness direction) Strain, partition area (area change rate), and the like may be used. Each section is a two-dimensional section generally designated by four or more points.

  The second section-specific display process is applied to all or a part of the plurality of simulated images constituting the simulated image set. According to the former, it is possible to observe the motion evaluation value while grasping the position on the cross section for all the sections, and according to the latter, it is possible to observe the cross section of interest (preferably the cross section corresponding to the displayed tomographic image). The motion evaluation value can be considered for the section on the cross section.

  Preferably, tomographic image forming means for forming a tomographic image based on each frame in a frame sequence corresponding to a selected slice selected from the plurality of slices, and synthesized on the tomographic image and on the selected slice Means for generating an overlay image representing a plurality of sections, and third image generating means for performing a third section display process on the overlay image, wherein the third section display process , A process of changing the display mode of each section according to the motion evaluation value calculated for each section and for each time phase, and for the developed image and the tomographic image after the first section display process A simulated image set after the second section display process is displayed together with a composite image generated by combining the overlay image after the third section display process. According to this configuration, it is possible to easily recognize which section in the developed image corresponds to which section on the tomographic image and in the simulated image set. Alternatively, it can be easily recognized which specific section on the tomographic image corresponds to the section on the developed image and the simulated image. Furthermore, it is possible to easily recognize which section on the tomographic image and the developed image corresponds to a specific section in the simulated image set.

  Preferably, in the partial processing mode, the first image generation means applies to a plurality of sections corresponding to a selected section selected from the plurality of sections in the group of sections displayed in the development image. The second image generation means performs the second section display processing on the simulated image corresponding to the selected section in the simulated image set in the partial processing mode. A section-specific display process is performed. Preferably, the first image generation means performs the first section-specific display processing on all of the section groups displayed in the developed image in the all processing mode, and the second image generation means In the all processing mode, the second section-specific display processing is performed on all the simulated image sets.

  Preferably, the calculation means calculates a two-dimensional movement of a plurality of observation points between frames in each frame sequence, and calculates a motion evaluation value for each block based on the two-dimensional movement of the plurality of observation points. Means for determining an error point among the plurality of observation points based on at least one of the two-dimensional movement of the plurality of observation points and the motion evaluation value of the partition unit, and the second The image generation means performs identification processing so that a section corresponding to the error point is identified for the simulated image set. According to this configuration, when a motion abnormality or tracking abnormality occurs, it can be specified on the simulated image set, so that the motion evaluation value can be diagnosed accurately.

  Desirably, the first to third segment-specific display processes are processes that give the same hue and luminance to each other according to the motion evaluation value. According to this configuration, it is easy to grasp the correspondence between the three images. The same hue and brightness need only look the same from the user's perspective, and do not require exact matching. The image displayed as an overlay on the tomographic image may be given a specific change in hue and luminance in consideration of the luminance of the background image.

  A program according to the present invention is an ultrasound image processing program executed in an ultrasound image processing apparatus that processes a plurality of frame sequences corresponding to a plurality of cross sections set for a moving tissue in a living body, A function for calculating a motion evaluation value for each section and for each time phase for a plurality of sections defined on each section by sequentially analyzing each frame sequence in the time axis direction, and defined on the plurality of sections. A function of generating a developed image representing a three-dimensional array of divided sections, a function of performing a first classified display process on all or a part of the developed image, A function of generating a simulated image set representing a partition row, and a function of performing a second partition-specific display process on all or a part of the simulated image set, the first partition-specific table The process and the second section-specific display process are processes for changing the display mode of each section according to the motion evaluation value calculated for each section and for each time phase, and the first section-specific display process. A simulated image set after the second section display process is displayed together with a later developed image. The ultrasonic image processing apparatus is an apparatus incorporated in an ultrasonic diagnostic apparatus, an information processing apparatus that processes data from the apparatus, and the like.

  According to the above configuration, while obtaining the advantage of being able to grasp all sections of the developed image at the same time, it is possible to compensate for the difficulty of spatial grasp, which is a drawback thereof, by mediating multiple simulated images. Can provide useful support.

  According to the present invention, when a developed image is displayed, it is possible to intuitively recognize a correspondence relationship between each section in the developed image and a tissue part. Alternatively, it is possible to intuitively recognize where a specific cross section corresponds to the developed image.

1 is a block diagram showing a preferred embodiment of an ultrasonic diagnostic system according to the present invention. It is explanatory drawing which shows the 1st arrangement | sequence about three cross sections. It is explanatory drawing which shows the 2nd arrangement | sequence about three cross sections. It is a figure which shows a division group and a bullseye image. It is a figure which shows an example of a display image. It is a figure for demonstrating the pattern matching process between frames. It is a figure which shows an example of a color display process. 3 is a flowchart for explaining display image generation processing in the system shown in FIG. 1. It is a figure which shows the display content in the middle of formation of a display image. It is a figure which shows the other example of a display image.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described with reference to the drawings.

  FIG. 1 shows a preferred embodiment of an ultrasonic diagnostic system according to the present invention, and FIG. 1 is a block diagram showing the overall configuration thereof. The ultrasonic diagnostic system shown in FIG. 1 is used in the medical field. In the example shown in FIG. 1, the ultrasonic diagnostic system includes an ultrasonic diagnostic apparatus shown in the upper stage and a PC (personal computer) 40 shown in the lower stage.

  First, an ultrasonic diagnostic apparatus will be described. The probe 10 is a transducer that is used in contact with the surface of a living body and transmits and receives ultrasonic waves. In the present embodiment, the probe 10 includes an array transducer including a plurality of vibration elements. The array transducer is a 1D array transducer, and an ultrasonic beam 11 is formed by the array transducer. A scanning surface is formed by electronic scanning of the ultrasonic beam 11. In the figure, r indicates the depth direction, that is, the beam direction, and θ indicates the electronic scanning direction. As the electronic scanning method, electronic sector scanning, electronic linear scanning, and the like are well known. It is also possible to use a 2D array transducer instead of the 1D array transducer.

  In this embodiment, in order to ultrasonically diagnose the function of the heart, particularly the left ventricle, three cross sections that cross the left ventricle are defined, and a scanning surface is repeatedly formed for each cross section. In setting the cross section, the cross section is determined at an appropriate position by adjusting the contact position and the contact posture of the probe 10 while viewing the ultrasonic image displayed on the image. In the present embodiment, three cross sections are set for the left ventricle. In this case, a first array that sets three cross sections with crossing relations with each other and a second array that sets three cross sections with parallel relations with each other. An array is selected. However, other arrangements may be used. Each array will be described later with reference to FIGS.

  Incidentally, if a 2D array transducer is used, it is possible to simultaneously acquire frame sequences (frame data sequences) for each of the three cross sections without changing the probe position and the like. In any case, a frame row is acquired for each cross section. The frame sequence is composed of a plurality of frames arranged in chronological order, and each frame is composed of a plurality of beam data or line data. Each beam data or each line data is composed of a plurality of echo data or pixel data.

  The transmission / reception unit 12 functions as a transmission beamformer and a reception beamformer. At the time of transmission, a plurality of transmission signals are supplied in parallel from the transmission / reception unit 12 to the array transducer. As a result, a transmission beam is formed. When the reflected wave from the living body is received by the 1D array transducer, a plurality of reception signals are output in parallel to the transmission / reception unit 12 from the 1D array transducer. The transmission / reception unit 12 performs phasing addition processing on a plurality of reception signals, thereby generating reception signals after phasing addition, that is, beam data. The beam data is output to a DSC (digital scan converter) 14 via a signal processing unit (not shown).

  The DSC 14 has a function of generating tomographic image data based on a plurality of beam data, and specifically includes a coordinate conversion function, an interpolation processing function, and the like. The DSC 14 generates two-dimensional tomographic image data, and outputs a plurality of line data constituting the data, that is, frames, to the display processing unit 16.

  In the present embodiment, data output from the DSC 14 is also sent to the cine memory 20, and a frame sequence over a certain period is stored on the cine memory 20. The cine memory 20 functions as a plurality of ring buffers. In the present embodiment, three frame sequences corresponding to three cross sections are stored in the cine memory 20. The cine memory 20 also stores an electrocardiogram waveform acquired at the same time when each frame sequence is acquired. The electrocardiogram waveform is output from the electrocardiograph 19.

  Reference numeral 22 represents a conceptual representation of the storage contents of the cine memory 20. The cine memory 20 stores data sets A, B, and C corresponding to three cross sections, where the data set A includes a frame sequence 24 corresponding to the first cross section and an electrocardiogram waveform corresponding to the frame sequence 24. 26. Similarly, the data set B corresponding to the second cross section is composed of the frame sequence 28 and the electrocardiographic waveform 30, and the data set C corresponding to the third cross section is composed of the frame sequence 32 and the electrocardiographic waveform 34. The reason why the electrocardiographic waveform is associated with each frame sequence is to match the time phase between the frame sequences. Therefore, if the three-dimensional volume data is acquired and the correspondence relationship of the time phases is known between the respective frame sequences, the electrocardiographic waveform does not necessarily need to be stored.

  The frame output from the DSC 14 may be directly output to the display processing unit 16 or may be output to the display processing unit 16 via the cine memory 20. The display processing unit 16 has an image composition function and the like, and the image data output from the display processing unit 16 is sent to the display unit 18. An ultrasonic image is displayed on the display unit 18. The ultrasonic image is, for example, a two-dimensional tomographic image. Examples of other ultrasonic images include a two-dimensional Doppler image, a three-dimensional image, and a Doppler waveform image.

  The PC 40 is an information processing apparatus that performs image processing based on data acquired from an ultrasonic diagnostic apparatus, particularly, the cine memory 20. The PC 40 may be connected online to the ultrasonic diagnostic apparatus or may be connected offline. For example, data may be passed from the ultrasonic diagnostic apparatus to the PC 40 via a storage medium. Of course, some functions in the image processing may be performed in real time simultaneously with the ultrasonic diagnosis. In this embodiment, the frame after the DSC 14 is output to the PC 40, but the frame before being input to the DSC 14, that is, the frame before coordinate conversion may be passed to the PC 40. In that case, the PC 40 may perform the same process as the DSC 14.

  In the PC 40, the tracking processing unit 42 is a module that performs tracking processing in time series on the frame sequence selected by the user. Specifically, pattern matching processing is executed for each observation point between frames. As a result, a two-dimensional movement vector in the time axis direction of each observation point is calculated for each frame. Incidentally, a plurality of observation points are manually specified on a reference frame (initial frame) selected by a plurality of calculations, and the movement of each point is automatically calculated by the tracking process in each subsequent frame. It will be. Such a series of processing is executed for each frame sequence.

  The measurement unit 44 is a module that calculates a measurement value based on a two-dimensional movement vector for each observation point calculated between frames or based on the position of the observation point on each frame. For example, measurement values are obtained for representative observation points in each section. Examples of such measurement values include various measurement values such as length, strain, and area. The processing described later can be applied to any of them. Incidentally, the type of measurement value can be selected by the user. The measuring unit 44 has a function of defining a section for each frame row, that is, a connected body including a plurality of sections is defined on each cross section. However, the form of each section changes depending on the movement of each observation point. In any case, the measurement unit 44 calculates a measurement value for each time phase, that is, for each frame, in units of sections.

  In the present embodiment, the measurement unit 44 includes an abnormality determination unit 45. In other words, when an abnormality is determined in the calculation of the measured value or as a result of the tracking process, a function for identifying the section where the abnormality is determined is provided. This abnormality determination unit 45 may be provided in the tracking processing unit 42. For example, when the correlation value is an abnormal value in pattern matching, specifically, when the similarity is a predetermined value or less, the abnormality may be determined. According to such abnormality determination, it is possible to present to the user a section in which an abnormality has been recognized in tracking processing or measurement value calculation, and to avoid erroneous diagnosis.

  The measurement values calculated by the measurement unit 44 are sent to the overlay image generation unit 46, the bullseye image generation unit 48, and the schema image processing unit 50. Other information is also given to the generating units 46 and 48 and the processing unit 50 as necessary. The overlay image generation unit 46 is a module that generates an overlay image as a graphic image displayed to be superimposed on a B-mode image as a two-dimensional tomographic image. In the present embodiment, the overlay image includes a plurality of sections defined by a plurality of observation points specified for each frame. In that case, color display processing is performed as necessary, that is, an overlay image subjected to color painting processing is generated. In coloring each section, the hue and brightness (that is, color) are associated with the measured values.

  The bullseye image generation unit 48 is a module that generates a bullseye image including a group of sections. In the present embodiment, a bullseye image subjected to color display processing is generated. A specific example of the bullseye image will be described later with reference to FIG. 4. The bullseye image represents all of the plurality of sections set on the three cross sections or the main sections thereof, and exists in a three-dimensional manner. This corresponds to a development view of a plurality of sections. The schema image processing unit 50 constitutes one of the characteristic modules in the present embodiment, and is a module that generates a schema image set including three schema images corresponding to three cross sections. Each schema image schematically represents a tissue form on a cross section corresponding to the image. In the present embodiment, a plurality of sections are further expressed for the form of the tissue, For example, color display processing can be performed. In the color display processing of the overlay image, the bullseye image, and the schema image, basically the same color conversion is performed, that is, the color corresponding to the measured value given to a certain section is the respective image. Is given to the corresponding section in. However, since the overlay image is synthesized on the B-mode tomographic image, that is, it is easily affected by the luminance of the background, the image can be modified such that the luminance is slightly changed.

  In the image memory 52, three schema images representing three cross-sections corresponding to the crossed array and three schema images representing three cross-sections corresponding to the parallel array are stored as graphic images in the present embodiment. . Reference numeral 54 schematically represents the contents of the image memory 52. Reference numeral 56 represents three schema images corresponding to the first array, and reference numeral 58 represents three schema images corresponding to the second array. Which schema image set is used is selected directly or indirectly by the user.

  As will be described later, a predetermined number of sections are defined on each of the cross sections constituting the three cross sections. In the present embodiment, the total number of sections does not necessarily match the number of sections constituting the bullseye image. This is because there are a plurality of overlapping sections in the three-dimensional space.

  The display processing unit 60 is a module that configures the content of the display image displayed on the display unit 62. As will be described later, the display image includes a composite image obtained by combining a B-mode image and an overlay image, a bullseye image, and a schema image set, and further includes a numerical display if necessary. It is. The image memory 64 stores the generated overlay image, bullseye image, schema image, and the like. The display unit 62 displays a display image as a still image or a display image as a moving image. Incidentally, as described above, each electrocardiographic signal is used to specify the mutual time phase relationship of a plurality of frame sequences. That is, although each frame sequence was acquired at different times, the left ventricle is an organ that moves periodically, so if the heartbeat time phases match in each frame sequence, substantially the same tissue It can be regarded as having a form.

  Next, the arrangement of the three cross sections will be described with reference to FIGS. 2 and 3 schematically show the left chamber 66 as an example of the target tissue. In the present embodiment, when the first arrangement is selected, as shown in FIG. 2, three cross sections 68, 70, and 72 having a cross relationship with each other are set for the left ventricle. In FIG. 2, three cross sections are set with an orthogonal relationship. Such three cross sections can be sequentially set by changing the contact position and the contact posture of the probe. FIG. 3 shows the second arrangement. In this second arrangement, three cross sections 74, 76, 78 are set in parallel with each other with respect to the left chamber 66. On each cross-section, observation point sequences are set for the outer and inner edges of the myocardium in the left ventricle, and the two observation point sequences are connected by a plurality of lines, thereby connecting a plurality of sections. Is defined. Three connected bodies will be defined corresponding to the three cross-sections, and a bullseye image is used to represent all of them simultaneously.

  FIG. 4 illustrates a group of compartments and a bullseye image developed therefrom. (A) schematically shows a group of sections having a three-dimensional arrangement. However, the lower side of the left ventricle is slightly open here. Three stages can be considered from the top to the bottom, where the upper stage is composed of four sections H1 to H4, the middle section is composed of six sections M1 to M6, and the lower stage is composed of six sections L1 to L6. . A bullseye image 82 shown in FIG. 5B is obtained by developing a group of partitions having such a three-dimensional relationship on a two-dimensional plane. Corresponding to the three stages described above, there are three regions concentrically, where the central region has four sections H1 to H4, the central region has six sections M1 to M6, and the outside This region has six sections L1 to L6. Since the three-dimensional shape has been developed two-dimensionally, the shape size of each section is modified or changed, but it is roughly understood that the arrangement of the entire section group is maintained. Actually, the bullseye image 82 is formed with a concentric pattern as an array as if each section was viewed from the inside of the left ventricle. Incidentally, the section 84A shown in (A) corresponds to the section 84B shown in (B), and similarly, the section 86A shown in (A) corresponds to the section 86B shown in (B).

  In the present embodiment, three cross sections are set, but two cross sections or four or more cross sections may be set. In other words, the present invention can be applied not only when displaying a bullseye image as shown, but also when displaying a wide spread image.

  FIG. 5 shows an example of a display image displayed on the display unit 62 shown in FIG. This display image includes a composite image 100, a bullseye image 102, a schema image set 104, an electrocardiogram waveform 106, and a numerical value display column 108. Each will be described below.

  In the example shown in the figure, the composite image 100 is made up of a B-mode image (two-dimensional tomographic image) 101A and an overlay image 101B displayed so as to overlap therewith. The B-mode image 101A is a black and white grayscale image, and in this example, a cross section of the heart is represented. In particular, the cross section of the left ventricle is shown. The overlay image 101B is a graphic image synthesized and displayed on the B-mode image as described above, and includes a plurality of observation point sequences set on the outer edge of the myocardium in the left ventricle and a plurality of sets set on the inner edge of the myocardium. And a series of observation points. All or part of the observation point sequence is set by the user. Based on a plurality of observation points set by the user, observation points are automatically added by interpolation processing or the like as necessary. In the figure, trace lines are generated by applying spline processing to multiple observation points set on the outer edge, and similarly, spline processing is applied to multiple observation points set on the inner edge. By doing so, a trace line is generated. Between the two trace lines, a plurality of lines are set between both ends thereof, thereby defining a plurality of sections, that is, six sections in the figure.

  Each section is defined by at least four observation points. In the illustrated example, the shape of each section is defined by six points. Of course, the shape may be determined by more observation points. The pattern matching process described above is applied between frames for each observation point, and a two-dimensional movement vector between frames is calculated.

  In the overlay image 101B, a connected body is constituted by a plurality of sections, and specifically, it is a series of six sections. In the present embodiment, as described above, the measurement value is calculated for each section at each time phase, and the measurement value is expressed in color. Specifically, a color corresponding to the measurement value provided for each section is given to the section, that is, the section is colored (see FIG. 7). However, the coloring process is a display process with a transparency that does not unnecessarily obstruct the observation of the B-mode image as the background.

  The bullseye image 102 is a bullseye image after color display processing is performed in the illustrated example. As described above, the bullseye image is configured as an aggregate of a plurality of sections, and the measurement value obtained for each section is expressed as the coloring content of each section. For example, the code | symbol 114 represents one division, The pigment | dye and brightness | luminance corresponding to the measured value calculated | required about the said division are given about the division. Incidentally, the measured value is displayed as a numerical value for each section (see reference numeral 114), and the measured value can be specifically understood as a numerical value. However, in order to intuitively understand the tendency and change of the entire measurement value, it is desirable to perform the color processing as described above.

  In the present embodiment, the schema image set 104 includes three schema images. Specifically, it corresponds to three cross sections set for the left ventricle. Three schema images 116, 118, and 120 are displayed. Each schema image represents a standard tissue form appearing on a corresponding cross section as a schematic diagram. Further, in the present embodiment, each schema image includes a plurality of schema images set on a corresponding cross section. In addition, color display processing is applied to each of the sections. The same color conversion function is used in the color display processing of the overlay image 101B, the bullseye image 102, and the schema image set 104, that is, colors are associated with each other among the three images. That is, when attention is paid to a certain section, the section is expressed by the same color in each image. However, the identity of the color in that case is sufficient if it is the identity of the user.

  In the example shown in FIG. 5, color display processing is performed on each of the displayed three schema images 116, 118, and 120. In this example, three schema images corresponding to three cross-sections that are orthogonal to each other are represented, and among them, a frame marker 112 is attached to a specific schema image 120. The frame marker 112 is a highlight display or a specific color display. The schema image 120 to which the frame marker 112 is attached corresponds to the composite image 100 displayed on the left side, that is, represents the currently selected cross section. In the example shown in FIG. 5, the cross section to which the frame marker 112 is attached cannot be recognized in the bullseye image 102, but in FIG. 10 shown later, the section corresponding to the selected cross section in the bullseye image 102 is shown. Only the color is expressed. This makes it easy to intuitively recognize the cross section. This will be explained again later.

  The electrocardiogram waveform 106 is generated based on the electrocardiogram signal, and the electrocardiogram waveform represents a specific waveform among the three electrocardiogram waveforms stored in the cine memory. Which waveform is selected may be appropriately determined. This is because in the present embodiment, it is assumed that the electrocardiographic waveforms are substantially the same between the three cross sections. Reference numeral 124 represents a time phase bar, and this time phase bar represents the timing at which the composite image 100 is acquired on the time axis. That is, what corresponds to the time phase represented by the time phase bar 124 is the composite image 100, and the bullseye image 102 and the schema image set 104. The time phase bar 124 can be fixed, that is, each image can be displayed as a still image. By moving the time phase bar 124 by the user, each image can be displayed for any time phase. . That is, the time phase bar 124 and the time phase of each image are linked. It is also possible to automatically display each image as a moving image by changing the time phase automatically. In this case, the time phase bar 124 moves in the time axis direction.

  Reference numeral 108 represents a numerical value display field as described above. In this embodiment, the bullseye image 102 includes 16 sections. In the numerical value display field 108, the measured value measured for each section is a numerical value. Is displayed.

  In the present embodiment, as described above, the abnormality determination function is provided, and when an error is determined in the pattern matching process or in the measurement value calculation process, an error is identified to identify the section related to the error determination. A marker 122 is displayed. In this embodiment, the error marker 122 is displayed in the vicinity of a section related to the occurrence of an error in the schema image set. Of course, an error may be positively displayed using color expression instead of such a graphic marker. Further, the display may be controlled so that the error section can be specified in the bullseye image. The same applies to B-mode images.

  As described above, according to the present embodiment, in addition to the composite image and the bullseye image, a schema image set is displayed, and for the schema image set, a part or all of the schema image set is displayed. Since the same color display processing is applied, it is possible to easily understand the partition correspondence between these images by observing the bullseye image or the synthesized image via such a schema image set. . In addition, if color display processing is applied to all of the schema image sets, the spatial distribution of the measurement values that form the basis of the bullseye image and its changes can be determined by simply observing these three schema images. It can be easily recognized. That is, it is possible to confirm on the screen the changes in the measured values on the other two cross sections that do not appear in the B-mode image. Further, in the present embodiment, it is possible to immediately recognize the relationship between the currently recognized B-mode tomographic image and the corresponding schema image by displaying or specifying the frame marker.

  Next, the image processing in the PC 40 shown in FIG. 1 will be described more specifically based on FIG. The flowchart shown in FIG. 8 is executed in a state where, for example, the arrangement for three cross sections is selected. Of course, such a selection may be made during the execution of the flowchart. This flowchart is executed after the data is fetched from the cine memory.

  In S10, a view is selected by the user. That is, a specific cross section among the three cross sections is selected. This selection corresponds to the selection of a specific frame sequence on the cine memory. In S12, a B-mode tomographic image is displayed as a still image or a moving image based on the selected frame sequence. The user selects a reference frame (initial frame) for designating a plurality of observation points while viewing such a tomographic image. In S14, a plurality of observation points (tracking points) are manually specified on the selected reference frame using a pointing device. In this case, a plurality of observation point sequences are designated by the user along the outer edge and inner edge of the myocardium appearing in the reference frame. As necessary, interpolation processing is applied to the observation point sequence, and interpolation points are automatically added.

  When a plurality of observation points are designated for the reference frame in this way, in S16, pattern matching processing, that is, tracking processing is executed for each observation point between frames after the reference frame. This will be described with reference to FIG. 6. (A) shows the previous frame, and (B) shows the rear frame. When the attention point 126 is currently specified on the previous frame, the corresponding point 130 corresponding to the attention point 126 is specified in the subsequent frame, and the search area 132 is defined based on that. A comparison window 134 to be compared with the original window 128 is sequentially set in the search area 132 while changing its position. The correlation value between the two windows is calculated for each window position, the best window position is specified at the position where the best correlation value is obtained, and the point that forms the center point of the window position is the position of the new attention point. It is determined as Accordingly, a two-dimensional movement vector is defined as a difference in coordinates between the attention point on the previous frame and the attention point on the rear frame. Such pattern matching processing between frames is executed for each frame, that is, for each time phase, and for each observation point.

  Returning to FIG. 8, in S16, an error is determined in tracking in this embodiment, that is, an error is determined when, for example, an abnormal correlation value is obtained. Subsequently, in S18, the bullseye image and the selected schema image set are displayed on the screen. If already displayed, this step is omitted. The selected schema image set corresponds to the array selected by the user from the first array or the second array described above. A frame marker is added to the currently recognized B-mode image, that is, the schema image corresponding to the cross section. This state is shown in FIG. At present, the processing of the first frame sequence is performed, and the measurement values are not yet calculated. Therefore, the color display processing is not yet applied to each image shown in FIG. The composite image 100A is composed of a B-mode image 101A and an overlay image 101C, where the overlay image 101C includes a plurality of observation points and trace lines connecting them, and further includes a plurality of lines connecting two trace lines. Yes. However, although each section is defined, the coloring process is not applied to it. Similarly, color display processing is not performed on the bullseye image 102 and the schema image set 104A. However, a frame marker 142 is attached to a specific schema image 140, and the frame marker 142 represents a cross section that is currently focused on. That is, a frame marker is added to the schema image 140 corresponding to the cross section. Such a specific schema image 140 is grayed or colored differently from the color representing the measurement value. Similarly, in the bullseye image 102A, identification processing is performed on a plurality of sections corresponding to the current cross section (see reference numeral 136). The identification process corresponding to the plurality of sections on the schema image 140 and the bullseye image 102A corresponding to the cross section only needs to be capable of intuitively recognizing the cross section, and any marker is displayed regardless of the coloring process or the gray expression. You may make it do. For example, a line graphic indicating a cross section as indicated by reference numeral 138 may be expressed.

  Returning to FIG. 8 again, in S20, the measurement is executed for each frame for each frame, and the measurement result is reflected in the bullseye image or the like. The reflection of the measurement value may be performed every time the measurement value calculation process for each frame is performed, or may be performed after the measurement value calculation for all the frames is completed. The area where the color display processing is performed in the bullseye image is enlarged according to the number of repetitions of S10 to S20 for the three cross sections.

  In S22, it is determined whether or not there is an unprocessed view among the three cross sections, that is, the three views. If there is such an unprocessed view, each step after S10 is repeatedly executed. On the other hand, if there is no such view in S22, S24 is executed.

  FIG. 10 shows a state after step S20 shown in FIG. 8 is applied to the first cross section. That is, in the bullseye image 102B, color display processing is performed only on six sections corresponding to the currently selected cross section (see 144). Similarly, in the schema image set 104B, only a specific schema image 140 is subjected to color display processing, and a frame marker 142 is displayed to represent it. In the electrocardiogram waveform 106B, the currently displayed time phase is represented by a time phase marker 124 on the time axis. The composite image 100B represents a tomographic image corresponding to the time phase. Specifically, the composite image 100B is composed of the B-mode tomographic image 101A and the overlay image 101B subjected to color display processing as described above. Has been. The overlay image 101B is an image that has been painted with a sense of transparency, and a tissue structure as a background can be observed through the overlay image 101B.

  Therefore, when the processing of S10 to S20 shown in FIG. 8 is repeated, the area subjected to color display processing in the bullseye image and schema image sets increases, and finally the display image as shown in FIG. Can be obtained. Of course, it is also possible to configure display contents in which color display processing is performed only on a specific cross section as shown in FIG. That is, it is possible to select either the partial processing mode or the full processing mode.

  Returning to FIG. 8, in S24, a time phase is designated by the user as necessary, and the display content corresponding to the time phase is displayed on the screen. In that case, the time phase may be changed manually, or the time phase may be switched continuously, that is, automatically.

  In the above embodiment, an overlay image, a bullseye image, and a schema image set that have been subjected to color display processing can be obtained regardless of whether the single color display mode or the all color display mode is selected. The user can intuitively recognize the correspondence between the partitions between the images by referring to the color display processing result on such an image, and in particular, can easily grasp the position of the cross section in the three-dimensional space. .

  20 cine memory, 42 tracking unit, 44 measuring unit, 45 abnormality determining unit, 46 overlay image generating unit, 48 bullseye image generating unit, 50 schema image processing unit, 60 display processing unit.

Claims (7)

In an ultrasonic image processing apparatus that processes a plurality of frame sequences corresponding to a plurality of cross sections set for a moving tissue in a living body,
A calculation means for calculating a motion evaluation value for each section and for each time phase for a plurality of sections defined on each cross section by sequentially analyzing a plurality of frames constituting each frame sequence in a time axis direction;
Means for generating a developed image representing a three-dimensional arrangement of a group of sections defined on the plurality of sections, wherein a first section-specific display process is performed on all or a part of the developed image; Image generation means;
A means for generating a simulated image set representing a tissue form and a plurality of sections on each cross section, wherein a second image generation is performed by applying a second section-specific display process to all or a part of the simulated image set. Means,
Including
The first section-specific display process and the second section-specific display process are processes for changing the display mode of each section according to the motion evaluation value calculated for each section and for each time phase,
The ultrasonic image processing apparatus, wherein a simulated image set after the second section display process is displayed together with the developed image after the first section display process. The apparatus of claim 1.
A tomographic image forming means for forming a tomographic image based on each frame in a frame sequence corresponding to a selected cross section selected from the plurality of cross sections;
Means for generating an overlay image synthesized with the tomographic image and representing a plurality of sections on the selected cross section, wherein a third image generating means for performing a third section-specific display process on the overlay image;
Including
The display processing according to the third section is a process of changing the display mode of each section according to the motion evaluation value calculated for each section and for each time phase,
Together with the combined image generated by synthesizing the expanded image after the first section display processing and the overlay image after the third section display process with the developed image after the first section display processing and the tomographic image, the second section display An ultrasonic image processing apparatus, wherein a simulated image set after processing is displayed. The apparatus according to claim 1 or 2,
In the partial processing mode, the first image generation unit performs the first image generation on a plurality of sections corresponding to a selected section selected from the plurality of sections in the section group displayed in the development image. Perform the display processing by 1 division,
In the partial processing mode, the second image generation unit performs the second section-specific display processing on the simulated image corresponding to the selected section in the simulated image set. Ultrasonic image processing device. The apparatus according to claim 1 or 2,
The first image generation means performs the first section-specific display processing for all of the section groups displayed in the development image in the all processing mode,
The ultrasonic image processing apparatus, wherein the second image generation means performs the second section-specific display processing on the entire simulated image set in the all processing mode. The apparatus according to claim 1 or 2,
The computing means is
Means for calculating a two-dimensional movement of a plurality of observation points between frames in each frame sequence;
Means for calculating a motion evaluation value for each block based on two-dimensional movement of the plurality of observation points;
Means for determining an error point among the plurality of observation points based on at least one of the two-dimensional movement of the plurality of observation points and the motion evaluation value of the partition unit;
Including
The ultrasonic image processing apparatus, wherein the second image generation means performs an identification process on the simulated image set so that a section corresponding to the error point is identified. The apparatus of claim 2.
The ultrasonic image processing device according to any one of claims 1 to 3, wherein the first to third divisional display processes are processes that give the same hue and luminance according to the motion evaluation value. An ultrasound image processing program executed in an ultrasound image processing apparatus for processing a plurality of frame sequences corresponding to a plurality of cross sections set for a moving tissue in a living body,
A function of calculating a motion evaluation value for each section and for each time phase for a plurality of sections defined on each cross-section by sequentially analyzing each frame sequence in the time axis direction;
A function of generating a developed image representing a three-dimensional arrangement of a group of sections defined on the plurality of sections, a function of performing a first section-specific display process on all or a part of the developed image;
A function of generating a simulated image set representing a tissue form and a row of sections on each cross section, a function of performing a second section-specific display process on all or a part of the simulated image set;
Including
The first section-specific display process and the second section-specific display process are processes for changing the display mode of each section according to the motion evaluation value calculated for each section and for each time phase, An ultrasound image processing program, wherein a simulated image set after the second section display processing is displayed together with a developed image after the first section display processing.

Images