WO2018090654A1

WO2018090654A1 - Fpga-based space compound imaging method and device

Info

Publication number: WO2018090654A1
Application number: PCT/CN2017/092936
Authority: WO
Inventors: 朱曦; 叶宗英; 刘辉; 黄明军
Original assignee: 深圳开立生物医疗科技股份有限公司
Priority date: 2016-11-21
Filing date: 2017-07-14
Publication date: 2018-05-24
Also published as: CN106780349A; CN106780349B

Abstract

An FPGA-based space compound imaging method and device. The method comprises: acquiring ultrasonic non-space compound image data at different deflection angles (S101); carrying out interleaving processing on the ultrasonic non-space compound image data (S102); correcting the coordinates of the ultrasonic non-space compound image data, which has undergone interleaving processing, so as to recover image data subjected to angle deflection to image data with zero angle deflection (S103); carrying out de-interleaving processing on the image data, the coordinates thereof having been corrected (S104); and superposing pixel points corresponding to the de-interleaved ultrasonic non-space compound image data with different deflection angles, and generating a space compound image (S105). The present invention reduces the complexity of implementing a space compound algorithm, can effectively improve a space compound calculation speed, reduces the processing time for an image, and improves an imaging frame rate.

Description

Space composite imaging method and device based on FPGA

The present application claims priority to Chinese Patent Application No. 201611023419.4, entitled "Synthesis-Based Space Imaging Method and Apparatus Based on FPGA", filed on November 21, 2016, the entire contents of which are incorporated herein by reference. In the application.

Technical field

The present invention relates to the field of medical ultrasonic imaging technology, and in particular to an FPGA-based spatial composite imaging method and apparatus.

Background technique

Spatial composite imaging in medical ultrasound imaging systems is an imaging method that scans scanned objects at different angles and then superimposes the corresponding pixels of these different angles to form an image. Space composite imaging technology can improve the detail performance of the image, reduce the influence of speckle noise, clutter and other ultrasonic artifacts on the image quality, enhance the resolving power between tissues, and obviously improve the low contrast tissue in the ultrasound image. The sharpness of the tiny lesions clearly shows the boundaries between the tissues.

The existing spatial composite imaging technology scans the target tissue from different angles by the deflection of the scan line, and obtains images of these different scan angles, and then weights the pixels corresponding to the images to form an image. Usually, spatial compounding algorithms are implemented in the CPU through software programming. When the spatial composite imaging is implemented, it is not necessary to wait for all angles to be scanned before performing a composite image processing, but a scrolling process is adopted. Taking spatial composite imaging with three angles of deflection as an example, the angle A/B/C. The previous cycle scan obtains the image of three angles of A0/B0/C0 to obtain a spatial composite image Y0. When A1 of the next scan cycle is acquired, the output of Y1 can be obtained by B0/C0/A1. It can be simply represented as Y1=Y0-A0+A1, and so on, a single spatial composite output can be obtained for each image with a deflection angle.

If the frame rate of spatial composite imaging is to reach the frame rate of ordinary B-mode imaging (non-spatial composite), there are certain requirements for the computing power and data scheduling performance of the CPU. If the CPU performance is not enough, it will lead to a longer time to implement the spatial composite algorithm, resulting in lower frame rate of ultrasound imaging. Therefore, It is very necessary to provide a spatial composite imaging method that increases processing speed and imaging frame rate.

Summary of the invention

It is an object of the present invention to provide a spatial composite imaging method and apparatus for solving the problem of slow processing speed and low imaging frame rate of the existing spatial composite.

To solve the above technical problem, the present invention provides an FPGA-based spatial composite imaging method, including:

Acquiring ultrasonic non-spatial composite image data of different deflection angles;

Interleaving the ultrasound non-spatial composite image data;

Performing coordinate correction on the interlaced ultrasonic non-spatial composite image data to restore the angularly deflected image data to the zero angle deflected image data;

Performing deinterleaving processing on the coordinate corrected image data;

The pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving are superimposed to generate a spatial composite image.

Optionally, the step of performing interleaving processing on the ultrasound non-spatial composite image data includes:

Separating the ultrasound non-spatial composite image data by using a preset window;

Performing pipelined interleaving processing on the segmented ultrasound non-spatial composite image data;

The interleaved image data is stored to an external storage device.

Optionally, the step of performing coordinate correction on the interlaced ultrasonic non-spatial composite image data comprises:

Acquiring the interleaved image data from the external storage device according to a preset direction;

Reading parameter information required for coordinate correction from the external storage device;

Performing coordinate correction on the interlaced ultrasonic non-spatial composite image data when the interleaved image data and the parameter information satisfy a preset threshold condition;

The coordinate corrected image data is stored to the external storage device.

The interpolated image data is registered by a linear interpolation algorithm;

Performing operations on the coordinates of the pixel points in the image data after the registration processing, processing the pixel points according to a preset boundary of the ultrasonic non-spatial composite image, and removing pixel points beyond the preset boundary, without being pre-predicted Set the pixel of the area covered by the boundary to zero.

Optionally, the step of performing deinterleaving processing on the coordinate-corrected image data includes:

Reading coordinate corrected image data from the external storage device;

Performing deinterleaving processing on the coordinate corrected image data;

The image data after deinterleaving is stored to the external storage device.

Optionally, the pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving are superimposed, and generating the spatial composite image includes:

Acquiring image data after deinterleaving processing from the external storage device;

Optionally, after the step of acquiring the ultrasonic non-spatial composite image data of different deflection angles, before the step of performing coordinate correction on the ultrasonic non-spatial composite image data after the interleaving processing, the method further includes:

The ultrasonic non-spatial composite image data is subjected to line smoothing processing and/or edge weakening processing.

Optionally, the step of performing line smoothing on the ultrasound non-spatial composite image data comprises:

The segmentation method is used for line smoothing preprocessing, and the original value is maintained at the edge of the line, and the third stage FIR filter is used for smoothing the middle segment line;

Wherein, if the number of buses is N and the current line number is n, the edge of the line is defined as n≤2, n≥N-2, and the middle segment line is positioned as 3≤n≤n-3.

The invention also provides an FPGA-based spatial composite imaging device, comprising:

Obtaining module for acquiring ultrasonic non-spatial composite image data with different deflection angles;

An interleaving module, configured to perform interleaving processing on the ultrasound non-spatial composite image data;

a coordinate correction module, configured to perform coordinate correction on the interlaced ultrasonic non-spatial composite image data to restore the angularly deflected image data to the image data with zero angle deflection;

a deinterleaving module, configured to perform deinterleaving processing on the coordinate corrected image data;

Composite module for ultrasonic non-spatial composite image with different deflection angles after deinterleaving A spatial composite image is generated by superimposing corresponding pixel points.

Optionally, it also includes:

a pre-processing module, configured to: after acquiring the ultrasonic non-spatial composite image data of different deflection angles, the ultrasonic non-spatial composite image data before the step of performing coordinate correction on the interlaced ultrasonic non-spatial composite image data Perform line smoothing and/or edge weakening.

The FPGA-based spatial composite imaging method and device provided by the invention obtain ultrasonic non-spatial composite image data with different deflection angles; interleave processing ultrasonic non-spatial composite image data; and perform ultrasonic non-spatial composite image data after interleaving processing Performing coordinate correction to restore the image data of the angular deflection to the image data of the zero angle deflection; deinterleaving the image data after the coordinate correction; and corresponding to the ultrasonic non-spatial composite image data of the different deflection angles after deinterleaving The pixels are superimposed to generate a spatial composite image. The application reduces the complexity of the spatial composite algorithm implementation, can effectively improve the speed of the spatial composite operation, reduce the processing time of the image, and improve the imaging frame rate.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are merely Some embodiments of the present invention may also be used to obtain other drawings based on these drawings without departing from the art.

1 is a flow chart of a specific implementation manner of an FPGA-based spatial composite imaging method provided by the present invention;

2 is a flowchart of another specific implementation manner of an FPGA-based spatial composite imaging method provided by the present invention;

3 is a flow chart showing steps of performing interleaving processing on ultrasonic non-spatial composite image data in an embodiment of the present invention;

4 is a flowchart of performing a coordinate correction step in an embodiment of the present invention;

FIG. 5 is a schematic diagram of still another specific implementation manner of the FPGA-based spatial composite imaging method provided by the present invention; FIG.

6 is a schematic diagram of an overall framework of a spatial composite imaging FPGA implementation;

7 is a flow chart of data processing implemented by a spatial composite imaging FPGA;

FIG. 8 is a structural block diagram of an FPGA-based spatial composite imaging apparatus according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below in conjunction with the drawings and embodiments. It is apparent that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

A flowchart of a specific implementation manner of the FPGA-based spatial composite imaging method provided by the present invention is shown in FIG. 1 , and the method includes:

Step S101: Acquire ultrasonic non-spatial composite image data of different deflection angles.

The ultrasonic probe emits an ultrasonic signal and receives ultrasonic echo signals of different deflection angles. The ultrasonic echo signals include ultrasonic non-spatial composite image data, that is, ultrasonic B image echo signals, and include beam signals and ADC acquisition echoes. Other signals such as signals. The ultrasonic echo signals of different deflection angles are stored, and may be stored in an external storage device such as a DDR memory. The ultrasonic non-spatial composite image data is read from the external storage device in step S101 of the embodiment.

Step S102: Perform interleaving processing on the ultrasound non-spatial composite image data.

Interleaving is essentially the realization of changing the information structure to the maximum without changing the content of the information. By interpolating the ultrasound non-spatial composite image data, the complexity of the spatial composite algorithm can be reduced.

Step S103: Perform coordinate correction on the interlaced ultrasonic non-spatial composite image data to restore the angularly deflected image data to the image data of the zero angle deflection.

Correcting the coordinates can uniformly restore the images of different deflection angles to the undeflected image for subsequent spatial recombination operations.

Step S104: Perform deinterleave processing on the coordinate-corrected image data.

In this step, the deinterleaving process is the inverse process of the interleaving process in step S102, and the image data is restored to the original image rule and size by deinterleaving the image data.

Step S105: superimposing pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving to generate a spatial composite image.

The spatial composite image can be obtained by fusing the ultrasonic non-spatial composite image data with different deflection angles.

The FPGA-based spatial composite imaging method provided by the invention acquires ultrasonic non-spatial composite image data with different deflection angles; interleaves the ultrasonic non-spatial composite image data; coordinates the interlaced ultrasonic non-spatial composite image data Correcting to restore image data of the angular deflection to image data of zero angle deflection; deinterleaving the image data after coordinate correction; and pixel points corresponding to ultrasonic non-spatial composite image data of different deflection angles after deinterleaving Perform superposition to generate a spatial composite image. The application reduces the complexity of the spatial composite algorithm implementation, can effectively improve the speed of the spatial composite operation, reduce the processing time of the image, and improve the imaging frame rate.

In this application, the spatial composite algorithm is implemented by FPGA. Since the internal buffer space of the FPGA is limited, an external storage device is required for data caching. The external storage device may be specifically an off-chip high-speed DDR3 memory (Double Data Rate SDRAM 3rd generation), and other devices capable of realizing storage are not limited to this one.

The process of spatial composite task scheduling of an FPGA and an external storage device is further elaborated below through a specific embodiment.

As shown in the flowchart of another embodiment of the FPGA-based spatial composite imaging method provided by the present invention, the process may specifically include:

Step S201: Acquire ultrasonic non-spatial composite image data of different deflection angles from an external storage device.

The ultrasound probe transmits an ultrasound signal and stores the received ultrasound non-spatial composite image data of different deflection angles into an external storage device. Preferably, the ultrasound non-spatial composite image data may be subjected to signal amplification, analog/digital conversion processing, beam synthesis, and digital before storage. Signal processing and other processes.

Step S202: performing pipelined interleaving processing on the ultrasonic non-spatial composite image data, and storing the interleaved image data to an external storage device;

In this embodiment, as shown in FIG. 3, the process of performing interleaving processing on the ultrasound non-spatial composite image data may specifically include:

Step S2021: Segmenting the ultrasound non-spatial composite image data by using a preset window.

When processing large-size image data, the FPGA requires a large amount of storage space if it is processed once. Therefore, in practical applications, due to limitations of storage space and logical resources, it is necessary to divide large-sized image data into small-sized image data for processing. Therefore, in this embodiment, the ultrasound non-spatial composite image data is segmented by a preset window. The size of the preset window may be 64 x 64 windows, or 128 x 128 or 32 x 32, which does not affect the implementation of the present invention.

Step S2022: Perform pipelined interleaving processing on the segmented ultrasound non-spatial composite image data.

The logic hardware circuit inside the FPGA divides the ultrasonic non-spatial composite image data into a plurality of 64×64 windows, and uses the window as a minimum unit to carry the data of the B image DDR3 buffer space to the logical internal Ram storage space. The logical hardware circuit performs pipelined interleaving processing on the logically buffered data in a window unit, and uploads the interleaved window data to an external cache device.

Among them, in the interleaving process of the buffer data, the ping-pong operation is performed by using the dual-chip Ram, so that the logical internal cache data can be continuously pipelined.

The ping-pong operation is applied to the processing technique of data flow control, and the data stream is equally allocated to two data buffers, and then switched according to the beat and the mutual cooperation, so that the data stream is in a continuous state to achieve data-free. The effect of seam buffering and processing.

Pipelined processing is a technical means in high-speed design that divides the data processing flow into several steps, the output of the previous step being the input to the next step. The biggest feature is that the processing of each step of the data stream is continuous in time, and the efficiency of data processing can be further improved by such setting.

It should be noted that in this embodiment, a window of 64×64 is used as a minimum processing unit, which is a preferred solution of the present invention in combination with the characteristics of the Xilinx tdpram resource, and the interlace can also be used. The window size of the control is modified to 128×128 or 32×32, etc., that is, the window size is different from the preferred scheme in the present invention, which does not affect the implementation of the present invention.

Step S203: Acquiring the data after the interleaving process from the external storage device, performing coordinate correction, and storing the corrected data to the external storage device;

In this embodiment, as shown in FIG. 4, the step of performing coordinate correction may be specifically as follows:

Step S2031: Acquire interlaced image data from an external storage device according to a preset direction.

The preset direction may be specifically: according to the depth direction of the ultrasonic echo signal, that is, the direction in which the ultrasonic probe is measured by the human body. The logic hardware circuit reads the interleaved data from an external storage device in units of different lines of the same depth. Similarly, the scheduling method can also be implemented by using queue flow control to improve the efficiency of data processing.

Step S2032: Read parameter information required for coordinate correction from an external storage device.

It should be noted that the processing may be performed in parallel between step S2031 and step S2032, and there is no order limitation.

Step S2033: Perform coordinate correction on the interlaced ultrasonic non-spatial composite image data when the interleaved image data and the parameter information satisfy a preset threshold condition.

In this embodiment, a threshold condition is set before the data signal processing, and the preset threshold condition is that both the parameter information required for the coordinate correction and the image data after the interleaving are reached.

The preset threshold condition may specifically determine whether the interleaved buffer area data and the status of the queue corresponding to the parameter are not empty, that is, whether data and parameters exist in the corresponding queue. The subsequent operations can be performed only when the interleaving buffer data and the parameter information arrive and the determination meets the preset threshold condition. When the preset threshold condition is not met, the process of performing task scheduling is returned until the preset threshold condition is met.

Coordinate correction includes two processes: registration processing and boundary processing.

Among them, the registration process can use a linear interpolation algorithm to register the image data. In this embodiment, a Catmull-ROM linear interpolation algorithm is employed. The Catmull-ROM interpolation algorithm performs coordinate correction by first performing linear interpolation in the longitudinal direction (depth direction) and then interpolating in the lateral direction (line direction). Of course, other interpolation algorithms can also be used, which will not be repeated here.

The boundary processing includes: calculating coordinates of pixel points in the image data after registration processing. The pixel points are processed according to the preset boundary of the ultrasonic non-spatial composite image, and the pixel points beyond the preset boundary are removed, and the pixel points of the area not covered by the preset boundary are zero-padded. The preset boundary is the boundary size range corresponding to the originally acquired ultrasonic non-spatial composite image.

In this embodiment, the parameter information required for coordinate correction specifically includes parameters required for the linear interpolation algorithm in the registration process and size parameters of the preset boundary in the boundary processing process.

Step S204: The coordinate-corrected image data is read from the external storage device, the coordinate-corrected image data is deinterleaved, and the de-interleaved data is stored to the external storage device.

Step S205: Acquire deinterleaved data from the external storage device, and superimpose the pixels corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving to generate a spatial composite image.

By superimposing the pixels corresponding to the ultrasonic non-spatial composite image data with different deflection angles, the normalization processing is performed, and the superimposed region of the ultrasonic non-spatial composite image is weakened.

The embodiment of the present application implements a spatial composite algorithm by using an FPGA, and uses an off-chip high-speed DDR memory for data buffering, and the FPGA implements data scheduling and composite operations through a high-speed access interface. The application can effectively improve the speed of the spatial composite operation, greatly reduce the processing time of the image, improve the imaging frame rate, and effectively improve the effect of the spatial composite imaging without replacing the CPU. In addition, the embodiment uses the external storage device buffer interleaving, coordinate correction, and deinterleaving image processing results, and the image data is scheduled to different degrees, thereby effectively improving the scale and efficiency of the FPGA image processing.

On the basis of any of the above embodiments, after the step of acquiring the ultrasonic non-spatial composite image data of the different deflection angles, the step of performing the coordinate correction on the ultrasonic non-spatial composite image data after the interleaving process may further include:

A process of performing line smoothing and/or edge weakening processing on ultrasonic non-spatial composite image data.

FIG. 5 is another specific example of the FPGA-based spatial composite imaging method provided by the present invention. As shown in the schematic diagram of the embodiment, the embodiment of the present invention uses an off-chip high-speed DDR memory for data caching, and the FPGA uses a high-speed access interface to implement a data scheduling and a compound operation by using a pipelined task control scheduling method. The process can specifically include:

Step S301: After the spatial recombination starts, the ultrasonic non-spatial composite image data in the DDR3 is read for interleaving processing.

Step S302: Read the interleave buffer data and the required parameters from the DDR3.

In this embodiment, the parameters required for processing include parameters and coefficients required in data processing such as line smoothing, edge weakening, and registration.

Step S303: determining whether the interleave buffer data and the parameter information in the data processing process meet the preset threshold condition, that is, whether the data and the parameters have all arrived; if yes, proceed to step S304; if not, return to step S302.

When reading the line data of all lines and the same depth after interleaving, the logic hardware circuit carries data and digital signal processing from the buffer DDR3 space in units of different lines of the same depth. The scheduling mode is implemented by using queue flow control, and threshold value judgment is set in the front end of the digital signal processing. When the state of the cached data event queue and the cache parameter queue are not empty at the same time, that is, in the queue container of the cached data and the cache parameter. When there are data and parameters at the same time, it is considered that the threshold judgment condition is satisfied, and line smoothing, edge weakening, and registration processing are started.

In this embodiment, the depth direction refers to the vertical direction, that is, the direction in which the probe is measured to the human body, and the horizontal direction is the method of line scanning.

Step S304: When the threshold judgment condition is satisfied, the interlaced buffer area data is subjected to line smoothing processing to reduce the near field jagged shape and the far field mosaic of the ultrasonic image.

For line smoothing of line data of different lines at the same depth, segmentation processing may be specifically adopted, including maintaining the original value and the intermediate line data FIR filtering at the line edge, wherein the number of buses is N, and the current line number is n, Then the line edge is defined as n ≤ 2, n ≥ N-2, and the middle section is defined as 3 ≤ n ≤ n-3. The logic hardware circuit performs special processing on the edge of the line by changing the weighting coefficient at the edge of the line, that is, keeping the original value unchanged; the middle line is smoothed, and the third-order FIR filtering is used, and the result of the smoothed output is smoothed.

In this embodiment, the third-order FIR filtering method is adopted, which satisfies the requirement of smoothing the ultrasound image, and is easier to implement than the fifth-order filtering and the seventh-order filtering. Passing on ultrasound Like line smoothing, it can reduce near-field jagged and far-field mosaic.

Step S305: Perform edge weakening processing on the data after the interleaving buffer smoothing to reduce artifacts after the ultrasound image is merged.

Step S306: Perform registration and boundary processing on the data of the interleaved buffer edge weakening process to perform coordinate correction on the images of different deflection angles.

The embodiment of the present invention adopts the Catmull-ROM interpolation algorithm for coordinate correction, first performing linear interpolation in the longitudinal direction, and then performing interpolation calculation in the lateral direction (line direction).

Registration processing of line data at the same depth, including FPGA implementation of Catmull-ROM linear interpolation algorithm, synchronization operation between interpolation coefficient and echo data required by Catmull-ROM algorithm, and dual parallel registration processing unit. The two-way parallel registration processing unit multiplies the data and the interpolation coefficient by a 2×4 operation window in a 4×4 shift window according to the Catmull-ROM interpolation rule, and outputs a registration process every four clock cycles. result.

The registration processing may specifically adopt a two-way parallel registration processing unit, which is a preferred scheme made by the present invention in combination with the FPGA system logic resources of the ultrasound system, and may have other methods. For example, the registration processing unit can be extended to four channels, six channels, and eight channels to increase the rate of registration processing, that is, the number of paths of the processing unit to be registered in the preferred scheme of the present invention is not the same value, which does not affect the present invention. Implementation of the invention.

When performing boundary processing on the line data at the same depth, the logic hardware circuit calculates the coordinates of the pixel points in the image data after the registration interpolation, and then constrains the registered pixel points according to the boundary of the ultrasonic B echo image. Discard pixels that are beyond the boundary of the B image, and zeros are added to areas that are not registered.

Step S307: Deinterleave the interleave buffer data to restore the image to the original image rule and size.

Step S308: Normalize the data after the deinterleaving process, and fuse the ultrasound images with different deflection angles.

On the basis of any of the above embodiments, before storing the ultrasonic echo signal data of different deflection angles, the embodiment of the present invention further includes: performing signal amplification, analog/digital conversion processing, beam synthesis, and the ultrasonic echo signal. Digital signal processing.

It should be noted that, in this embodiment, the data stream processing is performed according to interleaving, line smoothing, edge weakening, The registration, the boundary processing, the de-interlacing, and the normalization are sequentially performed. This method is a preferred solution implemented by the present invention in combination with an algorithm, and of course, there may be other methods. For example, the position of the line smoothing and the edge weakening may be interchanged, or the position of the line smoothing and the edge weakening may be completed before the interleaving, that is, the data stream processing sequence of the present invention may be exchanged.

Figure 6 is a schematic diagram of the overall framework of the space composite imaging FPGA implementation. The upstream of the system is the user configuration interface and the DDR3 high-speed read interface, and the downstream of the system is the DDR3 high-speed storage interface. The entire system data stream is from left to right. First, the interleaving processing module (INLE) acquires ultrasonic echo signals of different deflection angles from DDR3 for interleaving processing; then the signal processing module (SCON_PRO) performs the interleaved ultrasonic echo signals. Edge weakening, line smoothing, registration, and boundary processing; then the de-interleaving module (INV_INLE) restores the signal-processed echo signal to the ultrasound signal in the usual format; finally, the different deflection angles are returned by the fusion (NOR) module. Boss is normalized to obtain a spatial composite image.

Figure 7 is a flow chart of data processing implemented by a spatial composite imaging FPGA. The figure identifies the signal name, symbol, bit width and precision of the input/output of the data processing link. Take sample_shift s15.5 as an example, where sampe_shift is the signal name and s. Represents a signed signed number, 15 represents an integer part with a bit width of 15, and .5 represents a fractional part with a bit width of 5 and a signal overall bit width of 20. As shown in the figure, DownSizer is mainly used for bit width truncation of digital signals, UpSizer is used for bit width expansion of digital signals, Edge_weak is edge weakening processing module, and Scon_Cal is registration coordinate transformation module.

In this embodiment, the interleaving preprocessing of the ultrasonic echo signals can greatly reduce the complexity of the spatial composite algorithm implementation, and thus can pass the field programmable logic when the actual imaging frame rate is low and the CPU performance of the medical ultrasound system is insufficient. The array FPGA performs storage scheduling, hardware acceleration, and spatial composite processing on the ultrasonic non-spatial composite image data.

The FPGA-based spatial composite imaging apparatus provided by the embodiment of the present invention is described below. The FPGA-based spatial composite imaging apparatus described below and the FPGA-based spatial composite imaging method described above can be mutually referenced.

FIG. 8 is a structural block diagram of an FPGA-based spatial composite imaging apparatus according to an embodiment of the present invention. The space-based composite imaging apparatus based on the FPGA may include:

The acquiring module 100 is configured to acquire ultrasonic non-spatial composite image data with different deflection angles;

The interleaving module 200 is configured to perform interleaving processing on the ultrasound non-spatial composite image data;

The coordinate correction module 300 is configured to perform coordinate correction on the interlaced ultrasonic non-spatial composite image data to restore the angularly deflected image data to the image data with zero angle deflection;

The deinterleaving module 400 is configured to perform deinterleaving processing on the coordinate corrected image data;

The composite module 500 is configured to superimpose pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving to generate a spatial composite image.

The application reduces the complexity of the spatial composite algorithm implementation, can effectively improve the spatial composite operation speed, reduce the processing time of one frame of image, and improve the imaging frame rate.

In summary, this application replaces the traditional MPU processor with a field programmable logic array FPGA to realize the spatial composite function on the medical ultrasound image service. On the one hand, it provides a variety of implementation methods for ultrasound image processing-space composite; on the other hand, FPGA hardware acceleration can effectively improve the rate and imaging frame rate of spatial composite implementation. In addition, the present invention first pre-interleaves the ultrasonic non-spatial composite image data, and then performs line smoothing, edge weakening, and registration processing, which greatly reduces the complexity of the spatial composite FPGA implementation and saves the logic of the FPGA. Resources.

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts of the respective embodiments may be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

A person skilled in the art will further appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate the hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

The steps of the method or algorithm described in connection with the embodiments disclosed herein may be directly applied to the hard Implemented by a piece of software, a software module executed by a processor, or a combination of both. The software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

The FPGA-based spatial composite imaging method and apparatus provided by the present invention are described in detail above. The principles and embodiments of the present invention have been described herein with reference to specific examples, and the description of the above embodiments is only to assist in understanding the method of the present invention and its core idea. It should be noted that those skilled in the art can make various modifications and changes to the present invention without departing from the spirit and scope of the invention.

Claims

An FPGA-based spatial composite imaging method, comprising:

Acquiring ultrasonic non-spatial composite image data of different deflection angles;

Interleaving the ultrasound non-spatial composite image data;

Performing coordinate correction on the interlaced ultrasonic non-spatial composite image data to restore the angularly deflected image data to the zero angle deflected image data;

Performing deinterleaving processing on the coordinate corrected image data;

The pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving are superimposed to generate a spatial composite image.
The FPGA-based spatial composite imaging method according to claim 1, wherein the step of performing interleaving processing on the ultrasound non-spatial composite image data comprises:

Separating the ultrasound non-spatial composite image data by using a preset window;

Performing pipelined interleaving processing on the segmented ultrasound non-spatial composite image data;

The interleaved image data is stored to an external storage device.
The FPGA-based spatial composite imaging method according to claim 1, wherein the step of performing coordinate correction on the interlaced ultrasonic non-spatial composite image data comprises:

Acquiring the interleaved image data from the external storage device according to a preset direction;

Reading parameter information required for coordinate correction from the external storage device;

Performing coordinate correction on the interlaced ultrasonic non-spatial composite image data when the interleaved image data and the parameter information satisfy a preset threshold condition;

The coordinate corrected image data is stored to the external storage device.
The FPGA-based spatial composite imaging method according to claim 1, wherein the step of performing coordinate correction on the interlaced ultrasonic non-spatial composite image data comprises:

The interpolated image data is registered by a linear interpolation algorithm;

Performing operations on the coordinates of the pixel points in the image data after the registration processing, processing the pixel points according to a preset boundary of the ultrasonic non-spatial composite image, and removing pixel points beyond the preset boundary, without being pre-predicted Set the pixel of the area covered by the boundary to zero.
The FPGA-based spatial composite imaging method according to claim 3, wherein the step of deinterleaving the coordinate-corrected image data comprises:

Reading coordinate corrected image data from the external storage device;

Performing deinterleaving processing on the coordinate corrected image data;

The image data after deinterleaving is stored to the external storage device.
The FPGA-based spatial composite imaging method according to claim 5, wherein the superimposing pixels corresponding to different non-spatial composite image data of different deflection angles are superimposed to generate a spatial composite image comprising:

Acquiring image data after deinterleaving processing from the external storage device;

The pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving are superimposed to generate a spatial composite image.
The FPGA-based spatial composite imaging method according to any one of claims 1 to 6, wherein after the step of acquiring ultrasonic non-spatial composite image data of different deflection angles, after the pair of interleaving processes Before the step of performing coordinate correction on the ultrasonic non-spatial composite image data, the method further includes:

The ultrasonic non-spatial composite image data is subjected to line smoothing processing and/or edge weakening processing.
The FPGA-based spatial composite imaging method according to claim 7, wherein the step of performing line smoothing on the ultrasonic non-spatial composite image data comprises:

The segmentation method is used for line smoothing preprocessing, and the original value is maintained at the edge of the line, and the third stage FIR filter is used for smoothing the middle segment line;

Wherein, if the number of buses is N and the current line number is n, the edge of the line is defined as n≤2, n≥N-2, and the middle segment line is positioned as 3≤n≤n-3.
An FPGA-based spatial composite imaging device, comprising:

Obtaining module for acquiring ultrasonic non-spatial composite image data with different deflection angles;

An interleaving module, configured to perform interleaving processing on the ultrasound non-spatial composite image data;

a coordinate correction module, configured to perform coordinate correction on the interlaced ultrasonic non-spatial composite image data to restore the angularly deflected image data to the image data with zero angle deflection;

a deinterleaving module, configured to perform deinterleaving processing on the coordinate corrected image data;

The composite module is configured to superimpose pixel points corresponding to the ultrasonic non-spatial composite image data of different deflection angles after deinterleaving to generate a spatial composite image.
The FPGA-based spatial composite imaging apparatus according to claim 9, wherein It also includes:

a pre-processing module, configured to: after acquiring the ultrasonic non-spatial composite image data of different deflection angles, the ultrasonic non-spatial composite image data before the step of performing coordinate correction on the interlaced ultrasonic non-spatial composite image data Perform line smoothing and/or edge weakening.