CN113311440A - Method for improving ultrasonic image quality and detection system thereof - Google Patents

Method for improving ultrasonic image quality and detection system thereof Download PDF

Info

Publication number
CN113311440A
CN113311440A CN202010118594.1A CN202010118594A CN113311440A CN 113311440 A CN113311440 A CN 113311440A CN 202010118594 A CN202010118594 A CN 202010118594A CN 113311440 A CN113311440 A CN 113311440A
Authority
CN
China
Prior art keywords
image
value
pixel
gray
foreground
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010118594.1A
Other languages
Chinese (zh)
Other versions
CN113311440B (en
Inventor
黄思华
黄建国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qisda Suzhou Co Ltd
Qisda Corp
Original Assignee
Qisda Suzhou Co Ltd
Qisda Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qisda Suzhou Co Ltd, Qisda Corp filed Critical Qisda Suzhou Co Ltd
Priority to CN202010118594.1A priority Critical patent/CN113311440B/en
Publication of CN113311440A publication Critical patent/CN113311440A/en
Application granted granted Critical
Publication of CN113311440B publication Critical patent/CN113311440B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/96Sonar systems specially adapted for specific applications for locating fish
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88Sonar systems specially adapted for specific applications
    • G01S15/89Sonar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/539Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)

Abstract

The invention provides a method for improving the quality of an ultrasonic image and a detection system thereof, which aim at the ultrasonic sampling image obtained by an ultrasonic detection system, small noise in the ultrasonic sampling image is firstly filtered, then the filtered ultrasonic sampling image is subjected to binarization processing according to a first threshold value to generate a binarization image, and then the binarization image is subjected to foreground expansion processing according to a second threshold value and the pixel value of the ultrasonic sampling image to generate an output image. The second threshold value is smaller than the first threshold value, the binarized image retains foreground image bodies of the ultrasonic sampled image with high echo characteristics, and the output image retains not only the foreground image bodies in the ultrasonic sampled image but also the foreground image edges thereof. And finally, carrying out post-processing on the ultrasonic sampling image according to the foreground and background information of the output image to generate an improved ultrasonic sampling image.

Description

Method for improving ultrasonic image quality and detection system thereof
Technical Field
The invention relates to the field of ultrasonic detection, in particular to a method for improving the quality of an ultrasonic image and a detection system thereof.
Background
Sound waves with frequencies above the audible range of the human ear are called ultrasonic waves (ultrasounds) under physical definition. Ultrasonic waves have a wide range of applications in military, medical, leisure and industrial fields, such as ultrasonic diagnostic equipment, ultrasonic microscopes, ultrasonic ranging, and ultrasonic detection.
The fish school detector is an ultrasonic detection system for identifying and detecting fish schools in water, and can enable a user to accurately judge the number and the inhabitation depth of fish schools. The working principle of the fish finder is that a continuous conical sound wave signal is sent to the water bottom through an ultrasonic sensor, when the sound wave touches underwater objects such as the water bottom, objects or fish schools, an echo generated by reflection is sent back to the sensor, and the echo state under the water surface can be displayed on a display screen of the fish finder after the signal is processed and calculated by the sensor.
In the application of a fish finder, the quality of the ultrasonic sampling image may be poor due to water turbidity, bubbles, waves or other environmental noise.
Disclosure of Invention
The present invention is directed to a method for improving the quality of an ultrasound image and a probe system thereof, which can improve the quality of an ultrasound image.
To achieve the above object, the present invention provides a method for improving the quality of an ultrasound image, the method comprising: receiving an ultrasonic sampling image; carrying out noise reduction processing on the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image; performing binarization processing on the noise-reduced ultrasonic sampling image according to a first threshold value to generate a binarization image, wherein the binarization image comprises at least one pixel with a gray scale value as a foreground value or at least one pixel with a gray scale value as a background value, and the foreground value and the background value are two different gray scale values respectively; performing foreground expansion processing on the binarized image according to a second threshold value and the ultrasonic sampling image to generate an output image, wherein the second threshold value is smaller than the first threshold value, and the foreground expansion processing comprises the following steps: for a first pixel at a first position in the ultrasonic sampling image, a second pixel at the first position in the binary image and a third pixel at the first position in the output image, judging whether the gray-scale value of the first pixel is larger than the second threshold value, judging whether the gray-scale value of the second pixel is the foreground value, and judging whether a pixel with the gray-scale value being the foreground value appears in a neighboring area of the second pixel in the binary image; and when the gray-scale value of the first pixel is judged to be larger than the second threshold value and the pixel with the gray-scale value being the foreground value appears in the adjacent area in the binary image, setting the gray-scale value of the third pixel in the output image as the foreground value; and post-processing the ultrasonic sampled image according to the foreground and background information of the output image to generate an improved ultrasonic sampled image,
preferably, the method further comprises: and when the pixel with the gray-scale value being the foreground value does not appear in the adjacent area, setting the gray-scale value of the third pixel as the background value.
Preferably, the method further comprises: and when the gray-scale value of the first pixel is not larger than the second threshold value and the gray-scale value of the second pixel is not the foreground value, setting the gray-scale value of the third pixel as the background value.
Preferably, the method further comprises: and when the gray-scale value of the second pixel is judged to be the foreground value, setting the gray-scale value of the third pixel as the foreground value.
Preferably, the binarization processing includes: when the gray scale value of a fourth pixel at the second position in the denoised ultrasonic sampling image is larger than the first threshold value, setting the gray scale value of a fifth pixel at the second position in the binarized image as the foreground value; and when the gray-scale value of the sixth pixel at the third position in the denoised ultrasonic sampling image is not greater than the first threshold value, setting the gray-scale value of the seventh pixel at the third position in the binarized image as the background value.
Preferably, the method further comprises: and scanning and converting the improved ultrasonic sampling image into an ultrasonic brightness image presented in a grid pixel mode.
Preferably, the "performing the noise reduction processing on the ultrasonic sampling image" specifically includes: reducing the ultrasonic sampling image by a preset multiplying power to generate a reduced image; filtering noise in the reduced image; and amplifying the noise-filtered reduced image by the preset magnification to generate the noise-reduced ultrasonic sampling image.
Preferably, the method further comprises: performing a gray level adjustment process on all pixels of the ultrasound sampled image according to the foreground and background information of the output image to generate the improved ultrasound sampled image, the gray level adjustment process comprising: reducing the gray scale value of one or more specific pixels in the ultrasound sampled image to generate the improved ultrasound sampled image, wherein the one or more specific pixels correspond to all pixels in the output image without the foreground value; and increasing the gray scale value of one or more specific pixels in the ultrasonic sampling image to generate the improved ultrasonic sampling image, wherein the one or more specific pixels correspond to all pixels with the foreground value in the output image.
Preferably, the "performing the post-processing on the ultrasound sample image" includes: setting the gray-scale value of the one or more specific pixels in the ultrasound sampled image to a predetermined value to generate the improved ultrasound sampled image, wherein the predetermined value is not greater than the second threshold and the one or more specific pixels correspond to all pixels in the output image that are not the foreground value.
In addition, the present invention provides a method for improving the quality of an ultrasound image, the method comprising: receiving an ultrasonic sampling image; carrying out noise reduction processing on the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image; performing binarization processing on the noise-reduced ultrasonic sampling image according to a first threshold value to generate a binarization image, wherein the binarization image comprises at least one pixel with a gray scale value as a foreground value or at least one pixel with a gray scale value as a background value, and the foreground value and the background value are two different gray scale values respectively; performing foreground expansion processing on the binarized image according to a second threshold value and the ultrasonic sampling image to generate an output image, wherein the second threshold value is smaller than the first threshold value, and the foreground expansion processing comprises the following steps: judging whether the gray-scale value of the first pixel is greater than the second threshold value and whether the gray-scale value of the second pixel is the foreground value or not according to the first pixel at the first position in the ultrasonic sampling image, the second pixel at the first position in the binary image and the third pixel at the first position in the output image; when the gray-scale value of the second pixel is judged to be the foreground value, setting the gray-scale value of the third pixel in the output image as the foreground value; and reducing the gray scale value of one or more specific pixels in the ultrasound sampled image to generate an improved ultrasound sampled image, wherein the one or more specific pixels correspond to all pixels in the output image that do not have the foreground value.
Preferably, the method further comprises: when the gray-scale value of the second pixel is judged not to be the foreground value, judging whether a fourth pixel with the gray-scale value being the foreground value appears in all pixels adjacent to the second pixel in the binary image; and setting the gray scale value of the third pixel in the output image as the foreground value when the gray scale value of the first pixel is judged to be larger than the second threshold value and the fourth pixel with the gray scale value being the foreground value appears in all pixels adjacent to the second pixel in the binarized image.
Preferably, the method further comprises: and when the gray-scale value of the second pixel is judged not to be the foreground value and the fourth pixel with the gray-scale value being the foreground value does not appear in all the pixels adjacent to the second pixel in the binary image, setting the gray-scale value of the third pixel as the background value.
Preferably, the binarization processing includes: and when the gray-scale value of the first pixel is not larger than the second threshold value and the gray-scale value of the second pixel is not the foreground value, setting the gray-scale value of the third pixel as the background value.
Preferably, the binarization processing includes: when the gray scale value of a fifth pixel at the second position in the denoised ultrasonic sampling image is larger than the first threshold value, setting the gray scale value of a sixth pixel at the second position in the binarized image as the foreground value; and when the gray scale value of the seventh pixel at the third position in the denoised ultrasonic sampling image is not greater than the first threshold value, setting the gray scale value of the eighth pixel at the third position in the binarized image as the background value.
Preferably, the method further comprises: and carrying out dynamic range adjustment processing and image enhancement processing on the ultrasonic sampling image according to the foreground and background information of the output image so as to generate the improved ultrasonic sampling image.
Preferably, the method further comprises: and scanning and converting the improved ultrasonic sampling image into an ultrasonic brightness image presented in a grid pixel mode.
Preferably, the "performing the noise reduction processing on the ultrasonic sampling image" specifically includes: reducing the ultrasonic sampling image by a preset multiplying power to generate a reduced image; filtering noise in the reduced image; and amplifying the noise-filtered reduced image by the preset magnification to generate the noise-reduced ultrasonic sampling image.
Preferably, the method further comprises: and increasing the gray-scale value of one or more specific pixels in the ultrasonic sampling image to generate the improved ultrasonic sampling image, wherein the one or more specific pixels correspond to all pixels with the foreground value in the output image.
Preferably, the method further comprises: setting the gray-scale value of the one or more specific pixels in the ultrasound sampled image to a predetermined value to generate the improved ultrasound sampled image, wherein the predetermined value is not greater than the second threshold and the one or more specific pixels correspond to all pixels in the output image without the foreground value.
An ultrasonic detection system, the system comprising: an ultrasonic transmitter for transmitting an ultrasonic signal; the ultrasonic receiver is used for receiving a reflected signal of the ultrasonic signal reflected by an object; an operation circuit for providing an ultrasonic sampling image related to the object according to the ultrasonic signal and the reflection signal; a scan converter for converting the ultrasonic sampled image into an ultrasonic brightness image represented by grid pixels; and an image processor for: carrying out noise reduction processing on the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image; performing binarization processing on the noise-reduced ultrasonic sampling image according to a first threshold value to generate a binarization image, wherein the binarization image comprises at least one pixel with a gray scale value as a foreground value or at least one pixel with a gray scale value as a background value, and the foreground value and the background value are two different gray scale values respectively; performing foreground expansion processing on the binarized image according to a second threshold value and the ultrasonic sampling image to generate an output image, wherein the second threshold value is smaller than the first threshold value, and the foreground expansion processing comprises the following steps: aiming at a first pixel at a first position in the ultrasonic sampling image, a second pixel at the first position in the binary image and a third pixel at the first position in the output image, judging whether a gray-scale value of the second pixel in the binary image is the foreground value, judging whether the gray-scale value of the first pixel is larger than a second threshold value, and judging whether a pixel with the gray-scale value as the foreground value appears in a neighboring area containing the second pixel in the binary image; when the gray-scale value of the second pixel in the binary image is judged to be the foreground value, setting the gray-scale value of the third pixel in the output image as the foreground value; when the gray-scale value of the first pixel is judged to be larger than the second threshold value and the pixel with the gray-scale value being the foreground value appears in the adjacent area in the binary image, setting the gray-scale value of the third pixel in the output image as the foreground value; when the gray-scale value of the second pixel in the binarized image is determined to be the background value and the gray-scale value of the first pixel is not greater than the second threshold value, setting the gray-scale value of the third pixel in the output image as the background value; when the pixel with the gray scale value being the foreground value does not appear in the adjacent area in the binary image, setting the gray scale value of the third pixel in the output image as the background value; and reducing the gray scale value of one or more specific pixels in the ultrasound sampled image to generate an improved ultrasound sampled image, wherein the one or more specific pixels correspond to all pixels in the output image that are not the foreground value.
Compared with the prior art, the ultrasonic detection system provided by the invention can remove or inhibit the low-echo background and high-echo small noise of the ultrasonic image, and reserve or strengthen the part with a specific volume and high echo characteristic, thereby improving the quality of the ultrasonic image.
Drawings
FIG. 1 is a block diagram of an ultrasonic detection system according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating operation of an ultrasonic detection system according to an embodiment of the present invention;
fig. 3 to 7 are schematic diagrams of an ultrasonic detection system according to an embodiment of the present invention during foreground expansion processing.
Detailed Description
In order to further understand the objects, structures, features and functions of the present invention, the following embodiments are described in detail.
Certain terms are used throughout the description and following claims to refer to particular components. As one of ordinary skill in the art will appreciate, manufacturers may refer to a component by different names. The present specification and claims do not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to.
Fig. 1 is a functional block diagram of an ultrasonic detection system 100 according to an embodiment of the present invention. The ultrasonic detection system 100 includes an ultrasonic transmitter 10, an ultrasonic receiver 20, an arithmetic circuit 30, an image processor 40, and a scan converter 50.
Fig. 2 is a flowchart illustrating the operation of the ultrasonic detection system 100 according to an embodiment of the present invention, which includes the following steps:
step 220: providing an ultrasonic sampling image; step 230 is performed.
Step 230: filtering out small noise in the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image; step 240 is performed.
Step 240: carrying out binarization processing on the noise-reduced ultrasonic sampling image to generate a binarization image; step 250 is performed.
Step 250: carrying out foreground expansion processing on the binary image to generate an output image; step 260 is performed.
Step 260: post-processing the ultrasonic sampling image according to the foreground and background information of the output image to generate an improved ultrasonic sampling image; step 270 is performed.
Step 270: the improved ultrasound sample image is scan converted (scan conversion) into an ultrasound intensity image represented in grid-like pixels.
In step 220, the ultrasound detection system 100 may provide an ultrasound sample image using the ultrasound transmitter 10, the ultrasound receiver 20, and the computing circuit 30. In the present invention, the ultrasonic transmitter 10 and the ultrasonic receiver 20 may employ an electrostrictive piezotransistor or a magnetostrictive sendust alloy. The ultrasonic transmitter 10 can convert the electric energy into mechanical oscillation to generate the ultrasonic detection signal S1, and the ultrasonic receiver 20 can convert the mechanical oscillation into the electric energy when receiving the ultrasonic reflection signal S2.
In one embodiment, the ultrasonic transmitter 10 and the ultrasonic receiver 20 may be implemented as the same ultrasonic sensor (transducer), and the transmission/reception period is switched by pulse width modulation, duty cycle (duty cycle) or counting.
In another embodiment, the ultrasonic transmitter 10 and the ultrasonic receiver 20 may be implemented as independent devices, respectively. However, it should be noted that the embodiments of the ultrasonic transmitter 10 and the ultrasonic receiver 20 do not limit the scope of the present invention, that is, the present invention is not limited thereto.
The ultrasonic wave has the characteristics of high frequency, short wavelength, small diffraction phenomenon, high directivity and the like, has strong penetrating power to liquid and solid, can generate obvious reflection to form reflection echo when contacting impurities or interfaces, and can change the frequency of the reflection wave due to Doppler effect when contacting a moving object. When the ultrasonic detection signal S1 transmitted by the ultrasonic transmitter 10 is reflected by an object within the detection range, a different ultrasonic reflection signal S2 is formed according to the size and distance of the object. Therefore, the operation circuit 30 in step 220 provides the ultrasonic sampling image M2 related to the detection range thereof according to the ultrasonic detection signal S1 and the ultrasonic reflection signal S2. The ultrasonic sampling image M2 is composed of pixels with gray-scale values, wherein a plurality of pixels in a row on the image represent a plurality of sampling points on a scanning line, the gray-scale value of each pixel can reflect the echo intensity of the corresponding sampling point, and the larger the gray-scale value is, the stronger the echo is.
In most underwater ultrasound detection applications, the object of interest to the user is generally characterized as being highly echoic and having a particular volume, while low echoic or too small of a volume is generally of insignificant background detail. For example, when the ultrasound detection system 100 is a fish detector, the quality of the sampled image may be poor due to water turbidity, bubbles, waves, or other environmental noise. In the ultrasonic sampling image M2 obtained for the fish school detection application, objects of interest to the user, such as fish schools in water, plants in water, or the bottom of a fish farm, generally have characteristics of high echo and specific volume, while small bubbles or impurities with high echo in water and background details with low echo are generally not of interest to the user.
In step 230, the image processor 40 may perform noise reduction on the ultrasound sample image M2 to filter out small noise, i.e., small volume noise in the ultrasound sample image M2. For example, the image processor 40 may first reduce the ultrasonic sample image M2 by a predetermined magnification to generate a reduced image, then filter the noise in the reduced image, and finally enlarge the noise-filtered reduced image by the predetermined magnification to generate the noise-reduced ultrasonic sample image M3.
In one embodiment, the image processor 40 may include a gaussian filter and a median filter to perform the above-mentioned noise reduction processing, but the implementation of the noise reduction processing is not limited to the scope of the present invention, i.e., the present invention is not limited thereto.
In step 240, the image processor 40 performs a binarization process on the noise-reduced ultrasonic sample image M3 to generate a binarized image M4. The invention can define three gray scale value parameters aiming at binarization processing in advance: a first threshold TH1, a foreground value a and a background value b. The first threshold TH1 is used to determine whether each pixel in the noise-reduced ultrasound sample image M3 is a foreground or a background, the foreground value a is a gray level of the foreground pixel, and the background value b is a gray level of the background pixel. When the gray level of the pixel in the denoised ultrasonic sampling image M3 is greater than the first threshold TH1, the image processor 40 determines that the pixel is a foreground, and sets the gray level of the pixel at the corresponding position in the binarized image M4 as a foreground value a; when the gray level of the pixel in the denoised ultrasonic sampling image M3 is not greater than the first threshold TH1, the image processor 40 determines that the pixel is a background, and sets the gray level of the pixel at the corresponding position in the binarized image M4 as a background value b. Therefore, the pixel in the binarized image M4 has only two gray-scale values, i.e., the foreground value a and the background value b, or only one of the foreground value a and the background value b.
In step 250, the image processor 40 performs foreground expansion processing on the binarized image M4 to generate an output image M5. The invention can define three gray scale value parameters aiming at the enlarged foreground processing in advance: a second threshold TH2, a foreground value a, and a background value b. The second threshold TH2 is used to determine whether each pixel in the ultrasound sampled image M2 is an edge of a foreground image, the foreground value a is a gray level of the foreground pixel, and the background value b is a gray level of the background pixel, wherein the second threshold TH2 is smaller than the first threshold TH 1.
In one embodiment, the foreground value a and the background value b may be 1 and 0, respectively, or any two distinct gray-scale values, respectively. The first threshold TH1 and the second threshold TH2 may be manual preset values determined by a user, system preset values determined by a program, or the most suitable preset values calculated by the computing circuit 30 according to one or more input images. Whether an artificial preset value, a system preset value, or a most suitable preset value is used as the first threshold TH1 and the second threshold TH2, a user or the ultrasonic detection system 100 can adjust the values of the first threshold TH1 and the second threshold TH2 at any time during operation. However, the value of the gray-scale parameter used when performing the binarization process and expanding the foreground process is not limited to the scope of the present invention, i.e., the present invention is not limited thereto.
The noise-reduced ultrasonic sample image M3 obtained in step 230, the binarized image M4 obtained in step 240, the output image M5 obtained in step 250, and the improved ultrasonic sample image M6 obtained in step 260 are obtained by performing image processing in different stages and then respectively presenting the ultrasonic sample images obtained in step 220 in different ways. That is, the ultrasonic sampling image M2, the noise-reduced ultrasonic sampling image M3, the binarized image M4, the output image M5, and the improved ultrasonic sampling image M6 have the same resolution, and the pixels at the same position correspond to the same sampling point.
Fig. 3 to fig. 7 are schematic diagrams of the ultrasonic detection system 100 according to the embodiment of the present invention when performing foreground expansion processing in step 250. For illustrative purposes, in the binarized video M4 and the output video M5, pixels having a gray-scale value of foreground value a are indicated in a star pattern, and pixels having a gray-scale value of background value b are indicated in a cross pattern.
For the first pixel PX1 located at the first position in the ultrasonic sampling image M2, the second pixel PX2 located at the first position in the binarized image M4, and the third pixel PX3 located at the first position in the output image M5, the image processor 40 determines in step 250 whether the gray-scale value of the first pixel PX1 is greater than the second threshold value TH2, determines whether the gray-scale value of the second pixel PX2 in the binarized image M4 is the foreground value a, determines whether a pixel having a gray-scale value of the foreground value a appears in the neighboring region 55 including the second pixel PX2 in the binarized image M4, and sets the gray-scale value of the third pixel PX3 according to the determination result.
In the embodiment shown in fig. 3, the gray-scale value of the first pixel PX1 in the ultrasonic sampled image M2 corresponding to the second pixel PX2 in the binarized image M4 is the foreground value a, and the image processor 40 sets the gray-scale value of the third pixel PX3 in the output image M5 as the foreground value a.
In the embodiment shown in fig. 4, the gray-scale value of the first pixel PX1 in the ultrasonic sampled image M2 is greater than the second threshold TH2, and the binarized image M4 has the fourth pixel PX4 with the gray-scale value of the foreground value a in the region 55, at this time, the image processor 40 sets the gray-scale value of the third pixel PX3 in the output image M5 as the foreground value a.
In the embodiment shown in fig. 5, the gray scale value of the first pixel PX1 in the ultrasonic sampled image M2 is greater than the second threshold value TH2, the gray scale value of the second pixel PX2 in the binarized image M4 is the background value b, but the binarized image M4 has the fourth pixel PX4 with the gray scale value of the foreground value a in the region 55, and the image processor 40 sets the gray scale value of the third pixel PX3 in the output image M5 as the foreground value a.
In the embodiment shown in fig. 6, the gray-scale value of the first pixel PX1 in the ultrasonic sampled image M2 is not greater than the second threshold TH2 and the gray-scale value of the second pixel PX2 is the background value b, and the image processor 40 sets the gray-scale value of the third pixel PX3 in the output image M5 as the background value b.
In the embodiment shown in fig. 7, the binarized image M4 does not have any pixel with a gray level value of foreground value a in the region 55, and the image processor 40 sets the gray level value of the third pixel PX3 in the output image M5 as the background value b.
Although the brightness of the foreground image is much higher than that of the background image, there is still a difference between the brightness of the foreground image at the edge and the brightness of the foreground image at the edge, wherein the edge of the foreground image is slightly darker than the center of the foreground image. Therefore, the invention uses the first threshold TH1 to determine the body of the foreground image, and then expands the edge of the foreground image from the body of the foreground image according to the second threshold TH2 smaller than the first threshold TH 1.
As shown in fig. 3, if the gray-scale value of the second pixel PX2 in the binarized image M4 is the foreground value a, it indicates that the first position may be the subject of the foreground image, and therefore the gray-scale value of the third pixel PX3 in the output image M5 is also set as the foreground value a.
As shown in fig. 4, when the gray-scale value of the first pixel PX1 in the ultrasound sample image M2 is greater than the second threshold TH2, if the binarized image M4 has the fourth pixel PX4 with the gray-scale value of the foreground value a in the region 55, it represents that the first position may be the main body or the edge of the foreground image, and therefore the gray-scale value of the third pixel PX3 in the output image M5 is also set as the foreground value a.
As shown in fig. 5, in the case that the gray-scale value of the first pixel PX1 in the ultrasonic sampling image M2 is greater than the second threshold TH2, if the gray-scale value of the first pixel PX1 is not greater than the first threshold TH1, the gray-scale value of the corresponding second pixel PX2 in the binarized image M4 obtained in step 240 is set as the background value b, but if the binarized image M4 has the fourth pixel PX4 with the gray-scale value of the foreground value a in the region 55, it represents that the first position may be the edge of the foreground image, so the gray-scale value of the third pixel PX3 in the output image M5 is also set as the foreground value a.
As shown in fig. 6, in the case where the gray-scale value of the first pixel PX1 in the ultrasonic sample image M2 is not greater than the second threshold value TH2 and the gray-scale value of the second pixel PX2 is the background value b, it represents the background image where the first position may be unimportant, and therefore the gray-scale value of the third pixel PX3 in the output image M5 is set as the background value b.
As shown in fig. 7, in the case that no pixel with the gray-scale value of the foreground value a is present in the region 55 of the binarized image M4, it represents that the first position may be a unimportant background image, and therefore the gray-scale value of the third pixel PX3 in the output image M5 is set as the background value b.
In step 260, the image processor 40 performs post-processing on the ultrasound sample image M2 according to the foreground and background information of the output image M5 to generate an improved ultrasound sample image M6.
In one embodiment, the invention can define the gray level c for the post-processing in advance, wherein the gray level c is a fixed value not greater than the second threshold TH 2. More specifically, when the gray-scale value of the ninth pixel PX9 in the third position in the output image M5 is the background value b, the image processor 40 sets the gray-scale value of the tenth pixel PX10 in the third position in the ultrasonic sampled image M6 as c, thereby removing or suppressing the unimportant background information. When the gray-scale value of the ninth pixel PX9 is the foreground value a, the image processor 40 sets the gray-scale value of the tenth pixel PX10 as the gray-scale value of the eleventh pixel PX11 located at the third position in the ultrasound sample image M2.
In step 260, in another embodiment, the post-processing includes performing dynamic range adjustment processing on the ultrasound sample image M2 according to the foreground and background information of the output image M5 to generate a corresponding improved ultrasound sample image M6.
In another embodiment, the post-processing includes performing image enhancement on the ultrasound sample image M2 according to the foreground and background information of the output image M5 to generate a corresponding improved ultrasound sample image M6, for example, using a statistical distribution function, a curve or a continuous line segment to adjust the gray level of each pixel.
In another embodiment, the post-processing includes performing dynamic range adjustment processing and image enhancement processing on the ultrasound sample image M2 according to the foreground and background information of the output image M5 to generate a corresponding improved ultrasound sample image M6. In the improved ultrasonic sampling image M6 after the dynamic range adjustment process and/or the image enhancement process, the foreground image (the image within the range of interest) can be presented with more proper gray level values, and the background image (the image without the range of interest) can be removed or suppressed, wherein the gray level parameters TH1 and TH2 affecting the foreground and background information of the output image M5 can be determined by the user or determined by the ultrasonic detection system 100 in a program. However, the post-processing embodiments do not limit the scope of the present invention, i.e., the present invention is not limited thereto.
The ultrasonic detection system 100 can use different scanning methods of the probe to obtain the information of the detection range, such as Linear-Array (Linear-Array), Convex-Array (Convex-Array), or phase-Array (Phased-Array). Generally, the distances between each sampling point in the detection range and its directly adjacent sampling point in the axial or transverse direction of the scanning line are not all the same, so in step 270, the scan converter 50 will scan-convert the improved ultrasonic sampling image M6 into the ultrasonic brightness image M7 represented by grid pixels, and further reflect the actual spatial relative position ratio of each sampling position in the detection range.
In summary, the ultrasonic detection system 100 of the present invention can remove or suppress the low echo background and the high echo small noise of the ultrasonic image, and reserve or reinforce the portion with the specific volume and the high echo characteristic, thereby improving the quality of the ultrasonic image.
The present invention has been described in relation to the above embodiments, which are only exemplary of the implementation of the present invention. It should be noted that the disclosed embodiments do not limit the scope of the invention. Rather, it is intended that all such modifications and variations be included within the spirit and scope of this invention.

Claims (20)

1. A method for improving the quality of an ultrasound image, the method comprising:
receiving an ultrasonic sampling image;
carrying out noise reduction processing on the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image;
performing binarization processing on the noise-reduced ultrasonic sampling image according to a first threshold value to generate a binarization image, wherein the binarization image comprises at least one pixel with a gray scale value as a foreground value or at least one pixel with a gray scale value as a background value, and the foreground value and the background value are two different gray scale values respectively;
performing foreground expansion processing on the binarized image according to a second threshold value and the ultrasonic sampling image to generate an output image, wherein the second threshold value is smaller than the first threshold value, and the foreground expansion processing comprises the following steps:
for a first pixel at a first position in the ultrasonic sampling image, a second pixel at the first position in the binary image and a third pixel at the first position in the output image, judging whether the gray-scale value of the first pixel is larger than the second threshold value, judging whether the gray-scale value of the second pixel is the foreground value, and judging whether a pixel with the gray-scale value being the foreground value appears in a neighboring area of the second pixel in the binary image; and
when the gray-scale value of the first pixel is judged to be larger than the second threshold value and the pixel with the gray-scale value being the foreground value appears in the adjacent area in the binary image, setting the gray-scale value of the third pixel in the output image as the foreground value; and is
And post-processing the ultrasonic sampling image according to the foreground and background information of the output image to generate an improved ultrasonic sampling image.
2. The method for improving ultrasound image quality of claim 1, further comprising: and when the pixel with the gray-scale value being the foreground value does not appear in the adjacent area, setting the gray-scale value of the third pixel as the background value.
3. The method for improving ultrasound image quality of claim 1, further comprising:
and when the gray-scale value of the first pixel is not larger than the second threshold value and the gray-scale value of the second pixel is not the foreground value, setting the gray-scale value of the third pixel as the background value.
4. The method for improving ultrasound image quality of claim 1, further comprising:
and when the gray-scale value of the second pixel is judged to be the foreground value, setting the gray-scale value of the third pixel as the foreground value.
5. The method of claim 1, wherein the binarization process comprises:
when the gray scale value of a fourth pixel at the second position in the denoised ultrasonic sampling image is larger than the first threshold value, setting the gray scale value of a fifth pixel at the second position in the binarized image as the foreground value; and
and when the gray-scale value of the sixth pixel at the third position in the denoised ultrasonic sampling image is not greater than the first threshold value, setting the gray-scale value of the seventh pixel at the third position in the binarized image as the background value.
6. The method for improving ultrasound image quality of claim 1, further comprising:
and scanning and converting the improved ultrasonic sampling image into an ultrasonic brightness image presented in a grid pixel mode.
7. The method of claim 1, wherein said de-noising the ultrasound sample image comprises:
reducing the ultrasonic sampling image by a preset multiplying power to generate a reduced image;
filtering noise in the reduced image; and
and amplifying the reduced image after the noise is filtered by the preset multiplying power to generate the ultrasonic sampling image after the noise is reduced.
8. The method for improving ultrasound image quality of claim 1, further comprising:
performing a gray level adjustment process on all pixels of the ultrasound sampled image according to the foreground and background information of the output image to generate the improved ultrasound sampled image, the gray level adjustment process comprising:
reducing the gray scale value of one or more specific pixels in the ultrasound sampled image to generate the improved ultrasound sampled image, wherein the one or more specific pixels correspond to all pixels in the output image without the foreground value; and
and increasing the gray-scale value of one or more specific pixels in the ultrasonic sampling image to generate the improved ultrasonic sampling image, wherein the one or more specific pixels correspond to all pixels with the foreground value in the output image.
9. The method of claim 1, wherein said post-processing the ultrasound sample image comprises:
setting the gray-scale value of the one or more specific pixels in the ultrasound sampled image to a predetermined value to generate the improved ultrasound sampled image, wherein the predetermined value is not greater than the second threshold and the one or more specific pixels correspond to all pixels in the output image that are not the foreground value.
10. A method for improving the quality of an ultrasound image, the method comprising:
receiving an ultrasonic sampling image;
carrying out noise reduction processing on the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image;
performing binarization processing on the noise-reduced ultrasonic sampling image according to a first threshold value to generate a binarization image, wherein the binarization image comprises at least one pixel with a gray scale value as a foreground value or at least one pixel with a gray scale value as a background value, and the foreground value and the background value are two different gray scale values respectively;
performing foreground expansion processing on the binarized image according to a second threshold value and the ultrasonic sampling image to generate an output image, wherein the second threshold value is smaller than the first threshold value, and the foreground expansion processing comprises the following steps:
judging whether the gray-scale value of the first pixel is greater than the second threshold value and whether the gray-scale value of the second pixel is the foreground value or not according to the first pixel at the first position in the ultrasonic sampling image, the second pixel at the first position in the binary image and the third pixel at the first position in the output image;
when the gray-scale value of the second pixel is judged to be the foreground value, setting the gray-scale value of the third pixel in the output image as the foreground value; and is
And reducing the gray-scale value of one or more specific pixels in the ultrasonic sampling image to generate an improved ultrasonic sampling image, wherein the one or more specific pixels correspond to all pixels without the foreground value in the output image.
11. The method for improving ultrasound image quality of claim 10, further comprising:
when the gray-scale value of the second pixel is judged not to be the foreground value, judging whether a fourth pixel with the gray-scale value being the foreground value appears in all pixels adjacent to the second pixel in the binary image; and
and when the gray-scale value of the first pixel is judged to be larger than the second threshold value and the fourth pixel with the gray-scale value being the foreground value appears in all the pixels adjacent to the second pixel in the binarized image, setting the gray-scale value of the third pixel in the output image as the foreground value.
12. The method for improving ultrasound image quality of claim 11, further comprising:
and when the gray-scale value of the second pixel is judged not to be the foreground value and the fourth pixel with the gray-scale value being the foreground value does not appear in all the pixels adjacent to the second pixel in the binary image, setting the gray-scale value of the third pixel as the background value.
13. The method of claim 10, wherein the binarization process comprises:
and when the gray-scale value of the first pixel is not larger than the second threshold value and the gray-scale value of the second pixel is not the foreground value, setting the gray-scale value of the third pixel as the background value.
14. The method of claim 10, wherein the binarization process comprises:
when the gray scale value of a fifth pixel at the second position in the denoised ultrasonic sampling image is larger than the first threshold value, setting the gray scale value of a sixth pixel at the second position in the binarized image as the foreground value; and
and when the gray-scale value of the seventh pixel at the third position in the denoised ultrasonic sampling image is not greater than the first threshold value, setting the gray-scale value of the eighth pixel at the third position in the binarized image as the background value.
15. The method for improving ultrasound image quality of claim 10, further comprising:
and carrying out dynamic range adjustment processing and image enhancement processing on the ultrasonic sampling image according to the foreground and background information of the output image so as to generate the improved ultrasonic sampling image.
16. The method for improving ultrasound image quality of claim 10, further comprising:
and scanning and converting the improved ultrasonic sampling image into an ultrasonic brightness image presented in a grid pixel mode.
17. The method of claim 10, wherein said de-noising the ultrasound sample image comprises:
reducing the ultrasonic sampling image by a preset multiplying power to generate a reduced image;
filtering noise in the reduced image; and
and amplifying the reduced image after the noise is filtered by the preset multiplying power to generate the ultrasonic sampling image after the noise is reduced.
18. The method for improving ultrasound image quality of claim 10, further comprising:
and increasing the gray-scale value of one or more specific pixels in the ultrasonic sampling image to generate the improved ultrasonic sampling image, wherein the one or more specific pixels correspond to all pixels with the foreground value in the output image.
19. The method for improving ultrasound image quality of claim 1, further comprising:
setting the gray-scale value of the one or more specific pixels in the ultrasound sampled image to a predetermined value to generate the improved ultrasound sampled image, wherein the predetermined value is not greater than the second threshold and the one or more specific pixels correspond to all pixels in the output image without the foreground value.
20. An ultrasonic detection system, comprising:
an ultrasonic transmitter for transmitting an ultrasonic signal;
the ultrasonic receiver is used for receiving a reflected signal of the ultrasonic signal reflected by an object;
an operation circuit for providing an ultrasonic sampling image related to the object according to the ultrasonic signal and the reflection signal;
a scan converter for converting the ultrasonic sampled image into an ultrasonic brightness image represented by grid pixels; and
an image processor for:
carrying out noise reduction processing on the ultrasonic sampling image to generate a noise-reduced ultrasonic sampling image;
performing binarization processing on the noise-reduced ultrasonic sampling image according to a first threshold value to generate a binarization image, wherein the binarization image comprises at least one pixel with a gray scale value as a foreground value or at least one pixel with a gray scale value as a background value, and the foreground value and the background value are two different gray scale values respectively;
performing foreground expansion processing on the binarized image according to a second threshold value and the ultrasonic sampling image to generate an output image, wherein the second threshold value is smaller than the first threshold value, and the foreground expansion processing comprises the following steps:
aiming at a first pixel at a first position in the ultrasonic sampling image, a second pixel at the first position in the binary image and a third pixel at the first position in the output image, judging whether a gray-scale value of the second pixel in the binary image is the foreground value, judging whether the gray-scale value of the first pixel is larger than a second threshold value, and judging whether a pixel with the gray-scale value as the foreground value appears in a neighboring area containing the second pixel in the binary image;
when the gray-scale value of the second pixel in the binary image is judged to be the foreground value, setting the gray-scale value of the third pixel in the output image as the foreground value;
when the gray-scale value of the first pixel is judged to be larger than the second threshold value and the pixel with the gray-scale value being the foreground value appears in the adjacent area in the binary image, setting the gray-scale value of the third pixel in the output image as the foreground value;
when the gray-scale value of the second pixel in the binarized image is determined to be the background value and the gray-scale value of the first pixel is not greater than the second threshold value, setting the gray-scale value of the third pixel in the output image as the background value;
when the pixel with the gray scale value being the foreground value does not appear in the adjacent area in the binary image, setting the gray scale value of the third pixel in the output image as the background value; and
and reducing the gray scale value of one or more specific pixels in the ultrasonic sampling image to generate an improved ultrasonic sampling image, wherein the one or more specific pixels correspond to all pixels in the output image which are not the foreground value.
CN202010118594.1A 2020-02-26 2020-02-26 Method for improving ultrasonic image quality and detection system thereof Active CN113311440B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010118594.1A CN113311440B (en) 2020-02-26 2020-02-26 Method for improving ultrasonic image quality and detection system thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010118594.1A CN113311440B (en) 2020-02-26 2020-02-26 Method for improving ultrasonic image quality and detection system thereof

Publications (2)

Publication Number Publication Date
CN113311440A true CN113311440A (en) 2021-08-27
CN113311440B CN113311440B (en) 2024-06-14

Family

ID=77370151

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010118594.1A Active CN113311440B (en) 2020-02-26 2020-02-26 Method for improving ultrasonic image quality and detection system thereof

Country Status (1)

Country Link
CN (1) CN113311440B (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030063802A1 (en) * 2001-07-26 2003-04-03 Yulin Li Image processing method, apparatus and system
TW201311000A (en) * 2011-08-24 2013-03-01 Avermedia Information Inc Imaging apparatus and method for positioning thereof
CN103632361A (en) * 2012-08-20 2014-03-12 阿里巴巴集团控股有限公司 An image segmentation method and a system
CN104287777A (en) * 2014-10-17 2015-01-21 苏州佳世达电通有限公司 Ultrasonic scanning method and ultrasonic scanning system
CN104616290A (en) * 2015-01-14 2015-05-13 合肥工业大学 Target detection algorithm in combination of statistical matrix model and adaptive threshold
CN106053485A (en) * 2016-08-01 2016-10-26 苏州宙点自动化设备有限公司 Machine vision-based novel algorithm of intelligent circular inspection of steel ball surface defects
KR101717613B1 (en) * 2016-12-27 2017-03-17 주식회사한맥아이피에스 The moving vehicle detection system using an object tracking algorithm based on edge information, and method thereof
JP2017084365A (en) * 2015-10-27 2017-05-18 富士通株式会社 Background image model initialization device and method, and image processing device
CN106993109A (en) * 2017-04-01 2017-07-28 苏州佳世达电通有限公司 The quality improving method of ultrasound video
CN109190632A (en) * 2018-08-23 2019-01-11 甘肃政法学院 A kind of binarization method of ancient books file and picture
CN110008954A (en) * 2019-03-29 2019-07-12 重庆大学 A kind of complex background text image extracting method and system based on multi threshold fusion

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030063802A1 (en) * 2001-07-26 2003-04-03 Yulin Li Image processing method, apparatus and system
TW201311000A (en) * 2011-08-24 2013-03-01 Avermedia Information Inc Imaging apparatus and method for positioning thereof
CN103632361A (en) * 2012-08-20 2014-03-12 阿里巴巴集团控股有限公司 An image segmentation method and a system
CN104287777A (en) * 2014-10-17 2015-01-21 苏州佳世达电通有限公司 Ultrasonic scanning method and ultrasonic scanning system
CN104616290A (en) * 2015-01-14 2015-05-13 合肥工业大学 Target detection algorithm in combination of statistical matrix model and adaptive threshold
JP2017084365A (en) * 2015-10-27 2017-05-18 富士通株式会社 Background image model initialization device and method, and image processing device
CN106053485A (en) * 2016-08-01 2016-10-26 苏州宙点自动化设备有限公司 Machine vision-based novel algorithm of intelligent circular inspection of steel ball surface defects
KR101717613B1 (en) * 2016-12-27 2017-03-17 주식회사한맥아이피에스 The moving vehicle detection system using an object tracking algorithm based on edge information, and method thereof
CN106993109A (en) * 2017-04-01 2017-07-28 苏州佳世达电通有限公司 The quality improving method of ultrasound video
CN109190632A (en) * 2018-08-23 2019-01-11 甘肃政法学院 A kind of binarization method of ancient books file and picture
CN110008954A (en) * 2019-03-29 2019-07-12 重庆大学 A kind of complex background text image extracting method and system based on multi threshold fusion

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
MARUKATAT, S. 等: "A binarization technique using local edge information", 2010 7TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON 2010) *
徐俊良;曹建;杨凯斌;: "基于局部均值的绝缘子图像分割算法设计", 计算机工程, no. 09 *
戴璐平;刘海英;郑宽磊;: "结合局部二元图特征的运动目标阴影抑制方法", 华中科技大学学报(自然科学版), no. 10 *
熊炜;赵诗云;徐晶晶;赵楠;: "低质量文档图像二值化算法研究", 计算机应用与软件, no. 07 *
田梦娜 等: "基于MATLAB的边缘检测算法研究", 测绘与空间地理信息, vol. 43, no. 02 *
贺志明;: "基于背景规范化的照相文本图像二值化", 上海工程技术大学学报, no. 02 *
齐美彬;王倩;蒋建国;安宝磊;: "基于背景像素值频次最高假设的背景重构算法", 中国图象图形学报, no. 04 *

Also Published As

Publication number Publication date
CN113311440B (en) 2024-06-14

Similar Documents

Publication Publication Date Title
US8684934B2 (en) Adaptively performing clutter filtering in an ultrasound system
CN102306377B (en) Method and device for reducing noise in ultrasound image
KR100908252B1 (en) Image Processing System and Method
CN107789008B (en) Self-adaptive ultrasonic beam synthesis method and system based on channel data
US20150359507A1 (en) Ultrasound diagnosis apparatus and ultrasound image processing method
Dantas et al. Ultrasound speckle reduction using modified Gabor filters
KR20140040679A (en) An improved ultrasound imaging method/technique for speckle reduction/suppression in an improved ultra sound imaging system
EP1796037B1 (en) Image processing system and method for controlling gains for color flow images
JP4996247B2 (en) Ultrasonic diagnostic equipment
US11408987B2 (en) Ultrasonic imaging with multi-scale processing for grating lobe suppression
US20190350533A1 (en) Ultrasound diagnosis apparatus
US20180116631A1 (en) Ultrasound diagnostic apparatus and image forming method
CN105982694A (en) Signal processing method for inhibiting ultrasonic noises
EP0996002A2 (en) Method and apparatus for edge enhancement in ultrasound imaging
CN113311440B (en) Method for improving ultrasonic image quality and detection system thereof
CN111766306A (en) Full-focus imaging method and device
US20220330920A1 (en) Ultrasonic diagnostic apparatus and medical image processing apparatus
TWI769435B (en) Method of improving quality of ultrasound image and related ultrasound detection system
KR101124759B1 (en) Ultrasound system and method for enhancing quality of ultrasound image based on entropy information
US11896435B2 (en) Ultrasound diagnostic apparatus and examination method
US11506771B2 (en) System and methods for flash suppression in ultrasound imaging
CN108389174B (en) Ultrasonic imaging system and ultrasonic imaging method
JP2009261436A (en) Ultrasonic diagnostic apparatus
US8795179B2 (en) Methods, modules, and systems for gain control in B-mode ultrasonic imaging
CN106691499B (en) Method for analyzing an ultrasonic echo signal using scatterer distribution statistics

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant