CN112890866A - Ultrasound imaging method, system and computer readable storage medium - Google Patents

Ultrasound imaging method, system and computer readable storage medium Download PDF

Info

Publication number
CN112890866A
CN112890866A CN201911222413.3A CN201911222413A CN112890866A CN 112890866 A CN112890866 A CN 112890866A CN 201911222413 A CN201911222413 A CN 201911222413A CN 112890866 A CN112890866 A CN 112890866A
Authority
CN
China
Prior art keywords
target
image
image data
image processing
initial image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911222413.3A
Other languages
Chinese (zh)
Inventor
袁海锋
李雷
李庆鹏
付强
刘杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Mindray Bio Medical Electronics Co Ltd
Original Assignee
Shenzhen Mindray Bio Medical Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Mindray Bio Medical Electronics Co Ltd filed Critical Shenzhen Mindray Bio Medical Electronics Co Ltd
Priority to CN201911222413.3A priority Critical patent/CN112890866A/en
Publication of CN112890866A publication Critical patent/CN112890866A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/48Diagnostic techniques
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5207Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of raw data to produce diagnostic data, e.g. for generating an image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/52Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/5215Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
    • A61B8/5238Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image
    • A61B8/5246Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data for combining image data of patient, e.g. merging several images from different acquisition modes into one image combining images from the same or different imaging techniques, e.g. color Doppler and B-mode

Abstract

The embodiment of the application discloses an ultrasonic imaging method, an ultrasonic imaging system and a computer-readable storage medium. The method comprises the steps of transmitting ultrasonic waves to a target to be detected through a probe, receiving ultrasonic echoes reflected by the target to be detected, and obtaining ultrasonic echo data; obtaining initial image data of a target to be detected based on the ultrasonic echo data; performing image processing on the initial image data based on a first image processing mode to generate a reference image of the target to be detected for real-time display; when the freezing instruction is determined to be received, target initial image data corresponding to the freezing instruction is obtained; performing image processing on the target initial image data based on a second image processing mode to generate a frozen image of the target to be detected; the frozen image is displayed. The embodiment of the application carries out ultrasonic detection based on the frozen image so as to improve the accuracy of ultrasonic detection under real-time display.

Description

Ultrasound imaging method, system and computer readable storage medium
Technical Field
The present application relates to the field of ultrasound technology, and in particular, to an ultrasound imaging method, system, and computer-readable storage medium.
Background
In ultrasonic detection, an ultrasonic probe sends ultrasonic waves to a detected part or a target to be detected and receives echo signals reflected by the detected part or the target to be detected. The ultrasonic imaging device can obtain an ultrasonic image of a corresponding part or tissue through signal and image processing, so that a user can observe related information of a tissue structure conveniently. The ultrasonic imaging device can obtain ultrasonic images under different imaging modes through different ultrasonic imaging modes. The ultrasound imaging mode often needs to work in real time, and thus, the ultrasound imaging apparatus needs to meet the real-time requirement by reducing the display effect of the ultrasound image. However, when the real-time requirement is met, the quality of the ultrasound image may not be guaranteed, and the accuracy of the user in performing ultrasound detection based on the ultrasound image may be affected.
Disclosure of Invention
The embodiment of the application provides an ultrasonic imaging method, an ultrasonic imaging system and a computer-readable storage medium, which can improve the accuracy of ultrasonic detection under real-time display.
A first aspect of an embodiment of the present application provides an ultrasound imaging method, including:
transmitting ultrasonic waves to a target to be detected through a probe, receiving ultrasonic echoes reflected by the target to be detected, and obtaining ultrasonic echo data;
obtaining initial image data of the target to be detected based on the ultrasonic echo data;
performing image processing on the initial image data based on a first image processing mode to generate a reference image of the target to be detected for real-time display;
when a freezing instruction is determined to be received, obtaining target initial image data corresponding to the freezing instruction;
performing image processing on the target initial image data based on a second image processing mode to generate a frozen image of the target to be detected, wherein the frozen image is different from a reference image in real-time display in image quality;
and displaying the frozen image.
A second aspect of the embodiments of the present application provides an ultrasound imaging system, including:
a transmission circuit for outputting an excitation timing;
the probe is used for acquiring the excitation time sequence output by the transmitting circuit and transmitting ultrasonic waves to a target to be detected and then receiving ultrasonic echoes reflected by the target to be detected;
the receiving circuit is used for receiving the ultrasonic echo returned by the probe from the target to be detected to obtain ultrasonic echo data;
the processor is connected to the probe and used for processing the ultrasonic echo data to obtain initial image data of the target to be detected; the processor is further configured to:
performing image processing on the initial image data based on a first image processing mode to generate a reference image of the target to be detected for real-time display;
when a freezing instruction is determined to be received, obtaining target initial image data corresponding to the freezing instruction;
performing image processing on the target initial image data based on a second image processing mode different from the first image processing mode to generate a frozen image of the target to be detected;
a display device through which the processor displays the frozen image.
A third aspect of embodiments of the present application provides a computer-readable storage medium for storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform some or all of the steps as described in any one of the methods of the first aspect of embodiments of the present application.
The ultrasonic imaging method, the ultrasonic imaging system and the computer-readable storage medium perform image processing on the obtained initial image data based on the first image processing mode to obtain a plurality of reference images so as to display the tissue information of the target to be detected in real time, and perform image processing on the initial image data corresponding to the freezing instruction based on the second image processing mode after receiving the freezing instruction when the target to be detected is displayed in real time so as to obtain the frozen image which is different from the reference image in image quality.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic hardware configuration diagram of an ultrasound imaging system in an embodiment of the present application.
Fig. 2 is a flowchart illustrating steps of an ultrasound imaging method according to an embodiment of the present application.
Fig. 3 is a schematic diagram of a display interface according to an embodiment of the present application.
FIG. 4 is a schematic diagram of a display interface according to an embodiment of the present application.
Fig. 5 is a block diagram schematic diagram of an ultrasound imaging system according to yet another embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Referring to fig. 1, a hardware structure diagram of an ultrasound imaging system according to an embodiment of the present application is shown. The ultrasound imaging system 10 may include a probe 100, a transmitting circuit 102 connected to the probe 100, a receiving circuit 104 connected to the probe 100, a beam forming module 106, a signal processing module 108, an imaging processing module 110, and a display device 112, wherein the receiving circuit 104, the beam forming module 106, the signal processing module 108, the imaging processing module 110, and the display device 112 may be electrically connected in sequence. The transmitting circuit 102 can excite the probe 100 to transmit ultrasonic waves to a target to be detected; the receiving circuit 104 may receive the ultrasonic echo returned from the target to be measured through the probe 100, thereby obtaining ultrasonic echo data; the ultrasonic echo data is processed by the beam forming module 106, and then sent to the signal processing module 108. The signal processing module 108 sends the processed result of the ultrasonic echo data to the imaging processing module 110 to obtain an ultrasonic image of the target to be measured. The ultrasound images obtained by the imaging processing module 110 may be stored in a memory. These ultrasound images may also be displayed on the display device 112. In this embodiment, the ultrasound imaging system 10 may display the frozen image having a better display effect or image quality with respect to the real-time image of the ultrasound examination based on the freezing instruction, so that the user performs more detailed and accurate ultrasound examination based on the frozen image having a higher image quality at the time of the real-time ultrasound examination.
Referring to fig. 2, a flowchart illustrating steps of an ultrasound imaging method according to an embodiment of the present application is shown. The ultrasonic imaging method comprises the following steps:
200, transmitting ultrasonic waves to a target to be detected through a probe, receiving ultrasonic echoes reflected by the target to be detected, and obtaining ultrasonic echo data.
In this embodiment, the transmitting circuit 102 is used for outputting the excitation timing to the probe 100. Upon receiving the excitation sequence, the probe 100 may transmit ultrasound waves to the object to be measured (including but not limited to breast, liver, lung, etc. type tissue). After a certain delay, the probe 100 can receive the ultrasonic echo with the information of the detected object reflected from the object to be detected. The probe 100 may convert this ultrasonic echo into an electrical signal. The receiving circuit 104 is used for receiving the ultrasonic echo data in the form of the electrical signal generated by the probe 100, and processing the ultrasonic echo data (including but not limited to amplification, gain compensation, detection, noise filtering, and a/D conversion) and then sending the processed ultrasonic echo data to the beam forming module 106. The beam forming module 106 performs focusing delay, weighting, and channel summation on the ultrasound echo data, and performs related signal processing (e.g., signal processing via envelope detection) by the signal processing module 108.
And 202, obtaining initial image data of the target to be detected based on the ultrasonic echo data.
The imaging processing module 110 may generate initial image data of the target to be measured based on the ultrasonic echo data processed by the signal processing module 108. In this embodiment, the ultrasound echo data obtained after the envelope solving process is the amplitude envelope of the corresponding ultrasound signal, and when the subsequent imaging process is performed, the imaging interval of the display device is generally between 0 and 255. Therefore, the imaging processing module 110 further needs to map the value interval of the envelope to the imaging interval of the ultrasound imaging system, for example, map the value interval of the envelope to the imaging area of the ultrasound imaging system through logarithmic compression, gray scale transformation, and the like, so as to obtain the initial image data. As such, the initial image data may include data resulting from envelope detection, log compression, and/or gray scale transformation of the ultrasound echo data.
And 204, performing image processing on the initial image data based on a first image processing mode, and generating a reference image of the target to be detected for real-time display.
In the present embodiment, the image processing includes, but is not limited to, image enhancement processing, coordinate transformation, interpolation, and the like. Under different ultrasound imaging modes (B, Color, PW, elastography, vector blood flow imaging, contrast imaging, etc.), if the target to be detected needs to be displayed in real time, the imaging processing module 110 may perform image processing on the initial image data based on the first image processing mode, generate reference images of a plurality of frames, and display the reference images in the display device 112. In order to meet the requirement of real-time display and make the image of the target to be detected displayed in the display device 112 smoother, the reference image generated by the imaging processing module 110 needs to reach a certain number of frames in a unit time. Therefore, when the initial image data is image-processed based on the first image processing mode, the imaging processing module 110 may select a processing method or algorithm with small feature information such as processing time and calculation amount to perform image processing on the initial image data, such as performing image enhancement processing on the initial image data using a general image enhancement algorithm, or performing image processing on the initial image data based on a linear interpolation value when performing interpolation processing.
Step 206, when the freezing instruction is determined to be received, obtaining target initial image data corresponding to the freezing instruction.
In this embodiment, since the feature information of the image processing mode used by the reference image during real-time display is small, the image quality of the reference image may be affected (for example, the image quality may be affected in the aspects of definition, uniformity, sharpness, smoothness, and contrast). Therefore, in order to facilitate the user to perform the ultrasonic detection based on the reference image displayed in real time, the imaging processing module 110 may perform the image quality improvement processing on the reference image of one or more frames in real time display, so that the user performs the ultrasonic detection based on the image after the image quality improvement processing, thereby facilitating the improvement of the accuracy in the ultrasonic detection.
When the real-time display is carried out, if a freezing instruction is received, the user needs to further process the reference image so as to obtain an ultrasonic image with higher image quality. Therefore, the imaging processing module 110, upon receiving the freeze instruction, may determine a target reference image based on the freeze instruction, wherein the target reference image is an ultrasound image of one or more frames of the reference image displayed in real time. The imaging processing module 110 further obtains initial image data corresponding to the target reference image from the initial image data as target initial image data, so as to perform image processing in the second image processing mode on the target initial image data.
In one embodiment, for example, ultrasound imaging system 10 includes a physical freeze trigger key or a virtual freeze trigger key displayed within display device 112. The imaging processing module 110 may determine that the freeze instruction is received when the user selects the virtual freeze trigger button by triggering a freeze trigger button of the entity or by a mouse. At this time, the imaging processing module 110 may determine the reference image corresponding to the time when the freeze trigger key is triggered when displayed in real time as the target reference image. For example, when the user triggers the freeze trigger button at time a, the imaging processing module 110 acquires the reference image displayed at time a from the reference images displayed in real time as the target reference image, and acquires target initial image data for generating the target reference image from the initial image data. For example, the imaging processing module 110 may obtain the target initial image data from the data obtained after envelope detection, logarithmic compression and/or gray-scale transformation.
In one embodiment, the ultrasound imaging system 10 may also automatically acquire the target reference image. For example, the ultrasound imaging system 10 may generate the freeze instruction based on a preset interval time or a preset time, and acquire a reference image corresponding to the time of generating the freeze instruction as the target reference image when displayed in real time, and may further acquire target initial image data of generating the target reference image from the initial image data. The preset interval time may include one or more interval times, and different interval times may be the same or different, for example, the interval time may be 10 seconds, 50 seconds, and the like; the preset time may be a fixed time, such as the 55 th second after the ultrasonic testing is performed to generate the freezing instruction.
And 208, performing image processing on the target initial image data based on a second image processing mode to generate a frozen image of the target to be detected, wherein the frozen image is different from a reference image in real-time display in image quality. For example, the frozen image is distinguished from the target reference image in one or more of image noise, edge saliency of the target, global uniformity, image sharpness, image smoothness, and image contrast.
In order to more accurately determine the tissue information of the target to be detected during the ultrasonic detection, the imaging processing module 110 may perform image processing on the initial image data of the target based on the second image processing mode to obtain a frozen image with higher image quality. In this embodiment, when performing image processing on the initial image data based on the second image processing mode, the imaging processing module 110 may select a processing method or algorithm with large feature information, such as processing time and calculation amount, to perform image processing on the initial image data, for example, perform enhancement processing on the initial image data using a depth image enhancement algorithm, or perform image processing on the initial image data based on an interpolation method with a good interpolation effect relative to linear interpolation, such as an adjacent interpolation mode, a bilinear interpolation mode, or a cubic spline mode, when performing interpolation processing. That is, in the present embodiment, the feature information may include processing time and/or calculation amount; a first processing time for image processing the target initial image data based on the first image processing mode is shorter than a second processing time for image processing the target initial image data based on the second image processing mode; the first calculation amount of image processing of the target initial image data based on the first image processing mode is less than the second calculation amount of image processing of the target initial image data based on the second image processing mode, so that one or more characteristics of the frozen image obtained based on the second image processing mode in image noise, edge salient degree of the target, overall uniformity, image sharpness, image smoothness and image contrast can be distinguished from the target reference image obtained based on the first image processing mode, and the frozen image obtained based on the second image processing mode is better than the target reference image obtained based on the first image processing mode in overall image quality.
In an embodiment, after determining that the freeze instruction is received and the target initial image data corresponding to the freeze instruction is obtained, the imaging processing module 110 indicates that the user needs to view a frozen image with higher image quality corresponding to the target initial image data, at this time, the ultrasound imaging system 10 may automatically switch from the first image processing mode to the second image processing mode, so that the imaging processing module 110 performs image processing on the target initial image data based on the second image processing mode to generate the frozen image.
In one embodiment, the ultrasound imaging system 10 further includes a mode selection key, and after determining that a freeze instruction is received and obtaining target initial image data corresponding to the freeze instruction, the ultrasound imaging system 10 is further configured to determine whether the mode selection key is activated. The mode selection key may be a physical mode selection key or a virtual mode selection key displayed within the display device 112. If the mode selection key is triggered, it indicates that the user needs to check a frozen image with higher image quality corresponding to the target initial image data, and at this time, the imaging processing module 110 performs image processing on the target initial image data based on the second image processing mode to generate the frozen image.
In an embodiment, the imaging processing module 110 may further perform image enhancement processing on the target initial image data based on an image gray scale transformation, wherein the image gray scale transformation may include a linear transformation, a logarithmic transformation, and a gamma transformation. For example, the function of the linear transformation can be expressed as: and s is a r + b, wherein r is the gray scale of the target initial image data or the gray scale of the image data before transformation, s is the gray scale of the frozen image or the gray scale of the image data after transformation, and the frozen image with different enhancement effects can be generated by different values of a and b.
For example, when a >1, the resulting frozen image has an increased contrast in the image relative to the target reference image; when a <1, the contrast of the obtained frozen image is reduced relative to the target reference image; when a is equal to 1 and b is not equal to 0, shifting up or down the gray value of the obtained frozen image relative to the target reference image, so that the target image becomes brighter or darker as a whole without influencing the contrast of the target reference image and the frozen image; when a is-1 and b is 255, the resulting frozen image is image-inverted with respect to the target reference image, and white or gray details in dark areas of the image can be enhanced. The enhancement processing of images such as neural networks, histogram modification, smoothing filtering, high-pass filtering, and low-pass filtering can be obtained based on the related technology.
In an embodiment, after determining the target reference image, the user may also select a partial image region in the target reference image for image quality improvement operation, so that the user may input a selection operation in the target reference image, for example, select a corresponding image region in the target reference image by using a mouse. The ultrasound imaging system 10 may receive user-input adjustment signals that may be used to select a region of interest in the reference image. For example, the user may input the adjustment signal through the human-computer interaction interface, including but not limited to a keyboard, a scroll wheel, a display device with touch function, a mouse, a transceiver module related to gesture control signals, and the like. At this time, the ultrasound imaging system 10 may receive a selection operation by the user in the target reference image, and may determine an image region corresponding to the selection operation in the target reference image as the region of interest. After determining the region of interest in the target reference image, the imaging processing module 110 may obtain initial image data corresponding to the region of interest in the target reference image from the initial image data as target initial image data. In this way, the frozen image obtained by the imaging processing module 110 after image processing the target initial image data based on the second image processing mode may correspond to the frozen image of the region of interest in the target reference image. In an embodiment, the identification of the region of interest may also be semi-automatic. For example, an image automatic segmentation processing method automatically operated based on the system obtains target tissue (tissue structures such as heart wall, liver, stomach wall, blood vessel wall, etc.), and then receives a selection instruction input by a user in a region of the target tissue to determine a region of interest.
In an embodiment, the ultrasound imaging system 10 may also include a region of interest selection button. The ultrasound imaging system 10 is also configured to determine whether the region of interest selection key is activated prior to determining to process the target initial image data based on the second image processing mode. If the region-of-interest selection key is triggered, it indicates that the user wishes to perform image processing on a partial region in the target reference image to improve the image quality of the partial region in the target reference image, at this time, a selection operation of the user in the target reference image may be received, and an image region corresponding to the selection operation may be used as the region-of-interest, or the region-of-interest may be determined based on the above semi-automatic method. The region of interest selection keys may include physical region of interest selection keys or virtual region of interest selection keys displayed within the display device 112.
Step 220, displaying the frozen image. The step is to display the frozen image independently, and also can display the frozen image and a real-time reference image corresponding to the freezing time synchronously.
In some embodiments, referring to fig. 3 together, after the freeze command is obtained, the ultrasound imaging system 10 may stop displaying the reference image of the target to be detected in real time, and the display interface of the ultrasound imaging system 10 is switched from the real-time reference image to the frozen image. Upon determining that the unfreeze instruction is received, the ultrasound imaging system 10 may again switch from displaying the frozen image to displaying the real-time reference image.
Fig. 4 is a schematic view of a display interface according to an embodiment of the present application. In this embodiment, a display interface 195 may be included within the display device 112. The display interface 195 can include a first display area 170 and a second display area 172. When acquiring the reference images 180 corresponding to the frames of the object to be detected, the ultrasound imaging system 10 may display the acquired reference images 180 of the frames in real time in the first display area 170, and further, the user may acquire the tissue information of the object to be detected during the ultrasound detection in real time according to the first display area 170. After receiving the freeze instruction, the ultrasound imaging system 10 may display the freeze image generated based on the second image processing mode in the second display area 172, and at this time, the user may perform the ultrasound detection through the freeze image displayed in the second display area 172 to obtain a more accurate detection result. In other embodiments, the user may trigger or generate the freeze command multiple times during the ultrasound examination, and each time the freeze command is triggered, a corresponding freeze image may be generated, so that the ultrasound imaging system 10 may display multiple freeze images in the second display region 172, respectively.
In one embodiment, the size of the regions of the first display area 170 and the second display area 172 may be dynamically adjusted depending on whether a freeze instruction is received. When the freeze instruction is not received, the display interface 195 is mainly displaying the first display area 170, i.e., the first display area 170 is larger than the second display area 172. Upon receiving the freeze command or further determining that the mode selection key is activated, the second display area 172 of the display interface 195 may be enlarged to facilitate the user to view the frozen image for further image information.
In one embodiment, after receiving the freeze command or determining that the mode selection key is triggered, the display interface 195 switches to display the frozen image and displays the reference image corresponding to the frozen image in a floating window manner on the display interface. Upon receiving a user selection operation of the floating window, the display interface 195 may switch to display the reference image and display the frozen image within the floating window. Flexible switching of the main image can be supported by floating window design. The floating window may be displayed in an image area or may be displayed in a non-image area such as a control area of the display interface. When displayed in the image area, the floating window is preferably displayed near the edge of the image area, avoiding obscuring the image content of the main image.
In an embodiment, after obtaining the freeze instruction, the ultrasound imaging system 10 may continue to acquire new ultrasound echo data through the probe 100, and the imaging processing module 110 generates a reference image based on the first image processing mode to continue to display the object to be measured in the first display area 170 in real time, so that the ultrasound imaging system 10 may continue to display the object to be measured in real time in the first display area 170, and display the freeze image in the second display area 172.
In one embodiment, after obtaining the freeze instruction, the ultrasound imaging system 10 may stop displaying the reference image of the target to be measured in real time, at which point the ultrasound imaging system 10 may display the target reference image in the first display area 170 and display the freeze image in the second display area 172, that is, the ultrasound imaging system 10 may display the target reference image while displaying the freeze image 182. The ultrasound imaging system 10 may also determine whether a freeze release instruction is received, such as when the user again triggers a physical freeze trigger key or a virtual freeze release trigger key displayed within the display device 112, the ultrasound imaging system 10 may determine that the freeze release instruction was received. At this time, the ultrasound imaging system 10 returns to image processing the initial image data based on the first image processing mode to continue displaying the reference image of the object in real time, for example, to resume displaying the reference image of the object in real time in the first display area 170.
In an embodiment, ultrasound imaging system 10 may also include a screenshot button. After obtaining the reference images of several frames based on the first image processing mode, the ultrasound imaging system 10 may use initial image data corresponding to the reference images within a certain time period as ultrasound video data, and may store or save the ultrasound video data, so that a user may perform video playback or freezing based on the ultrasound video data. The ultrasound imaging system 10 may select ultrasound video data having a preset duration as the frozen video upon receiving the freeze instruction. For example, when the freeze instruction is triggered at time B, the imaging processing module 110 may use initial image data for generating a reference image within a preset time length C before time B as the ultrasound video data. In the process of saving the ultrasound video data with the preset duration, the ultrasound imaging system 10 is configured to determine whether the screenshot button is triggered; and if the screenshot key is triggered, the user needs to perform image processing of a second image processing mode on the part in the ultrasonic video data to generate a frozen image independent of the ultrasonic video data. At this time, the imaging processing module 110 may obtain target initial image data corresponding to the time when the screenshot key is triggered from the ultrasound video data, and perform image processing on the screenshot target initial image data based on the second image processing mode to generate a frozen image independent of the ultrasound video data. Image processing of the target initial image data of the screenshot based on the second image processing mode may be combined with the foregoing.
In one embodiment, the target to be measured includes a target tissue, wherein the target tissue includes, but is not limited to, liver, lung, and the like. When the target to be detected is detected by the probe 100, the reference image generated based on the first image processing mode may not include the target tissue or include the target tissue during the ultrasonic detection, but the sharpness of the target tissue in the reference image may not be high. Therefore, the ultrasound imaging system 10 can perform a target recognition operation during playback of the ultrasound video data of the preset duration to obtain target initial image data containing target tissue. For example, the ultrasound imaging system 10 may identify an image region or a partial image region of a tissue organ such as a liver or a lung after performing an automatic image segmentation process on the obtained reference image. Thus, a target reference image containing the target tissue is obtained using an image automatic segmentation algorithm. The imaging processing module 110 may obtain initial image data for generating the target reference image from the ultrasound video data as the target initial image data, and perform image processing on the target initial image data based on a second image processing mode to obtain a frozen image independent of the ultrasound video data.
In an embodiment, the imaging processing module 110 may obtain a target reference image of multiple frames including a target tissue, at this time, the ultrasound imaging system 10 may evaluate the sharpness of the target reference image of each frame to determine a target reference image with the highest sharpness, and the imaging processing module 110 may obtain initial image data for generating the target reference image with the highest sharpness from the ultrasound video data as the target initial image data, and perform image processing on the target initial image data based on the second image processing mode to obtain a frozen image independent of the ultrasound video data. Wherein the evaluation of sharpness may be combined with the same evaluation algorithm or method.
The ultrasonic imaging method is characterized in that a plurality of reference images are obtained after image processing is carried out on obtained initial image data based on a first image processing mode so as to display tissue information of a target to be detected in real time, and after a freezing instruction is received when the target to be detected is displayed in real time, image processing is carried out on the initial image data corresponding to the freezing instruction based on a second image processing mode so as to obtain a frozen image which is different from the reference image in image quality. Therefore, the user can carry out ultrasonic detection based on the frozen image, and the purpose of improving the accuracy of the ultrasonic detection under real-time display is achieved.
Referring to fig. 5, a block diagram of an ultrasound imaging system according to another embodiment of the present application is shown. As shown in fig. 5, the ultrasound imaging system 80 may apply the above embodiments, and the ultrasound imaging system 80 provided in the present application is described below, the ultrasound imaging system 80 may include a processor 800, a memory 802, a probe 100, a control circuit 804, a display device 112, and a computer program (instructions) stored in the memory 802 and executable on the processor 800, and the ultrasound imaging system 80 may further include other hardware parts, such as a communication device, a key, a keyboard, and the like, which are not described herein again. The processor 800 may exchange data with the probe 100, the control circuit 804 memory 802, and the display device 112 via signal lines 808.
The Processor 800 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like that is the control center for the ultrasound imaging system 80 and that connects the various components of the overall ultrasound imaging system 80 using various interfaces and lines. In this embodiment, the processor 800 may be configured to generate the excitation timing control probe 100 to emit the ultrasonic wave, may be configured to implement all functions of the imaging processing module 110, and may also be integrated with the functions of the beam forming module 106 and the signal processing module 108, which may refer to the foregoing embodiments.
The control circuit 804 may include the functions of the transmitting circuit 102, the receiving circuit 104, the beam forming module 106 and/or the signal processing module 108 in the above embodiments, which may be referred to in detail.
The memory 802 may be used for storing the computer programs and/or modules, and the processor 800 implements the various functions of the above-described ultrasound imaging method by running or executing the computer programs and/or modules stored in the memory 802 and invoking the data stored in the memory 802. The memory 802 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function, and the like. Further, the memory 802 may include high-speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The display device 112 may display a User Interface (UI), a Graphical User Interface (GUI), a picture corresponding to three-dimensional volume data of a head of a subject, or a midsagittal plane, the ultrasound imaging system 804 may also serve as an input device and an output device, and the display device 112 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) touch display, a flexible touch display, a three-dimensional (3D) touch display, and the like.
The processor 800 runs a program corresponding to the executable program code by reading the executable program code stored in the memory 802 for performing the ultrasound imaging method in any of the foregoing embodiments.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (28)

1. An ultrasonic imaging method is applied to an ultrasonic imaging system, and is characterized by comprising the following steps:
transmitting ultrasonic waves to a target to be detected, receiving ultrasonic echoes reflected by the target to be detected, and obtaining ultrasonic echo data;
obtaining initial image data of the target to be detected based on the ultrasonic echo data;
performing image processing on the initial image data based on a first image processing mode to generate a reference image of the target to be detected for real-time display;
when a freezing instruction is determined to be received, obtaining target initial image data corresponding to the freezing instruction;
performing image processing on the target initial image data based on a second image processing mode to generate a frozen image of the target to be detected, wherein the frozen image is different from a reference image in real-time display in image quality;
and displaying the frozen image.
2. The ultrasound imaging method of claim 1, wherein different image processing modes have different feature information, first feature information of image processing of the target initial image data based on the first image processing mode being smaller than second feature information of image processing of the target initial image data based on the second image processing mode.
3. The ultrasonic imaging method according to claim 2, wherein the characteristic information includes a processing time and/or a calculation amount; a first processing time for image processing of the target initial image data based on the first image processing mode is shorter than a second processing time for image processing of the target initial image data based on the second image processing mode; and/or a first calculation amount of image processing on the target initial image data based on the first image processing mode is smaller than a second calculation amount of image processing on the target initial image data based on the second image processing mode.
4. The ultrasound imaging method of claim 1, wherein the determining that a freeze instruction is received, obtaining target initial image data corresponding to the freeze instruction comprises:
determining a target reference image based on the freeze instruction;
and acquiring initial image data corresponding to the target reference image from the initial image data as the target initial image data.
5. The ultrasound imaging method of claim 4, wherein the ultrasound imaging system includes a freeze trigger button, and wherein said determining a target reference image based on the freeze instruction comprises:
when the reference image of the target to be detected is displayed in real time, if the freezing trigger key is triggered after being received, the freezing instruction is determined to be received;
and determining a reference image corresponding to the time when the freezing trigger key is triggered during real-time display as the target reference image.
6. The ultrasound imaging method of claim 4, wherein said determining a target reference image based on said freeze instruction comprises:
and generating the freezing instruction based on preset interval time or preset time, and acquiring a reference image corresponding to the time for generating the freezing instruction during real-time display as the target reference image.
7. The ultrasound imaging method according to claim 1 or 4, wherein after obtaining target initial image data corresponding to a freeze instruction when it is determined that the freeze instruction is received, further comprising:
and automatically switching from the first image processing mode to the second image processing mode to perform image processing on the target initial image data based on the second image processing mode to generate the frozen image.
8. The ultrasound imaging method according to claim 1 or 4, wherein the ultrasound imaging system further comprises a mode selection key, and wherein after determining that a freeze instruction is received and target initial image data corresponding to the freeze instruction is obtained, further comprising:
determining whether the mode selection key is triggered;
and if the mode selection key is triggered, performing image processing on the target initial image data based on the second image processing mode to generate the frozen image.
9. The ultrasound imaging method of any of claims 4 to 8, wherein said obtaining initial image data corresponding to the target reference image from the initial image data is the target initial image data, comprising:
receiving a selection operation of a user in the target reference image;
determining a region of interest in the target reference image corresponding to the selection operation;
and acquiring initial image data corresponding to the region of interest in the target reference image from the initial image data as the target initial image data.
10. The ultrasound imaging method of any of claims 4 to 8, further comprising:
displaying the target reference image while displaying the frozen image.
11. A method of ultrasound imaging according to any of claims 4 to 8, wherein the frozen image differs from the target reference image in one or more of image noise, degree of edge saliency of the target, global uniformity, image sharpness, degree of image smoothness, image contrast.
12. The ultrasound imaging method of claim 1, wherein the ultrasound imaging system further comprises a screenshot button, the obtained target initial image data comprising ultrasound video data of a preset duration; the determining that the freezing instruction is received and obtaining the target initial image data corresponding to the freezing instruction further comprises:
determining whether the screenshot key is triggered or not in the process of storing the ultrasonic video data with the preset duration;
and if the screenshot key is triggered, acquiring target initial image data corresponding to the time for triggering the screenshot key from the ultrasonic video data, and performing image processing on the screenshot target initial image data based on the second image processing mode to generate the frozen image independent of the ultrasonic video data.
13. The ultrasonic imaging method of claim 1, wherein the object to be measured comprises a target tissue, and the obtained target initial image data comprises ultrasonic video data of a preset time length; the method further comprises the following steps:
and controlling the target recognition operation on the ultrasonic video data during the process of playing back the ultrasonic video data with the preset time length so as to determine the target initial image data containing the target tissue.
14. The ultrasound imaging method of claim 1, wherein said determining that a freeze instruction is received comprises:
stopping displaying the reference image of the target to be detected in real time;
and after the freezing releasing instruction is determined to be received, restoring to the image processing of the initial image data based on the first image processing mode so as to continuously display the reference image of the target to be detected in real time.
15. An ultrasound imaging system, characterized in that the ultrasound imaging system comprises:
a transmission circuit for outputting an excitation timing;
the probe is used for acquiring the excitation time sequence output by the transmitting circuit and transmitting ultrasonic waves to a target to be detected and then receiving ultrasonic echoes reflected by the target to be detected;
the receiving circuit is used for receiving the ultrasonic echo returned by the probe from the target to be detected to obtain ultrasonic echo data;
the processor is used for processing the ultrasonic echo data to obtain initial image data of the target to be detected; the processor is further configured to:
performing image processing on the initial image data based on a first image processing mode to generate a reference image of the target to be detected for real-time display;
when a freezing instruction is determined to be received, obtaining target initial image data corresponding to the freezing instruction;
performing image processing on the target initial image data based on a second image processing mode different from the first image processing mode to generate a frozen image of the target to be detected;
a display device through which the processor displays the frozen image.
16. The ultrasound imaging system of claim 15, wherein different image processing modes have different feature information, the processor being less in a first feature information of image processing of the target initial image data based on the first image processing mode than in a second feature information of image processing of the target initial image data based on the second image processing mode.
17. The ultrasound imaging system of claim 16, wherein the characteristic information includes a processing time and/or a calculation amount; the processor performs image processing on the target initial image data in a first processing time based on the first image processing mode, which is shorter than a second processing time based on the second image processing mode; and/or a first calculation amount of the processor for performing image processing on the target initial image data based on the first image processing mode is smaller than a second calculation amount of the processor for performing image processing on the target initial image data based on the second image processing mode.
18. The ultrasound imaging system of claim 15, wherein upon determining that a freeze instruction is received, upon obtaining target ultrasound echo data corresponding to the freeze instruction:
the processor determining a target reference image based on the freeze instruction;
the processor also acquires initial image data corresponding to the target reference image from the initial image data as the target initial image data.
19. The ultrasound imaging system of claim 18, comprising a freeze trigger button that, when determining a target reference image based on the freeze instruction:
when the reference image of the target to be detected is displayed in real time, if the freezing trigger key is triggered, the processor determines that the freezing instruction is received;
the processor is further configured to determine a reference image corresponding to a time when the freeze trigger key is triggered when displayed in real time as the target reference image.
20. The ultrasound imaging system of claim 18, wherein, in determining a target reference image based on the freeze instruction:
the processor generates the freezing instruction based on preset interval time or preset time, and acquires a reference image corresponding to the time of generating the freezing instruction during real-time display as the target reference image.
21. The ultrasound imaging system of claim 15 or 18, wherein upon determining that a freeze instruction is received, after obtaining target initial image data corresponding to the freeze instruction:
the processor automatically switches from the first image processing mode to the second image processing mode to perform image processing on the target initial image data based on the second image processing mode to generate the frozen image.
22. The ultrasound imaging system according to claim 15 or 18, further comprising a mode selection key that, upon determining that a freeze instruction is received, after obtaining target initial image data corresponding to the freeze instruction:
the processor is used for determining whether the mode selection key is triggered;
and if the mode selection key is triggered, the processor performs image processing on the target initial image data based on the second image processing mode to generate the frozen image.
23. The ultrasound imaging system of any of claims 18 to 22, wherein, in acquiring initial image data corresponding to the target reference image from the initial image data as the target initial image data:
the processor receives a selection operation of a user in the target reference image;
the processor is used for determining a region of interest in the target reference image corresponding to the selection operation, and acquiring initial image data corresponding to the region of interest in the target reference image from the initial image data as the target initial image data.
24. The ultrasound imaging system of any of claims 18 to 22, wherein the processor is further configured to display the target reference image concurrently with the frozen image.
25. The ultrasound imaging system of any of claims 18 to 22, wherein the frozen image differs from the target reference image in one or more of image noise, edge saliency of the target, global uniformity, image sharpness, image smoothness, image contrast.
26. The ultrasound imaging system of claim 15, further comprising a screenshot button, wherein the target initial image data obtained comprises ultrasound video data of a preset duration; when the freezing instruction is determined to be received, and target initial image data corresponding to the freezing instruction is obtained:
the processor is used for determining whether the screenshot key is triggered or not in the process of storing the ultrasonic video data with the preset duration;
if the screenshot key is triggered, the processor acquires target initial image data corresponding to the time for triggering the screenshot key from the ultrasonic video data, performs image processing on the screenshot target initial image data based on the second image processing mode, and generates the frozen image independent of the ultrasonic video data.
27. The ultrasound imaging system of claim 15, wherein the processor is further configured to cease displaying the reference image of the object under test in real-time after determining that the freeze instruction is received; and after determining that the unfreezing instruction is received, the processor returns to the image processing of the initial image data based on the first image processing mode so as to continuously display the reference image of the target to be detected in real time.
28. A computer readable storage medium storing computer instructions which, when executed by a processor, implement the ultrasound imaging method of any of claims 1 to 14.
CN201911222413.3A 2019-12-03 2019-12-03 Ultrasound imaging method, system and computer readable storage medium Pending CN112890866A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911222413.3A CN112890866A (en) 2019-12-03 2019-12-03 Ultrasound imaging method, system and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911222413.3A CN112890866A (en) 2019-12-03 2019-12-03 Ultrasound imaging method, system and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN112890866A true CN112890866A (en) 2021-06-04

Family

ID=76104119

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911222413.3A Pending CN112890866A (en) 2019-12-03 2019-12-03 Ultrasound imaging method, system and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN112890866A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114052793A (en) * 2021-09-18 2022-02-18 武汉联影医疗科技有限公司 Medical equipment assisting method and device and storage medium
WO2023045119A1 (en) * 2021-09-24 2023-03-30 武汉联影医疗科技有限公司 Ultrasound imaging method and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0975350A (en) * 1995-09-14 1997-03-25 Toshiba Corp Ultrasonic diagnostic system
JP2001299745A (en) * 2000-04-21 2001-10-30 Hitachi Medical Corp Ultrasonic diagnostic instrument
US20060020207A1 (en) * 2004-07-12 2006-01-26 Siemens Medical Solutions Usa, Inc. Volume rendering quality adaptations for ultrasound imaging
US20080242986A1 (en) * 2007-03-29 2008-10-02 Olympus Medical Systems Corp. Ultrasonic observation apparatus and ultrasonic diagnostic apparatus using the same
US20130072795A1 (en) * 2011-06-10 2013-03-21 Ruoli Mo Apparatuses and methods for user interactions during ultrasound imaging
CN207083161U (en) * 2017-08-14 2018-03-09 深圳市奥斯特诺医疗设备有限公司 A kind of realtime graphic freezes to split medical camera module
WO2018119718A1 (en) * 2016-12-28 2018-07-05 深圳迈瑞生物医疗电子股份有限公司 Image extraction method and device in ultrasonic scanning, and ultrasonic imaging system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0975350A (en) * 1995-09-14 1997-03-25 Toshiba Corp Ultrasonic diagnostic system
JP2001299745A (en) * 2000-04-21 2001-10-30 Hitachi Medical Corp Ultrasonic diagnostic instrument
US20060020207A1 (en) * 2004-07-12 2006-01-26 Siemens Medical Solutions Usa, Inc. Volume rendering quality adaptations for ultrasound imaging
US20080242986A1 (en) * 2007-03-29 2008-10-02 Olympus Medical Systems Corp. Ultrasonic observation apparatus and ultrasonic diagnostic apparatus using the same
US20130072795A1 (en) * 2011-06-10 2013-03-21 Ruoli Mo Apparatuses and methods for user interactions during ultrasound imaging
WO2018119718A1 (en) * 2016-12-28 2018-07-05 深圳迈瑞生物医疗电子股份有限公司 Image extraction method and device in ultrasonic scanning, and ultrasonic imaging system
CN207083161U (en) * 2017-08-14 2018-03-09 深圳市奥斯特诺医疗设备有限公司 A kind of realtime graphic freezes to split medical camera module

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114052793A (en) * 2021-09-18 2022-02-18 武汉联影医疗科技有限公司 Medical equipment assisting method and device and storage medium
WO2023045119A1 (en) * 2021-09-24 2023-03-30 武汉联影医疗科技有限公司 Ultrasound imaging method and system

Similar Documents

Publication Publication Date Title
US8202220B2 (en) Ultrasound diagnostic apparatus
JP7077118B2 (en) Methods and systems for shading 2D ultrasound images
US9123139B2 (en) Ultrasonic image processing with directional interpolation in order to increase the resolution of an image
US11786216B2 (en) Ultrasound contrast enhanced imaging method and ultrasound imaging system
US9039620B2 (en) Ultrasound diagnostic apparatus
US11071525B2 (en) Ultrasonic diagnostic apparatus and method
US8724880B2 (en) Ultrasonic diagnostic apparatus and medical image processing apparatus
US10537305B2 (en) Detecting amniotic fluid position based on shear wave propagation
CN112890866A (en) Ultrasound imaging method, system and computer readable storage medium
JP2008532606A (en) Method and apparatus for automatic gain adjustment in spectral Doppler
CN111836584A (en) Ultrasound contrast imaging method, ultrasound imaging apparatus, and storage medium
KR20190029173A (en) Method and device for classifying medical ultrasound image based on deep learning using smart device
US8216145B2 (en) Ultrasonic diagonstic apparatus, ultrasonic image processing apparatus, and ultrasonic image processing method
CN111528901B (en) Four-dimensional ultrasonic imaging method, ultrasonic imaging method and related system
CN112568927A (en) Method and system for providing a rotational preview for three-dimensional and four-dimensional ultrasound images
US11314398B2 (en) Method and system for enhanced visualization of ultrasound images by performing predictive image depth selection
US11399806B2 (en) Method and system for providing freehand render start line drawing tools and automatic render preset selections
WO2021056645A1 (en) Elastography method and system as well as computer readable storage medium
US20150201908A1 (en) Method and system for adaptive blood flow visualization based on regional flow characteristics
WO2021120071A1 (en) Ultrasonic imaging method, ultrasonic imaging system, and computer-readable storage medium
KR20200102660A (en) Image processing method and image processing system
WO2020082229A1 (en) Method for determining inspection mode and ultrasonic device
WO2022141257A1 (en) Strain elastography method and apparatus, and storage medium
US20200193613A1 (en) Method and system for enhanced visualization of color flow ultrasound
JP2022162830A (en) Ultrasonic diagnostic device, image processing device, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210604