CN108095756B - Super-high resolution plane wave ultrasonic imaging method based on SOFI - Google Patents
Super-high resolution plane wave ultrasonic imaging method based on SOFI Download PDFInfo
- Publication number
- CN108095756B CN108095756B CN201711232982.7A CN201711232982A CN108095756B CN 108095756 B CN108095756 B CN 108095756B CN 201711232982 A CN201711232982 A CN 201711232982A CN 108095756 B CN108095756 B CN 108095756B
- Authority
- CN
- China
- Prior art keywords
- plane wave
- imaging
- sofi
- ultrasonic
- formula
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/48—Diagnostic techniques
- A61B8/481—Diagnostic techniques involving the use of contrast agent, e.g. microbubbles introduced into the bloodstream
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B8/00—Diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/52—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves
- A61B8/5215—Devices using data or image processing specially adapted for diagnosis using ultrasonic, sonic or infrasonic waves involving processing of medical diagnostic data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
Abstract
The invention discloses an ultra-high resolution plane wave ultrasonic imaging method based on SOFI. The method comprises the following steps: under the intervention of an ultrasonic contrast agent (microbubble), carrying out ultrasonic plane wave imaging on an imaging object to obtain a group of plane wave ultrasonic images at different moments; filtering all the obtained plane wave ultrasonic images to remove noise contained in the plane wave ultrasonic images; measuring transverse full width at half maximum FHWM based on ultrasonic plane wave data of an imaging area only containing a single microbubblexFHWM half height and width in longitudinal directionyCalculating to obtain the transverse standard deviationxStandard deviation from longitudinalyGenerating a point diffusion distribution model; and finally, calculating to obtain a second-order (or higher-order) balanced SOFI image by taking the filtered dynamic ultrasonic plane wave image as input data. The method provided by the invention not only can greatly improve the spatial resolution of ultrasonic plane wave imaging, but also can improve the time resolution of ultrasonic imaging, and is suitable for rapid ultrahigh resolution ultrasonic imaging.
Description
Technical Field
The invention relates to an ultra-high resolution plane wave ultrasonic Imaging method based on SOFI (Super-resolution Optical Imaging). Specifically, under the intervention of an ultrasonic contrast agent (microbubble), ultrasonic plane wave imaging is carried out on an imaging object to acquire a group of plane wave ultrasonic images at different moments; filtering operation is carried out on all the obtained plane wave ultrasonic images based on a wiener filter (or other filters) so as to remove noise contained in the plane wave ultrasonic images; ultrasonic plane wave data based on single microbubble, through measured transverse half-height-width FHWMxFHWM half height and width in longitudinal directionyCalculating to obtain the transverse standard deviationxStandard deviation from longitudinalyGenerating a point spread distribution model based on the point spread distribution model; finally, toAnd (3) calculating to obtain a second-order (or high-order) balanced SOFI image based on the constructed SOFI imaging model, the SOFI calculation formula and the balanced SOFI (bSOFI) processing step. The method provided by the invention not only can greatly improve the spatial resolution of ultrasonic plane wave imaging, but also can improve the time resolution of ultrasonic imaging, and is suitable for rapid ultrahigh resolution ultrasonic imaging.
Background
Ultrasound imaging is one of the leading medical imaging modalities of today, and has been widely used in clinical practice, with the advantage that non-radiation imaging of tissue larger than 10cm can be achieved non-invasively. However, limited by diffraction theory, the spatial resolution of ultrasound imaging is not high, being about half the emission wavelength. This limits, in some respects, further applications of ultrasound in the clinic.
The SOFI (super-resolution fluorescence fluctuation imaging) is an emerging super-resolution imaging method. At present, the method is successfully applied to optical microscopy imaging. Briefly, the SOFI utilizes the fluorescence fluctuation characteristics of fluorescent molecules in optical imaging to generate cumulant equations with different orders; based on this, the width of the imaging Point Spread Function (PSF) can be effectively reduced; further breaking through the limit of the optical diffraction limit theorem and realizing the fluorescence microscopic imaging with ultrahigh resolution.
It is considered that, during contrast agent (microbubble) based ultrasound imaging, microbubbles constantly change their position relative to the ultrasound transducer; therefore, the moving of the microbubbles enables the passing pixel points to experience two different states of brightness and darkness in a short time, which can be similar to the fluorescent fluctuation characteristic in optical imaging. Based on the above, in the invention, the SOFI technology is combined with the ultrasonic imaging so as to break through the limit of the ultrasonic diffraction limit theorem and realize the ultrasonic imaging with ultrahigh resolution. Given that the SOFI has a non-linear response to brightness, this limits, to some extent, the spatial resolution of the resulting ultrasound imaging based on the SOFI approach. In order to overcome the limitation, the invention also adopts balanced SOFI (bSOFI), on the basis, the nonlinear response of the SOFI to the brightness is eliminated, so that the high-order cumulative quantity is applied, and the higher ultrasonic imaging spatial resolution is realized. In addition, in order to further improve the time resolution of imaging, in the invention, a plane wave imaging modality is used to scan an imaging object, thereby realizing ultra-fast ultrasonic imaging.
Disclosure of Invention
The invention aims to provide a plane wave ultrasonic imaging method based on SOFI (soft-object-oriented optical Fidelity), aiming at overcoming the defects of the existing ultrasonic imaging technology, and keeping better time resolution while realizing ultrahigh image spatial resolution.
In order to achieve the above purpose, the idea of the invention is:
under the intervention of an ultrasonic contrast agent (microbubble), carrying out ultrasonic plane wave scanning on an imaging object to obtain a group of plane wave ultrasonic images at different moments; filtering operation is carried out on all the obtained plane wave ultrasonic images based on a wiener filter (or other filters) so as to remove noise contained in the plane wave ultrasonic images; based on the ultrasonic plane wave data of the imaging region only containing a single microbubble by calculationxAndygenerating a point diffusion distribution model; and finally, calculating to obtain a second-order (or high-order) balanced SOFI image by taking the filtered dynamic ultrasonic plane wave image as input data based on the constructed SOFI imaging model, the SOFI calculation formula and the bSOFI processing method. The method provided by the invention not only can greatly improve the spatial resolution of ultrasonic plane wave imaging, but also can improve the time resolution of ultrasonic imaging, and is suitable for rapid ultrahigh resolution ultrasonic imaging.
According to the invention idea, the invention adopts the following technical scheme:
an ultra-high resolution plane wave ultrasonic imaging method based on SOFI comprises the following operation steps:
(1) under the intervention of an ultrasonic contrast agent (microbubble), an imaging object is subjected to ultrasonic plane wave scanning, and a group of plane wave ultrasonic images at different moments are acquired. Each frame of image comprises a plurality of point scatterers (microbubbles) which are randomly distributed in an imaging area;
(2) filtering operation is carried out on all the obtained plane wave ultrasonic images based on a wiener filter (or other filters) so as to remove noise contained in the plane wave ultrasonic images;
(3) constructing an SOFI imaging model, which comprises the following specific steps:
(3-1) calculating a transverse half-width-at-half-height (FHWM) of the plane wave ultrasound data based on the ultrasound plane wave data in which the imaging region contains only a single microbubblex) Longitudinal half width (FHWM)y);
(3-2) calculating by the formula (3-1) to obtain a transverse standard deviation based on the obtained transverse half-height width and longitudinal half-height widthxStandard deviation from longitudinaly;
FHWM in the formula (3-1)xIs a transverse half-height width, FHWMyIs longitudinal half-height width;xandyrespectively a transverse standard deviation and a longitudinal standard deviation;
(3-3) based on the obtainedxAndycalculating to obtain a point diffusion distribution model by applying a formula (3-2);
in the formula (3-2), x and y describe an x axis and a y axis, respectively; x is the number of0And y0Describing the abscissa and ordinate values of the central point; psfxAs a function of the lateral probability density, psfyIs a longitudinal probability density function;
(4) the SOFI utilizes the fluctuation characteristic of fluorescent molecules in imaging to generate cumulant equations with different orders, and the cumulant equation CnThe formula (3) is shown as the formula (3-3);
in the formula (3-3), U (r) describes the Point Spread Function (PSF) of the system,kis the molecular brightness, wk(τ1,…,τn-1) Is based on a related weighting function, n representing the order of the accumulation;when using an n-order SOFI, spatial resolution may be improvedHowever, the SOFI has a non-linear response to luminance and flicker heterogeneity, resulting in an inability to improve resolution with higher cumulative amounts;
(5) bSOFI processing step: the balance SOFI (bSOFI) is an extended version of the SOFI and can be used for further improving the spatial resolution of imaging; in the bSOFI method, three parameters, i.e., the ratio of the light-emitting states to the time, are extractedMolecular brightnessAnd molecular densityThen, deconvoluting the accumulated quantity calculated in the formula (3-3) to eliminate the nonlinear response to the brightness; then, the accumulated quantities are denoised by truncating smaller values (e.g., 1% -5% of the maximum value) and the luminance is linearized; finally, the image and the point spread function are convolved again to obtain a balanced accumulated image;
(6) and (3) taking the denoised plane wave ultrasonic image in the step (2) as an input, and calculating to obtain a second-order (or high-order) balanced SOFI image based on the SOFI imaging model constructed in the step (3) and the SOFI calculation formula in the step (4) and the processing method bSOFI in the step (5).
Through the steps, the SOFI-based ultrahigh-resolution plane wave ultrasonic imaging method can be realized.
Compared with the prior art, the invention has the following evaluation properties and obvious advantages: compared with the existing ultrasonic imaging method, the method can effectively improve the spatial resolution of ultrasonic imaging and realize ultrasonic imaging with ultrahigh resolution; meanwhile, based on the method, the time resolution of ultrasonic imaging can be greatly improved, and ultra-fast ultrasonic imaging is realized.
Drawings
FIG. 1 is a flow chart of the "super high resolution plane wave ultrasonic imaging method based on SOFI" of the present invention;
FIG. 2 is a partial plane wave ultrasound image generated by the Field II simulation platform;
FIG. 3 is a super-resolution ultrasound image obtained based on the method. (a) An original plane wave ultrasound image; (b) a second order SOFI image; (c) a third order SOFI image; (d) a fourth order SOFI image; (e) a bSOFI image;
Detailed Description
The preferred embodiments of the invention are detailed below:
(1) referring to fig. 1, in order to verify the feasibility of the method, an ultrasonic plane wave simulation image is taken as an example, and the method for ultra-high resolution plane wave ultrasonic imaging based on the SOFI includes the following specific steps:
(2) and performing ultrasonic plane wave imaging through a Field II simulation platform to obtain a group of plane wave ultrasonic images at different moments. Each frame of image comprises a plurality of point scatterers (microbubbles) which are randomly distributed in an imaging area; the specific simulation steps are as follows:
(1-1) using a Field II simulation platform, after setting relevant parameters, creating a phantom, containing a plurality of point scatterers at the depth of 30mm to 40mm, and scanning the phantom by using single plane wave emission containing 192 array elements, wherein the relevant parameters of scanning are shown in a table 1-1:
TABLE 1-1 plane wave Scan parameters
Sensor array type | Linear array |
Spacing of array elements | 208μm |
Height of array element | 4.5mm |
Speed of sound, c | 1540m/s |
Center frequency, f0 | 7MHz |
Bandwidth of | 60% |
Wavelength of light | 220μm |
Receive apodization | Hanning |
(1-2) generating 101 point scatterers along the depth direction of the phantom from 30mm to 40mm, wherein the interval of each point scatterer is 0.1 mm; in each ultrasonic imaging process, randomly selecting 5 point scatterers, and imaging the phantom through a linear array transducer; then, randomly changing the position of the 5 point scatterers in the phantom, and carrying out plane wave imaging on the scatterers again; in order to simulate the movement of the microbubbles in the imaging area, the imaging process is repeated for 100 times to obtain 100 frames of plane wave ultrasonic images;
(1-3) after all plane wave ultrasonic images are obtained, in order to simulate the influence of noise in an actual experiment, 10dB of white Gaussian noise is added to the generated ultrasonic images one by one;
(2) filtering operation is carried out on all the obtained plane wave ultrasonic images based on a wiener filter (or other filters) so as to remove noise contained in the plane wave ultrasonic images;
(3) constructing an SOFI imaging model, which comprises the following specific steps:
(3-1) calculating plane wave ultrasonic data based on ultrasonic plane wave data in which the imaging region contains only a single microbubbleTransverse full width at half maximum (FHWM)x) Longitudinal half width (FHWM)y);
(3-2) calculating by the formula (3-1) to obtain a transverse standard deviation based on the obtained transverse half-height width and longitudinal half-height widthxStandard deviation from longitudinaly;
FHWM in the formula (3-1)xIs a transverse half-height width, FHWMyIs longitudinal half-height width;xandyrespectively a transverse standard deviation and a longitudinal standard deviation;
(3-3) based on the obtainedxAndycalculating to obtain a point diffusion distribution model by applying a formula (3-2);
in the formula (3-2), x and y describe an x axis and a y axis, respectively; x is the number of0And y0Describing the abscissa and ordinate values of the central point; psfxAs a function of the lateral probability density, psfyIs a longitudinal probability density function;
(4) the SOFI utilizes the fluorescence fluctuation characteristics of fluorescent molecules in imaging to generate cumulant equations with different orders, and the cumulant equation CnThe formula (3) is shown as the formula (3-3);
in the formula (3-3), U (r) describes the Point Spread Function (PSF) of the system,kis the molecular brightness, wk(τ1,…,τn-1) Is based on a related weighting function, n representing the order of the accumulation; when using an n-order SOFI, spatial resolution may be improvedHowever, the SOFI has a non-linear response to luminance and flicker heterogeneity, resulting in the inability to use higher onesCumulatively to increase resolution;
(5) bSOFI processing step: in the bSOFI method, three parameters, i.e., the ratio of the light-emitting states to the time, are extractedMolecular brightnessAnd molecular densityThen, deconvoluting the accumulated quantity calculated in the formula (3-3) to eliminate the nonlinear response to the brightness; then, the accumulated quantities are denoised by truncating smaller values (e.g., 1% -5% of the maximum value) and the luminance is linearized; finally, the image and the point spread function are convolved again to obtain a balanced accumulated image;
(6) and (3) taking the denoised plane wave ultrasonic image in the step (2) as an input, and calculating to obtain a second-order (or high-order) balanced SOFI image based on the SOFI imaging model constructed in the step (3) and the SOFI calculation formula in the step (4) and the processing method bSOFI in the step (5).
According to the finally obtained balanced SOFI image, the method provided by the invention can effectively improve the spatial resolution of ultrasonic plane wave imaging and realize ultrasonic imaging with ultrahigh resolution; in addition, due to the use of the plane wave scanning technology, the method can also effectively improve the imaging time resolution and greatly improve the imaging performance of the existing ultrasonic technology.
Claims (1)
1. An ultra-high resolution plane wave ultrasonic imaging method based on SOFI is characterized by comprising the following operation steps:
(1) under the intervention of an ultrasonic contrast agent microbubble, carrying out ultrasonic plane wave imaging on an imaging object to obtain a group of plane wave ultrasonic images at different moments; each frame of image comprises a plurality of point scatterer microbubbles which are randomly distributed in an imaging area;
(2) filtering operation is carried out on all the obtained plane wave ultrasonic images based on a wiener filter or other filters so as to remove noise contained in the plane wave ultrasonic images;
(3) constructing an SOFI imaging model, which comprises the following specific steps:
(3-1) calculating a transverse half-width-at-half-height (FHWM) of the plane wave ultrasound data based on the ultrasound plane wave data in which the imaging region contains only a single microbubblex) Longitudinal half width (FHWM)y);
(3-2) calculating by the formula (3-1) to obtain a transverse standard deviation based on the obtained transverse half-height width and longitudinal half-height widthxStandard deviation from longitudinaly;
FHWM in the formula (3-1)xIs a transverse half-height width, FHWMyIs longitudinal half-height width;xandyrespectively a transverse standard deviation and a longitudinal standard deviation;
(3-3) based on the obtainedxAndycalculating to obtain a point diffusion distribution model by applying a formula (3-2);
in the formula (3-2), x and y describe an x axis and a y axis, respectively; x is the number of0And y0Describing the abscissa and ordinate values of the central point; psfxAs a function of the lateral probability density, psfyIs a longitudinal probability density function;
(4) the SOFI utilizes the fluctuation characteristics of molecules to generate cumulant equations with different orders, and cumulant equation CnThe formula (3) is shown as the formula (3-3);
in the formula (3-3), U (r) describes the Point Spread Function (PSF) of the system,kis the molecular brightness, wk(τ1,…,τn-1) Is based on phasesA weighting function of interest, n representing the order of the accumulation; spatial resolution is improved when using an n-order SOFIDoubling;
(5) bSOFI processing step: the balance SOFI (bSOFI) is used as an extended version of the SOFI and is used for further improving the spatial resolution of imaging; in the bSOFI method, three parameters, i.e., the ratio of the light-emitting states to the time, are extractedMolecular brightnessAnd molecular densityThen, deconvoluting the accumulated quantity calculated in the formula (3-3) to eliminate the nonlinear response to the brightness; then, denoising the cumulant by cutting off a smaller value, and linearizing the luminance; finally, the image and the point spread function are convolved again to obtain a balanced accumulated image;
(6) and (3) taking the denoised plane wave ultrasonic image in the step (2) as an input, and calculating to obtain a second-order or high-order balanced SOFI image based on the SOFI imaging model constructed in the step (3) and the SOFI calculation formula in the step (4) and the bSOFI processing method in the step (5).
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711232982.7A CN108095756B (en) | 2017-11-30 | 2017-11-30 | Super-high resolution plane wave ultrasonic imaging method based on SOFI |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711232982.7A CN108095756B (en) | 2017-11-30 | 2017-11-30 | Super-high resolution plane wave ultrasonic imaging method based on SOFI |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108095756A CN108095756A (en) | 2018-06-01 |
CN108095756B true CN108095756B (en) | 2020-10-30 |
Family
ID=62208829
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711232982.7A Active CN108095756B (en) | 2017-11-30 | 2017-11-30 | Super-high resolution plane wave ultrasonic imaging method based on SOFI |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108095756B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109998589A (en) * | 2019-04-09 | 2019-07-12 | 上海大学 | A kind of compressed sensing based super-resolution ultrasonic imaging method |
CN110477947B (en) * | 2019-08-14 | 2022-04-15 | 中国科学院苏州生物医学工程技术研究所 | Plane wave beam synthesis method, system, storage medium and equipment based on deep learning |
CN110772285B (en) * | 2019-10-31 | 2022-05-17 | 南京景瑞康分子医药科技有限公司 | Ultrasonic super-resolution imaging method |
CN112435305A (en) * | 2020-07-09 | 2021-03-02 | 上海大学 | Ultra-high resolution ultrasonic imaging method based on deep learning |
CN114062507A (en) * | 2021-11-10 | 2022-02-18 | 复旦大学 | Ultra-high resolution ultrasonic imaging method based on repeated accumulation analysis |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104458683A (en) * | 2013-12-18 | 2015-03-25 | 香港科技大学 | Deep cell super-resolution imaging methods, deep cell super-resolution imaging optical system and prism sheet device |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140333750A1 (en) * | 2011-12-15 | 2014-11-13 | President And Fellows Of Harvard College | High resolution dual-objective microscopy |
-
2017
- 2017-11-30 CN CN201711232982.7A patent/CN108095756B/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104458683A (en) * | 2013-12-18 | 2015-03-25 | 香港科技大学 | Deep cell super-resolution imaging methods, deep cell super-resolution imaging optical system and prism sheet device |
Non-Patent Citations (3)
Title |
---|
Mapping molecular statistics with balanced super-resolution optical fluctuation imaging (bSOFI);Stefan Geissbuehler等;《Optical Nanoscopy》;20121215;全文 * |
Super-resolution photoacoustic imaging via flow-induced absorption fluctuations;THOMAS CHAIGNE等;《OPTICA》;20171120;全文 * |
超分辨光学波动显微成像技术研究;李蕊;《中国优秀硕士学位论文全文数据库(电子期刊)信息科技辑》;20170715;全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN108095756A (en) | 2018-06-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108095756B (en) | Super-high resolution plane wave ultrasonic imaging method based on SOFI | |
Coupé et al. | A CANDLE for a deeper in vivo insight | |
Qiu et al. | Spatiotemporal laser speckle contrast analysis for blood flow imaging with maximized speckle contrast | |
Anoop et al. | Retracted article: medical image enhancement by a bilateral filter using optimization technique | |
CN109447930B (en) | Wavelet domain light field full-focusing image generation algorithm | |
US20040247198A1 (en) | Image processing method and apparatus | |
CN112396560A (en) | System and method for deblurring medical images using a deep neural network | |
Hüpfel et al. | Wavelet-based background and noise subtraction for fluorescence microscopy images | |
CN111127320A (en) | Photoacoustic image super-resolution reconstruction method and device based on deep learning | |
KR100760251B1 (en) | Ultrasound image processing system and method | |
Choi et al. | Mean-subtraction method for de-shadowing of tail artifacts in cerebral OCTA images: a proof of concept | |
Almalki et al. | Enhancement of Medical Images through an Iterative McCann Retinex Algorithm: A Case of Detecting Brain Tumor and Retinal Vessel Segmentation | |
Zuo et al. | Spectral crosstalk in photoacoustic computed tomography | |
Hakakzadeh et al. | A spatial-domain factor for sparse-sampling circular-view photoacoustic tomography | |
CN109146812B (en) | Method for removing hexagonal noise from endoscope image based on frequency domain filtering | |
Qin et al. | Shearlet-TGV based fluorescence microscopy image deconvolution | |
DE102017108873A1 (en) | Phase-contrast imaging with transfer function | |
van Elteren et al. | Comparison of single pulse, multiple dosage, and 2D oversampling/deconvolution LA-ICPMS strategies for mapping of (ultra) low-concentration samples | |
CN116091317A (en) | Super-resolution method and system for secondary electron image of scanning electron microscope | |
Krylov et al. | A post-processing method for 3D fundus image enhancement | |
Lan et al. | A high-dynamic-range optical remote sensing imaging method for digital TDI CMOS | |
Wu et al. | A method for medical microscopic images’ sharpness evaluation based on NSST and variance by combining time and frequency domains | |
JP4982393B2 (en) | Image filtering apparatus, image filtering program, image filtering method, and ultrasonic diagnostic apparatus | |
WO2011018155A1 (en) | Method for noise suppression and directional contrast enhancement of nuclear magnetic resonance tomographic diffusion data, imaging method, computer program product, and imaging device | |
JP6274495B2 (en) | Image processing apparatus and ultrasonic diagnostic apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |