CN109799284B - Multi-harmonic self-adaptive separation method for ultrasonic echo signals - Google Patents
Multi-harmonic self-adaptive separation method for ultrasonic echo signals Download PDFInfo
- Publication number
- CN109799284B CN109799284B CN201910085176.4A CN201910085176A CN109799284B CN 109799284 B CN109799284 B CN 109799284B CN 201910085176 A CN201910085176 A CN 201910085176A CN 109799284 B CN109799284 B CN 109799284B
- Authority
- CN
- China
- Prior art keywords
- component
- signal
- components
- mode
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
The invention discloses a multi-harmonic self-adaptive separation method of ultrasonic echo signals, which comprises the steps of collecting and storing ultrasonic radio frequency echo signals of tissues, calculating the frequency spectrum of data of each scanning line in the signals, and obtaining frequency spectrum curves and frequency component components of local peak values; performing single-mode signal decomposition to obtain corresponding signal components, dividing the component into signal components such as fundamental wave components and harmonic components according to the frequency corresponding to the component energy peak value, and correspondingly superposing the signal components; if the frequency component contains more than one component, classifying the frequency component into a signal component which needs to be subjected to single-mode decomposition again; and performing single-mode signal decomposition on the signal component to be decomposed again, judging the decomposition result until the signal is decomposed into components only containing fundamental wave or each subharmonic component, and respectively integrating each division result into an image to obtain a B-ultrasonic image corresponding to the fundamental wave and each subharmonic. The invention can adaptively and accurately extract each harmonic from the ultrasonic echo signal and provides a reliable technical means for tissue harmonic imaging diagnosis.
Description
The technical field is as follows:
the invention belongs to the technical field of harmonic detection, and particularly relates to a multi-harmonic self-adaptive separation method of an ultrasonic echo signal.
Background art:
tissue harmonic imaging refers to a technology for receiving and imaging harmonic information generated by nonlinear propagation of ultrasonic waves, and is a major breakthrough in the field of ultrasound nonlinearity developed in recent years. The method improves the signal-to-noise ratio and the quality of the image, and has great advantages in the aspect of eliminating artifacts and sidelobe interference. Due to the improved tissue imaging performance, the clinical diagnosis range and the diagnosis level of a plurality of diseases are expanded and improved. In addition, the ultrasonic contrast agent can excite subharmonic waves, ultraharmonic waves and the like under the action of ultrasound, and the subharmonic waves and the ultraharmonic waves have better tissue ratio than fundamental waves and second harmonic waves, thereby showing wide application prospect in the field of medical diagnosis. Therefore, it is important to completely and accurately separate the second harmonic, the sub-harmonic, and the super-harmonic from the ultrasonic rf echo signal.
At present, two common methods for extracting harmonic components from an ultrasonic echo signal include high-pass filtering and pulse inversion. The cut-off frequency, the order and the algorithm type of the high-pass filter have great influence on the separation precision of harmonic signals, and relatively proper filter parameters and types are selected according to the priori knowledge of echo signals to carry out separation processing on the harmonic signals; in addition, in real signals, the high-frequency part of the fundamental wave component often overlaps with the low-frequency part of the second harmonic signal, and the situation that overlapping or certain harmonic wave does not exist also occurs among the second harmonic signals, and the high-pass filtering method directly divides the ultrasonic echo signal into several parts according to the cut-off frequency no matter whether overlapping or nonexistence exists. This reduces the accuracy of the fundamental and multiple harmonic separation, while causing the loss of each harmonic component. The pulse inversion method can adaptively separate odd harmonic signals and even harmonic signals into two parts, and enhance the strength of the two separated parts to a certain extent, but cannot realize the adaptive separation of multiple harmonics. In addition, because two incident waves with opposite phases need to be transmitted in sequence and echo waves need to be superposed, the detection frame frequency is reduced, and the tissues of the detected object need to be static. Tissue motion or the application of high frame rates can produce large separation errors. In summary, the existing method cannot completely and accurately separate multiple harmonic signals from the in-vivo measured ultrasonic radio frequency echo signal.
The invention provides a multiple harmonic self-adaptive separation method of an ultrasonic echo signal, aiming at self-adaptively separating fundamental wave and each subharmonic component from the ultrasonic echo signal without prior information of a signal to be processed.
Through literature retrieval, no public report related to the multiple harmonic adaptive separation method of the ultrasonic echo signal, which is the same as the technical scheme of the invention, is found.
The invention content is as follows:
aiming at the defects of the existing technology for separating multiple harmonic components from an ultrasonic echo signal, the invention provides a multiple harmonic self-adaptive separation method of the ultrasonic echo signal, which has the advantage that multiple harmonic detection and separation can be self-adaptively completed without the prior knowledge of a signal to be processed.
The invention discloses a multi-harmonic self-adaptive separation method of ultrasonic echo signals, which comprises the following specific steps:
1) the ultrasound radio frequency echo signals of the tissue are collected and stored. The ultrasonic transducer emits sine excitation to the tissue for ultrasonic scanning, receives an ultrasonic radio frequency echo signal which returns from the tissue and contains tissue base and harmonic information, stores the ultrasonic radio frequency echo signal and performs subsequent analysis;
2) performing fast Fourier transform on the received and stored radio frequency echo signal to obtain a frequency spectrum of the signal; smoothing the frequency spectrum to obtain a frequency spectrum curve, and recording the frequency corresponding to the maximum value of the detected frequency spectrum curve as the central frequency f of the signal0；
3) Performing single-mode signal decomposition on the radio frequency signal according to the frequency component distribution of the radio frequency signal to obtain a plurality of single-mode components of which the frequency components are from high to low;
4) performing fast Fourier transform on each component obtained by single-mode signal decomposition to obtain the frequency spectrum of each component, and performing smoothing treatment to obtain a frequency spectrum curve;
5) all local maxima (n total) for each component spectral curve are obtained and sorted in descending order, with maximum P1If P is1-Pi＜PthThen, it is considered that the maximum value can represent a single-mode probability, and only the maximum values (m in total) that can represent single-mode frequencies are reserved, where i is 1, 2thIndicating that the maximum satisfies a threshold representing single mode frequency content;
6) judging whether each component contains a mixed frequency: if m is more than or equal to 2, the component contains mixed frequency components and is not a single-mode component; if m < 2, the component is a single mode component;
7) if the component is a single-mode component, f corresponding to the energy peak value of each component is determined0、2f0、3f0Dividing the signal components into signal components such as fundamental wave components, second harmonic components or third harmonic components, and correspondingly superposing the signal components; if the signal component is not the single-mode component, classifying the signal component into a signal component which needs to be subjected to single-mode decomposition again;
8) after judging and classifying all the frequency components obtained by decomposition, judging whether the signal component needing to be subjected to single-mode decomposition again is empty; if the value is empty, entering the next step; otherwise, the component is used as a new signal to be decomposed until the signal is decomposed into components only containing fundamental wave components or harmonic components;
9) and correspondingly superposing the obtained component components respectively to obtain a complete radio frequency echo signal only containing the fundamental wave component or each subharmonic component.
Further, the signal component which is not the single-mode component in the step (7) and the signal component to be decomposed in the step (8) return to the step (3) to continue the decomposition.
Compared with the prior art, the invention has the following technical effects:
1) according to the frequency distribution of the echo signals, the signals can be adaptively divided into a plurality of single-mode components from high to low according to frequency components under the condition of not needing prior information of the signals to be processed;
2) according to the frequency distribution in each single-mode component, the component is divided into signal components only containing fundamental wave components, second harmonic components or third harmonic components;
3) and (3) regarding the component containing the mixed frequency as a new signal to be decomposed, continuing to decompose the single-mode signal until the component containing the mixed frequency does not exist, and completing the separation of the fundamental wave and multiple harmonic components of the ultrasonic radio frequency echo signal.
Hardware materials such as an ultrasonic transducer, a signal transmission cable and the like used by the invention are purchased from the market, and echo signal storage, a frequency analysis method, a fast Fourier transform and a smoothing method are all disclosed technologies.
Description of the drawings:
fig. 1 is a flowchart of a method for adaptively separating multiple harmonics of an ultrasonic echo signal according to the present invention.
Fig. 2 is a flowchart of the multi-harmonic adaptive separation and imaging results of the ultrasonic echo signal according to the embodiment.
In fig. 2, 1, the process of embodiment standardized ultrasound imaging forms an original B-mode ultrasound image; 2. a time domain oscillogram of a line of radio frequency echo signals; 3. a normalized frequency spectrum of a line of the radio frequency echo signal; 4. the mixed frequency simultaneously contains fundamental wave and second harmonic component; 5. a mixed frequency plot containing both second and third harmonic components; 6. frequencies containing only the fundamental component; 7. frequencies containing only second harmonic components; 8. the method comprises the following steps of obtaining a fundamental component normalized frequency spectrum by multiple harmonic self-adaptive separation of ultrasonic echo signals; 9. the second harmonic component normalized frequency spectrum is obtained by multiple harmonic self-adaptive separation of the ultrasonic echo signal; 10. third harmonic component normalized frequency spectrum obtained by multiple harmonic self-adaptive separation of ultrasonic echo signals; 11. the standardized ultrasonic imaging process forms a B ultrasonic image only containing a fundamental wave component; 12. b ultrasonic images only containing second harmonic components are formed in the process of standardized ultrasonic imaging; 13. the process of standardized ultrasound imaging forms a B-mode ultrasound image containing only the third harmonic component.
The specific implementation mode is as follows:
the present invention is further described in detail below with reference to fig. 2 and examples.
Taking the measurement of liver tissues as an example, the specific implementation steps of the invention comprise:
1) ultrasonic echo signals of liver tissues are collected and stored. The liver tissue is flatly placed on a measuring table, ultrasonic scanning is stably and accurately carried out on the tissue by using an ultrasonic transducer, ultrasonic echo signals which are returned from the tissue and carry fundamental wave and each harmonic information are transmitted and received, and an original B ultrasonic image 1 is formed according to a standardized ultrasonic imaging process. Storing the radio frequency echo signal by using an open type ultrasonic detection system to perform subsequent signal analysis;
2) the method of the invention needs to process each line of the radio frequency signal and then integrate, and the processing method for each line is the same. Selecting a line marked in black in an original B ultrasonic image 1 formed in the process of standardized ultrasonic imaging as an example, and performing fast Fourier transform on the line of signals by using a time domain waveform 2 to obtain a normalized frequency spectrum 3 of the signals;
3) smoothing the frequency spectrum of the normalized frequency spectrum 3 of a line of the radio frequency echo signal to obtain the maximum value of a smoothed frequency spectrum curve, and recording the corresponding frequency as f0As the center frequency of the fundamental wave;
4) performing single-mode signal decomposition on the radio frequency signal according to the frequency component distribution of the radio frequency signal to obtain components of N frequency components from high to low;
5) performing fast Fourier transform on each component obtained by single-mode signal decomposition to obtain the frequency spectrum of each component, and performing smoothing treatment to obtain a frequency spectrum curve;
6) all local maxima (n total) for each component spectral curve are obtained and sorted in descending order, with maximum P1If P is1-Pi＜PthThen, the maximum is considered to represent a single-mode probability, and only the maximum (m in total) that can represent a single-mode frequency is retained, where i is 1, 2, …, n, PthIndicating that the maximum satisfies a threshold representing single mode frequency content;
7) judging whether each component contains a mixed frequency: reserving the number m of maximum values which can represent single-mode frequency according to the step (6):
a) if m is more than or equal to 2, two maximum values which can represent single-mode components (simultaneously comprise fundamental wave and second harmonic component 4, and simultaneously comprise second harmonic and third harmonic component 5) are contained, the component contains mixed frequency components, is not a single-mode component, and is classified into signal components which need to be subjected to single-mode decomposition again;
b) if m < 2, only one maximum value (only the fundamental wave component 6 and only the second harmonic component 7) representing a single-mode component is contained, and the component is considered as a single-mode component, the components are divided into signal components such as a fundamental wave component, a second harmonic component or a third harmonic component according to the frequency corresponding to the energy peak of each component.
8) After judging and classifying all the frequency components obtained by decomposition, judging whether the signal component needing to be subjected to single-mode decomposition again is empty; if the value is empty, entering the next step; otherwise, returning the component as a new signal to be decomposed to the step (4) for continuous decomposition until the signal is decomposed into components only containing fundamental wave components or harmonic components;
9) and correspondingly superposing the obtained component components respectively to obtain a complete radio frequency echo signal only containing the fundamental wave component or each subharmonic component.
10) The normalized spectrum 8 of the fundamental component obtained by the multiple harmonic adaptive separation of the ultrasonic echo signal, the normalized spectrum 9 of the second harmonic component obtained by the multiple harmonic adaptive separation of the ultrasonic echo signal, and the normalized spectrum 10 of the third harmonic component obtained by the multiple harmonic adaptive separation of the ultrasonic echo signal show the normalized spectrum of the fundamental component or each subharmonic component obtained by the multiple harmonic adaptive separation of the ultrasonic echo signal.
Repeating the steps for each line of the ultrasonic radio frequency echo signal, and respectively integrating the fundamental wave component or each subharmonic component obtained by each line of the signal to obtain the complete radio frequency echo signal only containing the fundamental wave component and the radio frequency echo signal only containing the multiple harmonic components. Forming a B-mode ultrasonic image 11 containing only a fundamental wave component according to a standardized ultrasonic imaging process; a B-mode ultrasonic image 12 containing only second harmonic components; and a B-mode ultrasonic image 13 containing only a third harmonic component.
In summary, the present invention relates to a multiple harmonic adaptive separation method for an ultrasonic echo signal, which can adaptively detect and separate fundamental waves and multiple harmonic components in the signal according to frequency components of the signal.
Claims (2)
1. A multi-harmonic self-adaptive separation method of an ultrasonic echo signal specifically comprises the following steps:
(1) collecting and storing ultrasonic radio frequency echo signals of tissues;
(2) for obtaining signals by performing fast Fourier transform on received and stored radio-frequency echo signalsA frequency spectrum; smoothing the frequency spectrum to obtain a frequency spectrum curve, and recording the frequency corresponding to the maximum value of the detected frequency spectrum curve as the central frequency f of the signal0；
(3) Performing single-mode signal decomposition on a radio frequency signal according to frequency component distribution of the radio frequency signal to obtain a single-mode component of a plurality of frequency components from high to low, performing fast Fourier transform on each component obtained by the single-mode signal decomposition to obtain a frequency spectrum of each component, performing smoothing treatment to obtain a frequency spectrum curve, obtaining all local maximum values of each component frequency spectrum curve, counting n local maximum values, and arranging the local maximum values in a descending order, wherein the maximum value is P1If P is1-Pi＜PthThen, the maximum value is considered to represent a single-mode probability, and only the maximum values that can represent single-mode frequencies are reserved, for a total of m, where i is 1, 2thIndicating that the maximum satisfies a threshold representing single mode frequency content;
(4) judging whether each component contains a mixed frequency: if m is more than or equal to 2, the component contains mixed frequency components and is not a single-mode component; if m < 2, the component is a single mode component;
(5) if the component is a single-mode component, f corresponding to the energy peak value of each component is determined0、2f0、3f0Dividing the signals into signal components such as fundamental wave components, second harmonic components or third harmonic components, and correspondingly superposing the signal components; if the signal component is not the single-mode component, classifying the signal component into a signal component which needs to be subjected to single-mode decomposition again;
(6) after judging and classifying all the frequency components obtained by decomposition, judging whether the signal component needing to be subjected to single-mode decomposition again is empty; if the value is empty, entering the next step; otherwise, the component is used as a new signal to be decomposed until the signal is decomposed into components only containing fundamental wave components or harmonic components;
(7) and correspondingly superposing the obtained component components respectively to obtain a complete radio frequency echo signal only containing the fundamental wave component or each subharmonic component.
2. The method according to claim 1, wherein the step (7) of superposing the components containing mixed frequency components is followed by performing single-mode signal decomposition again, and the fundamental component and each subharmonic component in the signal are completely separated by an iterative decomposition process, and the method comprises the following steps:
(1) performing fast Fourier transform on each component obtained by single-mode signal decomposition to obtain the frequency spectrum of each component, and performing smoothing treatment to obtain a frequency spectrum curve;
(2) judging whether each component is a single-mode component or not according to the frequency component of the component; if the signal components are single-mode components, dividing the single-mode components into signal components such as fundamental wave components, second harmonic components or third harmonic components, and correspondingly superposing the signal components; if the signal component is not the single-mode component, classifying the signal component into a signal component which needs to be subjected to single-mode decomposition again;
(3) if the component needing to be subjected to single-mode signal decomposition again exists, the component is reset to be the signal to be decomposed, and the signal is decomposed continuously until the signal is decomposed into the component containing only the fundamental wave component or each subharmonic component.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910085176.4A CN109799284B (en) | 2019-01-29 | 2019-01-29 | Multi-harmonic self-adaptive separation method for ultrasonic echo signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910085176.4A CN109799284B (en) | 2019-01-29 | 2019-01-29 | Multi-harmonic self-adaptive separation method for ultrasonic echo signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109799284A CN109799284A (en) | 2019-05-24 |
| CN109799284B true CN109799284B (en) | 2021-07-02 |
Family
ID=66559032
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910085176.4A Active CN109799284B (en) | 2019-01-29 | 2019-01-29 | Multi-harmonic self-adaptive separation method for ultrasonic echo signals |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109799284B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113740678A (en) * | 2021-08-02 | 2021-12-03 | 中国电力科学研究院有限公司 | Noise reduction method and system suitable for corona current measurement data |
| CN114886463B (en) * | 2022-05-05 | 2023-06-16 | 以诺康医疗科技（苏州）有限公司 | Ultrasonic imaging method, system and signal demodulation method for ultrasonic imaging |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1977186A (en) * | 2004-06-30 | 2007-06-06 | 皇家飞利浦电子股份有限公司 | Nonlinear ultrasonic diagnostic imaging using intermodulation product signals |
| CN1976636A (en) * | 2004-06-30 | 2007-06-06 | 皇家飞利浦电子股份有限公司 | Ultrasonic diagnostic contrast imaging at moderate MI levels |
| CN101129268A (en) * | 2007-10-09 | 2008-02-27 | 哈尔滨工业大学（威海） | Method and device for complex imaging with principal wave harmonic wave |
| CN104224232A (en) * | 2014-09-25 | 2014-12-24 | 飞依诺科技(苏州)有限公司 | Ultrasonic harmonic imaging method and device |
| CN104757999A (en) * | 2015-04-07 | 2015-07-08 | 声泰特（成都）科技有限公司 | Ultrasonic fundamental wave and harmonic wave based nonlinear imaging method and system |
| CN107970042A (en) * | 2018-01-03 | 2018-05-01 | 声泰特（成都）科技有限公司 | A kind of ultrasound non-linear quantifies real time imagery method and system |
| CN108629770A (en) * | 2018-05-03 | 2018-10-09 | 河北省计量监督检测研究院廊坊分院 | Ultrasonic image division method based on support vector machines |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180049720A1 (en) * | 2016-08-17 | 2018-02-22 | Carestream Health, Inc. | Ultrasound beamforming system and method |
-
2019
- 2019-01-29 CN CN201910085176.4A patent/CN109799284B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1977186A (en) * | 2004-06-30 | 2007-06-06 | 皇家飞利浦电子股份有限公司 | Nonlinear ultrasonic diagnostic imaging using intermodulation product signals |
| CN1976636A (en) * | 2004-06-30 | 2007-06-06 | 皇家飞利浦电子股份有限公司 | Ultrasonic diagnostic contrast imaging at moderate MI levels |
| CN101129268A (en) * | 2007-10-09 | 2008-02-27 | 哈尔滨工业大学（威海） | Method and device for complex imaging with principal wave harmonic wave |
| CN104224232A (en) * | 2014-09-25 | 2014-12-24 | 飞依诺科技(苏州)有限公司 | Ultrasonic harmonic imaging method and device |
| CN104757999A (en) * | 2015-04-07 | 2015-07-08 | 声泰特（成都）科技有限公司 | Ultrasonic fundamental wave and harmonic wave based nonlinear imaging method and system |
| CN107970042A (en) * | 2018-01-03 | 2018-05-01 | 声泰特（成都）科技有限公司 | A kind of ultrasound non-linear quantifies real time imagery method and system |
| CN108629770A (en) * | 2018-05-03 | 2018-10-09 | 河北省计量监督检测研究院廊坊分院 | Ultrasonic image division method based on support vector machines |
Non-Patent Citations (1)
| Title |
|---|
| "A Novel Method for Separating Harmonic from Ultrasonic Echo Signals Using Improved Complete Ensemble Empirical Mode Decomposition with Adaptive Noise Algorithm";Suya Han.et al;《2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics》;20180228;第1-3页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109799284A (en) | 2019-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3455936B1 (en) | Systems, methods and programs for denoising signals using wavelets | |
| CN1954235B (en) | Improved method and device for local spectral analysis of an ultrasonic signal | |
| US6181810B1 (en) | Method and apparatus for spatial and temporal filtering of intravascular ultrasonic image data | |
| US20210190912A1 (en) | Method and Apparatus for Identifying Behavior of Target, and Radar System | |
| CN109799284B (en) | Multi-harmonic self-adaptive separation method for ultrasonic echo signals | |
| Yoon et al. | An efficient pulse compression method of chirp-coded excitation in medical ultrasound imaging | |
| Chang et al. | Frequency compounded imaging with a high-frequency dual element transducer | |
| CN103860201B (en) | A kind of based on broad beam contrast imaging and the method extracting infusion time intensity curve | |
| KR101610874B1 (en) | Module for Processing Ultrasonic Signal Based on Spatial Coherence and Method for Processing Ultrasonic Signal | |
| JP6105286B2 (en) | Digital signal processing method, digital signal processing apparatus, and program | |
| Adoul et al. | Time-frequency readability enhancement of compact support kernel-based distributions using image post-processing: Application to instantaneous frequency estimation of M-ary frequency shift keying signals | |
| Granchi et al. | Multidimensional spectral analysis of the ultrasonic radiofrequency signal for characterization of media | |
| CN110313940B (en) | Signal attenuation calculation method, device, equipment and computer readable storage medium | |
| KR101126182B1 (en) | Harmonic imaging apparatus of using nonlinear chirp signal and method thereof | |
| CN106780410B (en) | Generation method and device of harmonic scanning image | |
| Tsui et al. | An adaptive threshold filter for ultrasound signal rejection | |
| Seabra et al. | A Rayleigh mixture model for IVUS imaging | |
| US8500647B1 (en) | Data-optimized filter for image processing | |
| WO2021263006A1 (en) | Wavelet denoising using signal location windowing | |
| US9984450B2 (en) | Method and apparatus for enhancement of ultrasound images by selective differencing | |
| US10327740B2 (en) | Retrieving high spatial frequency information in sonography | |
| Schwarzenberg et al. | P1A-4 Model-Based Pulse Detection for 3D Ultrasound Computer Tomography | |
| Han et al. | A novel method for separating harmonic from ultrasonic echo signals using improved complete ensemble empirical mode decomposition with adaptive noise algorithm | |
| Intrator et al. | Sonar object discrimination via spectral density analysis | |
| RU2440022C2 (en) | Method for electric cardiac signal noise cancellation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |