CN110266988A - A kind of interlace-removing method detected based on scene shear and content characteristic - Google Patents
A kind of interlace-removing method detected based on scene shear and content characteristic Download PDFInfo
- Publication number
- CN110266988A CN110266988A CN201910477625.XA CN201910477625A CN110266988A CN 110266988 A CN110266988 A CN 110266988A CN 201910477625 A CN201910477625 A CN 201910477625A CN 110266988 A CN110266988 A CN 110266988A
- Authority
- CN
- China
- Prior art keywords
- backward
- field
- count
- scene
- image block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
- H04N5/147—Scene change detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
Abstract
The invention discloses a kind of interlace-removing methods detected based on scene shear and content characteristic, pass through the computing resource using scene change detecte, local features detection is carried out to video content, common moving region, compound movement region and stagnant zone will be divided into when each image block in front court.Then the video content features judging result for integrating entirety and regional area uses different motion compensated interpolations for the region of type.The present invention can reduce unnecessary estimation and motion state analytic process, to reduce the complexity of entire de interlacing algorithm.
Description
Technical field
It is the invention belongs to technical field of video processing, in particular to a kind of to be gone based on what scene shear and content characteristic detected
Interlacing method.
Background technique
It is limited by band resource and refreshing frequency, the analog television broadcast system of early stage is carried out using interlaced scan format
Transmission and display.The occupancy of bandwidth not only can be effectively reduced in this interlace mode, but also can eliminate and play video figure
When picture, since bulk region flashes caused by video frame rate is insufficient.With the development of modern science and technology technology, people pursue higher
The visual enjoyment of quality, this is resulted in field of video processing, and de-interlaced status is more and more important.Although many post-processings
The built-in de interlacing of software handles function, but their algorithm is all extremely single, and vision expected from people is often not achieved and wants
It asks.Opposite, although some interlace-removing methods for high-end video image procossing can improve clarity in very big program,
It is that the big and requirement to hardware of computational complexity is also higher, can not be really popularized in the market.So even to this day,
Still there are important theoretical and practical values for the research of the de interlacing algorithm of high-performance, low cost.
The research highest motion compensation de interlacing algorithm of temperature can be more abundant, quasi- according to the result of estimation at present
Image information in true land productivity use between field, realizes more accurate interpolation, and overcome the side of non-motion compensated algorithm
The disadvantages of edge sawtooth, motion blur.Again because being obtained most in motion compensation de interlacing algorithm heavy dependence motion estimation process
The accuracy of good speed moving vector, and it is extremely sensitive to error, so complexity is biggish in the limited situation of hardware condition
Motion compensation de interlacing algorithm cannot be widely applied.
Therefore, often motion compensation de interlacing algorithm merged with other de interlacing algorithms in practical application or
In conjunction with the advantage of de interlacing algorithm and other technologies, learn from other's strong points to offset one's weaknesses, to improve the high efficiency of algorithm realization and the accuracy of interpolation.
Many algorithms from different angles promote de-interlacing performance, but are difficult between high-performance, high-precision and low cost
Reach ideal balance.
In order to solve above-mentioned critical issue, a kind of new de-interlaced method is proposed, during scene shear
Computing resource increases entirety and local features judgement, proposes a kind of adaptive-interpolation based on video content detection
Algorithm can not only reduce the complexity of de interlacing algorithm, and for different types of interlaced, can obtain clearly by
Row video image.
The disclosure of background above technology contents is only used for auxiliary and understands patent application design and technical solution of the invention,
Not necessarily belong to the prior art of the invention, no tangible proof show above content the applying date of the invention
In disclosed situation, above-mentioned background technique should not be taken to evaluate novelty and creativeness of the invention.
Summary of the invention
Goal of the invention: in order to overcome the deficiencies in the prior art, the present invention provides a kind of based on scene shear and interior
The interlace-removing method for holding feature detection, can reduce unnecessary estimation and motion state analytic process, to reduce whole
The complexity of a de interlacing algorithm.
Technical solution: to achieve the above object, the present invention provides a kind of to be gone based on what scene shear and content characteristic detected
Interlacing method includes the following steps:
(1) regional area type judges: during scene change detecte, by comparing the difference when front court and front and back
The different judgement for obtaining whole field video content features and classification and the judgement of local features；
(2) adaptive-interpolation process: scene change detecte first is carried out to when front court, result is then will test and is divided into four classes:
When the occurrence scene shear simultaneously of front court and backward field, when the backward field of front court occurrence scene shear there is no scene shear, when
Front court there is no after scene shear to field occurrence scene shear, when front court there is no after scene shear to field also there is no
Scene shear；In when the occurrence scene shear, that is, continuous scene shear simultaneously of front court and backward field the case where, using frame interpolated value side
Formula；For other three classes situations, the judgement and classification of whole field video content features are first carried out in conjunction with the testing result of scene shear,
Then the local feature judgement for carrying out image block in field again, finally carries out classification interpolation.
Further, specific step is as follows for the judgement of regional area type in the step (1):
Wherein Local_forward and Local_backward respectively indicates the reference corresponding with front and back field of each image block
The comparison result of the image block of position；Local_forward=1 indicates that current image block is different from forward direction reference block, Local_
Forward=-1 indicates that current image block is similar to forward direction reference block, and Local_forward=0 indicates remaining uncertain condition；
Local_backward value 1, -1,0 respectively indicates current image block situations different from backward reference block, similar, uncertain；
The calculation method of forward direction absolute image block error AIBD_forward and backward absolute image block error AIBD_backward are as above
Shown in AIBD calculation formula；BlocksInWidth and BlocksInHeight is respectively estimation image block in row and column
Quantity；C1, C2 are empirical value, and value is 12,2 respectively；
During scene change detecte, each image block is first calculated relative to forward field and backward field correspondence image block
Absolute image block error AIBD_forward and AIBD_backward, then the value of AIBD is obtained compared with empirical value
The judgment method of Local_forward and Local_backward.
Further, forward direction absolute image block error AIBD_forward and backward absolute image block in the step (1)
Error AIBD_backward is only calculated once, and simultaneously for local features judgement and count_forward, count_
The quantity statistics of backward, wherein count_forward, count_backward are respectively indicated compared to forward field, backward
The quantity of the image block of the different detection types of field.
Further, it will test the specific classification decision procedure that result is divided into four classes in the step (2) are as follows:
If count_forward_different and count_backward_different are both greater than compare_
Count3, then when front court and the occurrence scene shear simultaneously of backward field；
If count_backward_same is greater than compare_count1 and count_forward_different is greater than
Compare_count3, then when there is no scene shears for the backward field of front court occurrence scene shear；
If count_forward_same is greater than compare_count1 and count_backward_different is greater than
Compare_count3, then when front court there is no after scene shear to field occurrence scene shear；
Remaining situation, when there is no also there is no scene shears to field after scene shear for front court；
Wherein compare_count1, compare_count2 and compare_count3 are empirical value, calculation
It is as follows:
Compare_count1=BlocksInWidth × BlockInHeight × 0.55
Compare_count2=BlocksInWidth × BlockInHeight × 0.5
Compare_count3=BlocksInWidth × BlockInHeight × 0.6
；Wherein count_forward_same, count_forward_different, count_forward_
Uncertain respectively indicates the image block of similar, different, uncertain three types obtained compared with forward direction reference field when front court
Quantity；Count_backward_same, count_backward_different, count_backward_uncertain points
It Biao Shi not be when the image number of blocks for similar, different, uncertain three types that front court obtains compared with backward reference field.
The utility model has the advantages that compared with the prior art, the present invention has the following advantages:
First, the present invention utilizes the computing resource during scene shear, increases entirety and local features are sentenced
It is disconnected, to use adaptive interpolation algorithm to different types of region, it is possible to reduce unnecessary estimation and movement shape
State analytic process；
Second, the present invention utilizes motion compensation de interlacing algorithm, can more sufficiently, accurately according to the result of estimation
Image information in land productivity use between field, realizes more accurate interpolation, and overcome the edge of non-motion compensated algorithm
The disadvantages of sawtooth, motion blur.Method proposed by the present invention can to avoid redundancy calculation amount, reduce and algorithm complexity and obtain
Clearly progressive video image.
Detailed description of the invention
Fig. 1 is flow chart of the invention.
Specific embodiment
The present invention will be further explained with reference to the accompanying drawing.
The present invention proposes a kind of video deinterlacing processing method, includes the following steps:
Interlaced video is inputted, works as whether front court generates scene shear according to the judgement of scene change detecte algorithm, it is basic herein
On, using the computing resource of existing absolute image block error (Absolute Image Block Differences, AIBD),
Increase the regional area type judgement to each each image block.
Wherein Fn(i, j) is the value of some pixel of current block, Fn±1(i ± 1, j) is the pixel of front and back corresponding position
Value, M, N, i, j, n are respectively motion estimation block height, motion estimation block width, Relative vertical coordinate, relative level coordinate and field
Picture numbers.
After the testing result for obtaining scene shear, if using frame interpolated value when front court generates continuous scene shear
Obtain progressive video.If there is no continuous scene shear, judgement when front court whether occurrence scene shear, if then doing base
In the estimation of scene change detecte (Scene Change Detection, SCD).When the backward field occurrence scene of front court is cut
Become, when front court there is no scene shear and when the more field picture of front court stagnant zone with opposite field compared with and is worked as in front court
The effect of scene shear is similar, their interpolation pixel and time-space domain adjacent pixel has very big correlation.Therefore, all may be used
With according to the judgement result of local feature, (i.e. current interpolation image block is to belong to stagnant zone or common moving region, still
Compound movement region), carry out adaptive-interpolation.But the field picture more for no moving region for generating scene shear,
The acquisition of optimal motion vectors is committed step, therefore, after scene change detecte and whole video content features determine,
Carry out estimation and motion state analysis.If can still combine regional area when the common moving region of top field image is more
Feature judgement carries out classification interpolation, if compound movement region is more, uses the motion compensated interpolation mode based on whole field.
As shown in Figure 1, be the interlace-removing method proposed by the present invention detected based on scene shear and content characteristic include with
Lower step:
(1) regional area type judges: during scene change detecte, working as front court and front and back still through comparing
Difference obtain the judgement and classification and the judgement of local features of whole field video content features, and these operations are all
It is carried out before interpolation, so as to lay the foundation for the selection of interpolation algorithm.The judgment mode of local features can be with shape
Formulaization is as follows:
Wherein Local_forward and Local_backward respectively indicates the reference corresponding with front and back field of each image block
The comparison result of the image block of position.Can be classified as three types, Local_forward=1 indicate current image block with
Forward direction reference block is different, and Local_forward=-1 indicates that current image block is similar to forward direction reference block, Local_forward
=0 indicates remaining uncertain condition.Similarly, Local_backward value 1, -1,0 respectively indicates current image block and backward ginseng
Examine different, similar, the uncertain situations of block.Forward direction absolute image block error AIBD_forward and backward absolute image block error
The calculation method of AIBD_backward is as shown in AIBD calculation formula above.BlocksInWidth and BlocksInHeight points
Not Wei in row and column estimation image block quantity.C1, C2 are empirical value, and value is 12,2 respectively.
During scene change detecte, each image block is first calculated relative to forward field and backward field correspondence image block
Absolute image block error AIBD_forward and AIBD_backward, then by the value of AIBD compared with empirical value.To
The judgment method of available formula (5.1) and formula (5.2).Because forward direction absolute image block error AIBD_forward is with after
It only needs to calculate once to absolute image block error AIBD_backward, but local features judgement can be used for simultaneously
(count_forward, count_backward are respectively indicated with the quantity statistics of count_forward, count_backward
Compared to the quantity of the image block of forward field, the different detection types of backward field), it is cut so as to continue subsequent scene
Become judgement and the judgement of whole video content features, local stagnant zone, relatively forward or backward stagnant zone are reduced with this
Interpolation algorithm execution step, finally reduce the complexity of entire adaptive-interpolation algorithm.
The judgement of the above-mentioned type of sports for each topography's block, different, similar, uncertain three kinds of situations are right respectively
Answer compound movement region, stagnant zone, common moving region.
(2) adaptive-interpolation process: adaptive Interpolation Process is still first to front court progress scene change detecte is worked as, so
After will test result and be divided into four classes: when front court and the occurrence scene shear simultaneously of backward field, when front court occurrence scene shear is backward
There is no scene shear, when front court there is no after scene shear to field occurrence scene shear, when there is no fields for front court
After scape shear to field also there is no scene shear,.Because joined the judgement of local features during detection, institute
With decision procedure of specifically classifying are as follows:
If 1, count_forward_different and count_backward_different are both greater than
Compare_count3, then when front court and the occurrence scene shear simultaneously of backward field.
If 2, count_backward_same is greater than compare_count1 and count_forward_different is big
In compare_count3, then when there is no scene shears for the backward field of front court occurrence scene shear.
If 3, count_forward_same is greater than compare_count1 and count_backward_different is big
In compare_count3, then when front court there is no after scene shear to field occurrence scene shear.
4, remaining situation, when there is no also there is no scene shears to field after scene shear for front court.
Wherein compare_count1, compare_count2 and compare_count3 are empirical value, calculation
It is as follows:
Compare_count1=BlocksInWidth × BlockInHeight × 0.55
Compare_count2=BlocksInWidth × BlockInHeight × 0.5
Compare_count3=BlocksInWidth × BlockInHeight × 0.6
In when occurrence scene shear (the i.e. continuous scene shear) simultaneously of front court and backward field the case where, using frame interpolated value side
Formula.For other three classes situations, the judgement and classification of whole field video content features are first carried out in conjunction with the testing result of scene shear,
Then the local feature judgement for carrying out image block in field again, finally carries out classification interpolation.With count_forward_same,
Count_forward_different, count_forward_uncertain are respectively indicated when front court is compared with forward direction reference field
The image number of blocks of similar, different, uncertain three types obtained.Similarly, count_backward_same, count_
Backward_different, count_backward_uncertain are respectively indicated when front court obtains compared with backward reference field
Similar, different, uncertain three types image number of blocks.
In short, new video interlace-removing method proposed by the present invention --- in the de interlacing algorithm based on scene change detecte
On the basis of, it joined whole and local video content detection module, classification interpolation can be carried out according to video content features.This
Method compares the clarity that can not only improve de interlacing backsight frequency sequence than conventional method, moreover it is possible to using during scene shear
Computing resource reduce the complexity of interpolation algorithm, there is better performance and good view to experience.
Claims (4)
1. a kind of interlace-removing method detected based on scene shear and content characteristic, which comprises the steps of:
(1) regional area type judges: during scene change detecte, obtaining by comparing when the difference of front court and front and back
To the judgement and classification and the judgement of local features of whole field video content features；
(2) adaptive-interpolation process: scene change detecte first is carried out to when front court, result is then will test and is divided into four classes: is current
And the occurrence scene shear simultaneously of backward field, when the backward field of front court occurrence scene shear there is no scene shear, work as front court
There is no after scene shear to field occurrence scene shear, when there is no to field, also there is no scenes after scene shear for front court
Shear；In when the occurrence scene shear, that is, continuous scene shear simultaneously of front court and backward field the case where, using frame interpolated value mode；It is right
In other three classes situations, the judgement and classification of whole field video content features are first carried out in conjunction with the testing result of scene shear, then
The local feature judgement for carrying out image block in field again, finally carries out classification interpolation.
2. a kind of interlace-removing method detected based on scene shear and content characteristic according to claim 1, feature are existed
In specific step is as follows for the judgement of regional area type in the step (1):
Wherein Local_forward and Local_backward respectively indicates each image block reference position corresponding with front and back field
Image block comparison result；Local_forward=1 indicates that current image block is different from forward direction reference block, Local_
Forward=-1 indicates that current image block is similar to forward direction reference block, and Local_forward=0 indicates remaining uncertain condition；
Local_backward value 1, -1,0 respectively indicates current image block situations different from backward reference block, similar, uncertain；
The calculation method of forward direction absolute image block error AIBD_forward and backward absolute image block error AIBD_backward are as above
Shown in AIBD calculation formula；BlocksInWidth and BlocksInHeight is respectively estimation image block in row and column
Quantity；C1, C2 are empirical value, and value is 12,2 respectively；
During scene change detecte, each image block is first calculated relative to the exhausted of forward field and backward field correspondence image block
To image block error AIBD_forward and AIBD_backward, then the value of AIBD is obtained compared with empirical value
The judgment method of Local_forward and Local_backward.
3. a kind of interlace-removing method detected based on scene shear and content characteristic according to claim 1, feature are existed
In forward direction absolute image block error AIBD_forward and backward absolute image block error AIBD_ in the step (1)
Backward is only calculated once, and simultaneously for local features judgement and count_forward, count_backward
Quantity statistics, wherein count_forward, count_backward respectively indicate the different inspections compared to forward field, backward field
Survey the quantity of the image block of type.
4. a kind of interlace-removing method detected based on scene shear and content characteristic according to claim 1, feature are existed
In will test the specific classification decision procedure that result is divided into four classes in the step (2) are as follows:
If count_forward_different and count_backward_different are both greater than compare_count3,
Then when front court and the occurrence scene shear simultaneously of backward field；
If count_backward_same is greater than compare_count1 and count_forward_different is greater than
Compare_count3, then when there is no scene shears for the backward field of front court occurrence scene shear；
If count_forward_same is greater than compare_count1 and count_backward_different is greater than
Compare_count3, then when front court there is no after scene shear to field occurrence scene shear；
Remaining situation, when there is no also there is no scene shears to field after scene shear for front court；
Wherein compare_count1, compare_count2 and compare_count3 are empirical value, and calculation is as follows:
Compare_count1=BlocksInWidth × BlockInHeight × 0.55
Compare_count2=BlocksInWidth × BlockInHeight × 0.5
Compare_count3=BlocksInWidth × BlockInHeight × 0.6；
Wherein count_forward_same, count_forward_different, count_forward_uncertain points
It Biao Shi not be when the image number of blocks for similar, different, uncertain three types that front court obtains compared with forward direction reference field；count_
Backward_same, count_backward_different, count_backward_uncertain, which are respectively indicated, works as front court
The image number of blocks of similar, different, uncertain three types obtained compared with backward reference field.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910477625.XA CN110266988A (en) | 2019-06-03 | 2019-06-03 | A kind of interlace-removing method detected based on scene shear and content characteristic |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910477625.XA CN110266988A (en) | 2019-06-03 | 2019-06-03 | A kind of interlace-removing method detected based on scene shear and content characteristic |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110266988A true CN110266988A (en) | 2019-09-20 |
Family
ID=67916563
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910477625.XA Pending CN110266988A (en) | 2019-06-03 | 2019-06-03 | A kind of interlace-removing method detected based on scene shear and content characteristic |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110266988A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203092A (en) * | 2020-09-27 | 2021-01-08 | 深圳市梦网视讯有限公司 | Code stream analysis method, system and equipment for global motion scene |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0624032A2 (en) * | 1993-05-07 | 1994-11-09 | Goldstar Co. Ltd. | Video format conversion apparatus and method |
| US20020075400A1 (en) * | 2000-12-06 | 2002-06-20 | Lg Electronics Inc. | Video restoring apparatus and method thereof |
| US7822122B2 (en) * | 2006-05-05 | 2010-10-26 | National Central University | Method for interpolations after edge detections in de-interlacing process |
| CN102946505A (en) * | 2012-11-22 | 2013-02-27 | 四川虹微技术有限公司 | Self-adaptive motion detection method based on image block statistics |
-
2019
- 2019-06-03 CN CN201910477625.XA patent/CN110266988A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0624032A2 (en) * | 1993-05-07 | 1994-11-09 | Goldstar Co. Ltd. | Video format conversion apparatus and method |
| US20020075400A1 (en) * | 2000-12-06 | 2002-06-20 | Lg Electronics Inc. | Video restoring apparatus and method thereof |
| US7822122B2 (en) * | 2006-05-05 | 2010-10-26 | National Central University | Method for interpolations after edge detections in de-interlacing process |
| CN102946505A (en) * | 2012-11-22 | 2013-02-27 | 四川虹微技术有限公司 | Self-adaptive motion detection method based on image block statistics |
Non-Patent Citations (1)
| Title |
|---|
| 朱小涛,李燕平,黄媛,黄倩: ""基于场景切变和内容特征检测的去隔行算法"", 《计算机科学》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203092A (en) * | 2020-09-27 | 2021-01-08 | 深圳市梦网视讯有限公司 | Code stream analysis method, system and equipment for global motion scene |
| CN112203092B (en) * | 2020-09-27 | 2024-01-30 | 深圳市梦网视讯有限公司 | Code stream analysis method, system and equipment for global motion scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4162621B2 (en) | Frame interpolation method and apparatus for frame rate conversion | |
| EP1742485A2 (en) | Motion estimator and estimating method | |
| CN101321269B (en) | Passenger flow volume detection method based on computer vision | |
| KR101536794B1 (en) | Image interpolation with halo reduction | |
| CN1270526C (en) | Device and method for using adaptive moving compensation conversion frame and/or semi-frame speed | |
| KR100327395B1 (en) | Deinterlacing method based on motion-compensated inter-field interpolation | |
| KR100995398B1 (en) | Global motion compensated deinterlaing method considering horizontal and vertical patterns | |
| US20070217517A1 (en) | Method and apparatus for determining motion between video images | |
| JPH02290387A (en) | Television signal system converter with moving correction | |
| CN100438609C (en) | Image processing unit with fall-back | |
| CN102025960B (en) | Motion compensation de-interlacing method based on adaptive interpolation | |
| JPH02290385A (en) | Television system converter with moving correction | |
| JPH0362691A (en) | Moving compensation video signal standard converter | |
| JPH02290384A (en) | Television signal system converter with moving correction | |
| CN1984240A (en) | Motion estimator device and motion estimating method | |
| CN103369208A (en) | Self-adaptive de-interlacing method and device | |
| JPH02290383A (en) | Television signal system converter with moving correction | |
| US9584807B2 (en) | Method and apparatus for motion estimation in a video system | |
| CN101510985A (en) | Self-adapting de-interleave method for movement compensation accessory movement | |
| CN110266988A (en) | A kind of interlace-removing method detected based on scene shear and content characteristic | |
| CN102447870A (en) | Detection method for static objects and motion compensation device | |
| CN101247472B (en) | De-interlacing processing method based on movement compensation | |
| CN101340539A (en) | Deinterlacing video processing method and system by moving vector and image edge detection | |
| CN106027943B (en) | A kind of video interlace-removing method | |
| CN1199449C (en) | Method for removing intersection by adopting error protection motion compensation and its equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190920 |