CN111083368A - Simulation physics cloud platform panoramic video display system based on high in clouds - Google Patents
Simulation physics cloud platform panoramic video display system based on high in clouds Download PDFInfo
- Publication number
- CN111083368A CN111083368A CN201911366137.8A CN201911366137A CN111083368A CN 111083368 A CN111083368 A CN 111083368A CN 201911366137 A CN201911366137 A CN 201911366137A CN 111083368 A CN111083368 A CN 111083368A
- Authority
- CN
- China
- Prior art keywords
- image
- panoramic
- cloud
- display system
- video display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
Abstract
The invention relates to a cloud-based physical cloud deck simulating panoramic video display system, wherein an image acquisition unit acquires real-time images of watching places in real time through image acquisition equipment and transmits the real-time images to an image processing unit through a network; the image processing unit obtains an input source image from the image acquisition unit, then carries out image fusion processing on the overlapped part of the spliced part, and finally maps the spliced image into the spherical model for panoramic image projection; the image processing unit transmits the processed panoramic image to a local storage main control unit and uploads the panoramic image to a cloud database through a source data gateway; the invention provides a physical cloud deck-simulated panoramic video display system which can update multi-place image data in real time, has low construction cost, good image panoramic presentation effect, smooth and efficient viewing and can meet the real-time calling of various types of terminals.
Description
Technical Field
The invention relates to the technical field of video image processing, in particular to a cloud-based physical cloud deck simulating panoramic video display system.
Background
Along with the continuous development of digital technology, digital management is more and more selected by governments and various enterprise management due to the convenience and high efficiency of the digital management, real-time monitoring and calling use are realized for panoramic videos or images needing to be collected in a certain range in a specific scene, and the modes for realizing panoramic video monitoring in the current market generally comprise the following three modes: (1) rotational imaging mode: the method is realized by adopting a mode of adding a mechanical holder and an integrated camera, and the single-lens panoramic monitoring is realized by the rotation of the camera. According to the rotating speed, the monitoring system can be divided into a constant-speed ball and a high-speed ball, the rotating speed of the constant-speed ball is from several degrees to tens of degrees per second, and the rotating speed of the high-speed ball is from one hundred degrees to hundreds of degrees per second; (2) multi-camera imaging mode: the panoramic monitoring effect is realized by accurately installing a plurality of cameras and splicing images in the later period; (3) the imaging mode of a fisheye lens camera is adopted: has the characteristics of large visual angle and strong visual impact. However, the above methods have many defects and shortcomings, wherein the first and second methods have relatively high installation and maintenance costs and are complicated and troublesome to control, and the monitoring image generated by the third method has large distortion and is not in line with a normal viewing angle, so that the real judgment of the scene is influenced, and therefore, the method is not suitable for direct monitoring application in a high-demand scene.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a cloud-based physical cloud deck panoramic video display system which is capable of updating multi-place image data in real time, low in construction cost, good in image panoramic presentation effect, smooth and efficient in viewing and capable of meeting real-time calling requirements of various types of terminals.
In order to achieve the purpose, the invention adopts the following technical scheme.
A cloud-based physical cloud deck simulating panoramic video display system comprises an image acquisition unit, an image processing unit, a local storage main control unit, a source data gateway, a cloud database and a display window terminal, wherein the image acquisition unit acquires real-time images of a watching place in real time through image acquisition equipment and transmits the real-time images to the image processing unit through a network; the image processing unit obtains an input source image from the image acquisition unit, performs characteristic point detection, performs image splicing by using a characteristic algorithm of a homography matrix, performs image fusion processing on an overlapped part of a spliced part, and finally maps the spliced image to a spherical model for panoramic image projection; the image processing unit transmits the processed panoramic image to a local storage main control unit and uploads the panoramic image to the cloud database through a source data gateway; and the display window terminal sends a real-time data calling request to the cloud database through the network and then obtains the panoramic image of the corresponding request site.
As a further improvement of the invention, the display window terminal comprises a panorama retrieving module, a panorama viewing module, a panorama rotating module and a panorama zooming module.
As a further improvement of the invention, the display window terminal comprises but is not limited to a display viewing terminal of a mobile phone client terminal, a computer PC client terminal and a tablet computer client terminal.
As a further improvement of the present invention, the image acquisition unit includes a plurality of image acquisition terminals, including but not limited to an a-site image acquisition terminal and a B-site image acquisition terminal, the plurality of image acquisition terminals employ a high-definition panoramic camera composed of eight cameras, seven of the image acquisition terminals are uniformly distributed on the side surface of the camera, the remaining one of the image acquisition terminals is located right below the camera, and the camera is selected from a model of not less than six thousand four million effective pixels.
As a further improvement of the present invention, the image processing unit selects feature information from the images according to a matching relationship between the mutually overlapped partial associated images in the original image, and determines the same feature information of the corresponding positions of the two images; then according to the mutual relation of the pictures obtained by matching, splicing the adjacent pictures together in sequence; according to different image matching modes, splicing treatment is also divided into two categories: according to the template matching mode, obtaining translation or scaling parameters between pictures, and then performing image splicing operation according to the parameters; the Homography matrix is calculated by utilizing the matched points, namely one Homography matrix is matched with the other Homography matrix through the associated characteristic points, coordinates of any pixel points in the original image can be converted into new coordinate points through the Homography matrix, and the converted image is a result image suitable for splicing.
As a further improvement of the present invention, the selected feature information includes, but is not limited to, image feature contour information and image feature curve information.
As a further improvement of the invention, the image fusion adopts one or more of an average superposition method, a linear method, a weighting method and a multi-segment fusion method to carry out fusion and remove overlapped parts, so as to obtain a clearer and more complete image.
As a further improvement of the invention, the panoramic image projection is to map the synthesized panoramic image onto the spherical model after calculating the map surface coordinate parameters of the image mapping onto the spherical surface, and then the obtained planar reverse expansion map is the spherical panoramic image.
As a further improvement of the present invention, the mobile phone client terminal or the tablet PC client terminal changes a distance between two points to zoom the displayed image after the two points are touched by the two-point touch screen, and the computer PC client terminal zooms the displayed panoramic image by sliding the mouse wheel.
Due to the application of the technical scheme, the technical scheme of the invention has the following beneficial effects: the technical scheme can realize the same function of simulating an actual electric pan-tilt, can realize the quick direction adjustment and image zooming of a display view field area under the condition without a physical pan-tilt, and has the beneficial technical effects of greatly saving hardware cost and being more efficient and convenient to adjust, control and call; the virtual tripod head core part of the technical scheme is realized by processing and controlling the background module, the change of subsequent setting can be directly realized by the processing control module without adjusting original hardware equipment, equipment regulation and control can be more efficiently and conveniently carried out, all functions of the physical tripod head are realized by simulation, and imaging quality and operation experience are not changed or reduced at the same time, so that the virtual tripod head core part replaces the traditional tripod head to carry out camera visual angle adjustment; the technical scheme can gradually restore the original size of the image in the display window and can also realize the online scaling of the displayed image; after the image data is acquired and obtained, after the later-stage splicing and streaming media pushing, the beneficial technical effects that the panoramic video can be watched by tens of thousands of people without mutual interference can be achieved; the technical scheme can also combine the function of a mobile phone gyroscope to ensure that the panoramic image changes along with the rotation of the display screen, thereby realizing the operation effect of dynamic OSD; the image processing unit of the technical scheme can develop and collect instructions of different frame rates for the image collection control end, can realize customized image collection adjustment according to actual network speed or transmission requirements, is convenient to adjust, and has the beneficial technical effects of expanding the application range.
Drawings
FIG. 1 is a schematic diagram of the overall structure of the present invention.
In the figure: the system comprises an image acquisition unit 1, an image processing unit 2, a local storage main control unit 3, a source data gateway 4, a cloud database 5, a display window terminal 6, an input source image 201, a feature point detection 202, an image splicing 203, an image fusion 204, a panoramic image projection 205, a mobile phone client terminal 601, a computer PC client terminal 602 and a tablet computer client terminal 603.
Detailed Description
The present invention will be described in further detail with reference to the following reaction schemes and specific examples.
As shown in fig. 1, a cloud-based physical pan-tilt head simulation panoramic video display system comprises an image acquisition unit 1, an image processing unit 2, a local storage main control unit 3, a source data gateway 4, a cloud database 5 and a display window terminal 6, wherein the image acquisition unit 1 acquires real-time images of a watching place in real time through an image acquisition device and transmits the real-time images to the image processing unit 2 through a network; the image processing unit 2 obtains an input source image 201 from the image obtaining unit 1, performs feature point detection 202, performs image splicing 203 by using a feature algorithm of a homography matrix, performs image fusion 204 processing on a spliced part overlapping part, and finally maps the spliced image to a spherical model for panoramic image projection 205; the image processing unit 2 transmits the processed panoramic image to a local storage main control unit 3, and uploads the panoramic image to the cloud database 5 through a source data gateway 4; and the display window terminal 6 sends a real-time data calling request to the cloud database 5 through a network and then obtains a panoramic image of a corresponding request place.
The display window terminal 6 comprises a panorama retrieving module 7, a panorama viewing module 8, a panorama rotating module 9 and a panorama zooming module 10. The display window terminal 6 includes, but is not limited to, display viewing terminals of a mobile phone client terminal 601, a computer PC client terminal 602, and a tablet computer client terminal 603.
The image acquisition unit 1 comprises a plurality of image acquisition ends, including but not limited to a site image acquisition end 101 and a site image acquisition end 102, the plurality of image acquisition ends adopt a high-definition panoramic camera consisting of eight cameras, seven cameras are uniformly distributed on the side surface of the camera, the rest cameras are positioned under the camera, and the cameras adopt models of not less than six thousand four million effective pixels.
The image processing unit 2 selects characteristic information from the images according to the matching relation between the mutually overlapped partial associated images in the original image, and judges the same characteristic information of the corresponding positions of the two images; then according to the mutual relation of the pictures obtained by matching, splicing the adjacent pictures together in sequence; according to different image matching modes, splicing treatment is also divided into two categories: according to the template matching mode, obtaining translation or scaling parameters between pictures, and then performing image splicing operation according to the parameters; the Homography matrix is calculated by utilizing the matched points, namely one Homography matrix is matched with the other Homography matrix through the associated characteristic points, coordinates of any pixel points in the original image can be converted into new coordinate points through the Homography matrix, and the converted image is a result image suitable for splicing.
The selected feature information includes, but is not limited to, image feature profile information and image feature curve information. The image fusion 205 adopts one or more of an average superposition method, a linear method, a weighting method and a multi-segment fusion method to perform fusion to remove the overlapped part, so as to obtain a clearer and more complete image. The panoramic image projection 205 is to map the synthesized panoramic image to the spherical model after calculating the image plane coordinate parameters of the image mapped to the spherical surface, and then the obtained planar reverse expansion image is the spherical panoramic image. The mobile phone client terminal 601 or the tablet PC client terminal 603 changes the distance between the two points to zoom the displayed image after the two points are touched through the two-point touch screen, and the computer PC client terminal 602 zooms the displayed panoramic image through the sliding operation of the mouse wheel.
The above is only a specific application example of the present invention, and the protection scope of the present invention is not limited in any way. All the technical solutions formed by equivalent transformation or equivalent replacement fall within the protection scope of the present invention.
Claims (10)
1. The utility model provides a simulation physics cloud platform panorama video display system based on high in clouds which characterized in that: the system comprises an image acquisition unit (1), an image processing unit (2), a local storage main control unit (3), a source data gateway (4), a cloud database (5) and a display window terminal (6), wherein the image acquisition unit (1) acquires real-time images of a watching place in real time through image acquisition equipment and transmits the real-time images to the image processing unit (2) through a network; the image processing unit (2) obtains an input source image (201) from the image acquisition unit (1), performs characteristic point detection (202), performs image splicing (203) by using a characteristic algorithm of a homography matrix, performs image fusion (204) on a spliced part, and finally maps the spliced image to a spherical model for panoramic image projection (205); the image processing unit (2) transmits the processed panoramic image to a local storage main control unit (3) and uploads the panoramic image to the cloud database (5) through a source data gateway (4); and the display window terminal (6) sends a real-time data calling request to the cloud database (5) through a network and then obtains a panoramic image corresponding to the request site.
2. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: the display window terminal (6) comprises a panorama calling module (7), a panorama viewing module (8), a panorama rotating module (9) and a panorama zooming module (10).
3. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: the display window terminal (6) comprises but is not limited to a display viewing terminal of a mobile phone client terminal (601), a computer PC client terminal (602) and a tablet computer client terminal (603).
4. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: the image acquisition unit (1) comprises a plurality of image acquisition ends, the image acquisition ends adopt high-definition panoramic cameras consisting of eight cameras, seven cameras are uniformly distributed on the side faces of the cameras, the rest cameras are located under the cameras, and the cameras adopt models not lower than six thousand four million effective pixels.
5. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: the image processing unit (2) selects characteristic information from the images according to the matching relation between the mutually overlapped partial associated images in the original image, and judges the same characteristic information of the corresponding positions of the two images; and sequentially splicing the adjacent pictures together according to the mutual relation of the pictures obtained by matching.
6. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: the image stitching (203) is divided into two categories by adopting stitching processing according to different image matching modes: according to the template matching mode, obtaining translation or scaling parameters between pictures, and then performing image splicing operation according to the parameters; the Homography matrix (the English name Homography Estimat i on) is calculated by utilizing the matched points, namely one of the Homography matrix is matched with the other Homography matrix through the associated characteristic points, the coordinates of any pixel point in the original image can be converted into a new coordinate point through the Homography matrix, and the converted image is a result image suitable for splicing.
7. The cloud-based simulated physical pan-tilt panoramic video display system of claim 5, wherein: the selected feature information includes, but is not limited to, image feature profile information and image feature curve information.
8. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: and the image fusion (205) adopts one or more of an average superposition method, a linear method, a weighting method and a multi-segment fusion method to carry out fusion and remove the overlapped part, so as to obtain a clearer and more complete image.
9. The cloud-based simulated physical pan-tilt panoramic video display system of claim 1, wherein: and the panoramic image projection (205) is to map the synthesized panoramic image onto a spherical model after calculating the image surface coordinate parameters of the image mapped onto the spherical surface, and then obtain a planar reverse expansion image which is the spherical panoramic image.
10. The cloud-based simulated physical pan-tilt panoramic video display system of claim 3, wherein: the mobile phone client terminal (601) or the tablet personal computer client terminal (603) changes the distance between the two points to zoom the displayed image after the two points are contacted through the two-point touch screen, and the computer PC client terminal (602) zooms the displayed panoramic image through the sliding operation of the mouse scroll wheel.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911366137.8A CN111083368A (en) | 2019-12-26 | 2019-12-26 | Simulation physics cloud platform panoramic video display system based on high in clouds |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911366137.8A CN111083368A (en) | 2019-12-26 | 2019-12-26 | Simulation physics cloud platform panoramic video display system based on high in clouds |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111083368A true CN111083368A (en) | 2020-04-28 |
Family
ID=70318051
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911366137.8A Pending CN111083368A (en) | 2019-12-26 | 2019-12-26 | Simulation physics cloud platform panoramic video display system based on high in clouds |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111083368A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111917984A (en) * | 2020-08-13 | 2020-11-10 | 上海航天测控通信研究所 | Virtual holder and control method |
CN113452909A (en) * | 2021-06-10 | 2021-09-28 | 高玉宗 | Panoramic presentation system and application thereof |
CN116684742A (en) * | 2023-08-03 | 2023-09-01 | 深圳市特力科信息技术有限公司 | Panoramic video conference system based on camera |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105488775A (en) * | 2014-10-09 | 2016-04-13 | 东北大学 | Six-camera around looking-based cylindrical panoramic generation device and method |
CN106534780A (en) * | 2016-11-11 | 2017-03-22 | 广西师范大学 | Three-dimensional panoramic video monitoring device and video image processing method thereof |
CN107205122A (en) * | 2017-08-03 | 2017-09-26 | 哈尔滨市舍科技有限公司 | The live camera system of multiresolution panoramic video and method |
CN109982047A (en) * | 2019-04-04 | 2019-07-05 | 郑州和光电子科技有限公司 | A method of flight monitoring panorama fusion display |
CN110390640A (en) * | 2019-07-29 | 2019-10-29 | 齐鲁工业大学 | Graph cut image split-joint method, system, equipment and medium based on template |
-
2019
- 2019-12-26 CN CN201911366137.8A patent/CN111083368A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105488775A (en) * | 2014-10-09 | 2016-04-13 | 东北大学 | Six-camera around looking-based cylindrical panoramic generation device and method |
CN106534780A (en) * | 2016-11-11 | 2017-03-22 | 广西师范大学 | Three-dimensional panoramic video monitoring device and video image processing method thereof |
CN107205122A (en) * | 2017-08-03 | 2017-09-26 | 哈尔滨市舍科技有限公司 | The live camera system of multiresolution panoramic video and method |
CN109982047A (en) * | 2019-04-04 | 2019-07-05 | 郑州和光电子科技有限公司 | A method of flight monitoring panorama fusion display |
CN110390640A (en) * | 2019-07-29 | 2019-10-29 | 齐鲁工业大学 | Graph cut image split-joint method, system, equipment and medium based on template |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111917984A (en) * | 2020-08-13 | 2020-11-10 | 上海航天测控通信研究所 | Virtual holder and control method |
CN113452909A (en) * | 2021-06-10 | 2021-09-28 | 高玉宗 | Panoramic presentation system and application thereof |
CN116684742A (en) * | 2023-08-03 | 2023-09-01 | 深圳市特力科信息技术有限公司 | Panoramic video conference system based on camera |
CN116684742B (en) * | 2023-08-03 | 2023-10-03 | 深圳市特力科信息技术有限公司 | Panoramic video conference system based on camera |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112053446B (en) | Real-time monitoring video and three-dimensional scene fusion method based on three-dimensional GIS | |
CN109348119B (en) | Panoramic monitoring system | |
US8723951B2 (en) | Interactive wide-angle video server | |
CN102984453B (en) | Single camera is utilized to generate the method and system of hemisphere full-view video image in real time | |
CN112533002A (en) | Dynamic image fusion method and system for VR panoramic live broadcast | |
CN111083368A (en) | Simulation physics cloud platform panoramic video display system based on high in clouds | |
WO2019238114A1 (en) | Three-dimensional dynamic model reconstruction method, apparatus and device, and storage medium | |
WO2019161814A2 (en) | Panoramic imaging system and method | |
CN110992484B (en) | Display method of traffic dynamic video in real scene three-dimensional platform | |
CN103607568A (en) | Stereo street scene video projection method and system | |
US11812154B2 (en) | Method, apparatus and system for video processing | |
CN107197135B (en) | Video generation method and video generation device | |
CN109120901B (en) | Method for switching pictures among cameras | |
CN113286138A (en) | Panoramic video display method and display equipment | |
WO2007060497A2 (en) | Interactive wide-angle video server | |
CN106060475A (en) | System and method for video pre-monitoring and control through VR method | |
CN109788270B (en) | 3D-360-degree panoramic image generation method and device | |
WO2018092992A1 (en) | Real-time panoramic image production system on basis of lookup table and real-time panoramic image production method using same | |
CN104539893B (en) | Realize the method, apparatus and system of virtual head monitoring effect | |
CN106846254A (en) | A kind of image-scaling method and system based on high in the clouds autonomous learning | |
CN111862240B (en) | Panoramic camera and calibration method thereof, panoramic image splicing method and storage medium | |
CN111061123B (en) | Rotary panoramic imaging system for tourist landscape display and use method | |
CN112330753A (en) | Target detection method of augmented reality system | |
CN202818497U (en) | Electronic PTZ device capable of monitoring based on high-definition digital camera | |
CN115205752A (en) | Liquid crystal splicing LCD method and system based on intelligent display |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200428 |