CN110913181A - A warehouse video surveillance system based on edge computing - Google Patents

A warehouse video surveillance system based on edge computing Download PDF

Info

Publication number
CN110913181A
CN110913181A CN201911243267.2A CN201911243267A CN110913181A CN 110913181 A CN110913181 A CN 110913181A CN 201911243267 A CN201911243267 A CN 201911243267A CN 110913181 A CN110913181 A CN 110913181A
Authority
CN
China
Prior art keywords
video
module
monitoring
system based
warehouse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911243267.2A
Other languages
Chinese (zh)
Inventor
亓慧
穆晓芳
韩素青
史颖
赵志瑛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Taiyuan Normal University
Original Assignee
Taiyuan Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Taiyuan Normal University filed Critical Taiyuan Normal University
Priority to CN201911243267.2A priority Critical patent/CN110913181A/en
Publication of CN110913181A publication Critical patent/CN110913181A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/188Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

本发明公开一种基于边缘计算的仓库视频监控系统,包括:依次连接监控采集终端模块、边缘节点模块、外围网络传输模块和终控端显示模块;还包括为各个模块供电的电源模块。本发明通过将分析处理的任务迁移到边缘节点模块,在保证数据可靠性的前提下,对监控采集终端模块短时间内产生的大量实时边缘数据进行预处理,提高了视频分析速度,降低了处理和传输时延,保证了监控视频流的实时性。同时运用改进的两帧差法与投影法相融合的算法对运动目标进行检测,只有检测到监控画面中有运动物体时才进行存储,增强证据信息的可信性,提高视频数据的存储空间利用率,节省了大量的存储空间。

Figure 201911243267

The invention discloses a warehouse video monitoring system based on edge computing, which comprises: sequentially connecting a monitoring and acquisition terminal module, an edge node module, a peripheral network transmission module and a terminal control terminal display module; and also includes a power supply module for supplying power to each module. By migrating the task of analysis and processing to the edge node module, the present invention preprocesses a large amount of real-time edge data generated by the monitoring and acquisition terminal module in a short period of time on the premise of ensuring data reliability, thereby improving the video analysis speed and reducing the processing time. and transmission delay to ensure the real-time monitoring of video streams. At the same time, the algorithm combining the improved two-frame difference method and the projection method is used to detect the moving target. Only when a moving object is detected in the monitoring screen, it is stored, which enhances the credibility of the evidence information and improves the storage space utilization of video data. , saving a lot of storage space.

Figure 201911243267

Description

Warehouse video monitoring system based on edge calculation
Technical Field
The invention relates to the technical field of intelligent video monitoring, in particular to a warehouse video monitoring system based on edge calculation.
Background
The video monitoring system is mainly used for video processing, target query, personnel tracking and the like, and gradually becomes an important guarantee for urban public safety. The video resolution ratio acquired by a front-end camera of the traditional video monitoring system is high, the video data volume is large, and the load of the computing and transmission bandwidth of the traditional cloud mode video monitoring system is heavy; the video processing capacity of the existing intelligent monitoring system is insufficient; the existing camera has the problems of large target information detection omission, low detection efficiency and the like due to the defects of computing capacity, time delay, bandwidth and the like of uploading data.
For the above-mentioned problems of unreliable moving target detection rate and time and space consumption for processing data amount, and incapability of guaranteeing real-time performance, there are two algorithms at present:
⑴ the weighted behavior recognition algorithm reduces the calculated amount of video analysis processing and solves the problem of high energy consumption, but the method only reduces the calculated amount of the behavior analysis stage and does not process redundant video frames.
⑵, the dynamic task scheduling algorithm migrates part of the calculation task to the cloud end to complete the calculation task, but under the scene of large traffic of people such as a station and an airport, the data volume is increased rapidly in a short time, and the target recognition rate is reduced to some extent.
Although the method improves the current situation that the cloud platform monitoring system has higher requirements on bandwidth and computing resources, the problems that video frames are not filtered and redundant edge data are transmitted are not fundamentally solved, so that the total computation amount is not reduced and the storage space is in short supply no matter how the computing tasks are migrated.
Disclosure of Invention
The invention discloses a warehouse video monitoring system based on edge calculation, which is characterized in that an analysis processing task is transferred to an edge node module, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by a monitoring acquisition terminal module in a short time are preprocessed, the video analysis speed is improved, the processing and transmission time delay is reduced, and the real-time performance of a monitoring video stream is ensured. Meanwhile, the moving target is detected by using an improved algorithm of fusing a two-frame difference method and a projection method, and the moving target is stored only when a moving object is detected in a monitored picture, so that the credibility of evidence information is enhanced, the storage space utilization rate of video data is improved, and a large amount of storage space is saved.
In order to achieve the purpose, the invention adopts the technical scheme that:
an edge computing based warehouse video surveillance system, comprising: the monitoring acquisition terminal module, the edge node module, the peripheral network transmission module and the terminal control end display module are connected in sequence; wherein:
the monitoring acquisition terminal module comprises a camera and a video converter, wherein the video converter converts an analog video signal acquired by the camera into a digital signal and transmits the digital signal to the edge node module;
the edge node module comprises a DSP unit and a data storage unit, the DSP unit is used for screening digital signals obtained by conversion of a video converter in the monitoring acquisition terminal module, compressing cached videos after the digital signals are processed, caching the videos into the data storage unit to form video streams, and sending the video streams to a terminal control end display module through the peripheral network transmission module;
the peripheral network transmission module is used for sending the cached video stream to the terminal control end display module in time;
and the terminal control end display module is used for receiving the video stream sent by the peripheral network transmission module, displaying the video and reminding a supervisor in front of the terminal control end.
Preferably, the digital signal is in a data format processable by the DSP.
Preferably, the screening process is to screen video frames according to an algorithm to select an effective video, judge whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame according to an improved algorithm combining a two-frame difference method and a projection method, store the changed video frames to generate a buffer video frame sequence, and not store the unchanged video frames.
Preferably, the system further comprises a power supply module, wherein the power supply module is connected with other modules and supplies power to each module.
Compared with the prior art, the invention has the beneficial effects that:
1. according to the invention, by migrating the analysis processing task to the edge node module, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by the monitoring acquisition terminal module in a short time are preprocessed, so that the video analysis speed is improved, the processing and transmission delay is reduced, and the real-time performance of the monitoring video stream is ensured;
2. the invention uses the algorithm fused by the improved two-frame difference method and the projection method to detect the moving target, is more reliable than the artificial detection, and only stores when a moving object is detected in the monitoring picture, thereby not only reducing the storage of invalid videos, but also storing the evidence video data of the warehouse site, enhancing the credibility of the evidence information, improving the storage space utilization rate of the video data and saving a large amount of storage space.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic view of the structure of the present invention;
FIG. 2 is a schematic diagram of an edge node module preprocessing process according to the present invention;
FIG. 3 is a detailed flow chart of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example 1
As shown in fig. 1, a warehouse video monitoring system based on edge calculation includes: the monitoring acquisition terminal module 1, the edge node module 2, the peripheral network transmission module 3 and the terminal control end display module 4 are connected in sequence; wherein:
the monitoring acquisition terminal module 1 comprises a camera 11 and a video converter 12, wherein the video converter 12 converts an analog video signal acquired by the camera 11 into a digital signal and transmits the digital signal to the edge node module 2;
the edge node module 2 comprises a DSP unit 21 and a data storage unit 22, wherein the DSP unit 21 performs a screening process on the digital signal converted by the video converter 12 in the monitoring acquisition terminal module 1, compresses the cached video after the processing, caches the compressed video in the data storage unit 22 to form a video stream, and transmits the video stream to the terminal control end display module 4 through the peripheral network transmission module 3;
the peripheral network transmission module 3 is used for sending the cached video stream to the terminal control end display module 4 in time;
and the terminal control end display module 4 is used for receiving the video stream sent by the peripheral network transmission module 3, displaying the video and reminding a supervisor in front of the terminal control end.
The digital signal is in a data format which can be processed by the DSP.
The system also comprises a power supply module 5, wherein the power supply module 5 is connected with other modules and supplies power to each module.
Example 2
As shown in fig. 2, the pretreatment process of the edge node module 2 is described in detail based on embodiment 1:
after receiving the digital signal, the DSP unit 21 of the edge node module 2 screens the video frames according to the algorithm to select an effective video, and according to the algorithm that combines the improved two-frame difference method and the projection method, determines whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame, stores the changed video frame, generates a sequence of buffered video frames, and the unchanged video frame is not stored, and after the processing is completed, compresses the buffered video, buffers the compressed video in the data storage unit 22, and sends the compressed video to the terminal control end display module 4 through the peripheral network transmission module 3.
The working process of the system is as follows:
the camera 11 is used as the input end of the system;
firstly, when the system acquires an effective video, the video converter 12 converts an analog video signal acquired by the camera 11 into a digital signal;
then, the video enters a DSP unit 21 for processing, an algorithm processed in the DSP unit 21 is cached in a data storage unit 22, whether the warehouse video is stored or not is judged according to an improved algorithm of combining a two-frame difference method and a projection method, namely whether the multi-angle projection of the current video frame is changed or not compared with the multi-angle projection of the previous frame is judged, the gray level projections of the two are subjected to difference processing, and if the difference is 0, the video is not stored; if not 0, it is buffered in the data storage unit 22. The video data are adjusted in real time in the preprocessing process, so that the storage of invalid videos is reduced, the storage space is reduced, the evidence video data of a warehouse site can be stored, and the credibility of evidence information is enhanced;
and finally, sending the cached video stream to a terminal control end display module 4 through a peripheral network transmission module 3.
By migrating the analysis processing task to the edge node module 2, on the premise of ensuring the reliability of data, a large amount of real-time edge data generated by the monitoring acquisition terminal module 1 in a short time are preprocessed, so that the video analysis speed is improved, the processing and transmission delay is reduced, and the real-time performance of monitoring video stream is ensured.
Compared with a cloud computing model, the video transmission and processing overhead is reduced. The influence of transmission and processing time delay is considered, the system firstly screens out effective video frames to upload, and the space occupied by the processed video is greatly reduced through a compression coding technology, so that the real-time performance and the resource utilization rate of the video stream are improved.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement, component separation or combination and the like made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims (4)

1.一种基于边缘计算的仓库视频监控系统,其特征在于,包括:依次连接监控采集终端模块、边缘节点模块、外围网络传输模块和终控端显示模块;其中:1. a warehouse video surveillance system based on edge computing, is characterized in that, comprises: successively connect monitoring acquisition terminal module, edge node module, peripheral network transmission module and terminal control terminal display module; Wherein: 所述监控采集终端模块包括摄像头和视频转换器,所述视频转换器将所述摄像头采集的模拟视频信号转换为数字信号,并将数字信号传输给边缘节点模块;The monitoring and collection terminal module includes a camera and a video converter, and the video converter converts the analog video signal collected by the camera into a digital signal, and transmits the digital signal to the edge node module; 所述边缘节点模块包括DSP单元和数据存储单元,所述DSP单元对来自所述监控采集终端模块中视频转换器转换得到的数字信号进行筛选处理,处理完成后将缓存的视频进行压缩,并缓存到所述数据存储单元中形成视频流,再通过所述外围网络传输模块发送到终控端显示模块;The edge node module includes a DSP unit and a data storage unit, the DSP unit performs screening processing on the digital signal converted by the video converter in the monitoring and acquisition terminal module, and after the processing is completed, the buffered video is compressed and buffered. In the data storage unit, a video stream is formed, and then sent to the terminal control terminal display module through the peripheral network transmission module; 所述外围网络传输模块用于将缓存起来的视频流及时发送到所述终控端显示模块;The peripheral network transmission module is used to send the cached video stream to the terminal control terminal display module in time; 所述终控端显示模块用于接收外围网络传输模块发送过来的视频流,并将视频显示出来,提醒终控端前的监管人员。The terminal control terminal display module is used to receive the video stream sent by the peripheral network transmission module, and display the video to remind supervisors in front of the terminal control terminal. 2.根据权利要求1所述的一种基于边缘计算的仓库视频监控系统,其特征在于,所述数字信号为DSP可处理的数据格式。2 . The warehouse video surveillance system based on edge computing according to claim 1 , wherein the digital signal is in a data format that can be processed by DSP. 3 . 3.根据权利要求1所述的一种基于边缘计算的仓库视频监控系统,其特征在于,所述筛选处理是根据算法进行筛选视频帧,选出有效视频,根据改进的两帧差法与投影法相融合的算法,判断当前视频帧的多角度投影相比较上一帧的多角度投影有没有发生变化,将发生变化的视频帧进行保存,生成缓存视频帧序列,不变化的视频帧则不保存。3. a kind of warehouse video surveillance system based on edge computing according to claim 1, is characterized in that, described screening process is to screen video frame according to algorithm, select effective video, according to improved two frame difference method and projection. The algorithm of fusion of methods determines whether the multi-angle projection of the current video frame has changed compared with the multi-angle projection of the previous frame, saves the changed video frames, and generates a cached video frame sequence, while the unchanged video frames are not saved. . 4.根据权利要求1-4中任一所述的一种基于边缘计算的仓库视频监控系统,其特征在于,该系统还包括电源模块,所述电源模块与其他模块连接,为各个模块供电。4. The warehouse video surveillance system based on edge computing according to any one of claims 1-4, wherein the system further comprises a power supply module, which is connected to other modules and supplies power to each module.
CN201911243267.2A 2019-12-06 2019-12-06 A warehouse video surveillance system based on edge computing Pending CN110913181A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911243267.2A CN110913181A (en) 2019-12-06 2019-12-06 A warehouse video surveillance system based on edge computing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911243267.2A CN110913181A (en) 2019-12-06 2019-12-06 A warehouse video surveillance system based on edge computing

Publications (1)

Publication Number Publication Date
CN110913181A true CN110913181A (en) 2020-03-24

Family

ID=69822978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911243267.2A Pending CN110913181A (en) 2019-12-06 2019-12-06 A warehouse video surveillance system based on edge computing

Country Status (1)

Country Link
CN (1) CN110913181A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111614936A (en) * 2020-05-09 2020-09-01 安徽三音电子科技有限公司 Video monitoring system for cloud computing data center
CN111866450A (en) * 2020-06-18 2020-10-30 昇辉控股有限公司 Intelligent video monitoring device based on cloud edge cooperation
CN112040189A (en) * 2020-09-01 2020-12-04 浙江大华技术股份有限公司 Monitoring method and system of front-end equipment and storage medium
CN112738458A (en) * 2020-12-21 2021-04-30 山东产研信息与人工智能融合研究院有限公司 Cotton bale quantity detection device and method based on video identification
CN113055654A (en) * 2021-03-26 2021-06-29 太原师范学院 Method for lossy compression of video stream in edge device
CN113542714A (en) * 2021-07-02 2021-10-22 恒大新能源汽车投资控股集团有限公司 Remote interactive communication system and device
WO2021218384A1 (en) * 2020-04-29 2021-11-04 华为技术有限公司 Algorithm update method, system and device
CN113747222A (en) * 2021-09-07 2021-12-03 湖南五凌电力科技有限公司 Picture synchronous transmission method and system based on edge calculation
CN115801614A (en) * 2022-11-22 2023-03-14 西安中科天塔科技股份有限公司 Data processing method and device, computer equipment and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102625082A (en) * 2012-02-29 2012-08-01 中山大学 A video surveillance system
WO2017118640A1 (en) * 2016-01-08 2017-07-13 Siemens Aktiengesellschaft Field data transmission apparatus, method and system
CN107093186A (en) * 2017-03-10 2017-08-25 北京环境特性研究所 The strenuous exercise's detection method matched based on edge projection
CN109118510A (en) * 2018-08-10 2019-01-01 平安科技(深圳)有限公司 A kind of monitor video processing method, device and computer-readable medium
CN109194926A (en) * 2018-10-19 2019-01-11 济南浪潮高新科技投资发展有限公司 A kind of city security system and its detection method based on edge calculations
CN110381298A (en) * 2019-08-16 2019-10-25 深圳江行联加智能科技有限公司 A kind of method, apparatus and system of tunnel video monitoring
CN110428522A (en) * 2019-07-24 2019-11-08 青岛联合创智科技有限公司 A kind of intelligent safety and defence system of wisdom new city
CN210839843U (en) * 2019-12-06 2020-06-23 太原师范学院 A warehouse video surveillance system based on edge computing

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102625082A (en) * 2012-02-29 2012-08-01 中山大学 A video surveillance system
WO2017118640A1 (en) * 2016-01-08 2017-07-13 Siemens Aktiengesellschaft Field data transmission apparatus, method and system
CN107093186A (en) * 2017-03-10 2017-08-25 北京环境特性研究所 The strenuous exercise's detection method matched based on edge projection
CN109118510A (en) * 2018-08-10 2019-01-01 平安科技(深圳)有限公司 A kind of monitor video processing method, device and computer-readable medium
CN109194926A (en) * 2018-10-19 2019-01-11 济南浪潮高新科技投资发展有限公司 A kind of city security system and its detection method based on edge calculations
CN110428522A (en) * 2019-07-24 2019-11-08 青岛联合创智科技有限公司 A kind of intelligent safety and defence system of wisdom new city
CN110381298A (en) * 2019-08-16 2019-10-25 深圳江行联加智能科技有限公司 A kind of method, apparatus and system of tunnel video monitoring
CN210839843U (en) * 2019-12-06 2020-06-23 太原师范学院 A warehouse video surveillance system based on edge computing

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021218384A1 (en) * 2020-04-29 2021-11-04 华为技术有限公司 Algorithm update method, system and device
CN111614936A (en) * 2020-05-09 2020-09-01 安徽三音电子科技有限公司 Video monitoring system for cloud computing data center
CN111866450A (en) * 2020-06-18 2020-10-30 昇辉控股有限公司 Intelligent video monitoring device based on cloud edge cooperation
CN112040189A (en) * 2020-09-01 2020-12-04 浙江大华技术股份有限公司 Monitoring method and system of front-end equipment and storage medium
CN112738458A (en) * 2020-12-21 2021-04-30 山东产研信息与人工智能融合研究院有限公司 Cotton bale quantity detection device and method based on video identification
CN113055654A (en) * 2021-03-26 2021-06-29 太原师范学院 Method for lossy compression of video stream in edge device
CN113542714A (en) * 2021-07-02 2021-10-22 恒大新能源汽车投资控股集团有限公司 Remote interactive communication system and device
CN113747222A (en) * 2021-09-07 2021-12-03 湖南五凌电力科技有限公司 Picture synchronous transmission method and system based on edge calculation
CN115801614A (en) * 2022-11-22 2023-03-14 西安中科天塔科技股份有限公司 Data processing method and device, computer equipment and storage medium
CN115801614B (en) * 2022-11-22 2025-02-07 西安中科天塔科技股份有限公司 A data processing method, device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN110913181A (en) A warehouse video surveillance system based on edge computing
Wang et al. Enabling edge-cloud video analytics for robotics applications
CN111741133B (en) A cloud-side-terminal collaborative meteorological intelligent early warning system
CN110390246A (en) A kind of video analysis method in side cloud environment
CN101119481A (en) A remote alarm video monitoring system and monitoring method
CN104581054A (en) Power transmission line inspection method and system based on video
CN112309068B (en) Forest fire early warning method based on deep learning
CN111027397B (en) Comprehensive feature target detection method, system, medium and equipment applicable to intelligent monitoring network
CN111090773B (en) Digital retina system structure and software architecture method and system
CN201499257U (en) Embedded CCD high definition intelligent network camera system
CN114679607A (en) Video frame rate control method and device, electronic equipment and storage medium
CN210839843U (en) A warehouse video surveillance system based on edge computing
CN102355575A (en) Distributed video monitoring device with pre-warning function
CN102104721A (en) Double-mode intelligent vision sensing system architecture
CN116248861A (en) An intelligent video detection method, system and device
CN116709037A (en) 5G camera-based method for transmitting monitoring key data of weather and rain
CN201238358Y (en) Full-view intelligent video monitoring hardware platform
CN115695720A (en) Intelligent monitoring method and device for smart city road and electronic equipment
CN105763484B (en) Signaling flow converging device and its method based on stream combination compression
CN201876973U (en) Image smoke detection system for rail transit station fire alarm
CN214177404U (en) Novel city security protection monitored control system
CN207218923U (en) A Non-real-time Monitoring System in Flow Sensitive Environment
CN201360312Y (en) Monitoring system based on embedded Web video server
CN203313317U (en) Online police service supervising system
CN206712926U (en) A kind of more exposure image emerging systems

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200324