CN117915039A - Internet of things edge intelligent video gateway system and application method - Google Patents
Internet of things edge intelligent video gateway system and application method Download PDFInfo
- Publication number
- CN117915039A CN117915039A CN202311664912.4A CN202311664912A CN117915039A CN 117915039 A CN117915039 A CN 117915039A CN 202311664912 A CN202311664912 A CN 202311664912A CN 117915039 A CN117915039 A CN 117915039A
- Authority
- CN
- China
- Prior art keywords
- internet
- data image
- things
- video gateway
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000012545 processing Methods 0.000 claims abstract description 38
- 238000012544 monitoring process Methods 0.000 claims abstract description 21
- 238000012552 review Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000005260 corrosion Methods 0.000 description 4
- 230000007797 corrosion Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Landscapes
- Alarm Systems (AREA)
Abstract
The invention relates to the technical field of the Internet of things, in particular to an Internet of things edge intelligent video gateway system and a use method thereof, comprising an acquisition end, an edge video gateway, an Internet of things application platform and a cloud server, wherein the acquisition end is used for acquiring data images of a monitoring area and processing the data images, the edge video gateway is used for acquiring and analyzing the processed data images, notification and alarm of events are completed according to established rule logic, and the Internet of things application platform is used for displaying and playing the received processed data images and alarm information on a display large screen; and the cloud server uploads the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment. And after the edge video gateway analyzes, notification and alarm information are generated and uploaded to the Internet of things application platform and the remote server in time for users to review, so that the burden of data processing of the Internet of things application platform is relieved, and the data processing efficiency is improved.
Description
Technical Field
The invention relates to the technical field of the Internet of things, in particular to an intelligent video gateway system at the edge of the Internet of things and a use method.
Background
Video monitoring is rapidly popularized and applied in various industries such as intelligent communities, intelligent parks and the like, and the demand for video monitoring playing services is increasing day by day, and meanwhile, the video monitoring playing services are required to be capable of adapting to a browser and playing videos on an APP. The video playing method is oriented to the field of security monitoring application, and has the basic requirement that video playing has low delay, so that the video playing method brings great challenges to the traditional browser live broadcasting technology.
The utility model discloses an intelligent video gateway system in internet of things edge, including the internet of things equipment platform, edge video gateway, cloud server, the network camera, network communication module, traditional camera, the mobile terminal, PC end and demonstration large screen, internet of things equipment platform and cloud server data communication are connected, edge video gateway's output is connected with internet of things equipment platform's input, network camera and network communication module all are connected with edge video gateway communication, traditional camera passes through the data line and is connected with network communication module, mobile terminal and PC end pass through network and cloud server communication connection, the demonstration large screen passes through video data line and internet of things equipment platform communication connection, can realize video access, transcoding and plug-flow broadcast, promote video terminal equipment's access compatibility, simultaneously greatly reduced video live broadcast's time delay.
But still generally need video monitoring unusual alarming function to security protection control application, above-mentioned marginal intelligent video gateway system's of thing networking marginal video gateway only possesses video access, transcoding and push stream broadcast function, and video unusual alarming still need to upload data to thing networking equipment platform and handle, causes the burden for thing networking equipment platform, reduces data processing efficiency.
Disclosure of Invention
The invention aims to provide an intelligent video gateway system for the edge of the Internet of things and a use method thereof, which solve the problems that the intelligent video gateway system for the edge of the Internet of things needs to upload data to an equipment platform of the Internet of things for processing, burden is caused on the equipment platform of the Internet of things, and data processing efficiency is reduced.
In order to achieve the above object, the invention provides an internet of things edge intelligent video gateway system, which comprises an acquisition end, an edge video gateway, an internet of things application platform and a cloud server, wherein the acquisition end is connected with the edge video gateway, the internet of things application platform is connected with the edge video gateway, the cloud server is connected with the edge video gateway,
The acquisition end is used for acquiring a data image of the monitoring area, processing the data image and uploading the processed data image to the edge video gateway;
The edge video gateway is used for acquiring and analyzing the processed data image, completing notification and alarm of an event according to the formulated rule logic, and uploading the processed data image and alarm information to the Internet of things application platform and the cloud server;
The application platform of the Internet of things is used for displaying and playing the received processed data image and the alarm information on a display large screen;
And the cloud server is used for uploading the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment.
The acquisition end comprises a camera module and a video processing module, wherein the camera module is connected with the video processing module, and the video processing module is connected with the edge video gateway;
The camera module is composed of one or more camera equipment of video monitoring, face recognition and people number recognition cameras and is used for collecting data images;
The video processing module is used for acquiring the data image, processing and judging the data image through a frame difference method, namely detecting and tracking a moving object, and sending the processed data image to the edge video gateway.
The edge video gateway comprises an equipment service module and a core service module, wherein the equipment service module is connected with the video processing module, and the core service module is respectively connected with the equipment service module, the Internet of things application platform and the cloud server;
the device service module is used for transcoding the acquired processed data image and uploading the transcoded data image to the core service module;
The core service module is used for receiving and storing the transcoded data image and transmitting the transcoded data image to the Internet of things application platform and the cloud server.
The edge video gateway further comprises an export service module, and the export service module is respectively connected with the core service module, the Internet of things application platform and the cloud server;
and the export service module is used for acquiring the processed data image and completing notification and alarm of the event according to the formulated rule logic.
The export service module comprises a rule engine unit and a notification unit, wherein the rule engine unit is connected with the core service module, and the notification unit is respectively connected with the rule engine unit, the Internet of things application platform and the cloud server;
the rule engine unit is used for making rule logic, comparing the rule logic with the processed data image and judging whether the rule logic is the rule range content or not;
and the notification unit is used for generating corresponding event notification and alarm information according to the judgment result and uploading the event notification and alarm information to the Internet of things application platform and the cloud server.
The application method of the internet of things edge intelligent video gateway system comprises the following steps:
collecting a data image of a monitoring area through the collecting end, processing the data image, and uploading the processed data image to the edge video gateway;
The edge video gateway acquires and analyzes the processed data image, completes notification and alarm of an event according to a formulated rule logic, and uploads the processed data image and alarm information to the Internet of things application platform and the cloud server;
The application platform of the Internet of things displays and plays the received processed data image and the alarm information on a display large screen;
and the cloud server uploads the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment.
According to the internet of things edge intelligent video gateway system and the application method, the data images are acquired through the acquisition end for the monitoring area, the data images are processed, and the processed data images are uploaded to the edge video gateway; the edge video gateway acquires and analyzes the processed data image, completes notification and alarm of an event according to a formulated rule logic, and uploads the processed data image and alarm information to the Internet of things application platform and the cloud server; the application platform of the Internet of things displays and plays the received processed data image and the alarm information on a display large screen; and the cloud server uploads the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment. And generating notification and alarm information after the edge video gateway is analyzed, and uploading the notification and alarm information to the Internet of things application platform and the remote server in time for users to review, so that the burden of data processing of the Internet of things application platform is relieved, and the efficiency of data processing is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a block diagram of an edge intelligent video gateway system of the internet of things according to a first embodiment of the present invention.
Fig. 2 is a block diagram of the configuration of the acquisition end according to the first embodiment of the present invention.
Fig. 3 is a block diagram of an edge video gateway according to a first embodiment of the present invention.
Fig. 4 is a block diagram of the export service module of the first embodiment of the present invention.
Fig. 5 is a step diagram of a method for using an internet of things edge intelligent video gateway system according to a second embodiment of the present invention.
In the figure: the system comprises a 101-acquisition end, a 102-edge video gateway, a 103-Internet of things application platform, a 104-cloud server, a 105-camera module, a 106-video processing module, a 107-equipment service module, a 108-core service module, a 109-export service module, a 110-rule engine unit and a 111-notification unit.
Detailed Description
The following detailed description of embodiments of the invention, examples of which are illustrated in the accompanying drawings and, by way of example, are intended to be illustrative, and not to be construed as limiting, of the invention.
The first embodiment of the application is as follows:
referring to fig. 1 to 4, fig. 1 is a block diagram of an internet of things edge intelligent video gateway system according to a first embodiment of the present invention. Fig. 2 is a block diagram of the configuration of the acquisition end 101 according to the first embodiment of the present invention. Fig. 3 is a block diagram of an edge video gateway 102 according to a first embodiment of the present invention. Fig. 4 is a block diagram of the export service module 109 according to the first embodiment of the present invention. The invention provides an intelligent video gateway system for the edge of the Internet of things, which comprises: the system comprises an acquisition end 101, an edge video gateway 102, an Internet of things application platform 103 and a cloud server 104, wherein the acquisition end 101 comprises a camera module 105 and a video processing module 106, the edge video gateway 102 comprises a device service module 107, a core service module 108 and an export service module 109, and the export service module 109 comprises a rule engine unit 110 and a notification unit 111.
For the embodiment, the acquisition end 101 is connected with the edge video gateway 102, the internet of things application platform 103 is connected with the edge video gateway 102, the cloud server 104 is connected with the edge video gateway 102,
The acquisition end 101 is configured to acquire a data image of a monitoring area, process the data image, and upload the processed data image to the edge video gateway 102;
The edge video gateway 102 is configured to acquire and analyze the processed data image, complete notification and alarm of an event according to a formulated rule logic, and upload the processed data image and alarm information to the internet of things application platform 103 and the cloud server 104;
The application platform 103 of the internet of things is configured to display and play the received processed data image and the alarm information on a display large screen;
The cloud server 104 is configured to upload the received processed data image and the alarm information to a mobile terminal device and a PC terminal device.
The collection end 101 collects and processes the data image in the monitoring area, and then uploads the data image to the edge video gateway 102, the edge video gateway 102 analyzes the data image, and judges whether an alarm condition exists according to formulated rule logic, and then generates corresponding notification and alarm information to upload to the internet of things application platform 103 and the cloud server 104 for a user to check, wherein the internet of things application platform 103 is connected with a display screen, the data image uploaded by the edge video gateway 102 can be checked directly, and the cloud server 104 is connected with a mobile end such as a mobile phone and other equipment and a PC end such as a computer and other equipment for the user to check the data image remotely.
The camera module 105 is connected with the video processing module 106, and the video processing module 106 is connected with the edge video gateway 102;
The camera module 105 is composed of one or more camera devices of video monitoring, face recognition and people number recognition cameras and is used for collecting data images;
The video processing module 106 is configured to obtain the data image, process and determine the data image by using a frame difference method, that is, detect and track a moving object, and send the processed data image to the edge video gateway 102.
The camera module 105 is composed of one or more camera devices such as frequency monitoring, face recognition, and people number recognition cameras, and shoots data images in a monitored area, and then uploads the data images to the video processing module 106, and the core of the video processing module 106 is detection and tracking of moving objects, and the main steps include: 1. frame difference calculation, namely, carrying out frame difference calculation on two adjacent frames, which is the basis of image processing, and carrying out subsequent steps on the basis. 2. The gray image conversion is to convert the collected video image into a color image, wherein the color image comprises three channels of red, green and blue (RGB), the color of the image has no influence on the detection and tracking of a moving object, but the complexity of an image processing system is increased, so that the color image is converted into the gray image, and the redundancy of the system is reduced. 3. Gaussian blur-the width and height of the specified gaussian kernel (must be odd), and the standard deviation of the gaussian function in the X, Y direction. Designating all 2 standard deviations as default value 0, the function will calculate itself according to the size of the kernel function. The purpose of the Gaussian blur is to filter out the Gaussian filter of the motion detection target and avoid interference. 4. Binarization image, namely, after the image is converted into gray scale, only black and white two colors are remained in the image after binarization in order to make the image more concise. 5. Corrosion expansion, a corrosion operation, i.e., a local minimum operation, is used to eliminate irrelevant details in the image. The corrosion is to convolve the image with the kernel to obtain a local minimum value and reduce the highlight region in the image; the expansion and corrosion are opposite operations, and the expansion operation, namely the local maximum operation, is used for bridging detail cracks, and aims to make the comparison between the front frame and the rear frame more obvious, so that the contour of the foreground can be found easily. 6. And (3) searching the outline, namely searching the outline by using a cv2. FindCountries function in the OpenCV, wherein the function can remove redundancy on the outline, and the cost of a system memory is saved. 7. Moving object marking: calculating the size of the outline, drawing the mark of the moving object by the outer frame, storing the picture and outputting the information.
Secondly, the device service module 107 is connected with the video processing module 106, and the core service module 108 is respectively connected with the device service module 107, the internet of things application platform 103 and the cloud server 104;
The device service module 107 is configured to transcode the acquired processed data image and upload the transcoded data image to the core service module 108;
the core service module 108 is configured to receive and store the transcoded data image, and transmit the transcoded data image to the internet of things application platform 103 and the cloud server 104.
The device service module 107 transcodes the data image, so that the data image is suitable for transmission in multiple modes, and further is used by a user to view the data image in multiple modes, and the core service module 108 stores the data image and transmits the data image to the internet of things application platform 103 and the cloud server 104 for the user to view the monitoring video.
Meanwhile, the export service module 109 is respectively connected with the core service module 108, the application platform 103 of the internet of things and the cloud server 104;
The export service module 109 is configured to obtain the processed data image, and complete notification and alarm of the event according to the formulated rule logic.
The rule engine unit 110 is connected with the core service module 108, and the notification unit 111 is respectively connected with the rule engine unit 110, the internet of things application platform 103 and the cloud server 104;
the rule engine unit 110 is configured to formulate rule logic, compare the rule logic with the processed data image, and determine whether the rule logic is rule range content;
The notification unit 111 is configured to generate a corresponding event notification and alarm information according to the determination result, and upload the event notification and alarm information to the internet of things application platform 103 and the cloud server 104.
The rule engine unit 110 provides an edge event triggering mechanism, the rule engine unit 110 receives the incoming data, triggers the device, executes linkage, judges whether rule logic is met, the notification unit 111 receives the judging result, if not, generates event notification and alarm information, and directly uploads the event notification and alarm information to the internet of things application platform 103 and the cloud server 104 for a user to view.
With the intelligent video gateway system at the edge of the internet of things in this embodiment, the camera module 105 collects data images in a monitoring area, the video processing module 106 processes the data images, detects and tracks moving objects, the device service module 107 receives the processed data images, transcodes the processed data images and uploads the transcoded data images to the core service module 108, the core service module 108 directly uploads the data images to the internet of things application platform 103 and the cloud server 104 for users to view, and uploads the data images to the rule engine unit 110 at the same time, the rule engine unit 110 judges whether the moving objects are in a rule range according to formulated rule logic, the notification unit 111 receives a result of judging no, generates event notification and alarm information, and uploads the event notification and alarm information to the internet of things application platform 103 and the cloud server 104 for users to view, and the user obtains alarm information through a video display or a mobile phone end and a PC end, and generates notification and alarm information after analysis by the edge video gateway 102, and uploads the notification and alarm information to the internet of things application platform 103 and the remote server for users to review the internet of things, and the internet of things application platform 103, and the internet of things data processing efficiency is improved.
The second embodiment of the application is as follows:
On the basis of the first embodiment, please refer to fig. 5, wherein fig. 5 is a step diagram of a method for using the internet of things edge intelligent video gateway system according to the second embodiment of the present invention. The application method of the internet of things edge intelligent video gateway system in the embodiment comprises the following steps:
S201: the data image is acquired by the acquisition end 101 in the monitoring area, the data image is processed, and the processed data image is uploaded to the edge video gateway 102;
S202: the edge video gateway 102 acquires and analyzes the processed data image, completes notification and alarm of an event according to a formulated rule logic, and uploads the processed data image and alarm information to the internet of things application platform 103 and the cloud server 104;
S203: the application platform 103 of the Internet of things displays and plays the received processed data image and the alarm information on a display large screen;
s204: and the cloud server 104 uploads the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment.
Specifically, the acquisition end 101 is composed of one or more camera devices such as video monitoring, face recognition and people number recognition cameras, acquires data images in a monitored area, processes the data images, detects and tracks moving objects, and uploads the processed data images to the edge video gateway 102; the edge video gateway 102 acquires and analyzes the processed data image, completes notification and alarm of an event according to the formulated rule logic, and uploads the processed data image and alarm information to the internet of things application platform 103 and the cloud server 104 for viewing by a user; the application platform 103 of the Internet of things displays and plays the received processed data image and the alarm information on a display large screen; the cloud server 104 uploads the received processed data image and the received alarm information to the mobile terminal device and the PC terminal device, so that a user can conveniently obtain the alarm information remotely. After the edge video gateway 102 performs analysis, notification and alarm information are generated and uploaded to the internet of things application platform 103 and the remote server in time for users to review, so that the burden of data processing of the internet of things application platform 103 is relieved, and the efficiency of data processing is improved.
The foregoing disclosure is only illustrative of one or more preferred embodiments of the present application, and it is not intended to limit the scope of the claims hereof, as persons of ordinary skill in the art will understand that all or part of the processes for practicing the embodiments described herein may be practiced with equivalent variations in the claims, which are within the scope of the application.
Claims (6)
1. The Internet of things edge intelligent video gateway system is characterized by comprising an acquisition end, an edge video gateway, an Internet of things application platform and a cloud server, wherein the acquisition end is connected with the edge video gateway, the Internet of things application platform is connected with the edge video gateway, the cloud server is connected with the edge video gateway,
The acquisition end is used for acquiring a data image of the monitoring area, processing the data image and uploading the processed data image to the edge video gateway;
The edge video gateway is used for acquiring and analyzing the processed data image, completing notification and alarm of an event according to the formulated rule logic, and uploading the processed data image and alarm information to the Internet of things application platform and the cloud server;
The application platform of the Internet of things is used for displaying and playing the received processed data image and the alarm information on a display large screen;
And the cloud server is used for uploading the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment.
2. The internet of things edge intelligent video gateway system of claim 1, wherein,
The acquisition end comprises a camera module and a video processing module, the camera module is connected with the video processing module, and the video processing module is connected with the edge video gateway;
The camera module is composed of one or more camera equipment of video monitoring, face recognition and people number recognition cameras and is used for collecting data images;
The video processing module is used for acquiring the data image, processing and judging the data image through a frame difference method, namely detecting and tracking a moving object, and sending the processed data image to the edge video gateway.
3. The internet of things edge intelligent video gateway system of claim 2, wherein,
The edge video gateway comprises an equipment service module and a core service module, wherein the equipment service module is connected with the video processing module, and the core service module is respectively connected with the equipment service module, the Internet of things application platform and the cloud server;
the device service module is used for transcoding the acquired processed data image and uploading the transcoded data image to the core service module;
The core service module is used for receiving and storing the transcoded data image and transmitting the transcoded data image to the Internet of things application platform and the cloud server.
4. The internet of things edge intelligent video gateway system of claim 3, wherein,
The edge video gateway further comprises an export service module which is respectively connected with the core service module, the Internet of things application platform and the cloud server;
and the export service module is used for acquiring the processed data image and completing notification and alarm of the event according to the formulated rule logic.
5. The internet of things edge intelligent video gateway system of claim 4, wherein,
The export service module comprises a rule engine unit and a notification unit, wherein the rule engine unit is connected with the core service module, and the notification unit is respectively connected with the rule engine unit, the Internet of things application platform and the cloud server;
the rule engine unit is used for making rule logic, comparing the rule logic with the processed data image and judging whether the rule logic is the rule range content or not;
and the notification unit is used for generating corresponding event notification and alarm information according to the judgment result and uploading the event notification and alarm information to the Internet of things application platform and the cloud server.
6. The application method of the internet of things edge intelligent video gateway system is suitable for the internet of things edge intelligent video gateway system as claimed in claim 1, and is characterized by comprising the following steps:
collecting a data image of a monitoring area through the collecting end, processing the data image, and uploading the processed data image to the edge video gateway;
The edge video gateway acquires and analyzes the processed data image, completes notification and alarm of an event according to a formulated rule logic, and uploads the processed data image and alarm information to the Internet of things application platform and the cloud server;
The application platform of the Internet of things displays and plays the received processed data image and the alarm information on a display large screen;
and the cloud server uploads the received processed data image and the received alarm information to the mobile terminal equipment and the PC terminal equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311664912.4A CN117915039A (en) | 2023-12-06 | 2023-12-06 | Internet of things edge intelligent video gateway system and application method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311664912.4A CN117915039A (en) | 2023-12-06 | 2023-12-06 | Internet of things edge intelligent video gateway system and application method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117915039A true CN117915039A (en) | 2024-04-19 |
Family
ID=90691307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311664912.4A Pending CN117915039A (en) | 2023-12-06 | 2023-12-06 | Internet of things edge intelligent video gateway system and application method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117915039A (en) |
-
2023
- 2023-12-06 CN CN202311664912.4A patent/CN117915039A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109299703B (en) | Method and device for carrying out statistics on mouse conditions and image acquisition equipment | |
| US20120195363A1 (en) | Video analytics with pre-processing at the source end | |
| WO2012142797A1 (en) | Video monitoring system and method | |
| JP2002112253A (en) | Networked surveillance/control system and method | |
| CN113660427A (en) | Image analysis system and method applied to video monitoring tester | |
| CN101500128B (en) | Method and apparatus for loading additional information on display image of network camera device terminal | |
| CN108933935A (en) | Detection method, device, storage medium and the computer equipment of video communication system | |
| CN103379266A (en) | High-definition web camera with video semantic analysis function | |
| CN102158690A (en) | Remote multichannel real-time video monitoring system | |
| CN101562729A (en) | Home video monitoring system based on mobile phone interaction and method thereof | |
| CN111277800A (en) | Monitoring video coding and playing method and device, electronic equipment and storage medium | |
| US20070285519A1 (en) | Method For Transferring Image Signals And System Using The Method | |
| US20230188679A1 (en) | Apparatus and method for transmitting images and apparatus and method for receiving images | |
| CN117915039A (en) | Internet of things edge intelligent video gateway system and application method | |
| CN116248861A (en) | Intelligent video detection method, system and device | |
| KR20060087732A (en) | Smart network camera | |
| CN115914676A (en) | Real-time monitoring comparison method and system for ultra-high-definition video signals | |
| CN115294661A (en) | Pedestrian dangerous behavior identification method based on deep learning | |
| US20130006571A1 (en) | Processing monitoring data in a monitoring system | |
| CN115103204A (en) | Method and device for realizing edge intelligent application supporting AI engine | |
| CN114374710A (en) | Distribution network monitoring method and system for monitoring 5G ultra-high-definition videos and Internet of things | |
| CN113727073A (en) | Method and system for realizing vehicle-mounted video monitoring based on cloud computing | |
| CN111179317A (en) | Interactive teaching system and method | |
| CN114079777A (en) | Video processing method and device | |
| KR100480520B1 (en) | Method for transferring image signals and system using the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |