CN113949929A - Video communication lifelike technology - Google Patents
Video communication lifelike technology Download PDFInfo
- Publication number
- CN113949929A CN113949929A CN202111204334.7A CN202111204334A CN113949929A CN 113949929 A CN113949929 A CN 113949929A CN 202111204334 A CN202111204334 A CN 202111204334A CN 113949929 A CN113949929 A CN 113949929A
- Authority
- CN
- China
- Prior art keywords
- dimensional
- video
- technology
- image
- compression
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/87—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Abstract
The invention discloses a video communication lifelike technology, which comprises a three-dimensional modeling capability technology, an ultra-strong compression network transmission technology and a three-dimensional reduction rendering technology, wherein a multi-dimensional two-dimensional picture is acquired by a single camera or a plurality of cameras, a virtual three-dimensional model is formed by analyzing and reconstructing through a server, when video communication is carried out, the two parties send the coded three-dimensional model to a communication base station server, the three-dimensional synthesis model of the other party and the scene of the own party are recombined and rendered to show the virtual three-dimensional space image, the realistic feeling and the lifelike feeling of the image of one other party of the two parties of the video in the peripheral space of the two parties are provided, the all-round immersive feeling is provided for users, the virtual three-dimensional model can be compressed through a triangle mesh algorithm and a geometric image algorithm compression technology, the problem that the media propagation is hindered by the limitation of the processing capacity and the network bandwidth of a limited graphic display card is solved.
Description
Technical Field
The invention relates to the technical field of three-dimensional video communication, in particular to a video communication lifelike technology.
Background
With the continuous development of multimedia technology, interactivity will become a main feature of future multimedia technology, and multimedia technology with interactivity will enable us to convert passive viewing into active viewing in some aspects. For example, we can change our view angle and viewpoint in a scene and select the region we are interested in for viewing. Video technology also requires a two-dimensional to three-dimensional transition for this purpose. Compared with the common two-dimensional video, the three-dimensional video increases the depth information of a scene, enhances the visual reality and reality, and can provide a user with an all-round immersive feeling, for example, the three-dimensional video is the video seen by the left eye and the right eye of a person, which are not completely identical, and especially when a short-distance scene is observed, the pictures seen by the left eye and the right eye of the person have larger aberration because the distance between the two eyes of the person is about 6 cm. This detail can be perceived by a simple experiment by starting a cup and looking carefully at it, the left and right eyes see what is really the different sides of the cup and the different backgrounds, the two different real images enter the brain through the retina, and the person gets a "stereo impression" of the space. The three-dimensional video technology can be widely applied to digital televisions, remote education, remote industrial control, three-dimensional video conference systems, virtual reality systems and other aspects.
With the outbreak of epidemic situation in 2020, home office and network courses become daily, the existing video communication technology is still in a two-dimensional video stage, the two-dimensional video only has a visible and active plane effect, and cannot provide users with immersive user experience to achieve the effect of face-to-face communication.
Disclosure of Invention
The present invention is directed to a video communication technique for solving the above problems.
In order to achieve the purpose, the invention provides the following technical scheme: a video communication lifelike technology comprises a three-dimensional modeling capability technology, a super-strong compression network transmission technology and a three-dimensional reduction rendering technology.
Preferably, the three-dimensional modeling capability technique comprises the following operational steps:
the first step is as follows: the omnidirectional video acquisition can be completed in two modes of a single camera and a plurality of cameras, wherein the single camera is formed by mounting a group of fisheye lenses or a curved surface transmitting lens in front of a lens of a common camera, is used for expanding the shooting visual angle of the camera and can change the resolution and the direction of an image in real time; the multi-camera shooting is that cameras are respectively erected in different directions, and a plurality of groups of cameras are used for shooting and splicing to form an omnibearing video without dead angles;
the second step is that: uploading the image information collected in the first step to a computer for decomposition and reconstruction, carrying out computer analysis to seamlessly connect the view angle images with different dimensions shot at the same time node by means of longitude and latitude of the image information through a multi-azimuth view shot by a plurality of cameras, and decomposing and reconstructing a plurality of two-dimensional images with different dimensions to obtain an omnibearing three-dimensional model image;
the third step: video coding, wherein the panoramic image is required to be coded after the images are synthesized into the panoramic image, the video is uploaded to a server to be coded and operated, 50 frames/second of a video signal is changed into 25 frames/second, then each frame is compressed by a JPEG algorithm according to the speed of 25 frames/second, and the image quality of Betacam can be achieved when the compression multiple is 3.5-5 times, such as MEPG-4 or H.264/AVC.
4. Preferably, the super-strong compression network transmission technology further refines and analyzes the video coding, and the specific compression method is as follows:
3.1) a compression mode based on geometric signal processing, wherein the geometric signal processing compression can be divided into a triangular mesh algorithm and a geometric image algorithm;
3.2) said triangular mesh algorithm, while decoding, the mesh reconstructed from a certain target bit rate is an approximate progressive compression of the original mesh, so to speak it is a strict multiresolution compression, adopt the progressive compression method, can realize the drawing while downloading, thus reduce the initial latency of users, the progressive transmission mechanism is especially suitable for transmitting the large-scale geometric model;
3.3) the geometric image algorithm, automatically cutting any mesh of the video into a single open mesh by the server, parameterizing the open mesh into a unit rectangle, and uniformly sampling all mesh surface information such as vertex position normal vectors and color information into an image, thereby well solving the drawing and compression of a mesh model.
Preferably, the three-dimensional reduction rendering technology is that when video communication is performed, both sides send the encoded three-dimensional model to the communication base station server, and the three-dimensional synthesis model of the other side and the scene of the own side are recombined and rendered to display the virtual three-dimensional stereo space image, so that the two sides of the video can have realistic feeling that the image of the other side is really in the peripheral space of the own side, the visual reality and reality feeling are enhanced, and the user can be provided with all-around immersive feeling.
Compared with the prior art, the invention has the beneficial effects that:
1. the video communication lifelike technology collects multidimensional two-dimensional picture information in two modes of a single camera and a plurality of cameras, and forms a virtual three-dimensional model through server analysis and reconstruction.
2. The video communication lifelike technology can compress a virtual three-dimensional model through a triangular mesh algorithm and a geometric image algorithm super-strong compression network transmission technology, and solves the problem that the limited processing capacity and network bandwidth of a graphic display card block the propagation of media.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example (b): the invention provides a technical scheme that: a video communication lifelike technology comprises a three-dimensional modeling capability technology, a super-strong compression network transmission technology and a three-dimensional reduction rendering technology.
The video communication lifelike technology and the three-dimensional modeling capability technology comprise the following operation steps:
the first step is as follows: the omnidirectional video acquisition can be completed in two modes of a single camera and a plurality of cameras, wherein the single camera is formed by mounting a group of fisheye lenses or a curved surface transmitting lens in front of a lens of a common camera, is used for expanding the shooting visual angle of the camera and can change the resolution and the direction of an image in real time; the multi-camera shooting is that cameras are respectively erected in different directions, and a plurality of groups of cameras are used for shooting and splicing to form an omnibearing video without dead angles;
the second step is that: uploading the image information collected in the first step to a computer for decomposition and reconstruction, carrying out computer analysis to seamlessly connect the view angle images with different dimensions shot at the same time node by means of longitude and latitude of the image information through a multi-azimuth view shot by a plurality of cameras, and decomposing and reconstructing a plurality of two-dimensional images with different dimensions to obtain an omnibearing three-dimensional model image;
the third step: video coding, wherein the panoramic image is required to be coded after the images are synthesized into the panoramic image, the video is uploaded to a server to be coded and operated, 50 frames/second of a video signal is changed into 25 frames/second, then each frame is compressed by a JPEG algorithm according to the speed of 25 frames/second, and the image quality of Betacam can be achieved when the compression multiple is 3.5-5 times, such as MEPG-4 or H.264/AVC.
The three-dimensional reduction rendering technology is characterized in that when video communication is carried out, both sides send coded three-dimensional models to a communication base station server, and the coded three-dimensional models are recombined and rendered with own scene through a three-dimensional synthesis model of the other side to display a virtual three-dimensional space image, so that the image of the other side is really realistic and realistic in own peripheral space of both sides of the video, the visual reality and reality are enhanced, and the omnibearing immersive feeling is provided for a user.
In the embodiment, multi-dimensional two-dimensional picture information is acquired through a single camera and a plurality of cameras, and is analyzed and reconstructed by a server to form a virtual three-dimensional model, when video communication is carried out, both sides send the coded three-dimensional model to a communication base station server, and the coded three-dimensional model and the scene of the own side are recombined and rendered through a three-dimensional synthesis model of the other side, so that a virtual three-dimensional space image is displayed, the realistic feeling of the image of one other side in the peripheral space of the video is provided, the visual reality and the realistic feeling are enhanced, and the all-dimensional immersive feeling is provided for a user.
5. The super-strong compression network transmission technology is used for further refining and analyzing video coding, and the specific compression mode is as follows:
3.1) a compression mode based on geometric signal processing, wherein the geometric signal processing compression can be divided into a triangular mesh algorithm and a geometric image algorithm;
3.2) triangle mesh algorithm, when decoding, the mesh reconstructed from a certain target bit rate is an approximate progressive compression of the original mesh, so to speak, a strict multi-resolution compression, and by adopting a progressive compression method, the mesh can be drawn while downloading, thereby reducing the initial waiting time of a user, and the progressive transmission mechanism is particularly suitable for transmitting large-scale geometric models;
3.3) geometric image algorithm, automatically cutting any grid of the video into a single open grid by a server, parameterizing the open grid into a unit rectangle, and uniformly sampling all grid surface information such as vertex position normal vectors and color information into an image, thereby well solving the drawing and compression of a grid model.
In the embodiment, the virtual three-dimensional model can be compressed by the ultra-strong compression network transmission technology of the triangular mesh algorithm and the geometric image algorithm, so that the problem that the media propagation is hindered by the limitation of the processing capacity and the network bandwidth of the limited graphic display card is solved.
The working principle is as follows: the first step is as follows: the omnidirectional video acquisition can be completed in two modes of a single camera and a plurality of cameras, wherein the single camera is formed by mounting a group of fisheye lenses or a curved surface transmitting lens in front of a lens of a common camera, is used for expanding the shooting visual angle of the camera and can change the resolution and the direction of an image in real time; the multi-camera shooting is that cameras are respectively erected in different directions, and a plurality of groups of cameras are used for shooting and splicing to form an omnibearing video without dead angles; the second step is that: uploading the image information collected in the first step to a computer for decomposition and reconstruction, carrying out computer analysis to seamlessly connect the view angle images with different dimensions shot at the same time node by means of longitude and latitude of the image information through a multi-azimuth view shot by a plurality of cameras, and decomposing and reconstructing a plurality of two-dimensional images with different dimensions to obtain an omnibearing three-dimensional model image; the third step: video coding, the panoramic picture is coded after the images are synthesized, the video is uploaded to a server for coding and operation, 50 frames/second of a video signal is changed into 25 frames/second, then each frame is compressed by a JPEG algorithm according to the speed of 25 frames/second, the image quality of Betacam can be achieved when the compression multiple is 3.5-5 times, such as MEPG-4 or H.264/AVC,
based on the compression mode of geometric signal processing, the geometric signal processing compression can be divided into a triangular mesh algorithm and a geometric image algorithm; in the triangle mesh algorithm, when decoding, the approximate progressive compression of a mesh reconstructed from a certain target bit rate as an original mesh is strict multi-resolution compression, and a progressive compression method is adopted, so that the mesh can be drawn while downloading, thereby reducing the initial waiting time of a user, and the progressive transmission mechanism is particularly suitable for transmitting a large-scale geometric model; according to the geometric image algorithm, any grid of a video is automatically cut into a single open grid by a server, the open grid is parameterized into a unit rectangle, all grid surface information such as vertex position normal vectors and color information can be uniformly sampled into an image, and drawing and compression of a grid model can be well solved.
The three-dimensional reduction rendering technology is characterized in that when video communication is carried out, both sides send coded three-dimensional models to a communication base station server, and the coded three-dimensional models and scenes of the other sides are recombined and rendered through a three-dimensional synthesis model of the other sides, so that virtual three-dimensional space images are displayed, the images of the other sides are really realistic and realistic in peripheral space of the video sides, the visual reality sense and the realistic sense are enhanced, and the omnibearing immersive feeling is provided for users.
In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (4)
1. A video communication lifelike technology comprises a three-dimensional modeling capability technology, a super-strong compression network transmission technology and a three-dimensional reduction rendering technology.
2. The realistic video communication technology of claim 1, wherein: the three-dimensional modeling capability technique includes the following operational steps:
the first step is as follows: the omnidirectional video acquisition can be completed in two modes of a single camera and a plurality of cameras, wherein the single camera is formed by mounting a group of fisheye lenses or a curved surface transmitting lens in front of a lens of a common camera, is used for expanding the shooting visual angle of the camera and can change the resolution and the direction of an image in real time; the multi-camera shooting is that cameras are respectively erected in different directions, and a plurality of groups of cameras are used for shooting and splicing to form an omnibearing video without dead angles;
the second step is that: uploading the image information collected in the first step to a computer for decomposition and reconstruction, carrying out computer analysis to seamlessly connect the view angle images with different dimensions shot at the same time node by means of longitude and latitude of the image information through a multi-azimuth view shot by a plurality of cameras, and decomposing and reconstructing a plurality of two-dimensional images with different dimensions to obtain an omnibearing three-dimensional model image;
the third step: video coding, wherein the panoramic image is required to be coded after the images are synthesized into the panoramic image, the video is uploaded to a server to be coded and operated, 50 frames/second of a video signal is changed into 25 frames/second, then each frame is compressed by a JPEG algorithm according to the speed of 25 frames/second, and the image quality of Betacam can be achieved when the compression multiple is 3.5-5 times, such as MEPG-4 or H.264/AVC.
3. The realistic video communication technology of claim 1, wherein: the super-strong compression network transmission technology is used for further refining and analyzing video coding, and the specific compression mode is as follows:
3.1) a compression mode based on geometric signal processing, wherein the geometric signal processing compression can be divided into a triangular mesh algorithm and a geometric image algorithm;
3.2) said triangular mesh algorithm, while decoding, the mesh reconstructed from a certain target bit rate is an approximate progressive compression of the original mesh, so to speak it is a strict multiresolution compression, adopt the progressive compression method, can realize the drawing while downloading, thus reduce the initial latency of users, the progressive transmission mechanism is especially suitable for transmitting the large-scale geometric model;
3.3) the geometric image algorithm, automatically cutting any mesh of the video into a single open mesh by the server, parameterizing the open mesh into a unit rectangle, and uniformly sampling all mesh surface information such as vertex position normal vectors and color information into an image, thereby well solving the drawing and compression of a mesh model.
4. The realistic video communication technology of claim 1, wherein: the three-dimensional reduction rendering technology is characterized in that when video communication is carried out, both sides send coded three-dimensional models to a communication base station server, and the coded three-dimensional models are recombined and rendered with own scenes through a three-dimensional synthesis model of the other side, so that virtual three-dimensional space images are displayed, the realistic feeling that the images of the other side are really in own peripheral space is provided for both sides of the video, the visual reality and reality feeling are enhanced, and the omnibearing immersive feeling is provided for users.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111204334.7A CN113949929A (en) | 2021-10-15 | 2021-10-15 | Video communication lifelike technology |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111204334.7A CN113949929A (en) | 2021-10-15 | 2021-10-15 | Video communication lifelike technology |
Publications (1)
Publication Number | Publication Date |
---|---|
CN113949929A true CN113949929A (en) | 2022-01-18 |
Family
ID=79330699
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111204334.7A Pending CN113949929A (en) | 2021-10-15 | 2021-10-15 | Video communication lifelike technology |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113949929A (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101626509A (en) * | 2009-08-10 | 2010-01-13 | 北京工业大学 | Methods and devices for encoding and decoding three dimensional grids |
CN106302132A (en) * | 2016-09-14 | 2017-01-04 | 华南理工大学 | A kind of 3D instant communicating system based on augmented reality and method |
CN113099204A (en) * | 2021-04-13 | 2021-07-09 | 北京航空航天大学青岛研究院 | Remote live-action augmented reality method based on VR head-mounted display equipment |
-
2021
- 2021-10-15 CN CN202111204334.7A patent/CN113949929A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101626509A (en) * | 2009-08-10 | 2010-01-13 | 北京工业大学 | Methods and devices for encoding and decoding three dimensional grids |
CN106302132A (en) * | 2016-09-14 | 2017-01-04 | 华南理工大学 | A kind of 3D instant communicating system based on augmented reality and method |
CN113099204A (en) * | 2021-04-13 | 2021-07-09 | 北京航空航天大学青岛研究院 | Remote live-action augmented reality method based on VR head-mounted display equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11706403B2 (en) | Positional zero latency | |
Domański et al. | Immersive visual media—MPEG-I: 360 video, virtual navigation and beyond | |
Smolic et al. | 3DAV exploration of video-based rendering technology in MPEG | |
CN101002471B (en) | Method and apparatus to encode image, and method and apparatus to decode image data | |
US11430156B2 (en) | Apparatus, a method and a computer program for volumetric video | |
US6583808B2 (en) | Method and system for stereo videoconferencing | |
US20150358539A1 (en) | Mobile Virtual Reality Camera, Method, And System | |
Kara et al. | Evaluation of the concept of dynamic adaptive streaming of light field video | |
KR102278848B1 (en) | Multi-viewpoint-based 360 video processing method and device | |
WO2018172614A1 (en) | A method and an apparatus and a computer program product for adaptive streaming | |
Ahmad | Multi-view video: get ready for next-generation television | |
CN113099204A (en) | Remote live-action augmented reality method based on VR head-mounted display equipment | |
CA3018600C (en) | Method, apparatus and stream of formatting an immersive video for legacy and immersive rendering devices | |
KR101329057B1 (en) | An apparatus and method for transmitting multi-view stereoscopic video | |
WO2019122504A1 (en) | Method for encoding and decoding volumetric video data | |
KR20220113772A (en) | Reference of Neural Network Models for Adaptation of 2D Video for Streaming to Heterogeneous Client Endpoints | |
WO2018109265A1 (en) | A method and technical equipment for encoding media content | |
CN113949929A (en) | Video communication lifelike technology | |
WO2019077199A1 (en) | An apparatus, a method and a computer program for volumetric video | |
CN116528065B (en) | Efficient virtual scene content light field acquisition and generation method | |
TWI778749B (en) | Transmission method, processing device, and generating system of video for virtual reality | |
Smolić et al. | Mpeg 3dav-video-based rendering for interactive tv applications | |
CN107547889B (en) | A kind of method and device carrying out three-dimensional video-frequency based on instant messaging | |
Hinds et al. | Immersive Media and the Metaverse | |
CN113992921A (en) | Virtual reality live video communication new technology |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |