CN117354455B - Communication method of distributed video conference system - Google Patents
Communication method of distributed video conference system Download PDFInfo
- Publication number
- CN117354455B CN117354455B CN202311641283.3A CN202311641283A CN117354455B CN 117354455 B CN117354455 B CN 117354455B CN 202311641283 A CN202311641283 A CN 202311641283A CN 117354455 B CN117354455 B CN 117354455B
- Authority
- CN
- China
- Prior art keywords
- client terminal
- client
- client terminals
- communication
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004891 communication Methods 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000005540 biological transmission Effects 0.000 claims abstract description 21
- 230000011664 signaling Effects 0.000 claims abstract description 9
- 230000008054 signal transmission Effects 0.000 claims abstract description 7
- 230000003993 interaction Effects 0.000 claims abstract description 4
- 238000012544 monitoring process Methods 0.000 claims abstract description 4
- 239000002699 waste material Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The invention discloses a communication method of a distributed video conference system, which specifically comprises the following steps: s1: when the communication transmission network is constructed, separating the control signaling from the data stream to perform signal data transmission; s2: the plurality of client terminals realize the real-time monitoring of the communication mutual signal intensity between the client terminals and the service providing end through signal monitors embedded in the client terminals; s3: when detecting a communication interaction signal intensity fault with a service providing end, starting a client terminal interconnection mode, and searching for optimal communication interconnection between other nearby client terminals; s4: the selected other nearby client terminals start a multichannel network transmission mode, and common signal transmission of a plurality of client terminals is realized by utilizing a preconfigured high-bandwidth network device, so that the problems of high service load pressure, serious fault influence and low network bandwidth utilization rate of the service providing end of the conventional video conference system are solved.
Description
Technical Field
The invention relates to the technical field of video conference communication, in particular to a communication method of a distributed video conference system.
Background
The video conference system is used as a real-time audio and video communication technology and is widely applied to a plurality of fields of enterprises, education, medical treatment and the like. The basic principle is that participants distributed in different places are synchronously connected through a network, so that the transmission and sharing of audio and video data are realized. However, in practical applications, conventional video conferencing systems face the following challenges:
1. the service providing end has large service load pressure: conventional videoconferencing systems typically employ a centralized architecture, where all participants' audio and video data streams are processed and forwarded through a service provider. As the number of participants increases, the computational resources and bandwidth requirements of the service provider increase linearly, resulting in an increasing traffic load pressure.
2. The fault impact is severe: since the core functions of the video conference system are concentrated on the service provider, once the service provider fails, the whole conference cannot be performed. In addition, the failure may cause loss of participant information, affecting communication quality.
3. The network bandwidth utilization is low: in conventional videoconferencing systems, the data streams are transmitted unidirectionally, i.e. from the sender to the receiver. This means that the network bandwidth is mainly dependent on the bandwidth of the sender, not the actual requirements of the participant. Therefore, network bandwidth utilization is low and may result in bandwidth waste.
In order to solve the problems, the invention provides a communication method of a distributed video conference system, which improves the communication efficiency and stability of the system by the technical means of separation of control flow and data flow, switching of self-adaptive network signals, multiple working modes and the like.
Disclosure of Invention
This section is intended to outline some aspects of embodiments of the invention and to briefly introduce some preferred embodiments. Some simplifications or omissions may be made in this section as well as in the description summary and in the title of the application, to avoid obscuring the purpose of this section, the description summary and the title of the invention, which should not be used to limit the scope of the invention.
The present invention has been made in view of the above-mentioned problems with existing video conference systems.
Therefore, the technical problems solved by the invention are as follows: the method solves the problems of high service load pressure, serious fault influence and low network bandwidth utilization rate of the service providing end of the conventional video conference system.
In order to solve the technical problems, the invention provides the following technical scheme: a communication method of a distributed video conference system specifically comprises the following steps: s1: when the communication transmission network is constructed, separating the control signaling from the data stream to perform signal data transmission; s2: the plurality of client terminals realize the real-time monitoring of the communication mutual signal intensity between the client terminals and the service providing end through signal monitors embedded in the client terminals; s3: when detecting a communication interaction signal intensity fault with a service providing end, starting a client terminal interconnection mode, and searching for optimal communication interconnection between other nearby client terminals; s4: the selected other nearby client terminals start a multichannel network transmission mode, and common signal transmission of a plurality of client terminals is realized by utilizing a preconfigured high-bandwidth network device; wherein, the control signaling and the data flow are both composed of two modes of processing by a service providing end and then directly sending to a plurality of client terminals and mutually transmitting among the client terminals; when the communication signal between the single client terminal and the service providing terminal fails, the selected other nearby client terminals start a multi-channel network transmission mode to transmit signal data to the service providing terminal; when the signal transmission of the service providing end fails, a plurality of client terminals realize mutual signal interconnection transmission; the method for searching the optimal communication interconnection between other nearby client terminals and the client terminal specifically comprises the following steps of: s1: determining the positions of the rest client terminals according to the actual situation; s2: taking a network device of a current problem terminal as a path starting point, acquiring the shortest path from the current problem terminal to other client terminals, wherein the path length is the sum of the number of the network devices; s3: acquiring a database according to the examples; s4: when one client terminal fails, selecting a path with the minimum path length for switching control; when more than two client terminals simultaneously fail, finding out a path with the non-conflicting shortest path length from the database formed in the step 3 for connection; the shortest path that does not collide is a path through which the failed client terminal cannot reach the same client terminal at the same time through the switching path.
As a preferred embodiment of the communication method of the distributed video conference system of the present invention, the method includes: when receiving the configuration signal sent by the client terminal network device, according to the corresponding configuration signal, adjusting the on-off state of the switch of the selector module correspondingly connected with each first client terminal so as to respectively configure and switch each client terminal to a second service client, specifically: when receiving the configuration signal sent by the client terminal, judging whether each client terminal is a service client terminal according to the configuration signal; if the current client terminal is a service client terminal, closing a first switch corresponding to the current client terminal, and adjusting the on-off states of all second switches corresponding to the current client terminal according to a preset on-off rule of the switch; if the current client terminal is not the service client terminal, the first switch corresponding to the current client terminal is disconnected.
As a preferred embodiment of the communication method of the distributed video conference system of the present invention, the method includes: when any service client receives the fault level sent by the faulty client terminal, the second switch in the closed state corresponding to the current faulty client terminal is used as a third switch, the first switch corresponding to the current client terminal and the second switch connected with the third switch in the second selector corresponding to the current client terminal are closed, and the rest of the second switches corresponding to the current client terminal are adjusted to be in the open state.
The communication method of the distributed video conference system provided by the invention has the following beneficial effects:
1. service provider service load pressure is reduced: by separating the control flow from the data flow, the control signaling and the data flow are respectively transmitted, so that the calculation and forwarding pressure of the service providing end is effectively reduced, and the system performance and the expandability are improved.
2. The network bandwidth utilization rate is improved: by adopting the self-adaptive network signal switching technology, the client terminal can automatically select the optimal signal source according to the network condition, realize lossless automatic switching, effectively reduce the waste of network bandwidth and improve the utilization rate of network resources.
3. Maintaining business stability and fluency: the client terminal has a plurality of working modes, including a direct connection mode and a bridging mode, and can select the most suitable network environment and application scene according to actual conditions. Meanwhile, the system can automatically identify the strength and quality of the network signal, and ensure smooth transmission of images and audios in the conference process.
4. Service retention capability: the communication method of the distributed video conference system provided by the invention is not influenced by the faults of the service providing end, has stronger service maintaining capability, and ensures that the conference can be continued when the service providing end breaks down.
5. Easy to expand and deploy: the communication method of the distributed video conference system provided by the invention has lower network delay and higher real-time performance, is suitable for large-scale and high-concurrency video conference scenes, and is convenient for expansion and deployment.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art. Wherein:
fig. 1 is a schematic diagram of an operation mode of a conventional videoconferencing system provided by the present invention.
Fig. 2 is a schematic diagram of a first operation scenario mode provided by the present invention.
Fig. 3 is a schematic diagram of a second operation scenario mode provided by the present invention.
Detailed Description
So that the manner in which the above recited objects, features and advantages of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
As conventional videoconferencing systems face the following challenges:
1. the service providing end has large service load pressure: conventional videoconferencing systems typically employ a centralized architecture, where all participants' audio and video data streams are processed and forwarded through a service provider. As the number of participants increases, the computational resources and bandwidth requirements of the service provider increase linearly, resulting in an increasing traffic load pressure.
2. The fault impact is severe: since the core functions of the video conference system are concentrated on the service provider, once the service provider fails, the whole conference cannot be performed. In addition, the failure may cause loss of participant information, affecting communication quality.
3. The network bandwidth utilization is low: in conventional videoconferencing systems, the data streams are transmitted unidirectionally, i.e. from the sender to the receiver. This means that the network bandwidth is mainly dependent on the bandwidth of the sender, not the actual requirements of the participant. Therefore, network bandwidth utilization is low and may result in bandwidth waste.
Accordingly, referring to fig. 1, 2 and 3, the present invention provides a communication method of a distributed video conference system, which specifically includes the following steps: a communication method of a distributed video conference system specifically comprises the following steps:
s1: when the communication transmission network is constructed, separating the control signaling from the data stream to perform signal data transmission;
s2: the plurality of client terminals realize the real-time monitoring of the communication mutual signal intensity between the client terminals and the service providing end through signal monitors embedded in the client terminals;
s3: when detecting a communication interaction signal intensity fault with a service providing end, starting a client terminal interconnection mode, and searching for optimal communication interconnection between other nearby client terminals;
s4: the selected other nearby client terminals start a multi-channel network transmission mode, and common signal transmission of a plurality of client terminals is realized by utilizing a preconfigured high-bandwidth network device.
Specifically, the control signaling and the data stream are both composed of two modes of processing by the service providing end and then directly sending to the plurality of client terminals and mutually transmitting among the plurality of client terminals.
Specifically, when the communication signal between the single client terminal and the service providing terminal fails, the selected other nearby client terminals start a multi-channel network transmission mode to transmit signal data to the service providing terminal; when the signal transmission of the service providing end fails, a plurality of client terminals realize mutual signal interconnection transmission.
Further, enabling the client terminal interconnection mode to find the optimal interconnection between other nearby client terminals and the communication thereof specifically comprises the following steps:
s1: determining the positions of the rest client terminals according to the actual situation;
s2: taking a network device of a current problem terminal as a path starting point, acquiring the shortest path from the current problem terminal to other client terminals, wherein the path length is the sum of the number of the network devices;
s3: acquiring a database according to the examples;
s4: when one client terminal fails, selecting a path with the minimum path length for switching control; and (3) when more than two client terminals simultaneously fail, finding out a path with the non-conflicting shortest path length from the database formed in the step (3) to connect.
Specifically, the shortest path that does not collide refers to a path through which a failed client terminal cannot reach the same client terminal at the same time through a switching path.
Further, when receiving the configuration signal sent by the client terminal network device, the on-off state of the selector module correspondingly connected to each first client terminal is adjusted according to the corresponding configuration signal, so as to switch the respective configurations of each client terminal to the second service client, specifically:
when receiving the configuration signal sent by the client terminal, judging whether each client terminal is a service client terminal according to the configuration signal;
if the current client terminal is a service client terminal, closing a first switch corresponding to the current client terminal, and adjusting the on-off states of all second switches corresponding to the current client terminal according to a preset on-off rule of the switch;
if the current client terminal is not the service client terminal, the first switch corresponding to the current client terminal is disconnected.
Specifically, when any service client receives the fault level sent by the faulty client terminal, the second switch corresponding to the current faulty client terminal and in the closed state is used as a third switch, and the first switch corresponding to the current client terminal and the second switch connected with the third switch in the second selector corresponding to the current client terminal are closed, and meanwhile, the rest of the second switches corresponding to the current client terminal are adjusted to be in the open state.
The communication method of the distributed video conference system provided by the invention has the following beneficial effects:
1. service provider service load pressure is reduced: by separating the control flow from the data flow, the control signaling and the data flow are respectively transmitted, so that the calculation and forwarding pressure of the service providing end is effectively reduced, and the system performance and the expandability are improved.
2. The network bandwidth utilization rate is improved: by adopting the self-adaptive network signal switching technology, the client terminal can automatically select the optimal signal source according to the network condition, realize lossless automatic switching, effectively reduce the waste of network bandwidth and improve the utilization rate of network resources.
3. Maintaining business stability and fluency: the client terminal has a plurality of working modes, including a direct connection mode and a bridging mode, and can select the most suitable network environment and application scene according to actual conditions. Meanwhile, the system can automatically identify the strength and quality of the network signal, and ensure smooth transmission of images and audios in the conference process.
4. Service retention capability: the communication method of the distributed video conference system provided by the invention is not influenced by the faults of the service providing end, has stronger service maintaining capability, and ensures that the conference can be continued when the service providing end breaks down.
5. Easy to expand and deploy: the communication method of the distributed video conference system provided by the invention has lower network delay and higher real-time performance, is suitable for large-scale and high-concurrency video conference scenes, and is convenient for expansion and deployment.
It should be noted that the above embodiments are only for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that the technical solution of the present invention may be modified or substituted without departing from the spirit and scope of the technical solution of the present invention, which is intended to be covered in the scope of the claims of the present invention.
Claims (3)
1. The communication method of the distributed video conference system is characterized by comprising the following steps of:
s1: when the communication transmission network is constructed, separating the control signaling from the data stream to perform signal data transmission;
s2: the plurality of client terminals realize the real-time monitoring of the communication mutual signal intensity between the client terminals and the service providing end through signal monitors embedded in the client terminals;
s3: when detecting a communication interaction signal intensity fault with a service providing end, starting a client terminal interconnection mode, and searching for optimal communication interconnection between other nearby client terminals;
s4: the selected other nearby client terminals start a multichannel network transmission mode, and common signal transmission of a plurality of client terminals is realized by utilizing a preconfigured high-bandwidth network device;
wherein, the control signaling and the data flow are both composed of two modes of processing by a service providing end and then directly sending to a plurality of client terminals and mutually transmitting among the client terminals;
when the communication signal between the single client terminal and the service providing terminal fails, the selected other nearby client terminals start a multi-channel network transmission mode to transmit signal data to the service providing terminal; when the signal transmission of the service providing end fails, a plurality of client terminals realize mutual signal interconnection transmission;
the method for searching the optimal communication interconnection between other nearby client terminals and the client terminal specifically comprises the following steps of:
s1: determining the positions of the rest client terminals according to the actual situation;
s2: taking a network device of a current problem terminal as a path starting point, acquiring the shortest path from the current problem terminal to other client terminals, wherein the path length is the sum of the number of the network devices;
s3: acquiring a database according to the examples;
s4: when one client terminal fails, selecting a path with the minimum path length for switching control; when more than two client terminals simultaneously fail, finding out a path with the non-conflicting shortest path length from the database formed in the step 3 for connection;
the shortest path that does not collide is a path through which the failed client terminal cannot reach the same client terminal at the same time through the switching path.
2. The distributed video conference system communication method of claim 1, wherein: when receiving the configuration signal sent by the client terminal network device, according to the corresponding configuration signal, adjusting the on-off state of the switch of the selector module correspondingly connected with each first client terminal so as to respectively configure and switch each client terminal to a second service client, specifically:
when receiving the configuration signal sent by the client terminal, judging whether each client terminal is a service client terminal according to the configuration signal;
if the current client terminal is a service client terminal, closing a first switch corresponding to the current client terminal, and adjusting the on-off states of all second switches corresponding to the current client terminal according to a preset on-off rule of the switch;
if the current client terminal is not the service client terminal, the first switch corresponding to the current client terminal is disconnected.
3. The distributed video conference system communication method according to claim 2, wherein: when any service client receives the fault level sent by the faulty client terminal, the second switch in the closed state corresponding to the current faulty client terminal is used as a third switch, the first switch corresponding to the current client terminal and the second switch connected with the third switch in the second selector corresponding to the current client terminal are closed, and the rest of the second switches corresponding to the current client terminal are adjusted to be in the open state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311641283.3A CN117354455B (en) | 2023-12-04 | 2023-12-04 | Communication method of distributed video conference system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311641283.3A CN117354455B (en) | 2023-12-04 | 2023-12-04 | Communication method of distributed video conference system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117354455A CN117354455A (en) | 2024-01-05 |
| CN117354455B true CN117354455B (en) | 2024-03-01 |
Family
ID=89371387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311641283.3A Active CN117354455B (en) | 2023-12-04 | 2023-12-04 | Communication method of distributed video conference system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117354455B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20030008952A (en) * | 2001-07-21 | 2003-01-29 | 주식회사 엠아이스트림 | Communication system of tree type structure and method of the same |
| CN103036781A (en) * | 2013-01-04 | 2013-04-10 | 杭州华三通信技术有限公司 | Method and device for processing main path link failures |
| CN104683730A (en) * | 2015-03-05 | 2015-06-03 | 苏州科达科技股份有限公司 | Video conference data transmission method and video conference system |
| WO2015151958A1 (en) * | 2014-03-31 | 2015-10-08 | 株式会社リコー | Transmission terminal, transmission system, and selection method for relay device |
| CN107911362A (en) * | 2017-11-14 | 2018-04-13 | 杭州万为科技有限责任公司 | The system and method for the internet video gateway security access of lightweight |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8185044B2 (en) * | 2004-03-31 | 2012-05-22 | Rockstar Bidco Lp | Multi-hop load balancing |
| US8990305B2 (en) * | 2006-10-18 | 2015-03-24 | Microsoft Corporation | Techniques for virtual conferencing servers |
-
2023
- 2023-12-04 CN CN202311641283.3A patent/CN117354455B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20030008952A (en) * | 2001-07-21 | 2003-01-29 | 주식회사 엠아이스트림 | Communication system of tree type structure and method of the same |
| CN103036781A (en) * | 2013-01-04 | 2013-04-10 | 杭州华三通信技术有限公司 | Method and device for processing main path link failures |
| WO2015151958A1 (en) * | 2014-03-31 | 2015-10-08 | 株式会社リコー | Transmission terminal, transmission system, and selection method for relay device |
| CN104683730A (en) * | 2015-03-05 | 2015-06-03 | 苏州科达科技股份有限公司 | Video conference data transmission method and video conference system |
| CN107911362A (en) * | 2017-11-14 | 2018-04-13 | 杭州万为科技有限责任公司 | The system and method for the internet video gateway security access of lightweight |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117354455A (en) | 2024-01-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5963547A (en) | Method and apparatus for centralized multipoint conferencing in a packet network | |
| EP1446908B1 (en) | Method and apparatus for packet-based media communication | |
| US6018360A (en) | Method of switching a call to a multipoint conference call in a H.323 communication compliant environment | |
| CN100559866C (en) | A kind of changing method of video terminal and multipoint control unit | |
| US20130335515A1 (en) | Call Movement in a Conferencing System | |
| CN111200521B (en) | Video networking service recovery method, server, electronic equipment and storage medium | |
| US20150009279A1 (en) | Distributed audio/video bridging for conferencing endpoints | |
| US9374232B2 (en) | Method and a device for optimizing large scaled video conferences | |
| CN111601068A (en) | Method for realizing multi-MCU cascade centerless video conference | |
| CN104883344A (en) | Method and device of negotiating media capabilities | |
| CN100420239C (en) | Method, system and device for realizing multicast program switching | |
| JP2007318556A (en) | Multipoint video conference system in communication network | |
| CN117354455B (en) | Communication method of distributed video conference system | |
| CN111614480B (en) | Service detection method, device and storage medium | |
| CN100428793C (en) | Conference television system and method of realizing maintaining business in said system | |
| CN212343934U (en) | Multipoint video conference system | |
| CN110958415B (en) | Method for dynamically adjusting media transmission based on single-platform network monitoring | |
| CN103152545B (en) | A kind of method, video server and video conferencing system processing error correction request | |
| JP2839295B2 (en) | Screen Update Method for Multipoint Video Conference System | |
| WO2023040325A1 (en) | Conference system | |
| CN115396383B (en) | Method for reversely controlling code stream in code stream transmitted by multiple devices | |
| US20060218259A1 (en) | Method of communication setup in a network | |
| CN112689118B (en) | Data transmission method and device for multi-screen network terminal | |
| CN117319593A (en) | Video conference method, electronic device and computer storage medium | |
| CN105704422A (en) | Video conference networking system and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |