CN104159164B - A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time - Google Patents
A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time Download PDFInfo
- Publication number
- CN104159164B CN104159164B CN201410428634.7A CN201410428634A CN104159164B CN 104159164 B CN104159164 B CN 104159164B CN 201410428634 A CN201410428634 A CN 201410428634A CN 104159164 B CN104159164 B CN 104159164B
- Authority
- CN
- China
- Prior art keywords
- node
- multicast
- relay
- collaboration
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Mobile Radio Communication Systems (AREA)
Abstract
A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time, each multicast reception node disjoint judges whether to need to start collaboration communication, from multicast error code node to standby relay node broadcasts relay request message, each standby via node for receiving relay request message is responded;Multicast error code node selects one as collaboration relay node according to channel latency etc. from the alternative via node of all responses.The program can avoid selecting the concealed nodes bandwidth overflow problem that cooperative node is caused, and improve the transmission performance of multicast service.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of net for reducing the reconstruction of wireless space multi-view point video
The wireless cooperation technology of multiple vision point video stream synchronization delayed time in network transmission.
Background technology
The network communications technology and video coding technique have promoted the transformation of video and multimedia technology application pattern.Stereopsis
It is a kind of by binocular or multi-vision visual signal during frequency, enable people to experience the multimedia shape of strong stereoscopic vision impact effect
Formula.Its study hotspot that the fields such as multimedia and communication are become in the application value of the aspects such as amusement, education, military affairs.
An important direction is based on various visual angles free stereo in stereo reconstruction technology based on the input of multichannel source view
The stereo reconstruction of technology.This kind of application is main to apply and needs the occasions such as immersion stereoscopic experience such as video conference.For example:2005
Year, Microsoft used the real-time multi-view video systems of interactive mode that 32 video cameras are realized.The system is by 32 spaced 5 degree
The video camera of arc shooting is that 6.5 meters of circumference are constituted around radius, can provide switchable viewing angle for the user on IP network
Direct broadcast function.
The huge video flowing of multi-view point video causes huge pressure to network transmission.To mitigate network transmission pressure,
Traditional technology is:Between multi-view point video identical content using wireless network multicast transmission identical part, and viewpoint
Between the part of difference use unicast transmission.But, wireless network can be subject to external interference, and there is channel difference, each to receive section
Point makes reception signal difference larger due to position difference.It is the receiving node that auxiliary error code is larger, it is possible to use collaboration communication, carries
The accuracy of the larger receiving node of high bit error.At present, the collaboration communication mechanism of use be mainly pick out the bit error rate it is low, load
Low node serves as cooperative node.
But, in the scene of multiple views transmission, because the image that each receiving point is rebuild has certain correlation, each node
It is to be serviced to rebuild a special scenes, therefore, the video that receiving node is rebuild must is fulfilled for regular hour limitation, existing
Technology is difficult to meet and requires.
The content of the invention
The purpose of the present invention is directed to prior art defect, there is provided a kind of reduction multiple vision point video stream synchronization delayed time it is wireless
Collaboration method.
Technical solution of the present invention provides a kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time, each
Multicast reception node disjoint judges whether to need to start collaboration communication, is to follow the steps below foundation as multicast error code node
Collaboration communication,
Step 1, multicast error code node disappear to corresponding all standby relay node broadcasts relay request messages in relay request
Being inserted in breath needs the multicast service number of cooperation;Each standby via node of relay request message is received, own services are more
Broadcast during service conditions inserts relay request response message, and send relay request response message and give multicast error code node;
Step 2, multicast error code node are according to default optimization principles from the alternative of all loopback relay request response messages
One is selected in via node as collaboration relay node;
Step 3, multicast error code node send relay selection message to collaboration relay node;
After step 4, selected collaboration relay node receive relay selection message, loopback relay selection response message is to more
Broadcast error code node;
Step 5, after multicast error code node receives the relay selection response message of collaboration relay node, trunking traffic machine
System is set up and is completed.
And, in step 3, the optimization principles of collaboration relay node are selected from the alternative via node of all responses such as
Under,
1) collaboration relay node transmission error rates are minimum;
2) it is preferential to select the being serviced multicast service section registered in multicast group interior nodes, and prioritizing selection multicast group interior nodes
The most node of point is used as collaboration relay node;
3) the minimum alternative via nodes of channel latency D are selected as collaboration relay node.
And, below occurring during any one situation, the standby via node of detection is opened,
(1) at the beginning of the network of multiple views multicast is set up, the alternative via node of each multicast reception node is separately detected;
(2) when default time threshold is reached, then the alternative relaying section of each multicast reception node is separately detected again
Point.
(3) each multicast reception node of multiple views multicast detects the bit error rate at interval of certain hour, when certain multicast reception
Node has three testing results to exceed corresponding wrong code distortion, and is provided without collaboration communication before, but corresponding standby via node is
0, then need to detect the standby via node of the multicast reception node.
And, each multicast reception node of multiple views multicast detects the bit error rate at interval of certain hour, when certain multicast connects
When receipts nodal test goes out the error of I frames, it is considered as testing result more than corresponding wrong code distortion.
And, alternative via node corresponding to the detection of any multicast reception node includes below scheme,
Step one, probe message is relayed from multicast reception node to neighbours' relay node broadcasts, and waited;
Step 2, when each neighbours' via node receive multicast reception node transmission relaying probe message when, return respectively
Send relaying probe response message to multicast reception node;Comprising the multicast service number that can be serviced in cooperation status information, with
And notebook data packet delivery time Tstart, corresponding multicast service number and the multicast node number that can be serviced;
Step 3, when multicast reception node receive neighbours' via node response relaying probe response message after, record work as
Preceding time of reception Tend, calculate channel latency D=Tend-Tstart, using each neighbours' via node as standby via node by correlation
Information is registered, and completion once detects the process of standby via node.
The present invention selects the Main Basiss of collaboration services node so that time delay is minimum, and proposes and regard a set of reduction more
The wireless network collaboration communication mechanism of point video stream synchronization delayed time.
Brief description of the drawings
Fig. 1 is the reconstruction result schematic diagram of the embodiment of the present invention.
Fig. 2 is detection unlocking condition (3) schematic diagram of the embodiment of the present invention.
Fig. 3 is the detection relaying secondary node flow chart of the embodiment of the present invention.
Fig. 4 is the cooperating process flow chart of the embodiment of the present invention.
Specific embodiment
Assuming that the reconstruction structure of a multiple views system is as shown in Figure 1:R0 is multicast group branch node, multicast downstream
Receiving node is d0~d4, and a1 is multicast group exterior node;Circle represents effective transmission range of r0 in figure.Sent except d0 receives r0
Packet exist outside error code, remaining each node can have correctly received r0 transmission packet.In the structure shown in Fig. 1
In figure, d0 can select the via node of d1 or d2 as cooperation transmission.But d1, d2 are subject in different geographical position
Interference is different, load is different, makes the multicast packet for being transmitted to d0 postpone to have differences.To reduce multiple views synchronization delayed time, Ying Xuan
The node of time delay minimum in d1, d2 is selected as via node.Represent can be with newly-built collaboration communication channel for dotted line in figure.Most disliking
In the case of bad, when there is not eliminable interference between d1, d2 and d0, and a1 retransmitting multi-castings are grouped when meeting multiple views synchronization
Time delay, can select group exterior node a1 as via node.
Referring to Fig. 2, the cooperation of embodiment is realized needing standby via node:
Detect standby via node:
Entry condition:
(1) at the beginning of the network of multiple views multicast is set up, the alternative via node of each multicast reception node is separately detected;
(2) when default corresponding time threshold is reached, then separately detect again each multicast reception node it is alternative in
After node.Because the former standby via node possible position change of multicast reception node, then can set at regular intervals, multicast
Receiving node actively starts to detect standby via node, is used subsequently to set up collaboration communication mechanism.
(3) find that the bit error rate of certain multicast reception node transfinites in bit error rate detection, but corresponding standby via node is
0, then need to detect the standby via node of the multicast reception node.
Collaboration communication is typically employed in the least significant end in multicast transmission direction, i.e. multicast reception node for end node.Multiple views
Each end node of multicast detects the bit error rate at interval of certain hour.When certain end node has three testing results to exceed corresponding error code
Thresholding, and be provided without collaboration communication before, then multicast error code node is designated as, it is necessary to begin setting up collaboration communication mechanism, if this
When standby via node number start to detect standby via node for 0 active, to continue to set up collaboration communication mechanism.Due to
Multicast transmission main business is video flowing, and time interval is related to the video type of transmission, and video flowing I frames are used as independent decoding
Frame, it is impossible to malfunction, therefore the time interval of the detection bit error rate can be selected to transmit the I frames equispaced of video during specific implementation
Time.When detecting whether the result of error code exceedes corresponding wrong code distortion, it is also possible to which whether I frames malfunction as criterion.When certain
When individual multicast reception node detects that I frames malfunction in one-time detection, it is considered as testing result more than corresponding wrong code distortion once.
Referring to Fig. 2, during specific implementation, any multicast reception node can be directed to, phase is exceeded when three testing results are had
Wrong code distortion is answered, then determines whether whether standby via node is 0, if otherwise carrying out setting up collaboration communication flow, selection association
Make via node, cooperating relay mechanism is set up in completion, if then detecting corresponding alternative via node, be then back to, in three inspections
Survey result and exceed corresponding wrong code distortion and standby via node to carry out setting up collaboration communication flow in the case of 0, choosing
Collaboration relay node is selected, cooperating relay mechanism is set up in completion.
When there is any of the above situation, the standby via node of detection is opened.
Referring to Fig. 3, alternative via node corresponding to the detection of any multicast reception node includes below scheme:
1st, multicast reception node is to neighbours' relay node broadcasts " relaying detection " message, and waits.In radio transmission range
Interior receiving node is neighbor node.Neighbours' via node is the via node in multicast reception nodes neighbors position.
2nd, when certain alternative via node receives " relaying detection " message of multicast reception node transmission, loopback " in
After probe response " message, including loopback itself cooperation status information to multicast reception node, comprising can in cooperation status information
With the multicast service number for servicing, and notebook data packet delivery time Tstart, corresponding multicast service number and can service it is many
Broadcast node number.One piece of test data of regular length B is added in " relaying probe response " last part.Recommend the length of B
It is 1000 bytes.
3rd, after multicast reception node receives " the relaying probe response message " that alternative via node is responded, then record current
Time of reception Tend, calculate channel latency and be designated as:D=Tend-Tstart.Multicast reception node is using each neighbours' via node as standby
Relevant information is registered with via node, completion once detects the process of standby via node.
During specific implementation, each node, type of data packet, each packet, multicast service can be respectively adopted corresponding label mark,
Those skilled in the art can designed, designed message format, it is proposed that the tool that each message involved by the standby via node process of detection is used
Physique formula is as follows:
Table 1:" relaying detection " message format
Type of data packet is numbered | Packet numbers | Sending node number |
Relaying detection type | Order is filled in | Multicast reception node |
Table 2:" relaying probe response " message format
The multicast node for servicing of the corresponding multicast service n of " relaying probe response " message " multicast service n " field
Number, represents that the node is available for the multicast reception node number of service.The value is higher, represents that the node can connect for more multicasts
Receive node and relay services are provided.But not necessarily having so multinode needs relay services.Every kind of business is corresponding to be available for clothes
The multicast reception node number of business is relevant with specific network node relative position.
Each multicast reception node disjoint judges whether to need to start collaboration communication, and collaboration communication is set up when needed.It is real
Apply in example, when certain end node separated in time of multiple views multicast detects that three bit error rates exceed thresholding, and store this
The information (i.e. standby via node number is not 0) of the standby via node of node, then the end node is multicast error code node, now
And begin setting up collaboration communication mechanism.
Referring to Fig. 4, each multicast error code node disjoint is performed and sets up collaboration communication mechanism, is comprised the following steps:
1st, multicast error code node starts relaying and creates a mechanism to standby relay node broadcasts " relay request ", " relay request "
Being inserted in message needs " multicast service number " of cooperation;The standby via node of " relay request " message is received respectively this section
The situation of point service multicast business is inserted in " relay request response " message, to multicast error code node loopback " relay request response "
Message.The situation of this node service multicast business typically may include:The multicast service sum that can be serviced, the multicast for having serviced
The multicast service nodes of service numbers and the being serviced of corresponding registration.
As Fig. 1, d0 transfinite for three times due to receiving error code, " relay request " message is then broadcasted.D0 this each node
Standby via node includes node d1, d2 and group exterior node a1 etc..
Receive node d1, d2 on the multicast tree of " relay request " message and organize exterior node a1 etc. to multicast error code node
Loopback " relay request response " message.
2nd, multicast error code node is former according to optimization from the alternative via node of all loopbacks " relay request response " message
A node is then selected, if the alternative via node being selected is labeled as collaboration relay node.Those skilled in the art can be certainly
Row pre-set optimization principles, it is proposed that now multicast error code node select collaboration relay node principle it is as follows:
1) collaboration relay node transmission error rates are minimum, and the bit error rate is typically counted in receiving terminal, the bit error rate=test data
Error code number/transmission data total number;
2) it is preferential to select the being serviced multicast service section registered in multicast group interior nodes, and prioritizing selection multicast group interior nodes
The most node of point is used as collaboration relay node;
3) the minimum alternative via nodes of channel latency D are selected as collaboration relay node.Channel latency D=Tend-Tstart
Value size, illustrate from alternative via node transmitted data amount B to multicast error code node need spend time length.Due to
Delay of the video information to the time is very sensitive.Multicast error code node needs the comprehensive data for oneself receiving and cooperation simultaneously to believe
The collaboration data of road transmission produces correct video data.If cooperation channel latency is larger, multicast error code node is needed
Open up and more cache come the multi-case data of the error that is stored with.Because video data is huge, larger channel latency is easily to make
Into data cached spilling, the delay and jitter of video is increased again, reduce the quality of video reconstruction.Therefore, in selecting after
During node, the less node of channel latency is selected as far as possible as via node.Can the optimal node of comprehensive three principles selection.
3rd, multicast error code receiving node sends " relay selection message " to collaboration relay node, and waits.
4th, collaboration relay node return " relay selection response message ", while register multicast service number, and " service it is many
Broadcast node number " Jia 1 on the original basis, the multicast service nodes of the being serviced for more newly registering, and cooperative transmission data letter
Breath." relay selection response " message specifies via node number herein, the approval information for waiting the node to beam back.
The multicast node of " the multicast node number of service " described service refers to receive collaboration relay node relaying signal
All-multicast error code node.In order to distinguish different multicast services, relay selection response message can register multicast service number.It is many
It is for distinguishing the digital without repetition of different multicast services or encoding, effect similar the Automobile trade mark or personal call to broadcast service numbers
Number.By multicast service number, different multicast services can be differentiated.During specific implementation, multicast service number and corresponding can be registered
The multicast service nodes of the being serviced of registration, due to being to initiate cooperation request by receiving node, via node receives to ask into
After for collaboration relay node, can direct forward collaboration multi-case data.
5th, when multicast error code node receives " relay selection response " message of collaboration relay node, it is believed that trunking traffic machine
System is set up and is completed, while can be with data message of the start to process from collaboration data subchannel.
During specific implementation, each node, type of data packet, each packet, multicast service can be respectively adopted corresponding label mark,
Those skilled in the art can designed, designed message format, it is proposed that set up the tool that each message involved by collaboration communication mechanism process is used
Physique formula is as follows:
Table 3:" relay request " message format
Table 4:" relay request response " message format
Table 5:Relay selection message format
Table 6:Relay selection response message format
Label during multiple is indicated with n in each table, value is relevant with concrete condition.
During specific implementation, invention technician can preset each threshold value according to experiment or experience.
Specific embodiment described herein is only to the spiritual explanation for example of the present invention.Technology neck belonging to of the invention
The technical staff in domain can be made various modifications or supplement to described specific embodiment or be replaced using similar mode
Generation, but without departing from spirit of the invention or surmount scope defined in appended claims.
Claims (2)
1. a kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time, it is characterised in that:Appoint below occurring
During a kind of situation, the standby via node of detection is opened,
(1) at the beginning of the network of multiple views multicast is set up, the alternative via node of each multicast reception node is separately detected;
(2) when default time threshold is reached, then the alternative via node of each multicast reception node is separately detected again;
(3) each multicast reception node of multiple views multicast detects the bit error rate at interval of certain hour, when certain multicast reception node
There are three testing results to exceed corresponding wrong code distortion, and be provided without collaboration communication before, but corresponding standby via node is 0, then
Need to detect the standby via node of the multicast reception node;
Alternative via node corresponding to the detection of any multicast reception node includes below scheme,
Step one, probe message is relayed from multicast reception node to neighbours' relay node broadcasts, and waited;
Step 2, when each neighbours' via node receives the relaying probe message of multicast reception node transmission, respectively in loopback
After probe response message to multicast reception node;Comprising the multicast service number that can be serviced, Yi Jiben in cooperation status information
Packet sends time Tstart, corresponding multicast service number and the multicast node number that can be serviced;
Step 3, when multicast reception node receive neighbours' via node response relaying probe response message after, record currently connect
Time receiving carves Tend, calculate channel latency D=Tend-Tstart, using each neighbours' via node as standby via node by relevant information
Registration is got off, and completion once detects the process of standby via node;
Each multicast reception node disjoint judges whether to need to start collaboration communication, is to be carried out as multicast error code node following
Step sets up collaboration communication,
Step 1, multicast error code node to corresponding all standby relay node broadcasts relay request messages, in relay request message
Insert the multicast service number for needing cooperation;Each standby via node of relay request message is received, by own services multicast industry
Business situation is inserted in relay request response message, and is sent relay request response message and given multicast error code node;
Step 2, multicast error code node are according to default optimization principles from the alternative relaying of all loopback relay request response messages
One is selected in node as collaboration relay node;
The optimization principles that collaboration relay node is selected from the alternative via node of all responses are as follows,
1) collaboration relay node transmission error rates are minimum;
2) the most node of the being serviced multicast service node registered in multicast group interior nodes, and selection multicast group interior nodes is selected
As collaboration relay node;
3) the minimum alternative via nodes of channel latency D are selected as collaboration relay node;
Step 3, multicast error code node send relay selection message to collaboration relay node;
After step 4, selected collaboration relay node receive relay selection message, loopback relay selection response message to multicast is missed
Code node;
Step 5, after multicast error code node receives the relay selection response message of collaboration relay node, trunking traffic mechanism is built
It is vertical to complete.
2. it is used to reduce the wireless cooperation method of multiple vision point video stream synchronization delayed time according to claim 1, it is characterised in that:
Each multicast reception node of multiple views multicast detects the bit error rate at interval of certain hour, when certain multicast reception nodal test goes out I
When frame malfunctions, it is considered as testing result more than corresponding wrong code distortion.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410428634.7A CN104159164B (en) | 2014-08-27 | 2014-08-27 | A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410428634.7A CN104159164B (en) | 2014-08-27 | 2014-08-27 | A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104159164A CN104159164A (en) | 2014-11-19 |
CN104159164B true CN104159164B (en) | 2017-06-27 |
Family
ID=51884553
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410428634.7A Expired - Fee Related CN104159164B (en) | 2014-08-27 | 2014-08-27 | A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104159164B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109218739B (en) * | 2017-07-06 | 2021-04-13 | 阿里巴巴集团控股有限公司 | Method, device and equipment for switching visual angle of video stream and computer storage medium |
CN113055092B (en) * | 2021-03-17 | 2022-07-12 | 卡斯柯信号有限公司 | Equipment and method for improving communication transmission safety of existing signal equipment |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101394410A (en) * | 2008-10-29 | 2009-03-25 | 北京邮电大学 | A communication method used in mobile Ad hoc network |
CN103220035A (en) * | 2013-05-08 | 2013-07-24 | 华中师范大学 | Cooperative communication transmission method |
CN103313141A (en) * | 2013-05-08 | 2013-09-18 | 华中师范大学 | Cooperative node selection establishment method for distribution type wireless multicast |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7483403B2 (en) * | 2002-01-10 | 2009-01-27 | Robert Bosch Gmbh | Protocol for reliable, self-organizing, low-power wireless network for security and building automation systems |
-
2014
- 2014-08-27 CN CN201410428634.7A patent/CN104159164B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101394410A (en) * | 2008-10-29 | 2009-03-25 | 北京邮电大学 | A communication method used in mobile Ad hoc network |
CN103220035A (en) * | 2013-05-08 | 2013-07-24 | 华中师范大学 | Cooperative communication transmission method |
CN103313141A (en) * | 2013-05-08 | 2013-09-18 | 华中师范大学 | Cooperative node selection establishment method for distribution type wireless multicast |
Also Published As
Publication number | Publication date |
---|---|
CN104159164A (en) | 2014-11-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
ES2297351T3 (en) | WIDE BAND TELECOMMUNICATION SYSTEM AND METHOD USED TO REDUCE CHANNEL CHANGE LATENCY BY A MULTIMEDIA RECEIVER. | |
US20080101270A1 (en) | Enhanced multicast broadcast multimedia service | |
CN101741538B (en) | Synchronous dispatching method | |
CN103733722B (en) | Telecommunication installation and method | |
CN101272519B (en) | Method, device and base station for generating protocol data unit | |
EP3298790A1 (en) | Providing low&high quality streams | |
CN102594672B (en) | Method and system applicable to high-quality internet communication in low-reliability network environment | |
CN101668158B (en) | Video switching processing method and multi-point control unit | |
CN101651510B (en) | Method and device for recovery processing in service data synchronous transmission | |
CN101389036B (en) | Error correcting device suitable for video conference and method thereof | |
US8774069B2 (en) | Method and system for synchronized mapping of data packets in an ATSC data stream | |
KR20100073515A (en) | Apparatus and method for communicating packtet including urgent packet in digital broadcasting system | |
JP2014519732A (en) | Method and apparatus for transmitting / receiving broadcast service in digital broadcasting system, and system thereof | |
CN104918132A (en) | Method and system for smart television audio and video communication | |
CN104159164B (en) | A kind of wireless cooperation method for reducing multiple vision point video stream synchronization delayed time | |
CN103475691B (en) | Video distributed cache transfer system | |
CN101686431B (en) | Synchronous processing method and device | |
CN109450791A (en) | The method and system of the host intercommunication of the host and main website side of remote station side | |
CN101465849A (en) | Method for synchronizing at least two streams | |
CN101102457A (en) | A method and device for automatic upgrade of private line conference TV system | |
CN102946530A (en) | Video transmission method and device and video playing method and device | |
CN113037515B (en) | Frame format analysis method and device of MAC layer multicast data frame based on HINOC system | |
CN100386987C (en) | Group broadcast data distributing method and data distributing device and terminal for realizing said method | |
CN102130778A (en) | Method and system for protecting IPTV (Internet Protocol Television) multicast service | |
CN104244322B (en) | It is a kind of to be used to overcome the wireless multicast cooperative node selection method for building up for hiding interference |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170627 Termination date: 20200827 |