CN103456168B - A kind of traffic intersection pedestrian behavior monitoring system and method - Google Patents
A kind of traffic intersection pedestrian behavior monitoring system and method Download PDFInfo
- Publication number
- CN103456168B CN103456168B CN201310363312.4A CN201310363312A CN103456168B CN 103456168 B CN103456168 B CN 103456168B CN 201310363312 A CN201310363312 A CN 201310363312A CN 103456168 B CN103456168 B CN 103456168B
- Authority
- CN
- China
- Prior art keywords
- pedestrian
- high definition
- image
- video camera
- traffic intersection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The present invention relates to field of traffic, provide a kind of traffic intersection pedestrian behavior monitoring system, comprise the first high definition IPC video camera, analysis module, humanoid detection analysis module and the second high definition IPC video camera.Additionally provide a kind of method of correspondence, system and method of the present invention, by analysis module, pedestrian accurately caught, follow the tracks of, and violation pedestrian is taken appropriate measures, save manpower and safeguarded the wasting of resources that crossing traffic causes, also contribution has been made to the accident transmission rate of traffic intersection simultaneously.
Description
Technical field
The present invention relates to field of traffic, more particularly, relate to a kind of traffic intersection pedestrian behavior monitoring system and method.
Background technology
Pedestrian violates the traffic regulations quite general in China, and this is also the main inducing of students in middle and primary schools' traffic accidents.The especially big traffic hazard in Qinyuan, Shanxi has beaten alarm bell to people, and the traffic hazard caused by traffic accident all " can torture " life of countless students in middle and primary schools every year.From certain angle, it is a key factor that awareness of safety-pedestrian goes across the road that (crossing) observe traffic rules and regulations.Research shows, the vehicle that pedestrian is traveling speed 40mph (speed of a motor vehicle per hour 40 miles) knocks down, and surviving may be 85%.In order to address this problem, in the last few years, vehicle supervision department of China had set up many taboo speed marks at peripheries such as crossing zebra stripes, optimized signal timing dial, achieved certain effect, reduce the incidence of school gate traffic accidents.
In order to reduce traffic hazard, some areas have also been put into effect pedestrian and have been violated traffic and take the laws and regulations of countermeasure, this accident rate produced reducing pedestrian to violate traffic achieves certain effect, but the method wastes a large amount of manpowers, the crossing arranging zebra stripes needs traffic police to assist implements this laws and regulations.
Therefore, need a kind of traffic intersection pedestrian behavior monitoring system and method, when can reduce accident rate, effectively reduce human cost.
Summary of the invention
The object of the present invention is to provide a kind of traffic intersection pedestrian behavior monitoring system and method, be intended to solve traffic intersection in prior art and have an accident the problem that rate is high, manpower maintenance cost is high.
In order to realize object of the present invention, a kind of traffic intersection pedestrian behavior monitoring system, comprising: the first high definition IPC video camera, analysis module, humanoid detection analysis module and the second high definition IPC video camera; Described first high definition IPC video camera, for Real-time Collection signal lamp image;
Described analysis module, for judging the state of signal lamp according to the image of the first high definition IPC camera acquisition, and issues humanoid detection analysis module and the second high definition IPC video camera by forbidden signal; Described second high definition IPC video camera, for taking the video image of traffic intersection and processing video image, and issues humanoid detection analysis module by process image; Described humanoid detection analysis module, for obtaining the process image of the second high definition IPC video camera after receiving forbidden signal, and catches and follows the tracks of process and process violation pedestrian to pedestrian.
Further, described system also comprises panalarm, sends alarm sound for judging at humanoid detection analysis module when having violation pedestrian.
Further, described system also comprises monitoring TV wall, obtains the video image of the second high definition IPC video camera shooting for being transmitted link by video and shows in real time at traffic intersection.
Further, described humanoid detection analysis module comprises humanoid detecting unit, in violation of rules and regulations analytic unit and counting unit;
Described humanoid detecting unit, determines whether pedestrian for extracting humanoid feature;
Described violation analytic unit, detects for the behavior of track algorithm to pedestrian by gradient orientation histogram and particle filter;
Described counting unit is used for counting violation pedestrian.
In above-mentioned arbitrary technical scheme, described first high definition IPC position for video camera is in the opposite of signal lamp; Described second high definition IPC position for video camera is in the side of traffic intersection.
In order to better realize object of the present invention, additionally providing a kind of traffic intersection pedestrian behavior monitoring method, comprising: the first high definition IPC camera acquisition signal lamp image; Judge the state of signal lamp according to the image of the first high definition IPC camera acquisition, and forbidden signal is issued humanoid detection analysis module and the second high definition IPC video camera; Second high definition IPC video camera is taken the video image of traffic intersection and is processed video image, and process image is issued humanoid detection analysis module; Humanoid detection analysis module obtains the process image of the second high definition IPC video camera after receiving forbidden signal, and catches and follow the tracks of process to pedestrian and process violation pedestrian.
Further, described method also comprises: send chimes of doom when humanoid detection analysis module has detected violation pedestrian.
Further, described method also comprises: transmit link by video and obtain the video and graphic of the second high definition IPC video camera shooting and show in real time at traffic intersection.
Further, describedly pedestrian caught and follows the tracks of process and violation pedestrian is processed specifically comprise: extracting humanoid feature and determine whether pedestrian; If not, then the process image of the second high definition IPC video camera is obtained; If so, the behavior of the track algorithm of gradient orientation histogram and particle filter to pedestrian is then utilized to detect; If cross traffic intersection, then judge that this pedestrian is as violation pedestrian, and this pedestrian is counted; Otherwise, do not count.
In above-mentioned arbitrary technical scheme, the image of described second high definition IPC video camera shooting traffic intersection also processes image, and process image is issued humanoid detection analysis module and specifically comprised: the image of the second high definition IPC video camera shooting traffic intersection; Image is carried out to convergent-divergent, takes off process, obtains process image; Process image is issued humanoid detection analysis module.
In technique scheme of the present invention, by to the colour recognition of signal lamp and the identification to traffic intersection pedestrian behavior, the present situation of traffic intersection not only can be obtained by video image, the pedestrian gone across the road in violation of rules and regulations can also be known, monitor staff can pass through remote assistance, realizes the control to this crossing.This human cost manual monitoring greatly reducing traffic intersection safeguarded, in addition, due to the existence of monitoring system, makes pedestrian start to focus on traffic rules, thus reduces the incidence of traffic hazard.
Accompanying drawing explanation
Fig. 1 is the structural representation of traffic intersection pedestrian behavior monitoring system in first embodiment of the invention.
Fig. 2 is the structural representation of humanoid detection analysis module in first embodiment of the invention.
Fig. 3 is the structural representation of traffic intersection pedestrian behavior monitoring system in second embodiment of the invention.
Fig. 4 is the method flow diagram of traffic intersection pedestrian behavior monitoring method in third embodiment of the invention.
embodiment
In order to make the object of the invention, technical scheme and advantage clearly, understand, be explained below in conjunction with accompanying drawing.
Composition graphs 1 and Fig. 2 the present invention propose an embodiment.A kind of traffic intersection pedestrian behavior monitoring system, it comprises: the first high definition IPC video camera 1, analysis module 2, second high definition IPC video camera 3 and humanoid detection analysis module 4.Wherein:
(1) first high definition IPC video camera 1, for the image of Real-time Collection signal lamp;
Described high definition IPC(IPCamera) video camera is one of hardware device of network video monitor and control system, can be used for video and audio data collection, signal transacting etc.
(2) analysis module 2, the image for gathering according to the first high definition IPC video camera 1 judges the state of signal lamp 5, and forbidden signal is issued humanoid detection analysis module 4 and the second high definition IPC video camera 3;
(3) second high definition IPC video cameras 3, for taking the video image of traffic intersection and processing video image, and issue humanoid detection analysis module 4 by process image;
(4) humanoid detection analysis module 4, for obtaining the process image of the second high definition IPC video camera 3 after receiving forbidden signal, and catches and follows the tracks of process and process violation pedestrian to pedestrian.
In technique scheme of the present invention, by to the colour recognition of signal lamp 5 and the identification to traffic intersection 6 pedestrian behavior, the present situation of traffic intersection 6 not only can be obtained by video image, the pedestrian gone across the road in violation of rules and regulations can also be known, monitor staff can pass through remote assistance, realizes the control to this crossing.This human cost manual monitoring greatly reducing traffic intersection 6 safeguarded, in addition, due to the existence of monitoring system, makes pedestrian start to focus on traffic rules, thus reduces the incidence of traffic hazard.
In first embodiment, described humanoid detection analysis module 4 comprises humanoid detecting unit 41, in violation of rules and regulations analytic unit 42 and counting unit 43;
(1) humanoid detecting unit 41, determines whether pedestrian for extracting humanoid feature.
Wherein, described humanoid feature includes but not limited to: head, health, hand, pin etc., also namely whether having the features such as the head of people, health, hand and pin by analyzing this detected object, if had, being then judged as pedestrian, otherwise judging not as pedestrian.
(2) violation analytic unit 42, detects for the behavior of track algorithm to pedestrian by gradient orientation histogram and particle filter.
The implementation of described track algorithm is: be follow the tracks of framework with particle filter, improvement gradient orientation histogram (HOG) method of miniaturization is utilized to achieve small scale pedestrian detection, and according to its testing result determination target, constantly revise particle sampler, achieve the pedestrian tracking under dynamic background.The technical program can follow the tracks of the pedestrian target of change in size in dynamic background more accurately and effectively.Set up observation model by color histogram, utilize the gradient orientation histogram (HOG) of miniaturization to detect as identification module, under the video condition of dissimilar background, realize the tracking effect to pedestrian target.Algorithm make use of the color histogram advantage insensitive etc. to target deformation, partial occlusion, dimensional variation, decrease detection time after gradient orientation histogram miniaturization simultaneously, realize Sampling and Correcting, to interference such as dynamic background and pedestrian's dimensional variation, there is stronger robustness, can realize following the tracks of preferably to pedestrian target in static and dynamic background video.
(3) counting unit 43 is for counting violation pedestrian.
Coordinate the quantity accurate Calculation that computing unit 43 can realize violation pedestrian, this understands existing pedestrian to vehicle supervision department and goes across the road and provide data intuitively, thus is more conducive to vehicle supervision department's amendment or improves traffic rules.
Technique scheme of the present invention, can distinguish pedestrian and other animals accurately, thus realizes the counting of pedestrian in violation of rules and regulations, and this makes traffic monitoring more convenient.
Based on the first embodiment, the present invention proposes the second embodiment, and as shown in Figure 2, traffic intersection pedestrian behavior monitoring system also can comprise panalarm 9, sends alarm sound for judging at humanoid detection analysis module when having violation pedestrian.This technical scheme can remind the pedestrian (especially blind person) gone across the road in violation of rules and regulations to take care, thus further can reduce traffic hazard.
In the present embodiment, described system also can comprise monitoring TV wall 8, obtains the video image of the second high definition IPC video camera 4 shooting for being transmitted link by video and shows in real time at traffic intersection.Wherein, the second described high definition IPC video camera 4 transmits link by video can first issue server 7 by video image, server 7 is presented on monitoring TV wall 8 by needing the video image of display, because the present situation of traffic intersection can be shown in real time by monitoring TV wall 8, and controllers can select the situation of the violation pedestrian playing prevailing traffic crossing as required, thus pedestrian's voluntary observance traffic under the supervision of monitoring TV wall 8 can be made, further reduce traffic hazard.
In technique scheme, described first high definition IPC video camera 1 is positioned at the opposite of signal lamp 5; Described second high definition IPC video camera 3 is positioned at the side of traffic intersection 6.Thus the information of signal lamp 5 and traffic intersection clearly can be photographed, thus ensure that humanoid detection analysis module obtains information accurately.
Composition graphs 4, the present invention proposes the 3rd embodiment, and traffic intersection pedestrian behavior monitoring method, comprises the following steps: S1, the first high definition IPC camera acquisition signal lamp image.
S2, judge the state of signal lamp according to the image of the first high definition IPC camera acquisition, and forbidden signal is issued humanoid detection analysis module and the second high definition IPC video camera.
The technical program, carries out color judgement to the signal lamp image gathered, when walker signal lamp is forbidden color, forbidden signal is issued humanoid detection analysis module, and humanoid detection analysis module prepares the process image of reception second high definition IPC video camera shooting; And forbidden signal is issued the second high definition IPC video camera simultaneously, the second high definition IPC video camera starts to take image.
S3, the second high definition IPC video camera are taken the video image of traffic intersection and process video image, and process image is issued humanoid detection analysis module.
Second high definition IPC video camera contains automatic adaptation and arranges, and according to image scanning techniques, has sensed that human body is in sensing range, then start image collecting device and face is taken.Described step S3 specifically comprises: the image of S31, the second high definition IPC video camera shooting traffic intersection; S32, image is carried out to convergent-divergent, takes off process, obtain process image;
S33, process image is issued humanoid detection analysis module.
S4, humanoid detection analysis module obtain the process image of the second high definition IPC video camera after receiving forbidden signal, and catch and follow the tracks of process to pedestrian and process violation pedestrian.
In described step S4, pedestrian caught and follows the tracks of process and violation pedestrian is processed specifically comprise: extracting humanoid feature and determine whether pedestrian; If not, then the process image of the second high definition IPC video camera is obtained; If so, the behavior of the track algorithm of gradient orientation histogram and particle filter to pedestrian is then utilized to detect; If cross traffic intersection, then judge that this pedestrian is as violation pedestrian, and this pedestrian is counted; Otherwise, do not count.Wherein, described humanoid feature includes but not limited to: head, health, hand, pin etc., also namely whether having the features such as the head of people, health, hand and pin by analyzing this detected object, if had, being then judged as pedestrian, otherwise judging not as pedestrian.
In technique scheme of the present invention, by to the colour recognition of signal lamp and the identification to traffic intersection pedestrian behavior, the present situation of traffic intersection not only can be obtained by video image, the pedestrian gone across the road in violation of rules and regulations can also be known, monitor staff can pass through remote assistance, realizes the control to this crossing.This human cost manual monitoring greatly reducing traffic intersection safeguarded, in addition, due to the existence of monitoring system, makes pedestrian start to focus on traffic rules, thus reduces the incidence of traffic hazard.
Further, the method for the present embodiment also can comprise: send chimes of doom when humanoid detection analysis module has detected violation pedestrian.This technical scheme can remind the pedestrian (especially blind person) gone across the road in violation of rules and regulations to take care, thus further can reduce traffic hazard.
Described method also comprises: transmit link by video and obtain the video and graphic of the second high definition IPC video camera shooting and show in real time at traffic intersection.Owing in real time the situation of traffic intersection can be shown to pedestrian in the technical program, thus pedestrian's voluntary observance traffic under this supervision can be made, further reduce traffic hazard.
Above are only preferred embodiment of the present invention, be not limited to the present invention, all any amendments done within the spirit and principles in the present invention, equivalent substitutions and modifications etc., all should be included within the scope of protection of the invention.
Claims (8)
1. a traffic intersection pedestrian behavior monitoring system, is characterized in that, comprising:
First high definition IPC video camera, analysis module, humanoid detection analysis module and the second high definition IPC video camera; Described first high definition IPC video camera, for Real-time Collection signal lamp image; Described analysis module, for judging the state of signal lamp according to the image of the first high definition IPC camera acquisition, and issues humanoid detection analysis module and the second high definition IPC video camera by forbidden signal;
Described second high definition IPC video camera, for starting to take the video image of traffic intersection and process video image after receiving forbidden signal, and issues humanoid detection analysis module by process image;
Described humanoid detection analysis module is used for the process image obtaining the second high definition IPC video camera after receiving forbidden signal, and catches and follow the tracks of process to pedestrian and process violation pedestrian;
Described humanoid detection analysis module comprises humanoid detecting unit, in violation of rules and regulations analytic unit and counting unit; Described humanoid detecting unit, determines whether pedestrian for extracting humanoid feature; Described violation analytic unit, detects for the behavior of track algorithm to pedestrian by gradient orientation histogram and particle filter; Described counting unit is used for counting violation pedestrian.
2. traffic intersection pedestrian behavior monitoring system according to claim 1, it is characterized in that, described system also comprises panalarm, sends alarm sound for judging at humanoid detection analysis module when having violation pedestrian.
3. traffic intersection pedestrian behavior monitoring system according to claim 1, it is characterized in that, described system also comprises monitoring TV wall, obtains the video image of the second high definition IPC video camera shooting for being transmitted link by video and shows in real time at traffic intersection.
4. traffic intersection pedestrian behavior monitoring system according to any one of claim 1 to 3, is characterized in that, described first high definition IPC position for video camera is in the opposite of signal lamp; Described second high definition IPC position for video camera is in the side of traffic intersection.
5., based on a traffic intersection pedestrian behavior monitoring method for system according to claim 1, it is characterized in that, comprising:
First high definition IPC camera acquisition signal lamp image;
Judge the state of signal lamp according to the image of the first high definition IPC camera acquisition, and forbidden signal is issued humanoid detection analysis module and the second high definition IPC video camera;
Second high definition IPC video camera starts to take the video image of traffic intersection and processes video image after receiving forbidden signal, and process image is issued humanoid detection analysis module; Humanoid detection analysis module, after receiving forbidden signal, obtains the process image of the second high definition IPC video camera, and catches and follow the tracks of process to pedestrian and process violation pedestrian; Describedly pedestrian caught and follows the tracks of process and violation pedestrian is processed specifically comprise: extracting humanoid feature and determine whether pedestrian; If not, then the process image of the second high definition IPC video camera is obtained; If so, the behavior of the track algorithm of gradient orientation histogram and particle filter to pedestrian is then utilized to detect; If cross traffic intersection, then judge that this pedestrian is as violation pedestrian, and this pedestrian is counted; Otherwise, do not count.
6. traffic intersection pedestrian behavior monitoring method according to claim 5, it is characterized in that, described method also comprises: send chimes of doom when humanoid detection analysis module has detected violation pedestrian.
7. traffic intersection pedestrian behavior monitoring method according to claim 5, it is characterized in that, described method also comprises: transmit link by video and obtain the video and graphic of the second high definition IPC video camera shooting and show in real time at traffic intersection.
8. require the traffic intersection pedestrian behavior monitoring method according to any one of 5 to 7 according to power, it is characterized in that, the image of described second high definition IPC video camera shooting traffic intersection also processes image, and process image is issued humanoid detection analysis module and specifically comprised: the image of the second high definition IPC video camera shooting traffic intersection; Image is carried out to convergent-divergent, takes off process, obtains process image; Process image is issued humanoid detection analysis module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310363312.4A CN103456168B (en) | 2013-08-20 | 2013-08-20 | A kind of traffic intersection pedestrian behavior monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310363312.4A CN103456168B (en) | 2013-08-20 | 2013-08-20 | A kind of traffic intersection pedestrian behavior monitoring system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103456168A CN103456168A (en) | 2013-12-18 |
| CN103456168B true CN103456168B (en) | 2016-01-06 |
Family
ID=49738486
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310363312.4A Expired - Fee Related CN103456168B (en) | 2013-08-20 | 2013-08-20 | A kind of traffic intersection pedestrian behavior monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103456168B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104091446B (en) * | 2014-07-11 | 2016-08-17 | 厦门磐联科技有限公司 | Pedestrian crosses the intelligent video analysis method of zebra crossing |
| CN104766071B (en) * | 2015-04-28 | 2018-02-02 | 重庆邮电大学 | A kind of traffic lights fast algorithm of detecting applied to pilotless automobile |
| CN106128105B (en) * | 2016-07-27 | 2019-01-04 | 深圳市汉锐信息技术股份有限公司 | A kind of traffic intersection pedestrian behavior monitoring system |
| CN106846791A (en) * | 2017-03-13 | 2017-06-13 | 王水观 | Crossing zebra stripes safe passing automatic prompting device |
| CN107622658B (en) * | 2017-10-12 | 2018-10-12 | 樊陆 | The monitoring method and terminal device that pedestrian goes across the road |
| CN110211370A (en) * | 2019-06-10 | 2019-09-06 | 吉林大学 | One kind being based on LK optical flow method pavement Intelligent warning device |
| CN110223506A (en) * | 2019-07-11 | 2019-09-10 | 杨子恩 | A kind of novel traffic intersection pedestrian's rale violation warnings system and method |
| CN112349096A (en) * | 2020-10-28 | 2021-02-09 | 厦门博海中天信息科技有限公司 | Method, system, medium and equipment for intelligently identifying pedestrians on road |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005119622A1 (en) * | 2004-06-01 | 2005-12-15 | Persen Technologies Incorporated | Vehicle warning system |
| GB2457668A (en) * | 2008-02-20 | 2009-08-26 | Prince Noah Davidson | Traffic control system with display and integrated communications technology |
| CN101739809A (en) * | 2008-11-04 | 2010-06-16 | 上海经达实业发展有限公司 | Automatic alarm and monitoring system for pedestrian running red light |
| CN102081844A (en) * | 2011-01-25 | 2011-06-01 | 华中科技大学 | Traffic video behavior analyzing and alarming server |
| CN202534163U (en) * | 2012-04-18 | 2012-11-14 | 杭州市公安局交通警察支队 | Pedestrian red light running warning device |
| CN103021175A (en) * | 2012-11-12 | 2013-04-03 | 上海经达实业发展有限公司 | Pedestrian red light running video detection method and device based on Davinci architecture |
| CN203012958U (en) * | 2012-12-04 | 2013-06-19 | 合肥寰景信息技术有限公司 | Road traffic violation behavior analysis early warning system based on motion identification |
-
2013
- 2013-08-20 CN CN201310363312.4A patent/CN103456168B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN103456168A (en) | 2013-12-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103456168B (en) | A kind of traffic intersection pedestrian behavior monitoring system and method | |
| CN103366565B (en) | Method and system of detecting pedestrian running red light based on Kinect | |
| CN105141885B (en) | Carry out the method and device of video monitoring | |
| CN107679471B (en) | Indoor personnel air post detection method based on video monitoring platform | |
| CN103413395B (en) | Flue gas intelligent detecting prewarning method and device | |
| CN102164270A (en) | Intelligent video monitoring method and system capable of exploring abnormal events | |
| CN110002315A (en) | Vertical ladder electric vehicle detection method and warning system based on deep learning | |
| CN105163014B (en) | Road monitoring device and method | |
| CN111325048B (en) | Personnel gathering detection method and device | |
| CN107977596A (en) | A kind of car plate state identification method and device | |
| CN112052815A (en) | Behavior detection method and device and electronic equipment | |
| CN204102328U (en) | A kind of device reminding pedestrian, bicycle violation | |
| CN110084987A (en) | A kind of foreign matter inspecting system and method towards rail traffic | |
| CN112349087B (en) | Visual data input method based on holographic perception of intersection information | |
| CN115393563A (en) | Package detection method and system and electronic equipment | |
| CN102937412B (en) | Foreign matter blocking detection and intelligent alarm method for camera devices | |
| CN109409173B (en) | Driver state monitoring method, system, medium and equipment based on deep learning | |
| CN106412507A (en) | Intelligent monitoring method and system of personnel flow | |
| CN113125133A (en) | System and method for monitoring state of railway bridge and culvert height limiting protection frame | |
| CN104392201A (en) | Human fall identification method based on omnidirectional visual sense | |
| KR100782205B1 (en) | Apparatus and system for displaying speed of car using image detection | |
| CN111753587B (en) | Ground falling detection method and device | |
| CN105869413A (en) | Method for measuring traffic flow and speed based on camera video | |
| CN103310207B (en) | A kind of vehicle using motor detection method based on many Gauss models | |
| CN116246401A (en) | Monitoring system for community public area management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160106 Termination date: 20190820 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |