CN103505224B - Fatigue driving remote monitoring and alarm system and method based on physiological information analysis - Google Patents
Fatigue driving remote monitoring and alarm system and method based on physiological information analysis Download PDFInfo
- Publication number
- CN103505224B CN103505224B CN201210216206.9A CN201210216206A CN103505224B CN 103505224 B CN103505224 B CN 103505224B CN 201210216206 A CN201210216206 A CN 201210216206A CN 103505224 B CN103505224 B CN 103505224B
- Authority
- CN
- China
- Prior art keywords
- driver
- fatigue
- slave computer
- eeg signals
- brain wave
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The invention discloses a fatigue driving remote monitoring and alarm system and method based on physiological information analysis. The system comprises a brain wave collecting device, an upper computer and a lower computer, the system further comprises a cell phone module, the input end of the brain wave collecting device is connected with the cerebral cortex of a driver, the output end of the brain wave collecting device transmits brain wave signals to the upper computer, the upper computer outputs fatigue signals to the lower computer, and the lower computer outputs alarm signals to the cell phone module. Driver monitor personnel can inquire the driving state of the driver in real time through the cell phone module, and the driver is reminded to prevent fatigue driving in time. When the driver is in a fatigue driving state, the system can analyze the brain wave signals and give an alarm in time, if the driver still drives a car, the lower computer controls the cell phone module to send alarm information to the cell phone of the monitor personnel, and therefore the capacity of detecting and early warning the driver fatigue driving is improved.
Description
Technical field
The invention belongs to the crossing domain of biomedical engineering and Mechatronic Engineering, be specifically related to a kind of fatigue driving remote monitoring of analyzing based on physiologic information and warning system and method.
Background technology
In China, due to the shortcoming of automotive safety consciousness, fatigue driving, drive over the speed limit, the phenomenon such as to drive when intoxicated is very outstanding, becomes the major reason causing major traffic accidents, wherein, annual because the death toll that fatigue driving causes is all thousands of people.Abroad, situation is also very severe, and National sleep foundation is delivered press release on November 4th, 2009 and said, and the whole nation is annual causes nearly 2,000,000 traffic accidents because of fatigue driving.National police general administration of France accident report shows, because the accident that driving fatigue causes accounts for 14.9% of personal injury accident, and 20.6% of death by accident.According to AA Automobile Association's statistics, Britain has the vehicle accident of 1/10th to be drive due to tired driver and cause every year; Statistics from German federal road traffic department shows, and just having in every five vehicle accidents of Germany is that the loss that this type of vehicle accident causes is every year up to 5,000,000,000 Euros because fatigue driving causes together.In recent years, due to the development of computer vision and integrated circuit technique, space has been widened in the research detected to driving fatigue, makes it to enter gold period.Here is some achievements in research abroad obtained fatigue detecting.
Attention Technologies company of the U.S. develops Driver Fatigue Monitor (DD850) fatigue detecting early warning system, mainly go to gather driver's eyes information by infrared camera, then utilize PERCLOS criterion to carry out fatigue to judge, finally play the object of early warning.This device by the limitation in driver driving orientation, when driver in position time could normally detect.
According to French media report, Timeliness coverage driver occurs that key that is tired and sleepiness captures the state that its eyelid stops opening and closing.For this reason, Renault has succeeded in developing a kind of infrared facility in 5 years consuming time.This device needs to be arranged on vehicle front, with the eyes of driver directly to looking.When driver's eyelid stops opening and closing, when namely there is tired meaning, infrared facility can give the alarm immediately, and driver is waken up with a start, and continues to keep normal driving.The shortcoming of this device is: more late to driver fatigue early warning, and by the time when driver's eyes stopping opening and closing, belong to sleep period, this is quite unfavorable to driving, and in order to driver safety is driven, must accomplish to give warning in advance.
In addition, the achievement more than related to all cannot realize the function that driver tired driving remote alarms and driving condition are inquired about.
Summary of the invention
For the deficiencies in the prior art, the present invention proposes a kind of fatigue driving remote monitoring of analyzing based on physiologic information and warning system and method, to reach quick Real-Time Monitoring, remote alarms and inquiry, comparatively early to detect driver fatigue state, improve the object detecting pre-alerting ability.
A kind of fatigue driving remote monitoring based on physiologic information analysis and warning system, this system comprises brain wave acquisition device, host computer and slave computer, this system also comprises mobile module, wherein, brain wave acquisition device input connects the cerebral cortex of driver, brain wave acquisition device outfan transmission EEG signals is to host computer, host computer processes collection EEG signals and extracts α band signal, export corresponding driver status data to slave computer according to α band signal excursion, slave computer output alarm signal is to mobile module.
Adopt the method for carrying out remote monitoring and warning based on the fatigue driving remote monitoring of physiologic information analysis and warning system, comprise step as follows:
Step 1, the EEG signals of brain wave acquisition device Real-time Collection driver when driving;
Step 2, host computer process collection driver EEG signals, and driver status data are issued slave computer;
Step 2-1, to gather driver's EEG signals carry out wavelet transformation and extract EEG signals;
Step 2-2, to process after EEG signals in 8 ~ 13Hz α band signal extract;
Step 2-3 also judges the amplitude of variation of α band signal in EEG signals, when the change of α band signal amplitude is in 6% ~ 15% scope, confirms as and occurs driving tired symptom, and output state data are to slave computer and return and perform step 2-1;
Step 2-4, when α band signal amplitude change in 16% ~ 25% scope time, confirm as occur serious driving fatigue symptom, output state data to slave computer and return perform step 2-1;
Step 2-5, when the change of α band signal amplitude is less than 6%, confirms as driver and can normally to drive state, output state data are to slave computer and return and perform step 2-1.
Step 3, slave computer carry out the classification of normal driving, slight fatigue and major fatigue to driver condition according to status data, and send corresponding short message to driver monitor staff hands machine according to alarm device and mobile module in different status datas control car;
Step 3-1, reception host computer send data;
Step 3-2, judge to receive driver status data in slave computer, if drive tired symptom, then control alarm device in car;
If the serious driving fatigue symptom of step 3-3, then control alarm device in car and perform step 3-5;
The state if step 3-4 normally drives, then return and perform step 3-1;
Step 3-5, mobile module send SMS alarm to driver monitor staff.
Adopt and carry out the method for inquiring about based on the fatigue driving remote monitoring of physiologic information analysis and warning system, comprise step as follows:
Step 1, mobile module real-time judge, with or without detection Query Information, if having, then perform step 2, if nothing, then return and perform step 1;
Step 2, send query statement by slave computer to host computer;
Driver state is sent to slave computer by step 3, host computer;
Signal is sent to mobile module by step 4, slave computer, and mobile module sends note to driver monitor staff mobile phone.
Advantage of the present invention:
Fatigue driving remote monitoring and warning system that the present invention is a kind of to be analyzed based on physiologic information and method, utilize mobile module can make the state of driving of driver monitor staff real-time query driver, prompting in time preventing driver tired driving; When driver is in fatigue driving state, the present invention can by analyzing EEG signals and alarm, if driver still adheres to driving, slave computer sends warning message to monitor staff's mobile phone by controlling mobile module, thus improves the detection pre-alerting ability of driver tired driving.
Accompanying drawing explanation
Fig. 1 is an embodiment of the present invention apparatus structure block diagram;
Fig. 2 is the Electrode connection schematic diagram of an embodiment of the present invention brain wave acquisition device;
Fig. 3 is an embodiment of the present invention remote monitoring and alarm portion circuit theory diagrams;
Fig. 4 is an embodiment of the present invention Chip Microcomputer A workflow diagram;
Fig. 5 is an embodiment of the present invention single-chip microcomputer B workflow diagram;
Fig. 6 fatigue driving monitoring that to be an embodiment of the present invention analyze based on physiologic information and alarm flow figure;
Fig. 7 is an embodiment of the present invention host computer flow chart of data processing figure;
Fig. 8 is an embodiment of the present invention brain α ripple active degree schematic diagram;
Wherein: A) be brain α ripple active degree schematic diagram under normal condition; B) be brain α ripple active degree schematic diagram under fatigue driving state;
Fig. 9 is an embodiment of the present invention slave computer warning function flow chart;
Figure 10 is an embodiment of the present invention driver status querying flow figure.
Detailed description of the invention
Below in conjunction with accompanying drawing, embodiments of the invention are described further.
Fig. 1 is an embodiment of the present invention apparatus structure block diagram, this device comprises brain wave acquisition device, host computer and slave computer, this system also comprises mobile module, wherein, brain wave acquisition device input connects the cerebral cortex of driver, brain wave acquisition device outfan transmission EEG signals is to host computer, and host computer exports tired signal to slave computer, and slave computer output alarm signal is to mobile module.In the embodiment of the present invention, brain wave acquisition device adopts the brain-computer interface BCI-II brain wave acquisition equipment of Northeastern University's bioelectronics laboratory design, host computer adopts PC, and slave computer adopts two STC89C52 model single-chip microcomputers, and mobile phone remote communication module adopts TC35 type mobile module.As shown in Figure 2, brain wave acquisition device is by six Electrode connection human brain Fp1, Fp2, P3, P4, Fz, Pz positions, and brain wave acquisition device is connected with PC by USB port in addition, and PC nine needles serial port connects the nine needles serial port of slave computer Chip Microcomputer A.
Fig. 3 is an embodiment of the present invention remote monitoring warning and query portion circuit theory diagrams.Comprise slave computer (STC89C52 model Chip Microcomputer A, STC89C52 model single-chip microcomputer B) and mobile module TC35.
Driver status monitoring, alarming functional realiey: host computer is by serial ports DB9(nine needles serial port) data are passed to slave computer Chip Microcomputer A DB9 serial port (nine needles serial port), after Chip Microcomputer A is classified to data, alarm signal is sent to single-chip microcomputer B, P00, P01, P02, P03 pin of Chip Microcomputer A connects P10, P11, P12, P13 pin of single-chip microcomputer B respectively.After single-chip microcomputer B receives signal, call short message sending program, control mobile module TC35 and send note, thus realize warning function, wherein P20, RXD, TXD pin of single-chip microcomputer B connects IGT, TxD0, RxD0 pin of mobile module TC35.
In the embodiment of the present invention, Chip Microcomputer A is by serial ports DB9(nine needles serial port) receive the data that host computer sends; As shown in Figure 4, after Chip Microcomputer A receives data, judge whether the P00 pin of Chip Microcomputer A sets to 0, if set to 0, query statement is issued host computer by Chip Microcomputer A, status data is issued Chip Microcomputer A according to driver's EEG signals by host computer, and status data is classified by Chip Microcomputer A; If do not set to 0, Chip Microcomputer A directly judges to accept data, and carries out status data classification.Adopt hexadecimal " 0X01 ", " 0X02 ", " 0X03 " code as data command in the present embodiment, driver condition is carried out to the classification of normal driving, slight fatigue and major fatigue, if equal hexadecimal " 0X01 " code, Chip Microcomputer A pin P01 sets to 0, control internal loudspeaker is reported to the police, Chip Microcomputer A will set to 0 signal and is sent to the P11 pin of single-chip microcomputer B, time delay after 1 second P00, P01, P02, P03 pin of Chip Microcomputer A put 1; If equal hexadecimal " 0X02 " code, Chip Microcomputer A pin P02 sets to 0, and simultaneously internal loudspeaker is reported to the police, and Chip Microcomputer A will set to 0 signal and is sent to the P12 pin of single-chip microcomputer B, time delay after 1 second P00, P01, P02, P03 pin of Chip Microcomputer A put 1; If data equal hexadecimal " 0X03 " code, then Chip Microcomputer A pin P03 sets to 0, and Chip Microcomputer A will set to 0 signal and is sent to the P13 pin of single-chip microcomputer B, time delay after 1 second P00, P01, P02, P03 pin of Chip Microcomputer A put 1;
As shown in Figure 5, after single-chip microcomputer B receives the data of Chip Microcomputer A transmission, because driver's major fatigue alarm priority is higher than the priority of query function, therefore first single-chip microcomputer B judges whether P12 pin sets to 0, if set to 0, single-chip microcomputer B sends a signal to mobile module TC35 by pin P20, and mobile module TC35 sends " major fatigue " warning message to driver monitor staff mobile phone; If P12 pin does not set to 0, then judge that mobile module TC35 receives Query Information, if receive short message enquiry, then pin P10 is set to 0 (time delay puts 1 in 1 second) and is passed to the P00 pin of Chip Microcomputer A by single-chip microcomputer B, query statement is issued host computer by Chip Microcomputer A, status data is issued Chip Microcomputer A according to driver's EEG signals by host computer, status data is classified by Chip Microcomputer A, and status data is issued single-chip microcomputer B, if the P12 pin of single-chip microcomputer B sets to 0, control mobile module TC35 and send " major fatigue " information to driver monitor staff mobile phone; If the P11 pin of single-chip microcomputer B sets to 0, control mobile module TC35 and send " slightly tired " information to driver monitor staff hands machine; If the P13 pin of single-chip microcomputer B sets to 0, control mobile module TC35 and send " normal driving " information to driver monitor staff mobile phone.
Adopt the method for carrying out remote monitoring and warning based on the fatigue driving remote monitoring of physiologic information analysis and warning system, as shown in Figure 6, comprise step as follows:
Step 1, the EEG signals of brain wave acquisition device Real-time Collection driver when driving;
As shown in Figure 2, brain-computer interface BCI-II brain wave acquisition equipment is by six Electrode connection human brain Fp1, Fp2, P3, P4, Fz, Pz positions for the wearing mode of brain wave acquisition device;
Step 2, host computer process collection driver EEG signals, and driver status data are issued slave computer;
As shown in Figure 7, step is comprised as follows:
Step 2-1, to gather driver's EEG signals carry out wavelet transformation and extract EEG signals;
Step 2-2, to process after EEG signals in 8 ~ 13Hz α band signal (namely referring to the EEG signals of frequency at 8 ~ 13Hz) extract;
Time tired the occipitalia (brain electrode P3, P4 position) of human brain EEG signals in α ripple have a declining tendency, the α ripple simultaneously in the EEG signals of the forehead (brain electrode Fp1, Fp2 position) of brain has the trend of rising, as shown in Figure 8.
Step 2-3 also judges the amplitude of variation of α band signal in EEG signals, when the change of α band signal amplitude is in 6% ~ 15% scope, confirm as and occur driving tired symptom, host computer outputting ten senary " 0X01 " code to slave computer, and returns execution step 2-1;
Step 2-4, when α band signal amplitude change in 16% ~ 25% scope time, confirm as occur serious driving fatigue symptom, host computer outputting ten senary " 0X02 " code to slave computer, and return perform step 2-1;
Step 2-5, when the change of α band signal amplitude is less than 6%, confirms as driver and can normally to drive state, host computer outputting ten senary " 0X03 " code to slave computer, and returns and performs step 2-1.
Step 3, slave computer carry out the classification of normal driving, slight fatigue and major fatigue to driver condition according to status data, and send corresponding short message to driver monitor staff hands machine according to alarm device and mobile module in different status datas control car;
As shown in Figure 9, step is comprised as follows:
Step 3-1, reception host computer send data;
Step 3-2, judge to receive driver status data in slave computer, if drive tired symptom, namely Received signal strength is hexadecimal " 0X01 " code, then control alarm device in car;
If the serious driving fatigue symptom of step 3-3, namely Received signal strength is hexadecimal " 0X02 " code, then control alarm device in car and perform 3-5;
The state if step 3-4 normally drives, namely Received signal strength is hexadecimal " 0X03 " code, then return and perform step 3-1;
Step 3-5, mobile module send SMS alarm to driver monitor staff.
Adopt and carry out the method for inquiring about based on the fatigue driving remote monitoring of physiologic information analysis and warning system, as shown in Figure 10, comprise step as follows:
Step 1, mobile module real-time judge, with or without detection Query Information, if having, then perform step 2, if nothing, then return and perform step 1;
Step 2, send query statement by slave computer to host computer;
Driver state is sent to slave computer by step 3, host computer;
Signal is sent to mobile module by step 4, slave computer, and mobile module sends note to driver monitor staff mobile phone.
Claims (1)
1. the fatigue driving remote monitoring based on physiologic information analysis and alarm method, the method adopts the fatigue driving remote monitoring and warning system analyzed based on physiologic information, this system comprises brain wave acquisition device, host computer and slave computer, this system also comprises mobile module, wherein, brain wave acquisition device input connects the cerebral cortex of driver, brain wave acquisition device outfan transmission EEG signals is to host computer, host computer processes collection EEG signals and extracts α band signal, corresponding driver status data are exported to slave computer according to α band signal excursion, slave computer output alarm signal is to mobile module, it is characterized in that: it is as follows that method comprises step:
Step 1, the EEG signals of brain wave acquisition device Real-time Collection driver when driving;
Step 2, host computer process collection driver EEG signals, and driver status data are issued slave computer;
Step 2-1, to gather driver's EEG signals carry out wavelet transformation and extract EEG signals;
Step 2-2, to process after EEG signals in 8 ~ 13Hz α band signal extract;
Step 2-3 also judges the amplitude of variation of α band signal in EEG signals, when the change of α band signal amplitude is in 6% ~ 15% scope, confirms as and occurs driving tired symptom, and output state data are to slave computer and return and perform step 2-1;
Step 2-4, when α band signal amplitude change in 16% ~ 25% scope time, confirm as occur serious driving fatigue symptom, output state data to slave computer and return perform step 2-1;
Step 2-5, when the change of α band signal amplitude is less than 6%, confirms as driver and can normally to drive state, output state data are to slave computer and return and perform step 2-1.
Step 3, slave computer carry out the classification of normal driving, slight fatigue and major fatigue to driver condition according to status data, and send corresponding short message to driver monitor staff hands machine according to alarm device and mobile module in different status datas control car;
Step 3-1, reception host computer send data;
Step 3-2, judge to receive driver status data in slave computer, if drive tired symptom, then control alarm device in car;
If the serious driving fatigue symptom of step 3-3, then control alarm device in car and perform step 3-5;
The state if step 3-4 normally drives, then return and perform step 3-1;
Step 3-5, mobile module send SMS alarm to driver monitor staff.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210216206.9A CN103505224B (en) | 2012-06-27 | 2012-06-27 | Fatigue driving remote monitoring and alarm system and method based on physiological information analysis |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210216206.9A CN103505224B (en) | 2012-06-27 | 2012-06-27 | Fatigue driving remote monitoring and alarm system and method based on physiological information analysis |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103505224A CN103505224A (en) | 2014-01-15 |
CN103505224B true CN103505224B (en) | 2015-01-07 |
Family
ID=49889040
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210216206.9A Expired - Fee Related CN103505224B (en) | 2012-06-27 | 2012-06-27 | Fatigue driving remote monitoring and alarm system and method based on physiological information analysis |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103505224B (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104173047B (en) * | 2014-08-13 | 2017-02-01 | 中国科学院昆明动物研究所 | Networked behavior electrophysiological experiment system through collaboration of multiple computers |
CN105286891A (en) * | 2015-11-17 | 2016-02-03 | 南京信息工程大学 | Method for fatigue detection and processing based on perception aspect in Internet of vehicle |
CN105701973A (en) * | 2016-04-26 | 2016-06-22 | 成都远控科技有限公司 | Fatigue detection and early warning method based on brain wave acquisition and system thereof |
CN108498092B (en) * | 2017-02-28 | 2021-09-14 | 中国航天员科研训练中心 | Error early warning method and system based on electroencephalogram characteristics |
CN107458382B (en) | 2017-08-22 | 2019-09-10 | 京东方科技集团股份有限公司 | Controller of vehicle, control method and head-up display |
CN112450933B (en) * | 2020-11-10 | 2022-09-20 | 东北电力大学 | Driving fatigue monitoring method based on multiple types of characteristics of human body |
CN112451833A (en) * | 2020-11-10 | 2021-03-09 | 东北电力大学 | System and method for detecting and relieving driving fatigue based on personalized music recommender |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103111020A (en) * | 2013-02-04 | 2013-05-22 | 东北大学 | System and method for detecting and relieving driving fatigue based on electrical acupoint stimulation |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU767533B2 (en) * | 1999-01-27 | 2003-11-13 | Compumedics Limited | Vigilance monitoring system |
CN2891967Y (en) * | 2006-04-21 | 2007-04-25 | 北京易飞华通科技开发有限公司 | Driver's fatigue driving monitoring and feedback stimulating instrument |
JP2012000280A (en) * | 2010-06-17 | 2012-01-05 | Panasonic Corp | Brain wave estimating device, brain wave estimation method and program |
CN102274032A (en) * | 2011-05-10 | 2011-12-14 | 北京师范大学 | Driver fatigue detection system based on electroencephalographic (EEG) signals |
-
2012
- 2012-06-27 CN CN201210216206.9A patent/CN103505224B/en not_active Expired - Fee Related
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103111020A (en) * | 2013-02-04 | 2013-05-22 | 东北大学 | System and method for detecting and relieving driving fatigue based on electrical acupoint stimulation |
Non-Patent Citations (2)
Title |
---|
基于脑电α波的非线性参数人体疲劳状态判定;王黎等;《东北大学学报(自然科学版)》;20051228;第26卷(第12期);1174-1177 * |
疲劳驾驶的脑电特性探索;彭军强等;《北京理工大学学报》;20070715;第27卷(第07期);585-589 * |
Also Published As
Publication number | Publication date |
---|---|
CN103505224A (en) | 2014-01-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103505224B (en) | Fatigue driving remote monitoring and alarm system and method based on physiological information analysis | |
CN103111020B (en) | System and method for detecting and relieving driving fatigue based on electrical acupoint stimulation | |
CN202383802U (en) | Acousto-optic warning system for truck fatigue driving | |
CN105615878B (en) | A kind of fatigue driving eeg monitoring method | |
CN103021134A (en) | Monitoring and alarm device for fatigue driving of automobile | |
CN203759832U (en) | Fatigue driving monitoring and alarm device | |
CN201955874U (en) | Fatigue driving early warning system | |
CN109703658A (en) | A kind of electric vehicle drives number of people helmet wearable system and its detection theft preventing method | |
CN105869356A (en) | Railway driver work state evaluation intervening system and method | |
CN103198617A (en) | Fatigue driving warning system | |
CN103932719A (en) | Fatigue driving detecting technology | |
CN108937923A (en) | A kind of real-time driving fatigue monitoring system based on EEG signals, electro-ocular signal and electromyography signal | |
CN106205048A (en) | Stupor automatic alarm system based on brain-computer interface and alarm method | |
CN102568158A (en) | Alarming system for automobile vehicle fatigue driving | |
CN203149771U (en) | A fatigue driving caution system | |
CN114652532B (en) | Multifunctional brain-controlled wheelchair system based on SSVEP and attention detection | |
CN202960535U (en) | Automobile fatigue driving monitoring alarm device | |
CN102006130A (en) | Anti-interference alarm for vehicles | |
CN104013394A (en) | Device for monitoring individual state of personnel working aloft in electric power engineering | |
CN205144578U (en) | Tired guardianship massage appearance of wear -type brain electricity | |
CN103871197A (en) | Intelligent sensing wrist strap | |
CN101667025B (en) | Real-time monitoring circuit aiming to carrier device | |
CN206333439U (en) | A kind of crash helmet security monitoring system | |
CN213035887U (en) | Intelligent steering wheel for drunk driving and fatigue driving detection | |
CN206639358U (en) | A kind of drowsy driving warning system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150107 Termination date: 20150627 |
|
EXPY | Termination of patent right or utility model |