CN104683770B - Campus classroom building safety monitoring system and method based on image recognition - Google Patents
Campus classroom building safety monitoring system and method based on image recognition Download PDFInfo
- Publication number
- CN104683770B CN104683770B CN201510105975.5A CN201510105975A CN104683770B CN 104683770 B CN104683770 B CN 104683770B CN 201510105975 A CN201510105975 A CN 201510105975A CN 104683770 B CN104683770 B CN 104683770B
- Authority
- CN
- China
- Prior art keywords
- module
- alarm
- alarm module
- warning device
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Alarm Systems (AREA)
Abstract
The invention discloses a kind of campus classroom building safety monitoring system and method based on image recognition,Including monitoring center module,Remote control module,Video monitoring module,Manual alarm module,Accident alarm module,Alarm module,Transmission network module,Video monitoring module is set in each corridor unit of classroom building,Manual alarm module,Accident alarm module,Alarm module,The number of student of the corridor up and down of real-time statistics,When more than setting value,Automatic alarm module sends a signal to monitoring center module,The alarm signal being connected to is sent to warning device and remote control module by monitoring center module,Warning device carries out sound and light alarm,The student that will or above going downstairs is being reminded,Accident during the manual alarm module of each corridor can allow downstairs carries out manual alarm,So as to cause the attention of student.
Description
Technical field
The present invention relates to campus classroom building safety monitoring system, is taught more particularly, to a kind of campus based on image recognition
Learn building safety monitoring system and method.
Background technology
In recent years, Informatization Construction of Campus is just developed with very surprising speed, and it is to learn that intelligent management is carried out to campus
How the target that school leaders are pursued, further improve Campus Security protective capacities, is put in school administration face
A preceding problem, although safety-protection system has been widely used in campus, the public security prevention and control system in campus is mainly to each
Import and export passage and carry out tight prevention and control, to the disposal ability deficiency of some things suddenly, be especially a lack of to the pre- of security incident
Anti- ability.
Safety-protection system has been widely used in campus, but Campus Security accident or generation again and again.For example, between student
Collision event, upper and lower corridor is crowded kills student's event etc., particularly some potential security incidents, if can be effectively pre-
It is anti-, the generation of security incident will be significantly reduced, especially to student more than second floor, due to close to guardrail, once clash,
Easily occur surprisingly, to clash sometimes, student is squeezed on guardrail, though most of can be prevented in time, is not occurred
Security incident, but due in high level, psychological upper fear easily being caused to individual student, many weak tendency students are being hindered
During evil, often selection is kept silent, and does not inform teacher and school administration actively, and it is surging that this has also further encouraged part
The impetus of student, once oppressive conflict outburst, often consequence is more serious, in order to effectively prevent, it is necessary to find in time
, it is necessary to there is student to alarm the collision event found in time, Surveillance center receives the report for police service signal, is recorded for conflict
And store, and alarm signal is sent into administrative department in time.
Crowded and safety easily generation area occurs for upper and lower corridor, now not only has crowded injury caused by itself, also
Having individual student may take advantage of the occasion to clash, especially when unifying collective activity or going to school and leaving school, when student conflicts while it is in a mess,
That injured is frequently not conflict both sides, but together other students downstairs, particularly schoolgirl, while psychologically will also result in
Certain injury, now need to record associated video in time, allow the individual student heart there are misgivings, so as to prevent the hair of collision event
It is raw, while in order to solve the problems, such as that upper and lower corridor is crowded in time, control the flow of the people of corridor up and down just to seem very necessary.
Safety-protection system can't reach effectively prevention and prevent, particularly in upper and lower corridor and shield in above-mentioned danger zone
Near column, use very inconvenient, be also not suitable for needs of the educational management department to corridor safety management, therefore, be badly in need of one
Set can effectively prevent the safety monitoring system for clashing event and upper and lower corridor congestion event occurred near guardrail, energy
It is enough to create the fine academic environment of a safety to students, for case above, to solve the above problems, special offer is a kind of new
Technical scheme.
The content of the invention
For above-mentioned the shortcomings of the prior art, the purpose of this invention is：A kind of school based on image recognition is provided
Garden classroom building safety monitoring system.Including monitoring center module, remote control module, video monitoring module, manual alarm mould
Block, accident alarm module, alarm module, transmission network module, by monitoring center module by transmission network module and far
Process control module, video monitoring module, manual alarm module, accident alarm module, warning device module organically integrate
Together, form school eduaction administrative department and a kind of new classroom building safety management guarantee body is constructed to campus classroom building
System, ensure safety of the student in classroom building.
To achieve these goals, the technical solution adopted in the present invention is：
A kind of campus classroom building safety monitoring system based on image recognition, including monitoring center module, remote control
Module, video monitoring module, manual alarm module, accident alarm module, alarm module, transmission network module, in monitoring
Core module passes through transmission network module and remote control module, video monitoring module, manual alarm module, accident alarm mould
Block, warning device module are connected, and manual alarm module is connected with alarm module, accident alarm module and video monitoring module
It is connected, video monitoring module includes picture recognition module, display module, automatic alarm module, memory module.
Monitoring center module is used to monitor in real time and management drop loss building, mainly including server, display, network connection
Etc. various hardware devices, for connect the video monitoring module in each corridor, manual alarm module, accident alarm module,
Alarm module and remote control module, the real-time monitoring display to student is realized, when detection alarm signal, record associated video
And sound and light alarm equipment is triggered simultaneously and carries out sound and light alarm.
Remote control module includes video information enquiry module, and remote control is respectively arranged at each management department of school
Door, facilitates school control.Video information enquiry module, the query function interface for being mainly directed towards school administrator's progress, it is convenient
They inquire about the video monitoring situation in special time or place.The mode of inquiry can be that fuzzy query is inquired about with accurate, for
The keyword of inquiry is selected, it is necessary to point to the critical field in video monitoring information.Inquiry mode may be configured as it is single inquiry and
Compound inquiry.
Corridor includes four video monitoring module, manual alarm module, accident alarm module, alarm module moulds
Block.
Video monitoring module connects Surveillance center, including real time image collection module, image storage module, image show mould
Block, image data processing module, automatic alarm module.
Real time video image acquisition module is using ccd video camera and combines Daheng's DH-CG400 video capture cards come real
Analog video image signals are converted into digital video signal and passed by computer PCI interface by the real-time collection of existing scene image
Calculator memory or video memory are transported to, meets real-time collection requirement of the system for video.The system is in Daheng DH-CG400
Image pick-up card carries the secondary development for entering line program on the basis of software kit.DH-CG400 image pick-up cards are to be based on high-performance
The high integration low-power-consumption video image pick-up card of pci bus, the color simulation vision signal gathered by CCD can be passed through collection
Analog-digital converter, proportional zoom, cutting and the color space-variant of card, which the processing such as change and be converted to data image signal, to be sent in computer
Deposit real-time storage, collection transmission without CPU participate in just can steady operation, be not take up CPU time, support adopting in real time for image
Collection.
Image storage module uses storage device of the PC hard disk as video image, and memory module includes accident report
Alert memory block and corridor stream of people memory block, the various data messages of video image in stocking system.
Image display selection computer display is used for the video image of display system, in real time will can collect
The result such as scene video image and detecting and tracking is shown over the display.
Image data processing module by the use of microcomputer as realize student monitor in real time, demographics analysis and automatic
The hardware device of alert process.
The pretreatment module of the software scenario of system including image, student detect identification module, number of student statistical module,
Automatic alarm module.Connect using the application of DH-CG400 Daheng image pick-up card of the Visual C++6.0 softwares based on pci bus
Mouth function carries out secondary development, can will obtain the digital picture changed into by capture card through ccd video camera, realize to reality
When scene video IMAQ to screen, collect the control and processing of internal memory, data transfer.
The pretreatment module of image is the first step of image procossing, and major function is that the conversion of data format can realize letter
Change data, reduce operand, suppress the interference of noise, strengthen some details of image, strengthen the quality of image, ensure that extraction has
The subsequent operation of the characteristics of image of effect.
Student detects the basis that identification module is intelligent monitor system, and a module of most critical, main function
It is to use corresponding human face detection tech, detects the region of variation in scene, splits moving target and background, by using to people
The extraction of the features such as the shape on face and head, barycenter, color histogram, profile identifies student.
Number of student statistical module is on the basis of student is identified, implementation statistics is carried out to the number of student in image,
And corresponding number is shown.
Automatic alarm module is to ensure the efficiency of corridor on and off duty and safety, and setting one is in number in corridor
Maximum, by the number of student of the corridor up and down of real-time statistics compared with maximum, when more than setting value, start automatic
Alarm module, automatic alarm module send a signal to monitoring center module, and monitoring center module sends out the alarm signal being connected to
Give warning device and remote control module, warning device carries out sound and light alarm, and the warning device by corresponding corridor is to will
Or upper student downstairs is reminded, Surveillance center's record associated video.
Manual alarm module includes two switches, and switch includes pressure sensor, be arranged at manual alarm module with it is nearest
Warning device be joined directly together.
Accident alarm module includes two switches, and switch includes pressure sensor, is respectively placed in corridor corner, and
Angle between two switches is 90 °.
Alarm module selection carries out sound and light alarm for sound and light alarm equipment.
After adopting the above technical scheme, the invention has the advantages that compared with the prior art,：
This campus classroom building safety monitoring system is by monitoring center module, remote control module, video monitoring module, hand
Dynamic alarm module, accident alarm module, alarm module, transmission network module organically integrate, and form school's religion
Educate administrative department and a kind of new classroom building safety management security system is constructed to campus classroom building, ensure that student is imparting knowledge to students
The safety in building.Picture recognition module, manual alarm module, automatic alarm module is relied on effectively to solve congested problem downstairs；
Accident alarm module is relied on effectively to solve the safety problem near guardrail.
Brief description of the drawings
Fig. 1 is the block diagram representation of the present invention.
Schematic diagram when Fig. 2 is upper and lower corridor.
Fig. 3 is the schematic diagram near guardrail.
Embodiment
As described below is only presently preferred embodiments of the present invention, is not intended to limit the scope of the present invention.
Embodiment 1, as shown in Figure 1.
A kind of campus classroom building safety monitoring system based on image recognition, it is characterised in that：Including Surveillance center's mould
Block, remote control module, video monitoring module, manual alarm module, accident alarm module, alarm module, transmission network
Module, monitoring center module pass through transmission network module and remote control module, video monitoring module, manual alarm module, meaning
Outer event alarm module, warning device module are connected, and manual alarm module is connected with alarm modules, accident alarm module with
Video monitoring module is connected, and video monitoring module includes picture recognition module, display module, automatic alarm module, memory module.
Monitoring center module is used to monitor in real time and management drop loss building.
Remote control module includes video information enquiry module, and remote control is respectively arranged at each management department of school
Door, facilitates school control.
Video monitoring module 1, manual alarm module 3, accident alarm module 4, alarm modules are set in each corridor
2。
Video monitoring module connects Surveillance center, including real time image collection module, image storage module, image show mould
Block, image data processing module, automatic alarm module.
Video monitoring module 1 carries out real time image collection and statistically descends the number of student of corridor, on and off duty in order to ensure
The efficiency and safety of corridor, determine that a span for being in the maximum of number in corridor is 32- according to the area of corridor
40, by the number of student of the corridor up and down of real-time statistics compared with the span of maximum, when more than maximum, open
Dynamic automatic alarm module, the maximum in the present embodiment are set as 36.
Automatic alarm module sends a signal to monitoring center module.
The alarm signal being connected to is sent to warning device and remote control module by monitoring center module, and warning device 2 enters
Row sound and light alarm, the student that will or above going downstairs is being reminded by the warning device of corresponding corridor, Surveillance center
Record associated video.
When student hears the operation of sound and light alarm equipment, being prepared to enter into the student of upper and lower corridor should stop immediately, wait to alarm
After equipment stops, continuing corridor up and down.
Embodiment 2, as shown in Figure 2.
During upper and lower corridor, when some student is felt not quite the thing suddenly, or video monitoring system is safeguarded, now in order to
Prevent it is crowded cause security incident, student can press manual alarm module 3.
Manual alarm module includes two switches, is respectively arranged at the middle part and bottom of upper and lower corridor.
Switch includes pressure sensor, and the switch of manual alarm module is joined directly together with nearest warning device 2.
When pressing manual alarm module 3, pressure sensor triggers corresponding warning device 2, and warning device 2 carries out acousto-optic
Alarm, while manual alarm is sent to monitoring center module.
Monitoring center module receive the report for police service signal when, record video-unit 1 content.
Embodiment 3, as shown in Figure 3.
When being clashed between student, nearby it can be seen that student can press accident alarm module 4 in time.
Accident alarm module includes two switches, is respectively placed in corridor corner, and the angle between two switches
For 90 °.
The switch of accident alarm module includes pressure sensor.
Angle between two switches is 90 °, and the purpose of this design is no matter to be sent out near upper and lower corridor or guardrail
During raw accident, student worry to catch a packet revenge when, the accident alarm module 4 of opposite side can be selected.
Accident alarm module 4 receives the report for police service signal, sends it to monitoring center module.
Monitoring center module receive the report for police service signal when, while record the content of video-unit 1 and 5.
One video of video-unit 1 and 5 is used for recording accident alarm people, and gives corresponding record.
Another of video-unit 1 and 5 records emergency with video, and gives corresponding record.
Alarm signal is sent to administrative department by monitoring center module, and administrative department is carried out in time to the student clashed
Education.
Described above is only the better embodiment of the present invention, therefore all constructions according to described in present patent application scope,
The equivalent change or modification that feature and principle are done, is included in the range of present patent application.
Claims (9)
1. a kind of campus classroom building safety monitoring system based on image recognition, including monitoring center module, remote control mould
Block, video monitoring module, manual alarm module, accident alarm module, alarm module, transmission network module, its feature exist
In：Video monitoring module, manual alarm module, accident alarm module, alarm module four are set in each corridor unit
Module, video monitoring module, manual alarm module, accident alarm module, warning device module pass through transmission network module
It is connected with monitoring center module, manual alarm module is connected with warning device, and monitoring center module is connected with remote control module,
Video monitoring module include real time image collection module, image storage module, image display, image data processing module,
Automatic alarm module, image data processing module includes the pretreatment module of image, student detects identification module, number of student system
Module, automatic alarm module are counted, by setting a maximum in image data processing module, upper by real-time statistics is gone downstairs
The number of student in road is compared with maximum, when more than maximum, starts automatic alarm module, automatic alarm module will be believed
Number monitoring center module is sent to, the alarm signal being connected to is sent to warning device and remote control mould by monitoring center module
Block, warning device carry out sound and light alarm, and the student that will or above going downstairs is carried out by the warning device of corresponding corridor
Remind, Surveillance center's record associated video；Manual alarm module is joined directly together with nearest warning device, manual alarm module bag
Include two switches, switch include pressure sensor, after manual alarm module starts, alarm signal be sent to simultaneously warning device with
Surveillance center；Accident alarm module includes two switches, is respectively placed in corridor corner, and the angle between two switches is
90°。
2. a kind of campus classroom building safety monitoring system based on image recognition according to claim 1, its feature exist
In：Video image acquisition module uses ccd video camera and Daheng DH-CG400 or Daheng's DH-CG410 video capture cards.
3. a kind of campus classroom building safety monitoring system based on image recognition according to claim 1, its feature exist
In：It is set as 36 according to the maximum that the area of corridor determines.
4. a kind of campus classroom building safety monitoring system based on image recognition according to claim 1, its feature exist
In：Memory module includes accident alarm memory block and corridor stream of people memory block.
5. a kind of campus classroom building safety monitoring system based on image recognition according to claim 1, its feature exist
In：The warning device of alarm module includes acoustic alarm or sound and light alarm.
6. a kind of campus classroom building safety monitoring system based on image recognition according to claim 1, its feature exist
In：Remote control is respectively arranged at each administrative department of school, facilitates school control.
7. a kind of campus classroom building safety monitoring system based on image recognition according to claim 1, its feature exist
In：Remote control includes video information enquiry module, is mainly directed towards the query function interface of school administrator's progress, facilitates him
Inquire about the video monitoring situation in special time or place, the mode of inquiry can be fuzzy query and accurate inquiry, for looking into
, it is necessary to point to the critical field in video monitoring information, inquiry mode may be configured as single inquiry and answer for the keyword selection of inquiry
Formula is inquired about.
8. a kind of method of campus classroom building safety monitoring system based on image recognition according to claim 1, its
It is characterised by：This method is using monitoring center module, remote control module, video monitoring module, manual alarm module, unexpected thing
Part alarm module, alarm module, transmission network module are monitored safely to campus classroom building, are set in each corridor unit
Four video monitoring module, manual alarm module, accident alarm module, alarm module modules, wherein, video monitoring mould
Block, manual alarm module, the signal of accident alarm module are sent to Surveillance center, and Surveillance center sends a signal to alarm
Equipment and remote control module, sound and light alarm is carried out by warning device, by the warning device of corresponding corridor to will or
Upper student downstairs is reminded, and video monitoring module includes real time image collection module, image storage module, image and shown
Show module, image data processing module, automatic alarm module, image data processing module includes the pretreatment module of image, learned
Biopsy surveys identification module, number of student statistical module, automatic alarm module, by setting one in image data processing module
Maximum, by the number of student of the corridor up and down of real-time statistics compared with maximum, when more than setting value, start automatic
Alarm module, automatic alarm module send a signal to monitoring center module, and monitoring center module sends out the alarm signal being connected to
Give warning device and remote control module, warning device carries out sound and light alarm, and the warning device by corresponding corridor is to will
Or upper student downstairs is reminded, Surveillance center's record associated video.
9. a kind of method of campus classroom building safety monitoring system based on image recognition according to claim 8, its
It is characterised by：Manual alarm module is connected with alarm module, and after manual alarm module starts, alarm signal is sent in monitoring
The heart, while start warning device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510105975.5A CN104683770B (en) | 2015-03-12 | 2015-03-12 | Campus classroom building safety monitoring system and method based on image recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510105975.5A CN104683770B (en) | 2015-03-12 | 2015-03-12 | Campus classroom building safety monitoring system and method based on image recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104683770A CN104683770A (en) | 2015-06-03 |
| CN104683770B true CN104683770B (en) | 2018-01-12 |
Family
ID=53318261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510105975.5A Expired - Fee Related CN104683770B (en) | 2015-03-12 | 2015-03-12 | Campus classroom building safety monitoring system and method based on image recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104683770B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105528858B (en) * | 2016-01-27 | 2018-03-20 | 温州职业技术学院 | Multi-functional self-defense emergency warning system |
| CN107439009A (en) * | 2017-02-13 | 2017-12-05 | 深圳市欸阿技术有限公司 | Multizone safety defense monitoring system, device and method |
| CN107370985A (en) * | 2017-05-25 | 2017-11-21 | 中建钢构有限公司 | Pedestrian's dynamic display method and system |
| CN108509852A (en) * | 2018-03-02 | 2018-09-07 | 刘峰 | A kind of good warehouse monitoring system of monitoring effect |
| CN111368749B (en) * | 2020-03-06 | 2023-06-13 | 创新奇智(广州)科技有限公司 | Automatic identification method and system for stair area |
| CN113537166B (en) * | 2021-09-15 | 2021-12-14 | 北京科技大学 | Alarm method, alarm device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008148138A (en) * | 2006-12-12 | 2008-06-26 | Hitachi Kokusai Electric Inc | Monitoring system |
| CN201467360U (en) * | 2009-06-12 | 2010-05-12 | 上海新联纬讯科技发展有限公司 | Detection system for exhibitting field personnel flow rate |
| CN103325209A (en) * | 2013-07-09 | 2013-09-25 | 綦涛 | Intelligent security alarm system based on wireless |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110261202A1 (en) * | 2010-04-22 | 2011-10-27 | Boris Goldstein | Method and System for an Integrated Safe City Environment including E-City Support |
| CN104349127A (en) * | 2013-08-05 | 2015-02-11 | 郑州学生宝电子科技有限公司 | Campus intelligent video monitoring system |
-
2015
- 2015-03-12 CN CN201510105975.5A patent/CN104683770B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008148138A (en) * | 2006-12-12 | 2008-06-26 | Hitachi Kokusai Electric Inc | Monitoring system |
| CN201467360U (en) * | 2009-06-12 | 2010-05-12 | 上海新联纬讯科技发展有限公司 | Detection system for exhibitting field personnel flow rate |
| CN103325209A (en) * | 2013-07-09 | 2013-09-25 | 綦涛 | Intelligent security alarm system based on wireless |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104683770A (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104683770B (en) | Campus classroom building safety monitoring system and method based on image recognition | |
| CN210955266U (en) | Internet of things temperature-sensing height and identification integrated machine | |
| CN107134112B (en) | A kind of multi-faceted safety defense monitoring system for campus | |
| DE60204292T2 (en) | AUTOMATIC MONITORING SYSTEM FOR A PATIENT AND HOSPITAL | |
| CN108830226A (en) | Intelligent campus system based on Internet of Things | |
| CN104464406A (en) | Real-time interactive online learning platform | |
| CN102013176A (en) | Online learning system | |
| CN105516652B (en) | A kind of intelligent campus street lamp illumination system | |
| CN204578662U (en) | Based on the campus classroom building safety monitoring system of image recognition | |
| CN107590953B (en) | Alarm method and system of intelligent wearable device and terminal device | |
| CN112542027A (en) | Construction site personnel safety warning system based on image recognition | |
| CN205354056U (en) | Law enforcement record appearance with face identification | |
| CN106485819A (en) | A kind of intelligent Dormitory management system | |
| CN108846914A (en) | A kind of student classroom attendance checking system based on cloud platform | |
| CN112528732A (en) | Smart campus supervision method, system and equipment based on smart box | |
| CN113971868A (en) | Alarm method and system based on infant behavior statistics | |
| CN203324805U (en) | Intelligent driving school supervision system | |
| CN206331450U (en) | A kind of robot face identification system | |
| CN112488888A (en) | Wisdom campus safety early warning system based on thing networking and big data technology | |
| CN108492231A (en) | The monitoring system of class efficacy information based on students ' behavior data | |
| CN106327646A (en) | Campus security system based on wireless technology | |
| CN204614156U (en) | A kind of campus classroom building manual alarm device | |
| KR100926580B1 (en) | System of crime prevention for children and operating method thereof | |
| CN111583074A (en) | Campus security management system and method | |
| CN204614157U (en) | A kind of campus classroom building autoalarm |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Shen Tao Inventor before: Yang Ming |
|
| CB03 | Change of inventor or designer information | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20171214 Address after: 100032 Xicheng District Exhibition Road, Xicheng District, Beijing Applicant after: Beijing University of Civil Engineering and Architecture Address before: 236800 city of Bozhou province Anhui District Road No. 2266 South Tang Wang Bozhou Teachers College Applicant before: Yang Ming |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180112 Termination date: 20200312 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |