CN102780872A - Device monitoring server and device monitoring system - Google Patents

Device monitoring server and device monitoring system Download PDF

Info

Publication number
CN102780872A
CN102780872A CN2011101295961A CN201110129596A CN102780872A CN 102780872 A CN102780872 A CN 102780872A CN 2011101295961 A CN2011101295961 A CN 2011101295961A CN 201110129596 A CN201110129596 A CN 201110129596A CN 102780872 A CN102780872 A CN 102780872A
Authority
CN
China
Prior art keywords
financial transaction
information
abnormality detection
image information
situation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011101295961A
Other languages
Chinese (zh)
Other versions
CN102780872B (en
Inventor
吉内英也
朱鹏
青木毅
小菅佳克
董远
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi China Research and Development Corp
Original Assignee
Hitachi China Research and Development Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi China Research and Development Corp filed Critical Hitachi China Research and Development Corp
Priority to CN201110129596.1A priority Critical patent/CN102780872B/en
Publication of CN102780872A publication Critical patent/CN102780872A/en
Application granted granted Critical
Publication of CN102780872B publication Critical patent/CN102780872B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention aims at providing device monitoring considering event correlation among a plurality of strong points. A device monitoring system comprises monitoring object devices and video monitoring terminals, which are dispersed and arranged at the plurality of the strong points, as well as a device monitoring server for monitoring the monitoring object devices and the video monitoring terminals, wherein the device monitoring server is used for receiving a plurality of event notices which are performed by sensors and video cameras from the monitoring object devices and the video monitoring terminals, and determining the range and the control content of the monitoring object devices to be controlled according to the correlation among a plurality of events.

Description

Device monitor server and equipment monitor system
Technical field
The present invention relates to a kind of device monitor server, relate in particular to (Automated Teller Machine: ATM) be the improvement of the device monitor server of object with ATM.
Background technology
In recent years, ATM because of card surreptitiously read to cause be injured and increase.Financial institution utilizes surveillance camera, various transducer to construct the ATM surveillance that the devious conduct to ATM detects.For example; Following technology has been proposed; Promptly; Through video camera card insert opening is kept watch on, and come technology (patent documentation 1) that the installation to suspicious item detects and through the infrared mode irradiation unit, the technology (patent documentation 2) that the setting of color or the shape improper equipment identical with existing ATM is detected based on the difference information of image.In addition, disclose in the patent documentation 3:, the video of surveillance camera is technological to the telemonitoring that central monitoring position sends via network for the device that is dispersed in a plurality of strong points is kept watch in the lump.
Patent documentation 1:JP spy opens the 2007-280317 communique
Patent documentation 2:JP spy opens the 2008-97064 communique
Patent documentation 3:JP spy opens the 2005-25533 communique
About the crime of ATM, a most common method that is employed is that the device of surreptitiously reading usefulness is installed.The equipment of surreptitiously reading for example has with card insert opening and has identical shaped magnetic card reading machine or miniature camera etc., and still, these surreptitiously read equipment is to need the people directly to arrive the place at object ATM place, and be provided with through handwork.Because surreptitiously reading equipment itself is small-sized and the equipment of easy carrying; So, can think:, be in specific zone as the typical actions of surreptitiously reading the criminal; A plurality of ATM to relative neighbor positions exists move so that more equipment to be set as much as possible between the strong point.But in the existing ATM surveillance, monitored object only limits to single ATM device, or single strong point, can not tackle the action of above-mentioned that kind.Even at the Long-Range Surveillance System that a plurality of strong points are kept watch on, also inquire into research phenomenon foundation association that has taken place and the method for analyzing are located in each strong point, thereby become a reason of supervision inefficiency.
Summary of the invention
For addressing the above problem, device monitor server of the present invention carries out the packetizing management to the device of monitored object.Each monitored object device possesses a plurality of event detection unit; Detect under the situation of incident at a certain monitored object device; Said device monitor server carries out record to the kind of event, to other the monitored object device notice and the relevant information of event in dividing into groups.Other the function of the monitored object device pair event detection unit corresponding with incident that receives event information is strengthened, and deals with suspicious figure's arrival.
Device monitor server of the present invention is connected via network and a plurality of financial transaction devices and video monitor terminal that said a plurality of financial transaction devices are kept watch on; Said device monitor server is characterised in that; Possess: acceptance division, it receives the detected abnormality detection information of the abnormal detector that possessed by said financial transaction device via said network and from the image information at said video monitor terminal; Storage device, it stores said abnormality detection information and said image information that said acceptance division receives; Control part; It is analyzed said abnormality detection information and said image information; Wherein, store the grouping information that said a plurality of financial transaction devices are divided into groups in the said storage device, said control part; Based on said abnormality detection information; One in the contained a plurality of financial transaction devices of said grouping information detects under the situation about having taken place unusually, with the image information of said financial transaction device having been carried out when this unusual generation the operator of operation in the said image information, sends to other the financial transaction device in the contained a plurality of financial transaction devices of said grouping information.
In addition; Device monitor server of the present invention is connected via network and a plurality of financial transaction devices and video monitor terminal that said a plurality of financial transaction devices are kept watch on; Said device monitor server is characterised in that; Possess: acceptance division, it receives the detected abnormality detection information of the abnormal detector that possessed by said financial transaction device via said network and from the image information at said video monitor terminal; Storage device, it stores said abnormality detection information and said image information that said acceptance division receives; Control part; It is analyzed said abnormality detection information and said image information; Wherein, store the grouping information that said a plurality of financial transaction devices are divided into groups in the said storage device, said control part; Under the situation that receives a plurality of said abnormality detection information; Relevance between these a plurality of abnormality detection information judges, and being judged as when having relevance, sends image information request to the video monitor terminal that the financial transaction device that has sent said abnormality detection information is kept watch on.
(effect of invention)
Therefore, the present invention can predict the action that the suspicious figure taked in advance, carries out high-precision event detection, and then can improve the supervision efficient of system.
Description of drawings
Fig. 1 is the network figure of the equipment monitor system of an execution mode of the present invention.
Fig. 2 is the functional-block diagram of device monitor server.
Fig. 3 is the functional-block diagram at video monitor terminal.
Fig. 4 is the functional-block diagram of monitored object device.
Fig. 5 has been functional-block diagram example, the monitored object device of the concrete transducer in the device.
Fig. 6 is the sequence chart that is used to explain the event detection that the operation information based on video camera and device carries out.
Fig. 7 is used to explain whole monitored object devices are kept watch on the sequence chart of handling as the device of controlling object.
Fig. 8 only is used to explain that the monitored object device that incident has been taken place keeps watch on the sequence chart of handling as the device of controlling object.
Fig. 9 is used to explain the sequence chart of device monitor server to the processing of monitored object device requests image information.
Figure 10 is the process chart of device monitor server.
Figure 11 is the process chart at video monitor terminal.
Figure 12 is the process chart of monitored object device.
Figure 13 is the list of data packet format.
Figure 14 is the key diagram of the concrete example of the warning information database after receiving event notice from a strong point.
Figure 15 is the key diagram of the concrete example of the warning information database after receiving event notice from two strong points.
Figure 16 is the key diagram of the concrete example of the warning information database after the whole device reception incidents in divide into groups are accomplished.
Figure 17 is the key diagram of the concrete example of the warning information database after the whole device reception incidents in divide into groups are accomplished.
(drawing reference numeral explanation)
1 device monitor server
2 video monitor terminals
3 monitored object devices
4 networks
Embodiment
Below, based on accompanying drawing an execution mode of the present invention is described.
Fig. 1 is that expression has been suitable for an example of system of the present invention, by device monitor server 1, a plurality of video monitors terminal (2-1~2-N) and a plurality of monitored object device (pie graph of the equipment monitor system of 3-1~3-N) constitute.Device monitor server 1, video monitor terminal (2-1~2-N) and monitored object device (3-1~3-N) connect via network 4.After, as required, (2-1~2-N) is generically and collectively referred to as video monitor terminal 2, and (3-1~3-M) is generically and collectively referred to as monitored object device 3 with a plurality of monitored object devices with a plurality of video monitors terminal.In addition, at present embodiment, monitored object device 3 is made as ATM.Video monitor terminal 2, monitored object device 3 utilize the event detecting method that detects to particular phenomenon respectively, and the incident that detection obtains is sent to device monitor server 1 via network 4.
Secondly, the detailed formation of each device is described.Fig. 2 is the functional-block diagram of indication device monitor server 1.Device monitor server 1 possesses basic hardware and constitutes; External memory 14, memory 16, bus 18 that basic hardware comprises so-called network interface 10, control part (CPU) 12, is made up of hard disk etc., and device monitor server 1 communicates via packet control part on the network interface 10 101 and network 4.Be equipped with in the memory 16 and be used for the device supervisory programme 161 that final controlling element is kept watch on processing.Device supervisory programme 161 is handled below carrying out: to from video monitor terminal 2, monitored object device 3 information relevant with incident that received manage, and indicate method for monitoring to video monitor terminal 2, monitored object device 3.External memory 14 stores and is used for monitored object device packet information data storehouse (DB) 141 that monitored object device 3 is carried out device packet identifier that packetizing and administrative institute need and the group of the device identifier that is used to discern monitored object device 3 is managed.For the packetizing of device, for example exist will nearer place, place be provided with in the geographical position the method handled as same grouping of device.External memory 14 also stores monitored object device information DB143, this monitored object device information DB143 to said device identifier, be used to represent the address of monitored object device 3 unit address, be used to discern with said monitored object device 3 be arranged at the video monitor terminal 2 in identical place the monitoring terminal identifier, be used to represent that the group of the duration of the alarm that send to said video monitor terminal 2 the monitoring terminal address and when incident takes place, being used for of the address at said video monitor terminal 2 manages.The major function of device monitor server 1 is: the association of the phenomenon of carrying out monitored object device 3 and 2 places, video monitor terminal in packetizing management are taken place (after, be referred to as " incident ") is set up, and carries out necessary supervision and handle.For realizing this function, external memory 14 also possesses the warning information DB145 that a series of incident that is associated with each monitored object device 3 is managed as alarm.Warning information DB145 by duration of the identifier of alarm, alarm, the record that is used for the device identifier of the monitored object device 3 that the identification incident taken place, the image information that is associated with alarm, said image information constantly, be used to represent take place that the event type of the kind of incident, the generation of incident constitute constantly.Group constantly takes place in said event type and said incident, can exist a plurality of with respect to said alarm identifier.These databases are to be read by the device supervisory programme 161 that is loaded on the memory 16 to write.In addition, these databases must not be stored in the external memory 14, and reasons such as the access speed of factor certificate, data capacity also have the situation that is stored in memory 16.
Fig. 3 is the functional-block diagram at expression video monitor terminal 2.Video monitor terminal 2 possesses basic hardware and constitutes; External memory 24, camera interface 25, memory 26, bus 28 that its basic hardware comprises so-called network interface 20, CPU22, is made up of hard disk etc., and video monitor terminal 2 communicates via packet control part on the network interface 20 201 and network 4.Be equipped with video monitor program 261 in the memory 26, this video monitor program 261 is used to carry out the supervision of carrying out through the video camera 251 that connects via camera interface and handles.Video monitor program 261 is handled below carrying out: carry out the event detection of being undertaken by video camera 251, and carry out detected incident is sent to device monitor server 1.External memory 24 stores to be used to discern with video monitor terminal 2 has set up the device identifier of corresponding monitored object device 3 and the monitored object device information DB 241 that the unit address of the address of representing said monitored object device 3 is managed.External memory 24 also has the warning information DB243 that the duration of identifier to alarm, alarm, the image information that is associated with alarm manage.Monitored object device information DB241 and warning information DB243 are read by the video monitor program 261 of being loaded on the memory 26 to write.In addition, these databases must not be stored in external memory 24, and reasons such as the access speed of factor certificate, data capacity also have the situation that is stored in memory 26.
Fig. 4 is the functional-block diagram of expression monitored object device 3.Monitored object device 3 possesses basic hardware and constitutes; External memory 34, memory 36, input device 37, bus 38, sensor interface 39 that its basic hardware comprises so-called network interface 30, CPU32, is made up of hard disk etc., and monitored object device 3 communicates via packet control part on the network interface 30 301 and network 4.Be equipped with the apparatus control program 361 of the basic function that is used to provide ATM on the memory 36.Apparatus control program 361 is handled below also carrying out: carry out the detection of the incident of being undertaken by a plurality of event detection transducer 391~39N, and detected incident is sent to device monitor server 1.
Store in the external memory 34 and be used for operation information DB 341 that the group of writing time of content of operation and the content of operation of device is managed.External memory 34 also possesses and is used for warning information DB 343 that the duration of the identifier of alarm and alarm is managed.Operation information DB341 and warning information DB 343 read through the apparatus control program 361 that is loaded on the memory 36 and write.In addition, these databases must not be stored in external memory 34, and reasons such as the access speed of factor certificate, data capacity also have the situation that is stored in memory 36.
Event detection transducer 391~39N implements the action based on the kind of event that detects.Fig. 5 is that expression constitutes the kind of transducer device that specialize, monitored object device 3.The basic hardware of so-called network interface 30, CPU 32, the external memory 34 that constitutes by hard disk etc., memory 36, input device 37, bus 38, sensor interface 39 constitute and external memory on database constitute identical with Fig. 4.With having that sensor interface 39 is connected: the vibration detecting sensor 396 that the card insert opening foreign object detection sensor 392 that the foreign matter of whether packing in the card insert opening is detected, the card insert opening that the breakage of card insert opening itself is detected destroy detecting sensor 394, detect the vibration of monitored object device 3, the residue detecting sensor 398 that whether has residue to detect to card insert opening and cash conveying end.These transducers carry out self contained function, and respectively the incident of keeping watch on are detected, and the result is sent to device monitor server 1.
Next, utilize sequential chart, the elemental motion of the equipment monitor system that carries out of device monitor server 1 is explained.The supervision of device starts from the detection that video monitor terminal 2 or monitored object device 3 carry out the person's of utilization movement through video camera, various transducer.Most incident detects with monomer through transducer, but passes through the operation information of combination shot machine and monitored object device 3, can the higher incident of detecting reliability.Fig. 6 is that the sequential chart of the processing that the particular event that suspicious person is implemented detects is cooperated at expression video monitor terminal 2 with monitored object device 3.Event detection is handled and is started from the detection (S1-01) that the 2 couples of operators that before monitored object device 3, exist in video monitor terminal carry out.General video camera has the basic video analytical capabilities that personage, the object that is detained in specific zone detected, and through this function of applying in a flexible way, can the personage who before the monitored object device, exists be detected.Monitored object device in the present embodiment is ATM, even when utilizing original the getting of ATM to save, transfer accounts function etc., the person of utilization also need stand in before the ATM.Thus, the operator who only carries out through video camera 251 detects, and can't be that common user or suspicious person judges to the operator.At this, the 2 pairs of monitored object devices in video monitor terminal, 3 transmit operation information request (S1-04).The PF-02 of Figure 13 representes the message format of operation information request.The zero hour and the finish time in the moment that operation information request PF-02 comprises the identifier of transmission source address and destination-address, type of data packet (operation information request), the monitored object device of message, ask operation information.During the delay of carrying out with video camera 251 respectively the zero hour and the finish time detects, moment that personage's delay is detected and to be detained the moment that the personage disappears consistent.The monitored object device 3 that has received the operation information request sends (S1-07) with the operation information in the specified time to video monitor terminal 2.The PF-03 of Figure 13 representes the message format of operation information.Operation information PF-03 comprises the record group constantly of identifier, content of operation and operation of transmission source address and destination-address, type of data packet (operation information), the monitored object device of message.Content of operation can include a plurality of in a message with record group constantly.The content that receives the 2 pairs of operation informations in video monitor terminal of operation information goes through (S1-10).In the operation information as include more than one content of operation; Can be considered the common person of utilization utilizes monitored object device 3; If any processing is not carried out yet; Operation information is under the empty situation, and video camera 251 detected personages are near monitored object device 3 exists and do not have the personage of use device, then are judged to be the possibility with suspicious person.Under this situation, video monitor terminal 2 pairs of devices monitor server 1 sends event notice (S1-13).The message format of event notice is shown in the PF-01A of Figure 13.Event notice PF-01A comprises: the generation of the identifier of the transmission source address of message and destination-address, type of data packet (event notice), monitored object device 3, the type of event and incident constantly.The identifier of monitored object device 3 is utilized in the value of being stored among the monitored object device information DB241.The statement of the type utilization of incident such as " surveillance camera and operation information " etc.During present event detected and handles, owing to can utilize the image information of video camera 251, video monitor terminal 2 also sent to device monitor server 1 (S1-16) with image information.Shown in the message format of image information such as the PF-05A of Figure 13.Image information PF-05 comprises: the identifier of the transmission source address of message and destination-address, type of data packet (image information), monitored object device 3, view data and record image data are constantly.The system of selection that should send image for example has, select the image in the moment that personage's delay is detected method, select to be detained the moment that the personage is detected and be detained the personage disappear constantly in the middle of constantly the method for image.Event notice and image information to device monitor server 1 sends are applied in a flexible way when whole monitored object device 3 that device monitor server 1 is administered is kept watch on expeditiously.
Next, utilize the sequential chart of Fig. 7, the elemental motion that 1 pair of a plurality of monitored object device 3 of device monitor server are kept watch on is described.At this, 1 pair of N platform of suppose device monitor server video monitoring devices 2-1~2-N, N platform monitored object device 3-1~3-N keep watch on.
Keep watch on to handle and start from the detection of being undertaken by video monitor terminal 2 or 3 pairs of incidents of monitored object device at specific strong point.For example, suppose that video monitor terminal 1 (2-1) detects (S2-01) according to the order shown in the sequential chart of Fig. 6 to incident, device monitor server 1 is sent event notice (S2-04) and image information (S2-07).At this moment, side by side, monitored object device 1 (3-1) also detects incident through transducer, and device monitor server 1 is sent event notice (S2-10).Device monitor server 1 is checked (S2-13) to the relevance of these incidents and image information.The inspection of the relevance of incident is carried out according to following order.Device monitor server 1 is from receiving the initial incident relevant with monitored object device 1 (3-1), the starting timer.(for example in several minutes) within a certain period of time; Receive under the situation of the image information relevant or other event notice information with identical monitored object device 1 (3-1); Device monitor server 1 is regarded as these incidents and image information has relevance; Be necessary to carry out the notice of alarm, and the incident and the image information that receive are stored in warning information DB145.Figure 14 representes the concrete example of warning information DB145.Figure 14 representes; Identifier " device 1 " in the specific monitored object device 1 (3-1); The card insert opening foreign matter incident of the incident of " surveillance camera and operation information ", the image information that is associated with this incident and monitored object device 1 (3-1) has the alarm identifier of so-called " alarm 1 ", and the situation of storing as a series of incident.The valid period of alarm is 30 minutes.Valid period is to be utilized in the value of setting as initial value in the device monitor server.Record images constantly and the generation of incident be that combination with year, moon, day and the moment constitutes constantly, still, about year, the moon, day,, explain among the figure with " YY/MM/DD " of time on date arbitrarily for simpleization of explaining.
Accomplished the device monitor server 1 of the renewal of warning information DB145, in order to confirm to notify the monitored object device of alarm, with reference to monitored object device grouping information DB141.Monitored object device grouping information DB141 is the database that the grouping to the monitored object device defines; A series of incident has taken place and has become under the situation of the situation that should notify alarm in a certain monitored object device in dividing into groups, then install 1 pair of monitor server belong to whole monitored object device this grouping, except that the monitored object device that a series of incident has taken place (3-2~3-N) (2-2~2-N) carries out the notice (S2-19, S2-22) of alarm related video monitor terminal.The message format of alert notification is shown in the PF-06 of Figure 13.Alert notification PF-06 comprises: the identifier of the transmission source address of message and destination-address, type of data packet (alert notification), alarm and duration and the image information that is associated with alarm.Alarm identifier, alarm duration and image information, the warning information DB according to Figure 14 is set to corresponding value respectively.(address of 2-2~2-N) then utilizes the device identifier that from monitored object device grouping information DB 141, is obtained, and obtains through monitored object device information DB143 is retrieved to carry out the video monitor terminal of the notice of alarm.Receive each video monitor terminal (2-2~2-N) alarm identifier contained in the alert notification, alarm duration and image information are stored among the warning information DB 243, and of alert notification to the monitored object device corresponding (3-2~3-N) pass on respectively (S2-25, S2-28) with alert notification.(3-2~3-N) that alert notification is contained alarm identifier and alarm duration is stored among the warning information DB343 to receive the monitored object device of alert notification.The monitored object device (3-2~3-N) is not owing to carry out based on the event detection through image, so, do not carry out the preservation of image information yet.
(after 3-2~3-N) passed on, (image analysis that the beginning video camera 251 of 2-2~2-N) carries out was handled (S2-31) at the video monitor terminal to the monitored object device with alert notification.It is that the detection of similar image is handled specifically that image analysis is handled, alarm continue during, video camera 251 carries out the notice of incident to device monitor server 1 under situation about detecting with the similar image of the image information of warning information DB243.For example; Video monitor terminal 2 (2-2) is under situation about detecting with the similar image of image information (S2-34); Video monitor terminal 2 (2-2) is regarded as incident with it, and event notice and image information are sent to device monitor server 1 (S2-37, S2-40).These event notices and image information are owing to be to be associated with contained alarm identifier in the alert notification of step S2-19 reception, and for this is shown clearly, event notice and image information adopt the PF-01B of Figure 13, the form of PF-05B respectively.The difference of PF-01B and F-01A is whether message comprises the alarm identifier.Also same as described above about PF-05B and PF-05A.Detect under the situation of incident at monitored object device 2 (3-2), the event notice that also will comprise the alarm identifier sends to device monitor server 1 (S2-43).
(2-2), monitored object device 2 (3-2) receive the device monitor server 1 of image information and a plurality of event notices from video monitor terminal 2; Utilize the contained alarm identifier of message separately that warning information DB 145 is retrieved, extract the go forward side by side renewal in line data storehouse of the warning information that is associated with this event notice and image information.The concrete example of warning information DB after the renewal is shown in figure 15.Store in the project of the alarm 1 of the warning information DB after the renewal and two event informations that install 1, device 2 is relevant.These incidents engrave when taking place and have some differences, but this difference was accommodated in the alarm duration.Reception is from the event notice of video monitor terminal 2 (2-2) and monitored object device 2 (3-2), and the duration of alarm 1 is updated to the value (S2-46) of regulation once more.The alert notification that the device monitor server that has upgraded the duration of alarm will comprise the new alarm duration sends to and becomes the video monitor of object terminal.The device that the video monitor terminal that becomes object belongs to the alert notification object divides into groups, and be with warning information DB 145 in the corresponding video monitor terminal of monitored object device of log-in events not.In the example of Fig. 7 and Figure 15; Have and monitored object device 1 (3-1) and the relevant incident of monitored object device (3-2) owing to login among the warning information DB 145; So, to ((2-3~2-N) sends alert notification (S2-49) at the video monitor terminal that 3-3~3-N) is corresponding with in addition monitored object device of monitored object device 1 (3-1) and monitored object device (3-2).(2-3~2-N) after the corresponding project of warning information DB243 is upgraded, (3-3~3-N) sends (S2-52) to the monitored object device with the message that receives to receive the video monitor terminal of alert notification.Monitored object device (3-3~3-N) also identically, the corresponding project of warning information DB343 is upgraded with the video monitor terminal.
As not detecting incident, because the opportunity of not carrying out the renewal of alarm duration, through behind the official hour, alarm becomes invalid in the certain hour.It is different according to each supervision strong point that alarm becomes the invalid time.For example, the alarm that receives alert notification and detect the video monitor terminal 2 (2-2) of incident at first is limited to the phase (S2-55) with incunabulum.Detect alarm time limit overdue video monitor terminal 2 (2-2) the corresponding project of warning information DB243 is deleted, and make the image analysis processing stop (S2-58).Identical ground, the alarm time limit also takes place and expires (S2-61) in N (2-N) at the video monitor terminal, and video monitor terminal N (2-N) handles image analysis to stop (S2-64).On the other hand, device monitor server 1 is detecting under the overdue situation of alarm time limit, and the relevance of 1 pair of whole incident that taken place of device monitor server is judged (S2-67).About the decision method of relevance, describe based on the example of Figure 16.Suppose in this example: 5 monitored object devices (device 1~device 5) belong to same grouping, detect 3 incidents of " surveillance camera and operation information ", " card insert opening foreign matter ", " card insert opening destruction " respectively with the content shown in the form.Card insert opening foreign matter and card insert opening destroy by detected reason simultaneously be because, for example destroy regular card insert opening equipment after, the processing that the Counterfeit Item that can give is installed in its position.The purpose that the relevance of incident is checked is after taking place in a series of incident, the monitored object device to be controlled.In the purpose that the ATM device is kept watch on; Major part is to be used for delinquency prevention; Thus, the detected incident of the transducer of the video camera 251 at video monitor terminal 2, monitored object device (392,394,396,398) is the incident with devious conduct dubiety.Receive these incidents, be injured take place before, device is controlled, for example the function of limiting device, or take to make equipment itself to become disposal such as unavailable.At this moment, confirm importantly what kind of control the monitored object device which monitored object device is controlled and is directed against as object is carried out.These judgements are independently to carry out.At first, the method to the device of confirming controlling object describes.For example, consider to belong to the monitored object device 3 of same grouping, it is the field set monitored object device nearer in the geographical position.Can expect: to the grouping of such monitored object device, carried out continuously under the situation of devious conduct same personage, a plurality of video monitors terminal 2 can detect similar image.At this; Shared ratio is under the above situation of the threshold value of regulation (for example 50%) in the terminal quantity in the quantity that receives image information is relatively divided into groups; Whole monitored object device that grouping is interior is as controlling object; Under really not so situation, under the shared situation of ratio less than the threshold value of regulation of the terminal quantity in the quantity that promptly receives image information is relatively divided into groups, the monitored object device that only will send image information to the device monitor server is as controlling object.As utilize the example of Figure 16 to describe, the quantity of contained monitored object device is 5 in the grouping, wherein, from install 1,3 devices of device 2, device 5 receive image information.Under this situation, the device that receives image information is 60% with respect to all ratios that divides into groups, with the object of the whole monitored object device in dividing into groups as control.
Then, the method for confirming as the control content of the monitored object device of object is described.The consistent degree of confirming to be based on event of control content carries out.Because incident is closely-related with video camera, the transducer of the incident of detecting, the incident that detects identical type at a plurality of strong points means that suspicious figure's action is similar.For example, to card insert opening, the suspicious figure has carried out under the situation of certain devious conduct, incident with the card insert opening sensor associated be that the center takes place.Consistent degree at each strong point event is high more, and the probability that can think to have carried out devious conduct is also high more.At this, the concordance rate at each strong point event for the situation more than the threshold value of regulation (for example 50%) under, make the function stop of monitored object device 3.Under the situation of threshold value of the concordance rate of incident less than regulation, the part of functions of monitored object device 3 is limited.The strong point that the judgement of incident unanimity degree has only taken place with incident is as object, and the nonevent strong point of incident is not as the object of judging.Handle like the back said about this.
Monitored object device 3 among the present invention is ATM, and the restriction of the part of function is meant, for example only can carry out the left fund inquiry, gets the function of saving, transferring accounts etc. and becomes disabled state and make.As the example of utilizing Figure 16 is when specifying the definite method of control content; The incident that device monitor server 1 is received has " surveillance camera and operation information ", " card insert opening foreign matter ", " card insert opening destruction " 3 kinds; Wherein, for surveillance camera and operation information incident, only from install 1, device 2, device 5 these 3 devices receive incident; And for card insert opening foreign matter incident and card insert opening destructive insident, but be all to receive incident from whole 5 devices.Thus, the concordance rate of incident is 2/3rds (66.7%), and therefore, the device monitor server is judged as and is necessary to make the function of device to stop fully.
Through said sequence, the device monitor server 1 after the monitored object device 3 of controlling object and control content have been confirmed is to monitored object device dispensing device control request (S2-70~S2-76).The message format of device control request is shown in the PF-07 of Figure 13.Device control request PF-07 comprises: the transmission source address of message and destination-address, type of data packet (device control request), device identifier and control operation type.The control operation type comprises contents such as " function stop ", " function restriction ".In the sequential chart of Fig. 7, represented example, the whole monitored object device of the device control request that will specify " function stop " in the dividing into groups (appearance of 3-1~3-N) send based on Figure 16.
Corresponding with the concordance rate of the quantity of the image information that receives and incident, the object and the control content of the device control request that 1 of monitor server of device will receive also change.To this, describe based on the sequential chart of Fig. 8 and the warning information DB of Figure 17.The identical ground of sequential chart with Fig. 7; Video monitor terminal 1 (2-1) and monitored object device 1 (3-1) send (S3-01~S3-10) with event notice and image information to the device monitor server; The device monitor server is judged the relevance of incident; And with the video monitor terminal of alert notification in dividing into groups ((S3-13~S3-28), (2-2~2-N) begins to carry out image analysis (S3-31) to 2-2~2-N) send at the video monitor terminal.Processing till the step S2-01 to S2-31 of the detailed content of the processing that these are a series of and Fig. 7 is identical.Thereafter, the card insert opening foreign object detection sensor 392 of monitored object device (3-2) destroys detecting sensor 394 with card insert opening and detects incident respectively, and sends event notice (S3-34, S3-37) to device monitor server 1.The relevance of the new event notice that receives of 1 pair of monitor server of device checks, and carries out the renewal of alarm valid expiration date and the notice of new alarm valid expiration date (S3-40~S3-46).After the warp of certain hour, each video monitor terminal (2-2~2-N) expires to valid expiration date of alarm and detects, image analysis is handled stop (S3-49~S3-58).The details of the processing till from step S3-40 to step S3-58 is identical with the processing till step S2-46 to S2-64 of Fig. 7.The valid expiration date that receives alarm, the relevance of the incident at 1 pair of a plurality of strong point of device monitor server was checked (S3-61), obtains the result of the warning information DB of Figure 17 to after date.In the example of Figure 17, device 1 and install 5 and send image informations becomes the situation that 40% device in divide into groups receives image information.About the consistent degree of incident, the device 3 that will not send an incident is as non-judgement object, and use device 1, device 2, device 4, device 5 these 4 devices carry out the judgement of consistent degree.In this example, 4 devices all detect " card insert opening destruction " incident, and about in addition incident, have the device of the incident that do not detect.Device 2 and install 4 and do not detect " surveillance camera and operation information " incident, device 4 does not also detect " card insert opening foreign matter " incident.Thus, the concordance rate of incident is calculated as 1/3rd (33.3%).After receiving these results, device 1 pair of monitored object device 1 of monitor server and monitored object device 5 send the device control request (S3-64) of the function restriction that is used for request unit.
Among the step S2-13 of Fig. 7 and the step S3-13 of Fig. 8; When the relevance of 1 pair of incident of device monitor server was checked, the definite condition that will send alert notification was the situation that receives the situation of an event notice and image information or receive the event notice more than 2.In addition, receive the video monitor terminal 2 of alert notification owing to after reception, begin to carry out the dissection process of similar image, and alert notification need include the image information that obtains in the place that a series of incident takes place at first.About event detection, the event detection that carry out at video monitor terminal 2 is owing to be to realize through video camera 251 combination with the operation information of monitored object device 3, so; Event notice must be accompanied by image information; And the monitored object device is not owing to utilize video camera in event detection, therefore, and in the monitored object device; A plurality of event detection transducers detect under the situation of incident simultaneously, and device monitor server 1 does not receive image information.For example, detect under the situation of incident at card insert opening foreign object detection sensor 392 and card insert opening destruction detecting sensor 394, device monitor server 1 receives the event notice that is associated with transducer respectively, but does not receive image information.Under these circumstances, can carry out the image analysis processing in order to make with the interior monitored object device 3 corresponding video monitor terminals 2 of dividing into groups, 1 request of device monitor server is sent image information to video monitor terminal 2.Utilize the sequential chart of Fig. 9 that this processing is described.In monitored object device 1 (3-1), a plurality of sensor outgoing events, and send the event notice (S4-01, S4-04) corresponding respectively with it.Device monitor server 1 is to judge the relevance of incident with the step S2-13 of Fig. 7 and the identical order of step S3-13 of Fig. 8.Owing to receive two event notices, although be necessary to send alert notification though the device monitor server is judged as, (2-1) do not receive image information from video monitor terminal 1, so, send image information request to video monitor terminal 1 (2-1).The message format of image information request is shown in the PF-04 of Figure 13.Image information request PF-04 comprises: the zero hour and the finish time of the transmission source address of message and destination-address, type of data packet (image information request), device identifier, incident.The zero hour and the finish time are the time ranges that is used to specify when image information selected, for example, the generation that will be set at initial incident the zero hour constantly, the generation that will be set at last incident the finish time is constantly.Appropriate image is selected in the video monitor terminal 1 (2-1) that receives image information request from specified time range, and image information is sent to device monitor server 1 (S4-13).About the system of selection of image, the method that for example has the method be chosen in captured image image information request specified zero hour and select the captured image of the middle of the zero hour and the finish time.Receive the video monitor terminal of device monitor server 1 in order to confirm that alarm should be notified of image information, carry out the inspection (S4-16) that device is divided into groups.The later processing of step S4-16 is identical with the sequential chart of Fig. 7, omits its explanation at this.
Next, the process chart of each device in the equipment monitor system is described.Figure 10 is the flow chart of indication device monitor server 1.Device monitor server 1 carries out initialization process when starting, and makes Message Processing circulation beginning (F1-01, F1-04).In the Message Processing circulation; Under receiving from the situation of the image information of video monitor terminal or monitored object device (F1-07), or receive under the situation of event notice (F1-10), the relevance of 1 pair of incident of device monitor server is checked (F1-22).The condition that decision event has relevance is: video monitor terminal 2 has been sent the two situation (S2-04 of Fig. 7, S2-07 etc.), situation (S4-01 of Fig. 9, S4-04) and the device monitor server 1 that monitored object device 3 has sent the event notice more than 2 of event notice and image information and has been sent the situation (S2-37 etc.) that contains the alarm identifier in alert notification and the event notice.As the result who judges, incident is to have under the situation of relevance with other incident, and whether 1 pair of device monitor server is stored in the incident corresponding image information is judged (F1-25) among the warning information DB 145.Image information is not stored under the situation of warning information DB 145, sends image information request (F1-28) to video monitor terminal 2.Receiving image information from the video monitor terminal; And be stored under the situation of warning information DB 145; Confirm monitored object device 3 that alarm should be notified and the video monitor terminal 2 corresponding with reference to monitored object device grouping information DB 141, and send alert notification (F1-31) with it.Under the valid expiration date that detects alarm overdue situation (F1-13), device monitor server 1 utilizes whole event notices and the image information that is received, and the relevance of the incident at a plurality of strong points is checked.At first; Whether the received quantity to image information is to judge (F1-34) below the threshold value; The received quantity of image information is under the above situation of threshold value; The range of transmission of device control request is made as device whole in the grouping (F1-37), under the situation of received quantity less than threshold value of image information, the range of transmission that installs control request only is set at the device (F1-40) that incident has taken place.Then, device monitor server 1 carries out the judgement (F1-43) to the consistent degree of incident.Consistent degree in incident is under the situation more than the threshold value, makes the function stop (F1-46) of monitored object device, under the situation of consistent degree less than threshold value of incident, the function of monitored object device is carried out part restriction (F1-49).Through above processing, accomplish to the judgement content of the device monitor server 1 after the inspection of the relevance of the incident at a plurality of strong points, to monitored object device 3 dispensing device control request (F1-52) according to step F 1-34 and step F 1-43.When circulating in the shutdown of device monitor server 1, Message Processing finishes (F1-16), after the Message Processing circulation is stopped, and device monitor server 1 hold function (F1-19).
Figure 11 is the flow chart at expression video monitor terminal 2.Initialization process the time is carried out in starting in video monitor terminal 2, make Message Processing circulation beginning (F2-01, F2-04).In Message Processing circulation, video camera 251 detects under operator's the situation (F2-07), and for parsing further, video monitor terminal 2 is to monitored object device 3 transmit operation information request (F2-28).Owing to need contain the finish time of operation in the operation information request, the transmission of message is after video camera 251 is through with operator's detection, to carry out.In Message Processing circulation, receive under the situation of operation information (F2-10), the 2 pairs of operation informations in video monitor terminal go through, and judge (F2-31) to whether operation information was arranged in this time.Do not having under the situation of operation information, the incident that is regarded as takes place, and event notice, image information are sent to device monitor server 1 (F2-34).Event notice, image information are sent in the situation (F2-13) that detects similar image in the Message Processing circulation and also can carry out to what device monitor server 1 carried out.In Message Processing circulation, receive under the situation of alert notification (F2-16); Video monitor terminal 2 is passed on (F2-37) with the alert notification that is received to monitored object device 3; And the alarm duration of upgrading warning information DB243, begin to carry out image analysis and handle (F2-43).Image analysis is handled as has been under the executory situation, does not carry out this operation.On the contrary, under the valid expiration date that detects alarm overdue situation (F2-19), video monitor terminal 2 handles image analysis to stop (F2-49).The Message Processing circulation is when the shutdown at video monitor terminal 2, to finish (F2-22), after the Message Processing circulation is stopped, and video monitor terminal 2 hold function (F2-25).
Figure 12 is the flow chart of expression monitored object device 3.Monitored object device 3 carries out initialization process when starting, make Message Processing circulation beginning (F3-01, F3-04).In the Message Processing circulation, under the situation of sensor outgoing event (F3-07), monitored object device 3 sends event notice (F3-25) to device monitor server 1.Receive under the situation of alert notification (F3-10), the valid expiration date that perhaps detects alarm, 3 couples of warning information DB343 of monitored object device upgraded (F3-28) under the overdue situation (F3-13).As method for updating, the method when the reception of alert notification is with different when the valid expiration date overdue detection.Receiving under the situation of alert notification, making newly adds project, perhaps the alarm duration of off-the-shelf item is upgraded to warning information DB343.Under valid expiration date overdue situation, carry out the deletion of this project of warning information DB343.In Message Processing circulation, receive under the situation of device control request (F3-16), the monitored object device is according to the contained control operation type of device control request, the stopping or the restriction of part of functions of final controlling element function.Finish when Message Processing circulates in the shutdown of monitored object device 3 (F3-19), the Message Processing circulation is stopped after, monitored object device 3 hold function (F3-22).
Profit property on the industry
As stated; In the device monitor server and equipment monitor system involved in the present invention; The device of the incident that takes place through carrying out a plurality of strong points and the combination of image information is kept watch on, and the relevance of the incident between the strong point is checked, thus; Can confirm to answer the scope and the control content of control device neatly, realize that effectively device is kept watch on.Such technology is to be object with the ATM device that exists in the wider range, is applicable to the extensive video monitoring system towards ATM.

Claims (9)

1. device monitor server, it is connected via network and a plurality of financial transaction devices and video monitor terminal that said a plurality of financial transaction devices are kept watch on, and said device monitor server is characterised in that,
Possess:
Acceptance division, it receives the detected abnormality detection information of the abnormal detector that possessed by said financial transaction device via said network and from the image information at said video monitor terminal;
Storage device, it stores said abnormality detection information and said image information that said acceptance division receives;
Control part, it is analyzed said abnormality detection information and said image information,
Wherein,
Store the grouping information that said a plurality of financial transaction devices are divided into groups in the said storage device,
Said control part; Based on said abnormality detection information; One in the contained a plurality of financial transaction devices of said grouping information detects under the situation about having taken place unusually; With the image information of said financial transaction device having been carried out when this unusual generation the operator of operation in the said image information, send to other the financial transaction device in the contained a plurality of financial transaction devices of said grouping information.
2. device monitor server according to claim 1 is characterized in that:
Store the operator's that said financial transaction device is operated transaction resume in the said storage device,
Include the situation that the operator is stood in the place ahead of said financial transaction device in the said abnormality detection information and detect the operator message that obtains,
Said control part; Based on said operator message and said transaction resume; Detect by said operator message specific operator stand in after the place ahead of said financial transaction device there not be under the situation of transaction certain hour, said financial transaction device transmission is used to ask the image information request of said operator's image information.
3. device monitor server according to claim 1 is characterized in that:
The financial transaction device of other a plurality of financial transaction devices contained from said grouping information receives under the situation of a plurality of image informations; Whether judge by consistent consistent degree to said a plurality of image informations for said control part; And under the situation of unanimity, to the contained financial transaction device dispensing device control request of said grouping information.
4. device monitor server according to claim 3 is characterized in that:
Also comprise insertion mouth monitoring picture that the card insert opening of said financial transaction device is kept watch on and the residue detection information that the residue that is additional to said financial transaction device is detected in the said abnormality detection information,
The financial transaction device of other a plurality of financial transaction devices contained from said grouping information receives under the situation of a plurality of abnormality detection information; Whether said control part is that the consistent degree of identical content is judged to said a plurality of abnormality detection information; And the consistent degree in said a plurality of abnormality detection information has surpassed under the situation of specified quantity; Based on this abnormality detection information and image information, to the contained financial transaction device dispensing device control request of said grouping information.
5. according to claim 3 or 4 described device monitor servers, it is characterized in that:
Said control part is based on the abnormality detection information of said unanimity, and transmission is used to indicate control perhaps to stop the device control request of the financial transaction of said financial transaction device.
6. according to claim 3 or 4 described device monitor servers, it is characterized in that:
Said control part comes the scope of the financial transaction device of the said device control request of Notification of Changes based on the abnormality detection information of said unanimity.
7. device monitor server, it is connected via network and a plurality of financial transaction devices and video monitor terminal that said a plurality of financial transaction devices are kept watch on, and said device monitor server is characterised in that,
Possess:
Acceptance division, it receives the detected abnormality detection information of the abnormal detector that possessed by said financial transaction device via said network and from the image information at said video monitor terminal;
Storage device, it stores said abnormality detection information and said image information that said acceptance division receives;
Control part, it is analyzed said abnormality detection information and said image information,
Wherein,
Store the grouping information that said a plurality of financial transaction devices are divided into groups in the said storage device,
Said control part; Under the situation that receives a plurality of said abnormality detection information; Relevance between these a plurality of abnormality detection information is judged; And be judged as when having relevance, send image information request to the video monitor terminal that the financial transaction device that has sent said abnormality detection information is kept watch on.
8. device monitor server according to claim 7 is characterized in that:
Said control part is based on the quantity of the image information that is received, and in the contained a plurality of financial transaction devices of said grouping information, is used to indicate the scope of the device control request of this financial transaction device of control to limit to transmission.
9. device monitor server according to claim 7 is characterized in that:
Whether judge by consistent consistent degree to said a plurality of abnormality detection information for said control part; Consistent quantity is under the above situation of specified quantity; Transmission is used to indicate the device control request of the financial transaction that stops said financial transaction device; Under the situation of quantity less than specified quantity of unanimity, transmission is used to indicate a part to limit the device control request of the financial transaction of said financial transaction device.
CN201110129596.1A 2011-05-12 2011-05-12 Device monitoring server and device monitoring system Expired - Fee Related CN102780872B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110129596.1A CN102780872B (en) 2011-05-12 2011-05-12 Device monitoring server and device monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110129596.1A CN102780872B (en) 2011-05-12 2011-05-12 Device monitoring server and device monitoring system

Publications (2)

Publication Number Publication Date
CN102780872A true CN102780872A (en) 2012-11-14
CN102780872B CN102780872B (en) 2015-06-24

Family

ID=47125617

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110129596.1A Expired - Fee Related CN102780872B (en) 2011-05-12 2011-05-12 Device monitoring server and device monitoring system

Country Status (1)

Country Link
CN (1) CN102780872B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103106579A (en) * 2013-01-15 2013-05-15 钱袋网(北京)信息技术有限公司 Data monitoring method, mobile payment terminal, server and payment system
CN103997621A (en) * 2013-02-20 2014-08-20 霍尼韦尔国际公司 System and method of monitoring the video surveillance activities
CN104820376A (en) * 2014-02-04 2015-08-05 阿自倍尔株式会社 Notification device
CN105917618A (en) * 2014-03-18 2016-08-31 株式会社日立制作所 Data transfer monitoring system, data transfer monitoring method, and site system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0753524A2 (en) * 1995-07-11 1997-01-15 Fujitsu Limited Remaining money management system
JP2000242828A (en) * 1999-02-25 2000-09-08 Pfu Ltd Automatic transaction device
CN101098469A (en) * 2006-06-30 2008-01-02 索尼株式会社 Image processing system, server for the same, and image processing method
CN101609581A (en) * 2008-06-16 2009-12-23 云南正卓信息技术有限公司 The anomalous video warning device of ATM
CN101854516A (en) * 2009-04-02 2010-10-06 北京中星微电子有限公司 Video monitoring system, video monitoring server and video monitoring method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0753524A2 (en) * 1995-07-11 1997-01-15 Fujitsu Limited Remaining money management system
JP2000242828A (en) * 1999-02-25 2000-09-08 Pfu Ltd Automatic transaction device
CN101098469A (en) * 2006-06-30 2008-01-02 索尼株式会社 Image processing system, server for the same, and image processing method
CN101609581A (en) * 2008-06-16 2009-12-23 云南正卓信息技术有限公司 The anomalous video warning device of ATM
CN101854516A (en) * 2009-04-02 2010-10-06 北京中星微电子有限公司 Video monitoring system, video monitoring server and video monitoring method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103106579A (en) * 2013-01-15 2013-05-15 钱袋网(北京)信息技术有限公司 Data monitoring method, mobile payment terminal, server and payment system
CN103106579B (en) * 2013-01-15 2016-04-13 北京智能果技术有限公司 Data monitoring method, mobile phones payment terminal, server and payment system
CN103997621A (en) * 2013-02-20 2014-08-20 霍尼韦尔国际公司 System and method of monitoring the video surveillance activities
CN104820376A (en) * 2014-02-04 2015-08-05 阿自倍尔株式会社 Notification device
CN104820376B (en) * 2014-02-04 2017-09-15 阿自倍尔株式会社 Notify device
CN105917618A (en) * 2014-03-18 2016-08-31 株式会社日立制作所 Data transfer monitoring system, data transfer monitoring method, and site system

Also Published As

Publication number Publication date
CN102780872B (en) 2015-06-24

Similar Documents

Publication Publication Date Title
US10949793B2 (en) Systems and methods for monitoring item distribution
US11605051B2 (en) System for parcel transport and tracking operated responsive to data bearing records
CN102780872A (en) Device monitoring server and device monitoring system
US11128839B2 (en) Image processing to identify conditions of interest within self-service terminals
US11868946B2 (en) System for parcel transport operated responsive to data bearing records
EP0661677A2 (en) Method and apparatus for customer identification at automated teller machines
US20160092740A1 (en) Image auditing method and system
CN109495723A (en) A kind of domestic intelligent monitoring system calculated based on mist
CA3089659A1 (en) Item depository operated responsive to data bearing records
US20180189726A1 (en) Systems and methods for monitoring and restocking merchandise
US20160351022A1 (en) Device fraud indicator detection and reporting
JP5202419B2 (en) Security system and security method
US11748697B2 (en) System for parcel pickup and delivery operated responsive to data bearing records
US20200334936A1 (en) System operated responsive to data bearing records
WO2019171468A1 (en) Machine learning-trained model switching system, edge device, machine learning-trained model switching method, and program
CN104010162B (en) System and method for being interacted by working application with digital video recorder
US20210342805A1 (en) System and method for identifying grab-and-go transactions in a cashierless store
JP2000149114A (en) Automatic vending machine and crime preventing method for the same
US20200388116A1 (en) Internet of automated teller machine
CN103379312A (en) Image monitoring system and method
KR20230043516A (en) Automated reusable cup retrieval system for rewarding users
CN111667628A (en) Control method, device, equipment and storage medium of unmanned vending device
KR101958417B1 (en) Pos security system for fabrication monitoring of pos terminal
JP2021009488A (en) Theft suppression device
US11521164B2 (en) System for parcel transport and tracking operated responsive to data bearing records

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150624

Termination date: 20190512

CF01 Termination of patent right due to non-payment of annual fee