CN103824407A - Systems and methods for distributed monitoring of remote sites - Google Patents

Abstract

The present invention relates to systems and methods for distributed monitoring of remote sites. Rules are applied to video surveillance data to detect events. Localization of the events is achieved by decomposing events into distinct components, each of which can, in some embodiments, be defined at different locations and by different users.

Description

For the system and method for distributed monitoring of remote sites

The application is the divisional application of the application that application number is 200780028664.7, denomination of invention is " for the system and method for distributed monitoring of remote sites ".

the cross reference of related application

The application requires right of priority and the rights and interests of the U. S. application number 11/446,523 submitted on June 2nd, 2006 and U. S. application number 11/446,570, and the disclosure content of above-mentioned application is combined in this by reference of text.

Technical field

The present invention relates to the method and system of computer based for surveillance operation, and more properly relate to a kind of area of computer aided surveillance that can detect in the event of multiple points.

Background technology

The current awareness of safety day by day improving and the surveillance equipment cost constantly reducing have caused adopting the more application such as the surveillance of Close Circuit Television (CCTV) technology.These systems have under multiple different environment diminish crime, Accident prevention and generally strengthen the potentiality of security.Video monitoring system typically comprises a series of video camera, and these positions for video camera are (for example, a warehouse, a retail location, an office building, an airport) different position everywhere in a relevant range.These video cameras send back a central observation station (or multiple observation station) video feed, and this central observation station is typically on duty by a security personnel.These different supervision feedbacks are presented on a series of screen, and these screens are used for monitoring suspicious actions.

Except using CCTV systems in indivedual positions, people are very interested is to collect the data relevant with personnel's the behavior of crossing over multiple positions by video monitor and analytic system.For example, a national Retail chain shop may be interested in the behavior in different shops shopper.Although the data of collecting from an independent field point are useful, but only in the time comparing from the data of putting from different, could realize whole value of these data, for example for how within some place, a field or a field point, spread all over multiple positions optimally resource allocation deep understanding is provided, to realize specific target.

But, for can be useful, should be comparable with the data of collecting in other similar position from the data of a position.That is to say, identical event (for example, " personnel stop before displaying ") should have consistent meaning in each position.But, due to off-gauge floor plan, variable camera arrangement and other field point difference, the occurring in each position and may seem very different (from the angles of a surveillance) an of event.These differences make an independent people (for example, a safety is responsible for or the marketing analyst of company) be difficult to stipulate that an event is to detect this event at multiple diverse locations reliably on required level of detail.

To make a global operation person in each single point and a surveillance interaction, to define dependent event for the treatment of a kind of mode of the inconsistent problem in this position.Although the advantage that this method has is so that event is carried out to concentrated control and management, the restriction of time and resource has suppressed to cross over the extensibility of a lot of points.The similar position that another kind method requires to cross over all points are all identical aspect arranging two at floor plan and sensor.Although this method allows a global operation person carry out centralized definition dependent event and cross over all positions and copy these events, it is unpractical requiring all positions all identical.The third method is that the responsibility of event definition is given in local field point operation person's hand, but this method has been abandoned any centralized control factor and reduced significantly and crossed over a data consistency for point.

Regrettably, in these methods, neither one is satisfied the demand.Therefore, needed is a kind of technology, and it allows the changeability of location layout and camera arrangement simultaneously for centralized definition and Admin Events on an overall level.

Summary of the invention

According to the present invention, by rule application in monitoring data (for example, video surveillance data, point of sale (POS) data, radio-frequency (RF) identification (RFID) data, eas (EAS) data, personal identification data (such as contactless card data and/or biometric data) etc., to detect the generation (or not occurring) of an event.In order to assist to carry out centralized control and location simultaneously, event definition is divided into multiple key elements, and making some key element is global definition, and other key elements are local definition.The overall key element of an event can be described on the leap of for example this event all (or certain big collection) position all aspects of identical (or almost identical).Local key element is described the aspect that this event can customize for each position.

For example, use system and the technology of following explanation, a central security mechanism can create an event definition " template ", this template (for example comprises some dependent event, stealing, deliberately destruction, shopping etc.) overall, concrete information, and for " placeholder " of the event information that localizes, these placeholders will be by completing the operator of long-range point, these operators will typically have the more knowledge of the aspects such as product layout, camera arrangements, floor plan.This template is provided for these points and implements as a part for field point surveillance.Local system operator completes this template, and portion is confirmed to send to central office, and this confirmation shows that event has been defined and be used to the supervision of well afoot completely.

Thus, in first aspect, the invention provides a kind of method of assisting to monitor multiple different points, the method comprises the rule that a set of description dependent event is provided.These rules have multiple key elements, and some of them key element is a peculiar key element of point, and other key element is independent of field point.The key element that these are independent of to point defines globally, and then by these regular allocation on described multiple points, assist thus the definition of the peculiar key element of these points and use the field point that these rules are carried out to monitor.

The peculiar key element of these points can stipulate the position relevant with these points, floor plan diagram data, sensor identification data (for example, video camera ID, RFID sensor ID, POS sensor ID and/or EAS sensor ID), or their any combination.These key elements that are independent of point can be defined in behavior that these points occur, spread all over object that these points place and/or with the personnel of object interaction that spread all over this point.

In certain embodiments, receive from these somes the alarm showing in these some generation events.Can gather these alarms to assist the statistical study of for example these alarms, as determine the average of the alarm receiving from some point during a predetermined time section.For example, special analysis can determine the distinctive key element of field point of these rules be whether secondary optimization and/or they whether cross over these points and applied inconsistently.In some cases, can be assigned to by analyzing the change for the peculiar key element of these points proposing the field point that observes inconsistency.Can also generate (intensively or remotely) secondary alarm and these secondary alarms are sent to a long-range point, this long-range point can be the field point that has generated one or more initial alarms, or to a different field point.In some example, this different fields point can be identified based on received relation of deriving in these alarm events and/or a point by it.The distinctive key element of these points also can be sent to a central office and ratifies and/or issue.

Except (or substituting) receiving alarm, also can receive monitoring data from these different fields points.In such cases, the generation (or not occurring) with detection dependent event in monitoring data by these rule application, thus generate the above-mentioned alarm that can gather and/or analyze.

On the other hand, the invention provides a system, this system is used for monitoring that multiple different are put and comprise a rule definition module and a delivery module.This rule definition module assists to create the rule of describing the different event that may occur in (or not occurring in) these points.These rules (had for example both comprised the peculiar key element of field point, floor plan diagram data, position, camera position information etc.) also comprise the key element personnel of the object interaction being monitored (behavior for example, occurring at this point, the object at this some place and the point on the scene place with) that is independent of point.Delivery module is sent to these rules the field point being monitored, can the distinctive position elements of definition environment at these points.

In certain embodiments, can provide the access to this rule definition module to the client of long range positioning with a Website server, each client puts with one specific be associated (and being usually located at this site-specific).In some cases, this website service management is authorized these remote clients' access, thereby limits these clients, for example, so that these remote clients only can revise the subset that field is put peculiar key element or accessed these key elements.This delivery module can also (for example, from the environment being monitored) receives data, as shows to occur a position alarm of an event, together with sensing data as video, RFID data, EAS data and POS data.In certain embodiments, this system can also comprise an analysis module, and this analysis module is for the quantity by for example gathering the alarm that the data that receive receive from the position being monitored for statistical study, comparison and identify inconsistency between these alarm and/or monitoring datas that receive and determine accuracy and the consistance of the peculiar key element of these environment.Based on identified inconsistency, can make modification (for example, using this rule definition module) to these rules, and via this delivery module, these rules are re-assigned to long-range point in some cases.This system can also comprise a data memory module, applies distinctive data for the result of store video monitor data, these rules, the analysis carried out by this analysis module and other.

On the other hand, the invention provides a kind ofly for monitoring the method for multiple points, the method comprises provides a gauge field point layout, the field point total one or more elements of this some layout regulation to a certain quantity.Event is assigned to these elements and does not consider the practical layout of these points, thereby produce a gauge field point layout that has note.Then this is explained layout and is sent to a user, this user is familiar with it to send the field point of this layout, for example, so and this user (can revise this gauge field point layout, use a Downloadable applet, a for example AJAX small routine) so that this gauge field point layout consistent with actual field point layout and can be used in monitor this point.

These elements can stipulate the position about these points, as floor plan diagram data.These events that are assigned to standard floor plan can be that field point is distinctive (for example, the sensor identification data of video camera ID, RFID sensor ID, POS sensor ID and/or EAS sensor ID) and/or be independent of point, for example one interaction (for example a client stops product introduction place) between a position (outlet, passageway etc.) or a people and an element.

In certain embodiments, for example, within this layout of revising can be used in a surveillance (, at one or more some places), generate a basis of alarm as the generation based on these events.For example can analyze these alarms, to determine accuracy and/or the floor plan of () these events.

On the other hand, the invention provides a kind ofly for monitoring the system of multiple points, this system comprises a user interface and a modified module.This user interface comprises being wherein independent of the gauge field point layout frame that the element of point is associated with gauge field point layout and wherein actual field being put to peculiar layout and is presented to frame of user.This modified module assists an element of point that is independent of of this actual field point layout to put the associated of peculiar element with field.

In certain embodiments, this modified module comprises an asynchronous JavaScript applet.This system can also comprise a Website server, and this Website server is used to user that this small routine is provided, and adopts and process the request of data from this small routine as XML.A data memory module also can be used for meeting the request of data of being made and being submitted to via this Website server by modified module.

Accompanying drawing explanation

In the following drawings, the similar reference marker that runs through different views refers to identical part generally.And these accompanying drawings also not necessarily meet ratio, but conventionally lay stress in explanation principle of the present invention.

Fig. 1 is according to the block diagram of the surveillance of one embodiment of the invention, and this surveillance merges the data from multiple sensor networks.

Fig. 2 is the block diagram of an embodiment of a surveillance, and this surveillance has concentrate and the long-range processing power according to one embodiment of the invention.

Fig. 3 is for define the schematic diagram of different key elements of event a surveillance according to one embodiment of the invention.

Fig. 4 is a process flow diagram, this figure described according to one embodiment of the invention for implementing the method for surveillance.

Fig. 5 is a process flow diagram, and this figure describes according to one embodiment of the invention for realizing the additional step of method of a surveillance.

Fig. 6 is a process flow diagram, and it is described according to one embodiment of the invention for realizing the additional step of method of a surveillance.

Fig. 7 is a snapshot of user interface, and this user interface is for implementing the surveillance according to one embodiment of the invention.

Fig. 8 is the diagram of a user interface, and this user interface is used to the surveillance definition floor plan template according to one embodiment of the invention.

Fig. 9 is a snapshot of a user interface, and this user interface is for defining according to the position elements of an event in the surveillance of one embodiment of the invention.

Figure 10 is a snapshot of a user interface, and this user interface is for defining according to the event in the surveillance of one embodiment of the invention.

Figure 11 is a snapshot of a user interface, and this user interface is for revising according to the event in the surveillance of one embodiment of the invention.

Figure 12 is the diagram of a user interface, and this user interface is defined as the attribute of event for distinctive key element being put in field according to the surveillance of one embodiment of the invention.

Figure 13 is the diagram of a user interface, and this user interface for being used field of a floor plan model customization to put distinctive floor plan according to the surveillance of one embodiment of the invention.

detailed description of the Invention

Although be described with reference to follow the tracks of user and product in retail location herein, and as detect stealing and measure different sale in shop and ruuning situation aspect time useful, but below explanation system and technology for multiple object is equally applicable to any environment being monitored, for example airport, amusement gambling house, school, amusement park, public place of entertainment and office building.

Fig. 1 shows according to the video monitor of different embodiments of the present invention integration and sensor network system 100.System 100 is caught monitoring data from one or more monitoring arrangements that are monitored any amount in wild point, therefore, these data can be for analyzing and/or process in this locality (at each monitoring arrangement, at a native processor or in the two), a single concentrated position and/or in the intermediate data processing position of any amount.In certain embodiments, below the processing of explanation and analytical technology can be distributed according to bandwidth, processing power and other parameters between long-range, moderate distance and central authorities' point.Can process the data from these monitoring arrangements according to one or more rules, to detect the generation (being not occur in some situation) in the one or more events in some place, field that are monitored.This system comprises an intelligent video surveillance system 105 and one or more optional external sensor network 110 substantially.Intelligent video surveillance system 105 comprises a video processing module 115 and alarm/search processing module 120.Video processing module 115 is analyzed video flowing, thereby produces video and video metadata as the compression of output.In certain embodiments, alarm/search processing module 120 comprises a tracking module 130, alarm module 135 and a delivery module 140, and scanning frequency metadata is to find out the pattern matching with a set of pre-defined rule, thereby in the time having found pattern match, generate alarm (or Search Results) in the metadata situation of prerecording, then these alarms can be sent to one or more output unit 145(and hereinafter describe in detail).The example of this alarm module metadata used in the time processing these rules comprises object ID, object type (for example, personnel, product etc.), date/time stamp, current camera position, previously camera position, directional data, cost of products, product loss etc.

An example of intelligent video surveillance system 105 is at unsettled u.s. patent application serial number 10/706 that own together, common, 850, " Method And System For Tracking And Behavioral Monitoring Of Multiple Objects Moving Through Multiple Fields-Of-View(is for following the tracks of to moving through multiple objects in many visuals field the method and system monitoring with behavior) " be described, whole disclosure contents of this application are incorporated to herein by reference.In some embodiments, alarm/search processing module 120 has increased extra input, to use multi-form tracking and data capture to receive data from external sensor network 110, as point of sale (" POS ") system, radio-frequency (RF) identification (RFID) system and/or electronic article surveillance (EAS) system, that submits on May 30th, 2006 as being owns together, common unsettled U.S. Patent Application No. 11/443, 500, " Object Tracking and Alerts(is to image tracing and warning) " described in, whole disclosure contents of this application are incorporated to herein by reference.

Video monitoring system 105 comprises multiple input pickups 125, and these input pickups are caught the data of having described personnel and article interaction in an environment being monitored.These sensors 125 (for example can comprise video camera, optical sensor, infrared eye, camera, analog video camera, digital video camcorder, maybe can generate the sufficiently high view data of quality to support any device of method of following explanation) and the sensor based on video (for example, RPID base station, POS scanner and system of inventory control) not.These sensors can also comprise that cigarette, fire and carbon monoxide detector, door and window enter detector, glass breaking detector, motion detector, audio detector, infrared eye, computer network monitor, voice recognition device, video camera, camera, microphone and/or fingerprint, face, retina or other biological and measure recognition device.In some example, these sensors can comprise conventional emergency button, HA Global Positioning Satellite (GPS) steady arm, other geo-location devices, medical science indicator and Vehicle Information System.These sensors can also with other existing Information System Integration, for example system of inventory control, accounting system or similar system.

In the case of extra external sensor network 110 and video monitoring system 105 combinations are implemented, external sensor network 110 is collected the signal that has represented these sensor outputs, and by one or more normal data tranmission techniques, these signals is sent to alarm/search processing module 120 of video monitoring system 105.These signals can be by a LAN and/or a WAN(for example, Tl, T3,56kb, X.25), broadband connection (ISDN, frame relay, ATM), wireless link (802.11, bluetooth etc.) etc. transmit.In certain embodiments, can use and encryption technology (trusted key-pair encryption) is encrypted these vision signals as trusted key.Different sensing systems can use different communication paths to transmit information, for example Ethernet or wireless network, direct serial or parallel join, USB, fire wall, bluetooth or proprietary interface.System 100 can be configured to one " star network ", wherein, each sensor 125 is separately connected to alarm/search module 120, or in some cases, sensor network 110 can have a more general topological structure, and this topological structure comprises other components and parts common in switch, router and computer network.In certain embodiments, sensor 125 can carry out two-way transmission, thus can from video monitoring system 105 receive signal (with hoisting power, sound the alarm, move, change arrange etc.).

In certain embodiments, system 100 comprises a video storage module 150 and rule/metadata store module 155.Video storage module 150 is stored the video capturing from video monitoring system 105.Video storage module 150 can comprise VCR, DVR, RAID array, USB hard disk drive, optical disc recorder, flash memory device, image analysis apparatus, multi-purpose computer, video enhancement device, deinterleave scanner, scaler and/or other are for storing and/or process video or data processing and the memory element of video.Can catch and store these vision signals with different simulations and/or digital format, only as example, these forms comprise national television systems committee (NTSC) standard, line-by-line inversion (PAL) standard and order and storage color TV (SECAM) standard, use not compression digital signal that DVI or HDMI be connected and/or for example, compression digital signal based on the general CODEC form of one (, MPEG, MPEG2, MPEG4 or H.264).

Rule/metadata store module 150 is stored the metadata capturing from video monitoring system 105 and external sensor network 110, and the rule of these metadata institute foundations relatively, to determine whether triggering alarm.Rule/metadata store module 155 can be implemented on the computing machine of a station server rank, this computing machine comprises application program instructions, and these application program instructions are used for storing these alarm rule and these alarm rule are offered to alarm/search processing module 120.The example that can be used for implementing the database application that video storage module 150 and/or rule/metadata store module 155 store comprises the MySQL database server of the MySQLAB company of Sweden Uppsala, the PostgreSQL database server of California, USA Berkeley PostgreSQL global development group exploitation or the ORACLE database server that California, USA Redwood Shores ORACLE company provides.In certain embodiments, can utilize and on a station server, implement video storage module 150 and rule/metadata store module 155 as multiple subregions and/or mode, to obtain desirable system performance.

Multiple external sensor network 110 can provide data to system 100.For example, POS network packet contained be connected to a network many base stations (for example, cashier's machine, scanner etc.), in the time that these base stations are activated, the sensor in base station is sent to this network a client's Transaction Information (product, price, client ID etc.) and the state (open or cut out) of this cashier's machine.Similarly, EAS network typically comprises that being positioned at a retail shop exports near many pedestals, and these pedestal sensings are placed in the existence of the eas tag of the activation on high-value product (being all over products in some situation).In the time a label of existence being detected, this pedestal is sent to a middle position through this network information.Many commercial buildings are also used security system, the opening and closing of these security system sensing doors, and use " swiping the card " system, these system requirements employees that " swipe the card " brush ID (identity number) card or show ID (identity number) card in the time entering or leave facility.According to the present invention, some or all these sensor-based surveillance 110 is integrated with video monitoring system 105, to strengthen ability and the accuracy of this video monitoring system.Certainly, sensor type list is above also not exhaustive, and the example of the type of the sensor network 110 that can adopt is only provided.

In a limiting examples, sensor network 110 comprises a RFID subsystem, this RFID subsystem self comprises transmitter (also claim " base station " or " station "), these transmitters and be positioned at the transponder interaction above the object of being followed the tracks of by surveillance 100.These base stations in certain effective radius of base station off and on (for example, every n millisecond, wherein n round numbers) send RF energy.In the time that a transponder enters this effective radius, this RF energy " wakes " this transponder up, and then this transponder and this RF energy interaction are to notify this base station by an identification signal.This signal typically comprises the different information of the appended object thereon of this transponder, for example a SKU code, a source code, a quantity code etc.These data obtain supplementing of information from this transponder (for example, transmitter ID and date/time stamp), and can store as a unique record.For example, by (multiple transmitters being dispersed in a region, spread all over a shop or warehouse), this RFID subsystem can be used for the number of times of coordinate by utilizing these transmitters and they and this transponder interaction and determines position and a path that is loaded with the object of RFID label.

In certain embodiments, the alarm being created by alarm/search processing module 120 can be sent to output unit 145, for example intelligence or unintelligent terminal, network computer, wireless device are (for example, hand-held PDA), wireless telephone, massaging device, workstation, small-size computer, mainframe computer or other can be used as the calculation element that a general object computing machine moves, or only use a kind of hardware unit of special purpose to be used as the output unit 145 in system 100.In an example, for security personnel provides wireless output unit 145, these devices have text, message and video capability in the time making an inspection tour an environment being monitored.In the time generating alarm, message is sent to these output units 145, thereby these staff are guided to a specific position.In certain embodiments, video can be included in these message, thereby provide the visual confirmation of related personnel or object for these tours personnel.

In certain embodiments, these output units 145 can also comprise geography information business (GIS) data.In these embodiments, map and/or floor plan (practical photograph or its graphically illustrate) and icon information and text message combination, these information are described the object in this environment and this environment.For example, can be for wireless handheld device (as Samsung SCHi730 wireless telephone) be provided the security personnel of a large retailing store job, these devices can present figure static and/or video, and these figures comprise a near parking lot floor plan and/or this shop.Utilize the gps coordinate obtaining by similar device (or, in some cases, by spreading all over the RFID base station in this shop), can determine the position of different show areas, personnel, vending machine or group, and these position display be become to a width map in this shop.By this method, all points common, can be with respect to each point-rendering map but be likely positioned at the characteristic of diverse location.

In the time that system 100 is analyzed client and other objects mobile, the metadata that alarm/search processing module 120 use receive from video monitoring system 115 and external sensor network 110 determines whether to meet one or more rule, if meet one or more rule, generate alarm.As an example, can use manual association and/or automatic technique (based on, for example, duplicate detection is to two objects that approach very much) make the object ID associated with client with linking together with the associated product IDs of Related product.If determine this product and this client (repeatability ground, continuously or with certain fixed intervals ground) position of coexistence, can generate and show that this client has put this product into an alarm of shopping cart.If show that subsequently this product is sensed in a RFID base station in the exit in this shop, and do not show that this product has been scanned a POS base station, may show a shoplifting event.So this alarm can be transmitted to security personnel, use the security personnel of the device with GIS function can on this shop floor plan, see this product and personnel's position.

In certain embodiments, can add extra data to this show area, for example, add color to represent crowd density or a preferred path, further to assist the fast moving of security personnel to an ad-hoc location.Can also add color and strengthen the speed of effect to show that an object is moving, or show that this object is the degree of the threat of the environment structure that is monitored.In some cases, the information of upgrading can be sent to this show area, with provide the event that is monitored and object one in real time when approximate real (or) represent.

Fig. 2 has shown an exemplary embodiment of the present invention 200, wherein, configures multiple video monitors and sensor network system 100 with a kind of distributed way, to assist to monitor multiple points.As shown in the figure, this distributed video monitors and sensor network system 100 comprises at least one central authorities point 205 and multiple long-range point 210, " (being referred to as 210), these o'clocks communicate by a network 215 210', 210.As shown in the figure, this system comprises three long-range points, but this is just for the object of demonstrating, and in fact can have any amount of point 210.Each long-range point can comprise one or more key elements 220, the 220', 220 of video monitor and sensor network system 100, and " (being referred to as 220), for example, for monitoring native client software 225 and/or one or more sensor network 230 of this long-range point.In some embodiments, intelligent video surveillance system 105 complete embodiment may reside in each (or some) long-range point 210.For example, specific long-range point (such as warehouse, shop etc. in large-scale metropolitan area) can be enough large to guarantee a complete embodiment of this system, and embodiment in other typical small-sized place can be confined to the data of catching to be sent to the sensor device of central authorities' point 205.In some embodiments, put 210 for the intermediate field point of some (be conventionally greater than and be less than long-range the quantity of putting) provides video and/or sensor network data, to process, to analyze and/or to store for multiple long-range.

Native client software 225 can be assisted to the long-range connection that is positioned at central authorities' point station server of 205.In these embodiments, native client software 225 can comprise a web browser, client software or above the two.This web browser allows the user who is in one long-range point 210 to carry out requested webpage by a web-page requests or ask other Downloadable programs, small routine or document (for example,, from central authorities' point 205 and/or other long-range point 210).An example of webpage is a data file, this file comprises the executable information that maybe can compile of computing machine, image, sound, text and/or video, these contents can be shown, carry out, play, process, propagate and/or store, and also can comprise link or pointer to other webpages.In one embodiment, webpage from central authorities' point 205 of native client software 225 user's manual request.As an alternative, native client software 225 can automatically be made request in this web browser.The example of commercially available web browser software comprises the INTERNET EXPLORER that Microsoft provides, the FIREFOX that the NETSCAPE NAVIGATOR that America Online/Time Warner provides or Mozilla foundation provide.

Native client software 225 can also comprise one or more application programs, and these application programs allow the key element of a user management sensor network 230 and/or put 210 relevant rules with monitoring this special field.Can carry out these application programs with different forms, for example, with the form of a Java small routine, this Java small routine downloads in this client, and be combined operation with a web browser, or this application program can be the form of a stand-alone utility, carry out this stand-alone utility with the multi-platform language of one, for example Java, Visual Basic or C, or carry out with the executable code of local processor.In one embodiment, if carried out on the client at one long-range point 210 places, this application program is opened one and is connected by communication network 215 to the network of a server at point 205 place of central authorities, and via this connection and server communication.In a special example, can use as asynchronous JavaScript and XML(AJAX) carry out this application program as an information screen in an independent application program, the behavior that many like this users start is processed at this long-range point.In these cases, can carry out exchanges data behind with central authorities' point 205, and in the time making change at every turn without reloading any webpage of watching long-range some user, thereby improve interactive, speed and the availability of this application program.

For example, long-range field selects 210 can for example, at the upper local software 225 of carrying out of a personal computer (PC with Intel processors or an apple MACINTOSH), this personal computer can move the MICROSOFT WINDOWS series operating system of the Microsoft of State of Washington Redmond, the MACINTOSH operating system of California Cupertino Apple Computer and various Unix system, the GNU/Linux(of the SUN SOLARIS of for example Santa Clara, California Sun Microsystems, Inc. and North Carolina state Durham RED HAT company and other).Local software 225 can also be carried out on such as intelligence or unintelligent terminal, network computer, wireless device, wireless telephone, massaging device, workstation, small-size computer, mainframe computer or other calculation elements, this calculation element moves as a general object computing machine or special object hardware unit, and this hardware unit is only for a client as in this surveillance.

Multiple system mutuals at central authorities' point 205 and each long-range point 210 places.In one embodiment, the some parts of video monitor and sensor network system 100, for example intelligent video surveillance system 105, on a station server at point 205 place of central authorities, 240 carry out.In these examples, preferably on other computing machine of one or more server level, realize server 240, such computing machine has enough large internal memory, data Storage and Processing ability, and move other operating system of server level (for example, SUN Solaris, GNU/Linux and MICROSOFT WINDOWS series operating system).Also can use and be different from system hardware described herein and software according to the amount of the ability of this device, a some quantity and the data that receiving and analyzing.For example, server 240 can be a logical groups (as a server zone or server network) of one or more servers or a part for this logical groups.As another example, can there be multiple servers, they can be associated with each other or be connected, or multiple servers can independent operating, but has shared data.In a further embodiment and as the typical case in large scale system, application software can be carried out in key element, wherein different key elements on different server computers, move, operation or operation in certain combination on identical server.In certain embodiments, server 240 can be carried out or by its operation a service bureau (service bureau) or trusteeship service (hosting service) are upper, that this service bureau or host services have represented is different, be incoherent entity sometimes, these entities are wished this type of service of outsourcing.

Communication network 215 utilizes a delivery module 245 at point 205 place of central authorities that these long-range embodiments are connected with server 240.The limiting examples that can carry out the application program of the function of this delivery module comprises the APACHE webserver and WINDOWS INTERNET INFORMATION SERVER.This communication can be carried out via any medium and agreement, as above described in conjunction with Figure 1 those.Preferred network 215 can carry ICP/IP protocol communication, and the connection between HTTP/HTTPS request and local software 225 and server 240 that this local software and/or this server propose can be communicated by letter by such TCP/IP network.But the type of network is a kind of restriction not, can use any suitable network.Can comprise wireless or the wired in-house network based on Ethernet, LAN (Local Area Network) or wide area network (LAN or WAN) and/or be called as the global communications network of Internet as the limiting examples of the network of a part for communication network 215 or communication network 215, these networks can adapt to multiple different communication media and agreement.

In central authorities, a point 205 carries out in some embodiment of part or all of processing and analysis,

Server 240 can also comprise different application program modules, and these application program modules are for the relevant data of long-range point 210 of same supervision and regular definition, storage and analysis.For example, definition module 250 is assisted the rule relevant with the dependent events that may occur in these long-range point and for these rules being defined as to the definition of floor plan of a point (putting or site-specific for general) attribute, as described in more detail below.

Server 240 can also comprise a centralized storage module 255, for example Database Systems, these Database Systems are stored from these long-range point 205 data that receive, rule, user license, industrial data and the similar information relevant with these dependent events in one or more databases.This database typically offers other modules within server 240 data and is positioned at the local software 225 at long-range point 205 places.For example, this database can be provided to an analysis module 260 information, and this analysis module compares to determine whether to occur a concrete event the rule of video data and definition.In certain embodiments,, to attempt identifying special feature in these data, for example, there is more situation in a special event of specific point in this analysis module audit historical data compared with other points.Centralized storage module 255 can also comprise point other database, and this database is for video and non-video sensors data, regular key element, historical analysis, user's license etc.The example that can be configured to the database server of carrying out these and other similar functions comprises the server of describing for memory module in Fig. 1.

Server 240 can also be used as a mass storage device, and this mass storage device is used for storing application program instructions and data, and these application program instructions are communicated by letter and process these monitoring datas for putting 210 with long-range field with data.Or rather, server 240 can be configured to storage according to an event detection of the present invention and monitor application program, this is for obtaining monitoring data from the different device of multiple long-range points 210, and for processing these data at central authorities' point 205.This event detection and supervision application program comprise the executable instruction of computing machine, and in the time carrying out these instructions by server 240 and/or local software 225, monitoring data is obtained, analyzes and transmitted to this application program, as described in detail hereinafter.Can and monitor that by this event detection application storage is on computer-readable any medium, and utilizing the driving mechanism being associated with this computer-readable medium this application program to be written in the internal memory of server 240, this driving mechanism is for example floppy disk, CD-ROM, DVD-ROM driver or network drive.

In many embodiments, these long-range point 210 can be homogeneity in function and/or design; But in many examples, one or more long-range points 210 can be different from other points.For example, a department store chain can implement according to a system of the present invention in its all warehouse, distribution central authorities and retail shop, is not identical like this in floor plan, activity and the operation planning of different points.In some example, some point can be closely similar (for example, there is the shop shop front of similar designs), but can benefit from different supervision strategies due to the difference of environment, and the difference of environment is as the surrounding area of position, shop and/or a promotional event that specific shop is exclusive.In these examples, be difficult in the give a definition rule series of overall importance of different aspect of the dependent event that is described in each point of the situation that accuracy is not caused to obvious impact or excessively do not increase employee's burden.

Fig. 3 has described the configuration of key element event more than, this configuration balance for the demand of concentrated rule definition and open-ended embodiment, this embodiment is wished localization input and the customization at these long-range point.In general, the multiple key elements of configuration of the present invention (wherein some are in fact of overall importance, are not distinctive its characteristic for any special point) combine with formation event 305 with a distinctive key element of point.The detection of each key element that then, can be based on defining in this event carrys out the generation (or not occurring) of detection event 305.For example, a certain key element of an event can be a position 310, physically discernible place of for example sales counter of a point of sale, outlet, corridor, doorway or other.The key element of event 305 can also comprise that multiple object 315(are as a particular commodity in a retail shop) and multiple behavior 320(as select and/or purchase object 315 or personnel in this some movement everywhere).

These events can be used as rule and implement, and these rules are for testing these events in the generation at one or more some places or not occurring.A kind of possible form of these rules is to adopt Boolean logic.Adopt a fraudulent employee to return goods event as an example, a rule can be expressed as " if ((having processed the return of goods at XXX POS) and (there is no (YYY article are present in ZZZ camera views)) give the alarm "." XXX " refers to and is assigned to unique No. ID of of each POS workstation herein, " YYY " refers to a specific product, " ZZZ " refers to and is assigned to unique No. ID of an of video camera, and this video camera has a visual field corresponding with this POS workstation.The definition of this rule and associatedly can being determined by hand by an onsite user of the knowledge with this specific POS workstation and these camera positions of this system of thus this POS workstation ID being carried out with this region ID, and this product information can by one lack field put special knowledge but know this particular commodity frequent stolen or by duplicity the user that returns goods carry out global definition.

In general, an alarm rule utilizes Boolean logic (for example, "AND", "or", Not operator) that the key element of event and these events is combined, and this can detect on a given sensor network.For example, POS event can comprise " returning goods processed ", " cashier's machine is opened ", " ZZZ project is bought " etc.Video system event can comprise " object existence ", " object moves ", " number of objects >N " etc.Security system event can comprise " No. #123456 card is swiped the card ", " door is opened ", " movement being detected " etc.

Can these events be combined to produce the statement of reporting to the police with Boolean logic, these statements of reporting to the police can be at random complicated.One rule can be made up of one or more warning statements.If whole statement be evaluated as "True", generate an alarm.For example, in the time an eas (EAS) event being detected, consider whether an alarm has two people to leave shop to detect.These event arguments are " label being detected " and " number of objects >2 ".If two key elements are all "True", this event has occurred and has given the alarm so.Therefore, compound being expressed as " (#123 EAS detects label) and (number of objects >2 in #456 region) ".As previously mentioned, by unique No. ID for making this special EAS pedestal close a relevant range of linking on suitable video camera.

As another example, can trigger based on detecting two people to use a certificate to enter a restricted entrance (being commonly referred to " incidentally ") alarm.This alarm rule is similar to EAS alarm rule above: " if (#834 door is opened) and (#532 section object quantity >2) give the alarm ".Other alarms can be based on objects such as hazardous material (fluids), automobile and goods movement, these move determines whether this object is entering a restricted region, whether moving too fast or whether move in the moment that should can't detect action.

Employee's swindle of returning goods is similar with detecting, and understands the cashier of a POS workstation and when opens and do not exist client useful often.These events show that employee steals conventionally.As a more complicated regular example, to the detection of this event can with employee return goods swindle rule combine, with a rule, both of these case all can be detected like this: " if (((at the processed return of goods of #XXX POS) or (opening at #XXX POS cashier's machine)) and (there is no (object is present in #YYY region)), give the alarm ".

Together, each key element provides a part for this event, and for example client chooses commodity and brings it to a cashier's machine.Although can this event of abstract definition, not with reference to any specific cashier's machine, monitoring arrangement 325 for example, for monitoring the maybe operating area 330 of this device (radius of clean-up of the visual field of a video camera or a RFID sensor) of this cashier's machine, but not entirely accurate of this event, until this type of information is added to this event.Therefore, the ability of the definition of individual event key element being distributed to the personnel of the physical attribute of being familiar with uniquely single point allows the overall object of these events to be consistent between these points, and allow these events to carry out necessary customization, so that the different physical characteristics of these points to be described.

In many cases, name a person for a particular job and share some characteristic (for example, they all have passageway, door, dressing cubicle, show area etc.) in each long-range field, but customized configuration characteristic can be different.As an example, a convenient chain shop can have self-service food court, refrigerator and a rest room in each shop, but due to different floor plans, the physical relation between these regions will be not identical.More particularly, the refrigerator in a shop can be put along wall paper after, the position of check-out counter be and outlet along same face wall, but refrigerator is in a passageway at middle part, shop in another shop, check-out counter is on the opposite of outlet.

In the time that the event of these definition is relevant with a special shop, in order to be further convenient to the execution of these defined events, can define a general point template (or moulding plate series), this template representative is from the one " canonical form (canonical form) " of these some floor plans of each long-range point.For example, this standard floor plan (for example can define a field point, wall, outlet, passageway, room etc.) any amount of general-purpose attribute and physical characteristics, these general-purpose attributes and physical characteristics are that these points are total, and in some cases event is associated with one or more elements of this floor plan, as being described in more detail below.In certain embodiments, for example, if this user has certain knowledge for a set of special some layout, this standard floor plan can comprise the combination of generic features and a peculiar element of point.

Fig. 4 to Fig. 6 shows a kind of different embodiment of technology, and this technology is used for crossing over multiple different points and carries out a rule-based surveillance.This process can be divided into three unique stages on the whole: a definition phase (shown in Figure 4 generally), define the global property of event, and can form one general some floor plan at central authorities' point in this stage; Customization and supervision stage (shown in Figure 5 generally), during this stage, can make these events and/or floor plan customize for these independent field points and for monitoring the activity at these some places; And, warning and analysis phase (shown in Figure 6 generally), during this stage, at central authorities some receiving alarm and sensing data, and analyze these alarms and sensing data to identify trend in these data and abnormal.

In the time describing the different task of this technology, will run through and below mention two user roles.First, one " central user " is responsible for carrying out the task of being attached to central authorities' point, and these tasks are in fact as a rule of overall importance, is applicable to some (being whole in some cases) long-range point.Secondly, one " long-distance user " is responsible for carrying out the task of being attached to long-range point, and these tasks are as a rule distinctive for specific (or a small group) long-range point.Conventionally by these Task Authorizations to long-distance user, because lacking this peculiar knowledge of point, central user (for example carries out this task, be that event is assigned a specific video camera), or it is more efficient that the user that the amount of task makes to cross over larger amt shares out the work.

Referring to Fig. 4, a central user of this system carries out different tasks, these task definitions these events multiple key elements that are independent of point and can be as an one or more universal plane arrangenent diagram for the starting point of the peculiar floor plan of point.More specifically, this central user will usually define an event configuration (step 405) by the difference of identifying these events.As mentioned above, these key elements can be independent of point or a point distinctive.Be independent of an example for the event argument of putting and comprise behavior (for example, the selection of article, movement, purchase etc.) and object (for example, personnel, product, automobile, cash etc.).Point peculiar key element example comprise monitoring sensor, for example video camera, point of sale workstation, RFID transmitter, contactless card reader and be arranged in these points everywhere for receiving other devices of monitoring data.

Key element as position can be to be that what be independent of point is also that a point is distinctive.For example, central user can carry out definition position according to general character, for example outlet, point of sale sales counter, dressing cubicle, parking lot and/or the special passageway of product or show area, in the case of these positions at known each (or several) long-range some place exist.Then can be by long-distance user by the abstract position defining at central authorities' field point be converted in the physical location of this long-range point and customizes these positions.

Utilize the different key element of defined event, central user can be given for the information (step 410) of some or all overall key element.For example, central user can stipulate a behavior (for example, selecting behavior for) of the attribute of an event based on for example, as two objects (, a client and a specific products).In certain embodiments, these events can comprise each do not occur of the combination of multiple behaviors, multiple object and multiple positions and they.Each key element can have one or more threshold values associated with it (as date/time parameter) and counting, and these parameters can be set jointly by central user, long-distance user or the two in some cases.These parameters also can based on meet a threshold value and/or an event generation (not occurring) requirement and manually and/or automatically reset.By time-based parameter being defined as to the attribute of these behaviors, the threshold value of these events can be adjusted, and its mode is to make to report by mistake minimized this event that simultaneously allows to detect exactly.For example, one can comprise three behavioral primitives for detecting the event of shoplifting, and for example selection of article, one are left and lacked once and sell; Two project key elements, for example, in a personnel and commodity extraordinary item; And, two position elements, i.e. a point of sale sales counter and an outlet.Once these events are defined, can distribute (step 415) be used for further customization and carry out to these long-range point.

In certain embodiments, central user also defines one or more standard floor plans (step 420) that can be used as the template of these remote locations.In some cases, a standard floor plan can be for long-range all points; But in many cases, multiple standard floor plans can be designed for the template of the subset of long-range point, these subsets are shared a lot of features.For example, large-scale retail chain store can have the shop of many warehouses and center for distribution and a lot of different brands, for example for teen-age shop, for baby father and mother's shop with for professional person's shop.In this case, central user can be a standard floor plan of field point definition of every type.In some example, for example, for the standard floor plan of the field point (for youth shop) of a type can be as a template of the standard floor plan (having possibly a small amount of modification) of other points (as the shop for professional person).The quantity of the different standard floor plan that can create is actually unrestricted, but conventionally depends on that similarity degree between these points and central user can provide the design of these floor plans.Can also annotate one or more events (step 425) be assigned to these long-range points (step 430) of these standard floor plans.Thus, for these long-distance users provide an initial event set and a universal plane arrangenent diagram, these long-distance users can build thus a field and put peculiar floor plan and put the distinctive definition that will usually complete these events by adding field.

Each event framework, event, floor plan template and their combination for example can be stored in, in the centralized storage module 255 of server 240 of () central authorities point.

Referring to Fig. 5, these long-distance users receive these events and/or floor plan (step 505), and utilize local software described here and system to customize these events and/or floor plan, to meet the individual demand of one group long-range point each long-range point or in some cases.For example, the distinctive key element of field point (step 510) of these events that these long-distance user's definables are initiated by central user, this is by adding or revising unique position elements for a site-specific.For example, a long-distance user can be to the one or more monitoring sensors of location assignment, and such one " choosing commodity from beverage show area " event has video camera, a RFID sensor with the radius of clean-up that comprises this show area in the visual field that comprises this show area and/or is associated for following the tracks of the position of the object in this show area or other mobile sensors with one.Be divided in some embodiments of multiple subregions in the visual field of a video camera (or other sensors), long-distance user can be by using an interactive graphics interface to select region of this floor plan and subregion that a video camera ID and a sub regions ID are all assigned to this event.

In certain embodiments, the event of long-range definition and/or the key element that forms these events can be reused at independent field point, also can be reused by central user, central user can utilize the understanding of long-distance user to this point in the time of the event subsequently of structure and floor plan template like this.For example, this central user can define a position elements if " cosmetics end cabinet (makeup endcap) " is for being included in retail shop's floor plan, and can have some parameter position, associated with it (highly, time cycle, sensor ID number) based on being defined by long-distance user.

These long-distance users can also set the parameter being associated with these events.For example, some shop can keep the time different from other shops, or has the extra security personnel's of requirement special time, and therefore, the time parameter that determines these events can be different between shop and shop.As another example, the time span for example, allowing between two events (, a shopper chooses article and leaves a shop) in the shop with larger overlay area compared with bantam shop may need longer.

Receive in the embodiment of a standard floor plan at one long-range point, this long-distance user can customize this floor plan (step 515) to meet the demand of this site-specific.For example, central user may provide a general layout, and this layout has four passageways, two point of sale location and an outlet.But if this long-range point has six passageways, three point of sale location and two outlets, this long-distance user can add necessary element, this floor plan just represents the practical layout of this point more exactly like this.In addition, central user may arrange these elements with a kind of usual manner, and does not consider these elements and/or the relation between body of wall around.Equally, this long-distance user can (for example, use above-mentioned local software 225, hereinafter describe in detail) and adjust this floor plan, so that this floor plan reflection (or being extremely similar to) actual field point.

In some example, central user may define an event, and it is associated with an element of standard floor plan, for example, the customer choice of a commodity item and a special passageway are associated, and this believes that based on him this association is is common in multiple points.But, (be for example inaccurate in this association, in a specific shop, do not have this product, or this product remains on after sales counter) situation under, this long-distance user can break this association, redefine this event, different elements of this event and this floor plan are associated or any combination of above-mentioned behavior.In some example, if put unmatched words with this long-range field, long-distance user can delete event or the event argument of central authorities' definition.By a building block by event driven surveillance is provided to long-distance user, wherein this surveillance maintains certain consistance of crossing over multiple points, and still allow to customize these events in this some level, this system balancing data general-purpose and a variable demand of point, name a person for a particular job and receive comparable data from these different fields points in this central authorities field like this.

Once customize these events and/or this floor plan for this point, these events are implemented (step 250) in this surveillance.In certain embodiments, this enforcement comprises the event of these customizations and/or floor plan is saved in to the centralized storage module at server.In other embodiments of implementing in long-range some place in this surveillance (or its multiple parts), local storage 525 can be for storing these events and floor plan and application code, and this application code is used in point on the scene (step 530) by system and monitors the activity that relates to these events.

In the time of this point of this system monitoring (or after it), information can (program automatically, manually or above the two) be sent to this central authorities' field point.For example, be positioned at the embodiment of long-range point for this alarm/search module (120 in Fig. 1), in the time that occurring, these events generate alarm, and except sending to local security personnel, these alarms can also be sent to central authorities' point (step 535) to cross over the analysis and comparison of multiple points.In other embodiments, video data also can be sent to these central authorities' field points (step 540), or transmit in real time for event handling and generate alarm, or periodically transmit to provide and cross over a video of point and centralized storage and the analysis of associated metadata.In some cases, these video datas can for example, send with batch mode (, every night once) at peak absences, thereby avoid blocking up and transshipping of data processing resources.Similarly, also can will be sent to this central authorities' field points (step 545) from the sensing data of other sensors (RFID, POS etc.) for similar purpose.

Referring to Fig. 6, receive these alarms, video and/or sensing data (step 605,610 and 615) at this some place, field of central authorities, can store (for example, being stored in centralized storage module 255) here and process these data.In certain embodiments, these data are gathered (step 620) and are analyzed (step 625).Can gather and analyze these alarms according to triggering official hour in the event of these alarms, a point (or multiple points) and/or object.For example, if the personnel at some place of central authorities wish to cross over multiple points relatively with special article (for example, shaver, babies ' formula milk powder etc.) relevant shoplifting event, can choose all alarms of event based on thering are these article, and divide into groups according to field point.In some example, the video of catching in this event procedure and/or sensing data can be further analyzed (step 630) to determine that whether this event is wrong report, or determine in this event procedure, whether there be other behavior or the object that should consider in the time revising these events.For example, this analysis can be undertaken by the central analysis module 260 being positioned on server 240.

Based on this analysis, can identify exceptional value (step 635), these exceptional values show that one or more events are defined inadequately.As explanation, if an event is assigned to a large amount of field points, the average of the alarm receiving from each shop can show " typically " event rates for the type field point.But, from one specific some received quantity significantly more greatly or significantly less (for example, than the standard deviation more than large twice of mean value) event may show that this event is defined inadequately at this point, or show in other some practical works that other parameters of this point compare with it not identical.For example, the distinctive key element possibility in position of this event is inaccurate (for example, a wrong passageway is belonged on a product, or a region has been assigned wrong video camera), sensor may lose efficacy or a long-distance user may destroy this system to hide the stealing based on employee.In these cases, this central user can advise these events to modify, or carries out voluntarily in some cases this modification (step 640) and these events are re-assigned to affected point (step 650).

Deduction relation between these points, position, event and the interior object of a point also can be for generating other alarm, and these other alarms can be assigned to these points.For example, can be different with two in certain time interval of comparing of traveling time between a point from these two different alarms that points receive, wherein this alarm shows that identical (or relevant) commodity item is stolen, and this may mean that same person has carried out this twice stealing.Once determined the contact of such one, this central authorities' field point can transmit a secondary alarm (comprise, for example, text, video and/or above the two) to the some place, field in the certain radius of stolen point of these projects, warn these points to note possible stealing.This field point selection that can be based on manual for determining of these long-range points, or automatically carry out based on being stored in the historical data at this some place, field of central authorities in some cases.When relation is then and there assigned to these points, secondary alarm can generate at one first some place, and is sent to the field point being confirmed as to this first point " relevant ", and this can determine by geography, product line or other historical datas.

In the situation that receiving these alarms and some or all sensing datas at a some place of central authorities, can be by additional rule application in these sensing datas.For example, additional rule in itself more complicated (for example, determining pattern or trend in these data) and/or be can confirmation property (for example, copying the rule that is assigned to long-range point, to confirm that these rules are just returning to the alarm of correct number).These sensing datas can also combine with (accurately with inaccurate) data with alert of reality, and can be as the input of a training algorithm, and in this training algorithm, system effectively " study " is identified dependent event more exactly.

Except the use of security incident aspect, these data can also be used for marketing and operation object.For example, can definition event monitor selling cheap, new product release, customer flow or the marketing activity during the relevant period.Can gather the alarm of the generation based on this type of event relatively to cross over multiple shops and the overall Customer Experience at different time, to determine the validity of sales promotion, price and other things relevant to commodity.

Referring to Fig. 7, an example of application screen comprises the user interface 700 of a menu-drive, and this user interface is for implementing above-mentioned system and technology.Interface 700 comprises four major functions: template definition 705, position definition 710, event definition 715 and event/position display 720.Template definition function 705 is assisted definition and revised can be as a standard floor plan of the starting point of the peculiar layout of point.Position defined function 710 is assisted a universal location of definition, at this universal location place, one or more behaviors occurs, and has multiple object interactions.The uniqueness of these positions can the most general situation as Yishanmen to special position as #2 warehouse No. #3 loading frame scope in change.Event definition function 715 allows user to define the combination of these events as one or more event arguments, also allows user that attribute or parameter are associated with these events, illustrates in greater detail as described above and below in connection with Figure 10.The field point that event/position display 720 allows user audit defined position and event and these positions and event in this system to be assigned to.

Referring to Fig. 8, an example of application screen comprises a stencil design user interface 800, and this user interface is for creating floor plan and the template of standard.This user interface comprises that a field point template 805, a template parameter select region 810 and a template behavior region 815.Template 805 is implemented as an interactive interface, and this interactive interface allows the element of user's selection, editor, interpolation, deletion and mobile this floor plan.In certain embodiments, these element representations are the application object with the attribute such as size, height, thereby allow this user to stipulate the size with respect to other objects (for example, unit, pixel etc.) of an object and use absolute value representation (for example, inch, foot etc.).Template 805 can respond user/display screen interaction of " drag and drop " formula, and this interaction is based on adopting fixed-point apparatus as the keyboard input of mouse or light pen and/or order input.User interface 800 being offered in user's embodiment by a browser application, these objects can be expressed as an object in the window based on Flash, an or AJAX application program, the order of the editor who is started by user like this and mobile these template objects is mainly processed in this client machine, and requires to commute the minimal data transmission of a station server.

Template parameter region 810 provides the region for inputting and check the parameter being associated with this template.More specifically, this user can stipulate the type (for example, warehouse, retail, bilayer, suburb, common etc.) of this template, the date created of this template and one or more the points that this template is assigned to.Template behavior region 815 provides the object that can take action (for example, hyperlink, control knob, combo box etc.), for example, in the time that user selects these objects, these objects are assigned to this template a specific point (or some group), (for example disclose this template, open to long-distance user), and copy this template to start the establishment of a new template.

User interface 800 also comprises template elements storehouse, these storehouses can be used for establishment event, make element become template attribute or above the two.Say clearly, user interface 800 can comprise a library of object 820, location library 825, behavior storehouse 830 and an event base 840.Each storehouse provides corresponding element a list, and user can utilize these yuan to be usually combined into an event (as mentioned above) and/or the position in this template.Each template base further provides the required ability to adding element in this storehouse.

A user can be by selecting a key element and this key element being pulled in the position in template 805 and utilized from the event in these storehouses and/or event argument and explain these templates.For example, this user may wish to utilize the fixing wall in two sides 845, passageway 850, a check-out counter 855 and a commodity displaying district 860 to create a template.In many cases, the floor plan representing in this template can actually not described any site-specific, but can be used as a starting point for customization (below describing in detail in connection with Figure 12 and Figure 13) by long-distance user.

In certain embodiments, user interface 800 can also comprise a sensor bank (not shown), this sensor bank provides a list of operational sensor in different sensors network and video monitoring system, thereby allow this user (for example to add general purpose transducer to this template, video camera) and/or the position of sensor special (for example, #321 video camera).In the situation that this template is just defined by a central user, these templates are stored in central authorities' point, and can after completing, " disclose " long-distance user.

Referring to Fig. 9, an example of application screen comprises a position definition of user's interface 900, and this user interface is used for defining the position of this location library, and can be for explaining floor plan and/or establishment event.User interface 900 comprises region 905 and 910, and user can for example, input this two regions by a full name (, the blue jeans goods platform before shop) and an abbreviation (blue jeans goods platform) respectively.The text box 915 of a location type, for this user provides a region, stipulates the type (for example, goods platform, door, sales counter, rest room, parking building etc.) of the position being just defined in this region.Describe region 920 for one and allow this user to input a longer textual description of this position, the text is described other correlation properties that can comprise as the coordinate of this position, the instruction of carrying out this position and this position.A contact area 925 is caught the user's who creates this position a attribute, as e-mail address, user name, employee-number or a responsibility.The framework that submit button 930 for example, creates user, this system of this position according to () implement or other parameters based on system by this position and its attribute be saved in centralized storage module, remote storage modules or above the two.

Referring to Figure 10, an example of application screen comprises an event definition user interface 1000, and this user interface is in event of this system definition (once and modification) after definition.As mentioned above, an event can build from one or more event arguments, as behavior, position and object and further describe the parameter how this event is implemented and when implemented.Typically, definition event-consumers interface 1000 is used for providing a key element that is independent of field point for these events, such as time parameter, universal location, behavior etc. by central user.But, in certain embodiments, may give the authority of this definition Event Function of remote user access, to create complete the distinctive new events of point.In some cases, a central administrator can permit or this type of function of denied access by the mode of per user.User interface 1000 comprises an event title region 1005, and this region is for catching a title of this event and identify this event (being to identify uniquely in some situation) in this data memory module.A band of position 1010 provides a list of the available position that can be associated with this event.Parameter region 1015 provides the ability of assigning date and/or time range to this event for this user.For example, be parked in a show area for detection shopper and can be defined as the date and time in this shop business with the event of choosing commodity before.

The key element based on behavior of project 1020 and 1025 these events of assistance definition is chosen in behavior.For example, in a retail shop arranges, may be related around the behavior of a special show area, for example a shopper is parked in before a show area, selects article and these article are put into shopping cart.But, judge exactly whether an event attribute of specific behavior occurs to require time-based parameter to be defined as.Say clearly, in order to determine whether a user is parked in before a show area, whether can use " residence time " parameter to detect this shopper has stopped the sufficiently long time veritably (for example, exceedance second) has checked this commodity before this show area.Similarly, one period of longer residence time, this product also had no attraction or price suitably not for example, in conjunction with one " without behavior " (, not selecting commodity) although may illustrate that this show area is attractive for buyer.

These behaviors can contribute to by through but (for example ignore this show area, there is no residence time, do not touch commodity but gone to this show area) buyer's quantity and buyer's the quantity that attracted to this show area (for example, the residence time in exceedance second touch commodity) compare to determine the validity of a show area.In addition, these statistics and the macromarketing volume based on as POS data can be compared, and compare with the buyer's who enters this shop sum.Detect and add up the behavior that specific buyer occurs when the specific position and different points crossing over other and carry out more similar event and just can make " standardization " the also absorbed behavior that directly contributes to buyer and commodity interaction effectively of these events by removing a peculiar generation difference of point.

Referring to Figure 11, an example of application screen comprises an event edits user interface 1100, and this user interface is used for revising an event and assigns a peculiar element of point to this event.In certain embodiments, for example (previously, by a central user) input and be that the data that a long-distance user is presented in user interface 1100 are read-only, but in some cases, specific element can be read-only (for example, the parameter based on title and time) and other data elements are editable.In each case, user interface 1100 also comprises an appointment video camera choice box 1105 and an appointment sensor choice box 1110.When a long-distance user receives instruction in the time that their field point (or some group) is carried out this event, this user can make a choice from the operational video camera of her site-specific and/or sensor id.Allow long-distance user to examine these events and select suitable sensor to improve for example probability of correct this event of camera record for detecting this event.

Referring to Figure 12, an example of application screen comprises an edit model user interface 1200, the shop floor plan template that this user interface is provided by a central user for allowing long-distance user to customize.Except the function and characteristic of stencil design user interface 800, edit model user interface 1200 allows user (central user or long-distance user) to revise these templates, makes like this these templates describe better a site-specific.This library of object can comprise in different video camera 1210 and some situation of sensor 1215(identified by unique ID), can select and locate these video cameras and sensor at the diverse location that spread all over floor plan.For example, a user may know that a particular camera is fixed on a specific wall and points to a passageway, and therefore this video camera is placed on to this position.Similarly, a RFID sensor or other similar EAS devices can be placed on this shop outlet.In some cases, this template can comprise the element (wall, passageway, show area etc.) being added by central user, and these elements are positioned at these long-range some place but are not properly oriented.In these cases, this long-distance user can select these elements and change their location in this some floor plan.For example, in primary template, be oriented to can be moved perpendicular to a passageway 1220 of the specific wall of one side, so that it is parallel to this face wall now.Similarly, commodity displaying district 1220 also can move, so that its end in the passageway in new placement still.Point of sale location 1430(for example, a check-out counter) also can be based on this point physical plane arrangenent diagram and move to its tram.In some cases, can add extra element (for example, the extra wall 1440 of one side) to complete this floor plan.Once complete after the distinctive change of field point for this floor plan, this floor plan is saved (be saved in remote memory, central memory or above the two) and is used as monitoring the basis of these points.In some cases, before implementing and/or being used as template in the future, these changes are sent back to a central user to be given the ratification.

Referring to Figure 13, an example of application screen comprises a floor plan mapping user interface 1300, and this user interface is used for a physical plane arrangenent diagram at the element map to of an a standard floor plan long-range some place.Similar with edit model user interface 1200, floor plan mapping user interface 1300 allows user to build a peculiar floor plan of point to implement in an above-mentioned surveillance; But it provides a visual statement of template 805 and existing some floor plan 1305, thereby allow this user to explain and manipulate a some floor plan 1305 by this template.In certain embodiments, electronics statement for a long-range floor plan of putting can obtain from other channel, such as architectural drawing, building layout, design drawing etc., and this user may wish to use the starting point of these drawings as the peculiar floor plan of this point.For example, this user shows the position of video camera and/or sensor 1310 in can on the scene some floor plan 1305, and option show the actual location in their on the scene some floor plans 1305 from template 805.Specifically, can in template 805, be selected, pull in the floor plan 1305 of showing up and be placed on correct position such as the such element in passageway 1315, POS device 1320 and commodity displaying district 1325.In some cases, element can be added to floor plan 1305, for example entrance 1330.In some cases, allowing this user to implement template 805 for before monitoring this point, system requirements user shows up all projects " placement " of carrying out self-template on a floor plan 1305.Consequently by one complete and accurately some floor plan offer system, for detecting the dependent event at this some place, and and do not require that central user has deep understanding to each long-range point, but guarantee to implement at each some the event of certain minimum number.

Except standard floor plan element map is arrived actual floor plan, actual floor plan element can also be mapped on standard floor plan element, thereby shows specific event to be assigned to the element in this standard floor plan to a central user.This method is further assisted the comparison of code requirement standard flat arrangenent diagram " point show up a little ", puts peculiar parameter and the data that capture but used based on field.For example, for example, in order relatively to there is the total volume of the flow of passengers between multiple (, more than two) shop of different physical plane arrangenent diagrams, can on this standard floor plan, draw event data.Consequently, central user can identify the product of crossing over the event of multiple points or having the unexpectedly high proportion of goods damageds, and needn't first consider these different fields point floor plans.

For these methods being provided as for the embodiment of one or more software programs, this program can be write with any one in multiple higher level lanquage, as FORTRAN, PASCAL, JAVA, C, C++, C#, BASIC, different script and/or HTML.Adopt such as the client/server technology of ODBC and Direct data access and by network service, XML and AJAX technology, can between different application programs and memory module, transmit data.In addition, this software can be implemented with a kind of assembly language, and this assembly language is implanted in the resident microprocessor of an object computer; For example, this software can be implemented with Intel80x86 assembly language, if it is configured to move on an IBMPC or clone PC.This software can be embodied in a kind of manufacture on article, includes but not limited to floppy disk, hard disk, CD, tape, PROM, EPROM, EEPROM, field programmable gate array or CD-ROM.

Without the marrow and the scope that deviate from desired invention, one of ordinary skill in the art will be expected change, modification and other embodiments to content described herein.Therefore, the present invention is not described to limit by above illustrative, but is limited by marrow and the scope of following claims.

Claims (25)

1. a method of assisting activity to monitor and detect for using video monitor and sensor network system (100) event at multiple different some place, described video monitor and sensor network system (100) have video monitoring system (105) and at least one external sensor network (110) the method comprises:

In rule/metadata store module (150) of described video monitoring system (105), provide set of rule, this cover rule description at least one event of being concerned about and comprise the distinctive key element of at least one point and at least one is independent of the key element of point;

At least one is independent of a key element for point to use the definition module (250) of described video monitoring system (105) to define this;

Use described video monitoring system (105) via communication network (215), this cover rule to be distributed to each in described at least one the external sensor network (110) that is disposed in a plurality of different some place, aid in thus the plurality of different point these peculiar key elements of at least one point of definition and use described at least one external sensor network (110) to monitor at each some place according to these rules;

Alarm/search processing module (120) at described video monitoring system (105) is located, receive one or more alarms from any being disposed in each described at least one external sensor networks (110) of the plurality of different points, one or more in the event that these alarms indications have occurred to be concerned about at corresponding some place, field; And

Use described alarm/search processing module (120) of described video monitoring system (105) to gather these alarms that receive, assist the statistical study of these alarms with this;

Wherein this gathers and comprises the average of determining the alarms that receive from the subset of described multiple different points during predetermined time section.

2. the method for claim 1, wherein, the peculiar key element regulation of each point is selected from lower group one or more, and this group comprises: at least one position of at least one point of described multiple different points, floor plan diagram data, and sensor identification data.

3. the method for claim 1, wherein each key element regulation that is independent of point is selected from lower group one or more, and this group comprises: at least one behavior, at least one object, and with a people of this at least one object interaction.

4. method as claimed in claim 2, wherein, this sensor identification data comprises one or more in video surveillance camera ID, RFID sensor ID, eas sensor ID and contactless card sensor ID.

5. the method for claim 1, further comprises these alarms that analysis receives, in order to determine that whether one or more in the peculiar key element of these points are secondary optimization.

6. the method for claim 1, further comprises and analyzes these alarms, in order to detect the inconsistency between each the peculiar key element of these points belonging in described multiple different points one or more.

7. method as claimed in claim 6, further comprises and revises the regular allocation that uses the peculiar key element of at least one point of a rule and this has been revised to field point observing inconsistency.

8. the method for claim 1, further comprises based on one or more alarms that receive in order to a secondary alarm is sent to a field point.

9. method as claimed in claim 8, wherein, these alarms that receive of this secondary alarm institute foundation are that the field point outside the field point transmitting from this secondary alarm receives.

10. method as claimed in claim 9, wherein, the relation of a kind of deduction between putting based on the field of it being transmitted to the field point of this secondary alarm and receive these alarms from it is determined the field point that it is transmitted to this secondary alarm.

11. the method for claim 1, further comprise: from this, at least one point receives monitoring data; And by one or more this monitoring datas that are applied in these rules, detect thus one or more in these events of being concerned about that at least one point occurs at this everywhere.

12. methods as claimed in claim 11, further comprise one or more in these events be concerned about that occur of at least one point based in the plurality of different points everywhere and generate an alarm.

13. methods as claimed in claim 12, further comprise and gather these alarms, assist the statistical study of these alarms with this.

14. methods as claimed in claim 13, wherein, this gathers the average that is included in during a predetermined time section event of subsets based on occurring in the plurality of different points and determines alarm.

15. methods as claimed in claim 13, further comprise and analyze these alarms that gather to determine that whether one or more in the peculiar key element of these points are secondary optimization.

16. methods as claimed in claim 13, further comprise and analyze these alarms, to detect the inconsistency between each the peculiar key element of these points in one or more points that belong to the plurality of different points.

17. the method for claim 1, are further included in different the relevant peculiar key elements of point this at least one point of definition.

18. methods as claimed in claim 17, further comprise that the peculiar key element of at least one point is sent to a central authorities point to be given the ratification by this.

19. 1 kinds for assisting activity to monitor and detect the system of the event at multiple different some places, and this system comprises:

For defining the rule definition module of set of rule, every rule is described one or more be concerned about events and is comprised one or more the peculiar key elements of point and one or more key element for point that is independent of;

Delivery module, this delivery module is for being sent to one or more different point by one or more of these rules, aid in thus the definition of described one or more the peculiar key elements of point of described multiple different points, wherein this delivery module is configured to receive one or more alarms from these points, and each alarm indication one or more in these events of being concerned about has occurred and used video monitor and sensor network system and being produced; And

Analysis module, this analysis module is for gathering these alarms that receive, assist thus the statistical study of these alarms, wherein this analysis module is further analyzed these alarms gathering, to detect the inconsistency between the one or more peculiar key element of these points belonging in the plurality of different points.

20. systems as claimed in claim 19, wherein, this analysis module is further configured to analyzes these alarms that gather, to determine that whether one or more in the peculiar key element of these points are secondary optimization.

21. systems as claimed in claim 19, wherein, this rule definition module is further configured to these inconsistencies based on detecting and revises these rules.

22. systems as claimed in claim 19, wherein, this delivery module is further configured to these rules of revising is sent to these long-range point.

23. the method for claim 1, further comprise: the field point layout of a standard is provided, and this some layout regulation is positioned at least one shared element of multiple points, and each point has an actual field point layout; By being assigned to one or more shared elements, one or more events do not consider that actual field point layout creates a gauge field point layout that has note; Assist the modification of this layout that has note so that it is consistent with the field point layout of these reality; And monitor this point according to the corresponding amended layout that has note of each point.

24. methods as claimed in claim 23, wherein, these modifications comprise one or more in following processing: position that an element, change of deleting this gauge field point layout that has note has with this that element of the gauge field point layout of note is associated and have the element of gauge field point layout interpolation of note to this.

25. systems as claimed in claim 19, further comprise: user interface, the field peculiar frame of point and modified module, this user interface has field point layout templates frame, this some layout templates frame is used for showing described gauge field point layout, the peculiar frame of this point is for showing the actual field point layout of monitored field point, and this modified module is for assisting at least one to be independent of the associated of an element of point and the peculiar element of the field of this actual field point layout point.

Images