Background technology
In current environment to the movable growing interest of crime and terrorist, the video monitor those skilled in the art recognize the limitation of current system rapidly, but are especially facing may rarely have highly catastrophic extensive threatening environment the time.In addition, those skilled in the art also recognizes the value by the information that monitors derivation that is used for commercial object, for example arrival-departure time; Activity is browsed in retail; Or travel pattern.
The response of current video surveillance is current and can predict the limited in one's ability of demand.Especially, the current video surveillance often be aspect enforcement flexibility seldom and to the mixing of the very strong video monitor equipment of the resistance of centralized telemanagement.Aspect enforcement, lack flexibility and be the result of the special-purpose solution of the structure of relevant video monitoring system up to now.In the prior art, this solution is at the supervision equipment at specific threat environment customization " customization " integrated relative low technical in the monitoring component, for example video camera.This solution may produce the generation ability of some complexity, in case but government or large-scale company attempt disposing existing fail safe solution to having many positions different and safety issue of conflict sometimes, just find to have important and crucial limitation.
As a result, government or company often face situation about starting anew, and wherein must obtain the new and unique surveillance of each facility structure of surveillance coverage at expectation.Because security expert's quantity is relatively limited, and the enforcement time of custom video surveillance is longer, legitimate reading is must be by closely to dispensing surveillance coverage in mid-term, and its logical consequence is that some facility is had to have limited or do not had the video monitor ability.Obviously, in the current threatening environment that increases day by day, this delay has tragedy and even terrified result.
Another problem of current video surveillance is its resistance to centralized management.Because many existing video monitoring systems are special-purpose in nature, they lack versatility naturally.This means and seek to realize that the government of centralized and top-down video monitoring system rwan management solution RWAN or large-scale company face unique monitoring component and for example different control protocol; Ability; With the set of data format, wherein each assembly can easily manage in the locality, but when connecting, its management may be the entity from the long-distance area hardly.
Therefore, those skilled in the art expects to improve existing video monitor technology.Especially, those skilled in the art expects to obtain having the member (for example video camera) of intrinsic programmability highly.This programmability will cause implementing many improvement of time cycle.By the capability on a large scale that is subjected to programming Control is provided, will significantly reduce needs to time-consuming special implementing.On the contrary, by this member, the security expert can realize the rough profile of video monitoring system rapidly, and the then operation by centralized programming Control rapid refinement system.
In addition, those skilled in the art expectation obtains one group of public control protocol that is used to control with the activity of managing distributed video monitoring system.This needs some reasons.At first, because the current video surveillance often is special-purpose and unique, the management agreement set of the distributed video surveillance that does not therefore have known being used to manage to constitute by the height programmable structure.Secondly, because the part of surveillance will be highly programmable and carry out centralized control easily, so need utilize the management agreement of these features.
Summary of the invention
According to the currently preferred embodiment of these guidances, overcome above-mentioned and other problem, and realized other advantage.The present invention includes be used to develop and manage long-range, distributed, modularization and can expand the method and apparatus of camera surveillance system.
Especially, the of the present invention first optional embodiment comprises the video monitoring system module, and it comprises: video surveillance camera, and wherein video surveillance camera is long-range programmable; Video encoder is used for the video that video surveillance camera is collected is encoded; With the video analysis engine, it is connected to the video that video surveillance camera is collected with the analysis video surveillance camera, and produces the data that derived by video analysis.
Especially, the of the present invention second optional embodiment comprises at least one video monitoring system module, and it comprises: video surveillance camera, and wherein video surveillance camera is long-range programmable; Video encoder is used for the video that video surveillance camera is collected is encoded; With the video analysis engine, it is connected to the video that video surveillance camera is collected with the analysis video surveillance camera, and produces the data that derived by video analysis.
The of the present invention the 3rd optional embodiment comprises the video surveillance camera cluster of incorporating in the video surveillance camera system, and this video surveillance camera cluster comprises: the unique identifier that is used for identifying the video surveillance camera cluster by video monitoring system; At least one video monitoring system module, this video monitoring system module comprises: video surveillance camera, wherein video surveillance camera is long-range programmable; Video encoder is used for the video that video surveillance camera is collected is encoded; With the video analysis engine, it is connected to the video that video surveillance camera is collected with the analysis video surveillance camera, and produces the data that derived by video analysis.
The of the present invention the 4th optional embodiment comprises the video surveillance camera system front end, and it comprises: at least one video monitoring system module, and this video monitoring system module comprises: video surveillance camera, wherein video surveillance camera is long-range programmable; Video encoder is used for the video that video surveillance camera is collected is encoded; With the video analysis engine, it is connected to the video that video surveillance camera is collected with the analysis video surveillance camera, and produces the data that derived by video analysis; At least one video monitoring system network, it is connected at least one video monitoring system module; With the remote video monitoring system control interface, it is connected at least one video monitoring system network, is used to control the operation of at least one video monitoring system module.
The of the present invention the 5th optional embodiment comprises signal bearing medium, it visibly embodies and can be carried out program of machine-readable instruction with the operation that develops and manages that comprises video monitoring system by the digital processing device of computer system, this operation comprises: distribute unique identifier to set up at least one the video surveillance camera cluster that is made of at least one programmable vision surveillance camera by at least one video surveillance camera at least one video surveillance camera cluster and this video surveillance camera cluster of formation, wherein unique identifier will be used to the operation of managing video surveillance camera cluster and at least one video surveillance camera that constitutes this video surveillance camera cluster in electronic database system; At least one video surveillance camera that constitutes this video surveillance camera cluster is programmed; The video data that at least one video surveillance camera of this video surveillance camera cluster of the formation of serving as reasons is gathered distributes unique identifier, wherein when preserving by the video data of at least one video surveillance camera collection so that when retrieving later on, unique identifier is used for this video data is classified by Database Systems; To operate at least one video analysis that the video data that at least one video surveillance camera that constitutes this video surveillance camera cluster is gathered is carried out with selecting.
So visible embodiments of the invention have overcome the limitation of prior art.Especially, above-mentioned prior art video monitor assembly is special-purpose through being everlasting in nature, and is not easy expansion.On the contrary, method and apparatus of the present invention has been simplified distributed greatly, and the foundation of modularization and extending video surveillance is implemented and management.
For example, video monitoring system module of the present invention has been simplified the foundation of the rough profile of video monitoring system greatly.This can realize by the modularization and the programmability of video monitoring system module.The user only need establish the desired locations of video surveillance camera, then connect (for example by using the video monitoring system network) desired locations to accept the video monitoring system module, follow the video monitoring system module for example is inserted on the video monitoring system network.Because video surveillance camera and video analysis engine are highly able to programme and long-range programmable, mounting technique personnel need not be provided with camera motion at each camera position spended time; On the contrary, the mounting technique personnel can be by network remote visit and programming video surveillance camera and video analysis engine.This function is particularly useful for the situation that a plurality of video cameras are used to observe single position; The long-range programmability of video camera allows mounting technique personnel optimal solution rapidly.
Another advantage of the present invention is the modularization of the video monitoring system intermediate level of video surveillance camera cluster representative.The ability that one group of video monitoring system module in can the video surveillance camera cluster of unique identification is associated has been simplified the management of distributed video surveillance greatly because the video surveillance camera cluster will with the specific buildings position; Inlet; Or the address is associated.This allows surveillance technology personnel to monitor the overview of one group of cluster with the physical environment that obtains rapidly being monitored.In addition, the modularization of cluster representative has been simplified the expansion of distributed video surveillance greatly, because it occurs in the system framework, and the data that this framework unique identification video monitoring system equipment and video monitoring system are produced.
Another advantage of the present invention is to can be used for user's the service and the assembly of management agreement.The popularity of available management agreement has been simplified the realization to the fine degree of the control of the video monitoring system of being managed greatly.
In a word, the above-mentioned summary of optional embodiment of the present invention is exemplary and nonrestrictive.For example, those of ordinary skill in the art will appreciate that, can combine to produce the new embodiment in the scope of the invention with one or more aspect or the step from another optional embodiment from one or more aspect or the step of an optional embodiment.
Description of drawings
When reading in conjunction with the accompanying drawings, the above-mentioned and others of these instructions below can be clearer in the detailed description of preferred embodiment, wherein:
Figure 1A has described the module map in conjunction with the front end of the electric video monitoring camera system of video surveillance camera tissue, and it comprises the video surveillance camera system and forms according to the present invention;
Figure 1B has described the module map in conjunction with the front end of the electric video monitoring camera system of the programming view tissue of video surveillance camera, and it comprises the video surveillance camera system and forms according to the present invention;
Fig. 2 has described the data flow architecture according to distributed video monitoring camera system of the present invention;
Fig. 3 has described the control flows architecture according to distributed video monitoring camera system of the present invention;
Fig. 4 has described the data flow architecture according to optional distributed video monitoring camera system of the present invention;
Fig. 5 has described according to optional video monitoring system architecture of the present invention;
Fig. 6 has described when setting up modularization and extending video surveillance by the operation of carrying out based on the method and apparatus of the embodiment of the invention;
Fig. 7 has described and can be used for realizing and manage classification based on the service agreement of modularization of the present invention and extending video surveillance;
Fig. 8 has described and can be used for realizing and manage specified cluster related service agreement based on modularization of the present invention and extending video surveillance;
Fig. 9 has described and can be used for realizing and manage specified cluster video camera related service agreement based on modularization of the present invention and extending video surveillance;
Figure 10 has described and can be used for realizing and manage particular camera related service agreement based on modularization of the present invention and extending video surveillance; And
Figure 11 has described and can be used for realizing and managing based on the particular video frequency of modularization of the present invention and extending video surveillance and analyze the related service agreement.
Embodiment
In the schematic block diagram of Fig. 1-5, illustrate specific embodiments of the invention and feature.The module map of Figure 1A has been described the part of the video monitoring system front end 100 that comprises root video monitor cluster 102, and root video monitor cluster 102 comprises each video surveillance camera cluster 112,114.Each cluster 112,114 comprises at least one video surveillance camera; For example, cluster 1 comprises 4 video surveillance cameras 122,124,126,128, and cluster 114 comprises a video surveillance camera 130.
Each video camera that comprises the video surveillance camera cluster is preferably highly programmable, has programmable swing lens, tilts zoom and digital zoom feature.Each video camera also has view (view) program capability, wherein by from waving, tilts, and the view that the operation of the specific collection of selecting at least one of zoom or digital zoom option or motion constitute is programmed to operation or motion sequence.In certain embodiments, each video camera can have a plurality of programming views, as video camera among Figure 1A 124, shown in video camera 128 and the video camera 130, video camera 124 has view 142,144 and 146, video camera 128 has view 148 and 150, and video camera 130 has view 152 and 154.
Except view programming, analyze video according to one or more user-specific criteria (criteria) corresponding to the particular figure 146 of gathering by video surveillance camera 124 by video analysis engine 214.Video analysis engine 214 produces track (track) information 162 by the video of analyzing by the video surveillance camera collection of for example video surveillance camera 124.Shown in Figure 1A, on the given view 146 of video surveillance camera 124, carry out video analysis.Trace information comprises the pointer that points to the video that satisfies user-specific criteria at least.For example, if the incident that this standard enters the visual field of video camera corresponding to automobile, then the video analysis engine will produce the trace information that comprises the pointer that points to each video section at least, and it has write down the appearance of the automobile that comes into view.
The embodiment that describes with Figure 1A is opposite, and the embodiment that describes among Figure 1B is organized into the cluster of programming camera view.In the situation of the embodiment that describes at Figure 1A, video surveillance camera front end 170 comprises root cluster 171, and root cluster 171 further comprises cluster 172 and 173.Each cluster 172,173 comprises the programming camera view of selecting from different video cameras.For example, cluster 172 comprises the view of selecting from video camera 11 (174); View 3 (175) from video camera 2 selections; With the view of selecting from video camera 52 (176); And cluster 173 comprises from the view 4 (177) of video camera 7 with from the view 3 (178) of video camera 9.In addition, the video analysis operation can be applied to the view cluster, or constitutes each view of cluster.In addition, can be from the cluster being data and the alert if that the angle at center is reported to be derived by the video analysis that is applied to the view cluster.
This feature description concrete advantage of the present invention be can be easily and constantly at the specific threat environment and custom video monitors and analytic activity.The video monitor analyst does not face such situation resembling in the prior art, wherein predetermined video monitor option when setting up video monitoring system; But when implementing method and apparatus of the present invention, the video monitor analyst constantly Adjustment System to adapt to the threat situation of differentiation.
Fig. 2 has described the data management details, and Fig. 3 has described the control and management details of the video monitoring system 200 that forms according to the present invention.Especially, video monitoring system 200 partly comprises a plurality of video monitoring system modules 210, and video monitoring system module 210 comprises video camera 212; Video analysis engine 214; Video encoder 216; With camera control unit 218.At least one video monitoring system module comprises the video surveillance camera cluster among Fig. 2 and 3 embodiment that describe.Video monitoring system module 210 is certain benefits of the present invention, because they provide programmability, modularization, flexibility and the extensibility of height.Can carry out remote programmable by each video surveillance camera 212 in 218 pairs of video monitoring system modules of camera control unit.In addition, video analysis engine 214 is long-range programmable, thereby allows the long-range designated analytical standard of user.In the data flow that Fig. 2 describes, the data that the analysis of the video that the video analysis engine will be gathered according to video surveillance camera 212 by video monitoring system network 215 is derived are sent to electronic database system 220.
In Fig. 2 and 3, described cellular system network 215, but in various optional embodiment of the present invention, the video monitoring system network can be divided into the various component network of operating according to variety of protocol.For example, the part of video monitoring system network can be hard wired, and other parts can be wireless.In addition, can be at the different wired and wireless network protocols of the use at all levels of system.
Electronic database system 220 comprises database server, is used for the data that video analysis engine 214 produces are received and classify; Video Manager is used to receive the video through video encoder 216 codings; With application server 226, be used for the managing video surveillance application.In Fig. 2 and 3 specific embodiments of describing, carry out the enforcement and the management of video monitoring system 200 by the electronic database system 220 of video monitoring system 200, and the managing video surveillance operation.In optional embodiment, can manage these activities by discrete means.
In addition, Database Systems have been described to database server 222 and Video Manager 224 integrated in Fig. 2 and 3.In optional embodiment, these can be discrete; And in other embodiments, in large-scale distributed video monitoring system, a plurality of database servers 222 and Video Manager 224 can be arranged according to the present invention's operation.In fact, be used to identify the video surveillance camera cluster; Video surveillance camera; The use of the GUID of video surveillance camera view and trace information has reduced the data base administration expense widely, because needn't manage the sign activity concentratedly, and makes it possible to realize the distributed video surveillance.
In Fig. 2 and 3 embodiment that describe, 2 application 228 and 230 are mutual by electronic database system 220 and video monitoring system 200.Especially, using 228 is to be used to realize that the control with managing video surveillance system uses, and is to be used to control the surveillance application of utilizing the surveillance operation that video monitoring system 200 finishes and use 230.For example, in each embodiment, video that surveillance application 230 can automatically be gathered video monitoring system 200 and data dissemination are to the video monitor analyst of execution monitoring activity.In other embodiments, surveillance application meeting receiver, video monitors the inquiry of the electronic database system 200 that the analyst worked out; Find out the data and the video that satisfy inquiry, and shown in Fig. 2 and 3 with browser form 240 video datas and video.In a further embodiment, surveillance application 230 can produce the alert if that is used for to the video monitor analyst warning of carrying out the video monitor activity.These variety of options can also be simultaneously available in single embodiment.
In Fig. 2 and 3, can find out the certain benefits of method and apparatus of the present invention.For example, can carry out video analysis continuously, thereby produce accessing quasi real time to help for example public security activity or to lag behind the database that enriches of accessing more with the object that helps investigative action and event data by video analysis engine 214.In addition, obviously can expand video monitoring system by adding modularization video monitoring system module 210 with Fig. 2 and 3 architectures of describing.By being the video surveillance camera cluster; Video surveillance camera; With video surveillance camera view allocation unique identifier, this is more prone to.The distribution of unique identifier not only helps the classification and the file of data and video in the electronic database system 220, and help the formation of video monitor analyst to the perception of situation, wherein by video surveillance camera and the related perception that increase video monitor analyst of view with unique identifier.
In addition, distribute to cluster, the unique identifier of video camera and view can also serve as based on the Web address in the system of Web, thereby simplifies mutual with the electric video surveillance greatly.For example, if live present relevant with the particular camera view seen in video monitor analyst expectation, then the analyst only need use the address of unique identifier input camera view to form a part of address of visit camera view.
Optional video monitoring system according to method and apparatus operation of the present invention has been described in Fig. 4.In Fig. 4, video analysis engine 214 is programmed the object detection of carrying out object detection and uses 250; Execution uses 252 to image tracing to image tracing; Carry out the object classification application 254 of object classification; Use 256 with the activity analysis that executed activity is analyzed.In the embodiment that Fig. 4 describes, analytic activity is applied to from the video of single video surveillance camera 212 collections, thereby illustrates that a plurality of video analysis activities can be applied to this video simultaneously.
Video encoder 216 comprises that a plurality of video codings use, thereby provides large-scale option for the video monitor analyst who uses video monitoring system.Especially, video encoder 216 comprises MPEG4 encoder 260; Windows media encoder 262; With Verint encoder 264.
The database server of describing among Fig. 4 222 is programmed to respond the data that receive from video analysis engine 214 and carries out various warnings.For example, the programming of database server comprises the acceleration alert applications 270 of sending the acceleration warning; Send the car alarming of car alarming and use 272; The application 274 of sauntering that sending saunteres reports to the police; With other application 276 of sending other warning.In other embodiment (for example embodiment that describes among Fig. 2-3), also warning this locality can be embodied as by at least one video analysis engine 214 and carry out.
Subsidiary details according to video monitoring system 200 of the present invention has been described in the conceptual module figure of Fig. 5.Video monitoring system 200 comprises at least one data processor 301 that is connected at least one system bus 302, and wherein data processor 301 can addressing abbreviates the memory sub-system 303 of memory 303 here as by this system bus 302.Memory 303 can comprise RAM, ROM and fixed and movable dish and/or tape.Memory 303 is assumed to be at least one program of storage, and this program comprises the instruction that is used to make that data processor 301 is carried out based on the method for instruction of the present invention.Data processor 301 also is connected to user interface by bus 302, user interface is preferably graphical user interface (" GUI ") 305, comprise for example one or more keyboards, mouse, trace ball, the user input device 306 of speech recognition interface, and high graphics CRT monitor terminal for example, user's display device 307 of LCD display terminal or any appropriate display equipment.By these input-output apparatus, the user can carry out the method step of the present invention of the value that wherein needs user's appointment.
Data processor 301 also can connect network interface 308 by bus 302, and network interface 308 provides the two-way access to the video monitoring system network 215 of for example in-house network and/or internet.In various embodiment of the present invention, can pass through display 307 and input equipment 306 executive system realizations and management and surveillance operation.
Usually, can realize these instructions in the following manner: use personal computer, server, microcomputer, mainframe computer, portable computer, at least one software program that moves on the embedded computer, or by with electronic database system 200 on the management of resident video monitoring system use 228 and the programmable data processor 301 of any suitable species of video surveillance applications 230 compounding practices.The video monitoring system technical staff also can comprise the video monitoring system module 210 of at least one video surveillance camera cluster 211 by display 305 and input equipment 306 management.
An advantage of the invention is can be fast and easily construct the distributed video surveillance.This is the result who is embodied in the modular concept in the system of reflection among Fig. 3-5, wherein is used to develop and manage the firmware of video monitoring system and software and is designed to the video surveillance camera with height programmability and the video analysis engine operation of methods of video analyses on a large scale is provided.
The step of having described the method according to this invention among Fig. 6 and having carried out by program according to the present invention and equipment.Fig. 6 has usually described step or the operation of being carried out by apparatus and method according to the invention when setting up video monitoring system 200.In Fig. 6, first operation 410 comprises that wherein unique identifier will be used to the operation of at least one video surveillance camera of managing video surveillance camera cluster and this video surveillance camera cluster of formation in electronic database system by being that at least one video surveillance camera cluster and at least one video surveillance camera that constitutes this video surveillance camera cluster distribute unique identifier to set up at least one the video surveillance camera cluster that is made of at least one programmable vision surveillance camera.Operation 420 then comprises programmes at least one video surveillance camera that constitutes this video surveillance camera cluster.Then, executable operations 430, be included as the video data of gathering by at least one video surveillance camera that constitutes this video surveillance camera cluster and distribute unique identifier, wherein when preserving by the video data of at least one video surveillance camera collection so that when retrieving later on, unique identifier is used for this video data is classified by Database Systems.Then in operation 440, selection will be operated at least one video analysis that the video data of being gathered by at least one video surveillance camera that constitutes this video surveillance camera cluster is carried out.
Except the operation that Fig. 6 describes, comprise that the Additional Services agreement of other operation can be used for realizing and managing according to video monitoring system 200 of the present invention.Especially, Fig. 7 has described the general category that wherein has various such service agreements.For example, there is cluster associative operation 600; Cluster video camera associative operation 700; Camera operation 800; With video analysis operation 900.The special services agreement that occurs in these classifications has been described in Fig. 8-11.
In Fig. 8, describe available cluster related service agreement, comprised the agreement that is used for following purpose: created cluster 610; Name cluster 612; Deletion cluster 614; Revise cluster 616; List available cluster 618; Cluster explanation 620 is provided; Fetch cluster explanation 622; With with cluster relevant with address information 624.In various embodiments, cluster can comprise static video camera; Video camera with viewer capability able to programme; Or video camera with plurality of programmable viewer capability.In addition, cluster can comprise the view of selecting from some different cameras.Except the operation that Fig. 6 describes, can carry out these operations, be used to develop and manage according to video monitoring system of the present invention.
In Fig. 9, described available cluster video camera related protocol, comprised the agreement that is used for following purpose: added video camera 710 to cluster; Name video camera 712; With deletion video camera 714.
Described the video camera related protocol among Figure 10, comprised the agreement that is used for following purpose: the inclination 812 of 810 video surveillance cameras of programming; Wave 814; Zoom 816; With digital zoom 818 motions or operation; The camera view that programming is made of at least one operation or the motion of video surveillance camera 820; A plurality of views 822 of programming; Deletion view 824; Revise view 826; With view specification 830 is provided.
Described the video analysis related protocol among Figure 11, comprised the agreement that is used for following purpose: selection will be to the video analysis 910 of video execution; Begin video analysis 912 and stop video analysis 914.Video analysis can be applied to single camera; The video camera cluster; Or the cluster of camera view, this is similar to the operation that control of video is analyzed.
So can find, above-mentioned explanation provides the foundation that is used for of the current consideration of inventor by exemplary and nonrestrictive example, realizes the best practice of management and expanded mode blocking and distributed video surveillance and the abundant explanation of the complete sum of equipment.It will be understood by those skilled in the art that the various embodiment that describe can implement separately here; Combine enforcement with one or more other embodiment that describes here; Or be different from here the video monitoring system of describing and combine enforcement.In addition, it will be understood by those skilled in the art that the present invention can implement by the embodiment that is different from described embodiment; The embodiment of these descriptions is used for diagram and nonrestrictive purpose; And the present invention is only limited by claim afterwards.