JP2003101994A - Monitoring camera system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a monitoring camera system capable of improving monitoring accuracy, reducing monitoring labor and enhancing monitoring inside an area. SOLUTION: The monitoring camera system is provided with a camera 1 photographing a monitoring area, a moving object detecting/tracking means 2 for detecting a moving object from a monitoring image based on photographing of the camera and tracking it, a movement information computing means for computing movement information of the moving object, a monitoring information storage means 4 for storing monitoring information such as the monitoring image, detected/tracked results of the moving object and the movement information, an area specifying means 7 specifying a partial optional area in the monitoring area as the area and preparing the monitoring information inside the specified area, and an image display means 6 for selectively displaying a part or all of the monitored information. For the camera 1, coordinates in the monitoring area are made to correspond to a plurality of photographed monitoring images.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a surveillance camera system for assisting surveillance by detecting and tracking a moving object to be monitored such as a person or a vehicle by image processing.

[0002]

2. Description of the Related Art Surveillance camera devices are used in financial institutions, commercial facilities, parking lots, etc. in order to detect intruders and grasp the usage status of users. In many conventional surveillance camera devices of this type, a monitoring person monitors a moving object to be monitored, such as a person or a vehicle, in a monitoring area while looking at a captured monitoring image. For this reason, for example, the monitoring area is photographed by using a plurality of monitoring cameras, and the monitoring images by the individual monitoring cameras are switched through the image selecting means to display or record.

On the other hand, in a store or the like, the flow line of a person, that is, the movement locus is one of the factors that influence sales. Therefore, in order to increase the sales, the flow lines are investigated to improve the layout of the store or change the composition of the displayed products. However, the conventional flow line survey is based on a method in which a surveyor follows a visitor and writes his / her behavior on a survey form each time.

[0004]

In the conventional surveillance camera apparatus, there is a problem that the surveillance operation is often performed by the observer while watching the surveillance image, and accurate surveillance cannot be performed when the surveillance area is wide.

On the other hand, the conventional flow line survey has a problem that it takes much time, labor and cost. Moreover, the flow line survey results were difficult to understand just by looking at non-specialists such as store managers. Therefore, there is also a problem that it is difficult for the store side to understand. In addition, it is easier to understand the current situation by looking at the current flow line while comparing it with the ideal flow line and the flow line when good results were obtained in the past (for example, when high sales were made). The above surveillance camera device cannot satisfy such requirements.

[0006] Further, there is a demand that the prioritized area in the monitoring area, which has a great influence on sales, be analyzed satisfactorily, and the layout be reasonably improved based on the analysis to increase sales. It was difficult to respond.

The present invention automatically detects and tracks a moving object to be monitored, calculates movement information, stores the monitoring information, and designates a partial area of the monitoring area as an area to monitor the area. It is an object of the present invention to provide a surveillance camera system capable of improving surveillance accuracy, reducing surveillance labor, and strengthening surveillance in an area by creating information.

The present invention provides a surveillance camera system that divides a surveillance area into a plurality of zones and counts management indexes such as sales in each zone, thereby making it easy to grasp a partial area in the surveillance area. The other purpose is to provide.

[0009]

According to another aspect of the present invention, there is provided a surveillance camera system comprising: a camera for photographing a surveillance area; and a moving object detecting / tracing means for detecting and tracking a moving object from a surveillance image based on photographing by the camera. And; movement information calculation means for calculating movement information of a moving object; monitoring image, detection of moving body
Monitoring information storage means for storing monitoring information such as tracking results and movement information; area designating means for designating an arbitrary partial area in the monitoring area as an area and creating monitoring information in the designated area; monitoring Image display means for selectively displaying a part or all of the information;

In the present invention and the following inventions, the definitions and technical meanings of terms are as follows unless otherwise specified.

<Regarding the camera> As the camera, it is preferable to use a camera such as a video camera capable of capturing a monitoring image composed of moving images. Further, one or more cameras can be appropriately used as required depending on the size of the monitoring area. Further, the processing of the monitoring image based on the photographing by the camera may be performed by either digital processing or analog processing, but the digital processing is easier to process the image capturing such as clipping of the image. Furthermore, the surveillance image may be either color or monochrome.

Also, multiple cameras can be used to cover a given surveillance area. In other words, when the surveillance area is large, it is difficult for one camera to clearly capture the entire surveillance area. Therefore, different cameras share different locations in the surveillance area. In that case, it is difficult to grasp which part of the monitoring area is the monitoring image by simply displaying the monitoring images taken by the individual cameras in parallel as individual images. The coordinates in the entire monitoring area are associated with the captured image for each device. Therefore, it becomes possible to accurately grasp which part of the monitoring area is displayed by the image captured by the camera.

<About Moving Object Detecting / Tracking Means> The moving object detecting / tracking means is a means for automatically detecting a moving object in a monitoring image based on the image picked up by a camera and for tracking the detected moving object. . The moving object is detected by performing image processing on the moving image. For example, when trying to detect a person as a moving object, a stationary object and a moving object are identified by difference processing between a plurality of image frames, and it is further determined whether the moving object is a person to be monitored. In order to distinguish the moving object to be monitored from other moving objects, the characteristic amount of the moving object to be monitored is stored in advance, and the characteristic amount is read out and compared with the characteristic data in the detection data. Good. Further, when a moving object to be monitored is detected, it is possible to further determine the direction of the moving object and what kind of operation the moving object is performing from the change in the operation to obtain the operation information of the moving object.

Further, how the moving object to be monitored which has been detected as described above has moved, that is, tracking of the moving object is obtained in time series by obtaining position information such as the center of gravity of the moving object. This can be done by comparing the movement of the location information from the surveillance image. It should be noted that the detection and tracking of the moving object may be performed so that the moving object may be performed individually or as a set, or may be configured to be switchable so as to be performed each time. . In order to detect and track at least a set of moving objects, the moving object detecting / tracking means comprises means for counting the number of moving objects.

Further, as a preferable structure of the moving object detection in the moving object detecting / tracking means, it is determined whether the moving object is a monitoring target, and how the moving object operates. The judgment is made separately. The former determination is performed by comparing the feature amount of the moving object, which is stored in advance, with the detected feature data of the moving object. The latter determination is based on a change in the feature amount or the like in the detection data of the moving object. This facilitates the detection of the moving object to be monitored and the operation of the moving object, that is, the detection of the motion information.

<Movement Information Calculating Means> The movement information calculating means is a means for calculating movement information regarding the detected moving object. That is, in the present invention,
The “movement information” includes at least information about the movement trajectory, movement distance, movement time, and movement speed of the moving object to be monitored. Furthermore, if necessary, information such as acceleration can be added for calculation. Of the above various information, the movement trajectory information can be obtained by tracking a moving object. Further, the movement distance information can be calculated from the movement locus in a certain time based on the movement locus information. Furthermore, the travel time information can be calculated from the time required to travel a certain distance based on the travel trajectory information. Furthermore, the moving speed information can be calculated based on the moving distance and the moving time. The acceleration can also be calculated based on the moving distance and the moving time. The above calculation items are useful for monitoring the monitoring area and planning the layout of the monitoring area. Of course, if required,
It goes without saying that it is possible to calculate items other than the above, such as the acceleration of the moving object.

Next, when monitoring a set of a plurality of moving objects, the movement information calculating means can calculate the density, the average velocity, the average movement vector, etc. of the moving objects, if desired. Here, the “density of moving objects” indicates the number of moving objects per unit area of a specific partial area in the monitoring area, and means the degree of congestion of moving objects in the specific space. Therefore, the density of the moving object is calculated based on the area of the specific partial region and the number of moving objects existing therein. The “moving object average movement vector” can be calculated by the average movement distance and movement direction.

By the way, in the construction field, in places where people are congested such as blame passages and ticket gates at stations, conducting lines are planned in consideration of the flow of people. Also in the transportation field, traffic flow plans are being carried out for the purpose of alleviating traffic congestion.
However, when there is no suitable technology to measure the congestion of moving objects consisting of a set of people or vehicles, and when obtaining a conductor of a set of people, the person who measures enters the crowd and measures the flow line. ing. In such a measuring method, there is a problem that time and labor are spent and labor cost increases. On the other hand, some of these facilities have surveillance cameras installed,
Mainly used only for monitoring, not for flow line measurement.

The set of moving objects is detected, the movement of the set is tracked, the movement information of the set is calculated, the monitoring information of the set is stored, and further the movement information, the layout of the space, the action parameters of the set, etc. are stored. When predicting the flow line of a set based on the information or using the past monitoring information by searching the stored monitoring information, the movement information of the set includes the density of the set, the average speed of the set, and the average movement of the set. For example, a vector. As the layout condition of the space, for example, the size of the space and the number, size and position of obstacles such as furniture are set. As the condition of the action parameter, for example, age, sex, weather, congestion degree, passage width, attention information (display, broadcast, etc.) are set. As a result, a set of people and vehicles is used as a moving object, which is effective for widespread use such as monitoring and layout examination in many fields such as the construction field, traffic field, and commercial fields such as stores.

<Regarding Monitoring Information Storage Means> In the present invention, the “monitoring information” means information related to monitoring such as monitoring images, moving object detection / tracking results and movement information.
The monitoring information storage means selectively stores some or all of the monitoring information. Further, it is also allowed to store information related to the monitoring information, if desired. When the monitoring information is stored, the attribute information of the moving object to be monitored, for example, when the moving object is a person, the sex, the age, and the like can be stored in association with each other. Various known storage means can be used as the recording means. For example, a storage means having a large storage capacity such as a hard disk, a DVD, a memory card, an MO disk, a video tape is suitable.

<Regarding Area Designating Means> The area designating means is a means for designating a partial area of the monitoring area as an area and creating the monitoring information in the designated area. The designated area is allowed to be one or more. The monitoring information in the area to be created may be any information, but for example, the number of moving objects in the area is counted, and the moving speed of the moving objects and the flow line obtained by tracking the moving trajectory are calculated. Alternatively, a surveillance image in the area can be formed. When forming the above-mentioned movement information, the movement information calculation means may be in charge of calculation of movement information within the designated area. Further, in the case of the surveillance image, the surveillance image captured by the closest camera in the designated area can be substituted.

<Regarding Display Means> The display means is a means for displaying a part or all of the monitoring information of the entire monitoring area or the area and related information, and displays one or both of the current data and the past data. It can be configured to display. Further, the monitoring information can be configured to display either one or both of the entire monitoring area and the specified area at the same time. Further, as the display means, various known display means can be appropriately selected and employed. Furthermore, the display means can use a single or a plurality of display means for displaying a plurality of current monitoring information. For example, the image display section of a single display means may be divided into a plurality of pieces for multiple display, or a plurality of display means may be arranged side by side to display one on one side and the other on the other side. You may be allowed to do.

<Regarding Other Configurations> Although not essential to the present invention, by adding the following configuration,
The functions of the surveillance camera system are improved and the convenience is increased.

1 Retrieval Means The retrieval means retrieves the entire past surveillance area or the current surveillance information stored in the surveillance information storage means and displays the retrieved desired surveillance information on the display means. Is a means to do. The monitoring information to be searched is not particularly limited, but monitoring images,
It is convenient to be able to search the moving object flow line tracking result, the moving information of the moving object, and the like. In addition, the search includes time such as date and time, items of monitoring information, attribute data of moving objects to be monitored, monitoring information stored with a specific mark,
It can be configured such that appropriate matters such as a content pattern can be performed individually or in combination.

Then, desired information is retrieved from past monitoring information, and the current monitoring information is selectively displayed,
By referring to it, you can easily understand the current status of the monitoring area,
Moreover, it can be performed accurately. Therefore, when considering the layout of the monitoring area, it is easy
And it can be done accurately.

(2) Comparison display of the current monitoring information and the past monitoring information The current monitoring information and the past monitoring information can be displayed on the display means in a comparable manner. Further, not only the flow line of the moving object to be monitored, but also other monitoring information such as a monitoring image, the current state and the past monitoring information extracted by the search can be displayed side by side.

A moving body tracking technique using moving image processing is
In the field of TS (Intelligent Transport System) and the like, research is actively conducted, and traffic flow monitoring, road monitoring, traffic volume measurement, and road information provision for abnormal traveling using moving images are being performed. In addition, moving object tracking technology is being researched in a wide range of fields, such as measuring the trajectory of soccer players and measuring crowd flow at station ticket gates.

Measuring the flow of a moving object means
It can be said that the current situation is being measured in order to bring that flow closer to a certain goal (state, grade, etc.). However, while tracking and recording the moving object, displaying the current monitoring information, searching for a desired flow line from past monitoring information,
The current flow line and the past flow line can be displayed at the same time. At this time, the attribute information of the visitor, such as gender,
The age, etc. can be displayed at the same time. This allows
It is possible to support the flow line evaluation.

By displaying the present and past monitoring information in a comparable manner, it becomes easy to grasp the current situation.

<Regarding Operation of the Present Invention> In the present invention, based on the configuration described above, a moving object to be monitored, which is a single object or a set, is selected from the monitoring images captured by the camera as a whole or area of the monitoring area. Is automatically detected and tracked, moving information including the moving distance, moving time and moving speed of the moving object is calculated, necessary monitoring information is stored, and part or all of the monitoring information is displayed. Can be displayed on the means. Therefore, even if the monitoring area is wide, monitoring can be performed easily and accurately. Therefore, it is possible to reduce the monitoring labor.

Further, by designating a part of the monitoring area as an area, the monitoring information in the area, for example, the number of moving objects to be monitored and their flow lines are calculated and displayed, or the monitoring information in the area is displayed. By displaying the monitoring image in parallel with or independently of the above, it is possible to strengthen the monitoring especially in the priority area in the monitoring area and to grasp the current problem and improve it. It will be easy to do.

Furthermore, since it is possible to specify a plurality of areas to be specified, it is possible to strengthen the monitoring of a plurality of important areas at the same time.

According to another aspect of the invention, there is provided a surveillance system, a camera for photographing a surveillance area; a moving object detecting / tracing means for detecting and tracking a moving object from a surveillance image based on photographing by the camera; movement information of the moving object. And a monitoring information storage unit for storing monitoring information such as a monitoring image, a moving object detection / tracking result, and movement information; A zone dividing means for counting a commercial index for each zone; and an image display means for selectively displaying a part or all of monitoring information.

Generally, in a store, there are a sales floor and a product display shelf called a gondola that have a great influence on sales increase, while there are places and a gondola that have a small influence on sales increase. Therefore, when monitoring a sales floor or a gondola for the purpose of increasing sales, it is a good idea to intensively monitor a sales floor or a gondola that has a large effect on sales increase, rather than targeting the entire sales floor, that is, the monitoring area.

The present invention is characterized in that a zone dividing means is provided in place of the area designating means in claim 1.
Different from

<Regarding Zone Dividing Means> The monitoring area is configured as a plurality of zones uniformly divided so as to be predividable in terms of counting, and a commercial index of a sales floor or a gondola in the zone is set for each zone. It is configured to count. The “commercial index” is an index value associated with commercial activities that is generally used in “balance sheet”, “income statement”, etc. such as sales amount, profit margin, and inventory quantity. As the size of multiple zones divided uniformly,
From the viewpoint of facilitating monitoring of product sales, it is preferable to divide the monitoring region into, for example, a grid in an appropriate area, for example, a unit of about 1 tsubo.

In order to count the commercial index in the zone, for example, the information of the products exhibited in the zone may be associated with the zone, and the commercial information may be counted using the zone as a key. Further, the counting of commercial indexes can be relatively easily performed by using POS data or the like.

Further, by designating a zone, the commercial index in the zone can be displayed on the display means. In addition,
The designated zone is configured to allow one or more zones.

<Regarding Other Configurations> Although not an essential component of the present invention, the area designating means defined in claim 1 can be added if desired. Thereby, while strengthening the monitoring of the area which is the important area in the monitoring area, it is possible to simultaneously watch the commercial index count of the zone including the area. For this reason, it becomes possible to know the priority order and problems by correlating the current state of the layout as a store in the priority area and the commercial index count.

<Regarding Operation of the Present Invention> In the present invention, the monitoring area can be arithmetically divided into a plurality of zones,
Since the commercial index is counted for each zone, a desired zone in the monitoring area can be designated to know the commercial index count value in the designated zone. As a result, it is possible to know the priority of the zone in the store.

Further, it is possible to display a plurality of zones in a store side by side, for example, in descending order of sales rate and profit rate. As a result, it becomes easy to understand the zones with high sales and profit rates.

Further, it is possible to set the purchase rate to 30% in advance as a warning standard and display the zones exceeding the warning standard. As a result, it is possible to easily grasp the zone where the problem occurs.

Furthermore, by adding the area designating means defined in claim 1, for example, by displaying the movement information mainly on one or a plurality of sales floors having a high profit margin, the purchase behavior of the visitor can be emphasized. It can also be monitored.

The surveillance camera system according to the invention of claim 3 is
The surveillance camera system according to claim 1 or 2,
It is characterized by comprising a moving body flow line predicting means for predicting a flow line of a moving object.

The moving object flow line prediction means is means for predicting the movement of the moving object as a flow line based on the movement information, and obtaining the prediction result. For this reason, the moving object flow line prediction means may be provided with a learning function so as to learn past movement information and movement information based on assumed conditions stored in advance for learning. The flow line can be obtained for both a single moving body and a set of moving bodies. Therefore, it is possible to switch between a single unit and a set. In this case, you may make it interlock with the same switching of the movement information calculation means.

Further, in order to predict the flow line of the moving object of the set, the moving object to be monitored is regarded as a fluid, and position information of obstacles in the monitoring area is introduced into the operation to perform the hydrodynamic operation. By doing so, it is possible to accurately predict the flow line of the moving object to be monitored.

Thus, according to the present invention, the movement prediction of the moving object to be monitored can be calculated as the flow line prediction and displayed, so that the movement line can be simulated by simulating the flow line of the monitoring area. The layout can be effectively planned while considering the flow line of the object. Further, by using the flow line prediction result, it is possible to improve the monitoring accuracy.

The surveillance camera system according to the invention of claim 4 is
The surveillance camera system according to any one of claims 1 to 3 is characterized in that the surveillance information and related information can be monitored from a remote location.

The present invention is constructed so that it is possible to monitor facilities such as stores from a remote location, for example, monitoring within a desired area or monitoring commercial index count values within a zone. That is, the surveillance camera system can be accessed from a remote place via an information transmission means such as a computer network such as the Internet to monitor the surveillance information of the entire surveillance area or a desired area or the management index of the zone. ing.

Thus, according to the present invention, information can be smoothly exchanged between, for example, a head office and a branch office in a remote place. Also, comparison by branch office becomes easy.

[0051]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

1 to 8 show a first embodiment of a surveillance camera system of the present invention, FIG. 1 is a system block diagram, FIGS. 2 and 3 are flow charts for detecting a moving object,
FIG. 4 is a flowchart for tracking a moving body, FIG. 5 is a flowchart for moving body information used for predicting a moving line in the case of a single moving body, FIG. 6 is a flowchart for predicting a moving line when the trajectory of a moving object disappears, and FIG. Is a layout showing an example of a desired local monitoring area designated in the monitoring area, and FIG. 8 is a layout diagram in which the flow line of the visitor is entered.

In the system block diagram of FIG. 1, 1 is a camera, 2 is a moving object detecting / tracking means, 3 is movement information calculating means, 4 is monitoring information storing means, 5 is moving object flow line predicting means, and 6 is display. Means, 7 is an area designating means. The present embodiment corresponds to the invention described in claims 1 and 3.

<Camera 1> The camera 1 is composed of a plurality of video cameras 1-1, 1-2, 1-3, ... 1-n, and is installed so that almost the entire surveillance area can be shared and photographed. To be done. Then, the plurality of video cameras 1-1, 1-
Coordinates are designated for each of 2, 1-3, ... 1-n, and those images are combined based on the designated coordinates to generate one or a plurality of monitoring images so as to cover almost the entire monitoring area. Form. In the example of the store shown in FIGS. 7 and 8, cameras 1-1 to 1-7 are arranged in the monitoring area MA.

<About Moving Object Detecting / Tracking Means 2> The moving object detecting / tracking means 2 includes moving object detecting means 2a, target moving object determining means 2b, target moving object motion determining means 2
c and target moving object tracking means 2d. The moving object detecting means 2a is means for identifying a moving object from the monitoring image created based on the input from the camera 1. The target moving object determination means 2b is means for detecting a moving object to be monitored from the identified moving objects. The target moving object motion determination unit 2c is a unit that determines the motion of the moving object to be monitored. Target moving object tracking means 2d
Is a means for tracking a moving object to be monitored.

Next, a flow chart for detecting the moving object to be monitored by the moving object detecting / tracking means 2 will be described with reference to FIGS. 2 and 3. First, in FIG. 2, the background image (0) is superimposed on the input image (t) to create a difference image by the difference method, and a binarized image is created based on the difference image. Subsequently, a labeling process is performed and then a person is determined. In this case, a person is detected as the moving body. If yes, it is stored as detection information, and the process for the next input image is continued. Also,
If the determination is no, the process for the next input image is continued as it is. The previous input image is used as the background image each time the input image is switched. FIG. 3 is a flowchart when the background image is (t−T), but the other parts are the same as those in FIG. 2.

Further, a flow chart of the moving object tracking in the moving object detecting / tracking means 2 will be described with reference to FIG. That is, when a moving object to be monitored is detected, the number N of moving objects is calculated and three-dimensional reconstruction is performed. Next, the motion information is calculated, and subsequently the motion compatibility is calculated. The above-described series of processing is performed N times for the moving object, and then the presence or absence of conformity is determined. If there is a match, the operation information is recorded / added, and the process returns to the beginning and the processes after the moving object detection are repeated. If there is no match, it is determined whether or not there is a match with reference to the information of another camera image. If there is a match, the above operation information is recorded / added. If there is no match, the previous information is retained, and the process returns to the beginning and the processes after the moving object detection are repeated to perform the tracking process.

<Regarding the movement information calculation means 3> The movement information calculation means 3 comprises a single piece movement information calculation means 3a and a set movement information calculation means 3b. Single unit movement information calculation means 3
Reference numeral a is a means for calculating movement information when the moving object to be monitored is a single unit, and is provided with a movement locus calculation means 3a1, a movement distance calculation means 3a2, a movement time calculation means 3a3 and a movement speed / acceleration calculation means 3a4. There is. The movement locus calculation means 3a1 calculates the movement locus of a single moving object. The moving distance calculation means 3a2 calculates the moving distance of the single moving object. The moving time calculating means 3a3 calculates the moving time of a single moving object. Moving speed / acceleration calculating means 3a4
Calculates the moving speed and acceleration of a single moving object.

The collective movement information calculating means 3b is means for calculating movement information, that is, collective movement information, when the moving object to be monitored is composed of a plurality of moving objects, that is, moving object counting means 3b1 and moving object density calculation. Means 3b2, average movement speed calculation means 3b3 and average movement vector calculation means 3b4 are provided. The moving object counting means 3b1 is a means for counting the number of single moving objects existing in a specific area of the monitoring area and calculating the size of the collective moving objects. The moving object density calculating means 3b2 is a moving object counting means 3b1.
It is a means for calculating the density of the collective moving object by dividing the calculated value of by the area of the specific region. Average moving speed calculation means 3b3
Is a means for calculating the average value of the moving speeds of the collective moving objects. The average movement vector calculation means 3b4 is a means for calculating the average movement vector of the collective moving object.

Next, a flow chart of the set movement information calculation centering on the movement information used in the moving object flow line predicting means 5 will be described with reference to FIG. That is, the current position of the moving object, the speed of the moving object, and the maximum speed (moving speed, moving maximum speed) are obtained based on the motion information of the moving object, and the moving range is calculated based on these. Similarly, the size, area / circumscribing rectangle of the moving object, the color of the moving object, and the RGB component are obtained, and the appearance information of the object is calculated based on these.

<Regarding the Monitoring Information Storage Means 4> The monitoring information storage means 4 is means for storing the monitoring information consisting of the monitoring image, the moving object detection / tracking result, the single movement information and the collective movement information.

<Regarding Moving Object Flow Line Prediction Unit 5> The moving object flow line prediction unit 5 is a unit for predicting the flow line of the moving object to be monitored, and includes the single moving object flow line predicting unit 5a and the collective moving object motion. The line prediction means 5b is provided. The single moving object flow line prediction unit 5a is a unit that predicts the flow line of a single moving object. The collective moving object flow line prediction unit 5b is a unit that predicts a collective moving object flow line.

Next, a flow chart for predicting a moving object flow line when the trajectory of the moving object in the single moving object disappears will be described with reference to FIG. That is, the state of the trajectory is determined based on the tracking information of the moving object, and when the trajectory disappears, the movement information obtained in FIG. 5, that is, the movement range and the appearance information is referred to determine the presence or absence of a candidate. To do. As a result, when there is a candidate, the movement information is stored / added. When there is no candidate, the movement information is held.

<Regarding Display Means 6> The display means 6 is means for displaying current and / or past monitoring information.

<Regarding Area Designating Means 7> The area designating means 7 designates a desired partial area in the monitoring area as an area, extracts moving object detection / tracking results in the area, and moves information. Is calculated by the movement information calculation means 3 and the resulting monitoring information is displayed on the display means 6. As an example, in the monitoring area MA of the store shown in FIG. 7, when the areas A to F are designated by the area designating means 7, the detected number of customers entering the store and the number of stoppages as the calculated movement information are the areas A and B. Table 1 shows the following. Further, the traced flow line ML is as shown in FIG. In addition,
7 and 8, E is the entrance (exit) of the store, G
Is a gondola and R is a cashier counter.

[0066]

[Table 1] Area Number of people entering (number of people) Number of stops (number of times) A 100 50 A 50 5 FIGS. 9 to 12 show a second embodiment of the surveillance camera system of the present invention, and FIG. 9 is a system block diagram, Figure 1
0 is a layout diagram showing an example of zone division in the monitoring area MA, FIG. 11 is an example of a management index list counted for each zone, and FIG. 12 is a different example of management index lists in areas A and B of FIG. 7. Is. In the figure, those parts that are the same as those corresponding parts in FIG. 1 are designated by the same reference numerals, and a description thereof will be omitted. The present embodiment is different in that a zone dividing means 8 is further provided.
The present embodiment corresponds to the invention described in claims 1 to 3.

That is, the zone dividing means 8 divides the monitoring area MA into a plurality of uniform zone numbers. 1-No. 24
(In FIG. 10, only No. 1 to No. 8 and No. 1 to No. 17 are displayed among them.) As a result, the commercial index is counted by using POS data for each zone. . It should be noted that the commercial indexes used here are, as shown in FIG. 11, the unit sales price, the number of displays, the sales total, the single item profit, the profit total and the profit ratio for the product, and in the list shown in FIG. Zone No.
Are arranged in order. However, they can be rearranged arbitrarily.

On the other hand, the list shown in FIG. 12 is summarized as follows. That is, FIG. 12 shows areas A and B of FIG. 17 and 1
6 correspond to each other, the monitoring information of the areas A and B in the first embodiment of the present invention and the zone number shown in FIG. The management data selected from the management indexes 17 and 16 shown in FIG. 11 are displayed side by side, and a “sales floor / product check sign” column is provided. The "Sales floor / commodity check sign" field is further divided into "area" and "product" fields so that a warning can be displayed regarding a comment regarding the area and indication of the corresponding product.

FIG. 13 is a system diagram showing a third embodiment of the surveillance camera system of the present invention. In the figure,
The same parts as those in FIG. 9 are designated by the same reference numerals and the description thereof will be omitted. The present embodiment is different in that a remote point access means 9 is provided.

That is, in this embodiment, the remote point access means 9 comprises a personal computer 9a and the Internet 9b. The personal computer 9a is connected to the surveillance camera system shown in FIG. 9 at a remote location via the Internet 9b.

In this way, it is possible to access the surveillance camera system by operating the personal computer 9a at a remote location from the surveillance camera system and browse the surveillance information and / or the management index.

[0072]

According to the first aspect of the present invention, the camera, the moving object detecting / tracking means for detecting and tracking the moving object from the monitoring image based on the image picked up by the camera, and the movement for calculating the moving information of the moving object. The information calculation means, the monitoring information storage means for storing the monitoring information such as the monitoring image, the detection / tracking result of the moving body, and the movement information, and an arbitrary part of the monitoring area is designated as the area, and the designated area By including the area designating means for creating the monitoring information inside and the image display means, even if the monitoring area is wide, the monitoring can be performed easily and accurately, and the monitoring labor can be reduced. A surveillance camera system that enables the monitoring of the areas that are particularly important in the monitoring area, and can easily strengthen the monitoring of the current problems and improve them. It is possible to provide a beam.

According to the second aspect of the present invention, the camera, the moving object detection / tracking means for detecting and tracking the moving object from the monitoring image based on the image taken by the camera, and the movement information calculation for calculating the movement information of the moving object. Means, a monitoring information storage means for storing monitoring information such as monitoring images, moving object detection / tracking results, and movement information, and a monitoring area that is divided into a plurality of zones in advance by counting and divided into commercial indexes for each zone. By including the zone dividing means for counting the number and the image display means, it is possible to display a plurality of zones in the store in order of the management index with the highest degree of interest, which facilitates grasping the zones. A camera system can be provided.

According to the third aspect of the present invention, by further comprising the moving body flow line prediction means for predicting the flow line of the moving object, the movement prediction of the moving object to be monitored is calculated as the flow line prediction. This can be displayed, so by simulating the flow line of the monitoring area, it is possible to effectively plan the layout while considering the flow line of the moving object, and use the flow line prediction result. It is possible to provide a surveillance camera system that improves the surveillance accuracy.

According to the invention of claim 4, since the monitoring information and the related information can be monitored from a remote point in addition, the monitoring which enables the smooth exchange of information with the business office located in the remote place. A camera system can be provided.

[Brief description of drawings]

FIG. 1 is a system block diagram showing a first embodiment of a surveillance camera system of the present invention.

FIG. 2 is a flowchart of moving object detection as well.

FIG. 3 is a flowchart for detecting a moving object as well.

FIG. 4 is a flowchart for tracking a moving body.

FIG. 5 is a flowchart of mobile body information used for flow line prediction in the case of a single mobile body.

FIG. 6 is a flowchart for predicting a flow line when the trajectory of a moving object disappears.

FIG. 7 is a layout showing an example of a desired local monitoring area specified in the monitoring area.

[Figure 8] Layout diagram with the flow lines of customers

9 is a system block diagram showing a second embodiment of the surveillance camera system of the present invention, FIG. 10, FIG. 11 and FIG.
2 is

FIG. 10 is a layout diagram showing an example of zone division in the same monitoring area.

[Fig. 11] Example of a list of management indicators also counted for each zone

FIG. 12 is a different example of the management index list in areas A and B of FIG.

FIG. 13 is a different example of a management index list in areas A and B of FIG.

[Explanation of symbols]

1 ... Camera 2 ... Moving object detection / tracking means 3 ... Movement information calculation means 4 ... Monitoring information storage means 5 ... Moving object flow line prediction 6 ... Display means 7. Area designation means 8 ... Zone dividing means 9 ... Remote point access means 9a ... PC 9b ... Internet

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/225 H04N 5/225 C 5/232 5/232 C (72) Inventor Takashi Ichijo Shinagawa-ku, Tokyo 4-3-1, Higashishinagawa, Toshiba Ritec Co., Ltd. F term (reference) 5C022 AA05 AB63 AC01 AC69 5C054 AA01 CC02 CF05 CF06 CG02 CG05 CG06 CH01 EA01 EA05 EA07 FC13 FE16 FE25 FE28 FF02 FF03 GB01 GB04 CA9602 EA43 FA52 FA59 FA69 GA08 GA34 HA02

Claims (4)

[Claims] 1. A camera for photographing a monitoring area; a moving object detecting / tracking means for detecting and tracking a moving object from a monitoring image based on photographing by the camera; and a movement information calculating means for calculating movement information of the moving object. Monitoring information storage means for storing monitoring information such as monitoring images, detection / tracking results of moving objects, and movement information; and an arbitrary partial area within the monitoring area is designated as an area, and monitoring information within the designated area A surveillance camera system, comprising: an area designating means for creating a monitor image; and an image display means for selectively displaying a part or all of the surveillance information. 2. A camera for photographing a monitoring area; a moving object detecting / tracking means for detecting and tracking a moving object from a monitoring image based on photographing by the camera; and a movement information calculating means for calculating movement information of the moving object. Monitoring information storage means for storing monitoring information such as monitoring images, detection / tracking results of moving objects, and movement information; and monitoring area is divided into a plurality of zones in advance to count commercial indexes for each zone. A surveillance camera system, comprising: a zone dividing means for performing; and an image display means for selectively displaying a part or all of the surveillance information. 3. A moving body flow line predicting means for predicting a flow line of a moving object is provided.
The surveillance camera system described. 4. The surveillance camera system according to claim 1, wherein the surveillance camera system is configured so that the surveillance information and related information can be monitored from a remote location.