JP2005051302A - Image storing system and monitoring system using the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem that huge labor and time are required to search an image where a desired subject is photographed from the video image of a monitor camera. <P>SOLUTION: An image set is obtained in such a way that the video image from the monitor camera 1 is A/D converted by an image processing server 2, and photographing time information and ID information from a radio ID tag 3 possessed by a photographing target are added to the predetermined number of images near a time of performing motion detection. The image set is stored in an image storing server 8 through the Internet 7. A user accesses the server 8 by a monitoring personal computer 9, and views a desired image by using the photographing time and ID information as searching conditions. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a monitoring system, and more particularly to a monitoring system capable of efficiently and quickly searching for a desired video from videos taken by a monitor camera.
[0002]
[Prior art]
Conventionally, a monitoring system that accumulates and monitors images taken by surveillance cameras installed at key points such as entrances and exits of buildings such as buildings, receptions inside them or offices for security purposes, and, for example, The children's images taken with the cameras installed in the classrooms of the kindergarten are transmitted to the server via the network and stored. The family of the children accesses the server from a monitoring device such as a personal computer, and their children at home in real time. There is a monitoring service system that can monitor the video.
Each of these systems has a feature that it can monitor a video of a current subject (such as a person) or a past video from a remote location.
[0003]
[Problems to be solved by the invention]
However, in the surveillance system provided for the security, when a problem such as a crime occurs in the surveillance place, the photographed person's image is taken over in the past by monitoring the accumulated photographed image. Although there is an advantage that can be seen, for example, when the surveillance camera is continuous shooting, if it is monitored at a constant speed for one week, a huge time of 16 hours or more is required even if it is monitored at 10 times the speed for one week. It becomes work to do.
Furthermore, when selecting only the images of the necessary parties from the enormous amount of images, the unnecessarily large amount of images is a simple and inefficient work, and the necessary images There is a problem that it may be overlooked. To solve this problem, a method has been proposed in which the captured video is stored in the server only when motion is detected on the image of the surveillance camera or when the presence of a person is detected by an infrared sensor. In the case of monitoring a place where there are many, there is a drawback that the amount of accumulated video is not reduced so much.
[0004]
In addition, in the kindergarten monitoring service system described above, the image of your child is not shown in the camera image, or because it cannot be clearly identified, the monitor family is dissatisfied. There's a problem. For example, in the case of one monitor camera in a classroom, a blind spot occurs in the shooting range of the camera, or if the entire classroom is shot without the blind spot, each kindergarten appears small and the same. It arises because it becomes difficult to clearly identify one's own children among uniformed children. (For example, JP 2002-269209 A)
For this reason, there are cases where a method of installing a plurality of monitor cameras in a classroom is used. In this case, the child of his / her own image is taken from a plurality of camera images taken of children who often move around freely in the classroom. It takes time to find out. In addition, when there is no blind spot in the classroom, the kindergarten teacher will always be in one of the cameras, and some teachers may feel the stress of being constantly monitored.
[0005]
On the other hand, there is a system that can remotely control the direction of the monitor camera from the monitor device so that the child's figure can be found freely, but at the same time, multiple family members can freely operate the monitor camera and focus on their child In order to be able to shoot, it is necessary to have the same number of monitor cameras as the number of children, which is very wasteful considering the effect on cost.
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a monitoring system that can quickly find a specific photographing object (person image).
[Patent Document 1] Japanese Patent Application Laid-Open No. 2002-269209
[Means for Solving the Problems]
In order to solve the above-described problem, in the image storage method according to claim 1, shooting time information is attached to an image set cut out from continuous camera shot images by motion detection by image processing of the shot images and stored in the storage means. It is characterized by that.
According to a second aspect of the present invention, in the image accumulation method according to the first aspect, ID information detected from an ID identifying unit attached to a subject is added to the photographing time information to associate the photographed image with the ID information of the subject. And storing in the storage means.
[0007]
According to a third aspect of the present invention, in the image accumulation method according to the second aspect, the image set accumulated in the storage means is browsed by specifying the photographing time information and the ID information.
4. The monitoring system using the image storage method according to claim 1, wherein the storage unit is connected to the Internet, from the monitoring unit connectable to the Internet. The image set accumulated in the storage means can be browsed.
[0008]
The monitoring system according to claim 5 is the monitoring system according to claim 4, wherein a monitor camera that converts a captured image into an NTSC signal and a predetermined frame near a detection time by performing motion detection of the NTSC signal image. An image processing server that combines a plurality of image data and shooting time information thereof into an image set, a wireless ID tag storing ID information, an antenna and reader / writer for reading ID information of the wireless ID tag, and the wireless ID A management personal computer that adds information about the time when the ID information is received to the ID information read from the tag 3 and sends out the image processing server, an image storage server that stores an image set in a database, and a storage in the image storage server And a personal computer that monitors the set of images.
[0009]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described based on embodiments shown in the drawings. FIG. 1 is a schematic diagram showing a configuration of an embodiment of a monitoring system according to the present invention. As shown in the figure, this monitoring system is installed at a monitor camera 1 that monitors an entrance of an office, an image processing server 2, a badge-like wireless ID tag 3 possessed by an office person, and an office entrance. The antenna 4, the reader / writer 5, the management personal computer 6, the Internet 7, the image storage server 8, and the monitor personal computer 9.
[0010]
The function of each component is as follows. That is, the monitor camera (hereinafter referred to as a CCD camera) 1 converts an image captured at a frame rate of, for example, 30 Hz into a television image electrical signal (hereinafter referred to as an NTSC signal).
The image processing server 2 detects motion from the function of AD-converting the NTSC signal transmitted from the CCD camera into a digital signal of an arbitrary frame rate, the difference in data between frames of digitized image data, and the like. A digital image data having a predetermined number of frames in the vicinity of the time when motion is detected, a shooting start time and an end time, and other attribute information described later are combined into an image set, and the digital image data of the image set is converted to digital It has a function of converting into compressed image data and combining the digital compressed image data and attribute information of the image set into an accumulated image set.
[0011]
The wireless ID tag 3 is a tag that stores unique ID information such as an employee number or name that can identify an employee who goes in and out of the office or a subcontractor, or a subcontractor number or name.
The reader / writer 5 can write ID information to the wireless ID tag 3 via the antenna 4 or read the ID information stored in the wireless ID tag 3. The management personal computer 6 adds the time information at which the ID information is received to the ID information read from the wireless ID tag 3 by the reader / writer 5 and sends the information to the image processing server 2.
The image storage server 8 receives the stored image set from the image processing server 2 and stores the stored image set in a database.
The monitor personal computer 9 can monitor the stored image by accessing the image storage server 8 using a user ID and a password.
[0012]
The operation of this system will be described in detail with reference to FIG.
When an office person wearing the wireless ID tag 3 passes through the doorway, the image of the office person taken by the CCD camera 1 installed on the ceiling or the like is converted into an NTSC signal at a predetermined frame rate, for example, 30 Hz. It is sent to the image processing server 2.
The image processing server 2 converts the NTSC signal into digital image data at a frame interval Δt.
[0013]
The image processing server 2 sequentially calculates a difference of image data between frames of digital image data: | A _n −A _n−1 |.
Since the difference between the image data increases when a person passes, the image shooting time when the difference exceeds the predetermined threshold value Ath and satisfies the condition of Expression (1) is set as the motion detection time T.
| A _n −A _n−1 |> Ath (1)
Then, an image from time (T−aΔt) to time (T + bΔt) is set as a stored image set, and shooting start time Ts = T−aΔt and shooting end time Te = T + bΔt are added as attribute information of the stored image set. Here, a and b are arbitrary positive integers, and can be set to arbitrary values.
When motion is detected at time T, the next motion detection is performed from time {T + (a + b + 1) Δt}.
[0014]
FIG. 2 is an explanatory diagram of a processing procedure for creating a digital image set from digital image data when a = 1 and b = 3.
As shown in the figure, motion detection is performed on the image data A0 to A9 taken from time t0 to time t9 based on Expression (1), and motion detection is performed at time t3 when the difference between the image data exceeds a threshold value. It is determined as time T.
The T = t3 image A3, the previous image A2, and the subsequent images A4 to A6 form one image set. In this image set, shooting start time: Ts = t2 and shooting end time: Te = t6 are added as attribute information.
New motion detection is resumed from the A8 image.
[0015]
On the other hand, when a person concerned with the office wearing the wireless ID tag 3 subject to motion detection passes between the antennas 4, the ID information of the wireless ID tag 3 is read by the reader / writer 5 via the antenna 4. It is sent to the management personal computer 6.
The management personal computer 6 sends the transmitted ID information together with the ID information detection time Tid to the image processing server 2. The image processing server 2 adds the ID information received from the management personal computer 6 and the ID information detection time Tid as attribute information of the corresponding stored image set.
The installation positions of the CCD camera 1 and the antenna 4 are adjusted so that the motion detection time T and the ID information detection time Tid are the same, and the ID information detection time Tid is expressed by the equation (2). Corresponding to the accumulated image set to be satisfied.
Ts ≦ Tid ≦ Te (2)
If there is no accumulated image set that satisfies Expression (2), an image set that satisfies Expression (3) is found and associated.
| Ts-Tid | or | Tid-Te | is minimum (2)
The ID information and the Tid image set are associated with each other within a predetermined time after the image set is detected.
[0016]
In addition, when two employees wearing the wireless ID tag 3 are lined up and pass between the antennas 4, two types of ID information are detected at substantially the same time, but the condition of the formula (2) or the formula (3) is satisfied. If it satisfies, a plurality of pieces of ID information may be associated with one image set. When a person who does not have the wireless ID tag 3 passes between the antennas 4, ID information is not detected, and therefore, for example, ID “no information” is recorded in the attribute information of the image set.
When a predetermined time elapses after the image set is detected, the digital image data of the image set is converted into digital compressed image data, and together with the above-described attribute information, as an accumulated image set, the image accumulation server 8 via the Internet 7 is used. Is transmitted.
The image storage server 8 stores the stored image set in a database.
[0017]
FIG. 3 is an explanatory diagram of a processing procedure for continuously creating a stored image set in the image processing server 2. In the figure, the ID information of the employee 001, the employee 002, the employee 003, the employee 004, the subcontractor 001, the subcontractor 002, the office personnel possessing the wireless ID tag 3 to which the ID information is assigned, and the wireless ID tag 3 A state of accumulating images of people who do not have ID (no ID information) will be described.
[0018]
Now, a person with a wireless ID tag of ID information: employee 001 passes through the entrance / exit where the CCD camera and the antenna are installed, and the wireless ID tag 3 is attached at about 8:00:08. A person who does not have it passes, ID information: employee 002 passes at around 8:00:14, an ID information: employee 003 passes at around 8:00:19, and around 8:00:24 ID information: Person of subcontractor 001 passes, ID information: Person of employee 004 passes around time 8:00:30, ID information: Person of subcontractor 001 and ID information: Subcontracting around time 8:00:38 It is assumed that the person of the trader 002 has passed almost simultaneously.
[0019]
An image photographed by the CCD camera 1 is converted into digital image data by the image processing server 2, and a difference between image frames is calculated. The motion detection times determined based on the equation (2) are respectively T1 = 8: 00: 0, T2 = 8: 00: 08, T3 = 8: 00: 14, T4 = 8: 00: 19, T5 = It is assumed that 8:00:24, T6 = 8: 00: 30, and T7 = 8: 00: 38.
Here, as in FIG. 2, assuming that a = 1 and b = 3, the images at the motion detection times T1, T2,... T7, and one image before and three images after each image, a total of five images. The image set Cn (n = 1, 2,..., 7) is configured with one combination as a set. Each of these image sets is added with a shooting start time and a shooting end time as attribute information. As described above, unnecessary images without movement are removed.
[0020]
On the other hand, the ID information of the wireless ID tag 3 worn by office personnel (employees, subcontractors) is detected by the reader / writer 5 via the antenna 4 when each passes through the doorway. Then, the information is transmitted to the image processing server 2 as information Dn (n = 1, 2,... 7) combined with the ID information detection time in the management personal computer 6.
When matching is performed by comparing the shooting time of the image set Cn and the ID information detection time of the information Dn, D1 is C1, D2 is C3, D3 is C4, D4 is C5, D5 is C6, D6 And D7 correspond to C7, respectively.
Since the person shown in the image set C2 did not have the wireless ID tag 3, there is no corresponding ID information in C2, and in the image set C7 where two people with the wireless ID tag 3 are shown. Corresponds to two pieces of ID information D6 and D7.
A combination of ID information of Dn corresponding to the attribute information of the image set Cn is used as new attribute information, and digital image data obtained by compressing the digital image data of Cn is used as new digital image data. The stored image set Fn (n = 1, 2,... 7) is stored in the database of the image storage server 8.
[0021]
When the monitor monitors the stored image set, the monitor connects the monitor personal computer 9 to the Internet and accesses the image storage server 8 with a user ID and password registered in advance. Then, by specifying time and ID information as search conditions, the corresponding stored image set can be viewed on the monitor personal computer 9.
[0022]
When the viewer designates “start time” and “end time” as the time specification of the search condition of the stored image set, the stored image set corresponding to the specified time range can be viewed. The next ID information specification includes “employee”, “subcontractor”, “no ID information”, etc. When “employee” is specified, for example, the stored image set of ID information: employee 001 to employee 999 is viewed. If the “subcontractor” is specified, the ID information: stored image sets of the subcontractor 001 to 999 can be viewed, and if “no ID information” is specified, the motion is detected but there is no ID information. The stored image set can be browsed.
In addition, as a time specification, a method for browsing the stored image set taken most recently, or a method for specifying browsing immediately after a new stored image set is added after browsing the latest stored image set. It is also possible to take.
[0023]
FIG. 4 is an explanatory diagram of an operation for browsing the stored image set stored in the database of the image storage server 8.
As shown in the figure, if the start time 8:00: 00 and the end time 8:00: 10:00 and the ID information: “employee” are designated as the search condition (1), the stored image sets F3, F4, F6 You can view the image set.
Further, when the start time 8: 00: 00: 00 and the end time 8:01:00 and the ID information: “No ID information” are designated as the search conditions, the image set of the stored image set F2 can be browsed.
Furthermore, if the start time 8:00: 00 and the end time 8:00: 00 and the ID information: “subcontractor” are specified as search conditions, the image set of the stored image set F7 can be browsed.
[0024]
As an application example of this system, for example, when a crime occurs in an office and it turns out that it is a crime of a person outside the company, the supervisor first searches the stored image set of the person who does not have the wireless ID tag 3. .
In FIG. 3, the search condition time designation is the start time 8: 00: 00: 00 and the end time 8: 00: 00: 00 (hereinafter referred to as 8: 00: 00: 00 to 8:01:00), and the ID information designation is “ID “No information” is set, and only images showing people outside the company are viewed. In this example, since only the stored image set F2 is applicable, F2 is checked.
Next, as a search condition, time designation: 8:00:00 to 8:01:00, ID information designation: subcontractor is set, and even when a plurality of people are shown in one image set, at least one person Browses images of subcontractors in order.
In this example, the stored image sets F4 and F7 are applicable. Although two people are shown in F7, two pieces of ID information are also detected, so it can be understood that both are outsourcers.
Finally, in the search condition 1 in the figure, time designation: 8:00:00 to 8:01:00, ID information: employee is set, and at least one person browses images in which the employee is photographed in order. In this example, stored image sets A3, A4, and A6 are applicable. In both cases, only one employee is shown, and the outside criminal is not shown.
If the search condition is set as described above based on the time designation and ID information designation in this system, a desired camera video can be retrieved efficiently and in a short time.
[0025]
FIG. 5 is a schematic diagram showing the configuration of another embodiment of the monitoring system according to the present invention.
As shown in the figure, this monitoring system includes a monitor camera 1 for photographing a predetermined place such as a kindergarten, an image processing server 2, a badge-like wireless ID tag 3 possessed by a kindergarten child, and a predetermined kindergarten or the like. And the reader / writer 5, the management personal computer 6, the Internet 7, the image storage server 8, and the monitor personal computer 9.
Since the functions and operations of the respective constituent parts are the same as the constituent parts having the same reference numerals constituting the embodiment shown in FIG. 1, detailed description of the constituent parts is omitted.
Based on this figure, the operation of the system when the parents of the kindergarten monitor the appearance of the kindergarten sitting on a chair in the kindergarten or the like, for example, in a chair in the kindergarten will be described.
[0026]
As shown in the figure, in a corner of the kindergarten, a chair that can seat two or three children is installed, and a monitor camera (hereinafter referred to as a CCD camera) 1 is installed where a child sitting in the chair can be photographed. To do. The CCD camera 1 is installed such that a limited area where only a child sitting on a chair can be seen is taken as an imaging range, and antennas 4 are installed at both ends of the area.
For example, a badge-like wireless ID tag 3 in which unique ID information is written is distributed in advance to the kindergarten, which is attached to clothes.
The CCD camera 1 is connected to an image processing server 2, and the image processing server 2 is connected to the Internet 7.
The antenna 4 receives the ID information of the wireless ID tag 3, and the ID information is transmitted to the management personal computer 6 via the reader / writer 5. The management personal computer 6 is connected to the image processing server 2.
The image storage server 8 is connected to the Internet 7 and stores images transmitted from the image processing server 2 via the Internet 7 in a database.
The parents can monitor the image on the image storage server 8 with a monitor personal computer 9 that can be connected to the Internet 7.
[0027]
In this embodiment, the procedure for creating an image set from digital image data of a kindergarten, the procedure for creating an image set continuously, and the procedure for storing the accumulated image set in the database of the image accumulation server are completely the same as those in FIGS. Since it is the same, description is abbreviate | omitted.
[0028]
The procedure for the parents to monitor the stored image set at home is as follows.
The parents connect the monitor personal computer 9 to the Internet 7 and access the image storage server 8 using a user ID and password registered in advance. When a time (shooting start time and end time) is designated as a search condition, an accumulated image set having ID information corresponding to the user ID of the parents as attribute information within the designated time is used for monitoring at home. It can be viewed on the PC 9.
In addition, as a time specification, a method for browsing the stored image set taken most recently, or a method for specifying browsing immediately after a new stored image set is added after browsing the latest stored image set. It is also possible to take.
[0029]
For example, the parent ID of the kindergarten with the ID information: kindergarten 001 is given in advance the user ID: kindergarten 001 from the kindergarten, the parent accesses the image storage server 8 with the user ID, and the search condition When the time is designated, only the image set of ID information: kindergarten 001 can be viewed in order from the stored image sets stored in the database.
In order to be able to monitor the latest video of the kindergarten within the designated time range, the latest image set may be displayed within the designated time range.
In order to always monitor the latest image, the latest image for each ID user ID may be displayed, and when a new image set is accumulated, this may be switched and displayed.
If the image search is performed based on the ID information corresponding to the time and the user ID as in the present embodiment, only the video of the parent's kindergarten having the ID information can be smoothly browsed.
[0030]
【The invention's effect】
As described above, according to the present invention, in the surveillance camera, the radio ID tag unique to the video subject is attached, and the ID information from the radio ID tag and the image set extracted by detecting the motion on the image. In the image storage server, the stored image set can be managed not only by time but also by ID information.
As a result, since there is no attribute information other than time in the image of the surveillance camera in the past, the time and ID information is used to find out what kind of subject was shown in the image. By using it as a search key, the monitor can quickly and quickly find the image he wants to find.
[0031]
In addition, if this system is used for monitoring services in kindergartens, etc., it is not always possible to see images of children's images, and even if they are captured, they could not be clearly recognized. , You can easily and clearly see only the images of your child.
Furthermore, by linking the user ID for accessing the Internet with the ID information designation for image search, it is possible to provide privacy protection because images that do not show their children cannot be viewed. became. In addition, by limiting the shooting location to a narrow area, there is also an effect of being freed from the stress caused by the fact that the teacher is always seen.
As described above, the present system has a significant effect in providing an excellent monitoring system that facilitates image retrieval.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing the configuration of an embodiment of a monitoring system according to the present invention.
FIG. 2 is an explanatory diagram of a processing procedure for creating a digital image set from digital image data.
3 is an explanatory diagram of a processing procedure for continuously creating an accumulated image set in the image processing server 2. FIG. 4 is an explanatory diagram of an operation for browsing the accumulated image set stored in the database of the image accumulation server 8.
FIG. 5 is a schematic diagram showing the configuration of another embodiment of the monitoring system according to the present invention.
[Explanation of symbols]
1 .... Monitor camera (CCD camera), 2 .... Image processing server,
3. ・ Wireless ID tag, 4. ・ Antenna, 5. ・ Reader / writer,
6 .... PC for management, 7 .... Internet, 8 .... Image storage server,
9. Monitor PC

Claims (5)

An image accumulating method characterized by attaching photographing time information to an image set cut out from continuous camera photographed images by motion detection by image processing of the photographed images and accumulating them in a storage means. The ID information detected from the ID identifying means attached to the subject is added to the photographing time information, and the photographed image and the ID information of the subject are associated with each other and stored in the storage means. Image storage method. 3. The image storage system according to claim 2, wherein the image set stored in the storage means is browsed by specifying the photographing time information and the ID information. 4. The monitoring system using the image storage method according to claim 1, wherein the storage unit is connected to the Internet, and is stored in the storage unit from a monitor unit connectable to the Internet. A monitoring system characterized by being able to view an image set. A monitor camera that converts a captured image into an NTSC signal, an image processing server that performs motion detection of the NTSC signal image, and combines an image data of a predetermined number of frames near the detection time and the shooting time information into an image set; The wireless ID tag storing the ID information, the antenna and reader / writer for reading the ID information of the wireless ID tag, and the ID information read from the wireless ID tag 3 are added with the information on the time when the ID information was received. 5. The management computer for sending out the image processing server, an image storage server for storing an image set in a database, and a personal computer for monitoring the image set stored in the image storage server. The monitoring system described in 1.

Images