JP6363130B2 - Surveillance method, difference image creation method, image restoration method, and difference detection apparatus in surveillance camera system - Google Patents

Description

  The present invention relates to a monitoring method in a surveillance camera system for transferring and storing captured images and data to a server for crime prevention and management, a difference image creation method, an image transfer method, and difference detection suitable for image transfer The present invention also relates to an image restoration method for restoring transferred data to an image that can be displayed on a terminal.

  Conventionally, for the purpose of crime prevention, investigation or management, the monitoring target points such as the entrances and exits of buildings such as apartment buildings, stores or streets, factories, distribution centers, etc. are monitored in a timely manner, and the monitoring results are transmitted to the Internet and other A camera system for sending and monitoring to a monitor of a user terminal via a communication line has been introduced. A camera system that captures a still image and compresses the image acquired by the server and then displays the image on the terminal has been developed (see, for example, Patent Document 1). Is known (for example, see Patent Document 2).

JP2013-51534A JP 2002-77882 A

  However, in the conventional system, the server can compress the image, but the transfer from the monitoring camera to the server has a problem that the transfer capacity is large, particularly in the case of moving images.

  Further, in order to reduce the transfer capacity from the monitoring camera to the server, there has been a problem that it is necessary to increase the shooting interval to reduce the number of frames to be transferred or to reduce the resolution for shooting.

  Therefore, the first object of the present invention is to solve the above-described problem, and to perform a difference image that can reduce the transfer capacity to the recording server without reducing the number of transfer frames to the recording server and without reducing the resolution. An object of the present invention is to provide a creation method, an image transfer method using the same, a difference detection device, and a monitoring method in a surveillance camera system. A second object of the present invention is to provide an image restoration method for restoring data transferred by such a method into an image that can be displayed on a terminal.

In order to achieve the above object, the first aspect of the present invention is based on the first full image and the second full image acquired successively after the first full image. Creating a first difference image using a mask area as an area that is a difference image between the image and the second all image, and the first all image is not different from the second all image;
A difference image between the second whole image and the first difference image, except for a mask area of the first difference image, a corresponding portion of the second whole image, and a mask of the first difference image Creating a second difference image in which transparent color information is set for the area;
The difference image production method characterized by including this is provided.

  According to the first aspect of the present invention, since the original image can be restored later and a difference image having a small capacity can be created, the number of transfer frames to the recording server is not reduced when transferring the image data to the server. In addition, the transfer capacity to the recording server can be reduced without reducing the resolution. From the viewpoint of transfer capacity, even if there is a limit to the acquisition of one frame per second for all two images, according to this aspect, the acquisition of three frames per second can be realized.

  Note that “image” is a term that includes both the meaning of a still image and a moving image. However, in the present application, when particularly distinguishing, a still image is displayed as “image” and a moving image is displayed as “video”.

  A second aspect of the present invention is a method for restoring a difference image created by the difference image creation method of the first aspect of the present invention described above, wherein the second difference image is added to the first entire image. An image restoration method comprising the step of combining is provided.

  According to the second aspect of the present invention, an image with a high resolution can be restored, so that a high-resolution moving image can be reproduced.

A third aspect of the present invention is a folder that is connected to each camera of a camera group that shoots moving images and / or a camera group that shoots still images, is connected to a recording server via a router and the Internet, and stores images. A difference detection device having
Acquire all images from the camera at regular time intervals or every time a request for all images from the recording server is received, store all images for all image transfer, and store all images for all image transfer in the folder And all image transfer means for transferring all images for all image transfer to the recording server,
Every time a predetermined time in the predetermined time or every time a difference image request is received from the recording server, all images are acquired from the camera, and all images for difference image transfer are set as all images for difference image transfer,
Extraction means for extracting all images stored in the folder;
A difference image between the entire image extracted by the extraction unit and the entire image for differential image transfer acquired by the differential image all-image acquisition unit, the entire image extracted by the extraction unit and the difference image First difference image creating means for creating a first difference image using a mask area as an area that is not different from all images for transfer of difference images acquired by the all image acquiring means;
The difference image is a difference image between the entire difference image transfer image acquired by the difference image all image acquisition unit and the first difference image, except for the mask area of the first difference image. A second difference that creates a second difference image in which transparent color information is set for the mask area of the first difference image, as a corresponding portion of all images for difference image transfer acquired by the all-image acquisition unit Image creation means,
Difference image transfer means for transferring the second difference image to the recording server;
All-image replacement means for replacing all images stored in the folder with all images for differential image transfer acquired by the differential image all-image acquisition means;
The difference detection apparatus characterized by having is provided.

  According to the third aspect of the present invention, when transferring image data from the camera group to the recording server, the transfer capacity to the recording server is reduced without reducing the number of transfer frames to the recording server and without reducing the resolution. Enables reduction.

According to a fourth aspect of the present invention, there is provided a difference detection apparatus having a camera group for capturing a moving image and / or a camera group for capturing a still image, a folder connected to a camera of the camera group and storing an image, and the difference detection A monitoring server in a surveillance camera system having a recording server connected to the apparatus via a router and the Internet,
The difference detection device obtains all images from the camera every predetermined time or every time a request for all images from the recording server is received, and sets all images for all image transfer to the folder. And a full image transfer step of transferring all the images for full image transfer to the recording server.
And,
Every time the difference image request from the recording server is received every predetermined time in the fixed time,
The difference detection device acquires all images from the camera and sets all images for difference image transfer as a difference image all image acquisition step;
An extraction step in which the difference detection device extracts all images stored in the folder;
The difference detection device is a difference image between all images extracted in the extraction step and all images for transfer of difference images acquired in the difference image all-image acquisition step, and extracted in the extraction step. A first difference image creation step of creating a first difference image using a mask area as an area where all images and the difference image transfer all images acquired by the difference image all image acquisition means are not different from each other;
The difference detection device is a difference image between the first difference image and the entire difference image transfer image acquired in the difference image all image acquisition and extraction step, and a mask area of the first difference image Except for the second differential image in which transparent color information is set for the mask area of the first differential image, which is a corresponding portion of the total image for differential image transfer acquired in the differential image all-image acquisition step. A second difference image creation step for creating
A difference image transfer step in which the difference detection device transfers the second difference image to the recording server;
The difference detection apparatus replaces all images stored in the folder with all images for differential image transfer acquired in the difference image all image acquisition step,
Including repeating each step of
And,
An all-image storage step in which the recording server stores all images acquired from the difference detection device;
A monitoring method in a surveillance camera system, wherein the recording server includes a difference image conversion step of combining the difference image acquired from the difference detection device with all the images at the previous time point and saving the resultant as a whole image. I will provide a.

  According to the fourth aspect of the present invention, it is possible to reduce the transfer capacity to the recording server without reducing the number of transfer frames to the recording server and without reducing the resolution. Can be restored, so high-resolution video can be played. In addition to the local network, a video camera can be installed to acquire data via the Internet network. In addition, when images are transmitted from cameras connected to each other via the Internet network to the server, in addition to all images at a predetermined timing, the original image is combined with an image having a small amount of data and an image before the difference image. Since the differential data that can be restored can be created and transferred, the transfer capacity flowing through the Internet network can be reduced.

  Further, in the all image transfer step and the difference image all image acquisition step, after acquiring all images from the camera, the entire image stored in the folder is compared with the color configuration of the image, and noise caused by a change in light quantity It is preferable to store after removing.

  Since the amount of difference due to changes in the color tone of the image caused by the effects of the sun's light outdoors and the effects of lighting on and off indoors can be reduced, it is installed in locations where the image of the external environment changes slightly. Since the difference can be reduced even with the surveillance camera that has been used, the transfer amount can be reduced.

  In the present invention, the “network” includes a network constituted by a communication network such as a LAN, the Internet, a Wi-Fi line, a 3G / LTE line, a dedicated line, or a combination thereof. The camera group is either or both of a camera group that shoots a still image and a camera group that shoots a moving image, and the image to be captured by the camera group may be either or both of a still image and a moving image. Good. Each camera has an output function, a still image shooting function, and / or a moving image shooting function. The camera is preferably an IP camera, but can also be an analog camera. For images acquired from a group of cameras that shoot still images, the compression format for moving images is H.P. More preferably, it is H.264. It is lightweight and easy to implement regardless of hardware or software. Further, in this aspect, the camera that shoots a moving image in the camera group does not need to be connected to the recording server via a LAN network, and for monitoring a moving image connected to the Internet via a 3G / LTE line. Even with a camera, data that can be restored and reproduced with a high-resolution video can be transferred to the recording server, and the range in which a video surveillance camera can be placed is widened. Note that the recording server may be a cloud server.

  According to the present invention, the transfer capacity to the recording server can be reduced without reducing the number of transfer frames to the recording server and without reducing the resolution.

It is a figure which shows an example of the system configuration | structure of the surveillance camera system using Example 1 of the difference image production method of this invention. It is a block diagram of the video recording server of Example 1 of the difference image creation method of this invention. It is a block diagram of the difference detection apparatus of Example 1 of the difference image creation method of this invention. It is a block diagram of the terminal (mobile) of Example 1 of the difference image creation method of the present invention. It is a block diagram of the terminal (PC) of Example 1 of the difference image creation method of this invention. It is an image figure of the data transmission from the monitoring camera in Example 1 of the difference image creation method of this invention to the video recording server. It is explanatory drawing of the image extraction method from the difference image produced by the difference extraction method in the Example of the difference image preparation method of this invention, and the difference image preparation method of this invention. It is a flowchart which shows the procedure outline | summary from the connection of the surveillance camera (for still images) and the recording server in Example 1 of the difference image production method of this invention to primary image data writing. It is a flowchart which shows the procedure outline | summary from the connection of the camera (moving image shooting) and recording server in Example 1 of the difference image production method of this invention to primary image data writing. It is an image figure which shows the conversion method of the image in Example 1 of the difference image preparation method of this invention.

  EXAMPLES Hereinafter, although this invention is concretely demonstrated using an Example about this invention, this invention is not limited to these.

  In the difference image creation method according to the first embodiment, a monitoring camera is operated on a recording server via a network, and the recording server captures, collects, edits, and saves camera images of moving images and still images. This is a difference image creation method used for a monitoring method in a monitoring camera system that transmits an image to be monitored to a terminal via a network in response to a request from the terminal. The difference detection apparatus of the first embodiment used in the difference image creating method of the first embodiment, the image transfer method of the monitoring camera of the first embodiment and the image restoration method of the first embodiment in the monitoring camera system will be described together.

  The surveillance camera system transmits an image restored by the image restoration method of the first embodiment to a terminal or the like, and performs reproduction / rewinding / fast-forwarding and relive reproduction of a live image. The surveillance camera system compresses and stores the restored image, transmits the image to a terminal or the like, and performs playback / rewinding / fast-forwarding of past images. In this embodiment, the transfer capacity of still images can be reduced by transferring the still images from the camera to the recording server, and still images can be collected on a cloud server or the like without installing a recording server on site. In addition, the number of frames can be increased or the resolution can be increased as compared with simple still image collection.

{Constitution}
FIG. 1 is a diagram illustrating an example of a system configuration of a monitoring camera system that uses the first embodiment of the differential image creation method of the present invention. On a network 500 configured by a combination of communication networks such as a LAN, the Internet, a Wi-Fi line, a 3G / LTE line, and a dedicated line, (1) a plurality of monitoring cameras (moving images) 700A to 700C and a plurality of monitoring cameras (for still images) 701A to C, (2) monitoring cameras (for moving images) 700B, C and monitoring cameras (for still images) 701B and C, respectively. The difference detection devices 400A to 400D that acquire images taken by the monitoring camera and transfer them to the recording server 100, and (2) are connected to the difference detection device 400 via the routers 600A to D and the Internet to detect the difference. Recording server 100 that acquires image data from the apparatus 400, stores it, and transmits it to the terminal. (3) Connected to the recording server 100 via the network 500, As a terminal for receiving and displaying image data from over 100 server, mobile terminal 200A, such as a smart phone, and B, browsing PC300A~C, such as a desktop PC (personal computer) or a notebook PC is connected. The recording server 100 is also connected to a monitoring camera (for moving images) 700A and a monitoring camera (for still images) 701A via a LAN. However, the difference image creation method of this embodiment is different from the recording server 100 and the LAN. Since the cameras connected above are not targeted, the cameras described below include cameras connected to the recording server 100 on the LAN (the monitoring camera (for moving image) 700A and the monitoring camera (still image in FIG. 1)). For example) 701A). In FIG. 1, the flow of a moving image (stream moving image) taken by a monitoring camera (for moving image) is indicated by a dotted arrow. Hereinafter, when the mobile terminal and the viewing PC are combined, they are referred to as “terminal” or “Viewer”.

  The recording server 100 is connected to the monitoring cameras (for moving images) 700B and C and the monitoring cameras (for still images) 701B and C via a network 500 including the Internet. In the present embodiment, not only the monitoring camera for shooting a still image but also a monitoring camera for shooting a moving image can be provided on a network other than the same LAN as the recording server 100. The difference detection devices 400D, C, B, and A are connected to the monitoring cameras (for moving images) 700B and C and the monitoring cameras (for still images) 701B and C, respectively. A 3G / LTE line is connected to the LAN connected to the recording server 100 via the router 600A and another LAN is connected via the router 600C. The difference detection device 400D is connected to the Internet network via a router 600D and a 3G / LTE line, and the difference detection device 400B is connected to the Internet network via a router 600B and a 3G / LTE line. The difference detection apparatuses 400 </ b> A and 400 </ b> C are connected to a different LAN from the recording server 100. FIG. 1 shows a connection example in which a monitoring camera (for moving images), a monitoring camera (for still images), a viewing PC, and a mobile terminal are connected to a recording server via a plurality of networks. Not. In the present embodiment, the communication between the monitoring camera (for still image) 401 and the recording server 100 and the communication between the monitoring camera (for moving image) 400 and the recording server 100 are reliable after the session is established. Although it is performed by TCP having high characteristics, UDP that transmits data without establishing a session and that is fast and excellent in real time may be used, and an image can be acquired by using both TCP and UDP protocols.

  The monitoring camera (for moving images) and the monitoring camera (for still images) are IP cameras in this embodiment, but may be analog cameras. However, in the case of analog, a converter is required. The viewing PC 300, which is a terminal for image display, is not limited to being in the same LAN as the recording server 100, and may be connected via a plurality of networks such as the Internet, a LAN, or a Wi-Fi line. The mobile terminal 200, which is an image display terminal, may also be connected via a plurality of networks such as a LAN, the Internet, and a cellular phone network (Wi-Fi line, 3G / LTE line, etc.). The router 600 is connected between the LAN and the Internet, and between the monitoring camera (for moving images) and the monitoring camera (for still images) and the Internet.

  One recording server 100 can acquire a camera moving image from a plurality of monitoring cameras (for moving images) 700 and a camera still image from a plurality of monitoring cameras (for still images) 701. In this embodiment, since the recording server 100 automatically distributes network traffic, network design is not required, and it is only necessary to connect the camera to the port, so that the operation becomes very simple. In addition, resuming is easy even when communication is interrupted.

  Although different from the present embodiment, a method (variation) may be used in which an image is transferred from the difference detection device to the recording server without accessing the difference detection device from the recording server. In the case of such a modified example, there is an advantage that the situation cannot be grasped on the recording server side when communication is interrupted, while there is no need to change the router port. As a process in the modified example, a timer in the difference detection device acquires an image at a timing such as 1 second and transfers it to a recording server, and sleeps at a set time such as 1 second after the transfer ends normally. .

  In the conventional IP camera system, if the surveillance camera for acquiring the moving image is not placed on the same LAN as the recording server, the burden on the network becomes excessive. In this embodiment, the number of frames transferred to the recording server is reduced. Since the transfer capacity to the recording server can be reduced without dropping the resolution and without reducing the resolution, a video surveillance camera may be provided on the Internet or on a 3G / LTE line such as a portable terminal. Because it can, the degree of freedom becomes very high.

  FIG. 2 is a configuration diagram of the recording server according to the first embodiment of the difference image creating method of the present invention. The recording server 100 includes a CPU 101 with a memory 102 that is a cache memory, a control / arithmetic unit having a device driver, a storage device 110 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a network interface 104, and the like. And an input / output device including a display 103 as a display device, a keyboard 105, a mouse 106, and the like. The storage device 110 stores an operating system 114 in addition to a primary image folder 111, a secondary video folder, a program 113, an authentication database, an environment setting folder, and the like. The program 113 is normally stored in the auxiliary storage device of the storage device 110, and is loaded into the main storage device at the time of execution. In the primary image folder 111, a moving image including only all images acquired from the difference detection device 400 and all images created from the difference images is accumulated as primary data. The primary data stored in the primary image folder 111 is converted into moving image compression data and stored as secondary data. The program 113 includes various programs such as a photographing / collecting / editing program and a transmission program. In the authentication database, IDs, passwords, port numbers and IP addresses of the monitoring cameras 700 and 701, the mobile terminal 200, and the viewing PC 300, and individual identification information (UID) are stored in terminals having no IP address. In this embodiment, the recording server 100 is integrated with the recording server and the terminal, and also serves as a terminal for displaying images by itself, and for maintenance and management, the display 103 and a keyboard as an input means. 105 and a mouse 106. When the recording server does not need to reproduce the camera image, the terminal function as the image display device may not be provided. The environment setting folder stores image acquisition timing from each difference detection device, primary data and secondary data creation intervals, compression conditions, and the like. The recording server 100 is a stationary server, but may be a cloud server.

  The recording server 100 causes the monitoring camera (for still image) 701 connected via the Internet to obtain an image as a still image by requesting an image from the difference detection device 400, so that the difference for each monitoring camera is obtained. In the detection device 400, the entire image is left as it is or converted into a difference image and transmitted to the recording server 100. The recording server 100 causes the monitoring camera (moving image) 700 connected via the Internet to request an image from the difference detecting device 400 to acquire an image with a moving image, and the difference detecting device for each monitoring camera. In 400, the whole image is converted into a differential image or transmitted to the recording server 100.

  In the recording server 100, the CPU 101 loads the image capturing / collecting / editing program to the memory 102 and executes the program to acquire and edit the image from the difference detection apparatus in the monitoring method using the difference image creating method of the present embodiment. Realize computer functions that are possible. The recording server 100 realizes the function of a computer capable of sending an image to a terminal by causing the CPU 101 to load and execute a transmission program in the memory 102. The CPU 101 is an arithmetic processing device mounted on a normal computer, executes various programs, and performs various controls.

  The recording server 100 may be a server group including a plurality of recording servers in addition to a single server. For example, for the secondary video folder, for secondary data after a certain period (for example, 24 hours) has elapsed, the storage destination may be a secondary video folder provided in a recording server separate from the recording server that acquires the camera image. . By separating past stored data that is not frequently played back, a larger number of cameras can be monitored on the same network.

  The shooting / collection / editing program records (1) a difference detection device connection function for connecting to the difference detection device, and (2) records an image on the connected difference detection device every predetermined time (for example, 1 second). An image acquisition function to be inputted to the server, (3) a difference image determination function for determining whether an image acquired from the difference detection device is a difference image, an all image storage function for storing all images acquired from the difference detection device, and (4) a difference A difference image converter that combines the difference image acquired from the detection device with all the images at the previous time and stores it as an entire image. (5) An image that holds the acquired or combined all images in the memory until the next image generation. (6) A program for realizing a primary data creation function for accumulating all acquired or synthesized images as primary data in a primary image folder.

  In the present embodiment, as a more preferable mode, the photographing / collecting / editing program further compresses the data in a moving image format by combining the primary data with a computer every predetermined time (for example, 10 minutes) and attaching a time stamp. This is a program for realizing a secondary data creation function for converting into secondary data. The primary data is all images (I frame (intra frame) when the camera image is a moving image), and the secondary data is compressed into a moving image format even when the camera image is a still image, and the camera image is a moving image. For example, the ratio of one I frame is 200 frames, and not only P frames (predicted interframes) but also B frames (bidirectional predictive interframes) are inserted in combination to reduce capacity without deterioration. In this embodiment, a future I frame can be referred to, so that a B frame can be inserted. Since the B frame is a front-back comparison difference, it is smaller than the P frame.

  The transmission program has a terminal connection function for connecting to a terminal on a computer, an image selection receiving function for displaying a camera list on the terminal and receiving a camera selection from the terminal, and an image of primary data for the selected camera as a live image Live image transmission function to be transmitted to the terminal, live image rewind reception function to receive a rewind request from the live image from the terminal, and for each rewind request, a certain amount of time (for example, 1 second) from the image previously transmitted to the terminal Rewind live image transmission function that extracts primary data of the past time point and transmits it to the terminal as a rewind live image, rewind live image fast forward reception function that accepts a fast forward request from the rewind live image from the terminal, for each fast forward request Until the current image is reached, the primary time point in the future for a certain amount of time (for example, 1 second) from the image previously transmitted to the terminal Is a program for also realizing fast forward a live image transmission function of transmitting to the terminal as a fast forward a live image to extract over data. “Current image” means the latest image acquired from the difference detection device. Therefore, the current image changes to a new image each time an image from the difference detection apparatus is input to the recording server.

  The transmission program further includes a relive image reception function that accepts a relive image request from a rewind live image from the terminal to the computer, and for each relive image request, for a certain amount of time from the image that was previously transmitted to the terminal, in detail, the difference detection This is a program for realizing a re-live image transmission function that extracts primary data at a future time point from the device 400 to the recording server 100 and transmits it to the terminal as a fast-forward live image. Here, the “relive image” refers to a reproduced image that is rewound from the live image to the past.

  In the present embodiment, the connection between the terminals 200 and 300 and the recording server 100 is also performed by the TCP / IP method, authentication is performed with the user ID and password, and it is confirmed that the terminal is a terminal registered in the recording server. Then send the image. The authentication is preferably performed by an authentication database on the recording server.

  Even if the terminal is not on the same LAN, if the recording server is connected to the network via a router, an image (all images or compressed images) is sent from the recording server using the IP address of the connected router and the port number assigned to the router. Acquire. For terminal connection, the terminal is authenticated using the UID registered at the time of terminal authentication.

  Since the recording server 100 identifies the terminal based on the terminal unique information using the UID at the start of connection of the mobile terminal 200, the recording server 100 can display an image by authenticating the user ID and the password and matching the terminal unique information.

  FIG. 3 is a configuration diagram of the difference detection apparatus according to the first embodiment of the difference image creation method of the present invention. The difference detection device 400 includes a control / arithmetic unit having a CPU 401 and a device driver with a memory 402, a storage device 410 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, and a communication control for a network interface 404 and the like. And an input / output device including a display 403, a keyboard 405, a mouse 406, and the like, which are connected and used only during maintenance. The storage device 410 stores an accumulation folder 411, an environment setting folder, a difference detection program 413, and an operating system 414. The accumulation folder 411 is a folder for storing images. The accumulation folder 411 includes all images of the camera images acquired from the monitoring camera (for moving image) 700 and the monitoring camera (for still image) 701, and the first. The first difference image having a mask area as an area where the stored all images and the next stored difference image transfer image are not different from each other, and the difference image transfer all except for the mask area of the first difference image For the mask area of the first difference image as the corresponding part of the image, the second difference image in which transparent color information is set is stored. The environment setting folder stores noise removal conditions, conditions for determining whether a camera image for storing all images or a camera image for storing difference images, and the like.

  One difference detection device 400 is connected to each of the monitoring camera (for moving image) 700 and the monitoring camera (for still image) 701 connected to the recording server 100 via the Internet.

  In this embodiment, the difference detection apparatus 400 is connected to the monitoring camera (for moving image) 700 or the monitoring camera (for still image) 701 to which the difference detection apparatus 400 is connected and the camera image by the recording server 100. The request is controlled, and the camera image acquired from the monitoring camera (for moving image) 700 and the monitoring camera (for still image) 701 is converted into a predetermined image and transmitted to the recording server 100.

  In the difference detection apparatus 400, the CPU 401 loads and executes the difference detection program 413 in the memory 402, thereby executing camera image acquisition, editing and storage in a monitoring method that uses the difference image creation method of the present embodiment, and recording to a recording server. Realize computer functions that can be transmitted. The CPU 401 is an arithmetic processing device mounted on a normal computer, executes various programs, and performs various controls.

  The difference detection program 413 has (1) a camera connection function for connecting to the monitoring camera every time a connection request to the monitoring camera is received from the recording server, and (2) all images from the recording server. Every time a request is received, all images are acquired from the connected monitoring camera (for moving images) or monitoring camera (for still images), and all images are transferred for transfer to the storage folder. All image transfer function for saving all images and transferring all images for all image transfer to the recording server. (3) Every time a difference image request is received from the recording server, the connected monitoring camera (for moving images) or A difference image all image acquisition function for acquiring all images from a monitoring camera (for still images) and making all images for difference image transfer; (4) an extraction function for extracting all images stored in a storage folder; (5) Extraction A difference image between all images extracted by the function and all images for difference image transfer acquired by the difference image all image acquisition function, and the all images extracted by the extraction function and the difference image all image acquisition function A first difference image creating function for creating a first difference image using an area that is not different from the entire difference image transfer image obtained by the above as a mask area, and (6) obtained by the difference image all image obtaining function. The difference image between the entire difference image transfer image and the first difference image, except for the mask area of the first difference image, the difference image transfer image acquired by the difference image all image acquisition function. A second difference image creation function for creating a second difference image in which transparent color information is set for the mask area of the first difference image as a corresponding portion of all images, and (7) a second difference image on the recording server The A difference image transfer function for sending, and (8) an all-image replacement function for replacing all images stored in the storage folder with all images for difference image transfer acquired by the difference image all-image acquisition function. It is a program.

  In addition, instead of acquiring all images from the camera every time an image request or a difference image request is received from the recording server, the connected monitoring camera (for moving images) or monitoring is performed every certain time (for example, 1 second). All images may be acquired from a camera (for still images).

  In this embodiment, the difference image all-image acquisition function is further stored in the storage folder after all images are acquired from the monitoring camera (for moving images) or the monitoring camera (for still images). It includes a function that compares the color composition of all images and the image, and saves after removing noise caused by a change in the amount of light.

  In this embodiment, the connection between the monitoring camera and the recording server via the difference detection device is performed by the TCP / IP method, and in order to identify the monitoring camera, authentication is performed with the user ID and password set on the recording server side. After that, a request for taking a camera image is made. The authentication is preferably performed by an authentication database on the recording server.

  If the camera is connected to the network via a router even if it is not on the same LAN, an image (all images or difference images) is acquired from the difference detection device using the IP address of the router to be connected and the port number assigned to the router. Do. When connected in an environment that does not have a global IP, an image (all images or a difference image) is transferred from the difference detection device to the recording server. At this time, the port number of the router on the recording server side is released and the port is transferred to the recording server.

  The recording server 100 can identify a connection partner by connection using an IP address and a port number at the start of monitoring camera connection in a local environment (for example, on the same LAN), and authenticates with a user ID and password. The recording server 100 uses a global IP address and port number by using router port forwarding (also expressed as port forwarding, etc.) when connecting to a surveillance camera in a remote environment such as via the Internet network. Identify the connection partner.

  FIG. 4 is a configuration diagram of a terminal (mobile) according to the first embodiment of the difference image creation method of the present invention. The mobile terminal 200 includes a control / arithmetic apparatus having a CPU 201 with a memory 202, a device driver, and the like, a storage device 210, a communication control device that transmits and receives data, a display 203 as a display device, operation buttons, a touch panel, and the like. An output device is provided. The storage device 210 stores an image display program 213 and an operating system 214. The mobile terminal 200 is, for example, a mobile phone such as a smartphone, and the CPU 201 loads the image display program 213 into the memory 202 and executes it, thereby realizing a computer function capable of displaying an image according to the present invention. The CPU 201 is an arithmetic processing device mounted on a normal mobile terminal, executes various programs, and performs various controls.

  FIG. 5 is a configuration diagram of a terminal (PC) according to the first embodiment of the difference image creation method of the present invention. The viewing PC 300 includes a control / arithmetic unit having a CPU 301 and a device driver with a memory 302, a storage device 310 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a communication control device such as a network interface 304, And an input / output device including a display 303 as a display device, a keyboard 305, a mouse 306, and the like. The storage device 310 stores an image display program 313 and an operating system 314. The browsing PC 300 is, for example, a desktop PC, a notebook PC, a tablet terminal, or the like. The CPU 301 loads the image display program 313 into the memory 302 and executes it, thereby realizing a computer function capable of displaying an image according to the present invention. The CPU 301 is an arithmetic processing device mounted on a normal PC, executes various programs, and performs various controls.

  The image display program is a program for realizing a terminal connection function for connecting to a recording server and an image display function for displaying an image transmitted from the recording server on a computer.

  As a more preferable aspect, the image display program further includes a live image request function for requesting a live image from the recording server at every camera image acquisition interval from the monitoring camera to the recording server during live image display on the computer. A rewind start request function for accepting an input of a rewind request during image display and requesting a rewind live image from the recording server, and a fixed time (for example, 0. 0) shorter than the live image request interval during rewind live image display. Every 2 seconds), a rewind continuation request function for requesting a rewind live image to the recording server, while receiving a rewind live image, accepts a fast forward request input from the user, and requests a rewind live image to the recording server. A fixed time (for example, 0.2 seconds) shorter than the request interval for live images while the fast live image display is in progress. To a program for also realizing the rewind live image fast-forward continuation request function for requesting fast forward a live image to the recording server.

  In the present embodiment, as a more preferable aspect, the image display program further receives a relive image request input to the computer during rewind live image display, and requests a relive image start request function from the recording server. This is a program for realizing a relive image continuation request function for requesting a relive image from the recording server at every camera image acquisition interval from the camera to the recording server during relive image display.

  In the present embodiment, the recording server 100, the viewing PC 300, and the difference detection device 400 are all configured as personal computers and have a clock function or the like that a normal personal computer has. The mobile terminal 200 also has a clock function and the like.

  In the difference detection method according to the present embodiment, the difference detection apparatus 400 according to the first embodiment includes a camera group that captures a moving image and a camera group that captures a still image (monitoring camera (for moving image) 700, monitoring camera ( (A still image) 701), connected to the recording server 100 via the router 600 and the network 500 including the Internet, and having a storage folder 411 for storing images, (1) a recording server Every time a connection request is received from the monitoring camera (for moving image) 700 or the monitoring camera (for still image) 701 from 100, the monitoring camera (for moving image) 700 or the monitoring camera (for still image) 701 (2) A monitoring camera connected to the difference detection device 400 every certain time or every time a request for all images from the recording server 100 is received. All images are acquired from (for moving image) 700 or monitoring camera (for still image) 701, are all images for all image transfer, and all images for all image transfer are stored in the storage folder 411, and the recording server 100 All image transfer means for transferring all images for all image transfer, (3) the difference detection device 400 is connected every predetermined time in a certain time or every time a difference image request is received from the recording server 100 All images from the monitoring camera (for moving images) 700 or the monitoring camera (for still images) 701 to obtain all images for differential image transfer, and (4) in the storage folder 411 Extraction means for extracting all stored images, (5) a difference image between all images extracted by the extraction means and all images for differential image transfer acquired by the difference image all-image acquisition means, Extraction hand The first difference image creating means for creating a first difference image in which an area where the all images extracted in step 1 and the difference image all images obtained by the difference image all image obtaining means are not different is used as a mask area. (6) The difference image between the entire difference image transfer image acquired by the difference image all image acquisition means and the first difference image, except for the mask area of the first difference image, the difference image Second difference image that creates a second difference image in which transparent color information is set for the mask area of the first difference image, as a corresponding portion of all images for difference image transfer acquired by the all-image acquisition unit Creation means, (7) difference image transfer means for transferring the second difference image to the recording server 100, and (8) difference image obtained by the difference image all image acquisition means for all images stored in the storage folder 411. All images for transfer All image replacement means for replacing is provided. In this embodiment, the difference image all-image acquisition unit further acquires all images from the monitoring camera (for moving image) 700 or the monitoring camera (for still image) 701 and then stores them in the accumulation folder 411. Compare all the images and the color composition of the images, remove the noise due to the change in the amount of light, and save.

  The difference detection apparatus 400 functions as means (1) to (8) by the hardware configuration and the difference detection program 413 described above.

  In the difference detection method of the present embodiment, the recording server 100 includes (1) a difference detection device connection means for connecting to the difference detection device, and (2) a connected difference detection device every fixed time (for example, 1 second). Image acquisition means for inputting an image to a recording server, (3) difference image determination means for determining whether the image acquired from the difference detection apparatus is a difference image, all image storage means for storing all images acquired from the difference detection apparatus, 4) Difference image conversion means for combining the difference image acquired from the difference detection device with all the images at the previous time and storing it as all images, (5) The acquired or combined all images in the memory until the next image generation Image holding means for holding; (6) primary data creating means for storing all acquired or synthesized images as primary data in a primary image folder; and (6) combining primary data every fixed time (for example, 10 minutes). It was assigned the time stamp is provided with a secondary data generating means for converting the secondary data compressed video format.

  The recording server 100 functions as means (1) to (6) by the hardware configuration and the shooting / collection / editing program described above. In addition, the recording server 100 functions as an image transmission unit such as a live image, a relive image, and rewinding or fast-forwarding of these images to the terminal by the above-described hardware configuration and transmission program.

  Also, the terminal 200, 300 is (1) live playback requesting means for requesting the recording server 100 to perform live playback of camera moving images for one or more monitoring cameras 700 with the authority to monitor, and (2) transmitted from the recording server 100. Live reproduction display means for displaying primary data, (3) past video reproduction request means for requesting the recording server 100 to reproduce past camera moving images for one or a plurality of monitoring cameras 700 having the authority to monitor, and (4) recording. Past video reproduction display means for displaying secondary data transmitted from the server 100 is provided. The terminal functions as means (1) to (4) by the hardware configuration and the image display programs 213 and 313 described above.

  Since the primary data created by compressing the camera image data is converted into secondary data by the recording server at regular time intervals, the terminal is not limited to rewinding live images or fast-forwarding after rewinding. It is also possible to reproduce, rewind, and fast forward past camera images, which is possible with a conventional recording / playback apparatus. Although the image quality is high, the data amount is small, and the rewind live composite image and fast-forward live composite image use primary data compressed for primary storage, so the data amount is small while high image quality. Since the secondary data, which is a moving image file that has been compressed and converted, is used for playback and fast forward rewinding more than the secondary data creation unit that is not frequently used, the amount of data required for storage can be reduced while moving images. Further, it becomes possible to reproduce the live composite image after rewinding.

  The above-described monitoring camera system including the monitoring camera, the difference detection device, the recording server, and the terminal includes the difference image creation method according to the first embodiment and the image transfer method according to the first embodiment using the difference image creation method. And a monitoring camera system that realizes the image restoration method according to the first embodiment, which is a restoration method of an image transferred by the image transfer method, and has a small amount of data to be transmitted from the difference detection device to the recording server. Even if a video camera is provided, a problem such as data delay is unlikely to occur, the amount of data transmitted from the recording server to the terminal is small, and a monitoring system that has a high resolution and a high image quality while reducing the load on the network can be realized. That is, the transfer capacity to the recording server can be reduced without reducing the number of transfer frames to the recording server and without reducing the resolution. Since the amount of data that flows simultaneously on the network is reduced, a camera image can be sent to the recording server through a general Internet line, and network camera information can also be sent to a general Internet line. In addition, data can be stored in a cloud server over the Internet line (WAN).

{procedure}
Next, a difference image creation procedure according to the first embodiment of the difference image creation method of the present invention will be described. In this procedure, the monitoring camera system including the above-described monitoring camera, difference detection device, recording server, and terminal is used.

  FIG. 6 is an image diagram of data transmission from the monitoring camera to the recording server in Embodiment 1 of the differential image creation method of the present invention. Both a stream IP camera that is a monitoring camera (for moving images) and a still image IP camera that is a monitoring camera (for still images) are connected to a difference detection device via a network HUB. The server machine that is connected to the Internet network via the HUB and is a recording server is connected to the Internet network.

  An all-image request or a difference image request is transmitted from the recording server to the difference detection device, and the difference detection device sends a monitoring camera (for video) or a monitoring camera (for still image) based on the request received from the recording server. Request an image. Based on a request from the difference detection device, the monitoring camera (for moving image) transmits a stream moving image to the difference detection device, and the monitoring camera (for still image) transmits a still image to the difference detection device. The stream moving image and still image transmitted to the difference detection device are edited into all images or difference images that are still images and transmitted to the recording server in the difference detection device. Therefore, only a still image flows through the Internet network, and the data amount of the difference image is smaller than that of all images, so that the load on the network can be reduced.

  FIG. 7 is an explanatory diagram of the difference extraction method in the embodiment of the difference image creation method of the present invention and the image restoration method from the difference image created by the embodiment of the difference image creation method of the present invention.

  In the difference image creation method of the present embodiment, (1) a first all image (“A image” in FIG. 7) and a second all image (FIG. 7) acquired successively after the first all image. The first image having a mask area that is a difference image between the first all image and the second all image and that is not different between the first all image and the second all image. A difference image (“difference between A image and B image” in FIG. 7), (2) a difference image between the second whole image and the first difference image, Except for the mask area, the second differential image in which transparent color information is set for the mask area of the first difference image is used as the corresponding portion of the second entire image ("extract difference generation area from B image" in FIG. 7). = “Difference image”). In the picture “Difference between A image and B image” in FIG. 7, the mask area is a blackened portion. In the picture “Extract difference occurrence area from B image” in FIG. 7, the blacked out area is an area in which transparent color information is set by converting into a format that can handle the transparent color as the α channel. Thereby, the image capacity can be reduced.

  In the restoration method of the difference image created by the difference image creation method described above, the difference generation area is extracted from the second whole difference image (“A image” in FIG. 7) and the second difference image (“B image” in FIG. 7). "=" Difference image "). When the second difference image is superimposed on the first all image, the second all image (“Draw only the difference image on the A image” = “B image” in FIG. 7) can be restored.

  The difference image creation method of the present embodiment is extremely effective in reducing the transfer capacity because the difference is small particularly in a surveillance camera system installed at a fixed point.

  The image transfer method of the surveillance camera including the difference image creation method of the present embodiment includes a camera group for capturing a moving image, a camera group for capturing a still image, and each camera of the camera group (monitoring camera (for moving image) / monitoring) An image transfer method in a surveillance camera system having a difference detection device connected to a camera (for still images) and having a folder for storing images, and a recording server connected to the difference detection device via a router and the Internet. (1) Every time when a request for all images from the recording server is received, the difference detection device acquires all images from the camera, sets all images for all image transfer, and transfers all images to the storage folder. A total image transfer step of storing all images for image transfer and transferring all images for transfer of all images to the recording server, and including a difference from the recording server every predetermined time in a predetermined time Each time an image request is received, (2) the difference detection device acquires all images from the camera and sets all images for difference image transfer as a difference image all image acquisition step; and (3) the difference detection device An extraction step for extracting all the images stored in the accumulation folder; and (4) a difference detection device for transferring all images extracted in the extraction step and difference image transfer acquired in the difference image all image acquisition step. A difference image with respect to all images, wherein an area in which all images extracted in the extraction step and all images for difference image transfer acquired in the difference image all image acquisition and extraction step are not different is defined as a mask area. A first difference image creating step for creating a difference image of the first difference image, and (5) a difference between the first difference image and the difference detection device from the difference image transfer all images acquired in the difference image all image acquisition step. In the image Thus, the areas other than the mask area of the first difference image are the corresponding parts of all the images for transferring the difference image acquired in the difference image all-image acquisition step, and the mask area of the first difference image is transparent. A second difference image creation step for creating a second difference image in which information is set; (6) a difference image transfer step in which the difference detection device transfers the second difference image to the recording server; and (7) a difference. Steps (2) to (7) of the all-image replacement step in which the detection device replaces all images stored in the storage folder with all images for differential image transfer acquired in the differential image all-image acquisition step. And (8) an all image storage step in which the recording server stores all images acquired from the difference detection device, and (9) a difference image acquired from the difference detection device by the recording server. It includes a difference image conversion step of combining the entire previous image and storing it as an entire image. Further, in the above-described all image transfer step and difference image all image acquisition step, in this embodiment, after all images are acquired from the camera, the color configurations of the images and the images stored in the storage folder are compared. , Remove the noise caused by the light intensity change, and save. Noise removal is performed in order to reduce the difference amount from each of the first all images and the second all images, and the timing at which the color configuration of the image is greatly changed (outdoor daytime, outdoor nighttime, indoor Adjustments that reduce the amount of difference using several still images (fluorescent lamps, no indoor lighting, etc.) are performed by determining the noise removal intensity.

  A surveillance camera system program having a photographing / collecting / editing program and a difference detection program causes a computer to execute these steps. This will be described more specifically with reference to the drawings.

  FIG. 8 is a flowchart showing an outline of the procedure from the connection between the monitoring camera (for still image) and the recording server to the writing of primary image data in the first embodiment of the differential image creating method of the present invention. First, the recording server requests connection to the difference detection device by the TCP / IP method. In response to the connection request, the difference detection apparatus issues a connection request to the monitoring camera (for still image). One or a plurality of monitoring cameras (for still images) are configured, and each camera and recording server authenticate with a user ID and a password via a difference detection device. When the difference detection apparatus receives a connection response from each camera and successfully authenticates with reference to the authentication database of the recording server, the connection state is established.

  Next, an image request is made from the recording server to the difference detection device. Upon receiving such an image request, the difference detection device requests (image request) the monitoring camera (for still image) to take a still image and transmit the captured camera image to the difference detection device in JPEG format. The surveillance camera (for still image) receives an image request, shoots a snapshot (still image), and uses the TCP / IP method to detect a still image obtained by shooting as a camera image in JPEG format. Send to. In this embodiment, since the video recording server side performs video compression conversion to secondary data at regular intervals, the camera that captures a still image does not need to have a video format function.

  When receiving the camera image of the still image, the difference detection device performs noise removal as described above, and the image (one image) transmitted from the monitoring camera (for still image) after the all-image request is transmitted from the recording server. Eyes). In the case of the first image, all images are transferred for transfer of all images, stored in the storage folder as all images for transfer of all images, and all images are transferred to the recording server for transfer of all images for transfer of all images. . If it is an image sent from the monitoring camera (for still image) after the difference image request is sent from the recording server (not the first one), it is stored in the accumulation folder as all the images for difference image transfer A second difference image in which transparent color information is set as described above is created from the differences from all the existing images, and difference image transfer is performed to transfer the second difference image to the recording server. The difference detection device replaces all images stored in the accumulation folder with the above-described all images for differential image transfer (second all images). These steps are repeated each time an image request is transmitted from the recording server.

  When the recording server acquires an image from the difference detection device, the recording server performs image restoration. First, it is determined whether the acquired image is a difference image. If the acquired image is a difference image, it is combined with all the images at the previous time to generate all images, and the acquired image is all images Is left as it is, and in either case, the image is developed in the memory and held until the next image generation. Then, the held image is stored in the primary image folder as primary data. Thereafter, the primary data is compressed and converted into a moving image and stored in the secondary video folder.

  FIG. 9 is a flowchart showing an outline of a procedure from connection of the camera (moving image shooting) and the recording server to writing of primary image data in the first embodiment of the differential image creating method of the present invention. First, the recording server requests connection to the difference detection device by the TCP / IP method. In response to the connection request, the difference detection apparatus issues a connection request to the monitoring camera (for moving image). One or a plurality of monitoring cameras (for moving images) are configured, and each camera and the recording server authenticate with a user ID and a password via a difference detection device. When the difference detection device receives a connection response from each camera, the difference detection device requests the monitoring camera (for moving image) to send a camera image of a streamed moving image taken to the difference detection device. Image request).

  Upon receiving an image request, the surveillance camera (moving image) continuously shoots moving images, and the moving images obtained by shooting are streamed in the H.264 format. H.264 baseline profile moving image as a camera image is transmitted to the difference detection device. When the difference detection device receives the camera image of the moving image, the difference detection device transmits a connection response to the recording server, and enters the connection state when the authentication is successful with reference to the authentication database of the recording server.

  Next, an image request is made from the recording server to the difference detection device. In response to such an image request, the difference detection device extracts still images from the received camera image of the moving image at predetermined intervals, and removes noise. The first still image extracted from the camera image of the received video is set as all images for all image transfer, stored in the storage folder as all images for all image transfer, and stored in the recording server for all image transfer. Transfer all images to transfer all images. The second and subsequent still images are all images for differential image transfer, and the second difference image in which transparent color information is set as described above is created from the differences from all images stored in the storage folder. Then, difference image transfer is performed to transfer the second difference image to the recording server. The difference detection device replaces all images stored in the accumulation folder with the above-described all images for differential image transfer (second all images). These steps are repeated each time an image request is transmitted from the recording server.

  When the recording server acquires an image from the difference detection device, the recording server performs image restoration. First, it is determined whether the acquired image is a difference image. If the acquired image is a difference image, it is combined with all the images at the previous time to generate all images, and the acquired image is all images Is left as it is, and in either case, the image is developed in the memory and held until the next image generation. Then, the held image is stored in the primary image folder as primary data. Thereafter, the primary data is compressed and converted into a moving image and stored in the secondary video folder.

  FIG. 10 is an image diagram illustrating an image conversion method according to the first embodiment of the difference image creation method of the present invention. FIG. 10 shows a state in which all images (I frames) and difference images (W frames) created by the difference detection device based on images acquired from the monitoring camera (for moving images) are transmitted to the recording server. The frame is a difference image including a transparent color. The primary data stored in the primary image folder of the recording server is all I frames, and the secondary data stored in the secondary video folder is from the primary data to the ratio of one I frame to 200 frames. This is a compressed moving image file including B frames and P frames.

  The present embodiment is a differential image creation method that can be used in a surveillance camera system for crime prevention, management, etc., and transfers captured images and data to a server for storage. The data transferred to the recording server by the image transfer method using this is restored to an image that can be displayed on the terminal by the image restoration method described above.

{effect}
According to this embodiment, the transfer capacity to the recording server can be reduced without reducing the number of frames transferred to the recording server and without reducing the resolution.

  In addition, data can be stored in the cloud server via the Internet line or the like. Compared to simple still image collection, the number of frames can be increased or the resolution can be increased. For example, even if the acquisition of an image of 1 frame per second with the I frame alone has been the limit, it is possible to acquire an image of 3 frames per second by using the I frame and the W frame. Can be raised. When the resolution is increased under the same conditions, a delay occurs in the first image, but after that, the difference becomes a difference and the capacity decreases, so that the on-time can be kept.

  When transmitting data from the camera to the terminal, packet loss is unlikely to occur and the amount of data transfer is small. Therefore, data can be stored in the cloud server over the Internet line (WAN).

  The present invention is not limited to the above embodiment, and various modifications can be made without departing from the spirit of the invention. In addition, the constituent elements of the above embodiments can be arbitrarily combined without departing from the spirit of the invention.

100 Recording server 101 CPU
102 Memory 103 Display 104 Network Interface 105 Keyboard 106 Mouse 110 Storage Device 111 Primary Image Folder 113 Shooting / Collecting / Editing Program 114 Operating System 200 Mobile Terminal 201 CPU
202 Memory 203 Display 210 Storage device 213 Image display program 214 Operating system 300 Viewing PC
301 CPU
302 Memory 303 Display 304 Network interface 305 Keyboard 306 Mouse 310 Storage device 313 Image display program 314 Operating system 400 Difference detection device 401 CPU
402 Memory 403 Display 404 Network interface 405 Keyboard 406 Mouse 410 Storage device 411 Storage folder 413 Shooting / difference detection / transmission program 414 Operating system 500 Network 600 Router 700 Monitoring camera (for video)
701 Surveillance camera (for still images)

Claims (6)

A difference detection device connected to each camera of a camera group for capturing moving images and / or a camera group for capturing still images, and connected to an image restoration device via a network ,
Every time a whole image request is received from the image restoration device or every time the image restoration device is received , all images are acquired from the camera as all images for all image transfer, and all images for all image transfer are stored in the image restoration device. All image transfer means to transfer,
A difference image all-image acquisition unit that acquires all images from the camera as all images for difference image transfer every predetermined time in the fixed time or each time a difference image request is received from the image restoration device ;
A difference image between the whole image for all image transfer and the whole image for difference image transfer acquired by the whole image acquisition unit for difference image, the whole image for whole image transfer and the whole image for difference image First difference image creation means for creating a first difference image using a mask area as an area that is not different from all images for transfer of difference images acquired by the image acquisition means;
The difference image is a difference image between the entire difference image transfer image acquired by the difference image all image acquisition unit and the first difference image, except for the mask area of the first difference image. A second difference that creates a second difference image in which transparent color information is set for the mask area of the first difference image, as a corresponding portion of all images for difference image transfer acquired by the all-image acquisition unit Image creation means,
Difference image transfer means for transferring the second difference image to the image restoration device ;
The difference detection apparatus characterized by having. The all image transfer means stores all images for all image transfer in a storage device,
Further comprising extraction means for extracting all images stored in the storage device;
The first difference image creating means creates a first difference image from the entire image extracted by the extracting means and the entire image for difference image transfer acquired by the difference image all-image acquiring means,
The difference detection device according to claim 1, further comprising an all-image replacement unit that replaces all images stored in the storage device with all images for transfer of difference images acquired by the all-image acquisition unit for difference images.   A difference execution method that is executed by a difference detection device that is connected to each camera of a camera group that captures a moving image and / or a camera group that captures a still image, and that is connected to an image restoration device via a network,
  Every time a whole image request is received from the image restoration device or every time the image restoration device is received, all images are acquired from the camera as all images for all image transfer, and all images for all image transfer are stored in the image restoration device. All image transfer steps to transfer,
  A difference image all image acquisition step for acquiring all images from the camera as all images for difference image transfer every predetermined time in the fixed time or each time a difference image request is received from the image restoration device;
  A difference image between the whole image for all image transfer and the whole image for difference image transfer acquired in the step for obtaining all images for difference image, wherein the whole image for all image transfer and the whole image for difference image are obtained. A first difference image creation step for creating a first difference image using a mask area as an area that is not different from all images for difference image transfer acquired in the image acquisition step;
  The difference image is a difference image from the entire difference image transfer image acquired in the difference image all image acquisition step to the first difference image, except for the mask area of the first difference image. A second difference that creates a second difference image in which transparent color information is set for the mask area of the first difference image, as a corresponding portion of all images for difference image transfer acquired in the all image acquisition step Image creation step,
  A difference image transfer step of transferring the second difference image to the image restoration device;
  A difference detection method characterized by comprising: A computer connected to each camera of a camera group that shoots moving images and / or a camera group that shoots still images, and connected to an image restoration device via a network,
  Every time a whole image request is received from the image restoration device or every time the image restoration device is received, all images are acquired from the camera as all images for all image transfer, and all images for all image transfer are stored in the image restoration device. All image transfer steps to transfer,
  A difference image all image acquisition step for acquiring all images from the camera as all images for difference image transfer every predetermined time in the fixed time or each time a difference image request is received from the image restoration device;
  A difference image between the whole image for all image transfer and the whole image for difference image transfer acquired in the step for obtaining all images for difference image, wherein the whole image for all image transfer and the whole image for difference image are obtained. A first difference image creation step for creating a first difference image using a mask area as an area that is not different from all images for difference image transfer acquired in the image acquisition step;
  The difference image is a difference image from the entire difference image transfer image acquired in the difference image all image acquisition step to the first difference image, except for the mask area of the first difference image. A second difference that creates a second difference image in which transparent color information is set for the mask area of the first difference image, as a corresponding portion of all images for difference image transfer acquired in the all image acquisition step Image creation step,
  A difference image transfer step of transferring the second difference image to the image restoration device;
  Difference detection program to execute A camera group for capturing moving images and / or a camera group for capturing still images, a difference detection device connected to a camera of the camera group, an image restoration device connected to the difference detection device via a network , A surveillance method in a surveillance camera system comprising:
The difference detection device acquires all images from the camera as all images for all image transfer every fixed time or every time a request for all images from the image restoration device is received, and the image restoration device stores the all images. Including an all-image transfer step for transferring all images for transfer;
And,
Every time the difference detection request is received from the image restoration device every predetermined time in the fixed time, the difference detection device acquires all images from the camera as all images for difference image transfer. An image acquisition step;
The difference detection device is a difference image between the whole image for all image transfer and the whole image for difference image transfer acquired in the step for obtaining all images for difference image, and the whole image for all image transfer. And a first difference image creating step for creating a first difference image using a mask area as an area where the difference image all images obtained in the difference image all image obtaining step are not different from each other,
The difference detection device, a differential image between the first differential image from the entire image for the differential image transfer acquired by the whole image preparative Tokusu step for the difference image, the mask of the first difference image The area other than the area is a corresponding part of all the images for transferring the difference image acquired in the difference image all-image acquiring step, and the second difference in which transparent color information is set for the mask area of the first difference image. A second difference image creation step for creating an image;
A difference image transfer step in which the difference detection device transfers the second difference image to the image restoration device ;
Including repeating each step of
And,
The image restoration apparatus stores all images acquired from the difference detection apparatus .
The monitoring in the surveillance camera system characterized in that the image restoration device includes a difference image conversion step of combining the difference image acquired from the difference detection device with all the images at the previous time point and saving as a whole image. Method. In the all image transfer step, all the images for all image transfer are stored in a storage device,
Further, in the above total image transfer step, or the difference image all image acquisition step for, after acquiring all the images from the camera, the image with the whole image stored with all the images on the acquired in the storage device monitoring method in a monitoring camera system according to claim 5, comparing the color configuration, and removing the noise of the light amount change.

Images