TW201737689A - Monitor camera system and monitor camera data saving method - Google Patents

Abstract

In the present invention a recording server, which is connected via a network to a monitor camera group that captures moving images, and which stores data on a storage device, has: a camera image acquisition means that causes the monitor camera group to capture moving images, and inputs the captured camera images to the recording server; a primary video data creation means that stores the input camera images in the storage device as primary video data; a combining means that combines the primary video data as one file of primary video data for each fixed amount of time; and a secondary video data creation means that reconverts the combined primary video data to create secondary video data.

Description

Surveillance camera system and surveillance camera data storage method

The present invention relates to a surveillance camera system and a surveillance camera data storage method for accumulating photographed pictures for theft prevention, management, and the like.

Conventionally, for the purpose of anti-theft or investigation or management, a camera system is introduced, and a surveillance camera monitors the entrance or exit of a building such as a house or a street, a factory, or a logistics center as a monitoring target. The monitoring result is sent to the monitor of the user terminal via an electronic communication line such as the Internet to be monitored. In the case of a camera system that displays a still picture and displays it (see, for example, Japanese Laid-Open Patent Publication No. 2013-51534), in general, a system for recording an animation recorded by a camera is known (for example, refer to Japanese Special Edition). Bulletin 2002-77882). In the industry of surveillance cameras, displaying real-time movies is considered an absolute condition, so even today, as IP camera technology is gradually developed, analogy is still at an advantage.

A surveillance camera system of the present disclosure has a video server that is connected to a surveillance camera group that captures an animation through a network to memorize the data in a memory device. The video server has a camera animation acquisition means for the aforementioned monitoring. The camera group captures an animation, and the captured camera animation is input to the video server; the video data creation means accumulates the input camera animation in the memory device as a video material; and the combination means, for each of the aforementioned video materials, A film material combined into a single file at a certain time; and a secondary film data creation means, the previously-converted video material is re-converted to be a secondary film material.

100‧‧‧Video Server

101, 201, 301‧‧‧ CPU

102, 202, 302‧‧‧ memory

103, 203, 303‧‧‧ display

104, 304‧‧‧ network interface

105, 305‧‧‧ keyboard

106, 306‧‧‧ Mouse

110, 210, 310‧‧‧ memory devices

111‧‧‧A picture folder

112‧‧‧Second film folder

113‧‧‧Photographing/collection/editing/transmission program

114, 214, 314‧‧‧ operating systems

115‧‧‧A video folder

200‧‧‧Mobile device terminal

213, 313‧‧‧ picture display program

300‧‧‧Reading PC

400‧‧‧Monitoring camera (for animation)

401‧‧‧Monitoring camera (for static screen)

500‧‧‧Network

600‧‧‧ router

[Fig. 1] Fig. 1 is a system image diagram of an analog camera.

2] Fig. 2 is a system diagram in the case of directly replacing an analog camera system with an IP camera.

FIG. 3 is a system image diagram in a case where an analog camera system is replaced with an IP camera and introduced into a software recorder.

Fig. 4 is a view showing an example of a system configuration of a surveillance camera system according to the first embodiment.

Fig. 5 is a view showing the configuration of a video server of the surveillance camera system of the first embodiment.

Fig. 6 is a configuration diagram of a terminal (mobile device) of the surveillance camera system of the first embodiment.

Fig. 7 is a configuration diagram of a terminal (PC) of the surveillance camera system of the first embodiment.

Fig. 8 is a schematic view showing a method of conversion and retransformation in the surveillance camera system of the first embodiment.

Fig. 9 is a schematic flow chart showing the procedure from the connection of the camera and the video server to the picture editing in the surveillance camera system of the first embodiment.

Fig. 10 is a flow chart showing the data compression (optimization) of the surveillance camera system of the first embodiment.

Figure 1 is a system image of an analog camera. In the system of the analog camera, as shown in Fig. 1, the camera must be directly wired from the camera to the recorder. Although the direct wiring can be used to deliver a film without delay on the monitor, there is a problem such as a large project. In addition, as shown in FIG. 1, the number of connected units is divided into 4, 8, and 16 sets, etc., because the number of terminals that can be directly connected to the recorder is determined to be good, and when the addition or the like is added, it is necessary to purchase a recorder. The problem.

2 is a system image diagram in the case of directly replacing an analog camera system with an IP camera. When the analog camera is simply replaced with an IP camera connected by a network HUB as shown in FIG. 2, if the number of cameras is small, it can be used like an analog camera system. If the demand is a simple reading level in the monitor, the system can be fully satisfied. However, since the flow rate is concentrated on the LAN of the hardware recorder, there is a problem that the data is delayed or defective. In addition, the animation for reading is a high-quality animation that does not separate LANs and mobile devices. As a result, the demand for reading in recent mobile device terminals can only be barely read. In response to this, there is a problem that the function of the nearest mobile device terminal capable of playing high-definition animation is not utilized. In addition, since the basic base is an animation, there is a problem that it is not good at a momentary response or a reply after disconnection.

Fig. 3 is a system diagram showing a case where an analog camera system is replaced with an IP camera and introduced into a software recorder. As shown in FIG. 3, in order to respond to the function that the hardware recorder cannot fully respond to the software, the software recorder is connected, that is, the server of the VMS (image management system) software is operated. It will increase, but the traffic will be concentrated on the LAN of the server machine, so there will be problems such as delays and defects in data. In such a system, in order to be able to look forward to the improvement of the reading level, there are various things to be realized, such as face authentication, motion detection, digital authentication, and linkage of other systems, etc., in order to be introduced into the airport or important According to the method of the point, etc., on the other hand, the number of cameras is extremely large, and there is a problem that a delay in reading is likely to occur. In addition, when introducing an environment that is used in an analogous manner, there is a problem that it is not easy to achieve a delay-free reading in an analogous manner, and there is a problem that it is easy to cause dissatisfaction. In addition, the video data will be concentrated on the network of the server, and at the same time, the data from the server will be read. Since the monitor transmits communication by the terminal, there is a problem that it is necessary to widen the network or increase the server specifications. In addition, since the basic substrate is still animated, there is a problem that it is not good at short-circuiting or a reply after disconnection.

Moreover, in order to store the animation data on the server, there is a problem that the data capacity becomes large or the problem cannot be stored for a long period of time. In addition, it is necessary to prepare a large number of large-capacity servers, which is costly.

Due to the limited amount of data, in order to reduce the capacity of the animation, it is necessary to reduce the bit rate (the amount of data received). However, if only the bit rate is lowered, there is a problem that blockiness is likely to occur in the case of a movie such as a motion with a large dynamic. In order to avoid this problem, you can do the measures to reduce the resolution of the film, or reduce the number of frames, but the low resolution video will be rough and can not be a clear film under the high-resolution device. The problem, while the film with a small number of frames, will become like the fixed play and the problem of missing important frames.

[Embodiment]

A first object of the embodiment described below is to provide a surveillance camera system and a surveillance camera data storage method that can achieve optimal data storage and achieve cost reduction.

The inventors reviewed various problems that occurred when replacing an analog camera with an IP camera, and based on the idea of monitoring the camera as a condition necessary for monitoring the camera in real time, after completing various trials and errors, the following was completed. Implementation form.

The surveillance camera system according to the first aspect of the embodiment includes a video server that is connected to a surveillance camera group that captures an animation through a network, and stores the data in a memory device. The video server has a camera animation acquisition means. The surveillance camera group captures an animation, and the captured camera animation is input to the video server; the primary video data creation means accumulates the input camera animation in the memory device as a video material; and the first video data is combined with the means , a film data combined into a single file at regular intervals; and a secondary film data creation means, the previously combined film data is re-transformed to create a secondary film material.

According to the first aspect of the embodiment, optimal data storage can be achieved, and cost reduction can be achieved.

According to the first aspect of the embodiment, it is a matter of course that the camera industry cannot be monitored in real time, but it can be implemented in many other things, such as avoiding traffic concentration and preventing animation. Lack of leakage, reduce the load on the server, prevent the display speed from deteriorating, reduce the capacity, and save long-term high-definition movies, and achieve high-definition movie readings under mobile devices. In addition, there is no need to purchase additional records when the camera is added. The device is also simple to construct, and it is also good for the recovery after a momentary break or disconnection, and can achieve long-term preservation at low cost. The term "optimization" as used in this application means minimizing the amount of data while preventing deterioration of image quality as much as possible, and by optimizing, for example, in a terminal where traffic is limited, such as mobile devices. Can achieve high quality playback. In the past, it has been a premise to perform animation playback without delay and smoothness. No one has thought about re-converting the load on the server. However, according to this aspect, it is possible to create low-capacity data for long-term storage. Here, the predetermined time in the combining means is preferably about 10 minutes, but the present invention is not limited thereto. For example, in the case where the subject has almost no dynamic monitoring camera, it can be set for a long time.

A monitoring camera system according to a second aspect of the present invention is the monitoring camera system according to the first aspect, wherein the video server further includes: a memory deployment means for converting the input camera animation into a continuous still image And deployed in the memory as a picture data; and a picture data accumulation means, the first picture data is accumulated in the memory device.

According to this aspect, the picture data that is extracted from the input camera animation and deployed in the memory and accumulated is transmitted to the terminal as a continuous still picture, so that even a PC connected by a network such as the Internet Terminals such as mobile devices can still play continuous still pictures in high quality with a pseudo-animation. Since it is a continuous playback of static pictures, it can be reversed and played back or jumped to any place with a scrolling column to play, or reverse and then fast forward. Further, during the period in which the still picture is deployed in the memory, the secondary video material can be optimized into the secondary video data by the secondary video material creation means, so that the concentration of the processing load in the server can be avoided. In addition, after the secondary film material is created, the created secondary film data can be transmitted to the terminal as a camera animation, and in addition, the data can be The state of small capacity is stored for a long time. Therefore, it is possible to perform playback of a continuous still picture of high image quality, and it is possible to achieve optimized data storage and achieve cost reduction.

That is to say, according to this aspect, the picture at the current time point can be played in high-definition real-time, and the animation can be maintained for a long period of time with high image quality and small capacity and can be transmitted to the terminal. The "picture at the current time point" means the latest picture obtained by the surveillance camera. Therefore, the picture at the current time point is changed to a new picture whenever the camera animation is input to the video server. In the present application, the term "immediate play" means playing a picture (instant picture) at the current time point. In addition, the "picture" is a word that encompasses the meaning of both the still picture and the dynamic picture. However, in the present application, when the difference is specifically distinguished, the still picture is represented as "picture" and the dynamic picture is represented as "movie".

The surveillance camera system according to the third aspect of the present invention is the surveillance camera system according to the first or second aspect, wherein the camera animation acquisition means converts the captured camera animation to the camera group. The input is input to the video server, and the conversion is encoded into an intra-frame that can be decoded separately and at regular intervals, and a reference to the past frame to create a plurality of numbers between the inner frames. a predictive inter-frame, in which the secondary film data creation means is formed in a bi-predictive frame created by referring to both past and future frames in the aforementioned video material. The number of frames in the aforementioned inner frame and the aforementioned prediction is reduced. To do less conversion of the code to make a secondary film material.

The compressed form of the animation is currently preferably a high compression H.264, but can also be encoded by a next generation such as H.265. The capacity of the server must have a limit. Because of the data defect often occurring in the animation, it is necessary to obtain one internal drawing in one second, so the amount of data will become large and it is difficult to save data over a long period of time. However, according to this aspect, it is based on temporary transformation. The inner frame and the prediction frame in the animation for a certain period of time are used to create a two-way prediction frame, which can be used for long-term preservation and can produce high-quality and low-capacity data.

A surveillance camera system according to a fourth aspect of the present invention is the monitor camera system according to the third aspect, wherein the number of the inner frames in the secondary video material is set in the one-time video material of the same time portion. The number of inside frames is less than one-fifth.

By reducing the number of large-capacity inner frames, it is possible to compress the amount of data, and it is possible to prevent image quality from being reduced by filling the frame between two-way prediction.

The monitoring camera data storage method according to the fifth aspect of the embodiment includes: a camera animation obtaining step of connecting a monitoring camera group that captures an animation through a network to memorize the data in a recording server of the memory device, and the monitoring camera group Shooting an animation to input the captured camera animation to the video server; and a video data creation step, wherein the video server stores the input camera animation in the memory device as a video material; In combination with the steps, the video server combines a video data of a single file at a certain time for the previous video data; and the second video data creation step is performed by the video server to combine the previous video data. Then change to create a secondary film material.

According to the fifth aspect of the embodiment, optimal data storage can be achieved, and cost reduction can be achieved.

The monitoring camera data storage method according to the sixth aspect of the embodiment is the monitoring camera data storage method according to the fifth aspect, further comprising: a memory deployment step, wherein the video server converts the input camera animation into The continuous static picture is deployed in the memory as a picture data; in the image data accumulation step, the video server accumulates the previous picture data in the memory device; the instant playback receiving step is performed by the video server from the through network The terminal connected to the video server accepts the instant playback of the camera animation; the instant playback step is that the video server transmits the previous image data to the terminal and displays it; the past video playback receiving step is performed by the video server The terminal accepts the past camera animation of the camera animation; and the past video playback step, the video server transmits the second video material to the terminal and displays it.

According to this aspect, a picture data will be created and able to High-quality continuous static playback, so that the current time point of the picture can be played in high-quality real-time playback, while the secondary video data will be created and converted into a small amount of data but with two-way predictive painting The image is filled with high-quality animation, so it can be used for long-term storage and can save high-quality images with small capacity and can be transmitted to the terminal. In addition, the amount of storage is drastically reduced, and the cost can be reduced. When the camera is added, there is no need to purchase a recorder, the construction is simple, and the response after the momentary or disconnection is also good, and the long-term preservation can be achieved at low cost.

Hereinafter, the embodiment will be specifically described by way of examples, but the embodiment is not limited thereto.

[First Embodiment]

In the first embodiment, the monitoring camera is activated by the video server through the network, the video server captures/collects/edits/saves the animation, and the video server transmits the network to the user terminal according to the requirements of the terminal. Transfer high-quality images to be monitored, and also save low-capacity and high-definition movies for long-term storage. It can also play/reverse/fast-forward, and play instantly or from the current time. The reversal, and the fast-moving picture of the current time point. In this embodiment, although it is impossible to monitor the real-time animation, it is a matter of course for the surveillance camera industry, but it can be implemented in many other things, such as avoiding traffic concentration, preventing partial omission of animation, and reducing servo. The load of the device, the speed of the display is prevented from decreasing, the capacity is reduced, the long-term storage of the high-definition animation is completed, and the high-definition movie reading under the mobile device can be achieved. In this embodiment, The animation of the surveillance camera is converted into an intra-frame (hereinafter referred to as an I-frame) and a predicted inter-frame by a baseline profile of H.264 (hereinafter referred to as an animation profile). The P-frame is acquired, and it is accumulated, and after a certain period of time, it is converted into a file, and then converted into an animation using a bi-predictive frame (hereinafter referred to as B-frame), so that the inner frame can be made (I-frame) The number of the images is very small, and the B-frame that cannot be inserted in real time can be inserted at the same time as the animation is acquired, so that the effective function of using H.264 can be optimized, and the server can be stored for a long period of time even if the server capacity is small. High-quality animation can still be played after a long period of time. In addition, at the same time, the input camera animation is converted into a continuous static picture and deployed in the memory as a picture material, and the deployed picture data is accumulated. A picture data can be transmitted to the terminal for instant playback of the camera animation. In addition, once the picture data is a static picture, it can also be reversed and played.

(constitution)

Fig. 4 is a view showing an example of a system configuration of a surveillance camera system of the first embodiment. In the network 500 composed of a communication network such as a LAN, an Internet, a Wi-Fi line, or a 3G line, (1) as a camera for taking pictures, there are a plurality of monitoring cameras (for animation) 400E to F, A plurality of monitoring cameras (for static screens) 401A to D; (2) as a monitoring camera (for animation) 400 connected to the LAN in the network 500, and a monitoring camera (for static screen) 401 through the network Connected to the road 500, and acquire and accumulate the picture data taken by each camera (camera still picture) or video material (camera animation), the video server transmitted to the terminal is connected to the video server 100; (3) is connected to the video server 100 via the network 500, and receives the video server 100. The terminal for displaying the video material is connected to a mobile device terminal 200A, B such as a smart phone, or a reading PC 300A to C such as a desktop PC (personal computer) or a notebook PC. Hereinafter, when the mobile device terminal and the reading PC are collectively referred to as "terminal" or "Viewer".

The video server 100 is located in the same LAN as the monitoring camera (for animation) 400. However, the monitoring camera (for static screen) 401 is not limited to the same LAN, and may be connected to the network 500 through the router 600. Connect via the internet. In the present embodiment, the communication between the monitoring camera (for static screen) 401 and the video server 100 and the communication camera (for animation) 400 and the video server 100 are TCP/IP, and it is possible to reliably perform picture data. Send and receive, high reliability.

The monitoring camera (for animation) 400 and the monitoring camera (for static screen) 401 may be an IP camera or an analog camera. In the case of analogy, a converter is required. The terminal for picture display, that is, the reading PC 300, is not limited to the case where the video server 100 exists in the same LAN. As long as it is connected to the network 500 through the router 600, it can also be connected through the Internet. The mobile device terminal 200, which is a terminal for picture display, can also be connected through a plurality of networks such as a LAN, an Internet, or a mobile phone network (a Wi-Fi line or a 3G line).

1 video server 100 capable of monitoring photography from multiple stations The camera (for animation) 400 acquires a camera animation, or acquires a camera still image from a plurality of monitoring cameras (for static screens) 401. In this embodiment, the video server 100 side will automatically disperse the network traffic, so no network design is required, and the camera can be connected to the camera, so the operation becomes very simple.

Fig. 5 is a view showing the configuration of a video server of the surveillance camera system of the first embodiment; The video server 100 includes: a control/calculation device having a CPU 101 or a device driver with a cache memory, that is, a memory 102; and a memory device 110 having a main memory device such as a DRAM or an auxiliary memory device such as a hard disk; The input/output device is composed of a communication control device such as a network interface 104 or a display 103 as a display device, a keyboard 105, a mouse 106, and the like. The memory device 110 stores, in addition to the primary picture folder 111, the primary video folder 115 and the secondary video folder 112, the imaging/collection/editing/transfer program 113, the authentication database, and the environment setting folder. Operating system 114. The capture/collection/edit/transfer program 113 is typically stored in the auxiliary memory device of the memory device 110 and is loaded into the main memory device upon execution. In the video folder 115, a video data is acquired from a camera animation obtained from a surveillance camera (for animation), and a video data is combined into a single file at a certain time. Re-accumulation, the secondary video folder 112 is a secondary video material that is reconstructed by combining one video material into a single file. In addition, in one picture folder 111, one piece of picture data which is extracted and is written to the picture data of the memory 102 is created and accumulated. In the authentication database, an ID, a password, a frame number and an IP address of each of the monitoring camera 400 or the mobile device terminal 200 or the reading PC 300 are accumulated, and if it is a terminal having no IP address, the individual identification information (UID) is accumulated. . In this embodiment, the video server 100 is a video server integrated with the terminal so as to function as a terminal for displaying a picture itself, and further has a display 103 or a keyboard 105 as an input means for maintenance or management. Mouse 106. When it is not necessary to play a camera animation with a video server, the terminal function as a picture display device may not be used. In the environment setting folder, a movie acquisition time point, a video material, a creation interval of a primary image data or a secondary video material, a conversion condition, and the like are accumulated.

Further, the video server 100 transmits a picture to the video server 100 for the surveillance camera (for the static picture) 401, and the obtained still picture is stored in the memory 102, and is processed by another process. The picture deployed in the memory is stored in the picture folder 111 once, and after a certain period of time, for example, 10 minutes, the continuous still picture of the picture folder 111 is converted into an animation. The number of I-frames of the converted animation is about 10 minutes in 10 minutes, and the amount of data is extremely small. Therefore, it is easy to maintain the form of the animation file and transmit it to the terminal, etc., but the details of the data storage method for the surveillance camera (for static screen) are Omitted in this case. In the description of the present embodiment, the description of the camera for monitoring (for a still screen) will be omitted unless otherwise specified. Hereinafter, the term "monitoring camera" will mean monitoring. Camera (for animation).

The video server 100, the CPU 101 loads the capture/collection/edit/transfer program 113 into the memory 102 and executes it, thereby realizing the acquisition from the camera animation to the editing and the image delivery processing to the terminal in the cost-effective embodiment. The function of the computer. The CPU 101 is an arithmetic processing device mounted on a normal computer, and executes various programs and performs various controls.

The video server 100 can be configured as one server, or can be a server group composed of a plurality of video servers. For example, for a secondary video folder, for a secondary video material after a certain period of time (for example, 24 hours), the storage destination may be set as a video server different from the video server that acquires the camera animation. Secondary video folder. By placing additional saved data that will not be played frequently, it is possible to monitor more cameras on the same network.

The photographing/collection/editing/transporting program 113 is a program for causing a computer to realize the following functions, that is, a camera connecting function connected to one or a plurality of monitoring cameras, and one or a plurality of terminals. Connected terminal connection function, continuous shooting of the connected surveillance camera at regular intervals (for example, 10 minutes), input of the captured camera animation to the camera animation acquisition function of the video server, and accumulation of the input camera animation to the video servo A video clip in the memory device of the device is used as a function of a video material of a video material, and a combination function of a video material combined into a single file at a certain time (for example, 10 minutes) of a video data will be combined. Cheng Cheng’s video material was re-transformed to create a second film material for the second film material. Become a function.

In this embodiment, the shooting/collecting/editing/transferring program 113 is further used to enable the computer to implement the following functions, that is, to convert the input camera animation into a continuous static image and deploy it to the memory as a time. The memory deployment function of the picture data, the image data accumulation function of one picture data folder in which the image data is accumulated in the memory device.

In this embodiment, the shooting/collecting/editing/transferring program 113 is further used to enable the computer to implement the following functions, that is, the instant playback receiving function for receiving the instant animation of the camera animation from the terminal, and transmitting the image to the terminal once. Information and display it for instant playback.

In this embodiment, the shooting/collecting/editing/transferring program 113 is further used to enable the computer to implement the following functions, that is, the past film playback acceptance function that accepts the past camera animation from the terminal, and will be accepted. The past two films were taken from the secondary video folder and the extracted secondary video data was transmitted to the terminal and displayed to show the past video player functions.

In this embodiment, the connection between the surveillance camera 400 and the video server 100 is performed by TCP/IP. In order to identify the surveillance camera, the camera ID is authenticated on the video server side with the set user ID and password, and then the camera animation is performed. Photography and other requirements. The connection between the terminals 200 and 300 and the video server 100 is also performed by TCP/IP, and the user ID and password are used for authentication, and the terminal is confirmed to be a terminal registered in the video server. Authentication, preferably by video server The certification database is used for authentication.

Even if the terminal or camera is not on the same LAN, as long as it is connected to the network through the router, it will be carried out with the IP address of the connected router and the assigned number. When connecting via the Internet, set the router number of the router between the two to "Active". If there is a mobile device terminal without an IP address, the UID is utilized.

The animation transmission from the surveillance camera 400 to the video server 100 is transmitted in RTSP (Instant Stream Protocol). In this embodiment, the transmission is performed by H.264 compression, but may also be the next generation coding such as H.265.

Fig. 6 is a view showing the configuration of a terminal (mobile device) of the surveillance camera system of the first embodiment. The mobile device terminal 200 includes: a control/calculation device, a CPU 201 with a memory 202, a device driver, etc.; and a memory device 210; and a communication control device for transmitting and receiving data; and a display 203 as a display device; And an input/output device such as an operation button or a touch panel. The picture display program 213 or the work system 214 is stored in the memory device 210. The mobile device terminal 200 is, for example, a mobile phone such as a smart phone, and the CPU 201 loads the picture display program 213 into the memory 202 and executes it, thereby realizing the function of a computer that can realize the display of the movie transmitted to the terminal. The CPU 201 is an arithmetic processing device mounted on a normal mobile device terminal, and executes various programs and performs various controls.

Fig. 7 is a view showing the configuration of a terminal (PC) of the surveillance camera system of the first embodiment. Read PC300 with: control / calculation device, A CPU 301 or a device driver with a memory 302; and a memory device 310 having a main memory device such as a DRAM or an auxiliary memory device such as a hard disk; and an input/output device, a communication control device such as a network interface 304 or a display device The display 303, the keyboard 305, the mouse 306, and the like are formed. In the memory device 310, a picture display program 313 or an operation system 314 is stored. The reading PC 300 is, for example, a desktop PC, a notebook PC, a tablet terminal, or the like, and the CPU 301 loads the picture display program 313 into the memory 302 and executes it, thereby realizing a computer that can realize the display of the camera animation transmitted to the terminal. function. The CPU 301 is an arithmetic processing device mounted on a normal PC, and executes various programs and performs various controls.

The picture display programs 213 and 313 are programs for causing the computer to implement the following functions, that is, a terminal connection function for connecting to a video server, and a video server for one or a plurality of cameras having monitoring authority. Camera animation playback of the camera animation requires the function to display the camera animation function of the camera animation transmitted from the video server.

The video server 100 can identify the connection target by using the connection between the IP address and the UI number when the monitoring camera connection in the local environment is started, and authenticates with the user ID and password. The video server 100, in connection with the surveillance camera that handles the remote environment, uses the router's 埠 transmission (also represented by port forwarding, etc.), thereby using the global IP address and the 埠 number to identify Connect objects. The video server 100 recognizes the terminal based on the terminal-specific information of the UID when the connection of the reading terminal is started, and thus the user ID and password are used. The image can be displayed by the consistency of the authentication and the inherent information of the terminal.

In the present embodiment, both the video server 100 and the reading PC 300 are configured as a personal computer, and have a clock function or the like of a normal personal computer. The mobile device terminal 200 also has a clock function and the like.

In this embodiment, the video server 100 is provided with a memory device that is connected to the surveillance camera 400 that captures the video and memorizes the data, and a terminal (the mobile device terminal 200 or the reading PC 300) through the network. 500 is connected to the video server 100 to display a camera animation; the video server 100 is provided with (1) a camera animation acquisition means for causing the surveillance camera 400 to capture an animation, and the captured camera animation is input to the video server 100 ( 2) accumulating the input camera animation in a video folder 115 in the memory device 110 as a film data creation means for one video material, and (3) combining the video files into a single file at regular intervals. The combination of film materials and (4) the transformation of a film material into a second film material to create a secondary film data.

In this embodiment, the video server 100 further includes (5) converting the input camera animation into a continuous static image and deploying it in the memory 102 as a memory deployment means for the primary image data, and (6) once. The picture material is accumulated in one picture data folder 111 of the primary picture folder 111 in the memory device 110.

In this embodiment, the video server 100 further includes (7) the slave terminals 200 and 300, and accepts the instant play receiving hand of the instant animation of the camera animation for one or more cameras 400 having the monitoring authority. The segment (8) is an instant playing means for transmitting the picture data to the terminal 200, 300 and displaying it for the camera 400 that has received the instant playing request.

In the embodiment, the video server 100 further includes (9) the slave terminals 200 and 300, and accepts the past movie playback acceptance means for the playback of the previous camera animation for one or more cameras 400 having the monitoring authority, (10) For the camera 400 that has accepted the request for the past video playback, the received secondary video material is extracted from the secondary video folder, and the extracted secondary video data is transmitted to the terminal 200, 300 and the displayed past video is played. means.

The video server 100 functions as (1) to (10) by the aforementioned hardware configuration and shooting/collection/editing/transmission program 112.

Fig. 8 is a schematic view showing a method of conversion and retransformation in the surveillance camera system of the first embodiment. The video is transmitted from the IP camera, that is, the surveillance camera 400, to the video server 100 in a baseline profile. In the present embodiment, the camera animation device is configured to convert and capture the captured camera animation into the surveillance camera 400, and the conversion is encoded into an inner frame that can be separately decoded and created at regular intervals, and Referring to the previous frame, a plurality of predictive frames are created between the interior frames. In addition, in the second film data creation means, in the present embodiment, in a film material, a two-way prediction frame created by referring to both the past and the future frame is created, thereby making the inner frame and the prediction picture. The number of cells is reduced and the code is transformed again to create a secondary film material.

The input camera animation, which is a baseline profile, is accumulated in the video server 100 in the video folder 115. The secondary video material, which is a high-profile, is accumulated in the secondary video folder 112 in the video server 100.

In this embodiment, in one movie material, the I frame (inside frame) is every 1 second, for example, a baseline profile of each of the 9 frames of the P frame (predictive frame) is inserted therebetween, and the second video material is included. In the middle, the I frame is set to insert a B-frame (a bi-predictive inter-frame) every 25 seconds, and the capacity is reduced by not combining it with the P-frame. In this case, a 10-minute video material has an I-frame of 600 frames and a P-frame of 5400 frames. For example, the secondary film data is optimized into an I-frame of 24 frames and a P-frame of 2000. The frame and B frame are 3976 frames, which will reduce the capacity, but can maintain high image quality. According to this embodiment, the video data of the video is optimized after completion, so that the I frame can be made very small. In addition, it is possible to insert a B-frame by referring to a future frame. The B frame is comparatively different before and after, so it will be smaller than the P frame.

In this embodiment, the video data is saved in a video folder 115. Once a certain time, for example, a 10-minute video is saved, the files segmented due to a session disconnection or the like are converted into a single one. A video of a 10-minute file. For a certain period of time, it is not limited to 10 minutes, 5 points or 20 points, and can be set arbitrarily. A video material combined into a single file is saved in a video folder 115. One video material, in this embodiment, the streaming video (baseline profile) from the webcam is not optimized, so Depending on the setting of the transmission capacity, it may become a very large file. For example, if you want to make a pure movie, it will be a transfer setting of 2 Mbps, so it will become 150 MB in 10 minutes (2 Mbit × 60 seconds × 10 points = 1200 Mbit = 150 MByte). In the present embodiment, the video from the camera is temporarily accumulated and then converted, so that it can be converted into a high-profile to reduce the capacity.

In addition, in the embodiment, the video data is stored in the memory 202, and is written to the primary image data folder 111 as a primary image data, and transmitted to the terminal 200. 300 as a camera animation. Further, in the camera animation sending means, in the present embodiment, the secondary movie data accumulated in the secondary movie folder 112 is directly transmitted to the terminals 200, 300 as a camera animation. If the video data is maintained as it is, the capacity is large. If it is maintained, the transmission will be very time consuming. Therefore, it can only be viewed in the same LAN environment. Therefore, the image is temporarily deployed in the memory and transmitted to the Viewer. The secondary film data is optimized. If the fixed point can reduce the capacity to about 1/100, even if there is dynamic, it can be reduced to 1/10. Therefore, the capacity will be reduced to the terminal of the mobile device. The extent of processing, so it can be deployed directly to a web page or to a mobile device environment.

Further, the terminal (the mobile device terminal 200 and the reading PC 300) is provided with (1) one or a plurality of monitoring cameras 400 having monitoring authority, and an immediate playback request means for the video server 100 to request instant playback of the camera animation, (2) Display is transmitted from the video server 100 The instant playback display means of the received image data, (3) for the surveillance camera having one or more surveillance cameras 400, the previous video playback request means for the video server 100 to play the past camera animation, (4) The past movie playback display means for displaying the secondary video material transmitted from the video server 100. The terminal functions as (1) to (4) by the hardware configuration and the picture display programs 213 and 313 described above. In the present embodiment, for example, immediately after the imaging is completed, the video server 100 deploys the primary picture data composed of the still picture created by cutting out from the camera animation to the memory 202, and writes it to the primary picture folder 111. The primary picture data can be transmitted to the terminal for instant playback. Even after, for example, one week later, in the video server 100, the designation of the camera picture, such as playing by date and time, can be accepted from the terminal, and the designated past time point is set. The secondary video material is extracted from the secondary video folder and transmitted to the terminal to play the past video.

In the present embodiment, the video camera 100 is streamed from H.264 to the video camera 100, so that it is basically a snapshot (still picture) without concentration of traffic, even if the video server is used for the most It is still not easy to affect the load after the change. The capacity is extremely small, so there is no need to add a disk. The H.264 encoder can reduce the size by more than 80% compared to the Motion JPEG format, enabling high image quality. In the H.264 baseline profile, only the I frame and the P frame are used, so that low latency can be achieved, which is suitable for the network camera. However, in the surveillance camera system, it has to be preserved in the past, so the server needs to be huge. Capacity. However, according to this embodiment, it is possible to maintain high Quality, and overwhelmingly shrink capacity.

In the surveillance camera system of the present embodiment, in order to confirm the movie on the spot, the image data is saved once as a high-resolution data that may be frequently viewed during a certain period of time, for example, one day, and is deleted after a certain period of time. Therefore, for instant playback of pictures, you can reverse to a certain period of time to play. On the other hand, in the surveillance camera system of the present embodiment, the video data of a single time combined into a single file is optimized and converted into secondary video material, thereby further extending the storage period.

(formalities)

Next, the monitoring procedure of the surveillance camera system of the first embodiment will be described. In this procedure, the above-mentioned surveillance camera system is used.

In the monitoring method of the present embodiment, the video server having the memory device connected to the monitoring camera group for shooting an animation through the LAN network includes (1) a camera animation obtaining step, and the monitoring camera group is photographed and the image is captured. The camera animation is transformed and input to the video server. The conversion is encoded into a frame that can be decoded separately and created at regular intervals, and the previous frame is referenced, and a plurality of predictions are made between the frames. a frame, (2) a film data creation step, a video clip stored in the memory device as a video material, and (3) a memory deployment step, converting the input camera animation into a continuous A static picture is deployed in the memory as a picture material, (4) a picture data accumulation step, and a picture data is once One picture folder accumulated in the memory device, (5) instant playback acceptance step, accepting instant playback of camera animation from the terminal, (6) instant playback step, transmitting the picture data to the terminal and displaying it, (7) combining The steps are as follows: for one video material, one video material combined into a single file at a certain time, and (8) a second video data creation step, the combined video data is made by referring to both the past and the future. The bi-predictive inter-frame is created to reduce the number of frames in the inner frame and the prediction, and to re-transform the code to create a secondary film material, (9) the past film playback acceptance step, and accept the camera animation from the terminal. In the past, the animation of the camera animation, (10) the past video playback step, the received secondary video data is transmitted to the terminal and displayed.

In the case where the storage period of one picture material is set to one day, the instant play can be accepted within one day, and the past video play can be accepted after the second video material is created (for example, after 10 minutes).

A program for a surveillance camera system that has a shooting/collection/editing/transmission program and a picture display program is for the computer to perform the steps. Use the figure to explain more specifically.

(From the connection between the surveillance camera and the video server to the secondary movie)

Fig. 9 is a flow chart showing the outline of the procedure from the connection of the camera and the video server to the picture editing in the surveillance camera system of the first embodiment. First, the video server requires a connection to the camera in TCP/IP mode. The camera is composed of one or a plurality of cameras, and each camera and video server is authenticated by a user ID and a password. After the authentication is successful with reference to the authentication database of the video server, the connection status is established.

Next, from the video server to the camera, it is required to continuously capture the animation for a certain period of time (10 minutes in this embodiment), and the captured camera picture is transmitted to the video server in the form of H.264 streaming. The camera continuously takes an animation when accepting the picture request, and transmits the captured animation to the video server as a camera animation of the H.264 baseline profile. More specifically, when it is input to the video server, the camera animation is converted and input, and the conversion is encoded into an inner frame that can be decoded separately at regular intervals, and referenced to the previous frame. A plurality of predictive frames are created between the grids.

Surveillance cameras, in addition to IP cameras, can also be analog cameras, can use the old camera, the cost can be reduced.

Once the video server obtains the camera animation of the streaming picture from the streaming camera, that is, the surveillance camera, it stores the video folder as a file. At the same time, a static picture is extracted from the acquired serial flow picture (camera animation) and stored in the memory. The static picture is extracted at a predetermined time point. Then, the picture to be stored in the memory is stored in the primary picture folder at the same time point as that of the time (in the present embodiment, every 1 second) deployed in the memory. This process is performed every sleep time. The time of sleep is 1-10 seconds, 1 second, 3 seconds, or 60 seconds, etc., and is arbitrarily set in advance. In this embodiment, it is set to 1 second. When the movie cannot be obtained from the surveillance camera, the connection is re-opened. When the dialogue is disconnected and after For a certain period of time (10 minutes in this embodiment), the requirements for camera animation are again performed. The camera animation is acquired until the end signal is reached.

Fig. 10 is a flow chart showing the data compression (optimization) of the surveillance camera system of the first embodiment. After a certain period of time (in this embodiment, the preset is 10 minutes), for a video material, the animation files dispersed by the disconnection of the dialogue are combined into a single animation of a certain time (for example, 10 minutes), and then saved again. As a video material, compression is performed by optimization. The optimized animation is treated as a secondary video material.

Optimization is carried out by making a two-way predictive frame created by referring to both past and future frames in a film material, thereby making the inner frame and the prediction frame The number of copies is reduced and the code is changed again. The optimized data becomes the secondary film material.

The images deployed in the memory are used for the release of the Viewer, and are accumulated in one image data, so the image data can be effectively utilized. This cumbersome structure is also equivalent to the insertion of optimization and other processing. important.

(The connection between the terminal and the video server, until the picture is displayed)

First, the terminal, upon accepting the connection request made by the user to the video server, and inputting the connection request, requests the video server to connect in a TCP/IP manner. In the terminal of the mobile device, it is also possible to connect a part using a mobile phone's own agreement. Terminal by 1 or multiple stations In this configuration, each terminal and video server are authenticated by a user ID and a password. When the authentication server for the video server is not authenticated, the authentication key is registered only for the first time, and the user ID and password are issued at the time of login. Once the authentication is successful, it becomes connected.

The terminal, once accepting a request from the user's camera and being input to the camera, requests the video server to transmit the camera. The video server, upon receiving the request from the camera, confirms the permission information of the camera that the requested terminal can monitor. The video server transmits the data from the authorized camera to the terminal. The terminal displays the received information of the camera on the display and accepts the selection of the camera from the user to display the instant play.

The terminal, once input to the camera to display the instant play, requests the video server to immediately play the camera animation for the selected camera in the video server. Once the video server receives the request for instant play, the latest image data that is acquired from the selected camera and deployed on the memory and accumulated in one picture folder is transmitted to the terminal. The picture data that the terminal will be transmitted is displayed on the display. Until the user selects the camera, or during the selection period other than the playback function, the terminal will acquire the time point of each camera's picture, and repeat the request for the instant picture and its subsequent.

The terminal accepts the input of the reverse request from the user in displaying the instant picture. The terminal, once input reversal request, requests the video server to reverse the picture. Video server, once received reverse picture The requirement is that the image data of the time point of the previous time for the picture transmitted by the terminal is extracted from a picture folder and transmitted to the terminal as a reversed instant picture. In this embodiment, the time point of the past certain time is set as the time point of 1 second, and the instant play is the picture obtained every 1 second, so when the input is reversed, the previous picture is transmitted. data.

In the period in which the reverse is selected, that is, in the display of the reversed instant picture, the terminal requests the video server to reverse the live picture at regular intervals. The certain time at this time is a certain time shorter than the required interval of the instant picture, and this embodiment is every 0.2 seconds. Therefore, at the terminal, the reverse picture is created from the image data of the camera animation every 1 second every 0.2 seconds.

Moreover, the terminal accepts the input of the fast forwarding request from the user in the reversed instant picture display. The terminal, once entered into the fast-forward request, requests the video server to quickly forward the instant picture. Once the video server receives the request for fast-forward instant picture, it will transmit the picture data at the time point of the previous time to the picture transmitted by the terminal to the terminal as a fast-forward instant picture. In this embodiment, the time point of a certain time in the future is set as the time point of the next one second, and the instant picture is the picture obtained every one second, so when the initial request is input, as the reverse picture, The transmission will be one picture of the next in the next picture.

In the period during which the fast forward is selected, that is, in the display of the fast-forward instant picture, the terminal will have a video server at regular intervals. Seek fast instant pictures. The certain time at this time is a certain time shorter than the required interval of the instant picture, and this embodiment is every 0.2 seconds. Therefore, at the terminal, a quick-forward instant picture created from a picture of the camera animation every 1 second is displayed every 0.2 seconds. Once the fast-forward instant picture reaches the picture at the current time point, it switches to the instant picture display, and the fast-forward ends.

The playback of past camera animations can also be performed in the same way as instant playback. However, it is to take the past secondary film from the secondary video folder instead of one image data, and transfer the extracted secondary video data to the terminal and display it.

The picture data is a static picture and its lightness is capable of continuous transmission to the terminal. In addition, the secondary video data is animated but the amount of data is extremely small, so the degree of lightness can be transmitted to the terminal. In addition, once the picture data is good, the second film data is good, can be reversed, reversed and then played or fast forward, its convenience is high.

(effect)

In the present embodiment, the above configuration is achieved, so that optimal data storage can be achieved and cost reduction can be achieved.

Further, according to the present embodiment, it is possible to avoid traffic concentration, prevent partial leakage of the animation, reduce the load on the server, prevent the display speed from decreasing, reduce the capacity, and save the high-quality animation for a long period of time, and realize the action device. High-quality animation reading and so on. In addition, for a picture, the static picture is transmitted to the terminal, so that in the playback of the instant picture in the photography, the image reversal from the current time point can be achieved in real time, and The current time point of the picture is fast. Even if there is a time point when photography cannot be taken for some reason, in this embodiment, the static picture at the time point of the defect is compensated by copying the static picture of the previous time point, so that the non-dropping can be achieved at low cost. Play. In addition, when a problem is found in the instant picture, it can be reversed immediately on the spot. In the present embodiment, at the same time, while the animation is acquired, the B-frame that cannot be inserted in real time can be inserted to create the optimized secondary video material, so that even if the server capacity is small, the image can be stored for a long period of time. High-quality animations can still be played after a long period of time.

In this embodiment, the video and the static video are sent from the camera to the video server, but the video server is used to perform the shooting, the static picture or the animation is saved, the picture is played, or the video is sent, so the amount of communication data will change. small. Therefore, it will not cause load on the communication network, and traffic congestion will not occur easily. The traffic is always stable, so it is possible to manage a large number of cameras with one video server. According to the embodiment, the animation is optimized and saved, so that the data capacity is small, that is, the camera or the user is a majority, the necessary capacity is still small, and the number of servers can be small.

When playing back in a terminal such as a smart phone, it takes no time from the start of the operation such as playback to the execution, so that it can be played without burden, and the situation can be immediately detected. Even when a plurality of cameras are monitored, the smart phone can be easily and smoothly played, and it is possible to easily confirm while moving between places. In the present embodiment, the static picture created by extracting the captured animation is sequentially transmitted in real time, which is convenient and simple, and the data capacity can be small.

According to this embodiment, the terminal side of the played picture is capable of Carrying and not only real-time playback or reversal, but also high-definition to achieve playback or reverse after multiple days, and the amount of data can be small. Therefore, according to the present embodiment, both high performance and low cost can be achieved.

In the present embodiment, it is preferable that the monitoring camera system can be used for road conditions, and the like, whether it is grasped by the current situation or confirmed after a plurality of days, can be played with high image quality, and can be monitored by reverse or fast turn. Camera system. The available scenarios are quite extensive.

The present invention is not limited to the embodiments described above, and various modifications can be made without departing from the scope of the invention. Further, the constituent elements of the above embodiments can be arbitrarily combined without departing from the gist of the invention.

100‧‧‧Video Server

200A~200B‧‧‧Mobile device terminal

300A~300C‧‧‧Reading PC

400A~400B‧‧‧Monitoring camera (for animation)

401A~401D‧‧‧Monitoring camera (for static screen)

500‧‧‧Network

600‧‧‧ router

Claims (6)

A surveillance camera system, comprising: a video server connected to a surveillance camera group for capturing an animation through a network to memorize the data in a memory device, wherein the video server has a camera animation acquisition means for the surveillance camera The group captures the animation, and the captured camera animation is input to the video server; the video data creation means accumulates the input camera animation in the memory device as a video material; and the combination means, for the first video material, every A certain period of time combined into a single file of a video material; and a secondary film data creation means, the combined one of the aforementioned film data is re-transformed to create a secondary film material. The surveillance camera system according to claim 1, wherein the video server further includes: a memory deployment means for converting the input camera animation into a continuous static image and deploying the memory as a picture data. And an image data accumulation means for accumulating the aforementioned image data in the aforementioned memory device. The surveillance camera system according to the first or second aspect of the invention, wherein the camera animation acquisition means converts the captured camera animation to the video camera group and inputs the video to the video. a server, and the transform is encoded into an intra-frame that can be decoded separately and at regular intervals, and a reference frame is referenced to create a plurality of predictive frames between the inner frames (predicted) Inter-frame), wherein the secondary film data creation means creates a two-way predictive frame created by referring to both past and future frames in the aforementioned video material, thereby making the inner frame and the prediction The number of frames is reduced and the code is transformed again to create a secondary film material. The surveillance camera system of claim 3, wherein the number of inner frames in the second video material is one-fifth of the number of inner frames in the one-time video material of the same time portion. the following. A method for storing a surveillance camera data, comprising: a camera animation acquisition step, wherein the camera is connected to a surveillance camera group that captures an animation, and the data is memorized in a video server of the memory device, so that the surveillance camera group captures an animation. Inserting the captured camera animation into the video server; a video data creation step, wherein the video server accumulates the input camera animation in the memory device as a video material; in combination with the step, the video server is configured to A video material is combined into a video file of a single file at regular intervals; and a secondary video data creation step is performed by the video server to convert the previous video data into two video materials. The method for storing a surveillance camera data according to claim 5, further comprising: a memory deployment step, wherein the video server converts the input camera animation into a continuous static image and deploys the memory in the memory. As a picture data; a picture data accumulation step, the video server accumulates the previous picture data in the memory device; and the instant broadcast receiving step is performed by the video server connected to the terminal of the video server through the network The instant playing of the camera animation; the instant playing step is that the video server transmits the previous image data to the terminal and displays it; the past video playback receiving step is that the video server receives the past animation of the camera animation from the terminal. The playback of the camera animation; and the past video playback step, the video server transmits the aforementioned secondary video data to the terminal and displays it.