WO2018042977A1

WO2018042977A1 - Surveillance camera system, and video browsing method and video combining method for surveillance camera system

Info

Publication number: WO2018042977A1
Application number: PCT/JP2017/027430
Authority: WO
Inventors: 昭弘佐久間
Original assignee: 株式会社Ｎｅｘｐｏｉｎｔ
Priority date: 2016-08-29
Filing date: 2017-07-28
Publication date: 2018-03-08
Also published as: JP2018037734A; TW201811022A; JP6446006B2

Abstract

An image recording server of the present invention includes: (1) an image data selection means which selects a plurality of individual image data sets from a folder; (2) a to-be-combined image data creation means which creates to-be-combined image data sets by performing coupling and/or partial deletion of the selected individual image data sets on the basis of whether or not two or more of the sets need to be coupled together and/or whether or not some of the sets need to be deleted; (3) a combined image data creation means which adjusts the to-be-combined image data sets such that those to be simultaneously displayed have an equal number of frames and the respective frame intervals thereof are made the same, and that those to be sequentially displayed are arranged in a display order, and which composites, as combined image data, one video using all the adjusted to-be-combined image data sets; and (4) a transmission means which transmits the combined image data to a terminal so as to cause the terminal to display the combined image data.

Description

Surveillance camera system, moving image browsing method and moving image combination method in surveillance camera system

The present invention relates to a monitoring camera system, a moving image browsing method and a moving image combining method in the monitoring camera system.

Conventionally, for the purpose of crime prevention, investigation, or management, monitoring points such as entrances and exits of buildings such as apartment buildings, stores or streets, factories, distribution centers, etc. are monitored in a timely manner, and the monitoring results are transmitted to the Internet and other telecommunications. A camera system for sending and monitoring to a monitor of a user terminal via a line has been introduced (see, for example, JP 2013-51534 A, JP 2002-77882 A, JP 2006-190294 A). .

A surveillance camera system according to one aspect of the present disclosure includes:
Comprising a recording server connected to one or more cameras and one or more terminals via a network;
The recording server is
Data storage means for storing camera images captured by the camera in a moving image format for each predetermined recording time length and storing them in a folder as individual video data;
Video data selection means for selecting a plurality of the individual video data from the folder;
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Among the video data for coupling, the video data for coupling to be displayed simultaneously are adjusted to the same number of frames, the frame interval is adjusted to be the same, and the video data for coupling to be sequentially displayed are arranged in the display order. Combined video data creation means for combining all the combined video data into one moving image to be combined video data,
Sending means for sending and displaying the combined video data on the terminal.

FIG. 1 is a diagram illustrating an example of a network configuration of the surveillance camera system according to the first embodiment. FIG. 2 is a configuration diagram of a recording server of the surveillance camera system according to the first embodiment. FIG. 3 is a configuration diagram of a terminal (mobile) of the surveillance camera system according to the first embodiment. FIG. 4 is a configuration diagram of a terminal (PC) of the surveillance camera system according to the first embodiment. FIG. 5 is a moving image combining flow schematic diagram of the moving image combining method according to the first embodiment. FIG. 6 is an image diagram of a connection procedure of the moving image combining method according to the first embodiment. FIG. 7 is an image diagram of a procedure for adjusting the number of frames in the moving image combining method according to the first embodiment. FIG. 8 is an image diagram of a moving image combining method of mixed combining in the moving image combining method according to the first embodiment. FIG. 9 is an image diagram illustrating a monitoring camera installation state in the dough process in the moving image combining method according to the first embodiment. FIG. 10 is an image diagram of a display screen by the moving image browsing method for the dough process in the moving image combining method according to the first embodiment. FIG. 11 is an image diagram showing an installation state of the monitoring camera in the molding and firing step in the moving image combining method according to the first embodiment. FIG. 12 is an image diagram of a display screen by the moving image browsing method for the molding and firing step in the moving image combining method according to the first embodiment. FIG. 13 is an image diagram of the moving image combining method of the same time combination in the moving image combining method according to the second embodiment. FIG. 14 is an image diagram of a display screen by the moving image browsing method for the barn in the moving image combining method according to the second embodiment.

In the conventional surveillance camera system, a plurality of cameras can be browsed at the same time in the live video playback. However, the archived video can only be played back one video at a time, and there is a problem that the viewability is poor.

Also, when a problem is discovered at a later date, for example, at the manufacturing site, when it is desired to check the manufacturing process of the lot in which the problem has occurred, all the images on each day on which the lot was manufactured must be checked one by one. Since the readability was bad, there was a problem that it took time from problem discovery to problem investigation.

[Embodiment]
The first object of the embodiment described below is to solve the above-mentioned problems, to efficiently view a moving image, and to improve the viewability at the time of confirmation at a later date, and to view a moving image in the monitoring camera system A method and a moving image combining method are provided.

The inventor does not view the video captured at the same time interval, but instead of browsing the video of the surveillance camera one video at a time, instead of using the stored video, the saved video can be viewed from a completely different perspective. The following embodiment has been completed based on the idea of generating a moving image for a new use.

The surveillance camera system according to the first aspect of the embodiment includes a recording server connected to one or more cameras and one or more terminals via a network,
The recording server is
Data storage means for storing camera images captured by the camera in a moving image format for each predetermined recording time length and storing them in a folder as individual video data;
Video data selection means for selecting a plurality of the individual video data from the folder;
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Among the video data for coupling, the video data for coupling to be displayed simultaneously are adjusted to the same number of frames, the frame interval is adjusted to be the same, and the video data for coupling to be sequentially displayed are arranged in the display order. Combined video data creation means for combining all the combined video data into one moving image to be combined video data,
Sending means for sending and displaying the combined video data on the terminal.

According to the first aspect of the embodiment, since the recorded video is combined, the moving image can be efficiently viewed, and the viewability at the time of confirmation at a later date can be improved. In addition, it is possible to simultaneously view moving images of a plurality of cameras at different times such as the manufacturing process of the same lot. In addition, since it is only necessary to browse the combined video according to the purpose, when a problem occurs, it is possible to reduce the labor of browsing many videos for a long time to find the cause of the problem. By making multiple browsing simultaneously, the workload of browsing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. The amount of data is small and the cost can be reduced while maintaining high resolution. Further, if only the combined image according to the purpose is stored, the original individual moving image can be deleted, so that capacity reduction and cost reduction can be realized. Further, even a plurality of moving images having different shooting intervals and shooting times can be simultaneously viewed at the same time.

In the embodiment, the “network” includes a network constituted by a communication network such as a LAN, the Internet, a Wi-Fi line, a 3G / LTE line, a dedicated line, or a combination thereof. In the embodiment, the camera may be either or both of a camera that shoots a still image and a camera that shoots a moving image, and the image that is captured by the camera may be either or both of a still image and a moving image. Each camera has an output function, a still image shooting function, and / or a moving image shooting function. The camera is preferably an IP camera, but can also be an analog camera. For images acquired from cameras that shoot still images, the compression format for moving images is H.P. More preferably, it is H.264. It is lightweight and easy to implement regardless of hardware or software. In addition, the camera that captures the moving image is preferably connected to the recording server via a LAN network, but this is not a limitation. In addition, the recording server in the embodiment may be connected to the camera via a network and collect an image of the camera, or the recording server in the embodiment may not be connected to the camera via the network, Even if the image is collected by another server connected to the camera via a network, transmitted from the collected server to the recording server in the embodiment, and stored in the recording server in the embodiment as video data in a moving image format Good. Note that the recording server may be a cloud server.

A surveillance camera system according to a second aspect of the embodiment is the surveillance camera system according to the first aspect,
The data storage means saves camera images taken by a plurality of cameras in a moving image format for each predetermined recording time length as individual video data in a folder, and sets time difference data of each camera with respect to a reference camera and each camera. And record the recording time length data in the database,
The video data selection means, based on the time difference data, determines a reproduction time for another camera of the cameras to be reproduced from a reproduction time for one of the cameras to be reproduced. Calculating for each camera, and from the playback time unit for the one camera, the playback time unit for the other camera is calculated for each camera based on the ratio of the recording time length data, and from the folder. Select the individual video data to be combined for all the cameras to be played back,
The combination video data creation means performs a connection and / or partial deletion of the selected individual video data depending on whether or not a plurality of connections are required and / or a partial deletion, and plays back each of the images. It is processed into video data for each playback time unit from the time, and each video data is combined.
The combined video data creating means is for combining video data to be displayed simultaneously among the combined video data so that the combined video data for each playback time unit is reproduced at the same time. The playback speed is calculated for each video data, the number of frames is adjusted to the same number, the frame interval is adjusted to be the same, the video data for combination to be displayed sequentially is arranged in the display order, and all the video data for combination to be displayed simultaneously is 1 The combined video data after adjustment is combined into one moving image so as to be combined video data so as to be divided and displayed on the screen.

A surveillance camera system according to a third aspect of the embodiment is the surveillance camera system according to the first aspect,
The video data selecting means selects a shooting time to be played back, selects the individual video data at the same time as the selected shooting time from all the cameras to be played back from the folder,
The combining video data creating means uses the selected individual video data as combining video data,
The combined video data creating means combines the combined video data into one moving image to form combined video data so that the combined video data are all displayed on one screen.

A surveillance camera system according to a fourth aspect of the embodiment is the surveillance camera system according to the first aspect,
The video data selection means selects all the individual video data corresponding to the video from the shooting start shooting time to the playback end shooting time from the folder,
The combining video data creation means concatenates the selected individual video data according to time series, deletes the video before the playback start shooting time and the video after the playback end shooting time, and combines video Data and
The combined video data creation means concatenates one or a plurality of the combined video data into a single moving image to form combined video data.

In the moving image browsing method according to the fifth aspect of the embodiment, a recording server connected to one or a plurality of cameras and one or a plurality of terminals via a network records a camera image captured by the cameras for a predetermined recording time. A data storage step that saves the video as long as the individual video data in a folder.
A video data selection step in which the recording server selects a plurality of the individual video data from the folder;
The video data for combination which the said recording server performs connection and / or partial deletion according to the necessity of multiple connection and / or the safety of partial deletion about each selected individual video data, and makes it video data for connection, respectively Creation steps,
Among the video data for combination, the video server for video to be displayed simultaneously adjusts the number of frames for the video data for combination, further adjusts the frame interval to be the same, and sequentially displays the video data for combination to be displayed in the order of display. Combined video data creation step that combines all the combined video data after adjustment into one moving image to form combined video data,
The recording server includes a transmission step of causing the terminal to transmit and display the combined video data.

According to the fifth aspect of the embodiment, the moving image can be efficiently viewed, and the viewability at the time of confirmation at a later date can be improved. In addition, it is possible to simultaneously view moving images of a plurality of cameras at different times such as the manufacturing process of the same lot. In addition, since it is only necessary to browse the combined video according to the purpose, when a problem occurs, it is possible to reduce the labor of browsing many videos for a long time to find the cause of the problem. By making multiple browsing simultaneously, the workload of browsing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. The amount of data is small and the cost can be reduced while maintaining high resolution. Further, if only the combined image according to the purpose is stored, the original individual moving image can be deleted, so that capacity reduction and cost reduction can be realized. Further, even a plurality of moving images having different shooting intervals and shooting times can be simultaneously viewed at the same time.

In the moving image combining method according to the sixth aspect of the embodiment, the recording server stores camera images captured by a plurality of cameras in a moving image format for each predetermined recording time length in a folder as individual video data, A data storage step for storing in the database the time difference data of each camera and the recording time length data for each camera,
Based on the time difference data, the recording server determines a reproduction time for another camera of the cameras to be reproduced from a reproduction time for one of the cameras to be reproduced based on the time difference data. Calculated for each camera, and from the playback time unit for the one camera, the playback time detection for the other camera is calculated for each camera based on the ratio of the recording time length data, and is combined from the folder. Video data selection step for selecting individual video data for all cameras to be played back,
The recording server concatenates and / or partially deletes the selected individual video data depending on whether or not a plurality of connections are necessary and / or partly deleted, and reproduces each of the selected individual video data from the reproduction time of each reproduction. Video data creation step for combining, which is processed into video data in time units, and used as video data for combination,
Among the video data for combination, the video data to be displayed simultaneously by the recording server is combined with the video data for combination so that the video data for combination corresponding to each reproduction time unit is reproduced at the same time. The playback speed is calculated, the number of frames is adjusted to the same number, the frame interval is adjusted to be the same, the combined video data to be sequentially displayed are arranged in the display order, and the combined video data to be displayed simultaneously are all divided into one screen. A combined video data creation step for combining the combined video data for adjustment into one moving image to be combined video data,
including.

According to the sixth aspect of the embodiment, since the recorded videos are combined, the moving images can be efficiently viewed, and the viewability at the time of confirmation at a later date can be improved. In addition, with this method, it is possible to create a moving image that allows simultaneous viewing of moving images at different times of a plurality of cameras, such as the manufacturing process of the same lot. In addition, since a combined moving image can be created according to the purpose, it is possible to reduce the labor of browsing many moving images over a long period of time and finding the cause of the problem when a problem occurs. By making a moving image that can be viewed simultaneously for a plurality of cameras, the work burden of viewing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. The amount of data is small and the cost can be reduced while maintaining high resolution. Further, if only the combined image according to the purpose is stored, the original individual moving image can be deleted, so that capacity reduction and cost reduction can be realized. Further, even a plurality of moving images having different shooting intervals and shooting times can be simultaneously viewed at the same time.

The moving image combining method according to the seventh aspect of the embodiment includes a data storage step in which the recording server stores camera images captured by a plurality of cameras in a moving image format for each predetermined recording time length in a folder as individual video data;
A video data selection step in which the recording server selects a shooting time to be played back, and selects from the folder the individual video data at the same time as the selected shooting time for all the cameras to be played back;
The video recording server is a video data creation step for combining each of the selected individual video data as video data for combining,
A step of creating combined video data in which the recording server synthesizes all of the video data for combination into one moving image so as to be combined video data so that the video data for combination are all displayed in one screen. Including.

According to the seventh aspect of the embodiment, since the recorded video is combined, the moving image can be efficiently viewed, and the viewability at the time of confirmation at a later date can be improved. Moreover, the moving image which browses simultaneously the moving image of the same time slot | zone of a some camera by this method can be produced. In addition, since a combined moving image can be created according to the purpose, it is possible to reduce the labor of browsing many moving images over a long period of time and finding the cause of the problem when a problem occurs. By making multiple browsing simultaneously, the workload of browsing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. The amount of data is small and the cost can be reduced while maintaining high resolution. Further, if only the combined image according to the purpose is stored, the original individual moving image can be deleted, so that capacity reduction and cost reduction can be realized.

In the moving image combining method according to the eighth aspect of the embodiment, the recording server stores a camera image captured by the camera in a moving image format for each predetermined recording time length in a folder as individual video data,
A video data selection step in which the recording server selects all the individual video data to be combined to create a video from the shooting start shooting time to the playback end shooting time from the folder;
The recording server concatenates the selected individual video data according to a time series, deletes the video before the playback start shooting time and the video after the playback end shooting time, and combines them as video data for combination Video data creation step,
A step of creating combined video data in which the recording server combines one or a plurality of the combined video data into one moving image to form combined video data;
Have

According to the 8th aspect of embodiment, a moving image can be browsed efficiently and the readability at the time of confirmation at a later date can be improved. In addition, it is possible to efficiently browse the moving image for the time that is desired to be browsed. In addition, since it is only necessary to browse the combined video according to the purpose, when a problem occurs, it is possible to reduce the labor of browsing many videos for a long time to find the cause of the problem. By making multiple browsing simultaneously, the workload of browsing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. The amount of data is small and the cost can be reduced while maintaining high resolution. Further, if only the combined image according to the purpose is stored, the original individual moving image can be deleted, so that capacity reduction and cost reduction can be realized.

Hereinafter, the embodiment will be specifically described using examples, but the embodiment is not limited thereto.

[First embodiment]
In the first embodiment, the video taken by the surveillance camera is processed and saved in a form that is easy to view, and even a video of a different time zone is combined and displayed on one screen for each camera. Is. Specifically, the recording server activates the monitoring camera via the network, and the recording server captures and collects camera images of moving images and still images, and creates a predetermined time unit for each camera. The individual video data, which is the secondary video data completed as a moving image, is created, the recording server creates a combined video data, which is the tertiary video data by combining multiple secondary video data, and the recording server is the user's terminal In response to a request from the terminal, the tertiary video data, that is, video data to be monitored on a single screen is transmitted by being synthesized even if the video is in a different time zone for each camera. Note that not only playback but also rewinding and fast-forwarding are possible. Therefore, in this embodiment, it is possible to effectively use the stored video. For example, in a work room, when you try to confirm at a later date whether there was a time when there was a foreign object at the time of material input, you can know immediately, and there was no suspicious movement of employees regarding the lot in question If you try to confirm that later, you can know immediately. Therefore, according to the present embodiment, the browsing property at the time of confirmation at a later date is improved, and the problem investigation that has been studied by taking a long time until now can be investigated in a very short time, efficiently and with a small effort.

{Constitution}
FIG. 1 is a diagram illustrating an example of a network configuration of the surveillance camera system according to the first embodiment. On a network 500 configured by a combination of communication networks such as a LAN, the Internet, Wi-Fi lines, 3G / LTE lines, and dedicated lines, (1) a plurality of surveillance cameras (stationary) (For image) 400A to 400C and monitoring camera (for moving image) 401, (2) connected to the monitoring camera 400, 401 via the network 500, acquires image data captured by the camera, stores it, and transmits it to the terminal As a server, the recording server 100, (3) connected to the recording server 100 via the network 500, and as a terminal for receiving and displaying image data from the recording server 100, mobile terminals 200A to 200C such as smartphones and desktop PCs (Personal computer) and viewing PCs 300A-C such as notebook PCs are connected The camera may be only a monitoring still image camera or only a monitoring moving image camera, and the number of cameras is not limited as long as both are within the processing range of the recording server. Hereinafter, when the mobile terminal and the viewing PC are combined, they are referred to as “terminal” or “Viewer”.

The recording server 100 exists in the same LAN as the monitoring camera (for moving image) 401 that shoots a moving image, but only when the monitoring camera (for still image) 400 that shoots a still image exists in the same LAN. Instead, they may be connected via a plurality of networks such as the Internet or a LAN. There may be a plurality of recording servers on the same network. In this embodiment, the communication between the monitoring cameras 400 and 401 and the recording server 100 is a TCP / IP system, and the monitoring camera (for still image) 400 that captures a still image has the camera and the recording server in the same LAN. Even if there is no image data, the image data can be reliably transmitted and received, and the reliability is high. The monitoring cameras 400 and 401 are IP cameras in this embodiment, but may be analog cameras. The viewing PC 300 that is an image display terminal is not limited to being in the same LAN as the recording server 100, and may be connected via a plurality of networks such as the Internet, a LAN, or a Wi-Fi line. The mobile terminal 200, which is an image display terminal, may also be connected via a plurality of networks such as a LAN, the Internet, and a cellular phone network (Wi-Fi line, 3G / LTE line, etc.). Note that a router 600 is used between the LAN and the Internet or between the surveillance camera for taking a still image and the Internet. FIG. 1 shows a connection example in which a monitoring camera (for moving images), a monitoring camera (for still images), a viewing PC, and a mobile terminal are connected to a recording server via a plurality of networks. Not. In this embodiment, the communication between the monitoring cameras 400 and 401 and the recording server 100 is performed by TCP with high reliability in which communication is started after establishing a session, but data is transmitted without establishing a session. UDP with excellent real-time characteristics may be used, and an image can be acquired by using both TCP and UDP protocols.

One recording server 100 can acquire images from a plurality of monitoring cameras 400 and 401. In this embodiment, the network traffic is automatically distributed on the recording server 100 side, so that no network design is required, and it is only necessary to connect the camera to the port. Therefore, the operation becomes very simple. In addition, resuming is easy even when communication is interrupted.

FIG. 2 is a configuration diagram of the recording server of the surveillance camera system according to the first embodiment. The recording server 100 includes a CPU 101 with a memory 102 that is a cache memory, a control / arithmetic unit having a device driver, a storage device 110 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a network interface 104, and the like. And an input / output device including a display 103 as a display device, a keyboard 105, a mouse 106, and the like. The storage device 110 includes an operating system 114 in addition to various programs such as a primary image folder 111, a secondary video folder 112, a tertiary video folder 116, a moving image connection / combination program 113, an authentication database, an environment setting folder, and the like. Stored. Combined video data for creating combined video data that is tertiary video data from individual video data that is secondary video data is also stored in a folder in the storage device 110. Various programs including the moving image connection / combination program 113 are normally stored in the auxiliary storage device of the storage device 110 and loaded into the main storage device at the time of execution. The primary image folder 111 stores camera images as primary data, and the secondary video folder 112 compresses and converts the primary data stored in the primary image folder 111 for a certain period of time as secondary video data. accumulate. Such secondary video data is individual video data obtained by converting a camera image taken by the camera into a moving image format. In the authentication database, IDs, passwords, and individual identification information (UID) that are reception information of the mobile terminal 200 and the viewing PC 300 are accumulated, and IP addresses, port numbers, IDs that are access information of the monitoring cameras 400 and 401, respectively. , Passwords are accumulated. In the present embodiment, the recording server 100 is integrated with the recording server and the terminal, and also serves as a terminal for displaying images by itself, and for maintenance and management, the display 103 and a keyboard as an input means. 105 and a mouse 106. When the recording server does not need to reproduce the camera image, the terminal function as the image display device may not be provided. The environment settings folder contains the image acquisition timing of each surveillance camera, the primary data and secondary video data creation interval, compression conditions, layout conditions when creating tertiary video data (combined video data), primary data and secondary data, etc. Image data creation intervals, compression conditions, and the like are stored. The recording server 100 is a stationary server, but may be a cloud server.

The recording server in the present embodiment also has a database having time difference data of each camera with respect to a reference camera and playback unit time length (recording time length) data for each camera.

The recording server 100 realizes the function of a computer capable of moving image combination editing processing according to the first embodiment by the CPU 101 loading and executing the moving image connection / combination program 113 in the memory 102. The CPU 101 is an arithmetic processing device mounted on a normal computer, executes various programs, and performs various controls.

The recording server 100 may be a server group including a plurality of servers in addition to a single server. For example, for the secondary video folder, for secondary video data after a certain period (for example, 24 hours) has elapsed, the storage destination is a secondary video folder provided in a recording server different from the recording server that acquires the camera image. It is good. By separating past stored data that is not frequently played back, a larger number of cameras can be monitored on the same network.

The recording server 100 is connected to a monitoring camera, and the connected monitoring camera for capturing a still image captures a still image every predetermined time (for example, 1 second), and the captured camera image is stored in the recording server. The connected surveillance camera for moving image shooting continuously shoots a moving image for a predetermined time (for example, 10 seconds), inputs the captured camera image to the recording server, compresses the input camera image, and performs primary processing. Data is created and stored in the primary image folder 111 of the storage device 110. Then, the recording server 100 combines the primary data every predetermined time (for example, 10 minutes), converts the primary data into secondary video data compressed in a moving image format with a time stamp. In the present embodiment, the secondary video data, that is, the individual video data is data for the same time by a predetermined recording time length, and all are adjusted to the same number of frames. In this embodiment, the individual video data for 10 minutes is used, but the present invention is not limited to this.

In this embodiment, the video combination method is a mixed combination in which even images of different time periods are combined and displayed on one screen for each camera.

The video connection / combination program allows the computer to select (1) a video data selection function for selecting a plurality of individual video data of the same recording time length in the same or different time zone to be combined from the secondary video folder; (2) selected A connection video data creation function for creating connection video data by connecting and / or partly deleting individual video data according to the necessity of multiple connection and / or partial deletion, (3) Among the video data for coupling, the video data for coupling to be displayed at the same time are adjusted to the same number of frames, and the frame interval is adjusted to be the same. Combined video data creation function that combines all video data into a single video to create combined video data, (4) Terminal connection function to connect to terminal, (5) Terminal Browse request receiving function that receives a video browsing request, (6) to the terminal, a program for realizing the transmission function of displaying by sending the combined video data. The setting of which camera video is to be combined in which layout, the necessity of multiple connections, and / or the necessity of partial deletion are stored in advance in the database of the recording server 100 as a combination condition.

In the present embodiment, the above-described video data selection function (1) is also applied to the other cameras among the cameras to be played back from the shooting time of the playback of one camera among the cameras to be played back. Is calculated for each camera based on the time difference data, and from the playback time unit for one camera, the playback time unit for the other camera is converted to playback unit time length (recording time length) data. This is a video data selection function that calculates each camera based on the ratio and selects individual video data to be combined for all the cameras to be reproduced from the folder. The function concatenates and / or partially deletes the selected individual video data depending on whether or not a plurality of connections are necessary and / or partly deleted. , A combined video data creation function that processes video data for each playback time unit from the respective shooting times to be played back to form combined video data, and the combined video data creation function of (3) described above includes: Among the video data for combination, the video data for combination to be displayed at the same time calculates the playback speed for each video data for combination so that the video data for the unit of each playback time is played back at the same time. The number of frames is adjusted to the same number, and the frame interval is also adjusted to be the same. The combined video data to be sequentially displayed are arranged in the display order, and the combined video data to be displayed at the same time are all divided into one screen for display. In addition, a combined video data creation function that combines all the combined video data after adjustment into one moving image to form combined video data.

In this embodiment, the rewind request, fast forward request and playback request for the combined video data displayed on the terminal are received from the terminal, and the combined video data to be displayed is rewinded, fast forwarded and played according to the request.

In this embodiment, secondary video data is created every predetermined time (for example, 10 minutes). If there is secondary video data, combined video data that is tertiary video data can be created, so that the video from multiple cameras can be viewed on a single screen in near real-time and sent as one video from the recording server to the terminal Therefore, the data amount is small.

In the present embodiment, the connection between the monitoring camera and the recording server is made by the TCP / IP method, and in order to identify the monitoring camera, a request for taking a camera image is made after authentication. The connection between the terminal and the recording server is also performed by the TCP / IP method, and image transmission is performed after confirming that the terminal is a terminal registered in the recording server. The authentication is preferably performed by an authentication database on the recording server.

The recording server 100 checks the IP address, port number, and UID of the monitoring camera or terminal every time connection is started, and when starting connection with a camera or terminal in the local environment (for example, on the same LAN), The connection partner can be specified by connection using a port number or UID, and authentication is performed with the user ID and password set on the recording server side. The recording server 100 uses a global IP address and port number by using router port forwarding (also expressed as port forwarding, etc.) when connecting to a surveillance camera in a remote environment such as via the Internet network. Identify the connection partner. Since the recording server 100 identifies the terminal based on the terminal unique information using the UID when the connection of the mobile terminal 200 or the viewing PC 300 is started, it is possible to display an image by authenticating the user ID and the password and matching the terminal unique information. .

FIG. 3 is a configuration diagram of a terminal (mobile) of the surveillance camera system according to the first embodiment. The mobile terminal 200 includes a control / arithmetic apparatus having a CPU 201 with a memory 202, a device driver, and the like, a storage device 210, a communication control device that transmits and receives data, a display 203 as a display device, operation buttons, a touch panel, and the like. An output device is provided. The storage device 210 stores an image display program 213 and an operating system 214. The mobile terminal 200 is, for example, a mobile phone such as a smartphone, and the CPU 201 loads the image display program 213 into the memory 202 and executes it, thereby realizing a computer function capable of image display according to the first embodiment. The CPU 201 is an arithmetic processing device mounted on a normal mobile terminal, executes various programs, and performs various controls.

In this embodiment, both the recording server 100 and the viewing PC 300 are configured as personal computers, and have a clock function or the like that a normal personal computer has. The mobile terminal 200 also has a clock function and the like.

FIG. 4 is a configuration diagram of a terminal (PC) of the surveillance camera system according to the first embodiment. The viewing PC 300 includes a control / arithmetic unit having a CPU 301 and a device driver with a memory 302, a storage device 310 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a communication control device such as a network interface 304, And an input / output device including a display 303 as a display device, a keyboard 305, a mouse 306, and the like. The storage device 310 stores an image display program 313 and an operating system 314. The browsing PC 300 is, for example, a desktop PC, a notebook PC, a tablet terminal, or the like. The CPU 301 loads the image display program 313 into the memory 302 and executes it, thereby realizing the computer function capable of displaying an image according to the first embodiment. To do. The CPU 301 is an arithmetic processing device mounted on a normal PC, executes various programs, and performs various controls.

The image display program is a program for realizing a terminal connection function for connecting to a recording server and an image display function for displaying an image transmitted from the recording server on a computer.

In the present embodiment, as a more preferable aspect, the image display program further accepts an input of a rewind or fast-forward request to the computer, and the recording server receives a certain unit before or after a unit of combined video data that is tertiary video data. It is a program for realizing a rewind / fast-forward request function for requesting an image.

In the present embodiment, since the images from a plurality of cameras are combined into a moving image, the images of all the cameras being displayed can be rewound and fast-forwarded at once.

The program of the moving image browsing method having the moving image connection / combination program and the image display program causes the computer to execute the steps of each program.

In this embodiment, the recording server 100 connected to the monitoring cameras 400 and 401 for capturing images via the network 500 and the

terminals

200 and 300 connected to the recording server 100 via the network 500 for displaying images are provided. The recording server 100 is connected to a surveillance camera, and the connected surveillance camera for taking a still image is photographed and photographed every certain time (for example, 1 second). Cameras that have camera images input to the recording server, and that the connected monitoring camera for moving image shooting continuously shoots moving images for a fixed time (for example, 10 seconds), and the captured camera images are input to the recording server and input. Means are provided for creating primary data by compressing images and storing them in the primary image folder 111 of the storage device 110. The recording server 100 is provided with means for combining the primary data every predetermined time (for example, 10 minutes) and converting it into secondary video data compressed in a moving image format with a time stamp. Further, the recording server 100 includes (1) video data selection means for selecting a plurality of individual video data having the same recording time length in the same or different time zone to be combined from the secondary video folder, and (2) the selected individual video. Video data creation means for joining that creates data for joining by performing joining and / or partial deletion according to the necessity of multiple connection and / or partial deletion of data, and (3) for joining Among the video data, the video data for combination to be displayed simultaneously is adjusted to the same number of frames, the frame interval is adjusted to be the same, and the video data for combination to be displayed sequentially is arranged in the display order, and the combined video after adjustment Combined video data creation means for combining all data into one moving image to form combined video data, (4) Terminal connection means for connecting to the terminal, (5) Video browsing request from the terminal Only put browsing request receiving means, is provided with delivery means for displaying by sending (6) to the terminal, the combined video data.

In this embodiment, the video data selection means (1) described above reproduces the other camera among the cameras to be reproduced from the shooting time to reproduce for one camera among the cameras to be reproduced. The shooting time to be calculated is calculated for each camera based on the time difference data, and the playback time unit for one camera is changed from the playback time unit for one camera to the ratio of playback unit time length (recording time length) data. Is a video data selection means for selecting individual video data to be combined for each camera to be reproduced from a folder, and for each of the cameras to be reproduced. The selected individual video data is concatenated and / or partially deleted depending on whether or not multiple connections are necessary and / or partial deletion is necessary. It is a video data creation means for combination that is processed into video data for each playback time unit from the shooting time to be reproduced and is used as video data for combination, respectively, and the above-mentioned combined video data creation means (3) Among the video data, the video data for combination to be displayed at the same time calculates the playback speed for each video data for combination so that the video data for the unit of each playback time is played back at the same time, Adjust the number of frames to the same number, adjust the frame interval to the same, arrange the video data for combination to be displayed sequentially in the order of display, so that all the video data for combination to be displayed at the same time is divided and displayed on one screen. This is combined video data creation means for combining all the combined video data after adjustment into one moving image to form combined video data.

In this embodiment, the recording server 100 functions as the means (1) to (6) by the hardware configuration and the moving image connection / combination program 113 described above.

Also, the terminal (mobile terminal 200 and viewing PC 300) is provided with (1) an image display means for displaying an image transmitted from the recording server 100, and (2) a rewind request, fast forward request, and playback means.

In this embodiment, the

terminals

200 and 300 function as means (1) to (2) by the hardware configuration and the

image display programs

213 and 313 described above. For example, when playback is performed on the next day of recording, the

terminals

200 and 300 select what time of recording and what time of recording they want to play, call a file converted into secondary data every 10 minutes, and play back. Do. Rewind and fast forward during playback are also possible.

In the surveillance camera system of this embodiment, a recording server connected via a network to a camera group that captures a still image or a moving image captures a camera image from the camera group by a TCP / IP method at regular intervals. Alternatively, it can be acquired as a video, compressed to create primary data, stored as primary data for a certain period, and then converted to secondary video data in a highly compressed video file with time stamp information after a certain period. And save again. In this embodiment, the recording server is H.264. Compressed to H.264 format and converted to a video file. Furthermore, the recording server combines the plurality of individual video data as the secondary video data in a format in accordance with the request from the terminal, and the tertiary video data that is a composite video for combined display in parallel. Create video data and display it on the terminal.

In the surveillance camera system of the present embodiment, it is possible to efficiently view a moving image and improve the viewability when checking at a later date. A plurality of cameras can be played back simultaneously, for example, the time from problem detection to problem investigation can be shortened.

{procedure}
The procedure of the moving image combining method in the monitoring camera system according to the first embodiment and the moving image browsing method using the moving image combining method according to the first embodiment will be described below.

The moving image browsing method in the moving image combining method of the present embodiment is a recording that is connected to one or a plurality of terminals via a network, and that camera images taken by one or a plurality of cameras are converted into a moving image format and saved as individual video data in a folder. (1) A video data selection step in which the server selects a plurality of individual video data having the same recording time length in the same or different time zone to be combined from the secondary video folder, and (2) a plurality of selected individual video data are connected. And / or partial deletion depending on the necessity and / or partial deletion, and creating video data for coupling, respectively, (3) Of the video data for coupling, Combined video data to be displayed at the same time is adjusted to the same number of frames, and the frame interval is adjusted to be the same, and the combined video data to be displayed sequentially Are arranged in the order of display, and a combined video data creation step for combining all the combined video data for adjustment into one moving image to be combined video data, (4) a terminal connection step for connecting to the terminal, (5) from the terminal A browsing request receiving step for receiving a video browsing request; and (6) a sending step for sending the combined video data to the terminal for display.

In the recording server, camera images transmitted from a plurality of surveillance cameras intermittently or continuously are accumulated as primary data in the primary image folder, and secondary video data created from the primary data is stored in the secondary video folder. Accumulated. The secondary video data is individual video data stored in a folder with a camera image as a moving image format. Since the display request of the combined video data from the terminal is answered after the target individual video data is created, the video of a plurality of cameras can be confirmed at one stage at an early stage, and the viewability is high.

In this embodiment, the camera and the combination method are stored in the recording server in advance, but the recording server accepts selection of a camera to be played back from the terminal, and then accepts selection of a combination method of video. The individual video data may be connected and combined in accordance with the received combination method and displayed on the terminal.

In this embodiment, based on the shooting time reproduced by one camera, the shooting time for the other camera is calculated based on the time difference data stored in the database of the recording server, and the individual images with different shooting times are used. Data is picked up from a folder and combined into one screen. This embodiment is a binding method that is useful when, for example, it is desired to simultaneously confirm the manufacturing process of a certain manufacturing lot.

FIG. 5 is a moving image combining flow schematic diagram of the moving image combining method according to the first embodiment. The recording server starts creating combined video data that is tertiary video data by a method set in advance by the recording server. In the present embodiment, the recording server is configured based on a combination method of mixed connection that combines images displayed in one screen for each camera to be viewed, as described above, even if the images are in different time zones for each camera. A plurality of secondary video data to be combined, that is, individual video data are selected and picked up from the next video folder. Next, the recording server determines whether it is necessary to link the individual video data, connects a plurality of individual video data as necessary, and deletes a part of the individual video data as necessary. Create as video data. Next, the recording server determines whether or not the number of frames needs to be adjusted when combining a plurality of video data for combination on one screen, and adjusts the frame interval and the number of frames to the same number between the video data as necessary. To do. Next, when the recording server combines a plurality of video data for combination into one screen, the video recording server combines the plurality of video data for combination into one frame and creates combined video data, that is, tertiary video data. , Accumulate in the tertiary video folder.

The recording server saves camera images taken by a plurality of cameras in a folder as individual video data in a moving picture format for each predetermined recording time length, and the time difference data of each camera with respect to the reference camera and the playback unit time for each camera Long (recording time length) data is stored in a database. The procedure of the moving image combining method in which the recording server creates tertiary video data, that is, combined video data from the above-described secondary video data, that is, individual video data, is more specifically described in (1) one of the cameras to be reproduced. Based on the time difference data stored in the database, the reproduction time for the other camera among the cameras to be reproduced is calculated for each camera from the reproduction time for the camera. From the playback time unit, the playback time unit for other cameras is calculated for each camera based on the ratio of playback unit time length (recording time length) data stored in the database, and individual video data to be combined from the folder Video data selection step for selecting all the cameras to be played back, (2) selected Separate video data is concatenated and / or partially deleted depending on whether or not multiple connections are required and / or partial deletion is required, and processed from each shooting time to video data for each playback time unit. (3) Among the video data for coupling, the video data for coupling to be displayed at the same time has the same video data for each playback time unit. The playback speed is calculated for each video data for combination so that it can be played back in time, the number of frames is adjusted to the same number, and the frame interval is adjusted to the same. All the combined video data after adjustment is combined into one moving image so that all the combined video data to be displayed are displayed on one screen. That combined video data creation step, including the.

FIG. 6 is an image diagram of a connection procedure of the moving image combining method according to the first embodiment. A method for connecting a plurality of individual video data includes, for example, individual video data from 9:20 to 10 minutes, individual video data from 9:30 to 10 minutes, individual video data from 9:40 to 10 minutes, and 9:50. When creating the combined video data from 9:25 to 9:55 from the 10-minute individual video data, first, the above-mentioned four individual videos are concatenated, and the video for 9 minutes from 9:20 and 9 It is performed by trimming to delete the video for 5 minutes from 55 minutes.

FIG. 7 is an image diagram of the frame number adjustment procedure of the moving image combining method according to the first embodiment. In the method of adjusting the frame interval and the number of frames to the same number between the video data for a plurality of video data for combination, the original individual video data is, for example, primary data of cameras A, B, and C. When the primary data of the camera is 1 frame per second, the primary data of the B camera is 5 frames per second, and the primary data of the C camera is 10 frames per second, all the videos are 5 frames per second. When doing so, the shortage is compensated by the previous frame, and the excess is thinned out.

FIG. 8 is an image diagram of the moving image combining method of the mixed combining of the moving image combining method according to the first embodiment. For CAM01, CAM03, CAM04, and CAM06, the reference camera is CAM06, and the time difference data of the cameras stored in the database is 10 minutes before CAM01, 20 minutes before CAM03, and 40 minutes before CAM04. The playback unit time length (recording time length) data is 10 minutes, and the video from 10:00 on CAM06, the video from 9:50 on CAM01, and 9:40 on CAM03 When the video of CAM04 and the video from 9:20 of CAM04 are combined every 10 minutes, as shown in FIG. 8, the video for 10 minutes of each of the four cameras is displayed on one screen. Next, the images after 10 minutes of each camera are synthesized in the same manner. After the time when the video of each target camera is completely completed, the individual video data is picked up and the connection is started. Since the video completion time of the target camera is started after the last individual video data creation of the target cameras, it is up to the next individual video creation time. If individual video data for 20 minutes for CAM03 and 10 minutes for other than CAM03 are targeted, that is, the reproduction unit time length (recording time length) data of CAM03 stored in the database is 20 minutes, and other cameras When the reproduction unit time length (recording time length) data is 10 minutes, it is specified whether the total number of frames for each camera is adjusted to CAM03 or other than CAM03. When matching to CAM03, the video is 20 minutes, and other than CAM03, the playback speed is ½ times. When it is set to other than CAM03, the video becomes 10 minutes, and CAM03 is reproduced at double speed.

FIG. 9 is an image diagram showing the installation state of the monitoring camera in the dough process in the moving image combining method according to the first embodiment. In the installation example of the monitoring camera shown in FIG. 9, the monitoring camera is installed at the manufacturing site in the factory, and the monitoring camera takes an image of each step of weighing and mixing the dough to perform primary fermentation.

FIG. 10 is an image diagram of a display screen by the moving image browsing method for the dough process in the moving image combining method according to the first embodiment. The video of the camera that shoots the weighing process is 30 frames per minute and the playback time unit (for example, the shooting time per lot of bread) is 30 minutes, and the video of the camera that shoots the mixing process is 15 frames per minute. If the unit is 60 minutes, the video of the camera that captures the primary fermentation process is 1 frame per minute, the playback time unit is 720 minutes, and mixed joining is selected as the joining method, the contamination check at the time of material input is checked. Since it is important, it is assumed that the combined video data is 30 frames per minute and the playback time unit is 30 minutes. Thereby, a mixing process turns into a 2 time speed image | video, and a primary fermentation process turns into a 24 time speed image | video. However, the portion where the actual number of frames is less than 30 is supplemented by equally arranging the same frames.

FIG. 11 is an image diagram showing an installation state of the monitoring camera in the molding and firing step in the moving image combining method according to the first embodiment. In the installation example of the monitoring camera shown in FIG. 11, a monitoring camera is installed at each process place of the manufacturing site in the factory, and the dough extraction process, the dividing process, the molding process, the final fermentation process, the baking process, and the packaging process. A surveillance camera takes a picture of each process.

FIG. 12 is an image diagram of a display screen by the moving image browsing method for the molding and firing step in the moving image combining method according to the first embodiment. For each camera, the number of frames is the same, and for the playback time unit, the dough extraction process is 10 minutes, the division process is 30 minutes, the molding process is 30 minutes, the final fermentation process is 60 minutes, the baking process is 15 minutes, and the packaging process is When it is 15 minutes, since the work contents of the employees are important in the food factory, the combined video data is combined video data of 30 minutes for both the dividing process and the molding process cameras. Thereby, the image of the final fermentation process becomes a double speed image, and the images of the baking process and the packaging process become a half speed image. By extracting and combining camera images installed at various locations from a specified time, it is possible to generate a video of the bread manufacturing unit, etc. It becomes like this. In addition, when combining videos with different playback time units of moving images, the number of frames is adjusted according to the shorter or longer one. When combining in accordance with a short moving image, a moving image having a long playback time unit is combined by thinning out frames. In addition, it is possible to link production plan information as a trigger so as to be able to deal with products having different manufacturing processes, and to combine moving images according to management information of manufactured products by RFID.

This embodiment is a mixed combination, for example, a combination method that is useful when, for example, it is desired to check the manufacturing process of a certain production lot at the same time, accepts a shooting time for reproduction from one camera, and reproduces for another camera. The shooting time to be calculated is calculated based on the time difference data stored in the database of the recording server, and individual video data at different shooting times are picked up from the folder and combined into one screen.

{effect}
According to the present embodiment, the moving image can be efficiently viewed, and the viewability at the time of confirmation at a later date can be improved. Multiple camera videos can be played back at the same time, and the time from problem detection to problem investigation, for example, mixing errors, foreign matter contamination, or lost luggage can be shortened.

More specifically, according to the present embodiment, it is possible to generate a moving image for a new use with a completely new aspect, instead of simple browsing in units of time. For example, it is possible to improve the viewability when confirming at a later date, such as a lot (corrugated cardboard) unit at the manufacturing site. Also, unnecessary recording information can be reduced. Furthermore, by developing software for the original player, the target movie can be enlarged and displayed in detail from the combined tertiary video data.

同 According to the moving image combining method of the same time combining, it is possible to improve the viewability when a large number of cameras are installed by greatly increasing the number that can be viewed at one time by combining moving images with the same time axis. According to this embodiment, which is a moving image combining method of mixed connection, moving images are combined with different time axes and with the time axis shifted at regular intervals, so that traceability of industrial products and the like can be ensured.

Until now, the camera video was only viewed when a problem occurred, but according to the surveillance camera system of this embodiment, since it can be confirmed in a short time, it can also be checked on a daily basis. Effective for early detection. Further, in a situation where only combined video data, that is, tertiary video data is sufficient, storage can be dramatically reduced by deleting not only the primary data but also the secondary video data.

According to this embodiment, it is possible to reduce the labor of finding many video files over a long time when a problem occurs. In addition, multiple simultaneous browsing is not burdened even if it is incorporated in the business, so the business is improved. In addition, deterrence becomes stronger by seeing many stored videos. In addition, authenticity such as complaints at the time of delivery can be confirmed. In addition, it is thought that the lie claim to a delivery company reduces as a ripple effect by this.

According to this embodiment, even if the number of frames of some of the camera images is reduced, the meaningful tertiary video data can be obtained as a whole.

[Second Embodiment]
In the second embodiment, the video taken by the surveillance camera is processed and stored in a form that is easy to view, and the video from a plurality of cameras at the same time is synthesized and displayed on one screen. The points other than those described below are the same as in the first embodiment described above. Specifically, the recording server activates the monitoring camera via the network, and the recording server captures and collects camera images of moving images and still images, and creates a predetermined time unit for each camera. The individual video data, which is the secondary video data completed as a moving image, is created, the recording server creates a combined video data, which is the tertiary video data by combining multiple secondary video data, and the recording server is the user's terminal In response to a request from the terminal, images from a plurality of cameras at the same time are combined and transmitted for monitoring on one screen via a network. Note that not only playback but also rewinding and fast-forwarding are possible. Therefore, in this embodiment, it is possible to effectively use the stored video. For example, it is possible to simultaneously monitor the diet status of a large number of cows in a barn. Therefore, according to the present embodiment, the browsing property at the time of confirmation at a later date is improved, and it is possible to investigate the problem investigation, which has been studied with a long time until now, in a very short time with a small amount of labor.

The network configuration of the surveillance camera system of the present embodiment is the same as that of the first embodiment described above. The basic configuration of the recording server 100 other than that described below is the same as that of the first embodiment described above. The configuration of the monitoring camera, the mobile terminal, and the viewing PC is the same as that of the first embodiment described above.

In this embodiment, the video combining method is simultaneous combining in which images from a plurality of cameras at the same time are combined and displayed on one screen.

The moving image concatenation / combination program 113 in the present embodiment allows the computer to (1) a video data selection function for selecting a plurality of individual video data having the same recording time length in the same time zone to be combined from the secondary video folder, (2 ) Combining video data creation function for creating and combining video data for each individual selected video data by concatenating and / or partially deleting depending on whether or not multiple connections are required and / or partial deletion required (3) Among the video data for coupling, the video data for coupling to be displayed simultaneously are adjusted to the same number of frames, the frame interval is adjusted to be the same, and the video data for coupling to be sequentially displayed are arranged in the display order, Combined video data creation function that combines all the combined video data after adjustment into one moving image to generate combined video data, and (4) a terminal connection step for connecting to a terminal. , (5) browse request accepting function that accepts a video browsing request from the terminal, (6) to the terminal, a program for realizing the transmission function of displaying by sending the combined video data. The setting of which camera video to be combined with which layout is stored in advance in the database of the recording server 100 as a combination condition.

In this embodiment, the video data selection function (1) described above selects the shooting time to be played back, and the individual video data at the same time as the selected shooting time is played back from the folder. This is a video data selection function for selecting all of the cameras, and the above-mentioned video data creation function for coupling (2) is a video data creation function for coupling that uses the selected individual video data as video data for coupling. The combined video data creation function of (3) combines the combined video data into one moving image so that the combined video data is all displayed on one screen and is combined video data. Data creation function.

In this embodiment, the recording server 100 includes (1) video data selection means for selecting a plurality of individual video data having the same recording time length in the same time zone to be combined from the secondary video folder, and (2) selected. (3) Combining all the combined video data into one video so that the combined video data is divided into one screen and displayed. (4) terminal connection means for connecting to the terminal, (5) browsing request receiving means for receiving a video browsing request from the terminal, and (6) the combined video on the terminal. Sending means for sending and displaying data is provided.

In this embodiment, the video data selection means (3) described above selects the shooting time to be played back, and all of the cameras to be played back the individual video data at the same time as the selected shooting time from the folder. The video data selection means for selecting the video data, and the video data creation means for coupling in (4) described above is video data creation means for coupling that uses the selected individual video data as video data for coupling, respectively. 5) The combined video data creating means combines the combined video data into one moving image so as to be combined video data so that the combined video data is all displayed on one screen. It is a creation means.

{procedure}
The procedure of the moving image combining method in the moving image combining method according to the second embodiment and the moving image browsing method using the moving image combining method according to the second embodiment will be described below.

The moving image browsing method in the moving image combining method of the present embodiment is the same as that of the first embodiment described above except for the following points.

The moving image browsing method in the moving image combining method of the present embodiment is a recording that is connected to one or a plurality of terminals via a network, and that camera images taken by one or a plurality of cameras are converted into a moving image format and saved as individual video data in a folder. (1) Video data selection step for selecting a plurality of individual video data having the same recording time length in the same time zone to be combined from the secondary video folder, and (2) video data for combining the selected individual video data respectively. (3) For all the video data for combination, the frame interval and the number of frames are adjusted to the same number between the video data, and all the combined video data after adjustment are divided into one screen. Combined video data creation step for combining video data to be displayed as combined video data so as to be displayed, (4) End for connection with terminal Connecting step, browsing request accepting step of accepting a video browsing request from (5) terminal, comprising the delivery step of displaying by sending the (6) terminal, the combined video data.

The recording server connects and joins individual images using the same time combination method. When a browsing request is received from the terminal, playback is started. Further, in the present embodiment, the same time combination is a combination method that is useful when, for example, it is desired to simultaneously check images at the same time at a plurality of locations. Video data is picked up and combined into one screen.

FIG. 13 is an image diagram of the moving image combining method of the simultaneous combining of the moving image combining method according to the second embodiment. When CAM01, CAM03, CAM04, and CAM06 cameras are combined every 10 minutes from 10 o'clock, as shown in the figure, 10 cameras from 10:00 are displayed on one screen. And then combine them in the same way from 10:10. After the time when the video of each target camera is completely completed, the individual video data is picked up and the connection is started. Since the video completion time of the target camera is started after the creation of the individual video data, it is up to the next individual video creation time. If a video that does not match the number of frames is included, it is specified which camera's number of frames to match. Cameras with a larger number of frames than the reference frame will be frame-by-frame to reduce the number of frames, but cameras with a smaller number of frames than the reference frame will be complemented by the previous frame when increasing the number of frames. There is no change.

FIG. 14 is an image diagram of a display screen according to the moving image browsing method for the barn in the moving image combining method according to the second embodiment. The number of frames is the same for each camera, and images for 10 minutes from 2:20 regarding cow room 01-06 can be confirmed simultaneously.

{effect}
According to the present embodiment, the moving image can be efficiently browsed, and the viewability at the time of confirmation at a later date can be improved. Since many cameras can be confirmed at one time, for example, an image in a barn can check whether there is any strange movement or the state of meals. For example, since the meal time zone is fixed, the viewability can be improved by combining the images of the camera in the same time zone.

[Third embodiment]
The present embodiment is a continuous combination in which videos of a plurality of continuous time zones from one camera are combined and displayed continuously on one screen. The points other than those described below are the same as in the first embodiment described above. In this embodiment, the video data selection step is a video data selection step for selecting all the individual video data to be combined to create a movie from the shooting start shooting time to the playback end shooting time from the folder. The video data creation step for the selected individual video data is linked according to time series, deletes the video before the playback start shooting time and the video after the playback end shooting time, A combined video data creating step, and the combined video data creating step is a combined video data creating step in which one or a plurality of the combined video data are concatenated into one image to be combined video data. The moving image combination shown in FIG. 6 is performed to obtain combined video data. In the figure, it is a video consisting of one continuous video from 9:25 to 9:55, but moreover, a plurality of videos from a plurality of continuous time zones of the same camera are combined and displayed continuously on one screen. You may do. For example, it may be one moving image in which a continuous video from 9:25 to 9:55 and a continuous video from 10:25 to 10:55 are connected.

The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the invention. In addition, the constituent elements of the above embodiments can be arbitrarily combined without departing from the spirit of the invention.

Claims

Comprising a recording server connected to one or more cameras and one or more terminals via a network;
The recording server is
Data storage means for storing camera images captured by the camera in a moving image format for each predetermined recording time length and storing them in a folder as individual video data;
Video data selection means for selecting a plurality of the individual video data from the folder;
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Among the video data for coupling, the video data for coupling to be displayed simultaneously are adjusted to the same number of frames, the frame interval is adjusted to be the same, and the video data for coupling to be sequentially displayed are arranged in the display order. Combined video data creation means for combining all the combined video data into one moving image to be combined video data,
A surveillance camera system comprising sending means for sending and displaying the combined video data on the terminal.
The data storage means saves camera images taken by a plurality of cameras in a moving image format for each recording time length in a folder as individual video data, and sets time difference data of each camera with respect to a reference camera and each camera. Save the recording time length data in the database,
The video data selection means, based on the time difference data, determines a reproduction time for another camera of the cameras to be reproduced from a reproduction time for one of the cameras to be reproduced. Calculating for each camera, and from the playback time unit for the one camera, the playback time unit for the other camera is calculated for each camera based on the ratio of the recording time length data, and from the folder. Select the individual video data to be combined for all the cameras to be played back,
The combination video data creation means performs a connection and / or partial deletion of the selected individual video data depending on whether or not a plurality of connections are required and / or a partial deletion, and plays back each of the images. It is processed into video data for each playback time unit from the time, and each video data is combined.
The combined video data creating means is for combining video data to be displayed simultaneously among the combined video data so that the combined video data for each playback time unit is reproduced at the same time. The playback speed is calculated for each video data, the number of frames is adjusted to the same number, the frame interval is adjusted to be the same, the video data for combination to be displayed sequentially is arranged in the display order, and all the video data for combination to be displayed simultaneously is 1 2. The surveillance camera system according to claim 1, wherein all of the adjusted combined video data are combined into one moving image to be combined video data so as to be divided and displayed on a screen.
The video data selecting means selects a shooting time to be played back, selects the individual video data at the same time as the selected shooting time from all the cameras to be played back from the folder,
The combining video data creating means uses the selected individual video data as combining video data,
The combined video data creating means synthesizes all the combined video data into one moving image to form combined video data so that the combined video data are all displayed on one screen. The surveillance camera system according to claim 1.
The video data selection means selects all the individual video data corresponding to the video from the shooting start shooting time to the playback end shooting time from the folder,
The combining video data creation means concatenates the selected individual video data according to time series, deletes the video before the playback start shooting time and the video after the playback end shooting time, and combines video Data and
The combined video data creating means connects one or a plurality of the combined video data and combines them into one moving image to form combined video data.
The surveillance camera system according to claim 1.
A recording server connected to one or a plurality of cameras and one or a plurality of terminals via a network stores the camera images captured by the cameras in a moving image format for each predetermined recording time length and saves them in a folder as individual video data. Data storage step,
A video data selection step in which the recording server selects a plurality of the individual video data from the folder;
The recording server performs connection and / or partial deletion of the selected individual video data according to the necessity of multiple connection and / or the necessity of partial deletion, respectively, and uses the combined video as combination video data Data creation step,
Among the video data for combination, the video server for video to be displayed simultaneously adjusts the number of frames for the video data for combination, further adjusts the frame interval to be the same, and sequentially displays the video data for combination to be displayed in the order of display. Combined video data creation step that combines all the combined video data after adjustment into one moving image to form combined video data,
A moving image browsing method, comprising: a transmission step in which the recording server causes the terminal to transmit and display the combined video data.
The recording server saves the camera images taken by a plurality of cameras into a folder as individual video data in a moving picture format for each predetermined recording time length, and records the time difference data of each camera with respect to the reference camera and the recording for each camera. A data storage step for storing time length data in a database,
Based on the time difference data, the recording server determines a reproduction time for another camera of the cameras to be reproduced from a reproduction time for one of the cameras to be reproduced based on the time difference data. Calculated for each camera, and from the playback time unit for the one camera, the playback time unit for the other camera is calculated for each camera based on the ratio of the recording time length data, and is combined from the folder. Video data selection step for selecting individual video data for all cameras to be played back,
The recording server concatenates and / or partially deletes the selected individual video data depending on whether or not a plurality of connections are necessary and / or partly deleted, and reproduces each of the selected individual video data from the reproduction time of each reproduction. Video data creation step for combining, which is processed into video data in time units, and used as video data for combination,
Among the video data for combination, the video data to be displayed simultaneously by the recording server is combined with the video data for combination so that the video data for combination corresponding to each reproduction time unit is reproduced at the same time. The playback speed is calculated, the number of frames is adjusted to the same number, the frame interval is adjusted to be the same, the combined video data to be sequentially displayed are arranged in the display order, and the combined video data to be displayed simultaneously are all divided into one screen. A combined video data creation step for combining the combined video data for adjustment into one moving image to be combined video data,
A moving image combining method comprising:
A data storage step in which the recording server stores camera images captured by a plurality of cameras in a moving image format for each predetermined recording time length and stores them in a folder as individual video data;
A video data selection step in which the recording server selects a shooting time to be played back, and selects from the folder the individual video data at the same time as the selected shooting time for all the cameras to be played back;
The video recording server is a video data creation step for combining each of the selected individual video data as video data for combining,
A step of creating combined video data in which the recording server synthesizes all of the video data for combination into one moving image so as to be combined video data so that the video data for combination are all displayed in one screen. A moving image combining method comprising:
A data storage step in which the recording server stores a camera image captured by the camera in a moving image format for each predetermined recording time length and stores it in a folder as individual video data;
A video data selection step in which the recording server selects all individual video data corresponding to videos from the shooting start shooting time to the playback end shooting time from the folder;
The recording server concatenates the selected individual video data according to a time series, deletes the video before the playback start shooting time and the video after the playback end shooting time, and combines them as video data for combination Video data creation step,
A step of creating combined video data in which the recording server combines one or a plurality of the combined video data into one moving image to form combined video data;
A moving image combining method comprising: