JP6453281B2 - Surveillance camera system, information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to a surveillance camera system that accumulates captured images and data for crime prevention, management, and the like, displays them on a terminal, a movie browsing method in the surveillance camera system, and a movie combination method that combines a plurality of movies.

  Conventionally, for the purpose of crime prevention, investigation, or management, monitoring points such as entrances and exits of buildings such as apartment buildings, stores or streets, factories, distribution centers, etc. are monitored in a timely manner, and the monitoring results are transmitted to the Internet and other telecommunications. A camera system for sending and monitoring to a monitor of a user terminal via a line has been introduced (for example, see Patent Documents 1, 2, and 3).

JP2013-51534A JP 2002-77882 A JP 2006-190294 A

  However, in the conventional surveillance camera system, a plurality of cameras can be browsed at the same time for live video playback. However, there is a problem that the video that has been archived can only be played back one video at a time, and the viewability is poor. It was.

  In addition, when a problem is discovered at a later date, for example, in a delivery site, when it is desired to check the wrong destination of a track with a problem, it is necessary to check all the in-vehicle images of the track one by one, Since it had to be browsed, there was a problem that readability was bad and it took time from problem discovery to problem investigation.

  Therefore, the first object of the present invention is to solve the above-mentioned problems, and only necessary parts can be viewed, and the surveillance camera system and the moving image viewing method in the surveillance camera system can improve the viewability at the time of confirmation at a later date. And providing a moving image combining method.

  The inventor of the present invention saves the video acquired at the same time interval in a completely different way in order to effectively use the stored video instead of browsing the video of the surveillance camera one video at a time unit. The present invention has been completed based on the idea of generating a moving image for a new purpose using the moving image.

In order to achieve the above object, a first aspect of the present invention is connected to one or more cameras, one or more measuring devices, and one or more terminals for capturing an image via a network. A recording server having a database in which a captured camera image is saved in a folder as individual video data, measurement data acquired from the measurement device is stored in the folder, and a measurement data type of the measurement device and a camera are associated with each other Comprising
The recording server is
Trigger data extraction means for selecting the measurement data type that matches the conditions specified from the measurement data, and extracting the time information of the measurement data as trigger data,
Individual video data selection means for selecting one or a plurality of individual video data in a predetermined time period including the time of the trigger data combined from the folder for each camera associated with the measurement data type,
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Combined video data creating means for combining the combined video data into one moving image to be combined video data;
There is provided a surveillance camera system comprising sending means for sending and displaying the combined video data on the terminal.

  According to the first aspect of the present invention, since the recorded video is combined, it is only necessary to browse the necessary part, and the browsing property when confirming at a later date can be improved. In addition, for example, when a door is opened, only moving images at a plurality of times when one or a plurality of triggers are generated can be viewed simultaneously or sequentially. In addition, since it is only necessary to browse the combined video according to the purpose, when a problem occurs, it is possible to reduce the labor of browsing many videos for a long time to find the cause of the problem. By making multiple browsing simultaneously, the workload of browsing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. You can easily check the authenticity of the complaint at the time of delivery. Therefore, the effect of reducing the number of false claims can be expected. The amount of data is small and the cost can be reduced while maintaining high resolution. Further, if only the combined image according to the purpose is stored, the original individual moving image can be deleted, so that capacity reduction and cost reduction can be realized.

  In the present invention, the “network” includes a network constituted by a communication network such as a LAN, the Internet, a Wi-Fi line, a 3G / LTE line, a dedicated line, or a combination thereof. In the present invention, the camera may be either or both of a camera that shoots a still image and a camera that shoots a moving image, and the image to be captured by the camera may be either or both of a still image and a moving image. Each camera has an output function, a still image shooting function, and / or a moving image shooting function. The camera is preferably an IP camera, but can also be an analog camera. For images acquired from cameras that shoot still images, the compression format for moving images is H.P. More preferably, it is H.264. It is lightweight and easy to implement regardless of hardware or software. In addition, the camera that captures the moving image is preferably connected to the recording server via a LAN network, but this is not a limitation. Further, the recording server in the present invention may be connected to the camera via a network and collect images of the camera, or the recording server in the present invention is not connected to the camera via the network, Even if the image is collected by another server connected to the camera via a network, transmitted from the collected server to the recording server in the present invention, and stored in the recording server in the present invention as video data in a moving image format Good. Note that the recording server may be a cloud server.

Further, a measurement data display image for creating a measurement data display image by selecting measurement data in the predetermined time period for all measurement data types to be displayed among measurement data types associated with the camera of the selected individual video data Has creation means,
The combined video data creating means adjusts the number of frames to the same number and simultaneously adjusts the frame interval between the combined video data to be displayed at the same time out of the combined video data. The measurement data display image may be combined with the combined video data in order, and the combined video data after adjustment may be combined into one moving image to form combined video data.

  It is convenient because the measurement data value can be checked at the same time as the video, and because the frame is adjusted, it is adjusted even if the number of frames and the interval of the original video are different, so there is no useless image and multiple cameras Can be displayed simultaneously.

In order to achieve the above object, the second aspect of the present invention is connected to one or more cameras, one or more measuring devices, and one or more terminals for capturing an image via a network. A recording server having a database in which a captured camera image is saved in a folder as individual video data, measurement data acquired from the measurement device is stored in the folder, and a measurement data type of the measurement device and a camera are associated with each other But,
Trigger data extraction step for selecting the measurement data type that matches the conditions specified from the measurement data, and extracting the time information of the measurement data as trigger data,
Individual video data selection step for selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data combined from the folder for each camera associated with the measurement data type,
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and is combined video data creation step to be combined video data,
A measurement data selection step for selecting measurement data of the predetermined time zone for each camera for all measurement data types associated with the selected individual video data camera;
A combined video data creating step of combining the combined video data into one moving image to form combined video data;
There is provided a moving image browsing method including a sending step of sending and displaying the combined video data on the terminal.

  According to the second aspect of the present invention, similar to the first aspect of the present invention, only necessary portions can be browsed, and the viewability at the time of confirmation at a later date can be improved.

In the third aspect of the present invention, a camera image captured by one or more cameras is converted into a moving image format and stored as individual video data in a folder, and measurement data acquired from one or more measurement devices is stored in the folder. A recording server having a database in which a measurement data type of the measurement device and a camera are associated with each other is selected for each measurement data type that matches a specified condition from the measurement data, and time information of the measurement data is extracted and triggered Trigger data extraction step as data,
Individual video data selection step for selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data combined from the folder for each camera associated with the measurement data type,
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and is combined video data creation step to be combined video data,
A combined video data creating step of combining the combined video data into one moving image to form combined video data;
A moving image combining method is provided.

  According to the third aspect of the present invention, since the recorded video is combined, only the necessary part can be viewed, and the viewability at the later confirmation can be improved. In addition, when you open a door, you can view only videos at multiple times when one or more triggers occur at the same time or sequentially. The effort to find etc. can be reduced. By making multiple browsing simultaneously, the workload of browsing is reduced and the work is improved. In addition, since stored videos can be viewed more at the same time, it can be expected that the deterrence of crimes and the like will increase. You can easily check the authenticity of the complaint at the time of delivery. Therefore, the effect of reducing the number of false claims can be expected. The amount of data is small and the cost can be reduced while maintaining high resolution. Moreover, if only the moving images in which the trigger is generated are collectively stored as one combined moving image, the original individual moving images can be deleted, so that capacity reduction and cost reduction can be realized.

  According to the present invention, only necessary portions can be browsed, and the viewability at the time of confirmation at a later date can be improved.

It is a figure which shows an example of the network structure of Example 1 of the surveillance camera system of this invention. It is a block diagram of the video recording server of Example 1 of the surveillance camera system of this invention. It is an image figure of the display method (temperature measurement example) with the database of the video recording server of Example 1 of the surveillance camera system of this invention, the measurement data of a measurement device, and an image. It is a block diagram of the measuring device (HTTP connection) of Example 1 of the surveillance camera system of the present invention. It is a block diagram of the terminal (mobile) of Example 1 of the surveillance camera system of the present invention. It is a block diagram of the terminal (PC) of Example 1 of the surveillance camera system of the present invention. It is an image figure of the moving image connection method (temperature measurement example) of Example 1 of the moving image combining method of the present invention. It is the schematic of the measurement data acquisition flow (example of an automatic door) of Example 1 of the moving image combining method of the present invention. It is the schematic of the moving image connection flow (automatic door example) of Example 1 of the moving image combining method of the present invention. It is an image figure of the connection procedure of Example 1 of the moving image combining method of the present invention. It is an image figure of the frame number adjustment procedure of Example 1 of the moving image combining method of the present invention. It is an image figure of the installation condition (track delivery example) of the monitoring camera in Example 1 of the moving image combining method of the present invention. It is an image figure which shows the secondary video data (track delivery example) in Example 1 of the moving image combining method of this invention. It is an image figure of the animation connection flow (example of truck delivery) of Example 1 of the animation combining method of the present invention. It is an image figure which shows the display screen (example of truck delivery) of Example 1 of the moving image combining method of this invention.

  EXAMPLES Hereinafter, although this invention is concretely demonstrated using an Example about this invention, this invention is not limited to these.

  In this embodiment, the video taken by the surveillance camera is processed and stored in a form that is easy to view, and the portions where the triggers are generated are extracted, connected, combined, and displayed. Specifically, a predetermined time unit is set for each camera based on the primary data created by capturing and collecting the camera images of moving images and still images by operating the monitoring camera on the recording server via the network. To create individual video data, which is secondary video data completed as a video, and combine multiple secondary video data to create combined video data, which is tertiary video data. In response to the request, the portion where the trigger is generated is extracted, connected and combined, and the image to be monitored is transmitted. Note that not only playback but also rewinding and fast-forwarding are possible. Therefore, in this embodiment, it is possible to effectively use the stored video. For example, in a work room, when you try to confirm at a later date whether there was a time when there was a foreign object at the time of material input, you can know immediately, and there was no suspicious movement of employees regarding the lot in question It is possible to know immediately when the user wants to check whether it has been confirmed at a later date, and it is possible to immediately know only when the door is open by simultaneously playing the video when the suspicious person has not entered. Therefore, according to the present embodiment, the browsing property at the time of confirmation at a later date is improved, and it is possible to investigate the problem investigation, which has been studied with a long time until now, in a very short time with a small amount of labor.

{Constitution}
FIG. 1 is a diagram illustrating an example of a network configuration of a monitoring camera system according to a first embodiment of the present invention. On a network 500 configured by a combination of communication networks such as a LAN, the Internet, Wi-Fi lines, 3G / LTE lines, and dedicated lines, (1) a plurality of surveillance cameras (stationary) (For image) 400A to 400C and monitoring camera (for moving image) 401, (2) connected to the monitoring camera 400, 401 via the network 500, acquires image data captured by the camera, stores it, and transmits it to the terminal As a server, the recording server 100, (3) connected to the recording server 100 via the network 500, and as a terminal for receiving and displaying image data from the recording server 100, mobile terminals 200A to 200C such as smartphones and desktop PCs (Personal computer) and browsing PCs 300A-C such as notebook PCs, (4) network An RFID sensor 700A, a beacon sensor 700B, an ON / OFF sensor 700C such as an automatic door, and a temperature sensor 700D are connected as measurement devices that are connected to the recording server 100 via 500 and transmit measurement data to the recording server 100. Has been. The sensor 700E is connected via another system database such as an open database. The camera may be only a monitoring still image camera or only a monitoring moving image camera, and the number of cameras is not limited as long as both are within the processing range of the recording server. Hereinafter, when the mobile terminal and the viewing PC are combined, they are referred to as “terminal” or “Viewer”. The measurement device is an example, and may be a measurement device, a sensor, or the like. In this embodiment, the ON / OFF sensor 700C is an HTTP connection sensor and the temperature sensor 700D is a SOCKET connection, but other connection methods such as FTP connection may be used. The data transmission method from the measuring device to the recording server may be a method of transmitting data from the measuring device side to the recording server, for example, at intervals of 5 minutes, 10 minutes, 1 hour, or from the recording server side to the measuring device. The data may be acquired at short intervals such as every second. Since the recording server directly acquires temperature information and the like from the temperature sensor 700D, it is possible to acquire information in a short cycle. Since it is the same connection as the camera, for connection from outside the local network, settings such as port forwarding are set in the router. The other system database connected to the sensor 700E is a unique cloud database of the sensor 700E, and the sensor 700E uploads to the database every 10 minutes, and the recording server acquires data from the database. According to this method, it is not possible to acquire information with a short period, but it is possible to acquire information that does not affect the installation environment of the device. The number and the number of measurement devices may be one or more. The connection method with the recording server may also be a connection other than the connection method described above.

  The recording server 100 exists in the same LAN as the monitoring camera (for moving image) 401 that shoots a moving image, but only when the monitoring camera (for still image) 400 that shoots a still image exists in the same LAN. Instead, they may be connected via a plurality of networks such as the Internet or a LAN. There may be a plurality of recording servers on the same network. In the present embodiment, the communication between the monitoring cameras 400 and 401 and the recording server 100 is TCP / IP, and the monitoring camera (for still image) 400 that captures a still image includes the camera and the recording server within the same LAN. Even if it does not exist, image data can be reliably transmitted and received, and reliability is high. The monitoring cameras 400 and 401 are IP cameras in this embodiment, but may be analog cameras. The viewing PC 300, which is a terminal for image display, is not limited to being in the same LAN as the recording server 100, and may be connected via a plurality of networks such as the Internet, a LAN, or a Wi-Fi line. The mobile terminal 200, which is an image display terminal, may also be connected via a plurality of networks such as a LAN, the Internet, and a cellular phone network (Wi-Fi line, 3G / LTE line, etc.). Note that a router 600 is interposed between the LAN and the Internet, between a monitoring camera for taking a still image and the Internet, and between an HTTP connection measuring device and the Internet. FIG. 1 shows a connection example in which a monitoring camera (for moving images), a monitoring camera (for still images), a viewing PC, a mobile terminal, and a measuring device are connected to a recording server via a plurality of networks. It is not limited to this. In this embodiment, the communication between the monitoring cameras 400 and 401 and the recording server 100 is performed by TCP with high reliability in which communication is started after establishing a session, but data is transmitted without establishing a session. UDP with excellent real-time characteristics may be used, and an image can be acquired by using both TCP and UDP protocols. The presence / absence of one or more types of triggers is detected from measurement data transmitted from a measurement device such as various sensors, barcode readers, and RFID information readers to the recording server.

  One recording server 100 can acquire images from a plurality of monitoring cameras 400 and 401. In this embodiment, since the recording server 100 automatically distributes network traffic, network design is not required, and it is only necessary to connect the camera to the port, so that the operation becomes very simple. In addition, resuming is easy even when communication is interrupted.

  FIG. 2 is a configuration diagram of the recording server according to the first embodiment of the surveillance camera system of the present invention. The recording server 100 includes a CPU 101 with a memory 102 that is a cache memory, a control / arithmetic unit having a device driver, a storage device 110 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a network interface 104, and the like. And an input / output device including a display 103 as a display device, a keyboard 105, a mouse 106, and the like. The storage device 110 includes an operating system 114 in addition to various programs such as a primary image folder 111, a secondary video folder 112, a tertiary video folder 116, a moving image connection / combination program 113, an authentication database, an environment setting folder, and the like. Stored. Combined video data for creating combined video data that is tertiary video data from individual video data that is secondary video data is also stored in a folder in the storage device 110. Measurement data acquired from the measurement device is also stored in a folder in the storage device 110. Furthermore, a database in which measurement data types of measurement devices and cameras are associated is also stored in the storage device 110. Various programs including the moving image connection / combination program 113 are normally stored in the auxiliary storage device of the storage device 110 and loaded into the main storage device at the time of execution. The primary image folder 111 stores camera images as primary data, and the secondary video folder 112 compresses and converts the primary data stored in the primary image folder 111 for a certain period of time as secondary video data. accumulate. Such secondary video data is individual video data obtained by converting a camera image taken by the camera into a moving image format. In the authentication database, IDs, passwords, and individual identification information (UID) that are reception information of the mobile terminal 200 and the viewing PC 300 are accumulated, and IP addresses that are access information of the monitoring cameras 400 and 401 and the measurement device 700, Port number, ID, and password are stored. In this embodiment, the recording server 100 is integrated with the recording server and the terminal, and also serves as a terminal for displaying images by itself, and for maintenance and management, the display 103 and a keyboard as an input means. 105 and a mouse 106. When the recording server does not need to reproduce the camera image, the terminal function as the image display device may not be provided. The environment settings folder contains the image acquisition timing of each surveillance camera, the primary data and secondary video data creation interval, compression conditions, layout conditions when creating tertiary video data (combined video data), primary data and secondary data, etc. Image data creation intervals, compression conditions, measurement data acquisition timing, and various conditions and layouts of measurement data display images created from measurement data are stored. The recording server 100 is a stationary server, but may be a cloud server.

  The recording server in the present embodiment also has a database having reproduction unit time length data for each measurement data type of each measurement device.

  In the recording server 100, the CPU 101 implements the function of a computer capable of performing the moving image combining / editing processing of the present invention by loading the moving image connecting / combining program 113 into the memory 102 and executing it. The CPU 101 is an arithmetic processing device mounted on a normal computer, executes various programs, and performs various controls.

  The recording server 100 may be a server group consisting of a plurality of servers in addition to a single server. For example, for the secondary video folder, for secondary video data after a certain period (for example, 24 hours), the storage destination may be a secondary video folder provided in a recording server separate from the recording server that acquires the camera image. Good. By separating past stored data that is not frequently played back, a larger number of cameras can be monitored on the same network.

  The recording server 100 connects to the monitoring camera, and at a certain time (for example, 1 second), the connected monitoring camera for taking a still image takes a still image and inputs the taken camera image to the recording server. First, a moving image is continuously shot by a connected moving image shooting monitoring camera for a certain time (for example, 10 seconds), the shot camera image is input to a recording server, compressed to create primary data, and a primary image of the storage device 110 Accumulate in folder 111. Then, the primary data is converted into secondary video data that is combined every predetermined time (for example, 10 minutes), compressed with a time stamp, and compressed in a moving image format. In this embodiment, the secondary video data, that is, the individual video data is data for the same time, and all are adjusted to the same number of frames. In this embodiment, the individual video data is for 10 minutes, but is not limited thereto.

  In the present embodiment, the video combining method is to display images of a certain time before and after the trigger for one camera in a time series and continuously display them, or synthesize a video for a certain time before and after the trigger for one camera on one screen. Trigger combination, which is either to display or to synthesize a video for a certain period of time before and after the trigger for a plurality of cameras and display them on one screen.

  The recording server 100 connects to the measurement device 700 and acquires measurement data transmitted from the measurement device every predetermined time (for example, 5 minutes, 10 minutes, 1 hour), or for a certain time (for example, 1 second). ), The measurement data is transmitted to the measurement device every time, and the measurement data is acquired and stored in the folder of the storage device 110.

  FIG. 3 is an image diagram of a recording server database, measurement device measurement data, and an image display method (temperature measurement example) according to the first embodiment of the surveillance camera system of the present invention. The recording server 100 includes a sensor master in which a measurement device key, an information collection interval, and a connection method are associated with each measurement device in a database, and a camera master in which a camera key, an image collection interval, a connection method, and the like are associated with each camera. A sensor item key that associates a sensor item key with a measurement device (sensor) key, an item name, a unit, etc., and a sensor item camera that associates a sensor item key with a camera key. And a tied map.

  The video connection / combination program allows the computer to: (1) Select trigger data extraction function that selects the data that meets the specified conditions from the measurement data for each measurement data type, and extracts the time information of the measurement data as trigger data (2) Individual video data selection function for selecting one or a plurality of individual video data in a predetermined time zone including the time of trigger data combined from the folder for each camera associated with the measurement data type, (3) The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are required and / or partly deleted, and is combined video data creation function as combined video data, 4) Combined video data creation function that combines video data for combining into one video to create combined video data, (5) Terminal connection function to connect to terminal, (6) Video from terminal This is a program for realizing a browsing request reception function for receiving a browsing request and (7) a transmission function for transmitting and displaying combined video data on a terminal. Setting of which camera video is to be combined in which layout, necessity of multiple connection and / or necessity of partial deletion, time requirement of how many minutes before the trigger and how many minutes after the trigger Which camera image is picked up based on the trigger of which measuring device is stored in advance in the database of the recording server 100 as a coupling condition.

  In the present embodiment, the moving image connection / combination program further includes (8) measurement data in the predetermined time zone for all the measurement data types to be displayed among the measurement data types associated with the camera of the selected individual video data. A measurement data display image creation function for creating a measurement data display image by selecting the image data, and the combined video data creation function (4) includes a combination of video data to be displayed simultaneously among the video data for combination. Adjust the number to the same number, adjust the frame interval to the same, and arrange the combined video data to be sequentially displayed in the display order, synthesize the measurement data display image with the combined video data, and combine all the combined video data after adjustment. This is a program for realizing a combined video data creation function that combines video data into combined video data.

  In this embodiment, a rewind request, fast forward request, and playback request for the combined video data displayed on the terminal are received from the terminal, and the combined video data to be displayed is rewinded, fast forwarded, and played according to the request.

  In this embodiment, secondary video data is created every predetermined time (for example, 10 minutes), and if there is secondary video data, combined video data that is tertiary video data can be created. Only a video with a trigger of a plurality of cameras can be viewed on a single screen or continuously, and is transmitted as one moving image from the recording server to the terminal, so that the amount of data can be reduced.

  In this embodiment, the connection between the monitoring camera and the recording server is performed by the TCP / IP method, and in order to identify the monitoring camera, a request for taking a camera image or the like is made after authentication. The connection between the terminal and the recording server is also performed by the TCP / IP method, and image transmission is performed after confirming that the terminal is a terminal registered in the recording server. The authentication is preferably performed by an authentication database on the recording server.

  The recording server 100 checks the IP address, port number, and UID of the monitoring camera, terminal, and measurement device every time connection is started, and connects to the camera, terminal, and measurement device in the local environment (for example, on the same LAN). At the start, the connection partner can be specified by connection using the IP address, port number, and UID, and authentication is performed with the user ID and password set on the recording server side. The recording server 100 uses a global IP address and port number by using router port forwarding (also expressed as port forwarding, etc.) when connecting to a surveillance camera in a remote environment such as via the Internet network. Identify the connection partner. Since the recording server 100 identifies the terminal based on the terminal unique information using the UID when the connection of the mobile terminal 200 or the viewing PC 300 is started, it is possible to display an image by authenticating the user ID and the password and matching the terminal unique information. .

  FIG. 4 is a configuration diagram of the measurement device (HTTP connection) of the monitoring camera system according to the first embodiment of the present invention. An HTTP-connected measuring device 700 includes a CPU 701 with a memory 702, a control / arithmetic device having a device driver, a storage device 710 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a network interface 704, and the like. And an input / output device including a display 703 as a communication control device and a display device. The storage device 710 stores a program 713 including a data collection program, an operating system 714, an HTTP service program 717, and a digital / analog conversion 718. The HTTP connection measuring device 700 may be, for example, a commercially available HTTP connection type measuring device. The CPU 701 is an arithmetic processing device mounted on a normal measurement device, executes various programs, and performs various controls. When measurement is performed in analog, the analog sensor 716 is connected to a digital / analog conversion 718 stored in the storage device 710, converted into digital data, collected, and transmitted to the recording server. The measuring device 700 of another connection method also collects data and transmits the data to the recording server. The serial connection measuring device 700 uses an RS232C / RS485 serial device. The measuring device 700 with socket connection, that is, TCP / IP connection, transmits data to the recording server by TCP / IP communication.

  FIG. 5 is a configuration diagram of a terminal (mobile) according to the first embodiment of the surveillance camera system of the present invention. The mobile terminal 200 includes a control / arithmetic apparatus having a CPU 201 with a memory 202, a device driver, and the like, a storage device 210, a communication control device that transmits and receives data, a display 203 as a display device, operation buttons, a touch panel, and the like. An output device is provided. The storage device 210 stores an image display program 213 and an operating system 214. The mobile terminal 200 is, for example, a mobile phone such as a smartphone, and the CPU 201 loads the image display program 213 into the memory 202 and executes it, thereby realizing a computer function capable of displaying an image according to the present invention. The CPU 201 is an arithmetic processing device mounted on a normal mobile terminal, executes various programs, and performs various controls.

  In this embodiment, the recording server 100 and the viewing PC 300 are both configured as personal computers, and have a clock function or the like that a normal personal computer has. The mobile terminal 200 also has a clock function and the like.

  FIG. 6 is a configuration diagram of the terminal (PC) of the monitoring camera system according to the first embodiment of the present invention. The viewing PC 300 includes a control / arithmetic unit having a CPU 301 and a device driver with a memory 302, a storage device 310 having a main storage device such as a DRAM and an auxiliary storage device such as a hard disk, a communication control device such as a network interface 304, And an input / output device including a display 303 as a display device, a keyboard 305, a mouse 306, and the like. The storage device 310 stores an image display program 313 and an operating system 314. The browsing PC 300 is, for example, a desktop PC, a notebook PC, a tablet terminal, or the like. The CPU 301 loads the image display program 313 into the memory 302 and executes it, thereby realizing a computer function capable of displaying an image according to the present invention. The CPU 301 is an arithmetic processing device mounted on a normal PC, executes various programs, and performs various controls.

  The image display program is a program for causing a computer to realize a terminal connection function for connecting to a recording server and an image display function for displaying an image transmitted from the recording server.

  In the present embodiment, as a more preferable aspect, the image display program further accepts an input of a rewind or fast-forward request to the computer, and the recording server receives a certain unit before or after a unit of combined video data that is tertiary video data. It is a program for realizing a rewind / fast-forward request function for requesting an image.

  In the present embodiment, since the images from a plurality of cameras are combined into a moving image, the images of all the cameras being displayed can be rewound and fast forwarded at once.

  A moving image browsing method program having a moving image connection / combination program and an image display program causes a computer to execute the steps of the respective programs.

  Various sensors, barcode readers, and RFID information readers attached to the monitoring camera send information converted to the recording server via a network connection, serial connection, or relay, to the recording server. For example, when a door opening / closing sensor is provided along with a monitoring camera mounted on a truck, door opening / closing information and a camera image are transmitted to the recording server. The recording server manages the sensor information in a database and collates it with a moving image combining instruction to generate target combined video data. For example, when a plurality of surveillance cameras and RFID information readers installed on a belt conveyor for manufacturing products are installed, the surveillance camera and RFID information reader are linked in advance and entered into the RF tag of the product. Information is read by a reader and point passing information is managed.

  In this embodiment, the recording server 100 connected to the monitoring cameras 400 and 401 for capturing images via the network 500 and the terminals 200 and 300 connected to the recording server 100 via the network 500 for displaying images are provided. The recording server 100 is connected to a monitoring camera, and a camera image obtained by shooting a still image with the connected monitoring camera for taking a still image every predetermined time (for example, 1 second). Is input to the recording server, and the video is continuously input to the monitoring camera for video recording that is connected for a certain period of time (for example, 10 seconds), and the captured camera image is input to the recording server and compressed to create primary data. The image is stored in the primary image folder 111 of the storage device 110. Each means is provided for converting the primary data into secondary video data that is combined every certain time (for example, 10 minutes), compressed with a time stamp, and compressed in a moving image format. Further, the recording server 100 selects (1) a trigger data extracting unit that selects, for each measurement data type, a condition that matches a condition specified from the measurement data, extracts time information of the measurement data, and uses it as trigger data; 2) Individual video data selection means for selecting one or a plurality of individual video data in a predetermined time period including the time of trigger data to be combined from the folder for each camera associated with the measurement data type, (3) selected (4) a video data creation means for coupling, wherein the individual video data is linked and / or partially deleted depending on whether or not a plurality of linkages are necessary and / or partly deleted; Combined video data creating means for combining combined video data into one moving image to form combined video data, (5) Terminal connecting means for connecting to a terminal, (6) Requesting a video viewing request from the terminal Only put browsing request accepting means (7) to the terminal, are also provided a delivery means for displaying by sending the combined video data.

  In the present embodiment, the recording server 100 further includes (8) measurement data of the predetermined time zone for all of the measurement data types to be displayed among the measurement data types associated with the camera of the selected individual video data. Measurement data display image creation means for selecting and creating a measurement data display image is provided, and the combined video data creation means of (4) includes the number of frames of the combined video data to be displayed simultaneously among the combined video data. Are adjusted to the same number, the frame interval is adjusted to be the same, and the video data for combination to be sequentially displayed are arranged in the display order, the measurement data display image is synthesized with the video data for combination, and all the video data for combination after adjustment is 1 This is combined video data creating means for combining the two moving images into combined video data.

  In the present embodiment, the recording server 100 functions as means (1) to (8) by the hardware configuration and the moving image connection / combination program 113 described above.

  The terminals (mobile terminal 200 and viewing PC 300) are provided with (1) an image display means for displaying an image transmitted from the recording server 100 and (2) a rewind request, a fast forward request, and a playback means.

  In the present embodiment, the terminals 200 and 300 function as means (1) to (2) by the hardware configuration and the image display programs 213 and 313 described above. For example, when playback is performed on the next day of recording, etc., it is selected what time of day recording is desired to be played, and a file converted into secondary data for 10 minutes is called and played back. Rewind and fast forward during playback are also possible.

  In the surveillance camera system of this embodiment, a recording server connected via a network to a camera group that captures a still image or a moving image captures a camera image from the camera group by a TCP / IP method at regular intervals. Alternatively, it can be acquired as a video, compressed to create primary data, stored as primary data for a certain period, and then converted to secondary video data in a highly compressed video file with time stamp information after a certain period. And save again. In this embodiment, H. Compressed to H.264 format and converted to a video file. Further, the tertiary video data as a synthesized video for combining and displaying a plurality of individual video data as secondary video data in combination at the same time in a format determined by the recording server or in a format according to a request from the terminal, that is, Create combined video data and display it on the terminal.

  The surveillance camera system according to the present embodiment can browse only necessary portions, and can improve the viewability at the later confirmation. A plurality of cameras can be played back simultaneously, for example, the time from problem detection to problem investigation can be shortened.

{procedure}
The procedure of the moving image combining method in the first embodiment of the surveillance camera system of the present invention and the moving image browsing method using the first embodiment of the moving image combining method of the present invention will be described below. In the description of the procedure using the drawings, an example of temperature measurement, an example of an automatic door, and an example of truck delivery are used as appropriate. The basic procedure is the same for each, and the type of measurement device, the type of trigger, the coupling conditions, etc. are different.

  The moving image browsing method in the moving image combining method of the present embodiment is a camera image that is connected to one or more cameras, one or more measuring devices, and one or more terminals that capture an image via a network. A video recording server that stores the video as an individual video data in the folder, stores the measurement data acquired from the measurement device in the folder, and has a database that associates the measurement data type of the measurement device with the camera. (1) Measurement For each data type, a trigger data extraction step for selecting data that matches the specified condition from the measurement data and extracting time information of the measurement data as trigger data, (2) a camera associated with the measurement data type One or a plurality of individual video data in a predetermined time zone including the time of trigger data combined from the folder for each (3) The selected individual video data is connected and / or partially deleted depending on whether or not multiple connections are required and / or partial deletion is required. Video data creation step for combining as data, (4) a measurement data selection step for selecting measurement data of the predetermined time zone for each camera for all the measurement data types associated with the camera of the selected individual video data; (5) a combined video data creating step of combining the combined video data into one moving image to form combined video data; and (6) a sending step of sending the combined video data to the terminal for display.

  Furthermore, in this embodiment, after the measurement data selection step (4) and before the combined video data creation step (5), (8) the measurement data type associated with the camera of the selected individual video data A measurement data display image creation step for creating a measurement data display image by selecting measurement data of the predetermined time period for all the measurement data types to be displayed, and the combined video data creation step of (5) Among the video data, the video data for coupling to be displayed at the same time are adjusted to the same number of frames and the same frame interval, and the video data for coupling to be sequentially displayed are arranged in the display order. This is a combined video data creation step of combining display images and combining all the combined video data for adjustment into one moving image to form combined video data.

  In the recording server, camera images transmitted from a plurality of surveillance cameras intermittently or continuously are accumulated as primary data in the primary image folder, and secondary video data created from the primary data is stored in the secondary video folder. Accumulated. The secondary video data is individual video data stored in a folder with a camera image as a moving image format. Since the display request of the combined video data from the terminal is answered after the target individual video data is created, the video of a plurality of cameras can be confirmed at one stage at an early stage, and the viewability is high.

  In this embodiment, the type of camera and trigger, the combining method, etc. are stored in the recording server in advance, but the selection of the camera to be played back or the selection of the trigger is accepted from the terminal, and then the video combining method May be displayed, and individual images may be connected and combined in accordance with the received combining method.

  In this embodiment, one or a plurality of individual video data in a predetermined time zone including the time of trigger data is selected for all the cameras selected by the recording server in a predetermined method. The moving image combining method of this embodiment is, for example, when it is desired to continuously check only the images before and after the temperature measured by the temperature / humidity sensor associated with a predetermined camera exceeds a certain level, This method is useful when you want to check only the images of cameras installed in multiple directions when opened.

  When a moving image browsing request is received from the terminal, in this embodiment, one or a plurality of individual video data in a predetermined time zone including the time of trigger data is selected for all selected cameras. The trigger data is time information of measurement data selected in accordance with a condition specified for each measurement data type. For example, in the example shown in FIG. 3, the measurement data type of the measurement device “Humidity meter A” (key S01), which is a temperature / humidity sensor associated with the camera 001 (key C01), is temperature (key I01). And humidity (key I02), and the temperature and humidity sensor (key S01) recorded 25 ° C. or higher when the specified condition for temperature (key I01), which is one of the measurement data types, was 25 ° C. or higher. When the time information of the measurement data (key I01) is from 12: 5 to 12: 7 and from 13:15 to 13:20, the trigger data is the temperature / humidity sensor and the measurement data type is temperature ( Key I01) is 12: 5 to 12: 7, 13:15 to 13:20, and the predetermined time zone including the time of trigger data is 2 minutes before and 3 minutes after , The individual image data of the camera 0011 is selected (key C01) becomes the data of up to 3 minutes and 12 o'clock 10 minutes 13 hours 13 minutes 13 hours 23 minutes 12 o'clock.

  When the display method is simultaneous display of images from a plurality of cameras, the measurement data type of the measurement device “heat / humidity meter A” (key S01), which is a temperature / humidity sensor associated with the camera 001 (key C01), is the temperature ( Measurement in which the temperature / humidity sensor records 25 ° C. or higher when the condition specified for the temperature (key I 01), which is one of the measurement data types, is 25 ° C. or higher. The time information of the data (key I01) is from 12:05 to 12:07, and the same applies to the temperature / humidity sensor “thermometer B” (key S02) associated with another camera 002 (key C02). When the time information of the measurement data recorded at 25 ° C. or higher with the temperature / humidity sensor (key S02) is from 13:15 to 13:20 under the specified conditions, the trigger data is When the device is a temperature / humidity sensor (key S01, key S02) and the measurement data type is temperature (keys I01, I03), the camera 001 (key C01) is from 12: 5 to 12: 7, and the camera 002 (key C02) is From 13:15 to 13:20, if the predetermined time zone including the time of the trigger data is 2 minutes before and 3 minutes after, the selected individual video data is 12:00 on the camera 001 (key C01). From 3 minutes to 12:10, the camera 002 (key C02) has data from 13:13 to 13:23. The individual video data of the camera 001 (key C01) from 12: 3 to 12:10 and the individual video data of the camera 002 (key C02) from 13:13 to 13:23 are set with the frame interval and the number of frames. The data is adjusted to the same number between the data, and the combined video data after adjustment is combined into one video so that it is displayed divided into one screen, or the measurement data display image is added to the combined video data after adjustment The combined video data is obtained by synthesizing the video into one moving image.

  When the display method is continuous display for video from one camera, it is as follows. FIG. 7 is an image diagram of the moving image connection method (temperature measurement example) according to the first embodiment of the moving image combining method of the present invention. The specified condition is 30 ° C. when the measurement data type of the “humidity meter A” (key S01) is temperature (key I01), and the predetermined time zone including the time of the trigger data is 2 seconds before and 5 seconds after Assuming that the video unit is 1 hour, individual video data from 12:26:25 to 12:26:37 and 12: 28: 6 to 12:28:13 of the camera 0011 (key C01) Are combined into video data for combination, or a combination of the video data for combination or measurement data display images of a predetermined measurement data type (I01, I02, I03) is combined with the video data for combination. The video is the combined video data.

  When the display method is simultaneous display of video from one camera, individual video data from 12:26:25 to 12:26:37 and 12: 28: 6 to 12:28:13 Individual video data up to and including the frame interval and the number of frames adjusted to the same number between the data, and the combined video data after adjustment combined into one video so that it can be divided into one screen and displayed, Alternatively, the combined video data is obtained by synthesizing the measurement data display image with the combined video data after adjustment into one moving image.

  FIG. 8 is a schematic diagram of a measurement data acquisition flow (automatic door example) of the moving image combining method according to the first embodiment of the present invention. The recording server requests an HTTP communication connection to an HTTP connection sensor that is “ON” when the automatic door is “open” and “OFF” when the automatic door is “closed”, and performs user / password authentication. When the connection is completed and measurement data (sensor data) is requested from the sensor at regular intervals, the measurement data acquired on the sensor side is transmitted to the recording server, and the acquired measurement data is stored in the device database of the recording server.

  FIG. 9 is a schematic diagram of a moving image connection flow (automatic door example) of the moving image combining method according to the first embodiment of the present invention. When a browsing request is received from the terminal, creation of combined video data, which is tertiary video data, is started by a method preset in the recording server. In the present embodiment, the video of the same camera is connected, and when the automatic door is “open”, the sensor is the measurement data whose measurement data is “ON”, and the recording server is the measurement data “ON”. Time information, that is, trigger data is 9: 5: 2: 9: 13: 7, 9:20:17, movie unit is 1 minute, start condition is start and end of movie unit including trigger data When the condition is the end of a moving image unit including trigger data, that is, a moving image at 9 o'clock is generated with one moving image unit as a unit of individual video data. 9. In the case of FIG. 9, from the secondary video data of the camera in front of the automatic door, as the individual video data based on the trigger data, from 9: 5: 0 to 1 minute, 9: 13: 0 1 minute from 9: 20: 0 and 1 minute from 1 second, video data are picked up and connected in time series to form video data for combination, and the combined video data is combined into a single video. That is, it is stored as tertiary video data.

  FIG. 10 is an image diagram of a connection procedure of the moving image combining method according to the first embodiment of the present invention. The individual video data of the camera linked to the first trigger data are the video from 10:00, the video from 10:20 and the video from 10:30 of the camera CAM01, and the second trigger data and The individual video data of the linked camera includes the video from 10:40 of the camera CAM01, the video from 10:00, the video from 10:20 of CAM03, the video from 10:10 of CAM04, and CAM06. When the first trigger is selected as the trigger, the video from 10:00, the video from 10:20, and the video from 10:30 are connected. To synthesize. When the trigger overlaps with another individual video data at the same time, it is specified whether the screen of the timing is divided into a plurality of screens by overlapping camera images to be one screen or simply arranged in time series. When the second trigger is selected as the trigger, when combining at the same time, the 10:20 video of CAM03 and CAM06 is synthesized to be displayed on a single screen, and the target of multiple cameras Are combined in order of shooting time. For example, for CAM01, a combination of black circle trigger images (every number of frames is the same) for each day becomes an image such as CAM01_201604151 in the lower left of FIG. CAM01_201404151 starts to be connected from the pickup after the time when the target camera image is completely completed. In the case of the black circle trigger, the final completed secondary video data is CAM01_1030. Therefore, for the tertiary video data of the target camera CAM01, moving image generation is started after 10:30. The completion time is unknown. An image such as CAM01_201604152 in the lower right of FIG. 10 is a concatenated white circle trigger image (a number of frames are all the same) for a plurality of cameras and the images of the overlapping cameras divided into a single screen. become.

  A method for connecting a plurality of individual video data includes, for example, individual video data from 9:20 to 10 minutes, individual video data from 9:30 to 10 minutes, individual video data from 9:40 to 10 minutes, and 9:50. When creating the combined video data from 9:25 to 9:55 from the 10-minute individual video data, first, the individual video is concatenated, and the video from 9:20 to 5 minutes and 9:55 to 5 This is done by trimming to delete the minutes of video.

  The method of adjusting the frame interval and the number of frames to the same number between video data for a plurality of video data for combination is that the original individual video data is, for example, cameras A, B, and C, and the primary data of the camera A Is 1 frame per second, B camera primary data is 5 frames per second, and C camera primary data is 10 frames per second. If there is not enough, make up for the previous frame.

  FIG. 11 is an image diagram of the frame number adjustment procedure of the moving image combining method according to the first embodiment of the present invention. The method of adjusting the frame interval and the number of frames to the same number between video data for a plurality of video data for combination is that the original individual video data is, for example, cameras A, B, and C, and the primary data of the camera A Is 1 frame per second, B camera primary data is 5 frames per second, and C camera primary data is 10 frames per second. If there is not enough, make up for the previous frame.

  FIG. 12 is an image diagram of a monitoring camera installation situation (truck delivery example) in the first embodiment of the moving image combining method of the present invention. In the installation example of the monitoring camera shown in FIG. 12, a monitoring camera is installed at the rear door of the truck and at each collection / delivery site, and a monitoring camera (T camera) and a door opening / closing sensor are installed at the rear door of the truck. The continuous T-camera video is transmitted to the recording server, and when the door is opened, the measurement data becomes “ON” and the time information when it is “ON” is stored in the recording server as trigger data. Is done. In addition, at the A base, B base, and C base, which are the truck collection / delivery bases, there are provided RFID readers that read the RF tag information embedded in the product box etc. and manage the point passing information. The monitoring cameras (A to C cameras) at each collection / delivery base are linked to the RFID readers at the respective bases, and continuous video images of the A to C cameras are transmitted to the recording server and passed through the points. Information data is transmitted to the recording server, and time information when the point passing information is read is stored in the recording server as trigger data together with the point passing information. It may be detected by RFID that a truck has entered each location.

  FIG. 13 is an image diagram showing secondary video data (track delivery example) in the first embodiment of the moving image combining method of the present invention. The truck at the A base opens the door from 9:30 to 9:45, unloads the baggage and acquires the point passing information with the reading device, and the truck at the B base opens the door from 11:20 to 11:40. When opening and unloading the baggage and acquiring point passing information with the reading device, and when the truck opens the door from 15:00 to 15:25 at site C and unloading the baggage and acquiring the point passing information with the reading device In the secondary video data, continuous video data of the A camera, B camera, and C camera and intermittent video data of the T camera are stored. Since the T camera is bright only when the door is opened, images other than 9:30 to 9:45, 11:20 to 11:40, and 15:00 to 15:25 are dark. In the example shown in FIG. 12, the belt conveyor at each site is shown from the camera mounted on the track, and the unloading status from the track is shown on the camera at each site.

  FIG. 14 is an image diagram of the moving image connection flow (track delivery example) of the moving image combining method according to the first embodiment of the present invention. For the A camera, the B camera, the C camera, and the T camera, trigger data is read from the point passing information by the RFID reader, that is, from 9:30 to 9:45 at the A site, and from 11:20 to 11 at the B site. Until 10:00, from 15:00 to 15:25 at C, for truck door sensors from 9:30 to 9:45, from 11:20 to 11:40, and from 15:00 to 15:25 First, these trigger data are extracted, and as individual video data, images of A camera and T camera from 9:30 to 9:45, and B camera from 11:20 to 11:40 And T-camera images and C-camera and T-camera images from 15:00 to 15:25 are picked up and connected to a video by combining the videos. Create a data, performs frame adjustment for all the binding video data attached to a single video, create and save a combined video data or tertiary video data.

  FIG. 15 is an image view showing a display screen (an example of truck delivery) of the first embodiment of the moving image combining method of the present invention. Video is secured according to the opening and closing of the truck door, and the arrival of each base is recognized by the RFID installed on the truck. A track camera (T camera) and a camera (A, B, C camera) at each base are connected and connected to generate an image.

  The combined video data includes A camera and T camera images from 9:30 to 9:45, B camera and T camera images from 11:20 to 11:40, and 15:00 to 15:25. The video from the C camera and T camera up to a minute is combined into a single video, and the video at each site and the video at the track can be confirmed simultaneously in a short time. Even in different time zones, all the cameras can be divided and displayed on one screen. In addition, when combining only triggered videos for one camera, for example, it is possible to collect only when the door is open for the video of the camera installed in the cargo for truck delivery etc. . In that case, you can view the contents at the time when there is a complaint by splitting the screen and browsing at once, or connecting and connecting after the first video without dividing the screen. It is also possible to check the working method of a person who is quick. The trigger information can vary depending on the situation, such as when the door is opened or closed, or when the image becomes brighter. If an RFID or barcode is installed on the cardboard, all images such as when passing through the gate can be combined. It becomes possible.

{effect}
According to the present embodiment, only necessary portions can be browsed, and the viewability at the later confirmation can be improved. One or a plurality of camera videos can be played back simultaneously, and for example, the time from problem detection to problem investigation such as temperature abnormality, visitor confirmation, and lost luggage can be shortened.

  More specifically, according to the present embodiment, it is possible to generate a moving image for a new use with a completely new aspect, instead of simple browsing in time units. For example, it is possible to improve the viewability when confirming at a later date, such as lot (corrugated cardboard) units at the manufacturing site, and the timing of loading and unloading the delivery truck. Also, unnecessary recording information can be reduced. Furthermore, by developing software for the original player, the target movie can be enlarged and displayed in detail from the combined tertiary video data.

  According to the moving image combining method of this embodiment, it is possible to collect only the images with triggers and view them at a time, so that the viewability can be improved.

  Until now, the camera video was only viewed when a problem occurred, but according to the surveillance camera system of this embodiment, since it can be confirmed in a short time, it can also be checked on a daily basis. Effective for early detection. Further, in a situation where only combined video data, that is, tertiary video data is sufficient, storage can be dramatically reduced by deleting not only the primary data but also the secondary video data.

  According to this embodiment, it is possible to reduce the labor of finding many video files over a long time when a problem occurs. In addition, multiple simultaneous browsing is not burdened even if it is incorporated in the business, so the business is improved. In addition, deterrence becomes stronger by seeing many stored videos. In addition, authenticity such as complaints at the time of delivery can be confirmed. In addition, it is thought that the lie claim to a delivery company reduces as a ripple effect by this.

  According to this embodiment, even if the number of frames is reduced for some of the video images from the camera, tertiary video data that is meaningful as a whole can be obtained.

  The present invention is not limited to the above embodiment, and various modifications can be made without departing from the spirit of the invention. In addition, the constituent elements of the above embodiments can be arbitrarily combined without departing from the spirit of the invention.

100 Recording server 101 CPU
102 Memory 103 Display 104 Network Interface 105 Keyboard 106 Mouse 110 Storage Device 112 Secondary Video Folder 113 Video Linking / Combining Program 114 Operating System 116 Tertiary Video Folder 200 Mobile Terminal 201 CPU
202 Memory 203 Display 210 Storage device 213 Image display program 214 Operating system 300 Viewing PC
301 CPU
302 Memory 303 Display 304 Network interface 305 Keyboard 306 Mouse 310 Storage device 313 Image display program 314 Operating system 400 Surveillance camera (for still image)
401 Surveillance camera (for video)
500 Network 600 Router 700 Measuring device 701 CPU
702 Memory 703 Display 704 Network interface 710 Storage device 713 Program 714 Operating system 716 Analog sensor 717 HTTP service 718 D / A conversion

Claims (8)

An information processing apparatus connected to one or more cameras and one or more measurement devices for capturing an image via a network;
The information processing apparatus is
For each measurement data type, a trigger data extraction unit that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. Individual video data selection means for selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Combined video data creating means for combining the combined video data into one moving image to be combined video data;
Have
The combined video data creating means adjusts the number of frames to the same number and simultaneously adjusts the frame interval between the combined video data to be displayed at the same time out of the combined video data. by arranging in sequence, surveillance camera system that is characterized by generating the combined video data. An information processing apparatus connected to one or more cameras and one or more measurement devices for capturing an image via a network;
The information processing apparatus is
For each measurement data type, a trigger data extraction unit that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. Individual video data selection means for selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Combined video data creating means for combining the combined video data into one moving image to be combined video data;
Have
Further, a measurement data display image for creating a measurement data display image by selecting measurement data in the predetermined time period for all measurement data types to be displayed among measurement data types associated with the camera of the selected individual video data Has creation means,
The combined video data creating means combines the measurement data display image with the combined video data and combines all the combined video data after adjustment into one moving image to form combined video data. surveillance camera system that. An information processing apparatus used in a monitoring camera system, which is an information processing apparatus connected to one or more cameras and one or more measurement devices for capturing an image via a network,
For each measurement data type, a trigger data extraction unit that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. Individual video data selection means for selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Combined video data creating means for combining the combined video data into one moving image to be combined video data;
Equipped with a,
The combined video data creating means adjusts the number of frames to the same number and simultaneously adjusts the frame interval between the combined video data to be displayed at the same time out of the combined video data. An information processing apparatus that creates the combined video data by arranging them in order . An information processing apparatus used in a monitoring camera system, which is an information processing apparatus connected to one or more cameras and one or more measurement devices for capturing an image via a network,
For each measurement data type, a trigger data extraction unit that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. Individual video data selection means for selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and combined video data creating means for respectively combining video data,
Combined video data creating means for combining the combined video data into one moving image to be combined video data;
Equipped with a,
Further, a measurement data display image for creating a measurement data display image by selecting measurement data in the predetermined time period for all measurement data types to be displayed among measurement data types associated with the camera of the selected individual video data Has creation means,
The combined video data creating means combines the measurement data display image with the combined video data and combines all the adjusted combined video data into one moving image to form combined video data. Information processing device. An information processing method used in a surveillance camera system including one or more cameras and one or more measurement devices for capturing an image,
For each measurement data type, a trigger data extraction step that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. An individual video data selection step of selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and is combined video data creation step to be combined video data,
A combined video data creating step of combining the combined video data into one moving image to form combined video data;
Including
In the combined video data creation step, among the combined video data, the combined video data to be displayed simultaneously are adjusted to the same number of frames and the same frame interval, and the combined video data to be sequentially displayed are displayed. An information processing method comprising creating the combined video data by arranging them in order . An information processing method used in a surveillance camera system including one or more cameras and one or more measurement devices for capturing an image,
For each measurement data type, a trigger data extraction step that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. An individual video data selection step of selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and is combined video data creation step to be combined video data,
A combined video data creating step of combining the combined video data into one moving image to form combined video data;
Including
Further, a measurement data display image for creating a measurement data display image by selecting measurement data in the predetermined time period for all measurement data types to be displayed among measurement data types associated with the camera of the selected individual video data Has a creation step,
In the combined video data creation step, the measurement data display image is combined with the combined video data, and all the combined video data for adjustment are combined into one moving image to form combined video data. Information processing method. A computer used in a surveillance camera system including one or more cameras and one or more measuring devices for capturing an image;
For each measurement data type, a trigger data extraction step that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. An individual video data selection step of selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and is combined video data creation step to be combined video data,
A combined video data creating step of combining the combined video data into one moving image to form combined video data;
A program for executing,
In the combined video data creation step, among the combined video data, the combined video data to be displayed simultaneously are adjusted to the same number of frames and the same frame interval, and the combined video data to be sequentially displayed are displayed. A program characterized by creating the combined video data by arranging in order . A computer used in a surveillance camera system including one or more cameras and one or more measuring devices for capturing an image;
For each measurement data type, a trigger data extraction step that selects a condition that matches a specified condition from measurement data acquired from the measurement device, extracts time information of the measurement data, and uses it as trigger data,
With reference to a storage device in which the measurement data type of the measurement device and the camera are stored in association with each other, the camera image captured by the camera is converted into a moving image format for each camera associated with the measurement data type. An individual video data selection step of selecting one or a plurality of individual video data in a predetermined time zone including the time of the trigger data to be combined from the individual video data
The selected individual video data is connected and / or partially deleted depending on whether or not a plurality of connections are necessary and / or partly deleted, and is combined video data creation step to be combined video data,
A combined video data creating step of combining the combined video data into one moving image to form combined video data;
A program for executing,
Further, a measurement data display image for creating a measurement data display image by selecting measurement data in the predetermined time period for all measurement data types to be displayed among measurement data types associated with the camera of the selected individual video data Run the creation step,
In the combined video data creation step, the measurement data display image is combined with the combined video data, and all the combined video data for adjustment are combined into one moving image to form combined video data. program.

Images