JP4761029B2 - Image analysis system - Google Patents

Description

  The present invention relates to an image analysis system that analyzes an image captured via a camera.

  For example, in a monitoring system that monitors the occurrence of danger or abnormality and a production system that monitors a manufacturing process, a method that uses image analysis on an image captured by a camera is applied. According to such a method, it is not necessary to always monitor visually an image captured by the camera.

  Examples of apparatuses that perform image analysis on images captured by a camera include the following.

JP 09-094772 A

  When monitoring by image analysis, there is a case where image analysis is desired at a place away from the camera. Further, when a plurality of cameras are used, it is advantageous in terms of cost if image analysis can be performed by a single device.

  However, when an image captured by the camera is transferred to the image analysis apparatus, the image data is enormous, which may cause a communication burden. In particular, when it is desired to share a communication line with another system, the amount of communication data is limited, and it becomes difficult to transfer image data.

  An object of the present invention is to provide an image analysis system that can reduce a communication burden.

Image analysis system of the present invention is an image analysis system for analyzing the image captured through the camera, and front analysis means for performing a camera for capturing an image, an image analysis based on the image captured by the camera, the Post-analysis means for executing image analysis based on the analysis result by the pre-stage analysis means, and the analysis result by the pre-stage analysis means from the pre-stage analysis means to the post-stage analysis means via a common line to which a plurality of devices can be connected. And transmitting means for transmitting the image, wherein the pre-stage analysis means executes, as the image analysis, a contour extraction process on an image frame constituting the image, and outputs a result of the contour extraction process as the analysis result and, wherein the subsequent analysis means and characterized by performing an image analysis based on the difference between image frames in the results of the outline extraction process That.
According to this image analysis system, the analysis result by the pre-stage analysis means is transmitted from the pre-stage analysis means to the post-stage analysis means, so that it is possible to reduce the burden on communication using a common line.

Image analysis system of the present invention is an image analysis system for analyzing the image captured through the camera, the first camera and the second camera capturing independent images, respectively, captured by the first camera the a first front analysis means for performing an image analysis based on the image, and the second front analysis means for performing an image analysis based on the image captured by the second camera, by the first front analyzer An analysis result and an analysis result based on an analysis result based on the analysis result of the second first-stage analysis means; a result of the analysis by the first front-stage analysis means; and a result of the analysis by the second front-stage analysis means, Transmission means for transmitting from the first pre-stage analysis means and the second pre-stage analysis means to the post-stage analysis means via a communication line, respectively. , Wherein the first front analysis means and said second front analysis means, respectively, wherein the image analysis, perform contour extraction processing for the image frames constituting the image, contour as the analysis result The result of the extraction process is output, and the latter-stage analysis unit performs image analysis based on a difference between image frames in the result of the contour extraction process, and the first-stage analysis unit, the second-stage analysis unit, and the The latter-stage analysis means is configured by different computers .

  According to this image analysis system, since the analysis result by the front-stage analysis unit is transmitted from the front-stage analysis unit to the rear-stage analysis unit, the communication burden can be reduced. Further, since the image analysis based on the analysis results of the plurality of upstream analysis means is executed by the downstream analysis means, the cost can be reduced as compared with the case where an independent image analysis apparatus is used for each camera.

Image analysis system of the present invention is an image analysis system for analyzing the image captured through the camera, and front analysis means for performing a camera for capturing an image, an image analysis based on the image captured by the camera, the First post-analysis means for executing image analysis based on the analysis result by the pre-stage analysis means, second post-stage analysis means for executing image analysis based on the analysis result by the pre-stage analysis means, and the analysis by the pre-stage analysis means the results, toward from the front analyzing means via a communication line to said first subsequent analysis means and the second subsequent analysis means, and transmitting means for transmitting respectively, wherein the front analysis means, the image As analysis, contour extraction processing is executed on the image frames constituting the image, and the result of contour extraction processing is output as the analysis result, The first latter analysis means and the second latter analysis means execute image analysis based on a difference between image frames in the result of the contour extraction processing, respectively, and the first analysis means and the first latter analysis. The means and the second latter analysis means are constituted by different computers .

  According to this image analysis system, since the analysis result by the front-stage analysis unit is transmitted from the front-stage analysis unit to the rear-stage analysis unit, the communication burden can be reduced. In addition, since a plurality of subsequent analysis means are provided, a plurality of types of image analysis can be performed on a single image.

  The communication line may be a common line capable of connecting a plurality of devices.

The analysis result may be compressed data of an image captured by the camera.
The compression method is not limited, and any compression data can be used as long as the data amount can be suppressed and information necessary for the subsequent analysis means is included. The compressed data includes, for example, information indicating the position of the object, information indicating the position of the outline of the object, vector information indicating the outline, color classification, binarized image data, and the like. Further, the compressed data is not limited to data generated only by processing within an image frame, and may be generated based on a plurality of image frames.

The analysis result may be object extraction information obtained from an image captured by the camera.
The object extraction information includes, for example, information indicating the presence, the number, or the position of an object such as a person, and includes both information that corresponds to the compressed data of the image and information that does not correspond. The object extraction information includes information indicating the position of the contour of the object, vector information indicating the contour, etc., color classification, the result of boundary detection, and the like. Further, the object extraction information is not limited to data generated only by processing within an image frame, and may be generated based on a plurality of image frames.

The latter-stage analysis unit may execute a process of analyzing a correlation between image frames in the result of the contour extraction process .
For example, the pre-stage analysis unit extracts an object by processing in the image frame, and the post-stage analysis unit analyzes the state of movement of the object, thereby determining a predetermined event, for example, a dangerous state based on the state of movement of the object. You may perform the process which recognizes generation | occurrence | production.

  According to the image analysis system of the present invention, the analysis result by the pre-stage analysis means is transmitted from the pre-stage analysis means to the post-stage analysis means, so that it is possible to reduce the burden on communication using a common line.

  According to the image analysis system of the present invention, since the analysis result by the front-stage analysis unit is transmitted from the front-stage analysis unit to the rear-stage analysis unit, the communication burden can be reduced. Further, since the image analysis based on the analysis results of the plurality of upstream analysis means is executed by the downstream analysis means, the cost can be reduced as compared with the case where an independent image analysis apparatus is used for each camera.

  According to the image analysis system of the present invention, since the analysis result by the front-stage analysis unit is transmitted from the front-stage analysis unit to the rear-stage analysis unit, the communication burden can be reduced. In addition, since a plurality of subsequent analysis means are provided, a plurality of types of image analysis can be performed on a single image.

  Hereinafter, an embodiment of an image analysis system according to the present invention will be described with reference to FIGS.

  A first embodiment of an image analysis system according to the present invention will be described below with reference to FIGS.

  FIG. 1 is a block diagram showing the configuration of the image analysis system of this embodiment.

  As shown in FIG. 1, the image analysis system of this embodiment includes a camera 1 that captures a moving image, a pre-analysis device 2 that performs image analysis based on the image captured by the camera 1, and an analysis by the pre-analysis device 2. A server 3 that executes image analysis based on the result, and an image display device 4 that appropriately displays a result of image analysis by the server 3 and an image captured by the camera 1 are provided. As shown in FIG. 1, the upstream analysis device 2, the server 3, and the image display device 4 are connected to be communicable with each other via a common line 5 that can connect a plurality of devices, for example, Ethernet (registered trademark). .

  FIG. 2 is a flowchart showing a processing procedure in the image analysis system of this embodiment.

  Steps S <b> 1 to S <b> 4 show a processing procedure in the upstream analysis device 2.

  In step S <b> 1 of FIG. 2, image analysis processing for removing the background of the image is executed based on the frame image captured by the camera 1. Next, in step S2, an image analysis process for extracting an object, for example, a human contour, is executed.

  In step S3, the server 3 waits for a data transmission request from the server 3 and proceeds to step S4. In step S4, the analysis result obtained by the process of step S2, that is, information indicating the contour of the object is transmitted to the server 3 via the Ethernet. Then, it returns to step S1 and repeats the said process.

  As described above, the upstream analysis device 2 performs image analysis processing for each image frame on the image captured by the camera 1 and transmits the analysis result to the server 3.

  Steps S <b> 11 to S <b> 13 in FIG. 2 indicate a processing procedure in the server 3.

  In step S11 of FIG. 2, the upstream analysis apparatus 2 is requested to transmit the analysis result. In step S12, the process proceeds to step S13 after receiving the analysis result from the pre-stage analysis apparatus 2. In step S13, a predetermined event recognition process (image analysis process) based on the received analysis result is executed. Then, it returns to step S11 and repeats the said procedure.

  Software for image analysis processing is installed in the server 3, and the recognition processing (step S13) is executed according to this software. In this process, for example, based on the positional relationship of the objects between the image frames, for example, the flow of a person is detected, and the presence or absence of a dangerous state is recognized.

  In the present embodiment, the analysis result obtained by the contour extraction process is transmitted from the upstream analysis device 2 to the server 3. This analysis result includes information necessary for image analysis processing in the server 3, but the amount of data is significantly smaller than the image data of the image captured by the camera 1. For this reason, the burden on communication can be reduced.

  In the present embodiment, the upstream analysis device 2 repeatedly performs contour extraction for each image frame. Such repetition of the same processing can be executed by a hardware device, and therefore the pre-analysis device 2 may be configured as a hardware device. Processing speed can be improved by hardware implementation.

  Moreover, the pre-analysis apparatus 2 can also be comprised using the function included in the camera 1, and a cost can be reduced in this case.

  The pre-analysis device 2 may be configured as a computer in which software for image analysis processing is installed.

A second embodiment of the image analysis system according to the present invention will be described below with reference to FIG.
FIG. 3 is a block diagram showing the configuration of the image analysis system of this embodiment. The same components as those in the first embodiment are denoted by the same reference numerals.

  As shown in FIG. 3, the image analysis system of the present embodiment includes four cameras 1 that capture moving image images that are independent from each other, and four previous-stage analyzes that perform image analysis based on the images captured by the camera 1. The apparatus 2 includes a server 31 that executes image analysis based on an analysis result obtained by the upstream analysis apparatus 2, and an image display device 4 that appropriately displays a result of image analysis performed by the server 31 and an image captured by the camera 1. As shown in FIG. 3, the upstream analysis device 2, the server 31, and the image display device 4 are communicably connected to each other via a common line 5 that can connect a plurality of devices, for example, Ethernet.

  The processing procedure in the image analysis system of the present embodiment is substantially the same as that of the first embodiment. However, the server 31 operates as four image analysis apparatuses that execute image analysis based on the respective analysis results obtained by the upstream analysis apparatus 2.

  According to the present embodiment, for example, a plurality of locations where the camera 1 is installed can be constantly monitored by one server 31. For example, when a plurality of cameras are installed on a platform of a station, a plurality of locations can be monitored simultaneously with a single server.

  In the present embodiment, the analysis result obtained by the contour extraction process is transmitted from the upstream analysis device 2 to the server 31. Since this analysis result has a data amount significantly smaller than the image data of the image captured by the camera 1, the communication burden can be reduced.

  Further, in this embodiment, image analysis based on the respective analysis results by the pre-stage analysis apparatus 2 is collectively performed by one server 31. For this reason, cost can be suppressed compared with the case where image analysis is performed by an independent device for each camera 1.

  A third embodiment of the image analysis system according to the present invention will be described below with reference to FIG.

  FIG. 4 is a block diagram showing the configuration of the image analysis system of this embodiment. The same components as those in the first embodiment are denoted by the same reference numerals.

  As shown in FIG. 4, the image analysis system of this embodiment includes a camera 1 that captures a moving image, a pre-analysis device 2 that performs image analysis based on the image captured by the camera 1, and an analysis by the pre-analysis device 2. A server 32 that executes image analysis based on the result, a server 33 that executes image analysis based on the analysis result of the upstream analysis device 2, an image display device 4 that displays the result of image analysis by the server 32 or the server 33, and the like, Is provided. As shown in FIG. 4, the upstream analysis device 2, the server 32, the server 33, and the image display device 4 are communicably connected to each other via a common line 5 that can connect a plurality of devices, for example, Ethernet.

  The processing procedure in the image analysis system of the present embodiment is substantially the same as that of the first embodiment. However, the server 32 and the server 33 execute different image analysis based on the same analysis result by the upstream analysis device 2. Each image analysis logic differs depending on the purpose of the image analysis. Note that the server 32, the server 33, or the image display device 4 may be provided with a function of determining the final analysis result based on the image analysis of both.

  Further, when executing a complicated image analysis, the processing load may be distributed to the server 32 and the server 33, and a substantially single image analysis may be executed by both servers.

  Conversely, a plurality of different processes based on the same analysis result may be executed in one server.

  According to the present embodiment, for example, it is possible to simultaneously monitor a plurality of events based on the same analysis result by the upstream analysis device 2. For example, the presence or absence of the occurrence of a dangerous state at the same location can be detected from a plurality of viewpoints.

  In the present embodiment, the analysis result obtained by the contour extraction process from the pre-stage analysis apparatus 2 is transmitted to the server 32 and the server 33. Since this analysis result has a data amount significantly smaller than the image data of the image captured by the camera 1, the communication burden can be reduced.

  The fourth embodiment of the image analysis system according to the present invention will be described below with reference to FIG.

  FIG. 5 is a block diagram showing the configuration of the image analysis system of this embodiment. The same components as those in the first embodiment are denoted by the same reference numerals.

  As shown in FIG. 5, the image analysis system according to the present embodiment includes four cameras 1 that capture independent moving images, and four previous-stage analyzes that respectively perform image analysis based on the images captured by the camera 1. Apparatus 2, server 34 that executes image analysis based on the analysis result of the pre-stage analysis apparatus 2, server 35 that executes another image analysis based on the analysis result of the pre-stage analysis apparatus 2, and image analysis by the server 34 or server 35 And an image display device 4 for displaying the results of the above. As shown in FIG. 5, the upstream analysis device 2, the server 34, the server 35, and the image display device 4 are communicably connected to each other via a common line 5 that can connect a plurality of devices, for example, Ethernet.

  The processing procedure in the image analysis system of the present embodiment is substantially the same as that of the first embodiment. However, the server 34 and the server 35 operate as image analysis apparatuses for four units that execute image analysis based on the respective analysis results obtained by the upstream analysis apparatus 2.

  In the present embodiment, the analysis result obtained by the contour extraction process from the upstream analysis device 2 is transmitted to the server 34 and the server 35. Since this analysis result has a data amount significantly smaller than the image data of the image captured by the camera 1, the communication burden can be reduced.

  Further, in this embodiment, image analysis based on the respective analysis results by the pre-stage analysis apparatus 2 is collectively performed by one server 34 and server 35. For this reason, cost can be suppressed compared with the case where image analysis is performed by an independent device for each camera 1.

  The scope of application of the present invention is not limited to the above embodiment. The present invention can be widely applied to an image analysis system that analyzes an image captured via a camera.

1 is a block diagram illustrating a configuration of an image analysis system according to a first embodiment. 3 is a flowchart illustrating a processing procedure in the image analysis system according to the first embodiment. FIG. 4 is a block diagram illustrating a configuration of an image analysis system according to a second embodiment. FIG. 10 is a block diagram illustrating a configuration of an image analysis system according to a third embodiment. FIG. 10 is a block diagram illustrating a configuration of an image analysis system according to a fourth embodiment.

Explanation of symbols

1 camera 2 pre-analysis device (pre-analysis means, transmission means)
3, 31, 32, 33, 34, 35 Server (second-stage analysis means)
5 Common line (communication line)

Claims (5)

In an image analysis system that analyzes images captured via a camera,
A camera to capture images,
A front analysis means for performing an image analysis based on the image captured by the camera,
Post-stage analysis means for performing image analysis based on the analysis result by the pre-stage analysis means;
Transmitting means for transmitting the analysis result by the pre-stage analysis means to the post-stage analysis means from the pre-stage analysis means via a common line capable of connecting a plurality of devices;
Equipped with a,
The pre-stage analysis unit performs the contour extraction process on the image frames constituting the image as the image analysis, and outputs the result of the contour extraction process as the analysis result,
The image analysis system according to claim 1, wherein the subsequent analysis unit executes image analysis based on a difference between image frames in the result of the contour extraction process . In an image analysis system that analyzes images captured via a camera,
A first camera and a second camera that respectively capture independent images;
A first front analysis means for performing an image analysis based on the image captured by the first camera,
A second front analysis means for performing an image analysis based on the image captured by the second camera,
Post-stage analysis means for performing image analysis based on the analysis result by the first pre-stage analysis means and the analysis result by the second pre-stage analysis means;
The analysis result from the first pre-analysis means and the analysis result from the second pre-analysis means are sent from the first pre-analysis means and the second pre-analysis means to the post-analysis means via a communication line. To each of the transmission means,
Equipped with a,
The first pre-stage analysis unit and the second pre-stage analysis unit each perform contour extraction processing on an image frame constituting the image as the image analysis, and the result of the contour extraction processing as the analysis result Output
The latter-stage analysis means performs image analysis based on a difference between image frames in the result of the contour extraction process,
The image analysis system according to claim 1, wherein the first pre-analysis unit, the second pre-analysis unit, and the post-analysis unit are configured by different computers . In an image analysis system that analyzes images captured via a camera,
A camera to capture images,
A front analysis means for performing an image analysis based on the image captured by the camera,
First post-stage analysis means for performing image analysis based on an analysis result by the pre-stage analysis means;
Second post-stage analysis means for performing image analysis based on the analysis result by the pre-stage analysis means;
Transmitting means for transmitting the analysis result by the pre-stage analysis means from the pre-stage analysis means to the first post-stage analysis means and the second post-stage analysis means via a communication line;
Equipped with a,
The pre-stage analysis unit performs the contour extraction process on the image frames constituting the image as the image analysis, and outputs the result of the contour extraction process as the analysis result,
The first latter analysis means and the second latter analysis means each perform image analysis based on a difference between image frames in the result of the contour extraction processing,
The image analysis system according to claim 1, wherein the pre-stage analysis unit, the first post-stage analysis unit, and the second post-stage analysis unit are configured by different computers . The image analysis system according to claim 2, wherein the communication line is a common line to which a plurality of devices can be connected. 5. The image analysis system according to claim 1, wherein the latter-stage analysis unit executes a process of analyzing a correlation between image frames in a result of the contour extraction process .

Images