JP2009302762A - Network camera system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problems wherein vibration-proofing processing discards a portion of image data especially when vibration-proofing algorithm like image segmentation vector vibration-proofing processing is adopted because image information before vibration-proofing processing is not stored in the conventional vibration-proofing processing, and discarding a portion of image data causes disadvantages when a detailed image analysis is later needed. <P>SOLUTION: In this network camera system, image information and blurring information which are not subjected to vibration-proofing processing are stored in an information storing part 105 in a server unit. Data is outputted from the information storing part 105 during reproduction, and a reproduction displaying part 111 displays image data subjected to vibration-proofing processing in a display part 112. For this purpose, data in which a portion of image data is not discarded by image segmentation vector vibration-proofing processing is always stored in the server. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a surveillance camera system that propagates photographing information via a network.

  2. Description of the Related Art Conventionally, a camera system in which a camera body is always installed on a wall or a pole, such as a surveillance camera, is subject to disturbances such as building vibrations and winds, and may cause blurring that greatly affects the captured image on the camera body.

For this reason, there is a technique in which a shake correction process is performed by a signal processing unit in the camera based on shake information acquired by a shake detection device such as a gyro sensor disposed in the camera body and image information acquired by the camera. (See Patent Document 1)
As the blur correction processing means, an image cutout image stabilization processing method or the like is often employed. The image cutout image stabilization processing method cuts out shooting information out of all image information acquired by an image sensor such as a CCD. And it is an electronic image stabilization system which reduces blurring by shifting the captured image information based on blur information acquired by an acceleration sensor such as a gyro sensor.

Then, the image subjected to the blur correction process is transmitted and stored to the server via the network, and is displayed on the playback device.
JP 2001-024934 A

  However, the image data stored in the information processing device storage unit is image information that has undergone image stabilization processing such as image cutout image stabilization processing, and there has been a problem that information is reduced as compared with image information before image stabilization processing.

  As a result, there is a problem that the resolution of the reproduced image deteriorates, and when the information is reduced to cut out the image and detailed image analysis is required later, it is disadvantageous to discard a part of the image data. Conceivable.

  Also, when image stabilization such as an image cutout method is performed in an environment where there is no blur information acquired from a gyro or the like, a highly accurate prevention effect may not be obtained. In addition, there are cases where it is difficult to separate panning and tilting operations from blurring.

  Further, performing the image stabilization process on the camera side is disadvantageous in terms of power consumption and the cost of the camera body.

  The image stabilization process is not performed on the camera side as in the prior art, and the image stabilization process is performed on the server side. An exemplary object of the present invention is to provide a network camera system that does not reduce or deteriorate image information stored in a server storage device by image stabilization processing on the camera side by the above method. Furthermore, since the image stabilization process can be performed using the image blur information acquired by the image blur detection apparatus, a higher image stabilization effect can be obtained compared to the image stabilization method such as the conventional image cutout method.

For this purpose, in the present invention,
Image information captured by the imaging device;
A network for transmitting the image information;
An information relay device having a function of transmitting and receiving the image information via the network, storing the image information by an internal storage means, and changing the image information;
A reproduction terminal having a function of instructing the information relay device to the relay device via the network, acquiring the image information, and further capable of reproducing and displaying;
In the network camera system including
Blur detection means for detecting blur information of the imaging device in the camera system;
An imaging information processing unit that processes the blur information and the image information into a suitable format;
The blur information is added to the imaging information by the imaging information processing unit,
Or delivered synchronously by the network,
By the information processing unit in the information relay device,
An object of the present invention is to achieve the object by realizing a network camera system having image processing means for performing suitable image processing based on the blur information and the image information.

In the present invention,
The information processing means includes
Image information whose blur information value is a predetermined value or less is extracted from the imaging information in the information relay device storage unit,
By realizing a network camera system characterized by creating a frame information group with less blur and storing and storing the frame information in the relay device storage unit or distributing it to a playback device via a network, It is intended to achieve the purpose.

In the present invention,
The information processing means in the information relay device storage unit is:
The number of frame images in a given period,
By realizing a network camera system having a function of generating a blur correction image group suitable as blur correction image information according to the blur information of a predetermined value or more, the above object is achieved. is there.

  As described above, in the network camera system, a gyro is mounted on the camera, and the camera-side image processing unit does not perform blur correction, and stores information in which the blur information and the image information are linked to the server storage unit. It is possible to always save the image before the image stabilization process in the storage device without degrading the information acquired by this method by the image stabilization process on the camera side.

  In the conventional method, the image data stored in the information processing device storage unit is image information subjected to image stabilization processing such as image cutout image stabilization processing, and there is a problem that information is reduced as compared with image information before image stabilization processing. there were.

  As a result, there is a problem that the resolution of the reproduced image deteriorates, and when the information is reduced to cut out the image and detailed image analysis is required later, it is disadvantageous to discard a part of the image data. Conceivable.

  In the case of the system of the present invention, the image before the image cutout image stabilization process is always saved in the server storage device, so that the above problem can be solved. Further, since the image before the prevention process is stored in the server, the prevention process can be turned ON / OFF at any timing after the image is stored using the image.

  Furthermore, since the image stabilization process can be performed using the image blur information acquired by the image blur detection apparatus, a higher image stabilization effect can be obtained compared to the image stabilization method such as the conventional image cutout method. Furthermore, it becomes easy to separate the camera pan and tilt operations from the blur.

  In addition, performing anti-vibration processing on the server is more advantageous than performing anti-vibration processing on the camera in terms of power consumption and the cost of the camera body.

  Next, details of the present invention will be described in accordance with the description of the embodiments.

  Hereinafter, embodiments of the present invention will be described in detail with reference to FIG.

  The network camera system includes a network camera 1, a network 2, a server unit 3, and a playback terminal 4.

  The network camera 1 acquires image data by the camera unit 102 under the control of the camera unit control unit 103.

  In addition, camera shake information and blur information are acquired by an acceleration sensor 104 such as a gyroscope. The blur information and the image data are transmitted to the information processing unit 105 such as a CPU through the camera unit control unit 103.

  The information processing unit 105 performs information processing including data compression such as JPEG, A / D, and D / A conversion.

  The processed blur information and image data are distributed to the network 2 via the network I / F 106.

  The server unit 3 receives image data and blur information distributed from the network 2 using the network I / F as an interface.

Each data is recorded in the information storage unit 108 via the server control unit.
The information storage unit is a large-scale storage device such as an HDD.

  As a method of sending blur information and image data, there is a method of sending to a network in a format in which blur information is incorporated in a JPEG header of image data. Further, image information and blur information may be incorporated into HTTP header information and sent.

  The reproduction display unit 104 receives data in the information storage unit 108 in the server unit 3 via the network 2 using the network I / F 110 as an interface.

  The information processing unit 113 in the server unit 3 receives a command from the reproduction control unit, performs suitable image processing based on the blur information and image information in the information storage unit, and transfers the image information to the reproduction terminal 4.

  The blur information and the image data are subjected to processing for reproduction display suitable for the situation in the reproduction display unit 111, for example, image cutout image stabilization processing and the like, and are displayed on a display unit such as a CRT.

  In a situation where a high-quality image is reproduced in real time, image data and blur information may be acquired directly from the network camera 1 without using the server unit 3.

  With the above processing, it is possible to always save the data stored in the information storage unit 108 without discarding part of the image data by the image cutout vector image stabilization processing.

  For this reason, it is possible to analyze a specific image in detail after storing the data, for example, based on a larger amount of image data than before. Works.

  FIG. 2 shows an embodiment in which blur is reduced in the reproduction display unit based on the image information and blur information stored in the server information storage unit 108.

  As shown in FIG. 2, the acquired camera shake information and image information stored at a rate by the acceleration sensor 104 such as a gyro are stored in the in-server information storage unit.

  The data is processed by the two types of data reproduction processing units 111 and displayed on the display unit 112.

  The processing method extracts only frames corresponding to blur information that is below a certain threshold.

  Then, by reproducing the extracted frame, it is possible to reproduce a moving image with less blur.

  The flowchart of FIG. 3 shows the flow of the algorithm. When performing the image stabilization reproduction processing of the same method, first, a blur amount threshold is set (S302). Conditional branching is performed at the set threshold (S303), and if the amount of blur is equal to or less than the threshold, only a frame linked to blur is adopted as a playback frame (S304). Then, the frame is reproduced (S305).

  On the other hand, if the blur amount is greater than or equal to the threshold, the frame to be linked is not adopted as an image (S306). After the determination work based on the blur amount described above, the processing is shifted to the next frame (S307).

  In addition, as described above, a frame whose blur information is equal to or lower than the threshold may not be used, and image cutout blur correction processing or the like may be performed.

  In this embodiment, an image acquired by an imaging sensor such as a CCD can be displayed without being cut out, and the data before the blur correction process is stored in the server even after the blur correction process. In the case of analyzing in detail, it becomes possible to analyze based on more image data than in the past, and it is advantageous when used in a surveillance camera system or the like.

  FIG. 4 shows an embodiment in which blurring is reduced in the reproduction display unit based on the image information and blur information stored in the server information storage unit 108.

  As shown in FIG. 4, camera shake information and image information stored at a rate by an acceleration sensor 104 such as a gyro are stored in the in-server information storage unit.

  The data is processed by the two types of data reproduction processing units 111 and displayed on the display unit 112.

  The processing method is divided into a frame corresponding to blur information below a certain threshold and other frames in a certain period. The blur correction process is performed when the number of extracted frames is greater than a certain value during a certain period, and is not performed otherwise.

  FIG. 5 shows details of the algorithm of the blur correction process. Set three parameters as algorithm settings. The blur information threshold Th (S502), the predetermined time T (S503), and the number of images N (S504). When the blur information value corresponding to the image is the threshold Th (S505), the counter Cn is incremented by 1 (S506). If the required time t after entering this algorithm is T or less (S507), the same processing is repeated. If the required time t is equal to or longer than T and the counter value Cn is equal to or larger than the number of images N set in S504, the blur correction is turned ON (S509). If the counter value Cn is equal to or smaller than the number of images N (S510), no blur correction process is performed (S510). After that, the counter Cn is cleared (S511), the current time t is cleared (S512), and the processes after S504 are repeated.

  By appropriately setting the predetermined period T, the threshold Th of the blur size for dividing the frame into two types, and the number N of images, it is possible to perform an image stabilization process suitable for the environment.

  As the blur correction processing means, for example, the center position of blur is detected, and characteristic pixels are set out of all image information acquired by an image sensor such as a CCD. An image frame with less blur is created by shifting the frame with reference to the pixel, overlaying, and performing image processing.

  The preferred embodiments of the present invention have been described above, but the present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the gist.

Overview of network camera system according to one embodiment of the present invention Example of extracting only frames with less blur and reducing blur in the playback display section Algorithm flow to reduce blur in the playback display Embodiment in which blur is reduced in the playback display unit based on image information and blur information stored in the information storage unit in the server Details of algorithm for blur correction processing

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Network camera 102 Camera part 103 Camera unit control part 104 Acceleration sensor 105 Imaging information processing part 106 Network I / F
107 Server control unit 108 Information storage unit 109 Network I / F
110 Network I / F
111 Playback Control Unit 112 Display Unit 113 Information Processing Unit

Claims (3)

Image information captured by the imaging device;
A network for transmitting the image information;
An information relay device having a function of transmitting and receiving the image information via the network, storing the image information by an internal storage means, and changing the image information;
A reproduction terminal having a function of instructing the information relay device to the relay device via the network, acquiring the image information, and further capable of reproducing and displaying;
In the network camera system including
Blur detection means for detecting blur information of the imaging device in the camera system;
An imaging information processing unit that processes the blur information and the image information into a suitable format;
The blur information is added to the imaging information by the imaging information processing unit,
Or delivered synchronously by the network,
By the information processing unit in the information relay device,
A network camera system comprising image processing means for performing suitable image processing based on the blur information and the image information. The information processing means includes
Image information whose blur information value is a predetermined value or less is extracted from the imaging information in the information relay device storage unit,
The network camera system according to claim 1, wherein a frame information group with less blur is created, and the frame information is stored / stored in the relay device storage unit or distributed to a playback device via a network. The information processing means in the information relay device storage unit is:
2. The network camera according to claim 1, wherein the network camera has a function of generating a blur correction image group suitable as blur correction image information in accordance with the number of frame images in a predetermined period and the blur information of a predetermined value or more. system.

Images