JP2001358984A - Moving picture processing camera - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving picture processing camera that is downsized at a low cost and can pick up an object with high accuracy at all times independently of a state of the object. SOLUTION: The moving picture processing camera is provided with a data processing section 20 that detects the state of an object based on a moving picture from an image sensor 10 and with a control means 11 that changes a frame rate denoting the number of frames per unit time outputted from the image sensor 10 based on the detection result by the data processing section 20.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image processing camera for picking up moving images, and more particularly to a technique for detecting a moving object with high accuracy.

[0002]

2. Description of the Related Art Conventionally, there has been known a camera which is installed at a fixed point and monitors a moving object within a viewing angle. This camera generates image data by photoelectrically converting light (image) input from an optical system by a solid-state imaging device, and outputs the image data at a standard frame rate of, for example, 30 frames / second.

As an example of a camera with a variable frame rate, Japanese Patent Laid-Open Publication No. Hei 10-341377 discloses "a driving apparatus for a solid-state image sensor, a method for detecting an image signal, and a camera using the same". I have. According to the technique disclosed in this publication, in the detection mode, the period of the vertical reset pulse can be set arbitrarily, and the reset period when the CCD image sensor is vertically transferred is set shorter than the field period. The vertical transfer of the CCD image sensor is driven at a high speed in some sections, and the frame rate is increased by detecting the imaging signal output from the CCD image sensor during the vertical transfer drive at the normal speed.

Japanese Patent Laid-Open Publication No. Hei 10-304250 discloses "a solid-state image sensor, a camera using the same, and a method for driving a solid-state image sensor". The solid-state imaging device disclosed in this publication can selectively take an all-pixel reading mode in which signal charges of all pixels are read out at the same time and a thinning-out reading mode in which signal charges are read out only from a part of a vertical pixel row. The solid-state imaging device includes: a solid-state imaging device; and a frequency varying unit that varies a driving frequency of the solid-state imaging device according to an operation mode. By operating in the thinning mode at the time of monitoring, the power consumption of the CCD solid-state imaging device is reduced while preventing a decrease in the frame rate.

[0005]

However, since the conventional camera uses a fixed standard frame rate of 30 frames / sec, when a moving object moving at a high speed is to be imaged, the moving object is taken. May not be captured. That is, when the moving body moves at a predetermined speed or less, the entire image of the moving body can be captured as shown in FIG. 9A.
As shown in (B), there is a case where only a part of it can be caught.

When an image of a moving object that moves at high speed is taken, the whole image can be captured by operating the image sensor at a high frame rate. However, if the image sensor is always operated at a high frame rate, power consumption is large. Operating costs increase. Further, when the power consumption increases, the amount of heat generated increases, so that it is difficult to reduce the size of the camera, and the camera becomes expensive.

In a camera having a constant frame rate, an exposure time for generating one frame of image data is constant. As a result, when the moving body is moving in darkness, the amount of exposure is insufficient, and there is a problem that the moving body cannot be captured.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problem, and an object of the present invention is to provide an inexpensive and miniaturized moving image processing camera capable of always capturing an object with high accuracy regardless of the state of the object. To provide.

[0009]

In order to achieve the above object, a moving image processing camera according to the present invention comprises: an image sensor for outputting a moving image obtained by imaging for each frame;
A data processing unit that detects a state of a subject based on a moving image from the image sensor; and a frame rate that represents the number of frames output per unit time from the image sensor based on a detection result of the data processing unit. Control means for changing.

According to this moving image processing camera, the frame rate is changed in accordance with the state of the subject detected based on the moving image from the image sensor, so that an image is taken at a frame rate suitable for the state of the subject. be able to.
As a result, the subject can always be imaged with high accuracy. Also, the frame rate varies according to the state of the subject and is not always high, so that the power consumption is reduced and the operating cost can be reduced. In addition, since power consumption is reduced, it is not necessary to take a special heat generation countermeasure, and it is possible to reduce the size and cost of the moving image camera.

In this moving image processing camera, the data processing section includes speed detecting means for detecting a moving speed of the moving object based on an image of the moving object included in the moving image from the image sensor, and a control means. Is configured to operate the image sensor at a standard frame rate when the moving speed of the moving object detected by the speed detecting means is equal to or lower than a predetermined value, and to operate the image sensor at a higher frame rate when the moving speed is higher than the predetermined value. it can.

In this case, the standard frame rate is
A frame rate of 30 frames / second commonly used in video cameras can be used. The speed detecting means may use a method of detecting the moving speed of the moving object from the difference value between the two moving images, a method of detecting the moving speed of the moving object using an optical flow, and the like. According to this configuration, the moving image processing camera normally operates at the standard frame rate, and operates at a high frame rate when a moving object that moves at high speed is detected. Can be detected.

In this moving image processing camera,
The data processing unit includes a brightness detection unit that detects the brightness of the moving object included in the moving image from the image sensor,
The control means is configured to operate the image sensor at a standard frame rate when the brightness detected by the brightness detection means is greater than a predetermined value, and to operate the image sensor at a lower frame rate when the brightness is equal to or less than the predetermined value. it can.

Also in this case, a frame rate of 30 frames / second, which is generally used in video cameras, can be used as the standard frame rate. The brightness detection means may use a method of detecting brightness by checking the average of the brightness levels of the entire moving image. According to this configuration, the moving image processing camera normally operates at a standard frame rate, and operates at a low frame rate when the brightness of the moving image is smaller than a predetermined value, for example, when capturing an image of a dark moving object. Therefore, a moving object that moves in the dark can be accurately detected.

In this moving image processing camera,
The data processing unit includes position detection means for detecting the position of the image of the moving object included in the moving image from the image sensor,
The control means can be configured to change the frame rate according to the position detected by the position detection means.

Generally, when a moving object is imaged by a camera,
The ratio of the moving speed of the moving object image on the obtained moving image to the actual moving speed of the moving object differs depending on the position of the moving object image on the moving image. Therefore, if the frame rate is constant, the moving object may not be imaged depending on the position of the moving object image on the moving image. However, according to this configuration, the moving image processing camera performs imaging while changing the frame rate according to the position of the moving object image on the moving image, so that the moving object can always be accurately imaged.

The moving image processing camera may further include a sensor for detecting a surrounding state, and the control unit may be configured to change a frame rate according to a detection result of the sensor.

As the above-mentioned sensor, an ultrasonic sensor, a sound sensor, a pyroelectric sensor or the like can be used. According to this configuration, the frame rate is changed according to the surrounding state detected by the sensor. Therefore, it is possible to detect a surrounding state that cannot be detected by processing a moving image from the image sensor, and the frame rate is changed according to the detection result. Can be accurately imaged. In addition, imaging can be performed while gradually changing the frame rate from low speed to high speed in response to the detection result from the sensor. According to this configuration, for example, a state occurs in which the sensor can be detected, but cannot be detected based on a moving image from the image sensor.
When the cause cannot be immediately determined, it is highly possible that the target can be imaged at a certain frame rate. Therefore, the target that cannot be imaged at the normal frame rate can be captured.

In this moving image processing camera,
The data processing unit further includes a compression unit that compresses the moving image from the image sensor, and can be configured to send the moving image compressed by the compression unit to the outside. According to this configuration, the data volume of the moving image transmitted from the moving image processing camera to the outside can be reduced, so that the communication amount can be reduced. As a result, moving images can be supplied to an external device in a short time,
The real-time property of an image processing system to which this moving image processing camera is applied can be improved.

Further, the moving image processing camera further includes a zoom control unit for controlling a zoom, wherein the control unit controls the image sensor as a standard when zoom-in is not instructed by the zoom control unit. It can be configured to operate at a frame rate and operate at a frame rate higher than the standard frame rate when zoom-up is instructed. According to this configuration, for example, when the zoom-up is instructed by detecting the moving object, for example, the moving object occupies a larger percentage in the moving image, so the moving speed of the moving object is apparently faster. Since the frame rate is changed to the high-speed frame rate simultaneously with the zoom-up, the entire image of the moving object can be accurately captured.

Further, the moving image processing camera further includes a pan / tilt control unit for controlling pan and tilt, and the pan / tilt control unit is configured to control the movement detected by the speed detecting means of the data processing unit. The pan and the tilt can be controlled so as to follow the moving body based on the speed.
According to this configuration, for example, when a moving object that moves at a high speed is detected, shooting is performed at a high frame rate while tracking the moving object, so that the moving object can be continuously tracked at an optimum speed.

Further, the moving image processing camera stores the moving image temporarily, compresses the moving image stored in the storing unit, and decompresses the compressed moving image read from the storing unit. Data compression / expansion means, wherein the data processing section compresses the moving image from the image sensor by the data compression / expansion means at a compression rate corresponding to a frame rate at that time, and stores the compressed image in the storage means. It can be configured to detect a subject based on a moving image stored and read from the storage means and expanded by the data compression / expansion means.

According to this configuration, when the moving image data is stored in the storage means, the moving image data is compressed and stored at a compression ratio corresponding to the frame rate. It is possible to avoid a situation in which the obtained moving image data becomes enormous and the storage means overflows.

[0024]

Embodiments of the present invention will be described below in detail with reference to the drawings.

(Embodiment 1) A moving image processing camera according to Embodiment 1 of the present invention is suitable for capturing an image of a moving object moving at high speed. The moving image processing camera detects a moving speed of the moving object based on an image of the moving object included in the moving image from the image sensor, and when the detected moving speed is equal to or less than a predetermined value, 30 image sensors are used. / S, and operates at a higher frame rate than the standard frame rate (hereinafter, referred to as “high-speed frame rate”) when the value is larger than a predetermined value.

FIG. 1 is a block diagram showing an electrical configuration of a moving image processing camera according to Embodiment 1 of the present invention.
This moving image processing camera is roughly composed of an optical system 1, a camera head 2, and an image processing unit 3.

Although the physical structure of this moving image processing camera is not shown, the camera head 2 and the image processing unit 3 are not shown.
Are arranged integrally or in close proximity. A conventional camera includes only a camera head and performs only imaging. Therefore, when controlling the camera based on the image captured by the conventional camera, it is necessary to separately prepare an image processing device and connect the image processing device and the camera. It was difficult to control the camera.

On the other hand, according to the structure of the first embodiment, since the camera head 2 and the image processing unit 3 are arranged integrally or close to each other, the camera head 2 and the image processing unit 3 are arranged on the basis of the result processed by the image processing unit 3. It is easy to control the camera head 2. In addition, with the above-described structure of being integrated or arranged in proximity, for example, image data is not sent to a subsequent computer, and only the coordinates and speed information of the detected moving object can be transmitted. As a result, the amount of communication can be reduced, so that it is easy to construct an image processing system including a plurality of cameras.

Although not shown, the optical system 1 is composed of optical elements such as a lens, a prism, and an optical filter. The optical system 1 forms an optical image of a subject on an image sensor 10 in a camera head 2.

The camera head 2 includes an image sensor 10,
It comprises a drive circuit 11 and an A / D converter 12.

The image sensor 10 comprises a CCD type device. The image sensor 10 is not limited to a CCD device, but may be a MOS device or another solid-state imaging device. The image sensor 10 is controlled by a drive signal from a drive circuit 11.

The drive circuit 11 generates a drive signal based on a frame rate signal from the data processing section 20 in the image processing section 3. This drive signal includes the image sensor 10
For example, a dot clock signal, a horizontal synchronizing signal (H
D), a vertical synchronization signal (VH), and the like.

The A / D converter 12 is provided with the image sensor 10
Is converted into a digital moving image signal. The digital moving image signal output from the A / D converter 12 is converted into moving image data by the image processing unit 3.
Supplied to

The image processing unit 3 includes a data processing unit 20, a memory 21, a D / A converter 22, a communication interface (I /
F) 23 and a central processing unit (CPU) 24.

The data processing unit 20 includes an FPGA, an ASI
C, a general-purpose CPU or the like. The data processing unit 20 calculates an optimal frame rate by processing moving image data sent from the A / D converter 12 in the camera head 2. The calculated frame rate is sent to the drive circuit 11 of the camera head 2 as a frame rate signal as described above. Details of the processing in the data processing unit 20 will be described later.

The memory 21 temporarily stores the moving image data sent from the A / D converter 12 under the control of the data processing unit 20. This memory 21 has a capacity capable of storing moving image data for several frames. Data processing unit 2
0 executes various processes on the moving image data stored in the memory 21. The memory 21 is also used for storing intermediate results and processing results during the processing in the data processing unit 20.

The D / A converter 22 converts the moving image data sent from the data processing unit 20 into an analog moving image signal. The analog moving image signal output from the D / A converter 22 is supplied to a monitor (not shown). The user can check the subject captured by the moving image processing camera by looking at the monitor. Note that the D / A converter 22 may be omitted, and the digital moving image signal may be sent to the outside as it is. In this case, a liquid crystal monitor operable in response to a digital moving image signal, a digital CRT, or the like can be used as the monitor.

The communication interface 23 sends the moving image data from the data processing unit 20 to a local area network (LAN). With this communication interface 23, this moving image processing camera can be connected to a LAN. Therefore, this moving image processing camera can be connected to a plurality of devices via a LAN, and is suitable for constructing an image processing system. The communication interface 23 is not limited to an interface for connecting to a LAN.
Various interfaces such as IEEE 1394, USB, and RS232C can be used.

The CPU 24 is connected to the data processing unit 20 by a bus 25. The CPU 24 executes image processing other than the processing performed by the data processing unit 20.
The CPU 24 is also used to give various operation commands (commands) to the data processing unit 20. The bus 25 is also connected to the communication interface 23 so that the result processed by the CPU 24 can be sent to the LAN via the communication interface 23.

Next, the operation when the moving image processing camera configured as described above captures an image of a moving body moving at high speed will be described. The operation described here is an example,
Of course, this moving image processing camera can also perform other imaging operations.

In a normal state, the drive circuit 11 generates a drive signal for operating the image sensor 10 at a standard frame rate, and supplies the drive signal to the image sensor 10. Thus, the image sensor 10 outputs an analog moving image signal for one frame every 1/30 second. This analog moving image signal is converted into a digital moving image signal by the A / D converter 12 and supplied to the data processing unit 20 in the image processing unit 3 as moving image data.

The data processing unit 20 sequentially stores the moving image data received from the A / D converter 12 in the memory 21. At this time, the moving image data received in a cycle of T = n · (1/30) (n is an integer of 2 or more) seconds is stored in the background image area of the memory 21 as a background image. The moving image data received at the timing is stored in the input image area of the memory 21 as an input image.

Next, the data processing section 20 executes a moving object detection process every time an input image is received from the A / D converter 12. In this moving object detection processing, first, the difference between the moving image data stored in the background image area of the memory 21 and the moving image data stored in the input image area at that time is calculated. By this calculation, as shown in FIG. 2, an image of the moving object newly appearing in the input image, which does not exist in the background image, is extracted.

Next, the distance on the moving image data between the moving object image extracted in the previous moving object detecting process in the same manner as described above and the moving object image extracted in the current moving object detecting process is calculated. You. Then, the actual moving speed of the moving object is obtained based on the calculated distance and the frame rate at that time.

Next, if the actual moving speed obtained as described above is equal to or less than the predetermined value, the data processing unit 20
Generates a frame rate signal corresponding to the standard frame rate and supplies it to the drive circuit 11. Therefore, if the camera is operating at the standard frame rate at that time, the frame rate is not changed.
Changed to standard frame rate. Thereafter, the moving image processing camera operates at the standard frame rate.

On the other hand, if the actual moving speed is higher than the predetermined value, the data processing section 20 generates a frame rate signal corresponding to the high frame rate and supplies it to the drive circuit 11. Therefore, if the camera is operating at the standard frame rate at that time, the frame rate is changed to the high frame rate. If the camera is operating at the high frame rate, the frame rate is not changed. Thereafter, the moving image processing camera operates at a high frame rate.

The data processing section 20 sequentially reads out the moving image data stored in the memory 21 and supplies the moving image data to the D / A converter 22 in parallel with the moving object detection processing.
The D / A converter 22 converts the moving image data into an analog moving image signal and supplies the analog moving image signal to a monitor (not shown). As a result, the user can see the image currently being shot by the moving image processing camera.

Further, the data processing section 20 sequentially reads out digital moving image data stored in the memory 21 and supplies it to the communication interface 23 in parallel with the moving object detection processing. The communication interface 23 sends the digital moving image data from the data processing unit 20 to a LAN (not shown). Thus, various devices connected to the LAN can capture a moving image captured by the moving image processing camera.

In the moving object detection processing described above, the actual moving speed of the moving object is detected from the difference between the background image and the input image. Utilizing a spatio-temporal gradient method or a collation method, the actual moving speed of the moving object can be detected.

According to the above configuration, the data processing unit 20
Detects the moving speed of the moving object based on the image of the moving object included in the moving image from the image sensor 10, and when the detection result is equal to or less than a predetermined value, operates the image sensor 10 at the standard frame rate, and If the value is larger than the value, it operates at a high frame rate. As a result, the moving image processing camera normally operates at a standard frame rate and operates at a high frame rate when a moving object moving at a high speed is detected, so that a moving object moving at a high speed can be accurately detected.

Next, a first modification of the moving image processing camera according to Embodiment 1 of the present invention will be described. The moving image processing camera according to the first modification is suitable for imaging a moving object in the dark. This moving image processing camera detects the brightness of the entire moving image from the image sensor, and operates at a standard frame rate of 30 frames / sec when the detected brightness is larger than a predetermined value. At times, it operates at a frame rate lower than the standard frame rate (hereinafter, this is referred to as “slow frame rate”).

The configuration of the moving image processing camera according to the first modified example is the same as that of the moving image processing camera according to the first embodiment shown in FIG. 1 except for the processing performed by the data processing unit 20 in the image processing unit 3. The configuration is the same as that of the image processing camera. Data processing unit 2
Details of the process at 0 will be described later.

Next, the operation when the moving image processing camera according to the first modification captures an image of a moving body moving in the dark will be described. In the following, only portions different from the operation of the moving image camera according to Embodiment 1 will be described.

In the moving image processing camera according to the first modification, a moving object is detected in the same manner as in the first embodiment. That is, in a normal state, the image sensor 10 outputs an analog moving image signal every 1/30 seconds. This analog moving image signal is converted into a digital moving image signal by the A / D converter 12 and supplied to the data processing unit 20 in the image processing unit 3 as moving image data.

The data processing section 20 sequentially stores the moving image data received from the A / D converter 12 in the memory 21. At this time, the moving image data received every T seconds is stored in the background image area of the memory 21 as a background image.
The moving image data received at a timing other than the second cycle is stored in the input image area of the memory 21 as an input image. Next, the data processing unit 20 executes the moving object detection processing every time the moving image data of the input image is received from the A / D converter 12, and extracts only the image of the moving object as in the first embodiment. I do.

Next, the brightness of the moving image is detected. The brightness of this video is determined by the average brightness level of the entire video,
That is, it can be detected by checking the average of the luminance data. Note that the brightness of the moving image may be configured to be separately provided with an illuminance sensor and detected using the illuminance sensor. If the brightness detected in this way is larger than the predetermined value, the data processing unit 20 generates a frame rate signal corresponding to the standard frame rate and supplies the frame rate signal to the drive circuit 11. Therefore, the frame rate is not changed if the apparatus is operating at the standard frame rate at that time, and is changed to the standard frame rate if the apparatus is operating at the low frame rate. Thereafter, the moving image processing camera operates at the standard frame rate.

On the other hand, if the detected brightness is equal to or less than the predetermined value, the data processing unit 20 generates a frame rate signal corresponding to the low-speed frame rate and supplies it to the drive circuit 11. Therefore, if the camera is operating at the standard frame rate at that time, the frame rate is changed to the low frame rate, and if the camera is operating at the low frame rate, the frame rate is not changed. Thereafter, the moving image processing camera operates at a low frame rate.

According to the above configuration, the data processing unit 20
Detects the brightness of a moving image from the image sensor 10, and operates the image sensor 10 at a standard frame rate when the detection result is larger than a predetermined value, and operates at a low frame rate when the detection result is smaller than the predetermined value. As a result, video processing cameras typically operate at standard frame rates,
In the case where a moving object in the dark is imaged, the moving object operates at a low frame rate, so that the moving object moving in the dark can be accurately detected.

Next, a second modification of the moving image processing camera according to Embodiment 1 of the present invention will be described. The moving image processing camera according to the second modification is suitable for capturing an image of a moving object that moves in a bright scene. This moving image processing camera
When the brightness of the moving image from the image sensor is smaller than a predetermined value, the operation is performed at a standard frame rate, and when the brightness is larger than the predetermined value, the operation is performed at a high frame rate. Here, the predetermined value is a value of luminance data obtained when the solid-state imaging device constituting the image sensor 10 is saturated (hereinafter, referred to as “saturation value”).

The configuration of the moving image processing camera according to the second modification example is the same as that of the moving image processing apparatus according to the first embodiment shown in FIG. 1 except for the processing executed by the data processing unit 20 in the image processing unit 3. The configuration is the same as that of the image processing camera. Data processing unit 2
Details of the process at 0 will be described later.

Next, the operation when the moving image processing camera according to the second modification captures an image of a dark moving object will be described.
In the following, only portions different from the operation of the moving image camera according to Embodiment 1 will be described.

In a normal state, the image sensor 10
An analog moving image signal is output every 1/30 second. This analog moving image signal is converted into a digital moving image signal by the A / D converter 12 and supplied to the data processing unit 20 in the image processing unit 3 as moving image data. The data processing unit 20
The moving image data received from the A / D converter 12 is sequentially stored in the memory 21.

Next, the data processing section 20 executes a saturation detection process each time moving image data is received from the A / D converter 12. That is, a plurality of pixels are extracted from the moving image data stored in the memory 21 and the ratio of pixels having luminance data equal to or higher than the saturation value is checked. If the ratio is smaller than the predetermined value, the data processing unit 20 generates a frame rate signal corresponding to the standard frame rate and supplies the frame rate signal to the drive circuit 11. Therefore, the frame rate is not changed if the apparatus is operating at the standard frame rate at that time, and is changed to the standard frame rate if the apparatus is operating at the high frame rate. Thereafter, the moving image processing camera operates at the standard frame rate.

On the other hand, if the above ratio is equal to or more than the predetermined value, the data processing unit 20 generates a frame rate signal corresponding to the high frame rate and supplies it to the drive circuit 11. Therefore, if the camera is operating at the standard frame rate at that time, the frame rate is changed to the high frame rate. If the camera is operating at the high frame rate, the frame rate is not changed. Thereafter, the moving image processing camera operates at a high frame rate.

According to the above configuration, the data processing unit 20
Detects the ratio of saturated pixels based on the moving image data from the image sensor 10, and if the ratio is equal to or less than a predetermined value, operates the image sensor 10 at the standard frame rate. Operate at a high frame rate. As a result, the moving image processing camera normally operates at a standard frame rate, and operates at a high frame rate when capturing an image of a moving object that moves in an extremely bright background such as a snow scene or outdoors in a fine weather. In addition, it is possible to prevent the whole captured image from becoming whitish, and it is possible to accurately detect a moving object.

In the first and second modified examples described above, the frame rate is changed according to the brightness of the moving image. However, regarding the overall sensitivity, in addition to the frame rate, the gain of the camera, Since factors such as iris, aperture, shutter speed, and the like are related, it is possible to configure to control not only the frame rate but also the brightness according to the brightness of the shooting target.

As described above, according to the moving image processing camera of the first embodiment, the frame rate is changed according to the state of the subject detected based on the moving image from the image sensor 10. In addition, it is possible to perform imaging at a frame rate suitable for the state of the subject. As a result, the subject can always be imaged with high accuracy. In addition, the frame rate varies according to the state of the subject and is not always high. Therefore, it is not necessary to take a special heat generation measure, and the moving image camera can be reduced in size and cost.

The moving image processing cameras according to the first and second modifications have been described as being configured by modifying the moving image processing camera according to the first embodiment. A moving image processing camera may be configured by combining the functions of the moving image processing cameras according to the first and second modifications with the moving image processing camera. According to this configuration, the condition for changing the frame rate increases, so that the moving image processing camera can be multifunctional.

(Embodiment 2) A moving image processing camera according to Embodiment 2 of the present invention
N is to compress the moving image data to be transmitted to N.

FIG. 3 is a block diagram showing an electrical configuration of a moving image processing camera according to Embodiment 2 of the present invention.
The moving image processing camera according to the second embodiment is configured by adding a data compression circuit 26 to the configuration shown in FIG.

The data compression circuit 26 includes a data processing unit 20
Compress the moving image data from Various well-known compression methods can be used. This data compression circuit 26
The moving image data compressed by the
And is sent to the LAN. Other configurations and operations are the same as those of the moving image processing camera according to Embodiment 1 described above.

According to the moving image processing camera of the second embodiment, the amount of data of the moving image transmitted to the outside can be reduced, so that the communication amount can be reduced. As a result, the moving image can be supplied to the external device in a short time, so that the real-time property of the image processing system to which the moving image processing camera is applied can be improved.

(Embodiment 3) The moving image processing camera according to Embodiment 3 of the present invention includes a sensor, detects a surrounding state with the sensor, and changes the frame rate according to the detection result.

FIG. 4 is a block diagram showing an electrical configuration of a moving image processing camera according to Embodiment 3 of the present invention.
The moving image processing camera according to the third embodiment is configured by adding a sensor 4 to the configuration shown in FIG.

As the sensor 4, an ultrasonic sensor, a sound sensor, a pyroelectric sensor or the like can be used. This sensor 4
Detects a moving object, a person, an abnormality, and the like. The detection signal from the sensor 4 is supplied to the data processing unit 20 and the CPU 24. The data processing unit 20 and the CPU 24 share processing in accordance with the type of the sensor 4 and the processing to be executed in response to a detection signal from the sensor 4. Note that the detection signal from the sensor 4 may be supplied to one of the data processing unit 20 and the CPU 24.

The data processing section 20 generates a frame rate signal in response to a detection signal from the sensor 4 or a signal sent from the sensor 4 via the CPU 24, and sends it to the drive circuit 11. The driving circuit 11 includes a data processing unit 20
A drive signal is generated based on the frame rate signal from the image sensor and sent to the image sensor 10. Thereby, the image sensor 10 operates at a frame rate corresponding to the detection signal from the sensor 4.

Further, when a detection signal is obtained from the sensor 4, imaging can be performed while gradually changing the frame rate from a low speed to a high speed. According to this configuration, for example, when a state occurs in which the sensor 4 can detect but cannot be detected based on the moving image from the image sensor 10 and the cause cannot be immediately determined, a certain frame rate is set. There is a high possibility that the target can be imaged. As a result, there is an advantage that a target that cannot be imaged at a normal frame rate can be captured.

According to the moving image processing camera of the third embodiment, the frame rate is changed in accordance with the surrounding state detected by the sensor 4. Therefore, by setting the low frame rate according to the detection signal from the sensor 4,
By detecting an object that requires sensitivity or by setting a high frame rate, a moving object that moves at a high speed that cannot be captured normally can be imaged. In addition, since the surrounding state that cannot be detected by processing the moving image from the image sensor 10 can be detected and the frame rate can be changed, the moving body can be accurately imaged according to various surrounding states.

(Embodiment 4) A moving image processing camera according to Embodiment 4 of the present invention detects the position of an image of a moving object in a captured moving image, and sets a frame rate in accordance with the detection result. To change.

Generally, when a moving object is imaged by a camera,
The ratio of the moving speed of the moving object image on the obtained moving image to the actual moving speed of the moving object differs depending on the position of the moving object image on the moving image. For example, as shown in FIG. 5, when the camera is installed so as to capture an image obliquely downward, the moving speed on the moving image at point A is slow but B In terms of speed. Therefore, if the frame rate is constant, the moving object may not be able to be imaged depending on the position (for example, point B) of the moving object image on the moving image.

The configuration of the moving image processing camera according to the fourth embodiment of the present invention is the same as that of the first embodiment shown in FIG. 1 except for the processing executed by the data processing unit 20 in the image processing unit 3.
Is the same as that of the moving image processing camera according to the first embodiment. Details of the processing in the data processing unit 20 will be described later.

Next, the operation when the moving image processing camera according to the fourth embodiment captures an image will be described. In the following, only portions different from the operation of the moving image camera according to Embodiment 1 will be described.

In a normal state, the image sensor 10
An analog moving image signal is output every 1/30 second. This analog moving image signal is converted into a digital moving image signal by the A / D converter 12 and supplied to the data processing unit 20 in the image processing unit 3 as moving image data. The data processing unit 20
The moving image data received from the A / D converter 12 is sequentially stored in the memory 21.

Next, each time the data processing unit 20 receives the moving image data from the A / D converter 12, the first embodiment
The moving object detection processing similar to that described above is executed. Then, when a moving object is detected, a position detection process is performed. In this position detection processing, the position of the detected moving body on the moving image is calculated.

Next, a frame rate signal corresponding to the calculated position is generated. The relationship between the position of the image of the moving object on the moving image and the frame rate can be stored in a table in advance. In this table, for example, in the example shown in FIG. 5, data is stored such that the frame rate gradually increases as the moving body moves from point A to point B. The data processing unit 20 generates a frame rate signal corresponding to the position of the image of the moving object on the moving image by referring to the table, and supplies the frame rate signal to the driving circuit 11.

Instead of storing the relationship between the position of the image of the moving object on the moving image and the frame rate in a table, the velocity vector at the position of the image of the moving object on the moving image is processed by image processing. It is also possible to configure so as to sequentially calculate and set a frame rate according to the calculated speed vector. According to this configuration, there is an advantage that there is no need to provide a table.

According to the moving image processing camera of the fourth embodiment, imaging is performed while changing the frame rate in accordance with the position of the moving object image on the moving image. The body can always be imaged with high accuracy. Further, since the image at the front (point B) is an image with a shorter distance, it can be used for more complicated identification processing at a later stage. Therefore,
There is a merit of imaging a large number.

(Embodiment 5) A moving image processing camera according to Embodiment 5 of the present invention includes a zoom mechanism, and changes a frame rate in synchronization with zoom-up and zoom-down operations. Since the structure of the zoom mechanism is well known, illustration and description are omitted.

FIG. 6 shows the configuration of the moving image processing camera according to the fifth embodiment. This moving image processing camera has the same configuration as that shown in FIG. 1 except that a zoom control unit 13 is added to the camera head 2.

The zoom control section 13 operates in response to a zoom up / down signal from the data processing section 20, and drives a zoom mechanism (not shown) included in the optical system 1.

When receiving a signal for instructing zoom-up from a switch or a LAN (not shown) via the communication interface 23, the data processing unit 20 sends a zoom-up signal to the drive circuit 11 and the zoom control unit 13. Accordingly, the drive circuit 11 operates the image sensor 10 at a high frame rate. The zoom control unit 13 drives the zoom mechanism to perform a zoom-up operation.

On the other hand, when the data processing unit 20 receives a signal to instruct zoom-down from the switch or the LAN (not shown) via the communication interface 23, the data processing unit 20
1 and a zoom-down signal to the zoom control unit 13. Thereby, the drive circuit 11 operates the image sensor 10 at the standard frame rate. Also, the zoom control unit 13
Drives the zoom mechanism to perform a zoom-down operation.

According to the moving image processing camera of the fifth embodiment, a moving object is detected without zooming up at first. In this case, since the angle of view can be widened, a wide range of monitoring is possible. On the other hand, when a moving object is detected, the zoom-in is performed. As a result, the moving object occupies a larger proportion in the moving image, so that the moving speed of the moving object apparently increases. However, since the frame rate is changed to the high-speed frame rate at the same time as the zoom-up, the entire image of the moving object can be accurately captured.

In the above-described configuration, the zoom-up or zoom-down instruction is performed in response to a signal sent from the switch or the LAN via the communication interface 23. However, a moving object is detected. It is also possible to have a configuration in which the zoom-in is performed automatically at times, and the zoom-down is performed when the moving object disappears from the screen. According to this configuration, the moving body can be automatically imaged without any trouble.

(Embodiment 6) A moving image processing camera according to Embodiment 6 of the present invention includes a pan mechanism and a tilt mechanism so that a moving object can be tracked. In addition,
Since the structures of the pan mechanism and the tilt mechanism are well known, their illustration and description are omitted.

FIG. 7 shows the configuration of a moving image processing camera according to the sixth embodiment. This moving image processing camera has the same configuration as that shown in FIG. 1 except that a pan / tilt control unit 14 is added to the camera head 2.

The pan / tilt control section 14 operates in response to a pan control signal and a tilt control signal from the data processing section 20, and drives a pan mechanism and a tilt mechanism (not shown).

When detecting the moving body as described in the first embodiment, the data processing section 20 detects the moving speed and the moving direction. The moving direction can be detected using, for example, a moving vector. Then, similarly to the first embodiment, the frame rate is changed based on the detected moving speed. Further, a pan / tilt control signal for controlling pan and tilt based on the detected moving direction is generated and sent to the pan / tilt control unit 14. As a result, the pan / tilt control unit 14 drives a pan mechanism and a tilt mechanism (not shown), and pans / moves the moving image processing camera.
Rotate up, down, left, and right by the angle specified by the tilt control signal.

According to the moving image processing camera of the sixth embodiment, for example, when a moving object moving at a high speed is detected, shooting is performed at a high frame rate while tracking the moving object. Can be continuously tracked at an optimum speed.

In the above-described configuration, the pan and tilt are instructed when the data processing unit 20 detects the moving object. However, the signals transmitted from the switch or LAN via the communication interface 23 are transmitted. And instructs pan and tilt in response to the instruction. According to this configuration, since pan and tilt can be controlled manually or from an external device, the application range of the moving image processing camera is expanded.

(Embodiment 7) A moving image processing camera according to Embodiment 7 of the present invention compresses moving image data obtained from an image sensor when storing it in a memory and decompresses it when reading it. Things.

FIG. 7 shows the configuration of a moving image processing camera according to the seventh embodiment. This moving image processing camera has the same configuration as that shown in FIG. 1 except that a data compression / decompression circuit 27 is added to the image processing unit 3.

The data compression / decompression circuit 27 compresses the moving picture data from the data processing section 20 and stores it in the memory 21. Further, the data compression / decompression circuit 27
The compressed moving image data stored in the file is expanded and supplied to the data processing unit 20. This data compression / decompression circuit 27
, A signal representing the frame rate is input from the data processing unit 20. This data compression / decompression circuit 27
The signal is compressed at a compression rate according to the signal indicating the frame rate from the data processing unit 20, that is, the frame rate set at that time.

According to the moving image processing camera of the seventh embodiment, when storing moving image data in the memory 21, the moving image data is compressed and stored at a compression rate corresponding to the frame rate. Is set, it is possible to avoid a situation in which the amount of moving image data obtained from the image sensor 10 becomes enormous and the memory 21 overflows.

In each of the embodiments described above, a case has been described where the present invention is applied mainly to an application in which a moving object is detected and the frame rate is changed. However, the present invention can also be applied to the following monitoring apparatus. In this monitoring apparatus, a background image previously captured and stored in the memory 21 is constantly compared with a moving image obtained in real time by imaging, and when a different portion exists, it is determined that an abnormality has occurred. According to this configuration, it is possible to detect abnormalities such as generation of smoke, water leakage and oil leakage in the plant.
It is also possible to detect a tool or the like being left behind on a factory or railway track.

[0106]

As described in detail above, according to the present invention,
It is possible to provide an inexpensive and downsized moving image processing camera that can always accurately image a subject regardless of the state of the subject.

More specifically, according to the moving image processing camera of the present invention, the frame rate is changed in accordance with the state of the subject detected based on the moving image from the image sensor, so that it is suitable for the state of the subject. Imaging can be performed at a different frame rate. As a result, the subject can always be imaged with high accuracy. In addition, the frame rate varies according to the state of the subject and is not always high. Therefore, it is not necessary to take a special heat generation measure, and the moving image camera can be reduced in size and cost.

According to the moving image processing camera of the present invention, the moving speed of the moving object is detected based on the image of the moving object included in the moving image from the image sensor. When the speed is below the predetermined value, the camera operates at the standard frame rate. When the speed is higher than the predetermined value, the camera operates at a higher frame rate than the standard frame rate.

Further, according to the moving image processing camera of the present invention, the camera normally operates at the standard frame rate, and when the brightness of the moving image is smaller than a predetermined value, for example, when a dark moving object is imaged. Since the camera operates at a low frame rate, a moving object that moves in the dark can be accurately detected.

Further, according to the moving image processing camera of the present invention, since the imaging is performed while changing the frame rate according to the position of the moving object image on the moving image, the moving object can always be imaged with high accuracy.

Further, according to the moving image processing camera of the present invention, since the frame rate is changed according to the surrounding state detected by the sensor, it cannot be detected by processing the moving image from the image sensor. The surrounding state can also be detected, and the moving body can be accurately imaged according to various surrounding states.

Further, according to the moving image processing camera of the present invention, the moving image from the image sensor is compressed and transmitted to the outside, so that the data capacity of the moving image is reduced and the communication amount can be reduced. As a result, the moving image can be supplied to the external device in a short time, so that the real-time property of the image processing system to which the moving image processing camera is applied can be improved.

According to this moving image processing camera, for example, when the zoom-up is instructed by detecting the moving object, the moving object occupies a large proportion in the moving image. Although the moving speed increases apparently, the frame rate is changed to the high frame rate at the same time as the zoom-up, so that the entire image of the moving object can be accurately captured.

According to this moving image processing camera, for example, when a moving object moving at a high speed is detected, shooting is performed at a high frame rate while tracking the moving object. You can track at optimal speed.

Further, according to this moving image processing camera, when moving image data is stored in the storage means, the moving image data is compressed and stored at a compression rate corresponding to the frame rate, so that, for example, a high frame rate is set. Thus, it is possible to avoid a situation in which the amount of moving image data obtained from the image sensor becomes enormous and the storage unit overflows.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an electrical configuration of a moving image processing camera according to Embodiment 1 of the present invention.

FIG. 2 is a diagram for explaining an operation of the moving image processing camera shown in FIG. 1;

FIG. 3 is a block diagram showing an electrical configuration of a moving image processing camera according to Embodiment 2 of the present invention.

FIG. 4 is a block diagram showing an electrical configuration of a moving image processing camera according to Embodiment 3 of the present invention.

FIG. 5 is a diagram for explaining an operation of a moving image processing camera according to Embodiment 4 of the present invention.

FIG. 6 is a diagram showing a configuration of a moving image processing camera according to Embodiment 5 of the present invention.

FIG. 7 is a diagram showing a configuration of a moving image processing camera according to Embodiment 6 of the present invention.

FIG. 8 is a diagram showing a configuration of a moving image processing camera according to Embodiment 7 of the present invention.

FIG. 9 is a diagram for explaining a conventional camera.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Optical system 2 Camera head 3 Image processing unit 4 Sensor 10 Image sensor 11 Drive circuit 12 A / D converter 13 Zoom control unit 14 Pan / tilt control unit 20 Data processing unit 21 Memory 22 D / A converter 23 Communication interface 24 CPU 25 bus 26 data compression circuit 27 data compression / decompression

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) H04N 7/24 H04N 7/13 Z F term (reference) 5C022 AA14 AB63 AB64 AB66 AC27 AC42 AC69 AC78 5C024 CX37 CX41 CX51 CX66 CX67 CY45 EX13 GY01 GZ32 HX22 HX58 JX35 5C059 KK33 NN01 PP04 SS06 SS14 TB04 TC37 UA02

Claims (9)

[Claims] An image sensor for outputting a moving image obtained by imaging for each frame, a data processing unit for detecting a state of a subject based on the moving image from the image sensor, and a detection by the data processing unit Control means for changing a frame rate indicating the number of frames output per unit time from the image sensor based on the result. 2. The data processing unit includes: a speed detecting unit configured to detect a moving speed of the moving object based on an image of the moving object included in a moving image from the image sensor. When the moving speed of the moving object detected by the speed detecting means is equal to or lower than a predetermined value, the image sensor is operated at a standard frame rate, and when the moving speed is higher than the predetermined value, the image sensor is operated at a higher frame rate than the standard frame rate. Item 10. The moving image processing camera according to Item 1. 3. The data processing unit includes: a brightness detection unit that detects a brightness of a moving image from the image sensor; and the control unit determines that the brightness detected by the brightness detection unit is a predetermined value. The moving image processing camera according to claim 1, wherein the image sensor is operated at a standard frame rate when the value is larger than the predetermined value, and is operated at a lower frame rate when the value is equal to or less than the predetermined value. 4. The data processing unit includes: a position detecting unit that detects a position of an image of a moving object included in a moving image from the image sensor; and the control unit detects the position of the moving object. The moving image processing camera according to claim 1, wherein the frame rate is changed according to the position. 5. The moving image processing camera according to claim 1, further comprising a sensor that detects a surrounding state, wherein the control unit changes a frame rate according to a detection result of the sensor. 6. The data processing unit according to claim 1, further comprising a compression unit configured to compress a moving image from the image sensor, and transmitting the moving image compressed by the compression unit to the outside. The moving image processing camera according to the paragraph. 7. A zoom control unit for controlling a zoom,
The control unit operates the image sensor at a standard frame rate when zoom-in is not instructed by the zoom control unit, and when the zoom-up is instructed, the frame is higher than the standard frame rate. The moving image processing camera according to claim 1, wherein the camera operates at a rate. 8. A pan / tilt control unit for controlling pan and tilt, wherein the pan / tilt control unit is configured to control the moving object based on a moving speed detected by the speed detecting means of the data processing unit. The moving image processing camera according to claim 2, wherein the panning and the tilting are controlled so as to follow the moving image. 9. A storage means for temporarily storing a moving image, and a data compression / compression means for compressing the moving image stored in the storage means and expanding the compressed moving image read from the storage means.
Decompression means, and the data processing unit compresses the moving image from the image sensor by the data compression / decompression means at a compression rate according to a frame rate at that time, and stores the compressed image in the storage means. 9. The moving image processing camera according to claim 1, wherein a subject is detected based on a moving image read from the storage unit and expanded by the data compression / expansion unit.