JP2006148557A - Automatic imaging apparatus and program for controlling the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an automatic imaging apparatus capable of detecting a change in an object without requiring an additional device, and capable of detecting and photographing a moving object and a control program to be integrated into a control device for the automatic imaging apparatus. <P>SOLUTION: A detection area for detecting a moving object and a detection condition for defining a reference image are set (step S1), detection quantity to be a threshold is set (step S2), and the number of images to be photographed is set as an end condition (step S3). Then a moving object detection/photographing is started (step S4). An image displayed on a display unit is photographed in each certain time (step S5), conversion quantity is calculated by the mean square of respective color information included in pixels of the image (step S6), whether the conversion quantity is larger than the detection quantity set in the step S2 or not is judged (step S7), and when the conversion quantity is larger, the moving object is detected and its image is photographed (step S8). When images for the set number of images are photographed, the moving object detection/photographing is allowed to end (step S9). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image pickup apparatus such as a digital camera, a video camera, or a CCTV (Closed Circuit TV) for taking an image, and particularly detects a moving subject and automatically takes a picture in response thereto. The present invention relates to an automatic imaging device to be performed and a control program incorporated in a control device (computer) of the automatic imaging device.

  Conventionally, in so-called nature photography in which wild animals are photographed, it is possible to efficiently photograph by detecting the presence of a moving animal and photographing accordingly. In order to realize this, for example, when two infrared detection sensors are arranged facing each other and connected to a shutter circuit of a digital camera or a video camera, and an animal passes between the infrared sensors, one infrared detection sensor By detecting that the animal has passed between the infrared sensors by the other infrared detection sensor not receiving (blocking) the emitted infrared light, and opening the shutter accordingly for a predetermined time. , Taking pictures of the animals.

  Further, in a digital camera, a still image is taken every certain time (for example, 1 second) by a function called time-lapse photography. The CCTV used as a surveillance camera has a time-lapse shooting function that takes a still image every predetermined time (for example, 1 second) in parallel with continuous image shooting. For example, by taking a chronological image of the molting of a moth or by taking a still image at a certain time in a store, a high-resolution still image can be obtained as compared with images continuously taken by CCTV. Images can be obtained at regular intervals, and detailed information on the object to be monitored (eg, a bag to be peeled off, a person entering and exiting a store, etc.) can be obtained.

  However, as described above, when an infrared sensor is connected to the shutter circuit of a digital camera to detect a moving object and shoot, there is a problem that an infrared sensor must be prepared in addition to the digital camera. Further, in the CCTV described above, since still images are taken at regular intervals, the target changes at the timing when the shooting is performed (hereinafter, “shooting and changes in the target are synchronized”). The following inconvenience occurs. In other words, when taking a picture of an unhulled moth, the molting itself is completed in a short time, so that the molting proceeds, and at the timing when many still images should be taken at fine time intervals, The number of images cannot be increased, the same still images are taken continuously, the situation where the object is changing cannot be taken, and there is a problem that it may not be possible to detect and shoot moving objects. It was. As a surveillance camera, for example, for a person who has entered a store, it is necessary to take a high-definition still image when the person enters the store and obtain detailed information about the person. However, in the above-mentioned CCTV, even if there is no change (whether or not a person enters the store), still images are taken at regular intervals. There is a problem in that it is impossible to shoot the changing state, and therefore it may not be possible to detect and shoot a moving object.

  The present invention has been made in view of the above circumstances, and its purpose is to detect a change in an object without using an additional device, thereby detecting a moving object and photographing it. It is an object of the present invention to provide an automatic imaging apparatus that can be used and a control program incorporated in the control apparatus of the automatic imaging apparatus.

In order to achieve the above object, the present invention proposes the following means.
According to a first aspect of the present invention, there is provided an imaging means for obtaining imaging data by converting an optical image into an electrical signal, a sampling means for sampling imaging data obtained from the imaging means at a predetermined time interval, and the sampling And a calculation unit that calculates a shift amount based on the captured image data, and a control unit that stores the captured data in the captured data storage unit when the shift amount exceeds a threshold value.
According to the present invention, when the amount of change of the imaging data is calculated by the arithmetic means, and the amount of change exceeds the threshold value, and the change of the imaging data exceeds the threshold value, the imaging data is stored in the imaging data storage means by the control means. Is remembered.

The invention according to claim 2 is the automatic imaging apparatus according to claim 1, wherein at least one of the region for calculating the shift amount, the predetermined time interval, or the threshold is required. According to the present invention, there is provided a calculation condition changing means for changing in response.
According to the present invention, the calculation condition changing means needs at least one of the region for calculating the shift amount, the time interval at which the reference image is taken, or the threshold value of the shift amount according to the subject. Change according to.

The invention according to claim 3 is the automatic imaging apparatus according to claim 1 or 2, wherein pixels of the imaging data for obtaining the shift amount by the calculating means are set at predetermined intervals. Subsampling means for thinning out is provided.
According to the present invention, the sub-sampling means thins out the pixels of the respective imaging data at predetermined intervals, thereby reducing the data amount for calculating the shift amount and reducing the amount of computation performed by the computing means.

The invention according to claim 4 is the automatic image pickup apparatus according to claim 1 or 2, wherein the color information of the pixels of the image data for obtaining the shift amount by the calculating means is obtained. Subsampling means for extracting a part is provided.
According to the present invention, the sub-sampling unit extracts part of the color information held by the pixels of the respective imaging data, thereby reducing the amount of data for calculating the shift amount and reducing the amount of calculation performed by the calculation unit. The

According to a fifth aspect of the present invention, there is provided a computer for controlling an automatic image pickup apparatus, comprising: an image pickup unit that obtains image pickup data by converting an optical image into an electrical signal; and an image pickup data storage unit that stores the image pickup data as necessary. The imaging means converts an optical image into an electrical signal to obtain imaging data, the imaging data obtained from the imaging means is sampled at a predetermined time interval, and the sampled imaging data. There is provided a control program for an automatic imaging apparatus for executing a step of calculating a shift amount and a step of storing the imaging data in an imaging data storage means when the shift amount exceeds a threshold value.
According to the present invention, the amount of change of the imaging data is calculated, and when the amount of change exceeds the threshold and the change of the imaging data exceeds the threshold, the imaging data is stored in the imaging data storage means.

  According to the invention according to any one of claims 1 and 5, for example, it is obtained from the imaging means by a component equivalent to that of a conventional digital camera without separately providing an external device such as an infrared sensor. There is an effect that a moving object can be detected and photographed by the shift amount calculated from the obtained imaging data.

  According to the second aspect of the present invention, since the moving object detection condition can be changed according to the subject, there is an effect that the moving object detection photographing can be performed in accordance with the actual situation such as the size of the subject and how to move.

  According to the invention according to claim 3 or 4, the amount of data for calculating the shift amount is reduced, thereby reducing the calculation amount of the shift amount, simplifying the processing, and There is an effect that the cost can be reduced.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration of a digital camera, which is an example of an automatic imaging apparatus according to the present embodiment. In this figure, a digital camera includes an OPS (OPtical System) 1, an OEC (OptoElectric Converter) 2 (hereinafter, imaging means), a CDS-ADC (Correlated Double Sampler-Analog Digital Converter) 3 (sampling means), a timing, Circuit 4, DSP (Digital Signal Processor) 5, DRAM (Dynamic Random Access Memory) 6, EEPROM (Electronically Erasable and Programmable Read Only Memory) 7, memory card I / F (InterFace) 8 (imaging data storage means) ), CPU (Central Processing Unit) 9 (calculation means) (control means) (calculation condition changing means) (subsampling means), lens driving unit 10, flash control unit 11, flash 12, and operation unit 13 (Calculation condition changing means), display control unit 14, display unit 15 as a finder, microphone 16, and ADC (Analog Digit) al Converter) 17, encoder 18, decoder 19, DAC (Digital Analog Converter) 20, and speaker 21. The configuration of the digital camera described above is the same as that of a conventional digital camera.

  The OPS 1 is a lens barrel that holds a lens or a lens unit that includes a plurality of lenses. The OEC 2 is a photoelectric converter including a CCD (Charge Coupled Device) or C-MOS (Complementary-Metal Oxide Semiconductor) element, and is input from the OPS 1 in synchronization with the timing signal input from the timing circuit 4. Convert optical signals into electrical signals. The CDS-ADC 3 includes a sampler that samples an image signal (electrical signal) input from the OEC 2 in synchronization with a timing signal (for example, a 1/15 second or 1/30 second period) input from the timing circuit 4, and the sampler. A digital image signal converted from the AD converter to the DSP 5 is output from the AD converter. The DSP 5 outputs a trigger signal to the timing circuit 4.

  The memory card I / F 8 is detachably mounted with a memory card (not shown), and the DSP 5 performs digital signal processing on the digital image signal input from the CDS-ADC 3, and the signal-processed digital image signal is temporarily stored in the DRAM 6. Let The CPU 9 reads the digital image signal via the DSP 5 and causes the display unit 15 to display an image corresponding to the digital image signal via the display control unit 14. When a new digital image signal is output from the DSP 5, the digital image signal temporarily stored in the DRAM 6 is overwritten by the new digital image signal.

  Further, the DSP 5 converts the digital image data subjected to the digital signal processing based on an instruction from the CPU 9 to the memory card (imaging data storage unit) attached to the memory card I / F 8 via the memory card I / F 8. Write to. The EEPROM 7 stores the operation parameters of the DSP 5 in a rewritable manner. The DRAM 6 temporarily stores data used when the DSP 5 executes the control program and the digital image data as described above.

  The CPU 9 controls each unit as follows according to an instruction from the operation unit 13. That is, the CPU 9 outputs an operation instruction to the DSP 5 and inputs a flash lighting request signal from the DSP 5. Further, the CPU 9 outputs a lens driving instruction to the lens driving unit 10, drives the flash 12 via the flash control unit 11, and displays display contents such as an operation state on the display unit 15 via the display control unit 14. Is displayed.

  A microphone 16 provided in the digital camera outputs an audio signal to the ADC 17, a signal AD-converted in the ADC 17 is input to the encoder 18, and a signal encoded from the encoder 18 is input to the CPU 9. The CPU 9 writes the signal to the memory card via the DSP 5 and the memory card I / F 8. Further, the CPU 9 reads the encoded audio signal written in the memory card via the memory card I / F 8 and the DSP 5. The CPU 9 outputs the encoded signal to the decoder 19, and the decoder 19 decodes the signal. The DAC 20 performs DA conversion on the decoded signal and outputs it to the speaker 21. The speaker 21 sounds based on the audio signal output from the DAC 20.

  Next, an outline of the operation of the automatic image pickup apparatus including a digital camera, a video camera, or a CCTV in this embodiment will be described. The basic idea of the automatic imaging apparatus according to the present embodiment is based on an image photographed by the OEC 2 at a certain time as a reference and is in a predetermined region compared with an image photographed at a time different from the time. When a certain amount of change (amount of change) is observed, a moving object is detected, an image of the moving object is taken, and stored in a memory card. Note that, as described above, a part or all of the imaging area of the OEC 2 is selected as necessary. In the digital camera, the above-described processing is performed by a control program incorporated in the CPU 9 shown in FIG. In a video camera or CCTV, the above-described processing is performed by a control program incorporated in a control unit that controls the apparatus.

Next, the method for calculating the above-described shift amount will be described.
First, let the current image and the previous image be an image Atn and an image Aref, respectively. Here, tn is a subscript indicating the order of the images in time series, and becomes t1, t2,. ref is a subscript indicating the time-series order of the reference image and is t0.

  Further, the image Atn and the image Aref are all the imaging areas of the OEC 2, and the images in a part of the areas are set as the image atn and the image aref. The image atn and the image aref have, for example, (R, G, B) signals, (Y, Cb, Cr) signals, (Y, I, Q) signals, or the like as constituent elements.

  Here, considering the (R, G, B) signals, for example, if the image atn and the image are are present in a rectangular area, the horizontal direction (: i = 0 to m) and the vertical direction (: j = 0). N) m × n pieces of (R, G, B) information. This is expressed as image atnRi, j image atnGi, j image atnBi, j.

  The amount of change V at this time is

  And Then, the above-described transition amount V is compared with a predetermined detection amount. When the transition amount V is larger than the detection amount, a moving object is detected. Note that, by setting the detection amount to a small value, the moving object can be detected even if the moving object changes minutely. Note that the shift amount V is defined by the mean square of each color information of the pixel by the above-described equation.

Next, the operation of the automatic imaging apparatus in the present embodiment will be described mainly as an operation in a digital camera with reference to a flowchart shown in FIG.
First, the power of the digital camera is turned on, and the operation of the digital camera is started. When the user operates the operation unit 13 while looking at the display unit 15, the operation mode of the digital camera shifts to a moving object detection shooting mode in which shooting is performed when a moving object is detected. When an area (detection area) for determining whether or not a moving object is present is selected to be a part or all of the imaging area of OEC2, and when moving object detection is performed as a detection condition By selecting a reference image, a detection area and a detection condition are set (step S1). Note that the image used as a reference when performing moving object detection is, for example, an image obtained by OEC2 at the beginning of moving to the moving object detection photographing mode, or obtained by OEC2 at a time point that is a predetermined time interval before. Selected from one of the images.

  Next, a detection amount used for moving object detection is set (step S2). Next, as a condition for ending the moving object detection shooting (end condition), in the digital camera, the number of images recorded on the memory card in the moving object detection shooting mode is set (step S3), and in the video camera or CCTV. Is set by designating the time during which moving object detection imaging continues. Then, the moving object detection photographing is started by the operation of the operation unit 13 (step S4).

  Next, in the digital camera, an image input from the OPS 1 (hereinafter referred to as a photographed image) is stored in the DRAM 6 and displayed on the display unit 15 (step S5). In the video camera or CCTV, shooting of a moving image is started, and the shot image is displayed on the finder and stored in the DRAM 6 and a mass storage device (not shown) such as a video tape or a hard disk. In step S1, if the setting is made such that the image used as a reference when performing moving object detection is the image at the time of starting the digital camera, the image at the time of starting the digital camera is stored in the DRAM 6. In other cases, images taken at predetermined time intervals are overwritten and stored in the DRAM 6.

  Next, after the captured image is stored in the DRAM 6, the captured image is compared with the image stored in the DRAM 6 in the detection area set in step S1. That is, as described above, the shift amount is calculated (step S6), and it is determined whether the shift amount is larger than the detection amount set in step S2 (step S7). If the determination is “YES”, it means that a moving object has been detected in the detection area described above, so an image is taken (step S8), digital image data is obtained, and the memory card I / F 8 is used. And stored in the memory card, the process proceeds to step S9. On the other hand, when the determination in step S7 is “NO”, no moving object is detected in the detection area described above, and the process proceeds to step S9.

  Then, for the digital camera, the number of images greater than or equal to the number of shots determined by the end condition set in step S3 has been recorded, or for the video camera or CCTV, the moving object is detected for a time equal to or longer than the shooting time determined by the end condition set in step S3. It is determined whether or not shooting is continued (step S9). That is, it is determined whether or not the condition for ending the moving object detection photographing is satisfied. When the determination is “YES”, the moving object detection photographing is finished. On the other hand, if the determination in step S9 is “NO”, the process returns to step S5, and the operations in the following steps are repeated.

  According to the above-described embodiment, the moving object detection shooting as described above is performed by using the control program incorporated in the control unit of the CPU 9, the video camera, the CCTV, or the like in the conventional digital camera, based on the shift amount of the image shot by the OEC 2. Therefore, an image of the moving object can be taken only when a moving object is detected in a predetermined area without providing a moving object detection unit such as an infrared sensor.

  In addition, according to the above-described embodiment, for example, when shooting a moving image using CCTV, such as a wild bird flying, the wild bird flying as a moving object is detected while performing normal moving image shooting. Still images can be taken, and a still image with higher definition than that of a normal CCTV still image acquisition means can be obtained.

  In addition, according to the above-described embodiment, it is generally possible to perform interval shooting for obtaining a still image with a certain time elapse as a trigger, with a certain amount of image change as a trigger. As a result, for example, when tracking and photographing the molting of a cocoon, it is possible to extract and photograph only a portion having a large change in the image, so that more rational information can be obtained.

  Further, according to the above-described embodiment, in CCTV used as a surveillance camera, a moving image is usually shot and recorded, and when the presence of any moving object, for example, a human intrusion is detected, a still image of the trunk is displayed. Since it can shoot and record, a high-definition image can be obtained for the moving object.

  In the present embodiment, it is assumed that detection area setting and detection condition setting are performed in step S1, and detection amount setting is performed in step S2. However, for the detection area, detection condition, and detection amount, It is also possible to previously set values having a track record in the past in the digital camera and change those set values as necessary.

  Further, in the calculation of the shift amount in step S6, sub-sampling that is a process of extracting a part of data from the data of the image is performed for the following without performing the calculation for all the pixels existing in the detection area. A calculation may be performed on the sampled pixels to reduce the total calculation amount. That is, the pixels themselves may be subsampled and thinned out. That is, the subscripts i and j of the pixels atnRi, j, arefRi, j described above are thinned out, and only the pixels atnRi, j, arefRi, j for the remaining i and j are used for calculating the shift amount, and the total amount of computation May be reduced

  In addition, a digital camera that handles color images has a plurality of pieces of information about colors (for example, three primary colors such as R (red), G (green), and B (blue)) for one pixel. In the calculation of the shift amount, the calculation of the shift amount is performed by using only the R signal, only the G signal, or only the B signal, for example, without calculating the information on all colors of one pixel. The amount of calculation may be reduced.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the concrete structure is not restricted to this embodiment, The design change in the range which does not deviate from the summary of this invention is also included.

1 is a configuration diagram of a digital camera that is a type of automatic imaging apparatus according to an embodiment of the present invention. FIG. It is a figure which shows the operation | movement of the moving body detection imaging | photography of the automatic imaging device in the embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... OPS (OPtical System), 2 ... OEC (OptoElectric Converter) (above, imaging means), 3 ... CDS-ADC (Correlated Double Sampler-Analog Digital Converter) (sampling means), 4 ... Timing circuit, 5... DSP (Digital Signal Processor), 6... DRAM (Dynamic Random Access Memory), 7... EEPROM (Electronically Erasable and Programmable Read Only Memory), 8. F (InterFace) (imaging data storage means), 9... CPU (Central Processing Unit) (calculation means) (control means) (calculation condition changing means) (subsampling means), 10.・ ・ ・ Flash control unit, 12 ... Flash, 13 ... Operation unit (calculation condition changing means), 14 ... Display control unit, 15 ... Display unit, 16 ... Microphone, 1 ··· ADC (Analog Digital Converter), 18 ··· encoder, 19 ... decoder, 20 ··· DAC (Digital Analog Converter), 21 ··· speaker

Claims (5)

Imaging means for obtaining optical data by converting an optical image into an electrical signal;
Sampling means for sampling imaging data obtained from the imaging means at a predetermined time interval;
A calculation means for calculating a shift amount based on the sampled imaging data;
Control means for storing the imaging data in the imaging data storage means when the amount of change exceeds a threshold;
An automatic imaging apparatus comprising:   The calculation condition changing means for changing at least one of the region for calculating the shift amount, the predetermined time interval, or the threshold value as needed. Automatic imaging device.   3. The automatic imaging according to claim 1, further comprising sub-sampling means for thinning out pixels of imaging data for obtaining the shift amount by the calculating means at predetermined intervals. apparatus.   The sub-sampling unit for extracting a part of color information of pixels of the imaging data for obtaining the shift amount by the arithmetic unit is provided. Automatic imaging device. In a computer for control of an automatic imaging apparatus having an imaging means for converting an optical image into an electrical signal to obtain imaging data, and an imaging data storage means for storing the imaging data as required,
Converting the optical image into an electrical signal to obtain imaging data by the imaging means;
Sampling imaging data obtained from the imaging means at a predetermined time interval;
Calculating a shift amount based on the sampled imaging data;
Storing the imaging data in imaging data storage means when the amount of change exceeds a threshold;
A program for controlling an automatic imaging apparatus for executing the above.

Images