JP2010093492A - Imaging apparatus and program for imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus that enables a photographer to take a photograph without missing any perfect shot, and securely prevents an increase in power consumption and a shortage in storage capacity. <P>SOLUTION: The imaging apparatus is provided with: an imaging unit which sequentially generates image data of prescribed resolution; a resolution matching unit which matches the resolution of the latest image data with the resolution of image data generated a prescribed time before the latest image data; a movement detection unit which detects a movement of the imaging device during photography of two image data, matched with each other by the resolution matching unit, by the imaging unit; an image correction unit which performs correction for erasing change due to a movement of the imaging apparatus from the latest image data when the amount of the movement of the imaging apparatus detected by the movement detection unit is smaller than a prescribed threshold; a difference value calculation unit which calculates a difference value between the latest image data having been corrected and the image data generated the prescribed time before the latest image data; and a resolution setting unit which sets the resolution of the image data generated by the imaging unit according to the difference value generated by the difference value calculation unit. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging apparatus program for imaging a subject and generating image data.

  2. Description of the Related Art Conventionally, as a technique capable of shooting without missing a photo opportunity in an image pickup apparatus, a technique related to an image pickup apparatus that allows a photographer to wear an image pickup apparatus on his / her body and always take a picture is known. (For example, refer to Patent Document 1). In this technology, an imaging device is worn in the vicinity of the photographer's head or chest, and image data of the photographed image is temporarily recorded in a memory and updated at predetermined time intervals. The image data is stored according to an instruction from the person. By the way, when this technique is applied, since the imaging device always captures and records an image, a lot of useless images are captured, causing problems such as increased power consumption and insufficient storage capacity.

  As a technique that can solve the problem of the technique described in Patent Document 1 described above, a plurality of frames are compared to detect an information change amount of a video signal or an audio signal of the frame, and according to the detected information change amount A technique for automatically switching image resolution at the time of imaging and signal processing is known (see, for example, Patent Document 2). According to this technology, when the amount of information change between captured frames is small, an increase in power consumption and a shortage of storage capacity can be prevented by setting the image resolution of some frames low. Is done.

JP 2003-204464 A JP 2003-134386 A

  However, when the technique described in Patent Document 2 is applied to the technique described in Patent Document 1, since the imaging apparatus is always moving together with the photographer, whether the change between frames is due to a change in the scene or not. It was not possible to accurately determine whether it was due to movement. For this reason, in the end, all the captured images are recorded with high resolution, and it has not been possible to prevent an increase in power consumption or a shortage of storage capacity.

  The present invention has been made in view of the above, and can capture an image without missing a photo opportunity, and can reliably prevent an increase in power consumption and a shortage of storage capacity. The purpose is to provide a program.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention is an imaging apparatus that images a subject and generates image data, and continuously captures the subject at intervals. An imaging unit that sequentially generates image data of a predetermined resolution, and a resolution match that matches the resolution of the latest image data generated by the imaging unit with the resolution of the image data generated a predetermined time before the latest image data A motion detection unit that detects a motion of the imaging device while the imaging unit captures each of the two pieces of image data matched by the resolution matching unit, and the imaging device detected by the motion detection unit When the amount of movement is smaller than a predetermined threshold, an image correction unit that performs correction to remove a change caused by the movement of the imaging device from the latest image data, and the latest image corrected by the image correction unit A difference value calculation unit that calculates a difference value between the data and image data generated a predetermined time before the latest image data, and an image generated by the imaging unit according to the difference value calculated by the difference value calculation unit And a resolution setting unit for setting the data resolution.

  In the image pickup apparatus according to the present invention, in the above invention, the resolution setting unit sets the resolution to one of two resolutions having different heights, and the resolution matching unit includes two image data resolutions. If the image data is different, the resolution of the high resolution image data is converted to a low resolution.

  In the imaging device according to the present invention, in the above invention, when the amount of motion of the imaging device detected by the motion detection unit is equal to or greater than the predetermined threshold, the resolution setting unit generates an image generated by the imaging unit. The data resolution is set to a high resolution.

  In the imaging device according to the present invention as set forth in the invention described above, the motion detection unit calculates a motion vector of a feature point in the image.

  Moreover, the imaging device according to the present invention is characterized in that, in the above invention, the motion detection unit includes an acceleration sensor or a gyro sensor.

  In addition, an imaging apparatus program according to the present invention includes an imaging unit that sequentially captures a subject and generates image data sequentially at intervals, and a storage unit that stores information including the image data. The apparatus shoots a subject to generate image data of a predetermined resolution, writes the generated image data to the storage unit, an image data generation step generated by the image data generation step, and a predetermined value based on the image data The image data generated before time is read from the storage unit, and the imaging unit captures each of the two image data matched in the resolution matching step, the resolution matching step for matching the resolutions of the two read image data. A motion detection step for detecting the motion of the imaging device during the operation, and the amount of motion of the imaging device detected in the motion detection step An image correction step for performing correction to remove a change caused by the movement of the imaging device from the latest image data, the latest image data corrected in the image correction step, and the latest image data, when smaller than a predetermined threshold A difference value calculating step for calculating a difference value from image data generated before a predetermined time, and a resolution setting step for setting the resolution of the image data generated by the imaging unit in accordance with the difference value calculated in the difference value calculating step , Is executed.

  According to the present invention, images of a subject are continuously photographed at intervals to sequentially generate image data of a predetermined resolution, and the influence of the movement of the imaging device between the predetermined image data is eliminated. Since the difference between the two image data is detected and the resolution of the image data generated by the imaging unit is set based on this difference value, the resolution continues to be set high despite a small scene change. There is nothing. Therefore, it is possible to shoot without missing a photo opportunity, and it is possible to reliably prevent an increase in power consumption and a shortage of storage capacity.

  The best mode for carrying out the present invention (hereinafter referred to as “embodiment”) will be described below with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a diagram illustrating a configuration of an imaging apparatus according to Embodiment 1 of the present invention. An imaging apparatus 1 shown in FIG. 1 outputs an imaging unit 2 that captures an image of a subject and generates image data, an image processing unit 3 that performs image processing on image data generated by the imaging unit 2, and an image processing unit 3 that outputs the image data. A display unit 4 that displays information including image data, an input unit 5 to which an operation instruction signal of the imaging device 1 is input, a control unit 6 that controls the operation of the imaging device 1, and various types of information related to the operation of the imaging device 1 are stored. A storage unit 7 is provided.

  The imaging unit 2 receives a photographing lens 21 that collects light from a subject in a predetermined field of view, a diaphragm 22 that adjusts an incident amount of light collected by the photographing lens 21, and incident light that has passed through the diaphragm 22. The image sensor 23 such as a CCD that converts the signal into an electrical signal, the analog signal processor 24 that performs various processes including sensitivity correction and white balance on the analog signal output from the image sensor 23, and the analog signal processor 24 output the signal. An A / D conversion unit 25 that generates digital image data from the signal is included. Among these, the photographing lens 21 is an optical system composed of one or a plurality of lenses, and is driven by the lens driving unit 8. The diaphragm 22 is driven by the diaphragm drive unit 9. The imaging unit 2 can be driven at a high speed and has a function of continuously photographing a subject at a constant cycle.

  The image processing unit 3 compares the resolution of the latest image data generated by the imaging unit 2 with the resolution of the previous image data generated, and if the two image data have different resolutions, A resolution matching unit 31 that matches the resolution of the image data, a motion detection unit 32 that detects the motion of the imaging apparatus 1 between the latest image data and the image data generated immediately before the latest image data, and motion detection A motion determination unit 33 that determines the movement of the imaging device 1 based on the detection result of the unit 32, an image correction unit 34 that corrects an image according to the determination result of the motion determination unit 33, and the latest image corrected by the image correction unit 34. And a difference value calculation unit 35 for calculating a difference value between the data and the image data generated immediately before the image data.

  The input unit 5 includes a power button of the imaging apparatus 1, a shutter button for giving an imaging instruction, a control button including an instruction for reproducing and editing image data, and the like. It is also possible to realize at least a part of various buttons constituting the input unit 5 using a cross key or a touch panel.

  The control unit 6 includes a resolution setting unit 61 that sets the resolution of image data generated by the imaging unit 2 according to the difference value calculated by the difference value calculation unit 35. The resolution setting unit 61 sets the resolution of the image data that is captured and generated by the imaging unit 2 to one of a high resolution and a low resolution. The control unit 6 is realized using an MPU or the like, and is connected to each unit to be controlled via a bus line.

  The storage unit 7 includes a program for the imaging device according to the first embodiment, stores a program storage unit 71 that stores various programs executed by the imaging device 1, and an image data storage unit that stores image data captured by the imaging unit 2. 72. The storage unit 7 is realized by using a semiconductor memory such as a flash memory or a RAM that is fixedly provided inside the imaging apparatus 1. The storage unit 7 may have a function as a recording medium interface for reading information recorded on a recording medium while recording information on a recording medium such as a memory card mounted from the outside.

  In the imaging apparatus 1 having the above configuration, the continuous shooting mode can be set in addition to the normal shooting mode. The continuous shooting mode is a mode in which the imaging unit 2 automatically and continuously captures images at a predetermined cycle. In this continuous shooting mode, the imaging unit 2 generates image data with the resolution set by the resolution setting unit 61. Hereinafter, a mode in which the imaging unit 2 generates high-resolution image data in the continuous shooting mode is referred to as a high-resolution mode, while a mode in which the imaging unit 2 generates low-resolution image data in the continuous shooting mode is low. This is called the resolution mode.

  The imaging device 1 has an aspect that a photographer can wear. FIG. 2 is a diagram illustrating a specific aspect of the imaging apparatus 1. In FIG. 2, the photographing unit 1 </ b> A including the imaging unit 2, the lens driving unit 8, and the aperture driving unit 9 is attached to the side surface of the vine of the glasses 201 worn by the photographer 200. A main body 1B including components other than the photographing unit 1A in the imaging device 1 is connected to the photographing unit 1A via a cable 1C.

  FIG. 3 is a flowchart illustrating an outline of the resolution setting process when the imaging apparatus 1 is set to the continuous shooting mode. First, the imaging unit 2 captures an image and generates image data (step S1). The imaging unit 2 performs imaging based on a control signal (including imaging parameters such as an AF instruction value, an AE instruction value, and an AWB instruction value) sent from the control unit 6, and the imaging mode set by the resolution setting unit 61 The image data having the resolution corresponding to is generated. When the shooting mode is set to the high resolution mode, the imaging unit 2 performs all pixel readout. On the other hand, when the shooting mode is set to the low resolution mode, the imaging unit 2 performs pixel thinning readout.

  Thereafter, the imaging apparatus 1 writes and saves the image data generated by the imaging unit 2 in the storage unit 7 via the image processing unit 3 (step S2).

  Subsequently, the resolution matching unit 31 compares the resolution of the latest image data generated in step S1 with the resolution of the image data captured once before (hereinafter referred to as “previous frame”), and according to the comparison result. Processing for matching the resolution of the latest image data with the resolution of the previous frame is performed (steps S3 to S7). First, if the latest image data has a high resolution (step S3, Yes), if the previous frame has a low resolution (step S4, Yes), the resolution matching unit 31 converts the resolution of the latest image data to a low resolution. (Step S5), the process proceeds to Step S8 described later. On the other hand, if the previous frame has a high resolution (step S4, No), the imaging apparatus 1 proceeds directly to step S8 described later.

  On the other hand, if the latest image data is not high resolution (step S3, No), if the previous frame is low resolution (step S6, Yes), the process proceeds directly to step S8 described later. On the other hand, if the previous frame has a high resolution (step S6, No), the resolution matching unit 31 converts the resolution of the previous frame to a low resolution (step S7), and proceeds to step S8 described later.

  Due to the processing in steps S3 to S7 performed by the resolution matching unit 31, the resolution of the latest image data matches the resolution of the previous frame in any situation.

  In step S8, the motion detection unit 32 detects the motion of the imaging device 1 (step S8). Specifically, the motion detection unit 32 detects feature points in the image, performs pattern matching, and calculates a motion vector of the feature points.

  Thereafter, the motion determination unit 33 determines the motion of the imaging device 1 by using the motion vector of the feature point calculated by the motion detection unit 32 (step S9). Specifically, in step S9, the motion determination unit 33 first extracts a set V of motion vectors having substantially the same direction and magnitude as the motion vectors of the feature points. The feature points specified by the set V correspond to the background of the screen. When the number of elements in the set V is equal to or greater than a predetermined number, the motion determination unit 33 determines that the imaging device 1 is moving. Note that the motion determination unit 33 may determine that the imaging device 1 is moving when the elements of the set V are greater than or equal to a predetermined ratio with respect to all the motion vectors. Subsequently, the motion determination unit 33 identifies whether or not the motion of the imaging device 1 is due to a shake, according to the size of the motion vector constituting the set V. That is, the motion determination unit 33 determines that the motion is caused by the shake if the average value of the magnitudes of the motion vectors constituting the set V is smaller than the predetermined threshold, while the average value is equal to or greater than the predetermined threshold. If it is, it will determine with the imaging device 1 having moved.

When the motion determination unit 33 determines that the imaging device 1 is moving (step S10, Yes) and determines that the motion is a blur (step S11, Yes), the image correction unit 34 corrects the image by the amount of the blur. It performs (step S12). FIG. 4 is a diagram showing an outline of blur correction. In FIG. 4, an image 101 is an image including a blur, and an image 102 is corrected using an inverse vector v _i of an average blur vector defined as an average of the magnitude and direction of motion vectors constituting the set V. It is a figure. By performing such correction, it is possible to accurately eliminate the influence of minute blurring of the imaging apparatus 1 caused by the photographer 200 moving slightly.

Thereafter, the difference value calculation unit 35 calculates a difference value D between the two image data arranged side by side in time (step S13). The difference value D here is defined as a function of the difference values of the R component, G component, and B component for each predetermined pixel, for example. When the difference value D is a predetermined value D ₀ or more (step S14, Yes), the resolution setting unit 61 sets the photographing mode to the high-resolution mode (step S15). On the other hand, when the difference value D is smaller than the predetermined value D ₀ (step S14, No), the resolution setting unit 61 sets the photographing mode to the low-resolution mode (step S16). When the shooting mode is set to the high resolution mode when performing step S15, and when the shooting mode is set to the low resolution mode when performing step S16, the resolution setting unit 61 sets again. May not be transmitted to the imaging unit 2.

  A case will be described in which the motion determination unit 33 determines that there is a motion of the imaging apparatus 1 in Step S10 (Yes in Step S10) and determines that the motion is a movement (No in Step S11). FIG. 5 is a diagram illustrating the previous frame and the latest image data when the motion determination unit 33 determines that there is a motion of the imaging apparatus 1. In the case shown in FIG. 5, the common portion of the image 103 corresponding to the previous frame and the image 104 corresponding to the latest image data is about half of the screen, and the position of the common portion is also greatly different. In such a case, the resolution setting unit 61 sets the shooting mode to the high resolution mode (step S15).

  A case where the motion determination unit 33 determines in step S10 that the imaging device 1 does not move (No in step S10) will be described. In this case, the imaging apparatus 1 proceeds to the difference value calculation process (step S13) between the image data by the difference value calculation unit 35. The processes in steps S14 to S16 subsequent to step S13 are as described above.

  Finally, when the storage unit 7 stores a low-resolution previous frame (step S17, Yes), the imaging device 1 deletes the low-resolution previous frame (step S18) and returns to step S1. When the storage unit 7 does not store the low-resolution previous frame (step S17, No), the imaging device 1 directly returns to step S1. In this way, the imaging device 1 suppresses an increase in the storage amount of the storage unit 7 by sequentially deleting unnecessary low-resolution image data.

  According to the first embodiment of the present invention described above, the subject is continuously photographed at intervals to sequentially generate image data with a predetermined resolution, and the imaging apparatus moves between the predetermined image data. This is because the difference between the two image data is detected and the resolution of the image data generated by the imaging unit is set based on this difference value. It is possible to accurately eliminate the influence of the minute blur of the image pickup apparatus, and there is no case where the resolution is kept high even though the scene change is small. Therefore, it is possible to shoot without missing a photo opportunity, and it is possible to reliably prevent an increase in power consumption and a shortage of storage capacity.

  Further, according to the first embodiment, the power consumption can be reduced and the storage capacity necessary for the storage unit can be reduced, so that the image pickup apparatus can be reduced in size and weight.

(Embodiment 2)
FIG. 6 is a diagram illustrating a configuration of an imaging apparatus according to Embodiment 2 of the present invention. The imaging apparatus 10 shown in the figure includes an acceleration sensor or a gyro sensor, and includes a motion detection unit 11 that detects the movement of the imaging apparatus 10. For this reason, the image processing unit 12 of the imaging device 10 does not have a function of detecting and determining the movement of the imaging device 10 by image recognition. In addition, the control unit 13 of the imaging device 10 includes a motion determination unit 131 that determines the presence or absence of motion of the imaging device 10 based on the output of the motion detection unit 11. The functional configuration of the imaging apparatus 10 excluding the above points is the same as the functional configuration of the imaging apparatus 1.

  FIG. 7 is a flowchart illustrating an outline of the resolution setting process when the imaging apparatus 10 is set to the continuous shooting mode. First, the imaging unit 2 captures an image and generates image data (step S21). Thereafter, the imaging device 10 writes and stores the image data generated by the imaging unit 2 in the storage unit 7 (step S22).

  The motion detection unit 11 detects the motion of the imaging device 10 (step S23). Specifically, the imaging device 10 detects the magnitude and direction of motion of the imaging device 10 from the output of the acceleration sensor or gyro sensor, and calculates the motion vector of the imaging device 10 based on the detection result.

  Subsequently, the motion determination unit 131 determines the presence / absence of the movement of the imaging device 10 based on the output from the motion detection unit 11, and determines whether the movement of the imaging device 10 is a shake when there is a movement. (Step S24).

  When the motion determination unit 131 determines that there is a motion of the imaging device 10 (step S25, Yes) and determines that the motion is a blur (step S26, Yes), the image correction unit 34 corrects the image by the amount of the blur. This is performed (step S27).

The processes in steps S28 to S32 subsequent to step S27 are processes in which the resolution matching unit 31 compares the resolution of the latest image data with the resolution of the previous frame, and matches the resolutions of the two image data according to the comparison result. Yes, and sequentially corresponds to the processing of steps S3 to S7 in FIG. The processing of steps S33~S36 calculates a difference value D of the two image data, sets the resolution of the image data generated by the imaging unit 2 in accordance with the magnitude relationship between the difference value D and the threshold value D ₀ This process corresponds to steps S13 to S16 in FIG.

  When the motion determination unit 131 determines in step S25 that the imaging device 10 is moving (step S25, Yes) and determines that the movement is movement (step S26, No), the resolution setting unit 61 sets the shooting mode to the high resolution. The mode is set (step S35).

  When the motion determination unit 131 determines in step S25 that there is no motion of the imaging apparatus 10 (No in step S25), the resolution matching unit 31 compares the resolution of the latest image data with the resolution of the previous frame, and the comparison result is obtained. Accordingly, after performing the process of matching the resolutions of the two image data (steps S28 to S32), the difference value calculation process of the two image data and the shooting mode setting process are performed according to the difference value calculation result (steps). S33 to S36).

  Finally, when the storage unit 7 stores a low-resolution previous frame (Yes in step S37), the imaging device 1 deletes the low-resolution previous frame (step S38) and returns to step S21. When the storage unit 7 does not store the low-resolution previous frame (step S37, No), the imaging device 1 directly returns to step S21.

  According to the second embodiment of the present invention described above, as in the first embodiment described above, it is possible to reliably prevent an increase in power consumption and a shortage of storage capacity.

  So far, the first and second embodiments have been described in detail as the best mode for carrying out the present invention, but the present invention should not be limited by these embodiments. For example, when determining the movement of the imaging apparatus according to the present invention, the determination may be made by a combination of detection by image recognition and detection by an acceleration sensor or a gyro sensor.

  Further, the imaging apparatus according to the present invention may have a housing shape like a normal digital camera.

  Thus, the present invention can include various embodiments and the like not described herein, and various design changes and the like can be made without departing from the technical idea specified by the claims. It is possible to apply.

It is a figure which shows the structure of the imaging device which concerns on Embodiment 1 of this invention. It is a figure which shows the specific aspect of the imaging device which concerns on Embodiment 1 of this invention. It is a flowchart which shows the outline | summary of the resolution setting process which the imaging device which concerns on Embodiment 1 of this invention performs. It is a figure which shows the outline | summary of the correction | amendment of a blur. It is a figure which shows the image respectively corresponding to two image data before and behind when it determines with the imaging device which concerns on Embodiment 1 of this invention moving. It is a figure which shows the structure of the imaging device which concerns on Embodiment 2 of this invention. It is a figure which shows the outline | summary of the resolution setting process which the imaging device which concerns on Embodiment 2 of this invention performs.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,10 Image pick-up device 1A Image pick-up unit 1B Main body part 1C Cable 2 Image pick-up part 3, 12 Image processing part 4 Display part 5 Input part 6, 13 Control part 7 Storage part 8 Lens drive part 9 Aperture drive part 11, 32 Motion detection part DESCRIPTION OF SYMBOLS 21 Shooting lens 22 Aperture 23 Image sensor 24 Analog signal processing part 25 A / D conversion part 31 Resolution matching part 33, 131 Motion determination part 34 Image correction part 35 Difference value calculation part 61 Resolution setting part 71 Program storage part 72 Image data storage Part 101, 102, 103, 104 Image 200 Photographer 201 Glasses

Claims (6)

An imaging device that images a subject and generates image data,
An imaging unit that sequentially shoots an object at intervals and sequentially generates image data of a predetermined resolution;
A resolution matching unit that matches the resolution of the latest image data generated by the imaging unit and the resolution of the image data generated a predetermined time before the latest image data;
A motion detection unit that detects a motion of the imaging device while the imaging unit captures each of the two pieces of image data matched by the resolution matching unit;
An image correction unit that performs correction to remove a change caused by the motion of the imaging device from the latest image data when the amount of motion of the imaging device detected by the motion detection unit is smaller than a predetermined threshold;
A difference value calculation unit that calculates a difference value between the latest image data corrected by the image correction unit and image data generated a predetermined time before the latest image data;
A resolution setting unit that sets a resolution of image data generated by the imaging unit in accordance with the difference value calculated by the difference value calculation unit;
An imaging apparatus comprising: The resolution setting unit sets the resolution to one of two resolutions of different heights,
The imaging apparatus according to claim 1, wherein the resolution matching unit converts the resolution of the high-resolution image data to the low resolution when the resolutions of the two image data are different.   The resolution setting unit sets the resolution of the image data generated by the imaging unit to a high resolution when the amount of motion of the imaging device detected by the motion detection unit is greater than or equal to the predetermined threshold value. The imaging device according to claim 1 or 2.   The imaging apparatus according to claim 1, wherein the motion detection unit calculates a motion vector of a feature point in the image.   The imaging apparatus according to claim 1, wherein the motion detection unit includes an acceleration sensor or a gyro sensor. An imaging apparatus comprising: an imaging unit that sequentially captures an object at intervals and generates image data sequentially; and a storage unit that stores information including the image data.
An image data generation step of shooting a subject to generate image data of a predetermined resolution and writing the generated image data to the storage unit,
A resolution matching step of reading out the image data generated in the image data generation step and the image data generated a predetermined time before the image data from the storage unit, and matching the resolutions of the two read image data;
A motion detection step of detecting a motion of the imaging device while the imaging unit captures each of the two pieces of image data matched in the resolution matching step;
An image correction step for performing correction to remove a change caused by the motion of the imaging device from the latest image data when the amount of motion of the imaging device detected in the motion detection step is smaller than a predetermined threshold;
A difference value calculating step for calculating a difference value between the latest image data corrected in the image correction step and image data generated a predetermined time before the latest image data;
A resolution setting step for setting a resolution of image data generated by the imaging unit in accordance with the difference value calculated in the difference value calculating step;
A program for an imaging apparatus, characterized in that

Images