JP2010268112A - Imaging device, and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent a photo opportunity from being missed before holding a camera, in a digital camera. <P>SOLUTION: Acceleration (gravity) is detected at predetermined intervals (S101); when a large variation occurs in the gravity in XYZ-axis directions (S102), the touch (grip) of a digital camera is determined (S103); and, when a grip part (a right side part) of the digital camera is held and a large gravity variation occurs on the opposite side (S104, S105), energy supply is increased to detect the gravity in a minute cycle (S108), and whether sudden increase occurs in the gravity in the Y-axis direction is determined (S109a). When the sudden increase occurs in the gravity in the Y-axis direction, energy is supplied to an imaging system (an imaging element, a face detection part), an image-capturing before holding the camera is started, and an image is recorded along with the inclination and vibration in imaging (S111); and data of the inclination and vibration are used in correction and selection of the image. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus such as a digital camera, a digital video camera, a mobile phone with a digital camera, a mobile terminal with a digital camera (a mobile tool with a digital camera), and a shooting method.

  In imaging devices such as digital cameras, digital video cameras, mobile phones with digital cameras, and mobile terminals with digital cameras (mobile tools with digital cameras), the image from the subject is imaged on the image sensor via the taking lens and photoelectrically converted. It is digitized and input to a central processing circuit such as a CPU. Then, necessary image processing such as color and gradation correction and compression processing is performed in the central processing circuit and recorded in a recording means such as a flash memory.

Shooting is performed by a release operation such as pressing a release switch, and it is desired to perform shooting with a release operation in a state in which the subject is most suitable for shooting (so-called photo opportunity).
However, (1) until the photographer determines that the state is most suitable for shooting (shutter chance), (2) until the shutter switch is pressed with a shutter chance, and (3) from the start of pressing the release switch. There is a time lag until completion. For this reason, at the time when the release operation is performed (when the release switch is pushed in), the most suitable state for shooting has already passed, and a photo opportunity is often missed (shooting missed).
Contrary to the case where the release operation is delayed, even if the release switch is pressed before the shutter chance is erroneously determined to be most suitable for shooting (even if the release operation is too early), the photo opportunity is missed. However, the release operation is often performed after the photo opportunity, and the release operation is performed with a delay from the photo opportunity.

  In order to shoot without missing a photo opportunity (shooting miss), there has been proposed an imaging apparatus that starts shooting before the release operation and continues shooting until after the release operation (for example, Japanese Patent Laid-Open No. Hei 10-2010). No. 257365, Japanese Patent Laid-Open No. 2008-283629). The captured image is recorded (temporarily) in a recording means such as a temporary recording memory, and when a certain amount of image is stored, the old image is sequentially updated with the latest image. Contains the latest fixed number of images.

  If you take images before and after the release operation and record the images, if the release operation is slow relative to the shutter chance, the image is taken before the release operation, and if the release operation is too early, the image is taken after the release operation. It is highly possible that an image in the most suitable state is included, and missed shooting is avoided.

  If the shooting interval before and after the release operation is set regardless of the moving speed of the subject, there is a high risk of missing a shot when shooting a fast moving subject. Therefore, in Japanese Patent Laid-Open No. 10-257365, the shooting interval before and after the release operation can be set according to the speed of movement of the subject, and in the mode for shooting the subject moving at high speed, the subject moving at low speed Alternatively, the shooting interval is set shorter than in a mode for shooting a stationary subject.

  Further, if the number of pixels of the image data to be taken is reduced, the processing time is shortened and the image data per unit time is increased. For this reason, in Japanese Patent Application Laid-Open No. 2008-283629, during shooting operation, still image data is recorded in a temporary recording memory by a certain amount in order from the newest, and the image data before the release operation is smaller than the standard number of pixels. The image data after the release operation is processed with the standard number of pixels. Therefore, before the release operation where there is a high possibility that a photo opportunity exists, the image data per unit time is increased, and shooting without missing is possible.

JP-A-10-257365 JP 2008-283629 A

Usually, the rear liquid crystal display is taken in a horizontal shooting posture (horizontal posture, horizontal posture) with the image pickup device being aimed at a photo opportunity, and in the known configuration described in Patent Documents 1 and 2 above In addition, photographing (pre-photographing) is started prior to the release operation after holding the digital camera (imaging device) in a horizontal posture.
In other words, shooting before the release operation starts after you hold the camera. If you do not hold it, shooting will not start. Therefore, it is inevitable to miss a photo.

SUMMARY OF THE INVENTION An object of the present invention is to provide an imaging apparatus that can take a picture without missing in response to a photo opportunity before holding.
Another object of the present invention is to provide a shooting method in an imaging apparatus that enables shooting without missing in response to a photo opportunity before holding.

Generally, before shooting, a series of operations are required in which the imaging device is taken out from a storage location such as a pocket or a bag and is set in a shooting posture. In a normal case, a series of operations of taking out the image pickup apparatus and setting it in a photographing posture is performed without rushing, and is a relatively slow operation. On the other hand, when a photo opportunity is encountered (emergency), a series of operations of taking out and holding them is performed quickly, and is clearly distinguished from a relatively slow operation during normal times.
In the present invention, when a photo opportunity is encountered (emergency), attention is paid to a series of operations in which the image pickup apparatus is taken out from the storage location, and pre-photographing is performed during the operation of taking out from the storage location. Has started.

That is, according to the first aspect of the present invention, an operation of grasping and lifting the imaging device before holding the image pickup device and performing a release operation is detected, and images before the holding and holding are started during the lifting operation. Have acquired.
According to the second aspect of the present invention, an operation of holding and lifting the imaging device before holding the imaging device and detecting the release is detected, and energy is supplied to the display means for displaying the live view image during the lifting operation. Energy is supplied to an image pickup means for acquiring an image without doing it, and images before the start of shooting are prepared.
According to the third aspect of the present invention, the gravity change in the vertical direction in the operation of grasping and lifting the imaging device before holding the release operation while holding the imaging device is detected, and during the lifting operation according to the detected gravity change In this way, it is possible to continuously acquire images before starting to take a picture.
According to the present invention, the image acquisition is continued until the release operation is performed even after the image pickup apparatus is held.
According to the fifth aspect of the present invention, the image obtained before the release operation is compared with the photographed image obtained by the release operation, the inclination is corrected and trimmed to obtain a corrected image, and the corrected image is obtained by the release operation. The image is recorded together with the image of the release operation in association with the photographed image.
According to the sixth aspect of the present invention, the selection process is performed before or after the correction, excluding an image that does not include a portion common to the captured image in the release operation, an image that is out of focus, and an image that is not suitable for exposure.
According to the seventh aspect of the present invention, in photographing before the release operation, the focus is fixed focus and the exposure is average photometry.
According to the eighth aspect of the present invention, in the photographing before the release operation, the photographing is performed with the number of pixels smaller than the number of pixels when photographing by the release operation.

According to the ninth aspect of the present invention, an imaging unit that captures an image from a subject, a display unit that displays the captured image, and reproduces and displays the captured image, and a subject captured by the imaging unit. Prior to deciding the release switch operated to determine the shooting timing and the shooting timing by the release switch, images are acquired continuously from the imaging means, and the inclination is corrected compared with the shot image in the release operation Control means for controlling to obtain a corrected image, and recording means for recording a photographed image and a corrected image in a release operation.
According to the tenth aspect of the present invention, when the photographed image obtained by the release operation is reproduced and displayed on the display means, the control means controls to reproduce and display the corrected image together.
According to the eleventh aspect of the present invention, the control unit includes an image association control unit that associates the corrected image with the photographed image in the release operation when the photographed image in the release operation is recorded in the recording unit. The captured image and the corrected image in the operation are recorded in association with each other.
According to the present invention as set forth in claim 12, the control means includes an image selection control section for selecting images continuously acquired from the imaging means prior to the photographing timing, and before or after selection by the image selection control section. A trimming control unit that trims a subsequent image to obtain a corrected image.

According to the thirteenth aspect of the present invention, the image pickup means for picking up an image from the subject, the display means for displaying the picked-up image, reproducing and displaying the picked-up image, and picking up the subject by the image pickup means. A release switch that is operated to determine a timing to perform the image recording, a recording unit that records an image, and an imaging unit that is continuously provided before the imaging device is set for shooting and the shooting timing by the release switch is determined. And a control unit that controls to record the image in the recording unit together with the captured image in the release operation, and the control unit selectively selects the image continuously acquired from the imaging unit prior to the imaging timing. An image selection control unit, a trimming control unit for trimming an image before or after selection by the image selection control unit to obtain a corrected image, Captured images in over's operation has an image associated with the control unit associates the corrected image, the photographed image in the release operation associated records the corrected image.
According to the present invention as set forth in claim 14, the control means determines the photographer's intention to photograph based on the gripping position of the imaging device and the moving direction of the imaging device. Energy is sequentially supplied from a small number of blocks, and when the conditions of the gripping position and the moving direction are satisfied, the energy is supplied to the remaining blocks, and the imaging apparatus is set up in a state capable of photographing.

According to the first aspect of the present invention, since shooting is started in the operation of grasping and lifting the imaging device, even if a photo opportunity is encountered before holding, shooting can be performed without missing. In addition, since the image before the image taken by the release operation is taken in time series, a series of movements of the subject can be recorded and enjoyed, and the enjoyment after the photography is increased.
In the present invention described in claim 2, as in the present invention described in claim 1, since shooting is started in the operation of grasping and lifting the imaging apparatus, it is possible to sufficiently cope with a photo opportunity before holding. , You can shoot without missing. In addition, since the image before reaching the image taken by the release operation is taken in time series, a series of movements of the subject can be recorded and enjoyed, and the enjoyment after taking increases.
Further, in the present invention as claimed in claim 2, since energy is supplied only to the imaging means necessary for photography and energy is not supplied to the display means that consumes a large amount of energy prior to the release operation. The consumption of energy can be minimized and energy waste can be prevented.
According to the third aspect of the present invention, it is possible to acquire an image before holding in accordance with the gravity change in the vertical direction detected in the operation of grasping and lifting the imaging device, and it is also possible not to acquire an image according to the gravity change. it can.
According to the fourth aspect of the present invention, since the image is taken even after the holding and before the release operation, the shutter chance before the release operation after the holding can be sufficiently dealt with, and it is possible to surely prevent the shooting from being missed.
According to the fifth aspect of the present invention, since the image acquired before the release operation is trimmed by correcting the tilt and becomes a corrected image in the same state as the photographed image in the release operation, an image without a sense of incongruity is obtained. It is. In addition, since the images acquired before the release operation are recorded in association with the captured images in the release operation, they can be managed in a lump and can be easily managed and searched.
In the present invention described in claim 6, an image suitable for focusing and exposure is selected and left including a portion common to the photographed image in the release operation, and an image obtained by photographing a common subject in time series is obtained. .
In the present invention described in claim 7, since the focus and exposure are predetermined, the photographing before the release operation can be smoothly performed regardless of the photographing during the movement of lifting.
In the present invention according to the eighth aspect, since shooting is performed with a reduced number of pixels, it is possible to smoothly perform shooting before the release operation, regardless of shooting during movement such as lifting.

According to the ninth aspect of the present invention, since shooting is started in the operation of grasping and lifting the imaging device, even if a photo opportunity is encountered before holding, shooting can be performed without missing. In addition, since the image before the image taken by the release operation is acquired in time series, it is possible to record and enjoy a series of movements of the subject, and enjoyment after shooting increases. Since the inclination of the image acquired before the release operation is corrected, an image without a sense of incongruity can be obtained.
According to the tenth aspect of the present invention, since the photographed image in the release operation and the corrected image acquired before the release operation and corrected for tilt are reproduced and displayed together, the time series leading to the photographing in the release operation is displayed. Can be recognized at a glance, and the photographed image can be fully enjoyed while remembering the time-series process.
In the present invention described in claim 11, since the photographed image and the corrected image in the release operation are recorded in association with each other, they can be managed collectively, and management and retrieval can be easily performed.
In the present invention described in claim 12, since the image acquired before the release operation is selected and trimmed, an image without a sense of incongruity obtained by photographing a common subject in time series can be obtained.
In the present invention described in claim 13, since shooting is started in the operation of grasping and lifting the imaging device, even if a photo opportunity is encountered before holding, shooting can be performed without missing. In addition, since the image before the image taken by the release operation is acquired in time series, it is possible to record and enjoy a series of movements of the subject, and enjoyment after shooting is increased. The image acquired before the release operation is selected, trimmed by correcting its inclination, and the corrected image in the same state as the captured image in the release operation is obtained, so that an image without a sense of incongruity is obtained. Since the images acquired before the release operation are recorded in association with the photographed images in the release operation, they can be managed in a lump and can be easily managed and searched.

  In the present invention described in claim 14, since energy is sequentially supplied from a block with low energy consumption and the power of the imaging apparatus is not started until all the assumed operations are detected and the intention of photographing is confirmed, There is no waste and energy consumption is minimized.

1 is a schematic block diagram of a main part of an imaging apparatus according to an embodiment of the present invention embodied as a digital camera. (A)-(E) show the conceptual diagram of imaging | photography of the digital camera by this invention. (A)-(C) show the basic conceptual diagram of this invention. (A)-(D) show the example of a detection of the acceleration (vibration, gravity) by an acceleration detection means. (A) and (B) show an example of the inclination detection method by the inclination detection means. (A) and (B) show schematic sectional views of a liquid crystal display. (A)-(C) respectively show the output of the acceleration detection means in the use condition of FIG. FIG. 3 is a flowchart of photographing control according to the present invention in the usage state of FIG. 2. FIG. 9 shows an example of a subroutine for determining whether or not it is suitable for photographing in S112 of FIG. The rear view of a digital camera when holding a horizontal posture and taking a horizontal composition is shown. An example of images obtained continuously from pre-photographing to photographing by a release operation in the present invention is shown. (A)-(D) show the schematic about trimming. (A)-(E) show a series of images including a common part. 9 shows an example of a subroutine after the display system is turned on in S113 of FIG. (A)-(E) show an example of the reproduction | regeneration and display of a picked-up image. An example of the flowchart of image reproduction is shown.

  An image before holding the image pickup apparatus and holding the image pickup apparatus before the release operation is detected and supplying energy to the image pickup means for acquiring an image during the lift operation and holding the image pickup apparatus. Are getting continuously. The image obtained before the release operation is compared with the image taken by the release operation to correct its inclination and trimmed to obtain a corrected image. The corrected image is associated with the image taken by the release operation and taken by the release operation. Recorded with the image.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a schematic block diagram of the main part of an imaging apparatus according to an embodiment of the present invention embodied as a digital camera.
As shown in FIG. 1, a digital camera (imaging device) 10 includes an imaging unit 12, a control unit (central processing circuit) 14, a display unit (monitor) 16, a gripping detection unit 17, a recording unit (memory) 18, and a timing unit. (Clock) 20, communication means 22, switch operation determination means 24, acceleration detection means 26, switch group 28, and the like.

  The imaging means 12 includes a photographic lens 12a (see FIG. 2C) formed of a zoom lens, an imaging element 12 such as a CCD or CMOS sensor, and an image from a subject is formed on the imaging element via the photographic lens. Then, it is photoelectrically converted and digitized and output to the control means (central processing circuit) 14. Then, the central processing circuit 14 performs necessary image processing such as color and gradation correction and compression processing. It is converted into an image file compressed in the H.264 format or the like and recorded in the recording means (memory) 18.

In the present invention, an operation of grasping and lifting the imaging device by a photographer (user) before holding the imaging device and performing a release operation is detected, and energy is supplied to the imaging means 12 for acquiring an image during the operation. Images are acquired continuously before shooting is started and ready.
The recording means 18 is formed, for example, having a temporary recording memory (first memory) and a formal registration memory (second memory), from before the release operation to the release operation. A series of images taken in (1) is (temporarily) recorded in the first memory. When a certain amount of image is stored in the first memory, the old image is erased and updated to the latest image in sequence, so the image taken during the lifting operation fills the first memory. There is no end.
Also, the image that is determined to be recorded without being erased is moved from the first memory to the second memory and recorded.

  The second memory is, for example, a flash memory such as a memory card, and an image photographed by the release operation without photographing before the release operation (an image obtained by a normal release operation) is recorded in the second memory. The The temporary recording memory (first memory) is used to make up for the recording capacity of the formal recording memory (second memory) and the lack of shooting speed, and the second memory (flash memory). If the memory capacity is sufficiently large, a series of images taken before the release operation may be recorded in the second memory for the time being, and it is not necessary to strictly distinguish the recording locations.

  The time measuring means (clock) 20 measures the shooting date and time, and the date and time information is recorded in the memory 18 together with the shot image, so that the shot images are recorded in order and can be easily searched. The clock (time measuring means) 20 has a stopwatch function for measuring each timing.

  The imaging unit 12 further includes a face detection unit 12b, and the central control circuit 14 determines whether there is a subject corresponding to the face from the characteristics of the image output from the imaging element. The image acquired before the release operation is trimmed so as to include a common part such as the face of the subject so as to be a common part of a series of images.

  In order to confirm the composition and timing of shooting prior to shooting by the release operation, the image of the subject obtained by the imaging means 12 is subjected to image processing by the central processing circuit 14, and a live view image (through moving image) is displayed on the liquid crystal display 16. ) Is displayed. On the display means 16, not only the live view image before photographing but also the image signal in the memory 18 are expanded and displayed for reproduction by the central processing circuit 14. For example, the display unit 16 includes a liquid crystal display (LCD), and is provided on the back surface of the digital camera 10 (opposite side to the subject; photographer side). An organic EL display or the like may be used as the display unit 16 instead of the liquid crystal display.

  A liquid crystal display (display means) 16 is provided so as to be able to swing on the side instead of the back of the imaging device 10, and the live view image can be displayed not only from the side but also from the back and front (subject side) by swinging the liquid crystal display back and forth. It may be observable.

  A central processing circuit (control means) 14 that processes the captured image from the imaging means 12 is composed of, for example, a CPU, an MPU, and the like. Although not shown, a still image processing unit that processes still images and a moving image processing unit that processes moving images. And a mode switching unit that determines whether to process still image processing or moving image processing and switches the shooting mode. The captured image is selectively processed by the still image processing unit and the moving image processing unit, and is stored in the memory 18. To be recorded.

  A touch panel (gripping detection means) 17 is provided on the screen surface of the liquid crystal display 16. For example, a mode menu including a still image mode, a moving image mode, and a playback mode is displayed as an icon on the liquid crystal display 16. The mode is switched to the touched icon mode. The still image is processed by the still image processing unit, and the moving image is processed and recorded by the moving image processing unit. If the touch panel 17 is touched to switch to the playback mode, the captured images are displayed as indexes on the liquid crystal display 16, and a desired captured image is reproduced and displayed by touching and selecting the touch panel.

In addition to the original function of selecting the mode from the mode menu displayed on the liquid crystal display 16 and switching the mode, the touch panel 17 is specifically used as a sensor for detecting an operation for taking a picture. It also functions as a grip detection means for detecting.
That is, when the photographer holds the digital camera 10, the liquid crystal display 16 has a large screen whose screen extends to the vicinity of the side edge of the digital camera 10 so that the photographer's finger is touched. A touch panel 17 is provided.

  In the present invention, when the digital camera 10 is taken out from a storage location such as a pocket or a bag under certain conditions, photographing before the release operation (pre-photographing) is started. The waste of energy is prevented by stopping power supply to the members.

When the photographer holds and lifts the digital camera 10, the digital camera is taken out of the storage location. Therefore, when the photographer holds the digital camera 10 and the finger touches the screen of the liquid crystal display 16, the touch panel 17 detects the touch of the liquid crystal display, thereby detecting the holding of the digital camera. In other words, the touch of the touch panel 17 is one of the operating conditions for photographing.
Since the touch panel 17 is arranged on the screen surface of the liquid crystal display 16 and functions as a grip detection unit, the grip position of the digital camera 10 can be accurately detected from the touch position on the screen of the liquid crystal display. When a touch in the direction in which the digital camera 10 is lifted is detected, one of the operating conditions for shooting is satisfied.

  If the screen of the liquid crystal display 16 cannot be enlarged by design and it is difficult to touch the screen of the liquid crystal display 16 even if the digital camera 10 is gripped, a touch switch is arranged near the side edge of the digital camera 10. The grip of the digital camera may be detected. That is, the touch switch may be individually provided as a grip detection unit. Even in a configuration in which the touch switch is a grip detection means, the grip position can be accurately detected.

Even if energy waste is prevented, it is difficult to capture images without missing a photo opportunity if detection accuracy is low, and it is necessary to prevent energy waste while maintaining detection accuracy. Therefore, as described later, in order to prevent waste of energy, energy is first supplied to a sensor system such as a touch panel (gripping detection unit) 17 and an acceleration sensor (acceleration detection unit) 26 that consumes less energy for photographing. The detection accuracy is improved by supplying energy to those that consume large amounts of energy in sequence. Then, until it is determined that the camera is ready for shooting, energy is not supplied to the display system (liquid crystal display 16) that consumes a large amount of energy, and the liquid crystal display is turned on after the ready operation for shooting is determined. This prevents energy waste.
In addition, stepwise detection is adopted in which when one operation for photographing is detected, the next operation is detected. If a possibility of erroneous detection is determined during the detection, the sensor that has already moved The energy supply to the blocks such as the system and the imaging system is stopped and initialized to prevent waste of energy.

The energy supply to the constituent members of the digital camera 10 is finely controlled by the central processing circuit 14, and the central processing circuit has three power supply control units 14a, 14b, and 14c.
The first power supply control unit 14a supplies energy to the display system (liquid crystal display 16) having the largest energy consumption among the constituent members, and the second power supply control unit 14b has an imaging system (image sensor, face) having the next largest energy consumption. The third power supply control unit 14c controls the supply of energy to the sensor system such as the touch panel 17 and the acceleration sensor 26 that consume relatively little energy.
The third power control unit 14c controls the supply of energy to the touch panel 17 and the acceleration sensor 26, confirms that the operation is for photographing, and then performs the energy supply control to the second power control unit 14b. Thus, it is possible to acquire an image before the release operation, and finally, supply of energy is controlled by the first power supply control unit 14a.

  Since the power control unit of the control means is subdivided into three parts of the first power control unit to the third power control units 14a to 14c, the energy supply can be finely controlled, and the display system (liquid crystal display 16) and the imaging system By efficiently supplying as much energy as necessary to the image sensor (the image sensor, the face detection unit 12b, etc.) and the sensor system (touch panel 17, acceleration sensor 26, etc.), energy consumption can be minimized.

  The central processing circuit 14 further includes an acceleration determination unit 14d. The acceleration determination unit is controlled by the third power supply control unit 14c, supplies energy to the acceleration sensor 26, and determines acceleration (gravity) in the vertical direction (Y-axis direction). A change is detected and a condition for shooting (presence of a sudden change) is determined.

In order to control photographing (pre-photographing) before the release operation that is started when the digital camera 10 is taken out from the storage location, the central processing circuit 14 includes a focus control unit 14e, an AE control unit (automatic exposure control unit) 14f. A trimming control unit 14g, an image selection control unit 14h, and an image association control unit 14i.
In the present invention, photographing (pre-photographing) before the release operation starts from the time when the digital camera 10 is grasped and taken out from the storage location, and is performed while moving the digital camera, not in a stationary state in a photographing posture. , With focus, exposure, composition, etc., with camera shake. It has been devised so as to enable the best possible shooting even in such pre-shooting under adverse conditions.

  The focus control unit 14e controls the zoom lens (photographing lens) 12a so that the subject (or the face of the subject if the subject is a person) is focused from the image output from the image sensor. However, since there is a possibility of missing a shooting opportunity if the focus is accurately set during pre-shooting, the zoom position is controlled with a wide angle of view and depth of focus, and the focus is controlled with a fixed focus of 2 to 3 m.

The AE control unit 14f controls to obtain an appropriate exposure regardless of whether the surrounding is bright or dark by switching the integration time of the image signal obtained by the image sensor. Whether the exposure of the range of the image is appropriate may be controlled so that the exposure of the face of the subject is appropriate according to the determination if the face detection unit 12b detects and determines the face of the subject. Exposure control may be performed so that the entire image is appropriate by photometry.
However, if an accurate operation such as detecting a face at the time of pre-photographing is performed, there is a possibility that a photographing opportunity may be missed, so control is performed with average photometry.

  Since the image (pre-photographed image) that was taken and taken from the storage location until it was held in the shooting posture was shaken and the composition was uncertain, the entire image was used without using the entire image. It is preferable to cut out (trim) the part and use the trimming control part 14g. The trimming control unit 14g compares the inclination of the pre-photographed image with the pre-photographed image and corrects the tilt so that the pre-photographed image is in the same state as the photographed image in the release operation. Is obtained.

  The image selection control unit 14h can withstand viewing except for pre-shooted images that are not appropriate (failed images) such as images that are extremely blurred due to the relationship with the subject, images that are out of focus, or images that are disturbed in exposure. An image is selected. Since the image selection control unit 14h selects an image and deletes (cancels) the failed image, waste of the recording capacity of the recording unit 18 can be avoided.

  The image association control unit 14i associates the pre-photographed image with the photographed image by the release operation, and a series of associated images (pre-photographed image + photographed image by the release operation) is stored in the same folder. Since it is centrally managed and recorded in a management file, it can be managed collectively and management and indexing can be performed easily.

  The communication unit 22 includes a USB terminal, a wireless transmission / reception unit, and the like. The captured image data recorded in the memory 18 is output to an external display unit such as a TV or another imaging device via the communication unit. Captured image data recorded in another imaging device is input via the communication means.

  The switch operation determining means 24 detects the photographer's switch operation such as the release switch 28a (see FIG. 2D), and the detection result is output to the central processing circuit 14 and the control corresponding to the switch operation in the central processing circuit. Is made. For example, when the operation (release operation) of the release switch 28 a is detected by the switch operation determining means 24 and determined by the central processing circuit 14, a still image or a moving image image processed is recorded in the memory 18.

  In the present invention, pre-photographing is performed before the camera is held, and the power supply of the digital 0 is automatically turned on before the release operation is performed. Therefore, a power switch (power switch) for setting the photographing enabled state is not necessary. . However, a power switch may be provided for manual operation because the power supply cannot be automatically started unless a predetermined condition is satisfied.

The acceleration detection means 26 comprises, for example, an acceleration sensor with a built-in comparator 26a, detects acceleration (including vibration and gravity), and the detection result is output to the central processing circuit 14 to determine the movement and posture change of the digital camera. The The comparator 26a operates with a weak current and, when detecting a large acceleration (for example, an acceleration of about 3G), generates a pulse signal and outputs it to the central processing circuit 14 to activate the acceleration determination unit 14d. When the acceleration determination unit 14d is activated, the acceleration sensor 26 finely detects even a small vibration (acceleration) caused by a camera shake occurring at the time of photographing, and the detection result is output to the central processing circuit 14.
Under the control of the central processing circuit 14, not only the camera shake is corrected from the detection result from the acceleration sensor 26, but also the vibration and tilt of the digital camera 10 are detected finely. That is, the movement of the digital camera 10 that is gripped and lifted from the storage position can be accurately determined.

  In the acceleration sensor 26 without a built-in comparator, the acceleration sensor is operated at predetermined intervals to detect gravity (acceleration). For example, it is possible to efficiently detect acceleration (gravity) changes while avoiding energy consumption by intermittently detecting gravity at a cycle of once per second.

  When the pulse signal from the comparator 26a of the acceleration sensor is received, the acceleration determination unit 14d of the central processing circuit operates, and the acceleration sensor 26 detects a small acceleration change under the control of the acceleration determination unit, and from the detection result. The central processing circuit determines the posture change of the digital camera. Under the control of the acceleration determination unit 14d, the energy supply of the acceleration sensor 26 with a built-in comparator can be efficiently supplied with a difference, and waste of energy can be prevented.

The switch group 28 includes a release switch 28a (see FIG. 2D) and the like, and when the switch is operated, the switch operation is detected by the switch operation determining means 24 and the corresponding processing is controlled by the central control circuit 14. Originally set.
Since the mode menu is displayed as an icon on the liquid crystal display 16 and the mode is changed by touching the touch panel 17 on the liquid crystal display, a menu key relating to mode change, a determination key (OK key), a zoom switch, a strobe switch, etc. Switches are omitted. However, these switches may be provided to use both mode change by switch operation and mode change by touching the touch panel 17.

  An image that has been shot with a still image or a moving image and recorded in the memory 18 is reproduced by the central processing circuit 14 and displayed on the liquid crystal display 16 on the back of the digital camera, and the shooting result is immediately confirmed. The captured image can be reproduced and displayed by connecting the digital camera 10 to an external display means such as a TV via the communication means 22.

  According to the present invention, a natural series of operations of holding and holding the digital camera 10 is detected, and energy is supplied to the imaging means 12 during the lifting operation to start shooting. Therefore, even if it encounters a photo opportunity before holding it, it can respond sufficiently, and it can shoot without missing. In addition, since the image before the image taken by the release operation is taken in time series, a series of movements of the subject can be recorded and enjoyed, and the enjoyment after the photography is increased.

FIGS. 2A to 2E are conceptual diagrams of photographing of the digital camera according to the present invention. With reference to FIG. 2, pre-photographing of the digital camera according to the present invention will be described according to a specific use situation. To do.
In order to start pre-photographing, the power source of the digital camera 10 must be turned on, and the photographing condition and the starting condition are inseparably integrated.

  A. When it is stored in a shoulder bag (bag) B of a walking woman (photographer; user), the digital camera is turned off (see FIG. 2A).

B-D. One of the start-up conditions is that the photographer searches for the digital camera in the bag B for photographing, grasps, grasps and lifts it up (see FIGS. 2C and 2D). reference).
When the digital camera 10 is gripped and lifted, an upward acceleration is generated, and this motion is detected by the acceleration sensor (acceleration detection means) 26.
Here, it is not possible to conclude that it is an operation for photographing only by an upward acceleration. For example, upward acceleration may occur even when the digital camera 10 that gets in the way to take out a handkerchief or the like is removed. Therefore, the intention to shoot (shooting conditions) is determined by combining the lifting operation with the gripping operation of the digital camera and the determination of the grip position.

  In order to lift the camera in consideration of shooting, it must be grasped and gripped as a premise, and the grip of the digital camera in the lifting direction (upward direction opposite to the direction where gravity is applied) is also detected. For example, when the grip of the right side (grip part) 10R of the digital camera is detected and the right side of the digital camera is gripped in the illustrated example, the right side of the screen of the liquid crystal display 16 is detected. This touch is detected by the touch panel (gripping detection means) 17.

  That is, when the digital camera 10 is gripped and lifted, it is considered that the photographer takes out the digital camera from the bag B for shooting, and this operation (gripping operation + lifting operation) is one of the start-up conditions. The gripping of the digital camera is detected by the touch panel 17, and the lifting is detected by the acceleration sensor 26.

  E. An operation for taking out the digital camera 10 from the bag (by rotating it clockwise as viewed from the photographer) and setting it for photographing is one of the startup conditions. For photographing, the digital camera is normally held horizontally as shown in FIG. 2E, and is in a horizontal posture (horizontal posture). For this reason, if it is held horizontally, it is determined as a posture for photographing, and other postures are not considered as postures for photographing. For example, even if accidents overlap and other conditions are satisfied, it is not determined that the operation is for shooting unless the robot is held horizontally. The posture of the digital camera 10 is detected by the acceleration sensor 26.

Note that the camera may be held vertically for vertical shooting, and the vertical posture held vertically may be detected as a shooting operation.
However, many photographs are taken in a horizontal posture, and it is assumed that the right side (grip portion) 10R of the digital camera is held, and the digital camera is held in a vertical posture and lifted. Therefore, assuming that the digital camera is held horizontally, the digital camera is rotated from the vertical position to the horizontal position, and the acceleration (gravity) generated in the digital camera changes abruptly, and this sudden change in acceleration can be easily detected and determined. It is easy to detect and determine a series of movements that are grasped and taken out.

  As described above, gripping of the digital camera 10 on the right side of the screen is detected by the touch panel 17 and the operation of lifting and holding the digital camera is detected by the acceleration sensor (acceleration detecting means) and output to the central processing circuit 14 for determination.

In the present invention, pre-shooting is performed from the time when the digital camera 10 is held and taken out before being set for shooting, that is, from the time of FIG. Even if you encounter a photo opportunity, you can handle it, and you can shoot without missing.
Here, the description has been made assuming a digital camera that can shoot immediately without requiring the photographer (user) to perform a special operation. However, a digital camera provided with a dedicated power switch may be used. Needless to say, the concept of the present invention can be applied even when holding the dedicated switch.

3A to 3C are basic conceptual diagrams of the present invention. The digital camera 10 is stored in a shirt pocket (chest pocket). In order to hold the digital camera 10 and raise it immediately in a shooting posture when a photo opportunity is encountered, it can be stored in a pocket in a vertical posture with the right side (grip) facing up.
The digital camera 10 is stored in a pocket in a vertical posture with the right side (grip part) 10R up (see FIG. 3A), and the photographer grips and lifts the right side of the digital camera with his right hand, If it is rotated in the direction, it can be immediately held in the photographing posture (lateral posture) (see FIGS. 3B and 3C).
In the operation (in the middle) indicated by the arrow in FIG. 3C until the digital camera 10 in the vertical posture is gripped and lifted and held in the horizontal posture, the digital camera is activated and pre-photographing is performed in the present invention. . The operation (change) from the vertical posture to the horizontal posture can be quickly performed because it can be naturally performed in an extremely smooth movement of holding and holding the digital camera 10 in the pocket of the left chest with the right hand. And since pre-photographing is performed in this quick operation, it is possible to fully cope with a shutter chance before holding, and it is possible to shoot without missing.

  In pre-shooting, shooting is performed with a small number of pixels. Therefore, waste of the recording capacity of the recording unit 18 can be prevented, and the number of shooting frames in a predetermined time can be increased, so that shooting is not missed.

  Pre-photographing is not always performed if the digital camera 10 is grasped and taken out, but pre-photographing is performed only under certain conditions, and pre-photographing is not performed even if the digital camera 10 is grasped and taken out without satisfying predetermined conditions. Therefore, normal shooting that can only be performed when the release operation is performed can also be performed.

Pre-photographing is premised on a situation in which it is desired to shoot immediately upon encountering a shutter opportunity, and is performed when the digital camera is grasped and lifted in a state where photographing can be started immediately. For example, (1) a predetermined position (right side; grip portion) of the digital camera 10 in the vertical posture is lifted and (2) the digital camera 10 stored in the vertical posture is held in the horizontal posture and the operation is urgent. When a large acceleration change is caused by the pre-photographing, the pre-photographing is not performed otherwise.
For example, if the posture is changed from a vertical posture to a horizontal posture under a slow motion that does not cause a large change in acceleration, pre-shooting is not performed, and normal shooting (taken when a release operation is performed) is performed. Yes.

  Also, in the detection and determination of a series of operations until pre-photographing is started, energy is sequentially supplied only to the indispensable blocks for detection and determination so as not to consume as much energy as possible. Specifically, in shooting before the release operation, energy is supplied only to imaging means necessary for shooting, and energy is not supplied to display means that consume a large amount of energy. Can prevent energy waste. If it is determined that the set condition is not satisfied, energy is supplied to immediately initialize all the blocks activated so far to avoid wasting energy.

4A to 4D show examples of acceleration (vibration, gravity) detection by the acceleration detection means.
The acceleration detecting means (acceleration sensor) 26 is formed of, for example, a MEMS element using a semiconductor manufacturing process. As shown in FIG. 4A, the upper electrode 26U having a substantially king shape and a fixed bottom having a substantially two shapes are provided. In combination with the electrode 26L, the movable electrode 26U having the arm portion 26Uc formed in a bridging structure changes relative to the pair of fixed lower electrodes formed on the chip surface by acceleration. .

  In the operation detection means (acceleration sensor) 26 having such a configuration, the movable upper electrode 26U is deformed in the direction of acceleration in the plane in which the movable upper electrode 26U is located, and the relative position with respect to the fixed lower electrode 26L changes by shaking. Since the output waveforms from the upper and lower electrodes change corresponding to the change (vibration) of the relative position, the direction of acceleration can be detected from the output waveform.

  As shown in FIG. 4B, the X axis is in the horizontal direction orthogonal to the optical axis (imaging optical axis) of the photographic lens 12a, the Y axis is in the vertical direction orthogonal to the photographic optical axis, and the horizontal direction is parallel to the photographic optical axis. The digital camera 10 has three operation detection means (acceleration sensors) 26 so that acceleration can be detected in three dimensions of XYZ. The acceleration sensor 26X that detects acceleration in the X-axis direction is a connection electrode that connects two parallel electrodes of the movable electrode 26U in parallel with the X-axis, and the acceleration sensor 26Y that detects acceleration in the Y-axis direction is a connection electrode. The acceleration sensor 26Z that detects acceleration in the Z-axis direction in parallel with the Y-axis is arranged so that the connecting electrode is in parallel with the Z-axis.

  Assuming that the acceleration sensor in FIG. 4A is an acceleration sensor 26Y in the Y-axis direction, when the digital camera 10 is moved in the arrow direction Y, the acceleration sensor 26Y in the Y-axis direction detects it. For example, a waveform of acceleration (vibration) in the Y-axis direction as shown in FIG. 4C is output, and the direction of the first generated waveform corresponds to the direction of acceleration. When the arrow Y 'is moved in the reverse direction, an acceleration (vibration) waveform that is inverted up and down with respect to the waveform of FIG. 4C is output (see FIG. 4D).

  In this way, if the acceleration sensor 26Y that detects the acceleration and outputs the waveform and the direction of the waveform that occurred first in the output waveform of the acceleration sensor are detected, the acceleration is detected on the Y axis from the detection result. Whether the digital camera has been added in the plus Y (+ Y) direction, the minus Y (−Y) direction, or in other words, whether the digital camera has moved up or down is determined.

Similarly, the acceleration direction (X (+ X), X ′ (− X) or Z (+ Z), Z ′ (− Z)) applied on the X axis outputs a waveform, and its output waveform (The direction of the first generated waveform). Then, by arranging the three acceleration sensors 26 (26X, 26Y, 26Z), the direction of acceleration is detected three-dimensionally. In particular, the direction of acceleration on the XY plane is determined from the acceleration sensors 26 (26X, 26Y) in the X-axis direction and the Y-axis direction, and the movement of the digital camera 10 on the XY plane is detected and determined. That is, an operation from a vertical posture to a horizontal posture as indicated by an arrow in FIG. 3C is detected and determined.
Since the motion from the vertical posture to the horizontal posture indicated by the arrow in FIG. 3C is detected by the acceleration sensors 26X and 26Y, the acceleration sensor 26Z in the Z-axis direction may be omitted.

An inclination detection means 30 such as an inclination sensor for detecting the inclination of the digital camera 10 may be provided, and the inclination of the digital camera 10 may be detected by the inclination detection means.
5A and 5B show an example of a tilt detection method by the tilt detection means.
The tilt detecting means 30 is configured such that the Hall element 30a and the magnet 30b are combined, and the Hall element detects a magnetic field change of the magnet corresponding to the change (tilt) of the posture of the digital camera 10.
That is, a substantially U-shaped support arm portion 30c is rotatably supported by a horizontally disposed shaft 30d, a partial annular permanent magnet 30b is held at the tip of the support arm portion, and the Hall element 30a is one of the magnets. It is placed in a position that overlaps the part.

If the digital camera 10 is held horizontally without tilting, the magnet 30b hangs around the horizontal shaft 30d due to its weight, and as shown in FIG. Are aligned with the Hall element 30a.
As shown in FIG. 5B, when the digital camera 10 is tilted about the photographing optical axis direction, the magnet 30b rotates to cause a magnetic field change, and this change is detected by the Hall element 30a. Then, the detection signal of the Hall element 30a is output to the central processing circuit 14, and the change (tilt) of the posture of the digital camera is determined.
If such a change in inclination is detected and determined, an operation from the vertical posture to the horizontal posture is detected and determined.

The tilt detection means combining the Hall element and the magnet is an example, and the tilt may be detected from a hand shake detection gyro or a mercury switch.
Further, it may be determined whether or not the posture of the digital camera 10 has changed from the change in the image on the image sensor, and the inclination may be detected by an acceleration sensor or an angular acceleration sensor.

6A and 6B are schematic sectional views of a liquid crystal display.
As shown in FIG. 6A, the liquid crystal display 16 includes a liquid crystal display element 16a and a backlight 16b, whereas the touch panel 17 includes an optical sensor 17a attached to the liquid crystal display element. Light from the backlight 16b is irradiated upward.
When the digital camera 10 is gripped (see FIG. 2D), the photographer's thumb F touches the screen of the liquid crystal display 16 to cover the screen of the liquid crystal display. Reflected and reflected light is input to the optical sensor 17a (see FIG. 6B). Therefore, the touch panel 17 detects where the finger is located from the sensor 17a that receives the light of the backlight 16b reflected by the photographer's finger F, that is, which part of the digital camera is being held.
In the present invention, when the touch panel 17 is touched at the right end portion of the liquid crystal display, it is determined that the grip at a predetermined position, that is, the right side (grip portion) 10R of the digital camera is gripped.

FIGS. 7A to 7C respectively show the output of the acceleration detection means, the touch on the touch panel, and the start timing of shooting in the usage state of FIG.
A. If the digital camera 10 is stored in a horizontal posture while walking in the bag B, the bag shakes considerably, so the digital camera 10 in the bag also moves up and down with the bag at a substantially predetermined cycle. In addition, the digital camera 10 positioned horizontally in the horizontally long bag is shaken in a substantially constant large period in the X direction parallel to the course direction. Further, the digital camera slightly shifts in the bag thickness direction (Z-axis direction). Therefore, during walking, the acceleration sensors 26X, 26Y, and 26Z detect gravity (acceleration) with a substantially constant amplitude and a substantially constant frequency in the XYZ axial direction.

B. When the vehicle stops (see FIG. 2B), the movement of the bag containing the digital camera 10 disappears, no noticeable gravity fluctuation is detected, and the amplitude is almost eliminated.
C. When the user stops and searches for and lifts the digital camera 10 in the bag (see FIG. 2C), a large gravity is applied to the digital camera, resulting in a large gravity fluctuation. That is, since the digital camera 10 positioned substantially horizontally is tilted by 90 degrees and taken out substantially vertically, the acceleration in both the X-axis direction and the Y-axis direction changes abruptly as shown by the dashed ellipse, and gravity The force that repels is detected as acceleration, and the output waveform changes greatly.
If the peak of the output waveform (as indicated by a broken line ellipse) that occurs when the digital camera 10 is taken out is detected by the comparator 26a of the acceleration sensor and a pulse signal is output, it does not depend on the determination in the central processing circuit 14. The removal operation can be determined.

D. When the grip part (right side part) 10R of the digital camera is gripped, gripping of the grip part is detected by the touch panel 17 detecting it and changing the output (see FIG. 7B).
Detection of gripping of the grip portion 10R by the touch panel 17 is one of the conditions for turning on the power, that is, the condition for supplying energy.

  When it is determined that it is gripped and lifted, in other words, when it is determined that the posture is changed from the vertical posture to the horizontal posture as shown by the arrow in FIG. 7A, photographing (pre-photographing) is started. (See FIG. 7C).

FIG. 8 shows a flowchart of the imaging control of the present invention in the usage situation of FIG. This flowchart is an example of the imaging control of the present invention in the usage situation of FIG. 2, and the imaging control in the usage situation of FIG. 2 is not limited to this.
Here, as shown in FIG. 2, it is assumed that the digital camera stored in the bag is taken out for shooting, and pre-shooting is performed while avoiding erroneous determination as much as possible to prevent waste of energy. It is devised to do it efficiently.

First, the acceleration (gravity) is detected by operating the comparator 26a of the acceleration sensor (acceleration detection means) in S101. In the acceleration sensor 26 without a built-in comparator, gravity (acceleration) is detected by operating the acceleration sensor at predetermined intervals in order to avoid energy consumption. For example, gravity (acceleration) is detected intermittently at a cycle of once per second.
An output waveform of gravity in the XYZ axial direction in the photographing operation is recorded in advance in the central processing circuit 14 as a reference waveform, and this reference waveform is, for example, the waveform shown in FIG. ) Is a unique waveform that is surrounded by a dashed ellipse.

  The detection result in S101 is output to the central processing circuit 14, and the gravity waveform is compared with the reference waveform in S102. Then, it is detected whether or not there is a large variation in the amplitude of gravity in any of the XYZ axial directions. If there is no fluctuation in the amplitude of gravity, for example, it is determined that there is no change as it is stored in the bag, and the process returns to S101. Every time the process returns to S101, the acceleration sensor 26 is initialized (including the built-in comparator 26a), so that waste of energy is prevented.

  If there is a large variation, it is considered that there has been some change, and in S103, it is determined (determined) whether the digital camera 10 is touched (gripped) by supplying energy to the touch panel 17 for a moment. As a touch, first, it is determined in S104 whether the right side of the screen of the liquid crystal display 16 (corresponding to the grip portion (right side) of the digital camera) has been touched. By instantaneous energy supply to the touch panel 17, power consumption slightly increases (slight increase in power consumption).

If there is no touch on the right side of the screen of the liquid crystal display 16 in S104, the process branches to S106 to determine whether the left side of the liquid crystal display is touched. If the left side of the liquid crystal display is not touched, the process returns to S101.
In other words, if there is no touch on the right side of the screen of the liquid crystal display 16 (when gravity is applied to the left side), and there is no touch on the left side of the screen (when gravity is applied to the right side), the rapid fluctuation of gravity in S102 is the action of the photographer. For example, the movement of the bag containing the digital camera 10 is ignored.

If the left side of the screen of the liquid crystal display 16 is touched in S106, it is considered that the left side of the digital camera is gripped, and whether or not there is a significant change in the gravity of the right side (grip part) 10R of the digital camera on the opposite side. Is detected in S107. If there is a large change in the gravity of the right side portion 10R, it is determined that the digital camera 10 has been lifted with the left side of the liquid crystal display 16 held and the right side portion 10R facing down. That is, it is determined that the gravitational direction (the right side of the digital camera) and the opposite side (the left side of the digital camera 10) are gripped and lifted, and the process proceeds to S108.
Even if the left side (left side) of the digital camera is gripped, if there is no significant change in the gravity of the right side 10R, it is not determined that the right side is lifted down. It is disregarded as a movement or a movement that shifts within.

  If it is determined in S104 that the right side of the screen of the liquid crystal display 16 is touched and the grip portion (right side) 10R is gripped, whether or not a large gravity change has occurred on the opposite side, that is, the left side of the digital camera 10, is determined in S105. To be judged. If a large gravity change occurs on the left side of the digital camera 10, the grip portion 10 </ b> R on the opposite side (the right side of the digital camera 10) to the direction of gravity (the right side of the digital camera 10) is gripped and the left side of the digital camera 10 is lowered. If it is determined that it is lifted, the process proceeds to S108.

If it progresses so far, possibility that it is the operation | movement which hold | grips and lifts the digital camera 10 for imaging | photography will become high. Therefore, the energy supply to the acceleration determination unit 14d for the acceleration sensor 26 is increased so that the gravity in the XYZ axial directions is detected in S108 at a period finer than S101, and the power consumption increases (power consumption increase 1 ). By detecting gravity at a fine cycle, it is possible to detect fine vibrations (gravity changes) such as camera shake.
At this stage, the posture (movement) of the digital camera 10 may be determined by detecting the tilt of the digital camera 10 by the acceleration sensor 26 or by the tilt detecting means 30 (see FIG. 5).

  If there is no touch on the right side of the screen of the liquid crystal display 16 in S104, it may be determined that the operation is not the operation of grasping and lifting the digital camera 10, and the process may return immediately to S101 without performing S106 and S107.

  It is determined whether the grasped (touched) digital camera 10 has been lifted. First, since the digital camera 10 is suddenly lifted and held when a photo opportunity is encountered, whether or not there has been a sudden change in gravity (acceleration) in the Y-axis direction (vertical direction) in S109a, that is, gravity in the Y-axis direction. It is judged whether or not there has been a rapid increase. If there is no sudden change (increase) in the gravity (acceleration) in the Y-axis direction, it is determined in S109b whether the change in gravity is moderate.

If the change in gravity is slow, it is determined that the camera is not ready to hurry when it encounters a shutter opportunity, but is ready to shoot for normal (non-urgent) shooting. The energy is supplied to the imaging system (imaging device, face detection unit 12b) and the power consumption increases (power consumption increase 2).
If there is neither an abrupt gravity change nor a gradual gravity change, there is no intention to lift the digital camera 10 and it is determined that the touch on the left side (left side) of the digital camera is not for shooting, and the process returns to S101. .

  In this way, if the photographer encounters a photo opportunity and wants to perform pre-photographing, he / she should hurry to lift the digital camera 10 to generate a sudden change in the gravity (acceleration) in the Y-axis direction (vertical direction). If there is no need for pre-photographing, it may be lifted gently without causing a rapid change in the Y-axis direction, and the photographing method can be arbitrarily selected according to the situation.

  For example, if the gravity in the Y-axis direction is abrupt or gradual, for example, if there is a gravity change of about 3G, it is determined that there is a sudden change, and even if there is a change in the gravity in the Y-axis direction, the value is 3G or less. If so, the pre-shooting is not started because it is judged that the gravity changes moderately. This 3G is an example and is not limited to this value.

  By supplying energy to the imaging system in S110, it is possible to detect the subject by the face detection unit 12b, and it is determined in S112 whether it is appropriate for photographing. When a person's face or the like is detected as a subject and it is determined that the situation is appropriate for photographing, energy is supplied to the display system (liquid crystal display 16) that consumes a large amount of energy in S113. Note that the determination in S112 as to whether or not it is appropriate for shooting will be described later with reference to FIG.

  Then, the image of the subject obtained by the imaging means 12 is displayed as a live view image on the liquid crystal display 16, and the release operation can be taken while looking at the liquid crystal display. The zoom lens 12a is set to the wide side.

  Energy is supplied to the liquid crystal display 16 to increase the power consumption (power consumption increase 3), and the power consumption reaches the maximum value. However, the power consumption (maximum value = slight increase in power consumption + power consumption 1, 2, 3) is only the same value as the power consumption when the power switch is turned on for shooting in a conventional digital camera, At the last stage, it was only general power consumption.

  If there is a sudden change in gravity in S109a, it is determined that the digital camera 10 has been suddenly lifted and held by holding a photo opportunity, and energy is supplied to the imaging system (imaging device, face detection unit 12b) in S111. Turns on and pre-shooting starts. That is, image recording is started even before the release operation, and the image is recorded (temporarily recorded) in the recording means 18. Further, the inclination and vibration of the image detected by the acceleration sensor 26 are recorded as image data together with the image, and the common part of the subject can be trimmed by recording the inclination of the image. Further, by storing vibration, it becomes possible to select images, and images that are so large that camera shake cannot be corrected are omitted.

In pre-photographing, as shown in FIG. 3, the digital camera 10 is moving from a vertical posture to a horizontal posture, and it is difficult to perform focusing (focusing) and exposure accurately. Therefore, in pre-photographing, for example, the focus is a fixed focus of 2 to 3 m, and the exposure is average photometry. In addition, it is preferable to shoot a rougher image than usual by reducing the number of pixels. Since shooting is performed with a predetermined focus and exposure and a reduced number of pixels, shooting before the release operation can be performed smoothly, regardless of shooting during movement such as lifting.
Then, in S112, it is determined whether or not it is suitable for photographing. When a person's subject is detected as described above and it is determined that the situation is suitable for photographing, energy is supplied to the display system (liquid crystal display 16) in S113. Thus, preparation for shooting by the release operation is completed.

  FIG. 9 shows an example of a subroutine for determining whether or not it is suitable for photographing in S112. Whether or not shooting is appropriate is determined from the acceleration (gravity) detected by the acceleration sensor 26 whether the digital camera 10 is correctly held, that is, whether it is in a horizontal composition (horizontal posture) or a vertical composition (vertical posture). The

First, in S201, it is determined whether the composition is horizontal, and if it is not a horizontal composition, whether it is vertical composition is determined from the acceleration (gravity) detected by the acceleration sensor 26 in S202. If it is neither horizontal composition nor vertical composition, it is not ready for shooting and is determined to be malfunctioning (NG).
Here, not only the horizontal composition but also the vertical composition is considered. However, most of the shooting is performed in a horizontal composition, and the digital camera 10 in a vertical posture is held and lifted, and if it is held in a horizontal composition, the posture changes from a vertical posture to a horizontal posture (horizontal composition). Since the gravity change is large and easy to detect, the determination of the vertical composition may be omitted in consideration of only the horizontal composition.

  If it is a horizontal composition or a vertical composition, the presence / absence of pre-photographing is determined in S203. If pre-photographing is performed, the image pre-photographed in S204 (pre-photographed image) and the image photographed by the release operation (release photographed image) In consideration of the continuity of the image, the focus and exposure are slowly converged (matched) over, for example, about 1 second so that there is no sudden change in the image. That is, the focus and exposure are converged over time from the initial values such as focusing at a predetermined distance and average photometry to the focus and exposure values determined by the face detection by the face detection unit 12b.

  If pre-photographing has not been performed, the process branches to S205 where the focus and exposure are adjusted. Here, since it is not necessary to consider the continuity with the pre-photographed image, the focus and exposure are quickly converged from the initial values to the focus and exposure values determined by the face detection by the face detection unit 12b. The

When focus and exposure are adjusted in S204 and S205, whether the composition prepared in S206 is stable is determined from vibrations for a predetermined time, for example, 1 second. If vibration (gravity fluctuation) having a small amplitude and a large frequency in the Y-axis direction or the X-axis direction is detected by the acceleration sensor 26 under the horizontal composition or the vertical composition, In step S207, a touch at a predetermined position is determined. If a touch at a predetermined position is detected by the touch panel 17, it is determined that the correct operation for shooting (OK).
FIG. 10 shows a rear view of the digital camera when it is in a horizontal posture and takes a horizontal composition. For example, as shown in FIG. 10, the grip portion (right side portion) 10R of the digital camera is held and the touch panel 17 is touched. If so, it is determined that there is an intention of shooting (correct operation for shooting).

  If no vibration (gravity fluctuation) having a small amplitude and a large frequency in the Y-axis direction or the X-axis direction is detected in S206, it is determined as a malfunction (NG). If a touch at a predetermined position is not detected in S207, a malfunction (NG) is also determined. Determined.

  Returning to the flowchart of FIG. 8, the description is continued, and it is expected that the digital camera 10 is still stored in the bag, for example, the face detection unit 12b does not detect the subject even if the posture is detected. If it is, it is determined that it is not suitable for photographing, and the process proceeds from S112 to S113 and waits for a predetermined time. The predetermined time is, for example, about 1 minute, and the passage of time is timed by a clock (clocking means) 20 having a stopwatch function.

If it is not determined that shooting is appropriate even after a predetermined time has elapsed in S114, the process returns to S112, and the sensor system is initialized including power supply control.
If there is an image taken in S111 before the digital camera 10 is properly held, it can be determined whether or not it is necessary. That is, the presence or absence of a pre-photographed image is determined in S115, and if there is a pre-photographed image, the display system is turned on and the photographing result is displayed in S116, and whether or not the photographer records it is determined in S117. If it is desired to record, it is recorded in S118.

  If not, the process proceeds to S119, and the determination in S117 is repeated whether or not to record until a predetermined time elapses. When the predetermined time elapses without recording, the imaging system is turned off and the pre-shooting is stopped in S120. The pre-photographed image recorded so far is cleared (erased), and the process returns to S101. The time necessary for determining whether or not to record (predetermined time in S119) is, for example, about 2 to 3 minutes.

FIG. 11 shows an example of images obtained continuously from the pre-photographing to the photographing by the release operation in the present invention.
For example, assuming that the digital camera 10 is held in a horizontal posture by holding and lifting the grip portion 10R of the digital camera stored in the vertical posture, the digital camera 10 changes its posture from the vertical posture to the horizontal posture as indicated by an arrow. Changes. For example, in terms of the tilt angle (rotation angle) with respect to the horizontal posture (horizontal posture), photographing (pre-photographing) is started at a tilt position of 65 degrees, the first image a is obtained, and a tilt of 40 degrees is obtained. The image b at the next timing of the position is obtained at the next timing at the tilt position of 20 degrees, and the image d is obtained when the release operation is performed in the horizontal posture.

By performing pre-photographing before the release operation in this way, a series of images from the images a, b, and c in pre-photographing to the image d at the time of the release operation can be obtained. These images a to d are related images obtained by photographing the same subject in time series, and are collectively recorded in the recording unit 18.
Usually, the pre-photographing is performed at a predetermined time interval (timing) from the start of photographing until a release operation is performed, and for example, photographing is performed at 20 to 40 frames / second.

FIGS. 12A to 12D are schematic diagrams showing trimming, and show how a maximum allowable image including a common subject is cut out (trimmed) from captured images.
For example, as described with reference to FIG. 11, shooting is started before the digital camera 10 is set up, and the image a in FIG. 12A becomes the next image b in FIG. 12B at the next timing. Images c in FIG. 12C are continuously photographed (pre-photographed) at the timing, and the image d shown in FIG.

  Since the images obtained from the pre-shooting to the shooting by the release operation are a series of related images obtained by shooting the same subject in time series, the face of the subject being run from the face detection of the shot image d by the release operation. When the upper body image (rectangular portion T surrounded by hidden lines) including the image is determined to be an image intended by the photographer, the pre-photographed images a to c are included so as to include a portion (common image) T common to the image. Is trimmed.

Here, pre-photographed images a to c are taken with the digital camera 10 tilted with respect to the image d obtained by performing the release operation in the horizontal posture. Similarly, the image needs to be corrected to a horizontal posture.
Therefore, as described in S111 of the flowchart of FIG. 8, the tilt angle of the image at the time of shooting detected by the acceleration sensor 26 is stored together with the image, and in trimming, the stored tilt angle is used correctly. The image is corrected to the image that was taken.

  Since the common image T is included and the tilt is corrected, in many cases, the trimmed image (trimmed image) includes a portion protruding from the screen (frame) of the liquid crystal display. For example, the upper left corner X1 and the upper right corner X2 of the common image T in FIG. For this reason, if the aspect ratio (aspect ratio) of the image is, for example, 16: 9, taking into account the portion protruding from the frame, the maximum and best image allowed by the aspect ratio including the common image T is Trimmed from pre-photographed images a to c. This trimming is performed under the control of the trimming control unit 14g of the central processing circuit.

FIGS. 13A to 13E show a series of images including common portions.
For example, the images a, b, and c in FIGS. 11 and 12A to 12C captured at a predetermined interval in the pre-photographing are trimmed so as to include the common portion T, and the image is held in the horizontal posture. The images Ta to Tc shown in FIGS. 13A to 13C are obtained after correction.

  Since these images (trimmed images) Ta to Tc obtained by trimming from an image photographed before holding are photographed at a predetermined interval, they are continuously shot images or moving images, and images photographed by a release operation are It becomes a still image. These series of images are recorded in association with each other by the image association control unit 14i of the central processing circuit as a series of images in which a common part of the upper body image including the face of the running subject is photographed in time series. The Since they are recorded in association with each other, they can be managed collectively, and management and search can be easily performed.

  In FIG. 13A, a part X1 and X2 of the image (trimming image) popping out from the frame may be left blank, or a wallpaper may be set as a background.

Of pre-photographed images, images that do not satisfy a predetermined condition, such as an out-of-focus image as shown in FIG. 13 (D), an image Td1 that is greatly blurred without correction, and a face image of a captured image obtained by a release operation. The image Td2 lacking the upper body image (common image) including the face of the running subject is selected and deleted (cleared) by the image selection control unit 14h of the central processing circuit.
The selection and deletion of an image that does not satisfy a predetermined condition by the image selection control unit 14h may be performed on a trimmed image or on an image before trimming.

As described above, not only the image e captured by holding and releasing, but also the images a to c captured (pre-capturing) until the positioning is performed, and the conventional shooting that starts pre-capturing after the holding is recorded. Compared to this, the number of missed shots is extremely small, and it is possible to fully cope with a photo opportunity.
In addition, the process up to the release shooting such as the time-series movement of the subject until the release shooting is recorded, and the enjoyment of reproducing the shot image is greatly increased. In particular, the photographer can photograph even the facial expression of the subject before he / she decides to shoot, such as the pre-shooting start image “a” before holding, and the enjoyment of the shot image increases.

  Although shooting after the release (post shooting) is not described, even after the release operation is performed, shooting for a predetermined time (post shooting) may be performed under the same conditions (same focus and exposure) as the pre shooting, for example. .

FIG. 14 shows an example of a subroutine after the display system is turned on in S113 of FIG.
When energy is supplied to a display system such as the liquid crystal display 16 (display means), it is determined whether or not a release operation is performed in S301. If there is no release operation, has a predetermined time elapsed since the branching to S321? Is judged. For example, the predetermined time is about 2 to 3 minutes. If a predetermined time elapses without performing the release operation, it is determined that there is no intention to shoot, pre-shooting is interrupted in S322, all the shot images are erased (cleared), and the process proceeds to S112 in FIG.

Of course, the pre-photographing may be continued as it is. In this case, when the camera is taken out from the pocket or bag, it is an emergency shooting mode, which is the specification of the digital camera 10 in which pre-shooting (moving-picture shooting) is continued. That is, when the camera is ready (when there is a rapid gravity change in the Y-axis direction), shooting is performed in the moving image mode.
Then, when the camera is slowly taken out and is operated by holding the power switch (when the gravity change in the Y-axis direction is gentle), a pre-shooting is not performed, and a digital camera having a specification for taking a still image is provided. That is, as with a general digital camera 10, when a power switch is operated, an ordinary digital camera is obtained. However, it can also be released as a digital camera with a new function that determines how to hold an emergency and moves to video shooting.

  If it is not ready for shooting in S321, the process directly proceeds to S112. In this case, if it is desired to record the pre-photographing result, it may be recorded in S118.

  If there is a release operation in S301 and the image is photographed in S302, the photographed image is temporarily recorded in the recording means 18 in S303, and the presence or absence of pre-photographing is determined in S304. The pre-photographed image is changed from the temporary recording to the official recording, and the process proceeds to S112.

  If it is determined in S304 that there is pre-photographing, an image of the subject's face taken is selected from the images pre-photographed in S305. That is, a pre-photographed image including a portion (subject's face) common to the image photographed by the release operation is selected.

  Then, in step S306, an image that is not suitable for storage, for example, an image with a large exposure difference or camera shake is deleted from the selected image. The image remaining after the two selections is trimmed in step S307 after correcting the inclination with respect to the photographed image in the release operation. The trimmed pre-photographed image is associated with the release-captured image in S308, is recorded together with the release-captured image, and the process proceeds to S112.

  After changing the order of S303 to S307 and correcting the tilt to obtain a trimmed image (corrected image), select a pre-photographed image including a common part and delete an image that is not suitable for storage. Also good.

  According to such a subroutine, an image taken while lifting the digital camera 10 (pre-photographed image) is an image worth recording even though it is incomplete, such as a portion having no image in the screen. Is obtained appropriately.

FIGS. 15A to 15E show examples of reproduction and display of captured images (release captured images and pre-captured images).
When an image (release photographed image) P1 photographed by the release operation is reproduced and displayed on the liquid crystal display (display means) 16 on the back of the digital camera, there are pre-photographed images (pre-photographed images), for example, images P01 to P03. For example, the pre-captured image P01 that is first captured is first displayed on the liquid crystal display (see FIG. 15A). Note that the pre-photographed images P01 to P03 are corrected images with corrected inclinations.
Then, the next pre-photographed image P02 is displayed on the liquid crystal display 16 with a part superimposed on the first pre-photographed image P01 (see FIG. 15B), and the next pre-photographed image P03 is pre-photographed. A part of the photographed image P02 is displayed so as to overlap (see FIG. 15C). When all the pre-photographed images P01 to P03 are displayed, the release-captured image P1 is displayed in an overlapped manner with a part superimposed on the top (see FIG. 15D).

  Thus, if the release photographed image P1 and the pre-photographed images P01 to P03 are reproduced and displayed together, the time-series process leading to the release operation can be recognized at a glance, and the time-series process is remembered. You can fully enjoy the images. In particular, if the images are displayed in the order in which the images are taken in a superimposed manner, the time-series process leading up to the shooting by the release operation can be recognized effectively.

If the touch panel 17 is touched at a position corresponding to the image displayed on the liquid crystal display 16, the image may be enlarged and displayed. For example, when the lowermost image in FIG. 15D, that is, the pre-photographed image P01 is touched, the pre-photographed image P01 is enlarged and displayed on the liquid crystal display 16 (see FIG. 15E). If the image is enlarged and displayed, the details of the image can be understood and the enjoyment of the photographed image is increased. Moreover, since it can be performed by touch, enlarged display can be performed easily and quickly. As can be seen from FIG. 15E, since the enlarged display is performed using the entire surface of the liquid crystal display 16, no image other than the touched image is displayed.
The specification may be such that if the user touches again, the original reduced image is restored.

Further, if the image to be printed is selected by touching on the liquid crystal display 16 as well as the release photographed image P1, the pre-photographed image can be printed without forgetting.
Immediately after shooting with the release operation or immediately after holding the digital camera (S116 in FIG. 8), the images from the pre-shooting to the shooting with the release operation are displayed in order of shooting, and the image to be formally recorded is selected by touching Also good.

  FIG. 16 shows an example of a flowchart of image reproduction. First, images taken by the release operation (release photographed images) are displayed as a list on the liquid crystal display 16 in S401, and images are selected from the list display (thumbnail) in S402. If there is no image to be selected, the process branches to S411, where it is determined whether or not to end the process. If it is determined that the process ends, the reproduction ends. If not, the process returns to S401.

  If an image is selected in S402, the presence / absence of a pre-photographed image (pre-photographed image) is determined in S403. If there is no pre-photographed image, S404 is skipped and the process proceeds to S405. The captured images are sequentially displayed from the first captured image. The image selected in S405 is displayed. Here, if the release photographic image has no pre-photographed image, only the release photographic image is displayed. If the release photographic image has the pre-photographed image, the release photographic image and the pre-photographed image are displayed. The images are displayed together.

The presence or absence of an image to be printed (printed) is determined in S406, and if there is an image to be printed, the image is touched, enlarged and displayed in S412 and the process returns to S407.
If there is no image to be printed in S406 (if there is no touch), the presence or absence of the next image (release photographed image) is determined in S407, and if there is a next image, the process returns to S403, and if there is no next image, in S408. It is determined whether to display the list. If the user wants to display a list, the process returns to S401 and the list is displayed. If the list display is not necessary, the process returns to S407 and S407 and S408 are repeated until there are no more release images.

  According to such a flowchart, a desired photographed image is appropriately reproduced and displayed, and printing can be appropriately performed. In particular, the image to be printed is enlarged and displayed, and the image to be printed can be sufficiently confirmed.

As described above, according to the present invention, since shooting is started in the operation of grasping and lifting the imaging device, even if a photo opportunity is encountered before holding, shooting can be performed without missing. In addition, since the image before the image taken by the release operation is acquired in time series, it is possible to record and enjoy a series of movements of the subject, and enjoyment after shooting increases. Since the inclination of the image acquired before the release operation is corrected, an image without a sense of incongruity can be obtained.
Of course, pre-shooting may be continued even after holding, and if pre-shooting is continued from the holding until the release operation is performed, the shutter chance before the release operation can be sufficiently handled after holding, and missed shooting is surely prevented. it can.

  The above-described embodiments are for explaining the present invention, and are not intended to limit the present invention. All modifications, alterations, etc. within the technical scope of the present invention are included in the present invention. Needless to say.

  For example, Embodiments 1 and 2 describe a case where a digital camera (imaging device) housed in a bag or (chest) pocket is taken out for photographing as a specific use situation. However, this is merely an example, and the usage situation is not limited to this. For example, it can be used in situations where it is required to be able to take pictures without performing complicated operations as much as possible, such as skiing, snowboarding, and bicycle riding. By detecting a similar operation, the digital camera is started up and pre-photographing is automatically started.

In the embodiment, shooting after the release (post shooting) is not described. However, after shooting by the release operation, for example, shooting after the release operation (post shooting) under the same conditions (same focus and exposure) as the pre shooting. Needless to say, you may do this. However, since there is almost always a shutter chance before the release operation, and there is almost no missed shooting by performing the pre-shooting, the shooting after the release operation may be omitted.
For example, a mode key (post shooting key) that switches between a mode for shooting after the release operation (post shooting mode) and a mode that does not (post shooting mode) is provided, and the mode without post shooting is set as the initial mode. If post shooting is desired, the mode key may be switched to the post shooting mode in the retracted state.

  Shooting after holding is performed by operating a conventional push-type release switch provided on the upper surface of the digital camera, but the release switch is not limited to this. For example, a release switch may be displayed as an icon on the liquid crystal display 16 and a release operation (photographing operation) may be performed by touching the touch panel 17.

  When energy saving is important, image acquisition may be performed without supplying energy to a display unit that displays a live view image.

  The present invention relates to an imaging device such as a digital camera having an imaging means capable of acquiring an image even before a release operation, for example, a digital video camera, a mobile phone having a digital camera function, a mobile terminal with a digital camera (mobile with a digital camera) It can be applied to a wide range of imaging devices such as tools.

10 Digital camera (imaging device)
10R Digital camera grip (right side)
12 Imaging means (imaging system)
12a Shooting lens 12b Face detection unit (imaging system)
14 Central processing circuit (control means)
14a 1st power supply control part 14b 2nd power supply control part 14c 3rd power supply control part 14d Acceleration determination part 14e Focus control part 14f AE control part 14g Trimming control part 14h Image selection control part 14i Image association control part 16 Liquid crystal display (display means) ; Display system)
17 Touch panel (gripping detection means; sensor system)
18 Recording means (memory)
24 switch operation determining means 26 acceleration detecting means (acceleration sensor; sensor system)
26a comparator 28 switch group 28a release switch 30 inclination detecting means

Claims (14)

An imaging method of an imaging apparatus that detects an operation of holding and lifting an imaging apparatus before the release operation by holding the imaging apparatus, and continuously acquiring images before starting holding and holding during the lifting operation. Image pickup means for detecting an operation of grasping and lifting the image pickup apparatus before holding the image pickup apparatus and performing a release operation, and acquiring an image without supplying energy to a display means for displaying a live view image during the lift operation The imaging method of the imaging device which acquires continuously the image before supplying the energy to the camera and starting shooting. Detects the gravity change in the vertical direction in the operation of holding and lifting the imaging device before the release operation with the imaging device held, and in accordance with the detected gravity change, the image before starting to hold and holding the image during the lifting operation An imaging method for an imaging apparatus that can be continuously acquired. The imaging method of the imaging apparatus according to claim 1, wherein acquisition of an image is continued until a release operation is performed even after the imaging apparatus is held. Compare the image acquired before the release operation with the image taken in the release operation, correct the tilt and trim it to obtain a corrected image, and record the corrected image together with the image taken in the release operation in association with the image taken in the release operation. The imaging | photography method of the imaging device in any one of Claims 1-4. The imaging method of the imaging apparatus according to claim 5, wherein the selection process is performed before or after the correction, excluding an image that does not include a portion common to the captured image in the release operation, an image that is out of focus, and an image that is not suitable for exposure. The imaging method of an imaging apparatus according to any one of claims 1 to 6, wherein, in imaging before the release operation, the focus is fixed focus and the exposure is average photometry. The imaging method of the imaging apparatus according to claim 7, wherein the imaging before the release operation is performed with a smaller number of pixels than the number of pixels when the imaging is performed with the release operation. Imaging means for capturing an image from the subject;
Display means for displaying the captured image and reproducing and displaying the captured image;
A release switch operated to determine the timing of photographing the subject by the imaging means;
Prior to determining the shooting timing by the release switch, a control unit that continuously acquires images from the imaging unit, corrects the inclination of the image compared with the captured image in the release operation, and controls to obtain a corrected image;
Recording means for recording a photographed image and a corrected image in a release operation;
An imaging apparatus comprising: The image pickup apparatus according to claim 9, wherein the control means controls to reproduce and display the corrected image together when the photographed image in the release operation is reproduced and displayed on the display means. The control unit includes an image association control unit that associates the correction image with the photographed image in the release operation when the photographed image in the release operation is recorded in the recording unit.
The imaging device according to claim 9, wherein a captured image and a corrected image in a release operation are recorded in association with each other. The control unit obtains a corrected image by trimming an image selection control unit that selects images continuously acquired from the imaging unit prior to shooting timing, and an image before or after selection by the image selection control unit. The imaging device according to claim 9, further comprising a trimming control unit. Imaging means for capturing an image from the subject;
Display means for displaying the captured image and reproducing and displaying the captured image;
A release switch operated to determine the timing of photographing the subject by the imaging means;
Recording means for recording images;
Prior to determining the shooting timing by the release switch when the imaging device is set up for shooting, control is performed so that images are continuously acquired from the imaging unit and recorded together with the captured image in the release operation on the recording unit. Control means,
The control means
An image selection control unit for selecting images continuously acquired from the imaging means prior to shooting timing;
A trimming control unit that compares an image acquired before the release operation with a photographed image in the release operation, corrects the tilt, and trims the image to obtain a corrected image;
An image association control unit for associating a captured image and a corrected image in a release operation;
Have
An imaging apparatus that records a captured image and a corrected image in an associated release operation. The control means determines the photographer's intention to shoot based on the gripping position of the imaging device and the moving direction of the imaging device. If it is determined that there is a shooting intention, the control unit sequentially supplies energy from a block with low energy consumption. The image pickup apparatus according to claim 9 or 13, wherein when the condition of the moving direction is satisfied, energy is supplied to the remaining blocks and the image pickup apparatus is started up in a state capable of photographing.

Images