JP5495760B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus, and more particularly to an imaging apparatus that can perform a shooting operation in a hands-free state without being held by hand.

  Conventionally, an optical image formed by a photographing optical system can be sequentially converted into an image signal by a photoelectric conversion element such as a solid-state imaging element, and the image signal thus obtained can be recorded on a recording medium as image data in a predetermined form. An imaging device such as a digital camera configured to include an image display device such as a liquid crystal display (LCD) that reproduces and displays image data recorded on the recording medium as an image is generally put into practical use and widely used. .

  Image data acquired and recorded by such an imaging apparatus is mainly digital data. This digital data is very easy to handle. For example, in a conventional imaging device, various signal processing is performed on image data acquired by an imaging device using an internal processing circuit. The signal processed image data generated in this way is recorded on a recording medium.

  In other words, the conventional imaging apparatus can cope with various shooting situations by appropriately executing various signal processing on the image signal acquired by the solid-state imaging device or the like using the processing circuit in the imaging apparatus. While always getting the right image.

  Further, in the conventional imaging apparatus, as an operation for starting the photographing operation, for example, a means in which a user operates an operation member such as a release button that is interlocked with a mechanical switch (mechanical switch) or the like is common. .

  In this case, when an operation member such as a release button is operated, first a preliminary operation of the photographing operation, that is, an automatic exposure setting operation, an automatic focus adjustment operation, an auto white balance operation, etc. is executed, and then a release operation is performed. That is, a series of operation processes such as an exposure operation for driving the image sensor, shutter mechanism, diaphragm mechanism, and the like, and subsequent image processing operation, recording operation, and the like are executed.

  In recent imaging apparatuses, instead of the operation member such as the release button, a series of photographing operation processes can be executed by a user touching (touching) the surface of the image display apparatus with a finger or the like. Various proposals regarding an operation system of a method different from the conventional one, such as what can be performed, have been made by, for example, Japanese Patent Application Laid-Open No. 2007-36492.

  In a conventional imaging device such as the imaging device disclosed in the above-mentioned Japanese Patent Application Laid-Open No. 2007-36492, the user holds the imaging device in his hand, or the imaging device itself is fixed using a tripod or the like. It is assumed that a series of photographing operations is started by performing a predetermined operation.

  On the other hand, in recent years, various ideas have been proposed by, for example, Japanese Patent Application Laid-Open No. 2006-60584, etc., so that a user can perform a desired photographing operation without holding the imaging device in his / her hand.

  The imaging device disclosed by the above Japanese Patent Application Laid-Open No. 2006-60584 is a detection means for mounting a main body having a display device on the palm or back of the hand and mounting the imaging unit on the fingers, and detecting bending of a plurality of fingers. And the control is performed so as to switch the operation mode according to the bending state of the plurality of fingers detected by the detecting means.

JP 2007-36492 A JP 2006-60584 A

  However, the imaging device disclosed in the above Japanese Patent Application Laid-Open No. 2006-60584 or the like is specialized for a predetermined application because it requires a detecting means for operation control such as detecting the bending state of a finger. It can be said that this is a dedicated device.

  The present invention has been made in view of the above-described points, and the object of the present invention is to hold the image pickup apparatus in the hand when taking a picture using the image pickup apparatus. In addition, it is possible to perform a photographing operation by performing a natural operation in a state where the imaging device is mounted on a part of the body without operating an operation member of the imaging device, and various kinds of image data obtained by the photographing operation. It is an object of the present invention to provide an imaging apparatus configured to obtain a still image with a natural composition and without a sense of incongruity by performing the above signal processing.

In order to achieve the above object, the imaging apparatus according to the present invention is an imaging apparatus that records an image signal based on an output signal from an imaging unit, and is in a no-finder state in which a user performs shooting without checking the display screen. A determination means for determining the position of the imaging apparatus when the determination means determines that the camera is in a no finder state, and an acceleration detection section for detecting a change in attitude of the imaging apparatus, When a change is detected, the imaging unit starts a continuous shooting operation to acquire a series of a plurality of image signals, and is represented by the series of a plurality of image signals based on the series of the plurality of image signals. A signal processing control unit that performs panorama synthesis processing for joining images, and the signal processing control unit receives acceleration from the acceleration detection unit when performing the panorama synthesis processing. It is greater than value selects every other frame from a sequence of multiple images obtained al a by the continuous shooting operation.

  According to the present invention, when taking a picture using the imaging device, the user takes an image of a part of the body without holding the imaging device in his hand and operating the operation member of the imaging device. Capturing can be performed by performing natural operations with the device attached, and still images with a natural composition can be obtained by applying various signal processing to the image data obtained by the photographing operations. An imaging device configured to be able to be provided can be provided.

1 is a block configuration diagram showing an outline of the internal configuration of an imaging apparatus according to an embodiment of the present invention; FIG. 1 is a schematic perspective view showing the structure of an acceleration detection unit taken out of the imaging apparatus of FIG. FIG. 2 is a layout diagram illustrating an outline of a layout state of an acceleration detection unit in the imaging apparatus of FIG. 1; FIG. 3 is a flowchart showing an outline of the operation of camera control in the imaging apparatus of FIG. FIG. 5 is a flowchart showing details (subroutine) of predetermined condition identification processing (step S102) in the camera control processing sequence of FIG. 4; FIG. 5 is a flowchart showing details (subroutine) of continuous shooting processing (processing in step S103) in the camera control processing sequence of FIG. 4; The figure which shows an example of the specific condition at the time of the camera control by the imaging device of FIG. 1 being performed, The figure which shows an example of the specific condition at the time of the camera control by the imaging device of FIG. 1 being performed, The figure explaining the effect | action at the time of using the imaging device of FIG. 1 in the condition shown in FIG. The figure explaining the effect | action at the time of using the imaging device of FIG. 1 in the condition shown in FIG. FIG. 7 is a diagram illustrating an example (a) of a plurality of images acquired when the continuous shooting operation of FIG. 6 is performed, and an example (b) of a composite image generated as a result of composite image processing from the plurality of images. The figure which shows another example of the concrete condition at the time of camera control by the imaging device of FIG. 1 being performed, The figure which shows another example of the concrete condition at the time of the camera control by the imaging device of FIG. 1 being performed, The figure which shows another example of the concrete condition at the time of camera control by the imaging device of FIG. 1 being performed, FIGS. 13 and 14 show changes in the posture of the imaging device under the usage conditions, where (a) shows the posture in the normal position with respect to the direction of gravity, and (b) shows the posture when the tilting operation is performed. Figure, FIGS. 1A and 1B show examples of imaging results during continuous shooting operation by the imaging apparatus of FIG. 1, where FIG. 1A shows an example where the overlapping area becomes large, FIG. 1B shows an appropriate example of the overlapping area, and FIG. Figure showing each example that was not, The figure which shows the movement condition of the imaging device under the use condition of FIG. The figure which shows the movement condition of the imaging device in the use condition of FIGS. 9-10 or FIG. 13, FIG. The figure which shows the other example of the imaging | photography result at the time of the continuous imaging operation | movement by the imaging device of FIG. FIG. 19 is a conceptual diagram illustrating the flow of composite image processing executed based on the imaging result of FIG.

  The present invention will be described below with reference to the illustrated embodiments.

  In one embodiment of the present invention, for example, an optical image formed by an optical lens is photoelectrically converted using a solid-state imaging device, and an image signal obtained thereby is converted into digital image data representing a still image or a moving image. Imaging of a digital camera or the like configured to record the generated digital image data on a recording medium, and to reproduce and display a still image or a moving image based on the digital image data recorded on the recording medium using a display device An apparatus is shown as an example.

  In each drawing used for the following description, the scale is different for each component in order to make each component large enough to be recognized on the drawing. It is not limited only to the quantity of the component described in the figure, the shape of the component, the ratio of the size of the component, and the relative positional relationship of each component.

  1-20 is a figure explaining one Embodiment of this invention. Among these, FIG. 1 is a block configuration diagram showing an outline of the internal configuration of the imaging apparatus of the present embodiment. FIG. 2 is a schematic perspective view showing the structure of the acceleration detection unit extracted from the imaging apparatus of FIG. FIG. 3 is an arrangement diagram illustrating an outline of an arrangement state of the acceleration detection units in the imaging apparatus of FIG. 1. FIG. 4 is a flowchart showing an outline of the operation of camera control in the imaging apparatus of FIG. FIG. 5 is a flowchart showing details (subroutine) of the predetermined condition identification process (the process of step S102) in the camera control process sequence of FIG. FIG. 6 is a flowchart showing details (subroutine) of the continuous shooting process (the process of step S103) in the camera control process sequence of FIG. 7 to 10 are diagrams illustrating examples of specific situations when camera control is performed by the imaging apparatus of FIG. FIG. 11 is a diagram illustrating an example (a) of a plurality of images acquired when the continuous shooting operation of FIG. 6 is performed, and an example (b) of a composite image generated as a result of composite image processing from the plurality of images. It is.

  12 to 14 respectively show different examples in specific situations when camera control is executed by the imaging apparatus of the present embodiment. FIG. 15 shows the posture change of the imaging device under the usage conditions of FIG. 13 and FIG. 14. Of these, (a) shows the posture in the normal position with respect to the direction of gravity, and (b) shows the tilting operation. Each case's posture is shown. FIG. 16 is a diagram illustrating an example of a photographing result at the time of a continuous photographing operation by the imaging apparatus of the present embodiment, in which (a) shows an example in which the overlapping area becomes large, and (b) shows an appropriateness of the overlapping area. For example, (c) shows an example in which no overlapping region was obtained. FIG. 17 shows the movement status of the imaging apparatus under the usage status of FIG. FIG. 18 shows a moving state of the imaging apparatus under the usage state of FIGS. 9 to 10 or FIGS. 13 and 14.

  FIG. 19 shows another example of the imaging result during the continuous imaging operation by the imaging apparatus of the present embodiment. FIG. 20 is a conceptual diagram illustrating the flow of composite image processing executed based on the imaging result of the example of FIG.

  First, the outline of the internal configuration of the imaging apparatus 1 according to an embodiment of the present invention will be described below with reference to the block diagram of FIG.

  The imaging apparatus 1 according to the present embodiment includes an imaging unit 2, a face detection unit 3, a recording unit 4, a microphone 5, an acceleration detection unit 6, an operation unit 7, a display unit 8, a touch panel 8b, and a watch. 9, a signal processing / control unit 11, a communication unit 12, a lens unit 20 (not shown in FIG. 1; see FIG. 3), and the like.

  The signal processing / control unit 11 is a control circuit that performs overall control of the entire imaging apparatus 1, and performs various control processes in response to various signals input from each component block in the imaging apparatus 1. Circuit. The signal processing / control unit 11 includes circuit units such as a display control unit 11b, a signal compression / expansion unit 11c, an image signal processing unit 11d, and a trimming unit 11e.

  Among these, the display control unit 11b corresponds to a continuous display of a real time image based on an image signal continuously output from the imaging unit 2, a playback display of a recorded image, a menu display for various settings, and a touch panel 8b. This is a control unit that performs display-related control to display an operation display (for example, display of a software keyboard) on the display screen of the display unit 8.

  The signal compression / decompression unit 11c receives the image signal acquired by the imaging unit 2 and performs a signal compression process for converting the image signal into an image data having an optimum form for recording on the recording medium, or has been recorded on the recording medium. This is a processing circuit that reads compressed image data and executes signal processing such as signal expansion processing for converting it into an image signal in a form optimal for reproduction and display using the display unit 8 or the like. The signal compression / decompression unit 11c can handle the compression / decompression processing of audio signals in addition to the compression / decompression processing of image signals (still images and moving images).

  The image signal processing unit 11d is an image signal acquired by the imaging unit 2, and is a predetermined image processor that performs predetermined image processing based on a plurality of image signals temporarily recorded in a first temporary recording unit 4a described later. It is a processing circuit that performs signal processing, for example, image synthesis processing such as panorama synthesis processing (image connection processing).

  The trimming unit 11e is a composite image signal generated by the image signal processing unit 11d, and cuts out a necessary image area based on the image signal that is temporarily recorded in the second temporary recording unit 4b described later. 2 is a processing circuit that performs trimming processing.

  The imaging unit 2 receives an optical image formed by the lens unit 20 and converts it into an electric signal corresponding to the optical image, and pre-processes an image signal generated by the photoelectric conversion element. It is comprised by the signal processing circuit etc. to perform. The image signal generated by the imaging unit 2 is output to the signal processing / control unit 11. As the photoelectric conversion element, a solid-state imaging element such as a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like is applied.

  The face detection unit 3 is a configuration block for realizing a so-called face detection function that detects, for example, a human face region from an image based on an image signal acquired by the imaging unit 2. A technique for realizing this face detection function has been widely used in imaging apparatuses. Also in the imaging apparatus 1 of the present embodiment, the same description as that of the conventional technique is applied, and detailed description thereof is omitted.

  The recording unit 4 receives and records and stores recording image data finally generated in the signal compression / decompression unit 11c after various signal processing is performed by the signal processing / control unit 11 acquired by the imaging unit 2. And a drive circuit for driving the recording medium, such as recording processing of image data on the recording medium and reading processing of recorded image data.

  Note that the recording unit 4 includes an image for recording corresponding to an image signal generated by performing trimming processing in the trimming unit 11e (that is, an image signal representing an image in a final form acquired by an automatic photographing mode described later). Data is also recorded.

  In addition, the recording unit 4 in the imaging apparatus 1 of the present embodiment includes a first temporary recording unit 4a, a second temporary recording unit 4b, and the like.

  The first temporary recording unit 4a is a recording area for temporarily recording a plurality of image signals corresponding to a plurality of still images continuously acquired by the imaging unit 2 when a shooting operation is executed in the automatic shooting mode. .

  The second temporary recording unit 4 b is a recording area for temporarily recording the composite image signal generated by the image signal processing unit 11 d of the signal processing / control unit 11.

  A microphone (hereinafter simply referred to as a microphone) 5 is a component that converts sound or the like into an electrical signal. The audio signal acquired by the microphone 5 is subjected to predetermined signal processing in the signal processing / control unit 11 and then recorded as audio data on the recording medium of the recording unit 4.

  The predetermined signal processing performed on the recording audio signal in the signal processing / control unit 11 includes various processes such as compression processing, conversion to recording audio data, or processing associated with image data. Processing is appropriately executed according to the operation mode and setting conditions.

  In normal cases, audio data is recorded by performing an audio recording operation simultaneously with a moving image or still image shooting operation, or in an operation mode in which only audio is recorded alone.

  In the imaging apparatus 1 of the present embodiment, the audio signal acquired by the microphone 5 is recorded in a predetermined operation mode, and the main subject 101 is detected from a plurality of images acquired in the automatic shooting mode, for example. (The details will be described later).

  The acceleration detection unit 6 is a posture detection unit that detects a posture change or a movement state of the imaging apparatus 1. The acceleration detection unit 6 includes a detection sensor including, for example, an acceleration sensor that detects acceleration, and a circuit that receives an output signal of the detection sensor and generates a predetermined instruction signal. In addition, as an attitude | position detection part, it can replace with the said acceleration sensor and can also apply the angular velocity sensor (gyroscope) which detects angular velocity.

  That is, the acceleration detection unit 6 detects the gravitational acceleration, vibration, and the like applied to the imaging device 1 in which the acceleration detection unit 6 is disposed, thereby holding the imaging device 1 by the user, that is, the hand shake state and the inclination of the imaging device 1. It is a component that detects postures such as states and movement status.

  In the conventional imaging apparatus 1, the camera shake correction function is realized by driving and controlling the camera shake correction mechanism based on the detection result of the acceleration detection unit 6.

  In addition, in the imaging apparatus 1 of the present embodiment, the output signal of the acceleration detection unit 6 is used for control when performing a shooting operation.

  Here, the outline of the configuration and operation of the detection sensor in the acceleration detection unit 6 will be briefly described with reference to FIGS.

  As shown in FIG. 2, the detection sensor in the acceleration detection unit 6 in the imaging device 1 of the present embodiment has a structure in which the positions of the cross-linked metal part 6 a and the metal part 6 b on the chip surface are changed by acceleration. It is a structural member.

  When the posture of the detection sensor of the acceleration detection unit 6 configured as described above is changed, the metal portion 6a bends due to the degree of gravity applied to the detection sensor. Thereby, the relative position change of the metal parts 6a and 6b occurs, and the output signal changes.

  For example, as shown in FIG. 3, it is assumed that such a form of the detection sensor is arranged on each surface portion of the upper surface 1 x, one side surface 1 y, and the bottom surface 1 x inside the imaging device 1.

  In this case, the detection sensors disposed on the upper surface 1x of the imaging device 1 are denoted by reference numerals 6xa and 6xb, the detection sensor disposed on the one side surface 1y is denoted by reference numeral 6y, and the detection sensor disposed on the bottom surface 1z is denoted by reference numeral 6z.

  Here, the surface on which the photographing lens 20a of the lens unit 20 of the imaging device 1 is provided is referred to as the front surface of the imaging device 1. Further, it is assumed that the optical axis of the photographing lens 20a is arranged in a direction orthogonal to the front surface of the imaging device 1. Then, as shown in FIG. 3, the direction along the optical axis of the taking lens 20a is the Z direction, the direction horizontally orthogonal to the Z direction is the X direction, and the direction perpendicular to the Z direction is the Y direction. And shall be referred to respectively.

  Therefore, the upper surface 1x and the bottom surface 1z of the imaging device 1 are configured by surfaces including the X direction and the Z direction. At this time, the top surface 1x and the bottom surface 1z are arranged so as to face each other with a predetermined distance therebetween. In addition, one side surface 1y of the imaging device 1 is configured by a surface including the Y direction and the Z direction.

  In this case, the detection directions of the detection sensors 6xa and 6xb are set and arranged so as to detect the posture change and the movement state in the X direction. Further, the detection direction of the detection sensor 6y is set and arranged so as to detect the posture change and the movement state in the Y direction. The detection direction of the detection sensor 6z is set so as to detect a change in posture in the Z direction.

  As a situation in which the posture of the imaging device 1 changes (including a sudden change in movement), for example, when the user lifts the imaging device 1 from a state where the imaging device 1 is placed on a desk or the like, or the user holds the imaging device 1 by hand. A case where the robot is turned in an arbitrary direction from the state held in the state (tilting operation, turning-back operation, or the like) can be considered.

  When the posture change as described above occurs, as shown in FIG. 3, each of the detection sensors 6xa and 6xb installed at a predetermined portion inside the imaging apparatus 1 corresponding to the three axes of the X axis, the Y axis, and the Z axis. , 6y, 6z can be monitored to determine how the imaging apparatus 1 has moved and how the posture has changed.

  In addition, with respect to the X-axis direction, one detection sensor may be provided in order to detect horizontal movement in the same direction. However, by providing two detection sensors 6xa and 6xb, for example, the imaging apparatus 1 can be moved horizontally. In contrast, it is possible to detect a situation in which movement is performed only in the horizontal direction while rotating around the Y axis among the axes orthogonal to the optical axis. In this case, a difference in acceleration is detected between the detection sensor (6xa) located outside the rotation radius when the imaging device 1 is rotated in a predetermined direction and the detection sensor (6xb) located inside. Judgment is possible from this.

  Returning to FIG. 1, the operation unit 7 includes various operation members (not shown) provided on the outer surface of the imaging apparatus 1, a plurality of switches and the like that are respectively linked to these operation members, and operation members operated by the user. And a processing circuit for transmitting an instruction signal generated as a result to the signal processing / control unit 11. The operation unit 7 includes, for example, a shutter release button (and the same switch), an operation mode switching dial (and the same switch), and the like.

  The display unit 8 is a display device that displays image display, setting menu display, operation display, and the like based on a display image signal generated as a result of signal processing by the display control unit 11b of the signal processing / control unit 11. For example, a liquid crystal display (LCD) or an organic EL display is applied as the display unit 8.

  When the imaging apparatus 1 is used in the shooting operation mode, the user determines the composition and timing for shutter release while viewing the real-time image displayed on the display unit 8. That is, during the shooting operation, the display unit 8 mainly functions as a viewfinder. When the setting menu display is displayed on the display unit 8, the user can perform various setting selection operations of the imaging apparatus 1 using various operation members. Further, when the imaging apparatus 1 is used in the reproduction operation mode, an image based on recorded image data is displayed on the display unit 8.

  In addition to this, the display unit 8 in the present embodiment is not particularly shown, but for example, a speaker or the like for generating a sound based on an audio signal acquired by the microphone 5 or audio data recorded in the recording unit 4 or the like Audio output device.

  The touch panel 8b includes a position input device arranged on the display screen of the display unit 8, an operation display displayed on the display unit 8, and the like.

  When the user performs a predetermined touch operation (contact operation) on the touch panel 8b, the touch panel 8b generates a signal related to the touched position or region and outputs the signal to the signal processing / control unit 11. In response to this, the signal processing / control unit 11 (its touch point determination unit (not shown)) detects and determines a touch point of a touch operation on the display screen of the display unit 8. Furthermore, by detecting a change in touch operation or the like, it is also detected and determined how the user's finger is moved during the touch operation.

  The display control unit 11b controls the contents displayed on the display screen of the display unit 8 according to the detection result of the touch operation on the touch panel 8b. As a result, the touch panel 8 b serves to assist the operation by the operation unit 7. For example, when the imaging apparatus 1 is operating in a predetermined shooting mode (for example, a program shooting mode) in the shooting operation mode (and when the power is on), the operation unit 7 or the touch panel 8b is operated by the user. And switching settings to other shooting modes (for example, aperture priority automatic exposure (AE) mode, shutter speed priority automatic exposure mode, etc.) of the shooting operation mode, and any shooting conditions within each shooting mode. Settings can be changed easily.

  The touch panel 8b has a configuration substantially similar to that applied to an imaging apparatus such as a digital camera that has been widely spread and put into practical use. Therefore, in describing the configuration of the present embodiment, detailed illustration and description of the configuration of the touch panel 8b are omitted.

  The timepiece 9 includes a timing circuit that contributes to a timing operation and the like necessary for controlling the internal electric circuit in the imaging apparatus 1. In the description of the present embodiment, an example in which the timepiece 9 is applied as a single constituent block is shown (see FIG. 1). However, instead of this, a configuration in which the timepiece 9 is included in the signal processing / control unit 11 is configured. Also good.

  The communication unit 12 includes a communication circuit for performing communication with an external device connected to the imaging device 1. Various forms such as wired communication by cable connection and wireless communication by wireless connection can be applied as a form of communication with an external device. Therefore, the image data acquired by the imaging device 1 can be output to an external device via the communication unit 12.

  The lens unit 20 (see FIG. 3 and the like) holds a plurality of optical lenses that collect a light beam from an object to be photographed (subject) and form an image on the light receiving surface of the imaging unit 2, and each of the plurality of optical lenses. In addition to the lens holding frame and its driving unit, the aperture mechanism, the shutter mechanism, and its driving unit, etc., other electrical components are also included. The lens unit 20 has a configuration substantially the same as that applied to an imaging apparatus such as a digital camera that has been widely spread and put into practical use. Therefore, in describing the configuration of the present embodiment, detailed illustration and description of the configuration of the lens unit 20 are omitted. The lens unit 20 may be applied in various forms, such as a lens unit that is detachable from the imaging device 1 or a lens unit that is integrated with the imaging device 1.

  The imaging device 1 of the present embodiment is configured to include various structural members in addition to the above-described structural members. However, configurations other than the above-described structural members are not directly related to the present invention. It is. Therefore, in order to avoid complication of the drawings, the configuration other than the above-described components is omitted, and the detailed description thereof is omitted assuming that the configuration is the same as that of a conventional imaging device or the like.

  The operation when photographing is performed using the imaging apparatus 1 of the present embodiment configured as described above will be described below with reference to the flowcharts of FIGS. 4 to 6 and FIGS.

  First, a brief usage situation when a processing sequence related to “camera control” by the imaging apparatus 1 is executed will be briefly described with reference to FIGS. 7 and 8.

  As shown in FIG. 7, the user 100 of the imaging apparatus 1 is in a state where he / she has a baggage or the like in his / her hands, for example, in a place where he / she is out, and therefore the user 100 uses his / her hand to capture the imaging apparatus 1. Is in a situation where it cannot be held. Further, at this time, it is assumed that the user 100 is walking with a child as the subject 101.

  Even under such circumstances, the user 100 has a lot of moments when he / she wants to photograph the child as the subject 101 as the photographing object. However, when the imaging apparatus 1 cannot be held in the hand as described above, it is difficult to take a picture with the conventional imaging apparatus, and a precious moment with a child or a precious photo opportunity is missed. It will end up.

  Therefore, in the imaging apparatus 1 of the present embodiment, the user 100 triggers the intention of the user 100 by a predetermined action or the like without holding the imaging apparatus 1 even in such a situation ( The image pickup apparatus 1 is operated as a starting point to perform continuous shooting, and predetermined signal processing (for example, panorama combining processing, image joining processing, trimming processing, etc.) for each image signal of a plurality of captured images acquired thereby. The automatic image capturing mode is provided as an image capturing mode for automatically performing a series of image capturing processing sequences such as recording the composite image signal generated by the processing.

  In addition, as the predetermined operation as a trigger for starting the operation, for example, an operation in which the user 100 holding the imaging device 1 looks back toward the subject 101 behind is assumed. In addition to this, by using a technique such as detecting conversation (sound) between the user 100 and the subject 101 or detecting the face of the subject 101 based on the acquired image signal, Appropriate shooting can be performed with higher accuracy. In addition, when applying such an auxiliary technique together, it is necessary to start an imaging operation before performing these detections.

  Therefore, as shown in FIGS. 7 and 8, the user 100 can use the belt-shaped holding member 1a to fix and hold the imaging device 1 of the present embodiment on his / her arm or the like. ing. Here, when the user 100 holds the imaging device 1 on his / her arm or the like, the imaging device 1 is fixed in a posture such that the photographing lens faces outward. In addition, it is assumed that the imaging apparatus 1 is in a power-on state so that a shooting operation can be performed, and the operation mode is set to the shooting operation mode.

  The imaging device 1 does not need to be completely powered on. For example, only some functions of the signal processing / control unit 11 are activated, and the imaging unit 2, the display unit 8, and the like consume power. You may make it be in the standby state by the power saving mode etc. which make the state which made the comparatively big structural block wait.

  In this case, the imaging apparatus 1 may perform some operation by the user 100, for example, as shown in FIG. 9, the user 100 speaks to the subject 101, turns around the subject 101, or stops. A processing sequence may be provided in which the imaging device 1 in the standby state immediately returns to the photographing enabled state with such an operation as a trigger.

  When the imaging apparatus 1 is in such a situation, first, in step S101 of FIG. 4, the signal processing / control unit 11 monitors the output signal from the acceleration detection unit 6 and the posture state of the imaging apparatus 1. Determine. Here, it is confirmed whether or not the state of the imaging device 1 is the no-finder state.

  The no-finder state refers to a state when the user 100 performs shooting without checking the display screen of the display unit 8.

  In a normal case, when shooting using the imaging device 1, the user 100 holds the imaging device 1 in a hand (or a state where the imaging device 1 is fixed to a fixture such as a tripod). While observing images continuously displayed on the display screen of the display unit 8 as a finder device normally provided on the back side, the composition and the like are determined, and then operations such as shutter release are performed.

  However, as described above, in a state where the imaging device 1 is fixedly held in the state illustrated in FIGS. 7 and 8, the user 100 checks the display screen of the display unit 8 of the imaging device 1. I can't. Accordingly, although correct framing on the display screen of the display unit 8 and shooting with an intended composition cannot be performed, the user 100 considers the optical axis direction of the imaging apparatus 1 and the shooting angle of view by the shooting lens. The desired subject can be captured within the shooting angle of view without checking the display screen. As described above, when the user 100 performs shooting without checking the viewfinder device (display unit), it is called no-finder shooting, and as a photography method, a conventional photographing method is generally used. One.

  However, since no-finder shooting performs a shooting operation without confirming the composition, an image obtained as a result is not always an image intended by the user.

  Therefore, in the imaging apparatus 1 of the present embodiment, signal processing such as performing continuous shooting by no-finder shooting to acquire a plurality of captured images, and combining the acquired plurality of images to form one image. In addition, a desired still image is generated using signal processing such as trimming processing for cutting out a predetermined portion of the composite image, for example, a predetermined region centered on the image of the subject 101. .

  The determination as to whether or not the imaging device 1 is in the no-finder state is made based on the output signal from the acceleration detection unit 6 as described above.

  In addition, for example, a means for detecting the mounting state of the holding member 1a may be provided, or a means for detecting whether a photographer is present at a position facing the display unit 8 may be provided. In addition, various detections such as a means for detecting whether the user's hand is applied to the grip portion of the imaging device 1 (the portion that is handed when the imaging device 1 is held by a hand in a normal state) or the like are provided. The state of the imaging device 1 may be detected by means.

  Further, in place of these state detection means, a “no finder mode” is provided in the mode setting of the photographing operation, and the mode in which the signal processing / control unit 11 is set is confirmed in the processing of step S101. May be.

  When a processing sequence for returning the imaging apparatus 1 from the standby state to the photographing enabled state is inserted using the above-described operation or the like (see FIG. 9) as a trigger, immediately after the return processing, the process of step S101 is performed. What is necessary is just to make it process.

  When it is confirmed in the process of step S101 that the imaging apparatus 1 is in the “no finder state”, the process proceeds to the next step S102. In the processing subsequent to step S102, the signal processing / control unit 11 executes a processing sequence in the “automatic imaging mode”.

  In step S <b> 102, the signal processing / control unit 11 monitors the output signal of the acceleration detection unit 6, the audio signal acquired by the microphone 5, etc., and “predetermined conditions” suitable for executing the “automatic shooting mode”. Confirm whether or not is satisfied. The details of this “predetermined condition” confirmation processing sequence are as shown in FIG.

  Here, the details of the processing sequence for confirming the “predetermined condition” for executing the processing sequence of the “automatic photographing mode” will be described with reference to the flowchart of FIG.

  First, in step S151 of FIG. 5, the signal processing / control unit 11 executes a gravity direction determination process for determining the direction of gravity applied to the imaging device 1 based on the output signal of the acceleration detection unit 6. Thereafter, the process proceeds to step S152.

  In step S152, the signal processing / control unit 11 determines the gravitational direction (Y-axis direction in FIG. 3) and the optical axis direction (Z-axis direction in FIG. 3) in the imaging apparatus 1 based on the determination result obtained in step S151. ) (X-axis direction in FIG. 3; horizontal direction) whether or not acceleration is occurring is confirmed. Here, when it is confirmed that the acceleration in the horizontal (X-axis) direction is generated, the process proceeds to the next step S153. If it is confirmed that no acceleration in the horizontal (X-axis) direction occurs, the process proceeds to step S161.

  Subsequently, in step S153, the signal processing / control unit 11 checks whether or not there is a change in the gravity (Y-axis) direction based on the determination result obtained by the processing in step S151 described above. If it is confirmed that there is no change in the gravity (Y-axis) direction, the process proceeds to the next step S154. Further, in the process of step S153 described above, when a change in the gravity (Y-axis) direction is confirmed, it is determined that the acceleration condition is inappropriate (NG), and the series of processing sequences is terminated. Then, assuming that the “predetermined condition” is not satisfied in the process of step S102 of FIG. 4, the process returns to the process of step S101 of FIG. 4 and the subsequent processes are repeated.

  That is, when the acceleration in the horizontal (X-axis) direction is confirmed in the process in step S151 and the change in the gravity (Y-axis) direction is confirmed in the process in step S154, that is, the imaging apparatus. As a situation when 1 moves mainly in the horizontal (X-axis) direction, for example, the situations shown in FIGS. 9 and 10 can be considered.

  That is, consider the case where the user 100 turns around in the direction of the arrow R shown in FIGS. 9 and 10 when the situation is as shown in FIG.

  If the situation at this time is viewed from the overhead of the user 100 as shown in FIGS. 9 and 10, the imaging device 1 fixed to the arm of the user 100 has the body of the user 100 as the center of rotation. As shown in FIG. 9 and FIG. During movement in this case, acceleration in the horizontal (X-axis) direction is applied to the imaging apparatus 1, while no change is seen in the gravity (Y-axis) direction.

  Further, as a situation different from the situation shown in FIGS. 9 and 10, as an example of the case where the imaging apparatus 1 moves in the horizontal (X-axis) direction, a situation as shown in FIG.

  The situation shown in FIG. 12 shows a situation where the user 100 in a state where the imaging apparatus 1 is held on the arm in the same manner as in the above-described FIGS. 8 to 10 gets on a vehicle such as a bicycle and moves. .

  In this case, consider a case where the user 100 moves from the point [A] to the point [B] shown in FIG.

  At this time, the imaging apparatus 1 only moves in the horizontal (X-axis) direction between the point [A] and the point [B]. Therefore, the imaging device 1 is accelerated in the horizontal (X-axis) direction, but no change is observed in the gravity (Y-axis) direction.

  Returning to FIG. 5, in step S <b> 154, the signal processing / control unit 11 monitors the audio signal acquired by the microphone 5 and confirms whether or not the voice of the user (photographer) 100 is detected. .

  Here, not only the state change of the imaging apparatus 1 described above but also a confirmation process of the photographer's voice by detecting an audio signal is inserted as the “automatic shooting mode” start condition item. As a result, the start condition of the “automatic photographing mode” can be tightened to prevent malfunction.

  As a means for detecting the voice of the user (photographer) 100 from the audio signal acquired by the microphone 5, for example, the voice of the user (photographer) is registered in advance in the recording unit 4 or the like. Based on the audio data, it is possible to compare the audio signal acquired by the microphone 5.

  If the detection of the audio signal based on the photographer's voice is confirmed in the process of step S154 described above, the process proceeds to the next step S155. If the detection of the audio signal based on the photographer's voice is not confirmed, it is determined that the acceleration condition is inappropriate (NG), and the series of processing sequences is terminated. Then, assuming that the “predetermined condition” is not satisfied in the process of step S102 of FIG. 4, the process returns to the process of step S101 of FIG. 4 and the subsequent processes are repeated.

  Next, in step S155, the signal processing / control unit 11 temporarily records state information such as the moving direction (movement pattern) and acceleration of the imaging apparatus 1 obtained based on the determination result obtained in step S151 described above. Or the recording medium of the recording unit 4 or the like. Thereafter, it is determined that the “predetermined condition” is in a suitable state, and a series of processing sequences is terminated. Then, assuming that the “predetermined condition” is satisfied in the process of step S102 of FIG. 4, the process proceeds to the process of step S103 of FIG.

  On the other hand, if the acceleration in the horizontal (X-axis) direction is not confirmed in step S152 in FIG. 5 and the process proceeds to step S161, in step S161, the signal processing / control unit 11 performs the process in step S151 described above. The presence or absence of acceleration in the direction of gravity (Y-axis) is confirmed based on the determination result by. Here, when it is confirmed that the acceleration in the gravity (Y-axis) direction is generated, the process proceeds to the next step S162. If it is confirmed that no acceleration in the gravity (Y-axis) direction has occurred, it is determined that the acceleration condition is inappropriate (NG), and the series of processing sequences is terminated. Then, assuming that the “predetermined condition” is not satisfied in the process of step S102 of FIG. 4, the process returns to the process of step S101 of FIG. 4 and the subsequent processes are repeated.

  In the process of step S162, the signal processing / control unit 11 checks whether or not the tilt angle of the imaging apparatus 1 has changed based on the determination result obtained by the process of step S151 described above. The tilt angle is an angle formed by the horizontal X axis and the optical axis Z axis.

  Here, as a situation when the tilt angle of the imaging apparatus 1 changes, for example, situations as shown in FIGS. 13 and 14 are conceivable.

  Among these, the situation shown in FIG. 13 is a situation in which the user 100 is walking with his / her arm swinging while the user 100 holds the imaging apparatus 1 on the arm in the same manner as in FIGS. 8 to 10 described above. Show.

  In this case, consider a case where the user 100 moves from the point [A] to the point [B] shown in FIG.

  At this time, the imaging apparatus 1 moves within a predetermined range together with the arm that is swung as the user 100 walks. When the user 100 walks from the point [A] to the point [B], the tilt angle of the imaging device 1, that is, the direction in which the optical axis (Z axis) faces changes. This change also causes a change in the output signal of the acceleration detector 6.

  The situation shown in FIG. 14 is a case where the user 100 faces the person 103 as a subject in a state where the imaging apparatus 1 is fixed to the front surface of his / her body using a holding member, for example, on the chest. Assumed.

  Then, when the user 100 is in a state (not shown) substantially facing the person 103, it is assumed that the user 100 has performed an action of bending the chest in the direction indicated by the arrow R in FIG. In this case, the image pickup apparatus 1 has its optical axis (Z-axis) pointing up with the user's 100 work. That is, the tilt angle (the direction in which the optical axis (Z axis) faces) of the imaging device 1 changes.

  The behavior of the imaging apparatus 1 in this case can be shown as shown in FIG. That is, in the situation of FIG. 14, when the user 100 is directly facing the person 103, the imaging apparatus 1 is in the state of FIG. In this state, the imaging device 1 is applied with a force F in the gravity (Y-axis) direction.

  From this state, when the user 100 performs the action of bending the chest as described above, the imaging device 1 changes the posture from the state of FIG. 15A to the state of FIG. Along with this change in posture (change in tilt angle), a change occurs in the direction in which the force F in the direction of gravity (Y-axis) is applied to the imaging device 1. This change also causes a change in the output signal of the acceleration detector 6.

  Returning to FIG. 5, when it is confirmed in the process of step S162 described above that the tilt angle of the imaging device 1 has changed, the process proceeds to the process of step S154 described above, and thereafter the same process is performed. . If no change in the tilt angle of the imaging device 1 is confirmed, it is determined that the acceleration condition is inappropriate (NG), and the series of processing sequences is terminated. Then, assuming that the “predetermined condition” is not satisfied in the process of step S102 of FIG. 4, the process returns to the process of step S101 of FIG. 4 and the subsequent processes are repeated.

  As described above, when it is confirmed that the “predetermined condition” is not satisfied in the process of step S102 (FIG. 4) including the processing sequence (FIG. 5) for confirming the “predetermined condition”, the above step While returning to the process of S101 and repeating the subsequent processes, if it is confirmed that the “predetermined condition” is satisfied, the process proceeds to the next step S103.

  Subsequently, in step S103, the signal processing / control unit 11 executes a continuous shooting operation in which a predetermined configuration block is controlled and a plurality of shooting operations are continuously executed. This continuous shooting operation is an operation for continuously performing a normal still image acquisition operation.

  For example, when the user 100 performs an action that turns around in the situation of FIGS. 8 and 9, the imaging apparatus 1 also rotates in the direction of arrow R in FIGS. 9 and 10. If a continuous shooting operation is performed during the period of this operation, a plurality of captured images acquired by the continuous shooting operation are as shown in FIG.

  FIG. 11A shows a plurality of images obtained by a series of continuous shooting operations in order from the left. Here, reference numerals [No. x] (x = 1 to 5) indicates the order of the captured images. At this time, it is desirable that the overlapping region W exists in the end region in the long side direction of each captured image (that is, the moving direction of the imaging device 1). In the present invention, the overlapping region W is used to perform image composition processing to be described later.

  However, depending on the posture change and movement of the imaging apparatus 1 when continuous shooting is performed, the overlap area W becomes larger than the one shot image area as shown in FIG. 16A, for example. There may be a case where an overlapping area is not obtained between images before and after successive images as shown in FIG. When the overlapping area W is large as shown in FIG. 16A, the burden of performing the image composition processing increases because the number of necessary images increases. Also, as shown in FIG. 16C, the image composition process cannot be performed unless an overlapping region is obtained.

  As the posture change and the movement state of the imaging apparatus 1, for example, when the imaging apparatus 1 moves straight forward at high speed as in the example shown in FIG. 12 (simply shown in FIG. 17, reference sign U is the straight traveling direction). When the image pickup apparatus 1 moves with rotation when moving in the horizontal or vertical direction as in the example shown in FIG. 9, FIG. 10, FIG. 13 or FIG. 14 (simply shown in FIG. 18). The moving speed of the imaging device 1 itself is different between the former and the latter.

  Therefore, in order to perform quick and accurate image composition processing, it is necessary to make a plurality of images obtained by the continuous photographing operation appropriate. Therefore, it can be said that the number of images acquired by the continuous photographing operation is as small as possible, and it is desirable that the overlapping area W has a small area while obtaining the overlapping area W as shown in FIG.

  In order to realize this, in the processing sequence of the continuous shooting operation in the present embodiment, the continuous shooting speed is controlled in accordance with the posture change and movement state of the imaging apparatus 1.

  Here, the details of the processing sequence of the continuous shooting operation in step S103 described above will be described with reference to the flowchart of FIG.

  When the continuous shooting operation is executed in the process of step S103 of FIG. 4 according to the above-described procedure, first, in step S171 of the subroutine of FIG. The “high frame rate shooting” process is executed to execute as fast as possible).

  Next, in step S172, the signal processing / control unit 11 performs a process of determining the acceleration in the main movement direction based on the state information temporarily recorded in the process of step S155 of FIG.

  Subsequently, in step S173, the signal processing / control unit 11 determines whether or not rotation (angle change) is involved as the posture change or movement state of the imaging device 1 based on the determination result in the process of step S172 described above. Confirm. If it is confirmed that there is no rotation, the process proceeds to the next step S174.

  Here, the movement state not accompanied by rotation is, for example, movement as shown in FIGS. 12 and 17 described above. In this case, since there is little change in the image, there is a possibility that the overlap area W of the adjacent images among the plurality of continuously shot images becomes large as in the example shown in FIG.

  Therefore, in the process of the next step S174, the signal processing / control unit 11 performs the selection process of the recording frame according to the acceleration information based on the determination result of the process of step S172 described above, and only the selected image is the first. Processing for temporarily recording in one temporary recording unit 4a is performed. The actual recording process is performed after the end of a series of continuous shooting processes (see step S104 in FIG. 4 described later).

  As an example of the selection process of the recording frame performed here, for example, when the acceleration is high, a frame is selected from a series of continuously shot images, and when the acceleration is low, the frame is selected every other frame. And so on. Thereafter, the process proceeds to step S176.

  On the other hand, when it is confirmed in the process of step S173 described above that rotation is involved, the process proceeds to step S175.

  Here, the movement state with rotation is, for example, movement as shown in FIG. 18, such as FIG. 9, FIG. 10, FIG. 13, FIG. In this case, since the change of the image is large, there is a possibility that the overlapping area W of the adjacent images among the plurality of continuously shot images becomes small as in the example shown in FIG.

  Therefore, in the process of step S175, the signal processing / control unit 11 performs a process for temporarily recording all of the plurality of images obtained by continuous shooting in the first temporary recording unit 4a. The actual recording process is performed after the end of a series of continuous shooting processes (see step S104 in FIG. 4 described later). Thereafter, the process proceeds to step S176.

  In step S <b> 176, the signal processing / control unit 11 monitors the output signal of the acceleration detection unit 6 and confirms whether or not the movement state of the imaging device 1 has substantially stopped. If it is confirmed that the imaging apparatus 1 is still moving and has not been stopped, the process returns to the above-described step S172, and the subsequent processes are repeated. If it is confirmed that the imaging apparatus 1 has stopped moving, the process proceeds to the next step S177.

  In step S177, the signal processing / control unit 11 executes processing for ending the photographing operation, thereafter ends a series of processing, and returns to the original processing (return).

  Returning to FIG. 4, when the subroutine of FIG. 6, that is, the process of step S103 is completed as described above, the process proceeds to the next step S104.

  In step S104, the signal processing / control unit 11 temporarily records a plurality of image signals to be acquired and recorded in the first temporary recording unit 4a by the processing in step S103 described above. Thereafter, the process proceeds to step S105.

  In step S105, the image signal processing unit 11d of the signal processing / control unit 11 executes panorama synthesis processing (image connection processing) for connecting a plurality of image signals temporarily recorded in the first temporary recording unit 4a. The composite image signal obtained as a result of processing is temporarily recorded in the second temporary recording unit 4b. Thereafter, the process proceeds to step S106.

  Here, the panorama synthesizing process (image joining process) executed by the image signal processing unit 11d is as follows.

  For example, as shown in FIG. 1] to [No. 5], it is assumed that the plurality of images are acquired, and this is an image composition process in which the overlapping regions W of these images are matched and connected. The panorama composite image generated by this processing is a horizontally long image indicated by the symbol G in FIG.

  Subsequently, in step S106, the trimming unit 11e of the signal processing / control unit 11 cuts out an image of a predetermined region centered on the main subject based on the composite image signal temporarily recorded in the second temporary recording unit 4b. Execute trimming processing. Thereafter, the process proceeds to step S107.

  Here, the trimming process executed by the trimming unit 11e is as follows.

  For example, as shown in FIG. 11A, the desired main subject 101 image among the panoramic composite images G generated from a plurality of images (five in the example of FIG. 11) acquired by continuous shooting is [No . 4], [No. 5].

  The trimming process is a process of cutting out a predetermined region T in the panorama composite image G so that the main subject 101 is substantially at the center of the screen. The trimmed image generated as a result is an image as shown in FIG.

  When performing the trimming process, as means for detecting the main subject 101 from the panorama composite image G, the face image of the subject 101 is registered in advance, and the face detection unit 3 is used based on the registration information. It is possible by using it.

  Subsequently, in step S107 of FIG. 4, the signal processing / control unit 11 records the trimmed image signal generated by the above-described processing of step S106 on the recording medium of the recording unit 4 after performing predetermined processing. . Thereafter, the series of processes is terminated (return).

  In the process of step S107, the image data recorded on the recording medium of the recording unit 4 is acquired not only by the trimmed composite image signal but also by a series of continuous shooting operations and is stored in the first temporary recording unit 4a. A plurality of temporarily recorded image signals, a panoramic composite image temporarily recorded in the second temporary recording unit 4b, and the like may be included.

  Of the “camera control” (FIG. 4) by the imaging apparatus 1 of the present embodiment, the processing sequence in the “automatic shooting mode” is as described above.

  On the other hand, when it is confirmed in the process of step S101 described above that the imaging apparatus 1 is not in the “no finder state”, the process proceeds to step S111. In step S111 and subsequent steps, the signal processing / control unit 11 executes a processing sequence in a normal operation mode.

  First, in step S111, the signal processing / control unit 11 monitors an output signal from the operation unit 7 and confirms whether or not a shutter release signal instructing the start of the photographing operation is generated. This confirmation is performed by, for example, confirming whether a predetermined operation for instructing a photographing operation in the operation unit 7 by the user 100, that is, an operation of a shutter release button or the like has been performed. If the shutter release signal is confirmed here, the process proceeds to the next step S112.

  In step S <b> 112, normal shooting processing that is generally performed in the conventional imaging apparatus 1 is executed. Thereafter, the process proceeds to step S107.

  In the process of step S111, if the release signal is not confirmed, the signal processing / control unit 11 proceeds to the process of step S121.

  In step S121, the signal processing / control unit 11 monitors the output signal from the operation unit 7 and confirms whether or not a switching instruction signal to the reproduction mode is generated. Here, when it is confirmed that the operation mode is set to the reproduction mode by the switching signal to the reproduction mode, the process proceeds to the next step S122. On the other hand, when the signal for switching to the reproduction mode is not confirmed, the process returns to the above-described step S101 and the subsequent processes are repeated.

  In step S <b> 122, the signal processing / control unit 11 controls a predetermined configuration block to execute image reproduction processing. Thereafter, the processing returns to the above-described step S121, and the subsequent processing is repeated.

  In the above-described embodiment, when performing panorama synthesis processing, trimming processing, or the like, it may be possible to use an audio signal from a subject acquired by the microphone 5.

  For example, consider a case as shown in FIG. 19 as an example of a plurality of images acquired by performing a continuous shooting operation.

  In FIG. 19, an arrow S indicates a moving direction when the imaging apparatus 1 performs continuous shooting while moving. In the example shown in FIG. 19, three images [No. 1]. [No. 2], [No. 3] is acquired, and it is assumed that an image of the main subject 101 is captured in any of the captured frames.

  Here, the three images [No. 1]. [No. 2], [No. 3], when the panorama synthesis process is executed, priority is given to an image taken at the timing when the subject 101 responds as a condition for selecting which of the main subjects 101 of the three images should be selected. To choose.

  For example, let us consider a case where the user 100 performs an action in which the user 100 turns and speaks toward the subject 101 as shown in FIG.

  At this time, for example, it is assumed that the imaging device 1 is activated and a continuous shooting operation is started. Accordingly, the continuous shooting operation starts from the time when the voice of the user 100 is generated, and the continuous shooting is continued during the work that the user turns around. If the subject 101 answers in the meantime, the sound generation timing is recorded. The sound generation timing information is appropriately referred to when signal processing such as panorama synthesis processing is performed.

  Here, each image obtained as a result of the continuous shooting shown in FIG. 19 is disassembled and shown in FIG. Here, an image photographed at a timing substantially equivalent to the timing at which the subject 101 pronounced is denoted by [No. 3].

  In this case, when panoramic image processing is executed, the image [No. 3] is preferentially selected, and then the image [No. 2] is selected. The image [No. 3] image [No. 3] as shown in FIG. 2] is performed.

  In the example of FIGS. 19 and 20, as indicated by the arrow S in FIG. 19, the imaging apparatus 1 is slightly moved in the oblique direction. Therefore, in order to generate a rectangular image, a processed panorama composite image Trimming in the height direction is required.

  Therefore, as shown in FIG. 20B, a trimming process for cutting out the portion of the region T is performed, and an image generated as a result is indicated by a code T (rectangular image indicated by width P × height H). Become.

  Thus, by effectively using the audio signal that can be acquired by the microphone 5 during image processing, for example, image recording before and after the moment when communication between the user 100 and the subject 101 is performed can be performed.

  As described above, according to the first embodiment, the operation of the user 100 held in the no-finder state by the imaging apparatus 1 is determined based on the output signal of the acceleration detection unit 6, and the predetermined condition is satisfied. When they match, a continuous shooting operation is executed, thereby acquiring a plurality of continuous images. Then, panorama synthesis processing is performed to connect the plurality of images, and further, trimming processing is performed to cut out a region in a predetermined range that is approximately centered on a desired subject from the generated panorama composite image, and finally generated. One still image recorded is recorded.

  Since such a series of processing is automatically executed, the user can hold the image pickup device in his / her hand without being aware of the composition or performing an operation for photographing, so-called no-finder state. It is possible to easily acquire a still image including a desired subject accurately by performing a predetermined operation in step.

  The present invention is not limited to the above-described embodiments, and it is needless to say that various modifications and applications can be implemented without departing from the spirit of the invention. Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the above-described embodiment, if the problem to be solved by the invention can be solved and the effect of the invention can be obtained, this constituent requirement is deleted. The configured structure can be extracted as an invention.

  The present invention is not limited to the form of an imaging device as an electronic device specialized for a photographing function such as a digital camera, and other forms of electronic devices having a photographing function, such as a recording device, a mobile phone, and an electronic notebook , Personal computers, game devices, digital media players, televisions, watches, navigation devices using GPS (Global Positioning System), and other electronic devices with various shooting functions.

DESCRIPTION OF SYMBOLS 1 ... Imaging device 1a ... Holding member 2 ... Imaging part 3 ... Face detection part 4 ... Recording part 4a ... 1st temporary recording part 4b ... 2nd temporary recording part 5 ... Microphone 6 ... Acceleration Detecting unit 7 ...... Operation unit 8 ... Display unit 8b ... Touch panel 11 ... Signal processing / control unit 11b ... Display control unit 11c ... Signal compression / decompression unit 11d ... Image signal processing unit 11e ... Trimming unit 20 …… Lens unit 20a …… Shooting lens

Claims (7)

In an imaging device that records an image signal based on an output signal from an imaging unit,
A determination means for determining whether the user is in a no-finder state in which shooting is performed without checking the display screen;
An acceleration detection unit that detects a change in posture of the imaging device when the determination unit determines that the camera is in a no-finder state;
When a change in posture of the imaging device is detected based on the output signal of the acceleration detection unit, the imaging unit starts a continuous shooting operation to acquire a series of image signals, and the series of images A signal processing control unit for performing a panoramic synthesis process for joining images represented by the series of multiple image signals based on the signal;
Comprising
The signal processing control unit, when performing the panorama composing process, selecting every other frame from the thus found a series of multiple images by the continuous shooting operation if the acceleration is greater than a predetermined value from the acceleration detecting portion An imaging apparatus characterized by:   2. The signal processing control unit according to claim 1, wherein, when performing the panorama synthesis processing, the signal processing control unit selects every other frame if the acceleration from the acceleration detection unit is smaller than a predetermined value. Imaging device.   The imaging apparatus according to claim 1, wherein the signal processing control unit controls a shooting speed of the continuous shooting operation according to the acceleration detected by the acceleration detection unit.   Further, the signal processing control unit includes a trimming unit that performs a trimming process for cutting out a partial area from the panorama image generated by the panorama synthesis process so that the main subject is substantially at the center of the screen. The imaging device according to claim 1. A microphone that converts sound into an electrical signal;
A record unit that records the panoramic image which is the panorama stitching process, further comprises,
The signal processing control unit starts the continuous shooting operation at a sounding timing at which an audio signal from a subject is acquired by the microphone, performs panorama synthesis processing on the continuously shot image obtained by the continuous shooting operation, and records the recording unit. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is recorded . Information of the sound generation timing is recorded in the recording unit, the panorama composing process imaging apparatus according to claim 5, characterized in that it is performed based on information of the sound generation timing. A face detection unit;
The trimming unit, the imaging apparatus according to claim 4, characterized in that to set the trimming area in the detection result based on Dzu have been the trimming process by the face detection unit.

Images