JP5932862B2 - Imaging method of digital camera and computer-executable program - Google Patents

Description

  The present invention relates to an imaging method for a digital camera and a computer-executable program.

  In a digital camera, a function for continuously photographing a subject (so-called continuous shooting function) is used. Various types of signal processing are performed on the image data captured by the digital camera. For example, there are an auto exposure (hereinafter abbreviated as AE) function for automatically controlling exposure and an auto white balance (hereinafter abbreviated as AWB) function for automatically adjusting white to an appropriate color. The exposure can be controlled by adjusting the digital gain for the image data or adjusting the gamma curve in the gamma conversion. Further, white balance adjustment can be performed by adjusting a WB (white balance) gain for image data. These shooting parameters can be adjusted only after the light is taken into the image sensor, and in general, appropriate shooting parameters can be obtained several seconds after the start of the shooting operation.

  When a user shoots a subject with a digital camera, the subject may be captured for a very short time (for example, when a child smiles or a longing star is seen in the city), but the shooting operation starts. Immediately after, no appropriate shooting parameters are obtained, and as a result, an image with exposure and white balance that is far from the photographer's intention is shot. Also, at the initial stage of shooting, the user often cannot frame the subject well.

JP 2008-48307 A JP 2001-251551 A

  The present invention has been made in view of the above, and it is possible for a user to obtain an image with an appropriate composition or an image with an appropriate composition without missing a shooting opportunity of a desired subject. An object is to provide an imaging method for a digital camera and a computer-executable program.

  In order to solve the above-described problems and achieve the object, the present invention is an imaging method of a digital camera that continuously captures a subject with L (where L ≧ 2) images, and N (where 0 <N <L) A step of storing image data obtained by imaging the Nth subject, and the stored image data obtained by imaging the Nth subject, at least imaging parameters and compositions of image data obtained by imaging the Mth subject. And signal processing using one of them.

  According to a preferred aspect of the present invention, in the storing step, RAW data of the subject imaged in the Nth image is stored, and in the signal processing step, the stored RAW data of the Nth subject is stored. On the other hand, it is desirable to perform signal processing using imaging parameters of image data obtained by imaging the Mth subject.

  Further, according to a preferred aspect of the present invention, it is desirable that L (where L ≧ 2) images of the subject are continuously captured when the shutter button is pressed.

  According to a preferred aspect of the present invention, when the digital camera is activated, L (where L ≧ 2) images of the subject are continuously captured, and the M (where N <M ≦ L) sheets. The subject is preferably image data captured when the shutter button is pressed.

  Further, according to a preferred aspect of the present invention, the shooting parameter is a white balance adjustment parameter, and in the image processing step, the stored image data obtained by capturing the Nth subject is used as the Mth image. It is desirable to perform white balance adjustment using white balance adjustment parameters of image data obtained by imaging the subject.

  According to a preferred aspect of the present invention, the shooting parameter is an exposure adjustment parameter, and in the signal processing step, the stored image data obtained by imaging the Nth subject is used as an Mth subject. It is desirable to adjust the exposure using the exposure adjustment parameter of the image data obtained by capturing the image.

  According to a preferred aspect of the present invention, in the signal processing step, the stored composition of image data obtained by imaging the Nth subject is based on the composition of image data obtained by imaging the Mth subject. It is desirable to change it.

  According to a preferred aspect of the present invention, in the signal processing step, it is determined whether or not there is the same object in the M-th image data and the N-th image data, and there is the same object, In addition, when the M-th image data of the same object is present in the center or larger than the N-th image data, the composition of the N-th image data is expressed as the M-th image data. If there is no same object, or there is the same object, the same object is compared with the Nth image data when the Mth image data is changed. In the case where the image data does not exist at the center or large, it is desirable that the composition of the Nth image data is not changed by using the composition of the Mth image data.

  According to a preferred aspect of the present invention, it is desirable that the object is a person.

  In order to solve the above-described problems and achieve the object, the present invention is a program mounted on a digital camera that continuously captures L (note that L ≧ 2) subjects. , 0 <N <L) image data obtained by imaging the subject, and the stored image data obtained by imaging the Nth subject are defined as M (where N <M ≦ L). And causing the computer to execute a signal processing step using at least one of imaging parameters and composition of image data obtained by imaging the subject.

  According to the present invention, there is an effect that a user can obtain a high-quality image or an image with an appropriate composition without missing a photographing opportunity of a desired subject.

FIG. 1A is a diagram for explaining the principle of the continuous shooting method of the imaging apparatus according to the present embodiment. FIG. 1B is a diagram for explaining the principle of the continuous shooting method of the imaging apparatus according to the present embodiment. FIG. 2-A is a perspective view showing an appearance of the mobile phone terminal. FIG. 2-B is a rear view showing the appearance of the mobile phone terminal. FIG. 3 is a block diagram showing a schematic configuration of the mobile phone terminal. FIG. 4 is a schematic functional block diagram of the camera device. FIG. 5 is a diagram illustrating an example of a camera operation screen. FIG. 6 is an explanatory diagram for explaining the continuous imaging process. FIG. 7 is a flowchart for explaining the composition optimization process. FIG. 8 is a diagram illustrating a specific image example of the composition optimization process. FIG. 9 is an explanatory diagram for describing a modification of the continuous imaging process. FIG. 10 is a flowchart for explaining a modification of the composition optimization process.

  A digital camera imaging method and a computer-executable program according to the present invention will be described in detail below. Although the components of the present invention are generally illustrated in the drawings herein, it can be readily understood that they may be arranged and designed in a wide variety of configurations with various configurations. Accordingly, the following more detailed description of the apparatus, system and method embodiments of the present invention is not intended to limit the scope of the invention as set forth in the claims, but merely as an example of selected embodiments of the invention. It is intended merely to illustrate selected embodiments of apparatus, systems and methods consistent with the present invention as set forth in the claims herein. Those skilled in the art will appreciate that the present invention may be implemented without one or more of the specific details or with other methods, components, and materials. Note that the present invention is not limited to the embodiments. In addition, constituent elements in the following embodiments include those that can be easily assumed by those skilled in the art or that are substantially the same. The following embodiments and modifications may be implemented independently, or a part or all of them may be implemented in combination.

(Outline of the present invention)
1A and 1B are diagrams for explaining the principle of the continuous shooting method of the digital camera according to the present embodiment. When you shoot with a digital camera, you may want to shoot as soon as you want to “shoot” the subject (for example, when you see a smiling child or a long-awaited star in the city), but you miss the opportunity to shoot. There are many cases. Therefore, it is desirable to be able to take a picture as soon as you want to "shoot" the subject. However, at the current level of technology, there is a time lag until the subject can be properly photographed. When photographing a subject, the shooting parameters (white balance, exposure, etc.) and composition are gradually appropriate. It will become a state.

  In FIG. 1-A, the horizontal axis indicates time (the number of images taken continuously), and the vertical axis indicates the preference of the image when the subject is continuously shot. 201 is the degree of similarity to the state where the user wanted to shoot a subject (for example, if he wanted to take a smile on his face, he wanted to shoot a smile), 202 was the shooting parameter (white balance, exposure, etc.) , 203 indicates the stability of the shooting composition by the user.

  As shown in FIG. 1-A and FIG. 1-B, when the first and sixth images are compared, the user wants to photograph the first image as compared to the sixth image. The image taken earlier is preferable. As for the stability of the shooting parameters, the sixth image is more stable than the first image, and an image taken later is preferable. Regarding the stability of the shooting composition by the user, the sixth shot is more stable in framing the shooting target to be shot than the first shot, and an image shot later is preferable.

  Therefore, in the present embodiment, when the subject is continuously shot, based on the idea that the previously shot image is preferable for the shooting target, and that the shot image and the composition are preferable for the shooting parameter and composition. In the case where L (where L ≧ 2) images of the subject are continuously captured, the image data of the subject that was previously captured (Nth (where 0 <N <L)) is captured later (Mth) (However, N <M ≦ L) Signal processing is performed using the shooting parameters and composition of the image data of the subject, so that the user does not miss the shooting opportunity of the desired subject and the high-quality image and It is possible to obtain an image with an appropriate composition.

(Embodiment)
An appearance configuration of the mobile phone terminal 1 to which the digital camera according to the present embodiment is applied will be described. In this embodiment, a smartphone will be described as an example of a mobile phone terminal. FIG. 2A is a perspective view showing an appearance of the mobile phone terminal 1. FIG. 2-B is a rear view showing the appearance of the mobile phone terminal.

  As shown in FIGS. 2-A and 2-B, the mobile phone terminal 1 includes a substantially hexahedral housing 2. One surface of the surface of the housing 2 is the front surface 2A, the other surface facing the front surface 2A is the back surface 2C, and the surface of the housing 2 sandwiched between the front surface 2A and the back surface 2C is the side surface 2B. . In the mobile phone terminal 1, a touch display unit 3 including a touch panel 3 </ b> A and a display unit 3 </ b> B, an operation unit 4, a microphone 5, and a speaker 7 are arranged on the front surface 2 </ b> A of the housing 2. On the back surface 2C of the housing 2, a camera unit 6A is disposed. On the side surface 2B of the housing 2, a power button, a volume adjustment button, etc. (not shown) are arranged.

  The touch display unit 3 is disposed over substantially the entire center of the front surface 2A. The operation unit 4 and the microphone 5 are arranged at one end in the longitudinal direction of the front surface 2A. The speaker 7 is disposed at the other end in the longitudinal direction of the front surface 2A. The camera unit 6A is disposed at one end in the longitudinal direction of the back surface 2C. The camera unit 6A can shoot from the back surface 2C side.

  The touch display unit 3 displays information such as characters, graphics, and images, and detects various operations performed on the touch panel 3A using a finger, stylus, pen, or the like (hereinafter referred to as “indicator”). . As a method of detecting various operations by the touch panel 3A, a capacitance type, a pressure sensitive type, or the like can be adopted.

  An image taken by the camera unit 6A can be displayed on the display unit 3B, and the user can use the display unit 3B as an electronic viewfinder. The user can obtain a photo opportunity while viewing the image displayed on the display unit 3B.

  FIG. 3 is a block diagram showing a schematic configuration of the mobile phone terminal 1. As shown in FIG. 3, the mobile phone terminal 1 includes a control unit 10, a memory 11, a storage unit 12, a communication unit 13, a camera device 6 including a camera unit 6A, and a touch display unit 3 (touch panel 3A, A display unit 3B), an operation unit 4, a microphone 5, and a speaker 7 are provided.

  The touch display unit 3 includes a display unit 3B and a touch panel 3A superimposed on the display unit 3B. The touch panel 3A detects various operations performed on the touch panel 3A using an indicator such as a finger or a pen together with a position on the touch panel 3A where the operation is performed, and notifies the control unit 10 of the detected operation. The operations detected by the touch panel 3A include a touch operation, a slide operation, and a pitch operation. The display unit 3B includes, for example, a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) panel, and displays characters, graphics, and the like.

  The operation unit 4 receives a user's operation through the buttons 4A, 4B and the like, and transmits an instruction signal corresponding to the received operation to the control unit 10. The button 4A is a button for switching between a continuous shooting (simply referred to as “continuous shooting”) mode and a normal shooting mode. The continuous shooting mode is a mode in which a plurality of subjects are continuously shot when a shutter button is pressed. The normal mode is a mode for photographing one subject when the shutter button is pressed.

  The power supply unit 14 supplies power obtained from the storage battery or the AC adapter to each unit of the mobile phone terminal 1 including the control unit 10 according to the control of the control unit 10.

  The communication unit 13 establishes a radio signal line with the base station via a channel assigned by the base station, and performs telephone communication and information communication with the base station. The speaker 7 outputs the sound signal transmitted from the control unit 10 as sound. The microphone 5 converts the voice of the user or the like into a voice signal and outputs it to the control unit 10.

  The memory 11 is composed of, for example, a RAM, a DRAM, or the like, and serves as a work area for temporarily storing a program executed by the control unit 10, data referred to by the control unit 10, calculation results of the control unit 10, and the like. used.

  The storage unit 12 is, for example, a nonvolatile memory or a magnetic storage device, and stores programs and data used for processing in the control unit 10. The program stored in the storage unit 12 includes an OS for realizing the basic functions of the mobile phone terminal 1, a device driver for hardware control of the device, a camera application program for realizing the camera function, and e-mail. A mail application program that provides a function for realizing the function, a browser application program that provides a function for realizing the WEB browsing function, and the like are included.

  The control unit 10 is, for example, a CPU (Central Processing Unit), a microprocessor, a DSP, and the like, and implements various functions (modes) by comprehensively controlling the operation of the mobile phone terminal 1. Specifically, the control unit 10 executes instructions included in the program stored in the storage unit 9 while referring to the data stored in the storage unit 12 or the data expanded in the memory 11 as necessary. Various functions (modes) are realized by controlling the touch display unit 3, the communication unit 13, the camera device 6, and the like. Note that the program executed by the control unit 10 and the data to be referenced may be downloaded from the server device by wireless communication by the communication unit 13.

  FIG. 4 is a schematic functional block diagram of the camera device 6. The camera device 6 includes a camera unit 6A, an analog signal processing circuit 24, an A / D conversion circuit 25, an ISP (Image signal Processor) 26, an interface 27 for connecting the camera device 6 and the control unit 10, and the like.

  The camera unit 6A includes a lens 21, a mechanical mechanism 22 having a lens moving mechanism (AF function, zoom function), a mechanical shutter, and an automatic iris function, an image sensor 23, and the like. The lens 21 is a wide-angle zoom lens, for example, and is configured to be movable in order to adjust the focal position and the zoom position, and forms an image of subject light. The image sensor 23 includes an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), an RGB color filter, and the like. The subject light imaged by the lens 21 is R, G, B Are output to the analog signal processing circuit 24 as analog image data.

  The analog signal processing circuit 24 performs analog signal processing (low noise, analog gain correction, etc.) on the R, G, B analog image data output from the image sensor 23, and the A / D conversion circuit 25. Output to.

  The A / D conversion circuit 25 performs A / D conversion on the R, G, B analog image data, and outputs the R, G, B digital image data (RAW data) to the ISP 26. The R, G, B digital image data output from the A / D conversion circuit 25 is RAW data that has not yet undergone digital signal processing such as pixel interpolation processing.

  An ISP (Image Signal Processor) 26 performs various types of digital signal processing such as pixel interpolation processing, AWB adjustment, AE adjustment, and color difference / luminance separation processing on input RAW data. The ISP 26 includes a buffer memory 31 for storing RAW data, an AWB adjustment parameter (white balance adjustment parameter), and an AE adjustment parameter (exposure adjustment parameter), a pixel interpolation unit 32, an AWB adjustment unit 33, an AE adjustment unit 34, A luminance color difference separation unit 35, a video signal processing unit 36, a JPEG processing unit 37, and the like are provided.

  The pixel interpolation unit 32 interpolates R, G, and B image data. The AWB adjustment unit 33 acquires an evaluation value for AWB adjustment from R, G, and B image data, calculates an AWB adjustment parameter based on the acquired evaluation value for AWB adjustment, and based on the calculated AWB adjustment parameter Adjust the white balance. For example, the evaluation value for AWB adjustment can be a value obtained by integrating R, G, B data for each of a plurality of blocks and for each color in the screen, and the AWB adjustment parameter can be a digital gain for R, G, B. In the AWB adjustment, each digital gain of R, G, and B image data may be adjusted.

  The AE adjustment unit 34 acquires an AE adjustment evaluation value from the R, G, and B image data, calculates an AE adjustment parameter based on the acquired AE adjustment evaluation value, and determines an AE based on the calculated AE adjustment parameter. Make adjustments. For example, the evaluation value for AE adjustment can be a value obtained by accumulating G data for each of a plurality of blocks in the screen, and the AE adjustment parameter is a digital gain value or a gamma conversion characteristic value. , G, B image data digital gain adjustment and gamma conversion may be performed.

  The luminance / color difference separation unit 35 separates R, G, and B image data into color difference signals (Cb, Cr) and luminance signals (Y). The video signal processing unit 36 creates a video signal based on the color difference signals (Cb, Cr) and the luminance signal (Y). This video signal is output to the touch display unit 3 via the control unit 10 to display an image of the subject.

  The JPEG processing unit 37 performs, for example, orthogonal transformation, which is a process of JPEG-compliant image compression / decompression, and Huffman encoding / decoding, which is a process of JPEG-compliant image compression / decompression.

  The control unit 10 uses the memory 11 as a work area according to the camera application program 12A stored in the storage unit 12, and follows an instruction from the operation unit 4 or an operation instruction from the camera operation screen displayed on the touch display unit 3, Controls all operations of the camera device 6.

  Specifically, the control unit 10 controls an imaging operation (including continuous imaging), an AE operation, an AWB adjustment operation, an AF operation, and the like. The control unit 10 includes a face detection function and the like, and can detect a person's face from image data. In addition, the control unit 10 records the JPEG data subjected to JPEG compression processing by the JPEG processing unit 37 in the storage unit 12 or reads out from the storage unit 12.

  When the camera application program 12A is selected on the touch display unit 3 by the user operation, the control unit 10 activates the camera application program 12A to activate the camera device 6 and displays the camera operation screen on the touch display unit 3. indicate. FIG. 5 is a diagram illustrating an example of a camera operation screen displayed on the touch display unit 3. As shown in FIG. 5, the camera operation screen includes an area (electronic viewfinder) 8A for displaying captured image data and decompressed recorded image data, a shutter button 8C, and buttons for selecting various functions. (Not shown) and an area 8B in which the state of the camera device 6 is displayed. The user can designate a focus position by touching the area 8A (manual focus), and the control unit 10 controls the mechanical mechanism 22 to place the lens 21 at a position corresponding to the designated focus position. Move.

  The continuous shooting process of the camera device 6 configured as shown in FIG. 4 will be described with reference to FIGS. FIG. 6 is an explanatory diagram for explaining the continuous shooting process. FIG. 7 is a flowchart for explaining the composition optimization process. FIG. 8 is a diagram illustrating a specific image example of the composition optimization process.

  First, when the camera application program 12A is selected on the touch display unit 3 by a user operation, the control unit 10 activates the camera application program 12A to activate the camera device 6 and displays the camera operation screen on the touch display unit 3. To display. Then, when the user presses the shutter button 8C in a state where the continuous shooting mode is selected, L images (L is 2 or more) are continuously imaged. In this case, the user immediately frames the desired shooting target, presses the shutter button 8C, and gradually matches the framing of the subject. Hereinafter, a case where 10 images are continuously shot will be described as an example.

  First, when the user presses the shutter button 8C in a state where the continuous shooting mode is set, the first shooting is performed. More specifically, the shutter of the mechanical mechanism 22 is opened for a certain time, and the subject image is incident on the image sensor 23. The RGB image data output from the image sensor 23 is subjected to analog signal processing by an analog signal processing circuit 24, and then A / D converted by an A / D conversion circuit 25, whereby RGB digital image data (RAW data) is converted. Input to the ISP 26.

  In the ISP 26, the first RAW data is stored in the buffer memory 31 (see T1 in FIG. 6). That is, the first R, G, B image data before digital signal processing is stored in the buffer memory 31. In the first RAW data, each pixel of R, G, and B is interpolated by the pixel interpolation unit 32. After pixel interpolation, the AWB adjustment unit 33 acquires an evaluation value for AWB adjustment from the R, G, and B image data, calculates an AWB adjustment parameter based on the acquired evaluation value for AWB adjustment, and calculates the calculated AWB adjustment. AWB adjustment is performed based on the parameters.

  Subsequently, the AE adjustment unit 34 acquires an AE adjustment evaluation value from the R, G, and B image data, calculates an AE adjustment parameter based on the acquired AE adjustment evaluation value, and calculates the calculated AE adjustment parameter. AE adjustment is performed based on the above.

  Thereafter, after the color / difference signal (Cb, Cr) and the luminance signal (Y) are separated by the luminance / color difference separation unit 35, a video signal is created by the video signal processing unit 36, and touch display is performed via the control unit 10. An image of the subject is displayed in part 3.

  Subsequently, the second to tenth images are sequentially taken. The RAW data obtained by imaging the second to tenth images is subjected to the same digital signal processing by the ISP 26 without being stored in the buffer memory 31. As shooting proceeds, an image with appropriate white balance and exposure (brightness) is obtained by AWB adjustment and AE adjustment. In the tenth shooting, the AWB adjustment unit 33 stores the AWB adjustment parameter used in the tenth AWB adjustment in the buffer memory 31 (T2 in FIG. 6), and the AE adjustment unit 34 sets the tenth AE. The AE adjustment parameter used in the adjustment is stored in the buffer memory 31 (T3 in FIG. 6). Further, the JPEG processing unit 37 generates JPEG (compressed) data based on the color difference signals (Cb, Cr) and the luminance signal (Y), and stores it as the 10th JPEG data via the control unit 10. 12 (T4 in FIG. 6). Note that JPEG data is not created or stored for the second to ninth sheets.

  The ISP 26 uses the tenth AWB adjustment parameter and the AE adjustment parameter stored in the buffer memory 31 for the first RWA data stored in the buffer memory 31 in accordance with an instruction from the control unit 10. Then, digital signal processing is performed (T5 in FIG. 6).

  More specifically, in the ISP 26, the first RAW data is interpolated into R, G, and B image data by the pixel interpolation unit 32, and then the AWB adjustment unit 32 performs the tenth AWB adjustment parameter. AWB adjustment is performed using, and the AE adjustment unit 33 performs AE adjustment using the tenth AE adjustment parameter. Thereafter, after the color / difference signal (Cb, Cr) and the luminance signal (Y) are separated by the luminance / color difference separation unit 35, JPEG data is created by the JPEG processing unit 37, and then 1 through the control unit 10. The first JPEG data is stored in the storage unit 12 (T6 in FIG. 5).

  Subsequently, the control unit 10 executes a composition optimization process for changing the composition of the first image data by using the composition of the tenth image data (T7 in FIG. 6). A specific process example of the composition optimization process will be described with reference to FIGS.

  In FIG. 7, the control unit 10 reads the first and tenth JPEG data from the storage unit 12, decompresses them by the JPEG processing unit 37, and then the first and tenth image data. It is then determined whether or not there is the same object (step S1). The object is, for example, a person. When there is no same object on the first and tenth sheets (“No” in step S1), the control unit 10 does not optimize the composition of the first image data (step S4). The object is not limited to a person, and may be, for example, an animal (for example, a dog, a cat, etc.), a vehicle (for example, a car, a UFO, etc.), etc., and the same object exists on the first and tenth sheets. Applicable.

  On the other hand, when there is the same object on the first sheet and the tenth sheet (“Yes” in step S1), the control unit 10 determines that the same object is compared with the first image data. Then, it is determined whether or not the image is in the center or large (step S2). If the same object is not shown in the center or larger than the first image data of the tenth image data (“No” in step S2), the composition of the first image data is optimal. (Step S4).

  When the image data of the 10th image is larger or larger than the image data of the first image (“Yes” in step S2), the control unit 10 determines that the same object has the 10th image data. Based on the data composition, the composition of the first image data is optimized using three divisions, two divisions, horizontal / vertical division, or the like (step S3). Then, the control unit 10 converts the first image data with the optimized composition into JPEG data by the JPEG processing unit 37 and stores it in the storage unit 12. Further, the control unit 10 causes the video processing unit 36 to convert the first image data whose composition is optimized into a video signal, and displays the video signal on the touch display unit 3. As a result, it is possible to provide the user with an image using the first image for the shooting target and using the tenth image for the shooting parameters and composition.

  Next, a specific image example of the composition optimization process will be described with reference to FIG. The first image 100 captures a smiling woman 110 and is suitable for the subject. On the other hand, the composition is not desirable because the woman 110 is shown small in the lower left. When the tenth image is the image 101, since the female 111 is partially captured in the lower right, it is not a desirable composition, so the composition optimization of the first image 101 is not performed. On the other hand, when the tenth image is the image 102, the female 112 is shown in the center, which is a desirable composition. Therefore, the composition of the first image 101 is optimized using the composition of the tenth image 102. As an example, the female 110 of the first image 101 is clipped and enlarged and moved to the position of the female 112 of the tenth image 102. As a result, the first image is an image in which a smiling woman 110 is arranged large in the center as shown in an image 103.

  In the above embodiment, the image data captured on the first image is processed using the imaging parameters and composition of the image data captured on the 10th image, but the present invention is limited to this. When the subject is continuously imaged with L (where L ≧ 2) images, the image data captured first (Nth image (where 0 <N <L)) is captured later (M images). Signal processing may be performed using the imaging parameters and composition of the image data (where N <M ≦ L).

  As described above, according to the present embodiment, when L (however, L ≧ 2) images of the subject are continuously imaged, the first image is captured (Nth image (where 0 <N <L)). The captured image data is subjected to signal processing using the imaging parameters and composition of the image data that was captured later (Mth image (where N <M ≦ L)). ), It is possible to obtain an image with high image quality and proper composition.

  In the above-described embodiment, the image data captured first (Nth image (where 0 <N <L)) is changed to the image data captured later (Mth image (where N <M ≦ L)). Although the signal processing is performed using the imaging parameter and the composition, it is not always necessary to perform the signal processing using both the imaging parameter and the composition, and the signal processing may be performed using at least one of them.

  In the above embodiment, the AWB adjustment parameter and the AE adjustment parameter have been described as shooting parameters. However, the present invention is not limited to this, and other shooting parameters of image data shot later are used. You may decide to signal-process the image data image | photographed previously. Other imaging parameters are, for example, AF adjustment parameters.

  In the above embodiment, the electronic viewfinder is used. However, an optical viewfinder may be used.

  In the above embodiment, the buffer memory 31 for storing the first RAW data is provided. However, when the buffer memory 31 is not provided, the first image is captured and digital signal processing is performed. The JPEG data, the tenth AWB adjustment parameter, and the AE adjustment parameter are stored in the storage unit 12, and after the JPEG data is expanded, the digital signal processing is performed using the tenth AWB adjustment parameter and the AE adjustment parameter. It may be.

(Modification)
In the above embodiment, when the user presses the shutter button 8C in the state where the continuous shooting mode is selected, the subject is continuously shot, and the image data shot on the first shot is shot on the tenth shot. Signal processing is performed using image capturing parameters and composition. The present invention is not limited to this. When the camera application program 12A (camera device 6) is activated in a state where the continuous shooting mode is selected, continuous shooting is started, and image data shot on the first image is taken. May be signal-processed using the shooting parameters and composition of the image data shot when the user presses the shutter button 8C. As a result, the user can acquire image data whose shooting parameters and composition seem to be appropriate, and change the shooting parameters and composition of the first image data using the acquired shooting parameters and composition of the image data. Therefore, it is possible to obtain shooting parameters and a composition more reflecting the user's will.

  FIG. 9 is an explanatory diagram for describing a modification of the continuous shooting process. In FIG. 9, the description of the same parts as those in FIG. 6 is omitted, and only different points will be described. When the camera device 6 is activated in the state where the continuous shooting mode is set, first, the first image is taken, and the ISP 26 stores the first RAW data in the buffer memory 31 (see FIG. 9). Digital signal processing is performed (see T11). The first image may be picked up by panchromatic focus (focusing from a short distance to a long distance) while the camera device 6 is stationary.

  Subsequently, the next shooting is sequentially performed. When the user views the subject image displayed on the touch display unit 3 and determines that the brightness and white balance are appropriate and the subject composition is appropriate, the shutter button 8C is pressed. Push. In this case, the user may manually focus.

  For example, when the image data captured when the shutter button 8C is pressed is the ninth image data, the AWB adjustment unit 33 performs the ninth AWB adjustment for the ninth image. The used AWB adjustment parameters are stored in the buffer memory 31 (see T12 in FIG. 9), and the AE adjustment unit 34 stores the AE adjustment parameters used in the ninth AE adjustment in the buffer memory 31 (T13 in FIG. 9). reference). Further, the JPEG processing unit 37 generates JPEG (compressed) data based on the color difference signal (Cb, Cr) and the luminance signal (Y), and stores it as the ninth JPEG data via the control unit 10. 12 (T14 in FIG. 9).

  Then, the ISP 26 uses the ninth AWB adjustment parameter and the AE adjustment parameter stored in the buffer memory 31 for the first RWA data stored in the buffer memory 31 according to the instruction of the control unit 10. After digital signal processing such as AWB adjustment and AE adjustment (T15 in FIG. 9), the first JPEG data is stored in the storage unit 12 (T16 in FIG. 9).

  The control unit 10 reads the first and ninth pieces of JPEG data from the storage unit 12, decompresses them by the JPEG processing unit 37, and then composes the composition of the first piece of image data in the ninth piece of image data. A composition optimization process for changing the composition is executed (T17 in FIG. 9). The control unit 10 causes the JPEG processing unit 37 to convert the first image data subjected to the composition optimization process into JPEG data, and stores the JPEG data in the storage unit 12. Further, the first image data with the optimized composition is converted into a video signal by the video processing unit 36 and displayed on the touch display unit 3.

FIG. 10 is a flowchart for explaining another example of the composition optimization process. In FIG. 10, the control unit 10 reads the first and ninth JPEG data from the storage unit 12, decompresses them by the JPEG processing unit 37, and then the first and ninth image data. In step S11, it is determined whether or not there is a face of the same person. If there is no face of the same person in the first and ninth sheets (“No” in step S11), the process proceeds to step S15.

  When there is a face of the same person in the first image and the ninth image (“Yes” in step S11), the control unit 10 specifies a person as a target (step S12), and the number of persons is nine. It is determined whether or not the eye image data is centered or larger than the first image data (step S13). The person does not optimize the composition of the first image when the tenth image data is not centered or larger than the first image data (“No” in step S13). (Step S17).

  In the case where the same person has the ninth image data in the center or larger than the first image data ("Yes" in step S13), the control unit 10 Based on the data composition, the composition of the first image data (person) is optimized using three divisions, two divisions, horizontal / vertical division, or the like (step S14).

  In step S15, the control unit 10 determines whether there is an object (moving object) that exists in the first image data and does not exist in the ninth image data. When there is an object that exists in the first image data and does not exist in the ninth image data (“Yes” in step S15), the control unit 10 determines that the object is a target object. (Step S16) The composition of the first image is not optimized (Step S17). In this case, since the subject to be photographed with the first image is not photographed with the ninth image, the composition of the first image data is used as it is.

  On the other hand, if there is no object that exists in the first image and does not exist in the ninth image (“Yes” in step S15), the first image data is changed to the ninth image data. The same composition is set (step S18). That is, in this case, since the target photographing target cannot be photographed by the first photographing, the composition of the ninth image data is used.

  In the above modification, the image data captured on the first image is subjected to signal processing using the shooting parameters and composition of the (ninth) image data captured when the shutter button is pressed. The image data captured first is not limited to the first image, and the image data captured when the shutter button is pressed is not limited to the ninth image data. When L (however, L ≧ 2) images of the subject are continuously captured, the image data captured first (Nth image (where 0 <N <L)) is captured when the shutter button is pressed ( Signal processing may be performed using the shooting parameters and composition of the image data of the Mth image (where N <M ≦ L).

  In the above embodiment, a mobile phone terminal equipped with a digital camera has been described. However, the present invention can also be applied to a single digital camera device. Devices equipped with digital cameras are not limited to mobile phone terminals, but can also be installed in other information processing devices such as tablet PCs, notebook PCs, PDAs (Personal Digital Assistants), portable navigation devices, and game consoles. is there.

  As described above, the imaging method of the digital camera according to the present invention can be widely applied to the case where the subject is continuously photographed.

DESCRIPTION OF SYMBOLS 1 Cellular phone terminal 2 Housing | casing 3 Touch display part 3A Touch panel 3B Display part 4 Operation part 5 Microphone 6 Camera device 6A Camera part 7 Speaker 10 Control part 11 Memory 12 Storage part 13 Communication part 14 Power supply part 21 Lens 22 Mechanical mechanism 23 Image Sensor 24 Analog signal processing circuit 25 A / D conversion circuit 26 ISP (Image signal Processor)
27 Interface 31 Buffer memory 32 Pixel interpolation unit 33 AWB adjustment unit 34 AE adjustment unit 35 Luminance color difference separation unit 36 Video signal processing unit 37 JPEG processing unit

Claims (10)

An imaging method of a digital camera that continuously captures L (note that L ≧ 2) subjects.
Storing image data obtained by imaging an Nth (where 0 <N <L) subject;
Signal processing the stored image data of the Nth subject using the composition of the image data of the M (where N <M ≦ L) subject;
An imaging method for a digital camera including:   In the storing step, RAW data of the subject imaged in the Nth image is stored, and in the signal processing step, the Mth subject is compared with the stored RAW data of the Nth subject. 2. The digital camera imaging method according to claim 1, wherein signal processing is performed using imaging parameters of the captured image data.   3. The imaging method of the digital camera according to claim 1, wherein when the shutter button is pressed, L (where L ≧ 2) images of the subject are continuously captured. When the digital camera is activated, L (where L ≧ 2) images of the subject are continuously captured,
3. The imaging method of a digital camera according to claim 1, wherein the Mth subject is image data captured when the shutter button is pressed. In the process of the signal processing, according to claim 1, characterized in that the composition of the image data of the captured N-th of a subject said storage, to change based on composition of the image data obtained by imaging the M-th object The imaging method of the digital camera as described in any one of -4 . In the signal processing step,
It is determined whether there is the same object in the M-th image data and the N-th image data,
When there is the same object and the M object image data is present in the center or larger than the N image data, the same object has the N object image data. Change the composition using the composition of the Mth image data,
When there is no same object, or when there is the same object, the same object does not exist in the center or larger than the N-th image data in the M-th image data. 6. The imaging method of a digital camera according to claim 5 , wherein the composition of the Nth image data is not changed by using the composition of the Mth image data. The imaging method of the digital camera according to claim 6 , wherein the object is a person. In the signal processing step, the stored image data obtained by imaging the Nth subject is further used using imaging parameters of image data obtained by imaging the Mth subject (where N <M ≦ L). Perform signal processing,
The shooting parameter is a parameter for white balance adjustment,
In the signal processing step, white balance adjustment is performed on the stored image data obtained by imaging the Nth subject using white balance adjustment parameters of image data obtained by imaging the Mth subject. An imaging method for a digital camera according to any one of claims 1 to 7 . In the signal processing step, the stored image data obtained by imaging the Nth subject is further used using imaging parameters of image data obtained by imaging the Mth subject (where N <M ≦ L). Perform signal processing,
The shooting parameter is an exposure adjustment parameter,
In the process of the signal processing, billing, characterized in that the image data of the captured N-th of a subject said storage and exposure adjustment using an exposure adjustment parameter of the image data of the captured subject M th Item 8. The digital camera imaging method according to any one of Items 1 to 7 . A program mounted on a digital camera that continuously captures L (note that L ≧ 2) subjects.
Storing image data obtained by imaging an Nth (where 0 <N <L) subject;
Signal processing the stored image data of the Nth subject using the composition of image data of the M (where N <M ≦ L) subject;
A computer-executable program for causing a computer to execute.

Images