TWI465107B - Image capturing apparatus capable of displaying live preview image - Google Patents

Description

Camera capable of displaying a live preview image

The present invention relates to an image pickup apparatus including a subject that displays an electronic viewfinder, a display control program of the image pickup apparatus, and a display control method.

The following configurations of conventional imaging devices are well known.

The image of the square is taken, converted into digital image data, and the vertical or horizontal portion of the image data of the cut square is recorded in the image memory in response to the state of the vertical/horizontal switching means. An example of this configuration is disclosed in Patent No. 2882391.

Specify the first point and the second point on the subject image, specify the trimming position, and set the trimming range based on the size and aspect ratio of the vertical or horizontal of the first point and the second point. An example of such a configuration is disclosed in Patent No. 3372989.

However, in the technique described in Japanese Patent No. 2882391, since the vertical or horizontal partial area of the image data of the square has been recorded in the image memory, it is not possible to confirm in advance whether or not the cut portion is included. The part of the image that you want. Therefore, it occurs that the cut portion does not contain the desired image portion, and the image containing the image portion desired by the user cannot be memorized.

On the other hand, the technique described in Japanese Patent No. 3372989 can include a portion of the image desired by the user or an image range in which the shape desired by the user is recorded. However, it is cumbersome to specify the first point and the second point on the subject image at the time of photographing, and to specify the trimming position, and it is not possible to easily specify the image range including the image portion desired by the user.

According to an aspect of the present invention, an image pickup apparatus includes: an image pickup unit that captures an image of a subject; a memory unit; a display unit; and a processor that is photographed by the image pickup unit The image is subjected to image processing to generate a first image having a first image size and a second image having a second image size, and the memory unit is controlled, and the memory unit records the first image For example, while controlling the display unit, the display unit displays the second image as a live preview image of the image captured by the imaging unit.

According to another aspect of the present invention, a method of controlling an image pickup apparatus includes: an image pickup unit that captures an image of a subject; a memory unit; and a display unit; and the method includes the following steps: Performing image processing on the image captured by the image capturing unit to generate a first image having a first image size and a second image having a second image size; and controlling the memory unit, The memory unit controls the display unit while recording the first image, and the display unit displays the second image as a live preview image of the image captured by the imaging unit.

According to another aspect of the present invention, there is provided a computer readable medium comprising a series of command groups required for a program executable by a computer system loaded by a camera device, the camera device comprising the following components: a camera unit, photographing An image of the subject; a memory unit; and a display unit; the program comprising the steps of: generating a first image having a first image size by performing image processing on the image captured by the image capturing unit And the second image having the second image size; and controlling the memory unit, wherein the memory unit records the first image while controlling the display unit, the display unit displays the second image to It serves as a live preview image of the image taken by the camera unit.

Embodiments in accordance with the present invention are described in detail with reference to the drawings. The scope of the claimed invention is not limited to the illustrated examples and the examples described below.

Fig. 1(a) is a plan view of a digital camera 100 according to an embodiment of the present invention, and Fig. 1(b) is a rear view. In the body 101 of the digital camera 100, the imaging lens 102 is placed in front of it. Further, a power switch 103, a shutter button (release button) 104, a zoom lever 105, a photographing mode dial 106, and a general dial 107 are disposed on the upper surface. The optical viewfinder 108, the OK key 109, the cursor key 110, the display key 111, the operation table key 112, and the display unit 79 are provided on the back side. Further, by operating the mode dial 106, various modes shown in a flowchart to be described later are set. The selection branch in the mode can be selected by operating the cursor key 110 and the OK key 109 in a state in which various modes are set. Further, the display unit 79 is constituted by an LCD panel, and also has a function of playing back a monitor that displays a recorded still image and a moving image.

2 is a block diagram showing the circuit configuration of the digital camera 100. The digital camera 100 is provided with a high-speed continuous shooting function, and has a control circuit 2 as shown in the drawing. In the control circuit 2, the CPU 3 and the interface 5, the sound input/output circuit 6, the input circuit 7, the memory card interface 8, the USB controller 9, the input/output interface 10, and the input/output port respectively connected to the CPU 3 via the data bus 4 and the CPU 3 are provided. 12, 13 and HDD interface 14. The sound input/output circuit 6 is connected to the microphone 16 via the amplifier 17 and the A/D converter 18, and the speaker 19 is connected via the amplifier 20 and the D/A converter 21. The operation input unit 22 provided with various operation keys, switches, and the like is connected to the input circuit 7, and the image memory medium 25 provided to be detachably attached is connected to the memory card interface 8. The USB controller 9 is connected to the USB terminal 26, and the input/output interface 10 is connected to the wireless LAN transceiver unit 28 having the antenna 27 via the communication controller 29.

In the output port 12, the focus lens driving unit 32, the zoom lens driving unit 33, the diaphragm driving unit 34, and the shutter driving unit 35 are connected, and the flash unit 36 is connected via the flash driving unit 37, and the photometry/ranging is connected via the detecting circuit 39. Sensor 38. In the input/output port 13, an angular velocity sensor (Y/Pitch) 40 for detecting jitter (pitch) in the up and down direction of the digital camera 100 and a jitter in the left and right direction are detected via detection circuits 41 and 43, respectively. Shake) angular velocity sensor (X/Yaw) 42. The HDD memory device 46 is connected to the HDD interface 14. The HDD memory device 46 has a disk medium 47, and has a motor 48, a motor driver 49, a microcomputer unit 50, a VC motor 51, a head amplifier 52, a read/write channel + CODEC 53, an HDD control unit 54, and the like.

Further, in the control circuit 2, the battery 44 is connected via the power supply control unit 45, and the power supply control unit 45 is controlled by the control circuit 2 to supply electric power from the battery 44 to each unit. Further, a sound CODEC (encoder/decoder) 15, a program memory 23, and a data memory 24 are connected to the data bus. The audio CODEC 15 stores a program necessary for the operation of the control circuit 2 shown in the flowchart described later, and the data memory 24 stores various materials in advance and stores other materials than the image data.

On the other hand, the imaging element 56 is disposed on the rear optical axis of the imaging optical system 55 including the zoom lens and the wide-angle lens, and the aperture 57 driven by the aperture driving unit 34 is driven by the shutter driving unit 35. The shutter 58 is inserted into the imaging optical system 55. Further, the focus lens driving unit 32 drives the focus lens in the imaging optical system 55, and the zoom lens driving unit 33 is configured to drive the zoom lens.

The image pickup device 56 is capable of high-speed reading such as parallel reading, and includes an image sensor unit 59, a horizontal scanning unit 60, a vertical scanning unit 61, and a P/S conversion unit 62. The DSP unit 63 is connected to this imaging element 56. The DSP unit 63 includes an S/P conversion unit 64 for processing an image signal taken in from the P/S conversion unit 62 of the image sensor 56, a buffer memory 65, a WB correction unit 66, and a resizing/pixel. The insertion unit 67, the color interpolation unit 68, the contour correction unit 69, the γ correction unit 70, and the matrix circuit unit 71 also include a controller 73 for controlling the period of the vertical scanning unit 61, the buffer memory 65, and an image. The digital signal processing unit 72 such as the processing is identified.

The matrix circuit unit 71 and the digital signal processing unit 72 such as image recognition processing pass through the image data bus 74 and the buffer memory 75, the still image CODEC (encoder/decoder) 76, and the moving image CODEC (encoder). The /decoder 77 and the display drive circuit 78 are connected. The image data bus 74 is connected to the interface 5 of the aforementioned control circuit 2. The digital signal processing unit 72, such as the image recognition processing, performs digital processing on the captured plurality of images and combines them, and the buffer memory 75 temporarily stores the still image CODEC 76 and the moving image CODEC 77 for encoding and image processing. The display drive circuit 78 drives the (viewfinder) display unit 79.

Fig. 3 and Fig. 4 are flowcharts showing a series of processing steps in the present embodiment. The control circuit 2 executes the processing shown in this flowchart based on the program stored in the program memory 23. First, it is determined whether or not the still image shooting mode has been set (step S101), and if it is not set, the process proceeds to step S119 of Fig. 4 which will be described later.

When the still image shooting mode has been set, the recorded image size of the image size recorded by the image storage medium 25 is set by the operation of the user in the operation input unit 22 (horizontal: X _R , vertical) :Y _R ), aspect ratio, and the like (step S102). Next, after setting the shooting mode, shooting conditions, and the like (step S103), the selection of the wide-angle viewfinder or the finder field-of-view magnification WR (%) is set (step S104).

Fig. 5 is an explanatory view showing the setting operation in this step S104. As shown in the fifth figure (a), the range of the normal live preview image (ie, the live preview image, the lens transmission image, the through image, etc.) is set to the field of view magnification of 100%, and the cursor key is responded to. The operation of 110 allows the field of view magnification of the fifth (d) to be freely changed by 200% in the horizontal direction and 200% in the vertical direction. Further, by operating the cursor key 110, 100% to 200% × 200% is selected, and by operating the OK key 109, the field of view magnification WR (%) of the viewfinder is set.

Further, the image in the fifth (d) image is an image in which the digital zoom processing has not been performed, that is, an image having a zoom magnification of "1", and is in accordance with the fifth (d), fifth (c), and fifth images. (b) An image in which the digital zoom magnification is increased in the order of the figure and the fifth drawing (a). Of course, the image having the largest field of view magnification of 200% × 200% in the fifth (d) chart is a range that can be captured within the imaging range of the imaging element 56.

In this way, if the viewfinder magnification WR (%) has been set, that is, the written image size (X _d , Y _d ) and the set field magnification WR (%) are displayed, and the setting is according to the following formula. The output image size (X _out , Y _out ) of the image size output to the display unit 79 (step S105).

X _out = (WR/100) ^‧ X _d

Y _out =(WR/100) ^‧ Y _d

Here, the display write image size (X _d , Y _d ) is written to the buffer memory 75 at the time of normal photography in which the wide-angle viewfinder is not selected, and is transmitted to the display unit 79 via the display drive circuit 78. The aspect ratio (the number of pixels) of the image, and the output image size (X _out , Y _out ) is written into the buffer memory 75 after being processed in this step S105, and then transmitted to the buffer circuit 75 via the display drive circuit 78. The aspect ratio of the image of the display unit 79.

Therefore, using the field of view magnification WR (%) set by the user, the display write image size (X _d , Y _d ) becomes (WR/100) times, which is then used as the output image size (X _out). , Y _out ), whereby the output image size (X _out , Y _out ) becomes (WR/100) times the write operation. At this time, since it is WR ≧ 100, the output image size (X _out , Y _out ) becomes a value above the display image size (X _d , Y _d ). That is, when WR=200%, the following formula is obtained.

X _out = (200/100) ^‧ X _d = 2X _d

Y _out = (200/100) ^‧ Y _d = 2Y _d

Next, in accordance with the image full image size (X _F , Y _F ) and the output image size (X _out , Y _out ), the limit of the digital zoom magnification (DZ) is set according to the following example (DZ _MAX ). (Step S106).

(E.g)

DZ _MAX =X _F /X _out

Or DZ _MAX =Y _F /Y _out

Here, the captured full image size (X _F , Y _F ) is the largest image size that can be captured by the imaging element 56. Therefore, the larger the output image size (X _out , Y _out ), the smaller the limit of the digital zoom magnification (DZ) (DZ _MAX ) becomes.

Next, the control circuit 2 determines whether or not there is a zoom operation (step S107), and in some cases, performs zoom processing (or further, digital zoom processing with less deterioration in image quality) (step S108). Further, details of the digital zoom processing in which the image quality deterioration at this step S108 is small will be described in a flowchart to be described later.

Then, according to the live preview image size (X', Y'), the resizing rate (IP _x = X _d /X', IP _y = Y _d / Y') is set, and the resizing/interpolation process is performed. It is converted into display write data composed of the display write image size (X _d , Y _d ) (step S109).

Here, the live preview image size (X', Y') is the aspect ratio of the live preview image displayed on the display unit 79. Therefore, the display write image size (X _d , Y _d ) becomes a size at which the full screen can be displayed on the display unit 79.

Further, the live preview image display processing (write display RAM) is executed in accordance with the display write image size (X _d , Y _d ), the finder view magnification WR (%), and the digital zoom magnification (DZ). At this time, the frame is displayed on the display area corresponding to the recorded image size (X _R , Y _R ) set in the step S102, and the field of view magnification is displayed, and the photographing area is displayed in color, and the photograph is displayed. The outside of the area is displayed after being converted into black and white (step S110).

Therefore, by the processing of this step S110, as shown in the fifth (a) to (d), the field of view magnification 791 such as "100%", "125% × 125%" is displayed on the display unit 79. Block 792 is displayed in a display area corresponding to the recorded image size (x _R , Y _R ), and in the photographing area 793 is displayed in color, and outside the photographing area 794 is displayed in black and white.

Therefore, the user can determine whether the currently set field of view magnification is appropriate by visually recognizing the displayed field of view magnification 791 and the displayed image area 793 and the outside of the shooting area 794, that is, setting a larger field of view magnification. Rate, or should set a smaller field of view magnification.

Further, the user can perform still image shooting while viewing the image portion 793 or the live preview image portion of the image display area 793 in the color display, while viewing whether or not the desired image portion is included in the image capturing area 793.

Further, as shown in the fifth (b) to (d), when the live preview image portion of the outside of the shooting area 794 is displayed, the character string of "※ is recorded in the frame at the time of shooting" is displayed on the character string. Outside the photographic area 794 is preferred. Therefore, even if the user is a beginner, it is possible to recognize that the live preview image portion of the photographing area 793 is the recorded image portion, and to confirm whether or not the desired image portion is included in the photographing region 793 while photographing.

Next, the control circuit 2 determines whether or not the half-press operation (or AF/AE lock operation) of the shutter button 104 has been performed (step S111), and if it is not, returns to step S107. On the other hand, when the half-press operation of the shutter button 104 has been performed, the photometry processing, the AF/AE lock processing (step S112) is performed, and the full press of the shutter button 104 is waited for (step S113).

When the full-press operation of the shutter button 104 has been performed, the control circuit 2 performs exposure and photographing processing, and reads the images of the selected area without adding them in accordance with the digital zoom magnification (DZ) (step S114). In other words, the image (the image of the selected region) corresponding to the image including the image 793 in the image capturing region 793 and the image capturing region 794 shown in Fig. 5 is not added and read out from the pixel. Therefore, the image read at this step S114 includes an image portion corresponding to 793 in the photographing area and an image portion corresponding to the outer portion 794 of the photographing area.

Next, the image read at this step S114 is taken as the photographic image (X", Y"), and then from the center of the photographic image (X", Y"), in response to the viewfinder magnification WR (%) Then, the captured image data in the photographing area of the image size (X2, Y2) is extracted according to the following formula (step S115).

X2=X”÷(WR/100)

Y2=Y”÷(WR/100)

Further, with respect to the extracted image of the image size (X2, Y2), the following resizing ratio (IP _x , IP _y ) is set in accordance with the recorded image size (X _R , Y _R ) set in the step S102. And re-sizing for recording, and performing interpolation processing as needed (step S116).

IP _x =X _R /X2

IP _y = Y _R /Y2

Then, the rescaled photographic image preview is displayed on the display unit 79, or after preview display before recording (step S117), encoding or compression encoding is performed, and then recorded on the memory medium (image memory medium 25 or The disc medium 47) (step S118). In other words, the imaging element 56 and the DSP unit 63 are controlled based on the imaging conditions set in the step S103, and the exposure and imaging operations are performed to obtain a high-resolution subject imaging signal for still image recording. Then, the image CODEC (Encoder/Decoder) 76 is encoded into uncompressed coded data such as compression-coded data or RAW data in accordance with the JPEG standard, and the like, and then recorded on the image memory medium 25 or the disk medium 47.

At this time, since the image recorded on the memory medium is as described above, the user operates the shutter button 104 while viewing the frame 792 or the live preview image portion in the image display area 793 displayed in the color. The ground contains a desired portion of the image, and thus, it is easy to photograph and record the image range including the desired image portion.

On the other hand, if the result of the determination in step S101 is that the still image shooting mode is not set, the process proceeds from step S101 to step S119 of Fig. 4 . The control circuit 2 determines whether or not the moving image shooting mode has been set, and if it is not set, moves to another mode processing (step S120).

When the moving image shooting mode has been set, the recording image of the size of one frame of the moving image recorded by the image storage medium 25 is set in response to the operation of the user operating the input unit 22. Dimensions (horizontal: X _R , vertical: Y _R ), aspect ratio, and the like (step S121). Next, after setting the shooting conditions of the moving image shooting or the like (step S122), the selection of the wide-angle finder and the finder field magnification WR (%) are set (step S123). The setting operation at this step S123 is the same as the operation of the step S104 explained in the fifth drawing.

If the finder field magnification WR (%) has been set, that is, the recorded image size (X _R , Y _R ) set in the step S121 and the field magnification WR (%) set in the step S123, The output image size (X _out , Y _out ) of the image size output to the display unit 79 is set according to the following formula (step S124).

X _out = (WR/100) ^‧ X _R

Y _out = (WR/100) ^‧ Y _R

Therefore, the output image size (X _out , Y _out ) becomes (WR/100) times the recorded image size (X _R , Y _R ), since WR>100 at this time, the output image size (X _out , Y _out ) is a value equal to or larger than the recorded image size (X _R , Y _R ). That is, when WR = 200%, the output image size (X _out , Y _out ) becomes the following expression.

X _out = (200/100) ^‧ X _R = 2X _R

Y _out = (200/100) ^‧ Y _R = 2Y _R

Next, as in the above-described processing of step S106, in response to the image capturing full image size (X _F , Y _F ) and the output image size (X _out , Y _out ), the digital zoom magnification is set according to the following example. The boundary of (DZ) (DZ _MAX ) (step S125).

(E.g)

DZ _MAX =X _F /X _out

Or DZ _MAX =Y _F /Y _out

Moreover, the control circuit 2 determines whether or not there is a zoom operation (step S126), and in some cases, performs zoom processing (or further, digital zoom processing with less deterioration in image quality) (step S127). In addition, details of the digital zoom processing in which the image quality deterioration at this step S127 is small will be described in a flowchart to be described later.

Next, the photographing processing of the live preview image/moving image is performed, and the image of the selected area is read in the selected addition mode in response to the digital zoom magnification (DZ) (step S128). In other words, an image corresponding to an image including the image 793 in the imaging region 793 and the photographic region 794 shown in FIG. 5 (an image of the selected region) is selected from the image pickup device 56 in a previously selected addition mode. The pixels are added and read out.

Next, the control circuit 2 determines whether or not the shooting start button (shutter button 104) has been pressed or is it in the moving image shooting (step S129), and if it is determined to be NO, the process proceeds to step S132. Further, when the shooting start button or the moving image shooting has been pressed, the image read in the step S128 is taken as the photographic image of the size (X', Y'), and from this size (X). In the photographic image of ', Y'), the captured image data of the imaging area of the size (X2, Y2) is extracted according to the following equation in response to the finder field magnification WR (%) (step S130).

X2=X’÷(WR/100)

Y2=Y’÷(WR/100)

Further, the extracted image of the image size (X2, Y2) is sequentially output to the moving image CODEC (encoder/decoder) 77, and the encoding/compression encoding processing of the moving image and the memory medium are performed. Recording processing (step S131). In other words, the imaging element 56 and the DSP unit 63 are controlled based on the imaging conditions of the moving image shooting set in the step S122, and exposure and imaging operations are performed to obtain a subject imaging signal for moving image recording. Then, by the moving image CODEC (Encoder/Decoder) 77, compression encoding corresponding to the compression method of MPEG4 or H.264/AVC or the like is performed, and the image memory medium 25 is recorded in the file format such as AVI or MP4. Or disc media 47.

Further, in the image frame image of the image size (X', Y'), the following resizing ratio is set in accordance with the display image size (X _d , Y _d ) described in the step S105. (IP _x , IP _y ), and re-sizing for recording, and performing re-sizing/interpolation processing for display (step S132).

IP _x =X _d /X'

IP _y = Y _d /Y'

Then, the live preview image display processing (writing display RAM) for the moving image is executed, and at this time, the frame is displayed on the photograph corresponding to the recorded image size (X _R , Y _R ) set in the step S121. In the area, the field of view magnification is displayed, and the image area is displayed in color, and the outside of the image area is displayed in black and white (step S133).

Therefore, as shown in the fifth (a) to (d), the field of view magnification 791 such as "100%", "125% × 125%" is displayed on the display unit 79 as shown in the processing of S133. Block 792 is displayed in a display area corresponding to the recorded image size (X _R , Y _R ), and in the photographing area 793 is displayed in color, and outside the photographing area 794 is displayed in black and white.

Therefore, the user can perform moving image shooting while viewing whether or not the desired image portion is included by the visual frame 792 or the live preview image portion in the image display area 793 displayed in color.

(zoom processing 1)

Fig. 6(a) is a flowchart showing the zooming process (1) of the optical & digital moving in the first processing example of the zoom processing executed in steps S108 and S128. At the start of the process according to this flowchart, for the still image, the process of step S105 of the main routine shown in FIGS. 3 and 4 is set as shown in FIG. 6(b).

X _out = (WR/100) ^‧ x _d

Y _out =(WR/100) ^‧ Y _d

For the moving image, in the processing of step S124, the following formula is set.

X _out = (WR/100) ^‧ X _R

Y _out = (WR/100) ^‧ Y _R

Further, the limit process of step S125 or step S106, is set as digital zoom magnification (the DZ) of DZ _MAX.

DZ _MAX =X _F /X _out

Or DZ _MAX =Y _F /Y _out

In this state, it is determined whether or not there is a zoom operation (step S201), and if there is a zoom operation, the conversion of the total zoom magnification Z is performed in accordance with the setting of the visual field magnification WR (%) (step S202). Z = OpZ × DZ ÷ (WR / 100) (where OpZ: optical zoom magnification of the imaging optical system 55). Therefore, when WR = 100%, Z = OpZ × DZ.

Then, in response to the zoom operation (zoom operation amount) ΔZ of the zoom lever 105, the total zoom magnification (Z) is increased or decreased according to the following equation (step S203). Z=Z±△Z

Then, it is determined whether or not Z <OpZ _min (OpZ _min: minimum value of the optical zoom magnification) whether or Z <1 (step S204). In this step, determination S204 is YES, a total zoom magnification Z is less than OpZ _min or smaller than 1, the set to the digital zoom magnification DZ = 1 and the optical zoom magnification _{OpZ = OpZ min × (WR /} 100) ( step S205) .

Then, the optical zoom processing is executed in accordance with the optical zoom magnification OpZ of this setting, and the zoom lens driving unit 33 is controlled to drive the zoom lens (step S206). In addition, when the AF frame (the AF frame selected in advance in the case where there are a plurality of AF frames) or the center of the field of view is selected, the AF process is executed, and the focus lens drive unit 32 is controlled to drive the focus lens (step S207). Then, based on the set DZ, the digital zoom processing sub-routine (which is described later) (the image quality deterioration is small) is moved (step S208).

On the other hand, it is determined in step S204 is NO, that is greater than a total zoom magnification Z OpZ _min or greater than 1, determines whether _{"Z> {OpZ max ÷ (WR} / 100)} " (OpZ _max: Optical Zoom The magnification maximum value) (step S209). Here, it is judged to be NO, and the total zoom magnification Z is smaller than the value of the optical zoom magnification maximum OpZ _max divided by (WR/100), and the setting is preferentially increased in response to the increase or decrease of the total zoom magnification Z. The optical zoom magnification (OpZ) is DZ=1 and OpZ=Z×(WR/100) (step S210), and the process proceeds to step S206.

Moreover, when the determination of step S209 is YES, OpZ=OpZ _{max is set} (step S211). Next, it is judged whether or not the digital zoom function is set to ON (step S212), and when it is not set to ON, DZ=1 is set (step S213), and the process proceeds to step S206. When the digital zoom function is set to ON, DZ=(WR/100)×Z/OpZ _max of the digital zoom magnification (DZ) is increased or decreased in response to the increase or decrease of the total zoom magnification Z (step S214).

Then, it is judged whether or not the DZ set in this step S214 exceeds the optical zoom magnification maximum value OpZ _max (step S215), and if it is not exceeded, the process proceeds to step S206. However, in the case of exceeding, the set digital zoom magnification DZ is limited to the digital zoom magnification maximum value DZ _max (step S216), and the process proceeds to step S206.

Therefore, according to the above optical & digital linked zoom processing (1), when the total zoom magnification (Z) is within the range of the optical zoom magnification (OpZ) (Op Z _min ≦Z≦{OpZ _max ÷( WR/100)}), which is controlled by preferentially increasing or decreasing the optical zoom magnification (OpZ) (DZ=1 and OpZ=Z×(WR/100), and can increase or decrease OpZ within the range of OpZ _min ~OpZ _max .

Further, in the case where the total zoom magnification (Z) exceeds the maximum value of the optical zoom magnification (OpZ) in consideration of the field of view magnification (WR) (Z>{OpZ _max ÷(WR/100)}), the optical zoom can be performed. The magnification (OpZ) is still at the maximum value (OpZ>OpZ _max ), and when the digital zoom function is set to ON, the digital zoom magnification (DZ) is increased or decreased depending on the increase or decrease of the total zoom magnification (Z). control. However, DZ increases or decreases in the range of 1~OpZ _max .

Therefore, as shown in the example of Fig. 7, in the optical zoom (×1 to 5 times), the full image size (X _F = 2880, Y _F = 2160), and the display write image size (X _d = 640) , Y _d = 480), (in the case of a moving image, when the image size is recorded (X _R = 640, Y _R = 480)), the numerical value shown can be obtained.

Then, according to the optical zoom magnification (OpZ) set in this way, the zoom lens is driven and subjected to optical zoom processing, or according to the high frequency component or contrast detected from the image pickup signal of the area in the center of the AF frame or the field of view. The focus detection information of the value, etc., drives the focus lens and performs AF. In addition, according to the set digital zoom magnification (DZ), the display processing of the live preview image is performed based on the captured image data read by the "digital zoom processing sub-routine with less deterioration in image quality" described later.

(zoom processing 2)

Fig. 8(a) is a flowchart showing the optical & digital interlocking zoom processing (2) of the second processing example of the zoom processing executed in steps S108 and S128. When the processing according to the flowchart is started, the processing of step S105 of the main routine shown in FIGS. 3 and 4 is also set for the still image, as shown in FIG. 8(b).

X _out = (WR/100) ^‧ x _d

Y _out =(WR/100) ^‧ Y _d

For the moving image, in the processing of step S124, the following formula is set.

X _out = (WR/100) ^‧ X _R

Y _out = (WR/100) ^‧ Y _R

Further, in the processing of this step S106 or step S125, the following digital zoom limit DZ _{MAX is set} .

DZ _MAX =X _F /X _out

Or DZ _MAX =Y _F /Y _out

In this state, it is determined whether or not there is a zoom operation (step S301), and if there is a zoom operation, the conversion of the total zoom magnification Z is performed in accordance with the setting of the visual field magnification WR (%) (step S302).

Z=OpZ×DZ÷(WR/100)

(Where, OpZ: optical zoom magnification of the imaging optical system 55). Therefore, when WR = 100%, Z = OpZ × DZ.

Then, in response to the zoom operation (zoom operation amount) ΔZ of the zoom lever 105, the total zoom magnification (Z) is increased or decreased according to the following equation (step S303).

Z=Z±△Z

Then, it is judged whether or not Z < 1 (step S304). In step S304 this determination is YES, a total zoom magnification Z is smaller than 1, the optical zoom magnification is set to OpZ = OpZ _min and digital zoom magnification DZ = 1 × (WR / 100 ) ( step S305).

Then, the optical zoom processing is executed in accordance with the optical zoom magnification OpZ of this setting, and the zoom lens driving unit 33 is controlled to drive the zoom lens (step S306). In addition, when the AF frame (the AF frame selected in advance in the case where there are a plurality of AF frames) or the center of the field of view is selected, the AF process is executed, and the focus lens drive unit 32 is controlled to drive the focus lens (step S307). Then, according to the set DZ, the digital zoom processing sub-routine (which is described later) (the image quality deterioration is small) is moved (step S308).

On the other hand, if the determination in step S304 is NO and the total zoom magnification Z is greater than 1, it is determined whether or not Z>DZ _max (step S309). In the case where it is judged to be NO, and the total zoom magnification Z is a value equal to or less than the digital zoom magnification maximum value DZ _max , the OpZ of the digital zoom magnification (DZ) is preferentially increased or decreased in response to the increase or decrease of the total zoom magnification Z. OpZ _min and DZ=(WR/100)×Z/OpZ _min (step S310) and move to step S306.

Moreover, when the determination of step S309 is YES, DZ=DZ _max and OpZ=(WR/100)×Z/OpZ _{min of the} increase/decrease optical zoom magnification (OpZ) are set in accordance with the increase or decrease of Z (step S311). ). Then, it is judged whether or not OpZ set in step S311 satisfies the relationship of OpZ≧OpZ _max (step S312), and if it is not satisfied, that is, when the optical zoom magnification OpZ is smaller than the optical zoom magnification maximum value OpZ _max , the Step S306. However, when the optical zoom magnification OpZ is equal to or larger than the optical zoom magnification maximum value OpZ _max , the set optical zoom magnification OpZ is limited to the optical zoom magnification maximum value OpZ _max (step S313), and is shifted. Go to step S306.

Therefore, according to the above optical & digital linked zoom processing (2), the total zoom magnification (Z) (Z = ± ΔZ) is increased or decreased according to the zoom operation, and then the total zoom magnification (Z) is increased or decreased. In the case where the total zoom magnification (Z) is within the range of the digital zoom magnification (DZ) (1≦Z≦DZ _max ), the digital zoom magnification (DZ) can be preferentially increased or decreased (set to OpZ=OpZ _min , And DZ = (WR / 100) × Z / DZ _max ) control, and can increase or decrease OpZ within the range of OpZ _min ~ OpZ _max .

Therefore, as shown in the example of Fig. 9, the optical zoom (×1 to 5 times), the full image size (X _F = 2880, Y _F = 2160), and the display image size (X _d = 640) are displayed. , Y _d = 480), (in the case of a moving image, when the image size is recorded (X _R = 640, Y _R = 480)), the numerical value shown can be obtained.

((zoom processing with less deterioration in image quality))

Fig. 10(a) is a flowchart showing the sub-normal formula of the digital zoom processing (the image quality deterioration is small) executed in the steps S208 and S308. First, as shown in the following example, the number of switching steps (integer) I and the initial addition number (integer) m = m (i) and n = n (i) are set (step S401).

(for example) set to i=3, m(i)=m ₃ , n(i)=n ₃

Further, the digital zoom magnification (DZ) and the set center position (X _C , Y _C ) are read (step S402). Then, the total image size (X _F , Y _F ) and the output image size (X _out , Y _out ) of the self-imaging element are set as follows, and the addition number m(i) of the addition reading in each segment is set as follows. The limit (switching magnification) DZ _L(i) of the digital zoom magnification DZ of n(i) (less image quality deterioration ₎ (step S403).

DZ _L(i) = INT{X _F /m(i)}/X _out or DZ _L(i) = INT{Y _F /n(i)}/Y _out Therefore, as shown in Figure 10(b) For example, when X _F = 2880, Y _F = 2160, X _out = 640, Y _out = 480, if m ₁ = n ₁ =1, m ₂ = n ₂ = 2, m ₃ = n ₃ = 3, .. ., the limit magnification DZ _L1 = INT(2880/1) / 640 = 4.5 when the number m ₁ is added, and the limit magnification DZ _L2 = INT (2880/2) / 640 = 2.25, phase when the number m ₂ is added The limit magnification DZ _L3 = INT (2880/3) / 640 = 1.5 when the addend is m ₃ and the limit magnification DZ _L4 = INT (2880 / 4) / 640 = 1.125... when the addition number m ₄ .

Next, whether digital zoom magnification (DZ) satisfies "1 ≦ DZ ≦ DZ _MAX" relationship of (step S404). In the case where the determination in step S404 is YES, the addition number is set to m = m(i), n = n(i) (step S405). Therefore, as shown in the example of Fig. 10(c), when X _F = 2880, Y _F = 2160, X _out = 640, and Y _out = 480, the initial addition number is from i = 3, m = n = 3 At the beginning, set the number of additions as shown below.

When DZ=1~1.5 times, m=n=3 (additional reading of 3×3)

When DZ=1.5~2.25 times, m=n=2 (additional readout of 2×2)

When DZ=2.25~4.5 times, m=n=1 (1×1 no-addition readout)

Next, in response to the digital zoom magnification (DZ) and the center position (X _C , Y _C ), the image size (X, Y) and readout range (X ₁ to X ₂ , Y) of the selected read area are set as shown below. ₁ ~ Y ₂ ) (step S406).

X=INT(X _F /DZ), Y=INT(Y _F /DZ),

X ₁ =X _C -X/2,X ₂ =X _C +X/2

Y ₁ =Y _C -Y/2,Y ₂ =Y _C +Y/2

Where X ₁ <0, X ₁ =0, X ₂ =X,

When Y ₁ <0, Y ₁ =0, Y ₂ =Y,

When X ₂ >X _F , X ₁ =XF-X, X ₂ =X _F

When Y ₂ >Y _F , Y ₁ =Y _F -Y, Y ₂ =Y _F

Therefore, as shown in Fig. 10(d), for example, when X _F = 2880, Y _F = 2160, and DZ = 1.2 times, the following formula is obtained.

X=INT(X _F /DZ)=(2880/1.2)=2400

Y=INT(Y _F /DZ)=(2160/1.2)=1800

Next, the image signals of the readout range (X ₁ to X ₂ , Y ₁ to Y ₂ ) are added from the image pickup element according to the addition number (m, n) (or no addition) and read out, and then The image signal of the image size (X', Y') = (X/m, Y/n) is read into the DSP unit 63 (step S407). Then, the image data of the size (X', Y') is output (step S408).

Therefore, as shown in Fig. 10(e), for example, when DZ = 1.2 times, the number of additions m = 3, and n = 3, the following equation is obtained, and a (3 × 3) addition image of 800 × 600 pixels is obtained. .

X'=X/m=(2400/3)=800

Y’=Y/n=(1800/3)=600

On the other hand, if the determination in step S404 is NO, the value of "i" is decreased (step S409), and it is determined whether or not the value of "i" which has been reduced is "1" or more (step S410). In the case where i ≧ 1 and the reduced "i" is a positive value, the process returns from step S410 to step S403. Then, the value of the reduced "i" is substituted, and the processing of step S403 is performed. Therefore, when the determination of step S404 is YES, the processing of step S405 and subsequent steps described above is executed.

However, when the value of "i" is "0" by the decrease in step S409, the determination in step S410 becomes NO. In this case, the digital zoom is ended, or error processing is performed (step S411). Then, the minimum value "1" of the addition number is set to m and n, and the processing of step S406 and subsequent steps described above is executed.

(image sensor)

In the case where the image pickup element 56 is constituted by, for example, a CCD image sensor, the signal charge generated in the photodiode due to the incident light is not amplified, and is directly transmitted by the vertical and horizontal CCD transmission paths. The output circuit uses an FD (Floating Diffusion) amplifier to amplify the signal voltage and output it. The image signal output from the CCD is removed from the noise in the CDS circuit (correlated double sampling circuit), sampled and held, amplified by an AGC (Automatic Gain Control) amplifier, and converted into digital camera by an ADC (A/D converter). The signal is output to the DSP (signal processing circuit).

On the other hand, in the case where the imaging element 56 is configured by a CMOS (Complementary Metal-Oxide Film Semiconductor) image sensor, a general APS (Amplified Pixel Sensor) type as shown in FIG. 2 The CMOS sensor is provided with an amplifying component (amplifier) in each unit pixel circuit including the photodiode, and the signal charge photoelectrically converted by the photodiode is once amplified in the pixel circuit, and then amplified from the vertical The column address selection signal of the scanning circuit and the image signal of each pixel selected by the row address selection signal from the horizontal scanning circuit in the XY address mode can be sequentially taken out from the output by voltage or current. Even if it is not sequentially taken out like a CCD, in the CMOS sensor, since an image pickup signal of only an arbitrary pixel or region can be taken out in an arbitrary order, in the case where the digital zoom processing only cuts out a predetermined area and reads out, Read out at high speed.

Moreover, although the CCD is weak in stain or noise due to direct transmission of signal charges, the CMOS sensor can be read randomly for each pixel, which is strong in transmitting noise due to electrical separation of the pixel circuits. Further, similarly to the CMOS LSI or the like, the digital logic circuits such as various CMOS circuits or addition arithmetic circuits are densely distributed around the image sensor in the same process, and the advantages are relatively easy to manufacture together. Conversely, the CMOS sensor has the disadvantages of fixed type noise (FPN) or dark current, KTC noise, etc. caused by variations in the individual values of the amplifier of each pixel, but (like the CCD) The ground is made of a structure in which a photodiode and an FD amplifier are buried, and a dark current and a KTC noise can be reduced, and a line type CDS/ADC circuit provided by a row circuit in which each line of signal lines are arranged side by side is used. The signal before and after resetting the photodiode is subtracted, and the fixed type noise can be removed, and the A/D converter of the integral type, the cyclic type, the successive type, etc. is loaded in each column circuit, and it is also easy to The digital signal outputs an image pickup signal.

The image pickup device used in the digital camera 100 of the present embodiment preferably selects an image region of an arbitrary size and selects a readout mode of an image pickup signal of a pixel in the read region, and uses the image pickup device 200 shown in FIG. . In other words, the image pickup device 200 includes a vertical scanning circuit 202, a horizontal scanning circuit 203, and a row circuit portion 204 connected to the timing generating circuit 201, and has a parallel serial conversion unit 250. A plurality of circuits each having the CDS circuit 206, the A/D conversion circuit 207, and the pixel addition circuit 208 as a group are provided in the row circuit portion 204, and the row signal lines 209 are connected to each other. On the other hand, in the vertical scanning circuit 202, a column selection line (address line) 210, a transmission TC line (column readout line) 211, and a column reset line 212 are connected. Further, in the image sensor section 213, a plurality of unit pixel circuits 214 are provided, and each unit pixel circuit 214 is composed of the row signal line 209, the column selection line (address line) 210, and the transmission TC line (column readout line). The 211 and the photodiode 215 connected to the column reset line 212 are configured.

Therefore, in the image pickup device 200, signals of a plurality of pixels of the same color (filter) adjacent to the rear portion of the CDS circuit 206 and the A/D conversion circuit 207 of the row circuit portion 204 are set by the digital signal. The added pixel addition circuit 208, when digital zooming, can read out the image data of the image data in the selected area for each arbitrary row and the predetermined plurality of pixels to be added, and make a live preview. Image or moving image shooting, even at a high rate, can be converted into an image signal with a small amount of image data and output.

Further, the image pickup signal of the selected area selected for reading and the image pickup signal added by the pixels are sequentially output from the CDS circuit 206 and the A/D conversion circuit 207 of the row circuit unit 204 in accordance with the row selection of the vertical scanning circuit 202. The line signal selected by the signal, but at this time, it is synchronized with the high-speed clock, and outputted as a parallel digital signal, or the parallel digital signal is encoded, and then converted by a parallel/serial conversion circuit, and then The serial digital camera signal is output, and the high-resolution imaging signal can be transmitted to the DSP at a high-speed frame rate.

(DSP department)

In the case where the imaging element 56 is a CMOS image sensor, the CDS/ADC circuit of the built-in CMOS sensor removes noise and performs digital conversion, and the same built-in high-speed output circuit will be juxtaposed or serially arranged. When the imaging signal transmitted by the digital signal is input to the DSP unit 63, the DSP unit 63 first performs white balance adjustment or color balance adjustment, and then according to the mosaic-like "Bayer arrangement" or level provided in front of the imaging element 56. / Green square R/B color difference line pattern which is staggered in a repeating period of 2 pixel units, etc., color filters such as RGB primary color filters are arranged, although each pixel has only one color component, but other The pixel value of the color difference component is also obtained by pixel interpolation from the neighboring pixel values (color interpolation processing), and converted into a digit map of gray scale values having RGB color difference components for each pixel. Like information.

In addition, in the case of performing resolution conversion processing (Resolution Conversion) for converting the size of the captured image into a different image size, the size/interpolation processing circuit is used before the color interpolation. For example, in order to display a live preview image or a playback image on a viewfinder or an image monitor, in order to write a video RAM or a display RAM area in the display driver, a resizing to a predetermined image size is performed (Resize). Or interpolation processing (Interpolation). Alternatively, in the case of photographic recording, in order to record at the desired recorded image size, the image of the set recording image size is subjected to reduction/enlargement processing, or resizing/interpolation processing or resolution conversion processing. In the case where resizing or interpolation processing has been performed, since the image is faint or the resolution is lowered, it is preferable to perform contour enhancement filtering calculation or image sharpening filtering processing such as Unsharpness Filtering at the same time. Further, in the DSP unit 63, the RGB-based digital image signal which has been subjected to gray scale correction by the γ correction circuit is temporarily stored in the buffer memory, and then displayed on an electronic viewfinder such as an LCD monitor or in a color matrix circuit. The RGB system converts the image signal into a predetermined color space such as the YUY system/YCbCr system, and performs compression/encoding processing by the image CODEC to become JPEG still image data or MPEG4 or H.264 moving image data.

(wide-angle zoom lens)

In the case of reducing the number of pixels, although the photographic angle of view is unchanged, the photographic angle of view is not changed, but in the case of the wide-angle finder, a small angle of view is cut out. In the case of the zoom lens, since the range of the viewable angle of view is narrowed, it is difficult to perform wide-angle photography, and the problem of the zoom system toward the telephoto side occurs. Therefore, if the range of the field of view magnification of the viewfinder display that is generally used is set to 125 to 200%, the zoom is shifted by about 1/1.25 to 1/2 or slightly to the wide angle side by more than usual. The lens system is combined to solve this problem.

Fig. 12 is a view showing the relationship between the configuration example of the zoom lens system, the optical zoom magnification, and the visual field magnification. If the most common user is about HDR=125% of the field of view magnification, for example, in the 5x optical zoom system of the 1/2 type image sensor, the general focal length is 6.2~32mm (in the case of 35mm filter conversion is about 35~175mm). Just set the focal length of the W end to a wide angle of 6.2 mm ÷ (141/100) = 4.4 mm or less, that is, a zoom system with a focal length of 4.4 to 22 mm (converted to about 24.8 to 124 mm in 35 mm).

Further, at this time, a display control means may be provided, and instead of the actual focal length, a photographing angle of view (angle) or a focal length of a 35 mm filter conversion may be calculated and displayed on the display unit 79.

In addition, a setting control means may be provided, such that the operating range of the usual zoom lens is operable in a range slightly biased toward the telephoto side, and in the wide-angle viewfinder, the zoom lens is actuated in response to the viewfinder magnification of the viewfinder. The range is controlled in a manner that moves in a range that is biased toward the telephoto side. Even in the case of making a wide-angle viewfinder, in order to be substantially equal to the usual shooting range (angle of view), it is also possible to set a setting means for automatically setting the zoom focus or optical zoom in accordance with the viewfinder magnification of the viewfinder. Magnification.

Therefore, an appropriate optical zoom magnification can be set in accordance with the viewfinder magnification of the viewfinder.

(Other embodiments)

Further, in the present embodiment, the live preview image is displayed on the display unit 79 on a single screen, but the live preview image is displayed in the display form shown in FIGS. 13 and 14. In other words, in the display form of Fig. 13, as shown in Fig. 13(a), the display unit 79 performs focus selection display of the live preview image to select the focus position from the live view shown in Fig. 13(b). Preview the size of the image or photographic image data, cut out the size of the displayed image shown in Fig. 13(c), and cut out the predetermined range centered on the focus position and zoom in. Then, as shown in Fig. 13(d), the display image of the cut size is displayed in the live preview image, and the enlarged display for the focus confirmation is performed by the enlarged display of the focus position superimposed thereon. Therefore, it is possible to accurately confirm whether or not the focus is aligned by the user viewing the enlarged display for focus confirmation.

Further, as shown in FIG. 14(a), the user may select a focus position, and display a center portion of the image on another screen according to a plurality of magnifications, or as shown in FIG. 14(b). The non-photographed person is recognized and the recognized subject person portion is superimposed and displayed.

It is to be understood that the invention is not limited to the specific embodiment, and the invention may be practiced without departing from the spirit and scope of the invention. The present invention can be embodied in various forms depending on the appropriate combinations of the configurations disclosed in the above embodiments.

2. . . Control circuit

3. . . CPU

4. . . Data bus

5. . . interface

6. . . Sound output circuit

7. . . Input circuit

8. . . Memory card interface

9. . . USB controller

10. . . Output interface

12, 13. . . Input and output

14. . . HDD interface

15. . . Sound CODEC (encoder/decoder)

twenty two. . . Operation input

twenty three. . . Program memory

twenty four. . . Data memory

25. . . Image memory medium

26. . . USB terminal

27. . . antenna

28. . . Wireless LAN transceiver

29. . . Communication controller

32. . . Focus lens drive

33. . . Zoom lens drive unit

34. . . Aperture drive unit

35. . . Shutter drive

36. . . flash

37. . . Flash drive circuit

38. . . Metering / Ranging Sensor

39, 41, 43. . . Detection circuit

40, 42. . . Angular velocity sensor

44. . . battery

45. . . Power control unit

46. . . HDD memory device

48. . . motor

49. . . Motor driver

50. . . Microcomputer department

52. . . Head amplifier

53. . . Read/write channel +CODEC

54. . . HDD Control Department

55. . . Imaging optical system

56. . . Camera element

57. . . aperture

58. . . shutter

59. . . Image sensor unit

60. . . Horizontal scanning unit

61. . . Vertical scanning unit

62. . . P/S conversion unit

63. . . DSP department

64. . . S/P conversion unit

65. . . Buffer memory

66. . . WB Correction Department

67. . . Resize/pixel interpolation

68. . . Color interpolation

69. . . Contour correction unit

70. . . γ correction unit

71. . . Matrix circuit

72. . . Digital signal processing unit

73. . . Controller

74. . . Image data bus

75. . . Buffer memory

76. . . Image CODEC (encoder/decoder)

77. . . Dynamic image CODEC

78. . . Display driver circuit

79. . . Display department

100. . . Digital camera

101. . . Ontology

102. . . Camera lens

103. . . switch

104. . . Shutter button

105. . . Zoom lever

106. . . Photography mode dial

107. . . General turntable

108. . . Optical viewfinder

109. . . OK button

110. . . Cursor key

111. . . Display key

112. . . Operation table key

The general configuration for carrying out the various features of the present invention is described with reference to the drawings. The drawings and the related description are provided to illustrate the embodiments of the invention and not to limit the scope of the invention.

Fig. 1(a) is a plan view of a digital camera according to an embodiment of the present invention, and Fig. 1(b) is a rear view.

Fig. 2 is a block diagram showing the circuit configuration of the image pickup apparatus of the embodiment.

Fig. 3 is a flow chart showing the overall processing procedure in the embodiment.

Fig. 4 is a flow chart subsequent to Fig. 3.

Fig. 5 is a view showing a display example of the embodiment.

Fig. 6 is a flow chart showing the optical & digital interlocking zoom processing (1).

Fig. 7 is a view showing specific numerical values obtained by the optical & digital interlocking zoom processing (1).

Fig. 8 is a flow chart showing the zoom processing (2) of the optical & digital motion.

Fig. 9 is a view showing specific numerical values obtained by the optical & digital interlocking zoom processing (2).

Fig. 10 is a flow chart showing a subroutine of the digital zoom processing in which image quality deterioration is small.

Fig. 11 is a view showing a circuit configuration of an image pickup element.

Fig. 12 is a view showing a relationship between a configuration example of a zoom lens system, an optical zoom magnification, and a field magnification.

Fig. 13 is a view showing an example of another display screen.

Fig. 14 is a view showing an example of another display screen.

79. . . Display department

791. . . Field of view magnification

792. . . View box

793. . . Within the photography area

794. . . Outside the photography area

Claims (13)

An image pickup apparatus comprising: an image pickup unit that captures an image of a subject; a memory unit; a display unit; and a processor that performs image processing on the image captured by the image capture unit to generate an image a first image having a first image size and a second image having a second image size, and controlling the memory unit, the memory unit recording the first image and controlling the display unit The display unit displays the second image as a live preview image of the image captured by the camera unit, and the processor sets the field of view magnification to an arbitrary value according to a user operation, and the field of view magnification For the ratio between the first image size and the second image size, the processor automatically sets the second image size according to the field of view magnification set by the user operation and the first image size. In response to the change, the processor sets the value of the field of view magnification to a direct and arbitrary value in accordance with the user operation such that the second image size is larger than the first image size. The image pickup device of claim 1, wherein the processor sets the value of the field of view magnification value to a direct and arbitrary value within a range from 100% to more than 200% of a specific value according to a user operation. The image pickup device of claim 1, wherein the processor displays the second image data as a live preview image on the display unit At this time, the first image size is displayed in an identifiable state. The image pickup device of claim 3, wherein the processor displays an area corresponding to the first image size in a color mode, and the other areas are displayed in a black and white mode. An image pickup apparatus according to claim 1, wherein the processor displays a value indicating a field of view magnification set to the arbitrary value together with the live preview image on the display unit. The camera device of claim 1, further comprising: a user interface, accepting a command group including a record command input from the user; and a recording unit, the first picture is recorded as the command is to be recorded Like recording on a recording medium. The image pickup device of claim 1, comprising a wide-angle lens for imaging the image of the subject to the image capturing unit; the processor is configured to capture the image taken by the camera unit through the wide-angle lens The image is subjected to digital zoom processing, whereby the first image is generated. The image pickup device of claim 1, further comprising: a zoom lens that images the image of the subject to the image pickup unit; and a driving unit that drives the zoom lens to change an optical zoom magnification , The processor generates the first image from the image captured by the zoom lens through the zoom lens. The image pickup device of claim 1, wherein the processor performs the image processing, and applies a pixel addition process to the image captured by the image capturing unit, thereby applying the digital zoom to the live preview image. image. The image pickup device of claim 1, wherein the processor obtains the third image data having the third image size captured by the image capturing unit, and obtains the smaller size than the third image size. The second image data of the second image size is displayed on the display means as the through image, and the image data captured by the image capturing unit is obtained from the second image data. The first image data of the first image size is smaller than the image size, and the acquired first image data is recorded in the memory unit. The image pickup device of claim 10, further comprising a zoom unit for setting a zoom magnification to an arbitrary value, the processor pressing the zoom magnification set by the zoom unit and the field of view magnification set to the arbitrary value. The first image size and the second image size are automatically changed. The image pickup device of claim 11, wherein the zoom unit sets a magnification of the digital zoom processing, that is, a digital zoom magnification, and the processor presses the digital zoom ratio set by the zoom unit. And the third image size, the first image size and the second image size are automatically changed. A method of controlling an image pickup apparatus, comprising: a camera unit that captures an image of a subject; a memory unit; and a display unit; the method includes the following steps: by photographing the camera unit The image is subjected to image processing to generate a first image having a first image size and a second image having a second image size; and controlling the memory unit, the memory unit recording the first image While controlling the display unit, the display unit displays the second image as a live preview image of the image captured by the camera unit, and the processor sets the field of view magnification according to a user operation. An arbitrary value, the field of view magnification is a ratio of the first image size to the second image size, and the processor is based on the field of view magnification set by the user operation and the first image size. The second image size is automatically changed, and the processor sets the value of the field of view magnification to a direct and arbitrary value according to the user operation, so that the second image size becomes larger than the first image. The size is still large.