JP5223950B2 - Imaging apparatus, display control program, and display control method - Google Patents

Description

  The present invention relates to an imaging apparatus having means for displaying a subject such as an electronic viewfinder, a display control program for the imaging apparatus, and a display control method.

As conventional imaging devices, those described in Patent Documents 1 and 2 below are known.
Patent Document 1: Shooting a square image and converting it into digital image data, and recording a partial area of the square image data cut off in the vertical or horizontal direction in the image memory according to the state of the vertical / horizontal switching means.
Patent Document 2: Specifying the first point and the second point on the subject image to specify the trimming position, and based on one of the vertical and horizontal dimensions and the aspect ratio of the first point and the second point. Set the trimming range.

Japanese Patent No. 2882391 Japanese Patent No. 3372989

  However, in the technique described in Patent Document 1, since a partial area obtained by cutting out the vertical or horizontal square image data is recorded in the image memory, the cut-out portion includes an image portion desired by the user. It is not possible to confirm in advance whether or not For this reason, there is a case where the desired image portion is not included in the cut-out portion, and an image including the image portion desired by the user cannot be stored.

  On the other hand, in the technique described in Patent Document 2, it is possible to include an image portion desired by the user in the trimming range or to record an image range having a shape desired by the user. However, it is troublesome to specify the trimming position by specifying the first point and the second point on the subject image at the time of shooting, and the user can easily specify the image range including the image portion desired by the user. I can't.

  The present invention has been made in view of such conventional problems, and an imaging apparatus capable of easily capturing an image range including a desired image portion, a display control program for the imaging apparatus, and a display control method for the imaging apparatus. The purpose is to provide.

In order to solve the above-described problems, the present invention is an imaging apparatus including an imaging unit that images a subject and outputs image data, a display unit that displays image data, and a recording unit that records image data. First image data having a first image size smaller than the third image size is acquired from third image data having a third image size captured by the imaging unit, and the acquired first The second image data having a second image size smaller than the first image size is acquired from the image data captured by the imaging unit. and control means, the value of the field expansion ratio is the ratio between the first image size and the second image size user to record a second image data thus acquired in the recording means An expansion rate setting means for setting a direct and an arbitrary value depending on the chromatography operation, the so that the field of view expansion ratio set by the extended rate setting means, and the first image size and the second image size Size determining means for determining the zoom magnification, zoom magnification setting means for setting the zoom magnification to an arbitrary value, and recording size setting means for setting the second image size to an arbitrary value in response to a user operation. The control means displays the second image size in an identifiable state when displaying the first image data as a through image on the display means, and the size determining means is configured to set the zoom magnification setting. According to the zoom magnification set by the means, the visual field expansion ratio set by the expansion ratio setting means, and the change in the second image size set by the recording size setting means. Characterized in that automatically changing the image size.

According to the present invention, it is possible to determine the size of an image to be displayed as a through image and the size of an image to be recorded in accordance with an arbitrary field expansion rate setting.

The top view of the digital camera which concerns on one embodiment of this invention, (b) is a rear view. It is a block diagram which shows the circuit structure of the imaging device which concerns on the embodiment. It is a flowchart which shows the whole process sequence in the same embodiment. It is a flowchart following FIG. It is a figure which shows the example of a display in the embodiment. It is a flowchart which shows the optical & digital interlocking zoom process (1). It is a figure which shows the specific numerical value obtained by optical & digital interlocking zoom processing (1). It is a flowchart which shows the optical & digital interlocking zoom process (2). It is a figure which shows the specific numerical value obtained by the zoom process (2) of optical & digital interlocking | linkage. It is a flowchart which shows the subroutine of a digital zoom process with little image quality degradation. It is a figure which shows the circuit structural example of an image pick-up element. It is a figure which shows the relationship between the structural example of a zoom lens system, an optical zoom magnification, and a visual field expansion rate. It is a figure which shows the other example of a display screen. It is a figure which shows the other example of a display screen.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1A is a plan view of a digital camera 100 according to an embodiment of the present invention, and FIG. An imaging lens 102 is provided on the front surface of the main body 101 of the digital camera 100. On the top surface, a power switch 103, a shutter button (release button) 104, a zoom lever 105, a shooting mode dial 106, and a general dial 107 are provided. On the back side, an optical finder 108, an OK key 109, a cursor key 110, a DISPLAY key 111, a MENU key 112, and a display unit 79 are provided. Various modes shown in the flowcharts to be described later are set by operating the mode dial 19, and the cursor key 110 and the OK key 109 are operated in a state in which the various modes are set, thereby allowing selection of options in the mode. It becomes. The display unit 79 includes an LCD panel, and also functions as a monitor for reproducing and displaying recorded still images and moving images.

  FIG. 2 is a block diagram illustrating a circuit configuration of the digital camera 100. The digital camera 100 has a high-speed continuous shooting function, and has a control circuit 2 as shown in the figure. The control circuit 2 includes a CPU 3, an interface 5, an audio input / output circuit 6, an input circuit 7, a memory card interface 8, a USB controller 9, an input / output interface 10, an input / output connected to the CPU 3 via a data bus 4. Ports 12 and 13 and an HDD interface 14 are provided. A microphone 16 is connected to the audio input / output circuit 6 via an amplifier 17 and an A / D converter 18, and a speaker 19 is connected via an amplifier 20 and a D / A converter 21. An operation input unit 22 provided with various operation keys, switches, and the like is connected to the input circuit 7, and an image memory medium 25 provided detachably is connected to the memory card interface 8. The USB controller 9 is connected to a USB terminal 26, and the input / output interface 10 is connected to a wireless LAN transmission / reception unit 28 having an antenna 27 via a communication controller 29.

  The input / output port 12 is connected to a focus lens driving unit 32, a zoom lens driving unit 33, an aperture driving unit 34, and a shutter driving unit 35, and a strobe 36 is connected via a strobe driving circuit 37 to perform photometry. / A distance measuring sensor 38 is connected via a detection circuit 39. In the input / output port 13, an angular velocity sensor (Y / Pitch) 40 for detecting the vertical shake of the digital camera 100 and an angular velocity sensor (X / Yaw) 42 for detecting the vertical shake are respectively detected circuits. 41 and 43 are connected. An HDD storage device 46 is connected to the HDD interface 14. The HDD storage device 46 includes a disk medium 47 and also includes a motor 48, a motor driver 49, a microcomputer unit 50, a VC motor 51, a head amplifier 52, a read / write channel + CODEC 53, an HDD control unit 54, and the like.

  In addition, a battery 44 is connected to the control circuit 2 via a power supply control unit 45, and the power supply control unit 45 is controlled by the control circuit 2 to supply power from the battery 44 to each unit. Further, an audio CODEC (encoder / decoder) 15, a program memory 23 and a data memory 24 are connected to the data bus 4. The audio CODEC 15 encodes an audio signal and decodes audio data. The program memory 23 stores a program for operating the control circuit 2 shown in the flowchart described later. The data memory 24 stores various data in advance and stores other data other than image data.

  On the other hand, an image sensor 56 is disposed on the rear optical axis of the image pickup optical system 55 including the zoom lens and the wide-angle lens, and the image pickup optical system 55 includes a stop 57 and a stop 57 driven by the stop drive unit 34. A shutter 58 driven by the shutter drive unit 35 is inserted. The focus lens drive unit 32 drives the focus lens in the imaging optical system 55, and the zoom lens drive unit 33 is configured to drive the zoom lens.

  The image sensor 56 is capable of high-speed reading such as parallel reading, and includes an image sensor unit 59, a horizontal scanning unit 60, a vertical scanning unit 61, and a P / S conversion unit 62. A DSP unit 63 is connected to the image sensor 56. The DSP unit 63 includes an S / P conversion unit 64 for processing the image signal captured from the P / S conversion unit 62 of the image sensor 56, a buffer memory 65, a WB correction unit 66, a resizing / pixel interpolation unit 67, a color An interpolation unit 68, a contour correction unit 69, a gamma correction unit 70, a matrix circuit unit 71, a controller 73 for controlling the period of the vertical scanning unit 61, the buffer memory 65, an image recognition process, and other digital signals. A processing unit 72 is provided.

  The matrix circuit unit 71 and the image recognition processing and other digital signal processing unit 72 are connected via an image data bus 74 to a buffer memory 75, an image CODEC (encoder / decoder) 76, and a moving image CODEC (encoder / decoder). 77 and the display drive circuit 78, and the image data bus 74 is connected to the interface 5 of the control circuit 2. In addition to image recognition processing, the digital signal processing unit 72 digitally processes and synthesizes a plurality of captured images, and the buffer memory 75 temporarily stores image data when the image CODEC 76 and the moving image CODEC 77 perform encoding and decoding processing. The display drive circuit 78 drives the (finder) display unit 79.

(Overall operation)
3 and 4 are a series of flowcharts showing a processing procedure in the present embodiment. The control circuit 2 executes processing as shown in this flowchart based on the program stored in the program memory 23. First, it is determined whether or not the still image shooting mode is set (step S101). If it is not set, the process proceeds to step S119 in FIG. 4 to be described later.

When the still image shooting mode is set, the recorded image size (horizontal: X _R , vertical: Y) which is the size of the image to be recorded in the image memory medium 25 in accordance with the operation by the operation input unit 22 by the user. _R ), aspect ratio, etc. are set (step S102). Next, after setting the shooting mode, shooting conditions, and the like (step S103), selection of a wide finder or finder field expansion rate WR (%) is set (step S104).

  FIG. 5 is an explanatory diagram showing the setting operation in step S104. As shown in FIG. 10A, the normal through image range is set to 100%, and the field expansion rate of FIG. 10D is set to 200% horizontal and 200% vertical in accordance with the operation of the cursor key 110. Is variable. Then, 100% to 200% × 200% is selected by operating the cursor key 110, and by operating the OK key 109, the viewfinder expansion rate WR (%) is set.

  Note that the image in FIG. 5D is an image that has not been subjected to digital zoom processing, that is, an image with a zoom magnification of “1”, and is an image with a larger digital zoom magnification in the order of (d), (c), (b), and (a). Of course, the image with the maximum field expansion rate of 200% × 200% in FIG. 5D is a range that can be imaged within the imaging range of the imaging device 56.

When the finder field expansion rate WR (%) is set in this way, the following is indicated according to the display writing image size (X _d , Y _d ) and the set field expansion rate WR (%). The output image size (X _OUT , Y _OUT ) that is the size of the image to be output to the display unit 79 is set by the equation (step S105).
X _OUT = (WR / 100) · X _d
Y _OUT = (WR / 100) · Y _d

Here, the display writing image size (X _d , Y _d ) is written in the buffer memory 75 during normal shooting when the wide finder is not selected, and is vertically and horizontally transferred to the display unit 79 via the display driving circuit 78. The size (number of pixels), and the output image size (X _OUT , Y _OUT ) is written in the buffer memory 75 and transferred to the display unit 79 via the display drive circuit 78 after the processing in step S105 is executed. There are vertical and horizontal sizes of the image to be played.

Therefore, the display writing image size (X _d , Y _d ) is multiplied by (WR / 100) using the visual field expansion rate WR (%) set by the user, and this is multiplied by the output image size (X _OUT , Y _OUT ), the output image size (X _OUT , Y _OUT ) is (WR / 100) times the display writing image size (X _d , Y _d ). At this time, since WR ≧ 100, the output image size (X _OUT , Y _OUT ) is equal to or _larger than the display writing image size (X _d , Y _d ). In other words, if WR = 200%,
X _OUT = (200/100) · X _d = 2X _d
Y _OUT = (200/100) · Y _d = 2Y _d
It becomes.

Next, the limit (DZ _MAX ) of the digital zoom magnification (DZ) is set according to the following exemplary expression in accordance with the captured full image size (X _F , Y _F ) and the output image size (X _OUT , Y _OUT ). (Step S106).
(Example) DZ _MAX = X _F / X _OUT
Or DZ _MAX = Y _F / Y _OUT

Here, the captured full image size (X _F , Y _F ) is the maximum image size that can be captured by the image sensor 56. Accordingly, the limit (DZ _MAX ) of the digital zoom magnification (DZ) becomes smaller as the output image size (X _OUT , Y _OUT ) is larger.

  Next, it is determined whether or not a zoom operation has been performed (step S107). If there is a zoom operation, a zoom process (or a digital zoom process with less image quality degradation) is executed (step S108). Note that details of the digital zoom process with little image quality deterioration in step S108 will be described in a flowchart described later.

Subsequently, the resizing ratio (IP _x = X _d / X ′, IP _y = Y _d / Y ′) is set according to the through image size (X ′, Y ′), and the resizing / interpolating process is performed. The display writing image data having the embedded image size (X _d , Y _d ) is converted (step S109).
Here, the through image size (X ′, Y ′) is the vertical and horizontal size of the through image displayed on the display unit 79. Therefore, the display writing image size (X _d , Y _d ) is a size that can be displayed on the display unit 79 in full screen.

Further, through image display processing (writing to the display RAM) is executed in accordance with the display writing image size (X _d , Y _d ), the viewfinder field expansion ratio WR (%), and the digital zoom magnification (DZ). At this time, a frame is displayed in the display area corresponding to the recording image size (X _R , Y _R ) set in step S102, the visual field expansion rate is displayed, and the photographing area is displayed in color. The area outside the imaging area is converted into monochrome and displayed (step S110).

Therefore, as shown in FIGS. 5A to 5D, the field expansion rate 791 such as “100%” or “125% × 125%” is displayed on the display unit 79 by the processing in S110. A frame 792 is displayed in the display area corresponding to the recorded image size (X _R , Y _R ), the shooting area 793 is displayed in color, and the shooting area 794 is displayed in monochrome.

  Therefore, the user visually recognizes the displayed field expansion ratio 791 and the displayed imaging area 793 outside the imaging area 794, thereby confirming whether or not the currently set visual field expansion ratio is appropriate. It can be determined whether a large visual field expansion rate should be set or a smaller visual field expansion rate should be set.

  Further, the user can perform still image shooting while visually confirming whether or not the desired image portion is included by visually recognizing the through image portion in the frame 792 or the color-displayed shooting region 793.

  As shown in FIGS. 5B to 5D, when the through image portion outside the shooting area 794 is displayed, “* The inside of this frame is recorded at the time of shooting” outside the shooting area 794. It is preferable to display a character string. Thereby, even a beginner can recognize that the through image portion in the photographing region 793 is an image portion to be recorded and perform photographing while confirming whether or not the desired image portion is included. it can.

  Next, it is determined whether or not the release button 104 has been half-pressed (or AF / AE lock operation) (or AF / AE lock operation) (step S111). Return to S107. If the release button 104 is pressed halfway, photometry processing and AF / AE lock processing are executed (step S112), and the release button 104 is fully pressed (step S113).

  If the release button 104 has been fully pressed, exposure and shooting processes are executed, and the area-selected image is read out without addition in accordance with the digital zoom magnification (DZ) (step S114). That is, an image corresponding to the image including the inside 793 and the outside 794 shown in FIG. 5 is read from the image sensor 56 without adding pixels. Therefore, the image read in step S114 includes an image portion corresponding to the inside shoot area 793 and an image portion corresponding to the outside shoot area 794.

Subsequently, the image read in step S114 is taken as a photographed image (X ″, Y ″), and from the center of the photographed image (X ″, Y ″), according to the following formula according to the finder field expansion rate WR (%). The captured image data in the imaging area of the image size (X2, Y2) is extracted (step S115).
X2 = X ″ ÷ (WR / 100)
Y2 = Y ″ ÷ (WR / 100)

In addition, the following resize ratio (IP _x , IP _y ) is set for the extracted image having the image size (X2, Y2) in accordance with the recording image size (X _R , Y _R ) set in step S102, and is recorded. For resizing, and interpolation processing is performed as necessary (step S116).
IP _x = X _R / X2
IP _y = Y _R / Y2

  Then, after the resized photographed image is displayed on the display unit 79 as a review or preview before recording (step S117), it is encoded and compression-encoded and stored in a memory medium (the image memory medium 25 or the disk medium 47). Recording is performed (step S118). That is, based on the shooting conditions set in step S103, the image sensor 56 and the DSP unit 63 are controlled to perform exposure and shooting operations, thereby obtaining a high-resolution subject imaging signal for still recording. Then, it is encoded by the image CODEC (encoder / decoder) 76 into compressed encoded data according to the JPEG standard or the like, or uncompressed encoded data such as RAW data, etc., and recorded in the image memory medium 25 or the disk medium 47. To do.

  At this time, as described above, the image recorded in the memory medium is photographed by the user operating the release button 104 while visually checking the through-image portion in the frame 792 or the color-displayed photographing region 793. Therefore, the desired image portion is surely included, so that the image range including the desired image portion can be easily captured and recorded.

  On the other hand, if the result of determination in step S101 is that the still image shooting mode has not been set, processing proceeds from step S101 to step S119 in FIG. It is determined whether or not the moving image shooting mode is set. If it is not set, the process proceeds to other mode processing (step S120).

When the moving image shooting mode is set, a recording image size (horizontal: X _R , vertical size) that is the size of one frame of a moving image to be recorded in the image memory medium 25 in response to an operation by the user through the operation input unit 22 : Y _R ), aspect ratio, etc. are set (step S121). Next, after setting the shooting conditions for moving image shooting (step S122), selection of a wide finder or finder field expansion rate WR (%) is set (step S123). The setting operation in step S123 is the same as that in step S104 described with reference to FIG.

If the viewfinder field expansion rate WR (%) is set, the recorded image size (X _R , Y _R ) set in step S121 and the field expansion rate WR (%) set in step S123 are set. Accordingly, the output image size (X _OUT , Y _OUT ), which is the size of the image output to the display unit 79, is set according to the following equation (step S124).
X _OUT = (WR / 100) · X _R
Y _OUT = (WR / 100) · Y _R

Therefore, the output image size (X _OUT , Y _OUT ) is (WR / 100) times the recorded image size (X _R , Y _R ). At this time, since WR> 100, the output image size (X _OUT , Y _OUT ) is a value greater than or equal to the recorded image size (X _R , Y _R ). In other words, if WR = 200%,
X _OUT = (200/100) · X _R = 2X _R
Y _OUT = (200/100) · Y _R = 2Y _R
It becomes.

Next, similarly to the processing in step S106 described above, the digital zoom magnification (DZ) is expressed by the following exemplary expression according to the captured full image size (X _F , Y _F ) and the output image size (X _OUT , Y _OUT ). ) Limit (DZ _MAX ) is set (step S125).
(Example) DZ _MAX = X _F / X _OUT
Or DZ _MAX = Y _F / Y _OUT

  Further, it is determined whether or not a zoom operation has been performed (step S126). If there is a zoom operation, a zoom process (or a digital zoom process with less image quality deterioration) is executed (step S127). The details of the digital zoom process with little image quality deterioration in step S127 will be described in the flowchart described later.

  Subsequently, through image / moving image imaging processing is executed, and the image selected in the area is read out in the selected addition mode in accordance with the digital zoom magnification (DZ) (step S128). That is, an image corresponding to an image including the inside 793 and the outside 794 shown in FIG. 5 (an area selected image) is read from the image sensor 56 while adding pixels in a preselected addition mode.

Next, it is determined whether or not the shooting start button (release button 104) has been pressed or whether or not moving image shooting is in progress (step S129). If this determination is NO, the process proceeds to step S132. If the shooting start button is pressed or the action shooting is in progress, the image read in step S128 is taken as a shot image of the size (X ′, Y ′) and the size (X ′, Y ′). Based on the finder field expansion rate WR (%), the captured image data of the captured area of size (X2, Y2) is extracted from the captured image (step S130).
X2 = X ′ ÷ (WR / 100)
Y2 = Y ′ ÷ (WR / 100)

  Also, the extracted image data of the image size (X2, Y2) is sequentially output to a moving image CODEC (encoder / decoder) 77 to encode / compress moving images and record them in a memory medium. Is executed (step S131). That is, based on the moving image shooting conditions set in step S122, the image sensor 56 and the DSP unit 63 are controlled to perform exposure and shooting operations to obtain a high-resolution subject imaging signal for moving image recording. Then, an image codec (encoder / decoder) 77 uses MPEG4 or H.264. The image data is compressed and encoded corresponding to a compression method such as H.264 / AVC and recorded in the image memory medium 25 or the disk medium 47 in a file format such as AVI or MP4.

Further, the following resize ratios (IP _x , IP _y ) of the captured frame image having the image size (X ′, Y ′) are selected according to the display writing image size (X _d , Y _d ) described in step S105. Is set, recording resize is performed, and display resize / interpolation processing is performed (step S132).
IP _x = X _d / X ′
IP _y = Y _d / Y ′

Then, through image display processing for moving images (writing to the display RAM) is executed, and at this time, a frame is displayed in the shooting area corresponding to the recording image size (X _R , Y _R ) set in step S121, In addition to displaying the visual field expansion rate, the inside of the photographing area is displayed in color, and the outside of the photographing area is converted into monochrome and displayed (step S133).

Accordingly, as shown in FIGS. 5A to 5D, the field expansion rate 791 such as “100%” “125% × 125%” is displayed on the display unit 79 by the processing in S133. A frame 792 is displayed in the display area corresponding to the recorded image size (X _R , Y _R ), the shooting area 793 is colored, and the shooting area outside 794 is displayed in monochrome.

  Therefore, the user can perform moving image shooting while visually confirming whether or not the desired image portion is included by visually recognizing the through image portion in the frame 792 or the color-displayed shooting region 793.

(Zoom processing 1)
FIG. 6A is a flowchart showing optical and digital interlocking zoom processing (1), which is a first processing example of the zoom processing executed in steps S108 and S128. At the start of the processing according to this flowchart, the still image is processed in step S105 in the main routine shown in FIGS. 4 and 5, as shown in FIG.
X _OUT = (WR / 100) · X _d
Y _OUT = (WR / 100) · Y _d
Is set,
For the video, in step S124,
X _OUT = (WR / 100) · X _R
Y _OUT = (WR / 100) · Y _R
Is set.
Furthermore, the following digital zoom limit DZ _MAX is set in the processing of step S106 or step S125.
DZ _MAX = X _F / X _OUT
Or DZ _MAX = Y _F / Y _OUT

In this state, it is determined whether or not there has been a zoom operation (step S201). If there has been a zoom operation, the total zoom magnification Z is converted by the following equation according to the setting of the viewfinder field expansion ratio WR (%) (step S201). S202).
Z = OpZ × DZ ÷ (WR / 100)
(However, OpZ: Optical zoom magnification of the imaging optical system 55)
Therefore, when WR = 100%, Z = OpZ × DZ.

Next, the total zoom magnification (Z) is increased or decreased according to the following equation in accordance with the zoom operation (zoom operation amount) ΔZ for the zoom lever 105 (step S203).
Z = Z ± ΔZ

Then, it is determined whether or not Z <OpZ _min (OpZ _min : optical zoom magnification minimum value) or Z <1 (step S204). When the determination in step S204 is YES and the total zoom magnification Z is less than OpZ _min or less than 1, the digital zoom magnification DZ = 1 and the optical zoom magnification OpZ = OpZ _min × (WR / 100). Setting is made (step S205).

  Subsequently, optical zoom processing is executed according to the set optical zoom magnification OpZ, and the zoom lens driving unit 33 is controlled to drive the zoom lens (step S206). Further, AF processing is executed at the selected AF frame (an AF frame selected in advance when there are a plurality of AF frames) or the center of the visual field, and the focus lens driving unit 32 is controlled to drive the focus lens (step S207). ). Thereafter, the process proceeds to a digital zoom processing subroutine described later (with little image quality degradation) according to the setting DZ (step S208).

On the other hand, if the determination in step S204 is NO and the total zoom magnification Z is greater than or equal to OpZ _min or greater than or equal to 1, whether or not “Z> {OpZ _max ÷ (WR / 100)}” ( (OpZ _max : optical zoom magnification maximum value) is determined (step S209). When this determination is NO and the total zoom magnification Z is a value smaller than the value obtained by dividing the optical zoom magnification maximum value Z _max by (WR / 100), according to the increase or decrease of the total zoom magnification Z, DZ = 1 and OpZ = Z × (WR / 100) that increase or decrease the optical zoom magnification (OpZ) with priority are set (step S210), and the process proceeds to step S206.

If the determination in step S209 is YES, OpZ = OpZ _max is set (step S211). Next, it is determined whether or not the digital zoom function is set to ON (step S212). If it is not set to ON, DZ = 1 is set (step S213), and the process proceeds to step S206. When the digital zoom function is set to ON, DZ = (WR / 100) × Z / OpZ _max for increasing / decreasing the digital zoom magnification (DZ) according to the increase / decrease in the overall zoom magnification Z is set (step S214).

Then, it is determined whether DZ set in step S214 exceeds a digital zoom ratio maximum value _{DZ max} (step S215), the process proceeds to step S206 if not exceeded. However, if it exceeds, the set digital zoom magnification DZ is limited to the maximum digital zoom magnification DZ _max (step S216), and the process proceeds to step S206.

Therefore, according to the above optical & digital interlocking zoom process (1), when the total zoom magnification (Z) is within the operation range of the optical zoom magnification (OpZ) (Z _min ≦ Z ≦ {OpZ _max ÷ (WR / 100)}), the optical zoom magnification (OpZ) can be preferentially increased or decreased (DZ = 1 and OpZ = Z × (WR / 100)), and OpZ is set to OpZ _min ~ It can be increased or decreased within the range of OpZ _max .

When the total zoom magnification (Z) exceeds the maximum value of the optical zoom magnification (OpZ) considering the field expansion ratio (WR) (Z> {OpZ _max ÷ (WR / 100)}), the optical zoom magnification When the digital zoom function is set to ON while maintaining (OpZ) at the maximum value (OpZ> OpZ _max ), the digital zoom magnification (DZ) is increased or decreased according to the increase or decrease of the overall zoom magnification (Z). Can be controlled. DZ increases or decreases within a range of 1 to OpZ _max .

Accordingly, as illustrated in FIG. 7, the optical zoom (× 1 to 5 times), the captured full image size (X _F = 2880, Y _F = 2160), the display writing size (X _d = 640, Y _d = 480), (in the case of a moving image, when the recording image size (XR = 640, YR = 480), the illustrated numerical value is obtained.

  Then, in accordance with the high-priced zoom magnification (OpZ) set in this way, the zoom lens is driven to perform optical zoom processing, or in the selected AF frame or the center of the visual field, Based on the focus detection information such as the contrast value, the focus lens is driven to perform AF. Further, according to the set digital zoom magnification (DZ), through image display processing is performed based on captured image data read out by a “digital zoom processing subroutine with less image quality degradation” described later.

(Zoom process 2)
FIG. 8A is a flowchart showing optical and digital interlocking zoom processing (2), which is a first processing example of the zoom processing executed in steps S108 and S128. At the start of the processing based on this flowchart, as shown in FIG. 8B, the still image is processed in step S105 in the main routine shown in FIGS.
X _OUT = (WR / 100) · X _d
Y _OUT = (WR / 100) · Y _d
Is set,
For the video, in step S124,
X _OUT = (WR / 100) · X _R
Y _OUT = (WR / 100) · Y _R
Is set.
Furthermore, the following digital zoom limit DZ _MAX is set in the processing of step S106 or step S125.
DZ _MAX = X _F / X _OUT
Or DZ _MAX = Y _F / Y _OUT

In this state, it is determined whether or not there has been a zoom operation (step S301). If there has been a zoom operation, the total zoom magnification Z is converted by the following equation according to the setting of the viewfinder field expansion ratio WR (%) (step S301). S302).
Z = OpZ × DZ ÷ (WR / 100)
(However, OpZ: Optical zoom magnification of the imaging optical system 55)
Therefore, when WR = 100%, Z = OpZ × DZ.

Next, the total zoom magnification (Z) is increased or decreased according to the following equation in accordance with the zoom operation (zoom operation amount) ΔZ for the zoom lever 105 (step S303).
Z = Z ± ΔZ

Then, it is determined whether or not Z <1 (step S304). If the determination in step S304 is YES and the total zoom magnification Z is less than 1, the optical zoom magnification OpZ = OpZ _min and the digital zoom magnification DZ = 1 × (WR / 100) are set (step S305). ).

  Subsequently, optical zoom processing is executed according to the set optical zoom magnification OpZ, and the zoom lens driving unit 33 is controlled to drive the zoom lens (step S306). Further, AF processing is executed at the selected AF frame (an AF frame selected in advance when there are a plurality of AF frames) or the center of the visual field, and the focus lens driving unit 32 is controlled to drive the focus lens (step S307). ). Thereafter, the process proceeds to a digital zoom processing subroutine (described later with less image quality degradation) according to the setting DZ (step S308).

On the other hand, if the determination in step S304 is NO and the total zoom magnification Z is 1 or more, it is determined whether or not Z> DZ _max (step S309). A judgment is NO, i.e., if the total zoom magnification Z is smaller than the optical zoom magnification maximum value Z _max, depending on the increase or decrease of the total zoom magnification Z, with priority digital zoom magnification (DZ) decrease Set OpZ = 1 and OpZ _min , and DZ = (WR / 100) × Z / OpZ _min (step S310), and proceed to step S306.

If the determination in step S309 is YES, DZ = DZ _max and OpZ = (WR / 100) × Z / DZ _max are set to increase or decrease the optical zoom magnification (OpZ) according to the increase or decrease of Z. (Step S311). Then, it is determined whether OpZ set in step S311 is greater than optical zoom magnification maximum _{OpZ max} (step S312), the process proceeds to step S306 if not exceeded. However, if it exceeds, the set optical zoom magnification OpZ is limited to the optical zoom magnification maximum value OpZ _max (step S313), and the process proceeds to step S306.

Therefore, according to the above optical & digital interlocking zoom process (2), the overall zoom magnification (Z) is set to increase or decrease (Z = ± ΔZ) according to the zoom operation, and the total zoom magnification (Z) is increased or decreased. Accordingly, when the total zoom magnification (Z) is within the operation range of the digital zoom magnification (DZ) (1 ≦ Z ≦ DZ _max ), the digital zoom magnification (DZ) is preferentially increased or decreased (OpZ = OpZ _min) , DZ = (WR / 100) × Z / DZ _max ), and OpZ can be increased or decreased within a range of OpZ _{min to} OpZ _max .

Accordingly, as illustrated in FIG. 9, the optical zoom (× 1 to 5 times), the captured full image size (X _F = 2880, Y _F = 2160), the display writing size (X _d = 640, Y _d = 480), (in the case of a moving image, when the recording image size (XR = 640, YR = 480), the illustrated numerical value is obtained.

(Zoom processing (with little image quality degradation))
FIG. 10A is a flowchart showing a digital zoom processing subroutine (small image quality deterioration) executed in steps S208 and S308. First, as shown in the following example, the switching step stage number (integer) i and the initial addition number (integer) m = m _(i) , n = n _(i) are set (step S401).
(Example) Set i = 3, m _(i) = m ₃ , n _(i) = n ₃

Further, the digital zoom magnification (DZ) and the set center position (X _C , Y _C ) are read (step S402). Then, based on the full image size (X _F , Y _F ) of the image sensor and the output image size (X _OUT , Y _OUT ), the addition readings m (i) and n (i) of each stage (the image quality does not deteriorate). ) The limit (switching magnification) DZ _{L (i} ) of the digital zoom magnification DZ is set as follows (step S403).
DZ _{L (i)} = INT {X _F / m _(i) } / X _OUT , or
DZ _{L (i)} = INT {Y _F / n _(i) } / Y _OUT

Therefore, as shown in FIG. 10B, for example, when X _F = 2880, Y _F = 2160, X _OUT = 640, and Y _OUT = 480,
If m ₁ = n ₁ = 1, m ₂ = n ₂ = 2, m ₃ = n ₃ = 3,.
Limit magnification _DZ LI = INT when the addition number _{m l} (2880/1) /640=4.5,
Limit magnification DZ _L2 = INT (2880/2) /640=2.25 when the addition number is m ₂
Limit magnification DZ _L3 = INT (2880/3) /640=1.5 when the addition number is m ₃
Limit magnification DZ _L4 = INT (2880/4) /640=1.125 when the number of addition is m ₄
...

Next, it is determined whether or not the digital zoom magnification (DZ) is “1 ≦ DZ ≦ DZ _{L (i)} ” (step S404). If the determination in step S404 is YES, the addition number is set to m = m _(i) and n = n _(i) (step S405). Therefore, as illustrated in FIG. 10C, when X _F = 2880, Y _F = 2160, X _OUT = 640, and Y _OUT = 480,
When the initial addition number starts from i = 3 and m = n = 3,
When DZ = 1 to 1.5 times, m = n = 3 (3 × 3 addition reading),
When DZ = 1.5-2.25 times, m = n = 2 (2 × 2 addition reading),
When DZ = 2.25 to 4.5 times, m = n = 1 (reading without 1 × 1 addition)
It becomes.

Subsequently, according to the digital zoom magnification (DZ) and the center position (X _C , Y _C ), the image size (X, Y) and readout range (X _{1 to} X ₂ , Y _{I to} Y ₂ ) of the selected readout area are set. Settings are made as follows (step S406).
X = INT (X _F / DZ), Y = INT (Y _F / DZ),
X ₁ = X _C -X / 2, X ₂ = X _C + X / 2,
_{Y 1 = Y C -Y / 2} , Y 2 = Y C tens Y / 2,
However, when X ₁ <0, X ₁ = 0, X ₂ = X,
When Y _I <0, Y ₁ = 0, Y ₂ = Y,
When _{X 2> X F, X 1} = X F -X, X 2 = X F,
When _{Y 2> Y F, Y 1} = Y F -Y, Y 2 = Y F

Therefore, as shown in FIG. 10D, for example, when X _F = 2880, Y _F = 2160, and DZ = 1.2 times,
X = INT (X _F /DZ)=(2880/1.2)=2400
Y = INT (Y _F /DZ)=(2160/1.2)=1800
It becomes.
Next, image signals in the readout range (X _{1 to} X ₂ , Y _{1 to} Y ₂ ) are read from the image sensor by adding (or without addition) according to the addition number (m, n), and the image size (X ′ , Y ′) = (X / m, Y / n) image signal is read into the DSP unit 63 (step S407). Then, the image data of the size (X ′, Y ′) is output (step S408).

Therefore, as shown in FIG. 10 (e), for example, when DZ = 1.2 times and the addition number m = 3 and n = 3,
X ′ = X / m = (2400/3) = 800
Y ′ = Y / n = (1800/3) = 600
Thus, a (3 × 3) addition image of 800 × 600 pixels is obtained.

  On the other hand, if the determination in step S404 is NO, the value of “i” is decremented (step S409), and it is determined whether the decremented value of “i” is equal to or greater than “1” (step S409). Step S410). While i ≧ 1, and while the decremented “i” is a positive value, the process returns from step S410 to step S403. Then, the value of “i” that has been decremented is substituted, and the process of step S403 is executed. If the determination in step S404 is YES, the process after step S405 described above is executed.

  However, if the value of “i” becomes “0” due to the decrement in step S409, the determination in step S410 is NO. In this case, the digital zoom is terminated or error processing is performed (step S411). Then, the minimum value “1” of the addition number is set to m and n, and the processes after step S406 described above are executed.

(Image sensor)
In the case where the image pickup device 56 is constituted by a CCD image sensor, for example, signal charges generated in the photodiode by incident light are not amplified but are transferred in order through the vertical and horizontal CCD transfer paths, and output circuit. For the first time, the signal voltage is amplified by a FD (Floating Diffusion) amplifier and output. The image pickup signal output from the CCD is subjected to noise removal and sample & hold processing by a CDS circuit (correlated double sampling circuit), amplified by an AGC (automatic gain control) amplifier, and digitally imaged by an ADC (A / D converter). It is converted into a signal and output to a DSP (signal processing circuit).

  On the other hand, in the case where the image sensor is composed of a CMOS (complementary metal monoxide semiconductor) image sensor, a typical APS (amplified pixel sensor) type CMOS sensor as shown in FIG. Each unit pixel circuit including an amplifying element (amplifier) includes a signal charge photoelectrically converted by a photodiode, which is once amplified by an amplifier in the pixel circuit, from a row address selection signal from a vertical scanning circuit and a horizontal scanning circuit. The image pickup signal for each pixel selected by the XY address method by the column selection signal can be sequentially extracted from the output as voltage or current. Even if it is not taken out sequentially like a CCD, the CMOS sensor can take out only the image signals of any pixel or area in any order. Can be read.

  In CCD, signal charges are transferred as they are, so they are vulnerable to smear and noise. However, in CMOS sensors, each pixel is read out by random access, and each pixel circuit is electrically separated, so it is resistant to transmission noise. Similar to a CMOS LSI or the like, there is an advantage that digital logic circuits such as various CMOS circuits and addition arithmetic circuits are highly integrated around the image sensor portion in the same manufacturing process and can be relatively easily formed together. On the other hand, in CMOS sensors, fixed pattern noise (FPN), dark current, and KTC noise due to variations in individual elements, such as the dark value of the amplifier for each pixel, were difficult, but embedded photodiodes (similar to CCD) As a result, the dark current and the KTC noise can be reduced, and the photodiode is reset by a column type CDS / ADC circuit provided in a column circuit arranged in parallel for each column signal line. Fixed pattern noise can be removed by subtracting the front and back signals, and integration signals, cyclic types, and sequential type AD converters are built into each column circuit, making it easy to output imaging signals as digital signals. became.

  In the image sensor used in the digital camera 100 according to the present embodiment, the image sensor 200 shown in FIG. 11 is selected so that an image area of an arbitrary size can be selected and an image signal of pixels in the area can be read out. It is preferable to use it. That is, the imaging device 200 includes a vertical scanning circuit 202, a horizontal scanning circuit 203, and a column circuit unit 204 connected to the timing generation circuit 201, and also includes a parallel / serial conversion unit 204 and an encoder 205. The column circuit unit 204 includes a plurality of circuits each including a CDS circuit 206, an A / D conversion circuit 207, and a pixel addition circuit 208, and each column signal line 209 is connected to the column circuit unit 204. On the other hand, to the vertical scanning circuit 202, a row selection line (address line) 210, a transfer TC line (row readout line) 211, and a row reset line 212 are connected. The image sensor unit 213 is provided with a plurality of unit pixel circuits 214, and each unit pixel circuit 214 includes the column signal line 209, a row selection line (address line) 210, a transfer TC line (row readout line). ) 211, a photodiode 215 connected to the row reset line 212, and the like.

  Therefore, in the imaging device 200, the pixel addition circuit 208 that adds the signals of a plurality of pixels of the same color (filter) adjacent to the subsequent stage of the CDS circuit 206 and the A / D circuit 207 of the column circuit unit 204 as a digital signal is provided. By providing it, it is configured to be able to read out the image signal obtained by adding the pixel data in the selection area for a predetermined number of pixels for each arbitrary matrix during digital zooming, and image data can be obtained even at a high rate in through image and video shooting. It can be converted into an image signal with a small amount and output.

  The picked-up image signals of the selected area and the image signals added with the pixels are the column signals selected from the CDS circuit 206 of the column circuit unit 204 and the column selection signal of the horizontal scanning circuit 202 from the A / D circuit 207. Are output in sequence, but at this time, it is output as a parallel digital signal in synchronization with a high-speed clock, or the parallel digital signal is encoded and converted by a parallel / serial conversion circuit to obtain a serial digital imaging signal. The high-resolution imaging signal can be transferred and output to the DSP at a high frame rate.

(DSP part)
When the image pickup device 56 is a CMOS image sensor, noise removal and digital conversion are performed by a CDS / ADC circuit built in the CMOS sensor, and an image pickup signal transferred in parallel or in series from the built-in high-speed output circuit is input. The DSP unit 63 first performs white balance adjustment and color balance adjustment, and is provided on the front surface of the image sensor 56. The DSP unit 63 has a mosaic “Bayer arrangement” or a horizontal / vertical repeat cycle of two pixels. According to the color filter array such as RGB primary color filters such as the green checkered R / B color difference line sequential method arranged in a staggered pattern, each pixel has only one color component, but the pixel values of the other color difference components are also neighboring pixels. Pixel interpolation (Pixel Signal Interpolation) is obtained from the value (color interpolation processing). ), It is converted into digital image data having a gradation value of the RGB chrominance each component for each pixel.

  Also, before color interpolation, a resolution conversion process (Resolution Conversion) for converting the captured image size to a different image size may be performed by a resizing / interpolating circuit as necessary. For example, resizing (Resize) for converting to a predetermined image size (such as VGA size) in order to write a through image or a reproduced image in a video RAM or a display RAM area in a display driver for display on a viewfinder or an image monitor. Alternatively, interpolation processing (interpolation) is performed. Alternatively, at the time of shooting and recording, in order to record at a desired recording image size, reduction / enlargement processing, resizing / interpolation processing, or resolution conversion processing is performed on the image of the set recording image size. When resizing or interpolation processing is performed, the image is likely to be blurred or the resolution is likely to deteriorate. It is preferable. Further, in the DSP unit 63, the RGB digital image signal whose tone has been corrected by the gamma correction circuit is temporarily stored in the buffer memory and then reproduced and displayed on an electronic viewfinder such as an LCD monitor, or the RGB matrix image is displayed by a color matrix circuit. Is converted into an image signal of a predetermined color space such as a YUV system / YCbCr system, and JPEG still image data, MPEG4, H.264, etc. H.264 moving image data or the like is compressed / encoded.

(Wide-angle zoom lens)
When the number of pixels is reduced, thinning and compression interpolation are performed, so the shooting angle of view does not change, but in the case of a wide finder, a small range of angle of view is cut out. In the case of a zoom lens, since the range of the field angle that can be photographed becomes narrow, it is difficult to perform wide-angle photographing, and there is a problem that the zoom system becomes biased toward the telephoto side. For this reason, assuming that the range of the field-of-view expansion rate of the finder display that is normally used is 125 to 200%, the zoom is slightly shifted to the wide-angle side about 1 / 1.25 to 1/2 of the normal range. By combining with a lens system, the above problem can be solved.

  FIG. 12 shows a relationship between a configuration example of the zoom lens system, an optical zoom magnification, and a field expansion rate. If the field-of-view ratio WR is about 125%, for example, in a 5 × optical zoom system of a ½ type image sensor, a normal focal length is 6.2 to 32 mm (about 35 to 175 mm in terms of 35 mm film). ), The zoom lens has a focal length at the W end of 6.2 mm / (141/100) = 4.4 mm or less, that is, a focal length of 4.4 to 22 mm (about 24.8 to 124 mm in terms of 35 mm film). Set to the system.

  At this time, instead of the actual focal length, a display control means for calculating the shooting angle of view (angle) or the focal length in terms of 35 mm film and displaying it on the display unit 79 may be provided.

  In addition, the normal zoom lens operation range is moved within the range slightly closer to the telephoto side.In the wide viewfinder, conversely, the zoom lens operation range is shifted toward the wide-angle side according to the viewfinder field expansion rate. Control means for controlling the operation may be provided. Even when the wide viewfinder is used, the zoom focal length or optical zoom magnification is automatically set according to the viewfinder field expansion ratio so that the shooting range (viewing angle) is substantially equivalent to that in normal times. Setting means may be provided.

  Thus, an appropriate optical zoom magnification can be set according to the viewfinder field expansion rate.

(Other embodiments)
In the present embodiment, the through image is displayed on the display unit 79 on a single screen. You may make it display a through image with the display form shown in FIG.13 and FIG.14. That is, in the display form of FIG. 13, as shown in (a), the focus selection display of the through image is performed on the display unit 79, the focus position is selected, and the through image or captured image data shown in (b) is displayed. The size of the display image shown in (c) is cut out from the size, and a predetermined range centered on the focus position is cut out and enlarged. Then, as shown in (d), the cut-out display image is displayed as a through image, and is superimposed on the display image, and enlarged display for focus confirmation is performed by enlarged display of the focus position. Therefore, it is possible to accurately confirm whether or not the user is in focus by visually recognizing the enlarged display for focus confirmation.

  Further, as shown in FIG. 14A, the center of the image is displayed on a separate screen with a plurality of magnifications without requiring the user to select a focus position, or as shown in FIG. The subject person may be recognized and the recognized subject person portion may be superimposed and displayed.

2 control circuit 22 operation input unit 23 program memory 24 data memory 25 image memory medium 33 zoom lens driving unit 34 driving unit 35 shutter driving unit 46 HDD storage device 47 disk medium 55 imaging optical system 56 imaging element 58 shutter 59 image sensor unit 60 Horizontal scanning unit 61 Vertical scanning unit 62 P / S conversion unit 63 DSP
65 Buffer memory 67 Resize / pixel interpolation unit 68 Color interpolation unit 75 Buffer memory 76 Image CODEC
77 Movie CODEC
78 Display drive circuit 79 Display unit 100 Digital camera 105 Zoom lever 106 Shooting mode dial 109 OK key 200 Image sensor

Claims (5)

An imaging apparatus comprising: an imaging unit that images a subject and outputs image data; a display unit that displays image data; and a recording unit that records image data.
First image data having a first image size smaller than the third image size is acquired from third image data having a third image size captured by the imaging unit, and the acquired first The second image data having a second image size smaller than the first image size is acquired from the image data captured by the imaging unit. Control means for recording the acquired second image data in the recording means;
An expansion rate setting means for setting a value of a visual field expansion rate , which is a ratio between the first image size and the second image size, to a direct and arbitrary value according to a user operation ;
Size determining means for determining the first image size and the second image size so as to be the visual field expansion ratio set by the expansion ratio setting means;
Zoom magnification setting means for setting the zoom magnification to an arbitrary value according to a user operation;
Recording size setting means for setting the second image size to an arbitrary value in accordance with a user operation;
With
The control means displays the second image size in an identifiable state when displaying the first image data as a through image on the display means.
The size determining unit is responsive to a zoom magnification set by the zoom magnification setting unit, a visual field expansion rate set by the expansion rate setting unit, and a change in the second image size set by the recording size setting unit. An image pickup apparatus characterized by automatically changing the first image size . The imaging apparatus according to claim 1 , wherein the expansion rate setting means sets the visual field expansion rate to be variable in a range from 100% to a predetermined value exceeding 100%. Wherein, when displaying on said display means said first image data as a through image, claim 1, characterized in that to display a numerical value indicating the set field expansion rate to the desired value or 2. The imaging device according to 2 . A display control method for an imaging apparatus, comprising: an imaging unit that images a subject and outputs image data; a display unit that displays image data; and a recording unit that records image data.
First image data having a first image size smaller than the third image size is acquired from third image data having a third image size captured by the imaging unit, and the acquired first The second image data having a second image size smaller than the first image size is acquired from the image data captured by the imaging unit. A control step of recording the acquired second image data in the recording means;
An expansion rate setting step for setting a value of a visual field expansion rate , which is a ratio between the first image size and the second image size, directly and arbitrarily according to a user operation ;
A size determination step for determining the first image size and the second image size so as to be the visual field expansion rate set by the expansion rate setting step;
A zoom magnification setting step for setting the zoom magnification to an arbitrary value;
A recording size setting step of setting the second image size to an arbitrary value in accordance with a user operation;
Including
The control step displays the second image size in an identifiable state when displaying the first image data as a through image on the display means.
The size determining step corresponds to a zoom magnification set by the zoom magnification setting step, a visual field expansion rate set by the expansion rate setting step, and a change in the second image size set by the recording size setting means. A display control method for an imaging apparatus , wherein the first image size is automatically changed . A computer included in an imaging apparatus including an imaging unit that images a subject and outputs image data, a display unit that displays the image data, and a recording unit that records the image data.
First image data having a first image size smaller than the third image size is acquired from third image data having a third image size captured by the imaging unit, and the acquired first The second image data having a second image size smaller than the first image size is acquired from the image data captured by the imaging unit. Control means for recording the acquired second image data in the recording means;
An expansion rate setting means for setting a value of a visual field expansion rate , which is a ratio between the first image size and the second image size, to a direct and arbitrary value according to a user operation ;
Size determining means for determining the first image size and the second image size so as to be the visual field expansion ratio set by the expansion ratio setting means;
Zoom magnification setting means for setting the zoom magnification to an arbitrary value;
Recording size setting means for setting the second image size to an arbitrary value in accordance with a user operation;
To function,
The control means displays the second image size in an identifiable state when displaying the first image data as a through image on the display means.
The size determining unit is responsive to a zoom magnification set by the zoom magnification setting unit, a visual field expansion rate set by the expansion rate setting unit, and a change in the second image size set by the recording size setting unit. A display control program for automatically changing the first image size .

Images