JP2024061309A - Image processing device, imaging device, image processing method, imaging method, program, and recording medium - Google Patents

Abstract

[Problem] To provide an imaging method that switches functions without changing the angle of view, making it possible to obtain an image with the angle of view intended by the user. [Solution] The image processing device according to the present invention is characterized by having a determination means for determining the angle of view, and a synthesis means for selecting one of a plurality of predetermined synthesis methods based on the angle of view determined by the determination means, synthesizing a plurality of images, and generating a synthetic image. [Selected Figure] Figure 5

Description

The present invention relates to an image processing device, and in particular to an image processing device that displays and synthesizes an angle of view.

In recent years, technology has been put into practical use in image processing devices such as digital cameras that automatically perform processes such as compositing on images to automatically generate images with better image quality.

However, it often happens that the angle of view of the images changes after compositing. For example, the technology described in Patent Document 1 discloses that in compositing to deepen the depth of field, known as depth compositing, the angle of view of the composite image becomes narrower than that of the images used in compositing.

In addition, even with HDR (high dynamic range) compositing technology, the angle of view of the composite image may become narrower due to alignment.

As described above, in an image processing device that performs compositing, the angle of view of the composite image becomes narrower than that of the image before compositing. For users who use the live view function, the angle of view of the composite image becomes narrower than the angle of view during framing, and they may not be able to capture the image they intended.

Patent document 2 discloses a technology that changes the angle of view by a fixed amount over a given period of time.

JP 2020-96317 A JP 2016-72663 A

However, while the method disclosed in Patent Document 2 can make the change in the angle of view more gradual, it does not solve the problem of the angle of view becoming narrower after synthesis.

The present invention was made in consideration of the above-mentioned problems, and aims to provide an image processing device in which the synthesis method is determined based on the set display angle of view.

The present invention provides an image processing device that includes a determination means for determining an angle of view, and a synthesis means for selecting one of a plurality of predetermined synthesis methods based on the angle of view determined by the determination means, synthesizing a plurality of images using the selected synthesis method, and generating a synthetic image.

According to the configuration of the present invention, in an image processing device that performs automatic compositing, the compositing method can be limited by the set display angle of view.

FIG. 1 is a block diagram illustrating a hardware configuration of a digital camera according to an embodiment of the present invention. 11A and 11B are diagrams for explaining a display image on a display unit when a focus stacking image is live-viewed in an embodiment of the present invention. FIG. 2 is a diagram for explaining zooming of an image captured by a digital camera. 10 is a flowchart illustrating an example of scene determination in an embodiment of the present invention. 11A and 11B are diagrams for explaining display of a saved angle of view in an embodiment of the present invention.

The following describes in detail a preferred embodiment of the present invention with reference to the accompanying drawings.

Note that the following embodiments do not limit the scope of the invention as claimed, and not all of the combinations of features described in the embodiments are necessarily essential to the solution of the present invention.

1 is a block diagram for explaining the hardware configuration of a digital camera in this embodiment. In FIG. 1, the digital camera 100 has an imaging system including a shutter 101, a barrier 102, a focus lens 103, and an imaging unit 22. The shutter 101 is a shutter with an aperture function. The barrier 102 covers the imaging system of the digital camera 100 to prevent the imaging system from becoming dirty or damaged. The focus lens 103 is a lens included in a lens group (not shown) arranged between the shutter 101 and the barrier 102. Note that the lens group described above also includes other lenses such as a zoom lens. The imaging unit 22 has an imaging element composed of a CCD or CMOS element that converts an optical image into an electrical signal, and an A/D conversion processing function. The output data (captured image) of the imaging unit 22 is written to the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. During focus bracketing imaging described later, all of the captured images up to the set number are written to the memory 32.

The digital camera 100 further includes an AF evaluation value detection unit 23, a strobe 90, an image processing unit 24, a depth stacking unit 25, a motion detection unit 26, a state detection unit 27, a memory 32, a D/A converter 13, a display unit 28, a non-volatile memory 56, a system control unit 50, a system memory 52, and a system timer 53. The AF evaluation value detection unit 23 is located inside the imaging unit 22 and calculates an AF evaluation value from contrast information obtained from a digital image signal, and outputs the obtained AF evaluation value from the imaging unit 22 to the system control unit 50. The strobe 90 can compensate for illuminance when imaging in a low-illumination scene or a backlit scene by emitting light during imaging. The image processing unit 24 performs resizing processing such as predetermined pixel interpolation and reduction and color conversion processing on the image data output from the imaging unit 22 or the image data from the memory control unit 15. In addition, the image processing unit 24 performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. This allows TTL (through-the-lens) AE (automatic exposure) processing and EF (automatic flash light emission) processing to be performed. The image processing unit 24 also performs AF (autofocus) processing, and the output of the AF evaluation value detection unit 23 provided in the imaging unit 22 may be used at this time. The image processing unit 24 also performs a predetermined calculation process using the captured image data, and performs TTL AWB (auto white balance) processing based on the obtained calculation results.

The depth stacking unit 25 uses multiple captured images obtained by focus bracketing imaging in the imaging unit 22 to generate an image with an extended depth of field by outputting pixels that are in focus in each image. Details will be described later.

The motion detection unit 26 uses two pieces of image data to perform template matching processing between the area of interest and its surroundings, and calculates a motion vector for each area into which the image is divided, or for each pixel. If the calculated motion vector is equal to or greater than a threshold, it detects that there is motion in the subject, and notifies the system control unit 50. The status detection unit 27 detects the status of the digital camera 100, such as the angular velocity from the gyro sensor, the attachment/detachment status of the tripod, and the settings made by the user via the operation unit 70. The detection results are notified to the system control unit 50.

The memory 32 stores image data acquired and A/D converted by the imaging unit 22, and image data to be displayed on the display unit 28. The memory 32 has a storage capacity sufficient to store a predetermined number of still images, a predetermined period of moving images, and sound. The memory 32 also serves as a memory for displaying images (video memory). The D/A converter 13 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28. In this way, the image data for display written in the memory 32 is displayed by the display unit 28 via the D/A converter 13. The display unit 28 performs display according to the analog signal from the D/A converter 13 on a display such as an LCD. The digital signal once A/D converted by the imaging unit 22 and stored in the memory 32 is converted to analog by the D/A converter 13, and is sequentially transferred to the display unit 28 for display, thereby functioning as an electronic viewfinder and performing through image display (hereinafter referred to as live view). The non-volatile memory 56 is an electrically erasable and recordable memory, and for example, a flash memory or the like is used. The non-volatile memory 56 stores constants, programs, etc. for the operation of the system control unit 50. The programs referred to here are programs for executing various flowcharts described later in the first and second embodiments.

The system control unit 50 controls the entire digital camera 100. Specifically, by executing the program recorded in the non-volatile memory 56 described above, focus bracketing imaging based on subject information, subject distance, and image contrast information is realized. That is, during this imaging, the system control unit 50 controls the drive of the focus lens 103 and the shutter 101, so that multiple images with different focus positions are captured sequentially. The amount of change in focus position (focus step) between adjacent captured images obtained by this imaging process is set from a value calculated by the system control unit 50.

The system memory 52 is composed of RAM etc., and expands constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, etc. The system control unit also performs display control by controlling the memory 32, D/A converter 13, display unit 28 etc. The system timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock.

The digital camera 100 also includes an operating unit for inputting various operation instructions to the system control unit 50, which is composed of a mode changeover switch 60, a shutter button 61, a first shutter switch 64, a second shutter switch 62, an operation unit 70, and a power switch 72. The mode changeover switch 60 switches the operation mode of the system control unit 50 to one of a still image recording mode, a video recording mode, a playback mode, etc. Modes included in the still image recording mode include an auto imaging mode, an auto scene discrimination mode, a manual mode, various scene modes in which the imaging settings are made for each imaging scene, a program AE mode, a custom mode, etc. The mode changeover switch 60 directly switches to one of these modes included in the still image imaging mode. Alternatively, after switching to the still image imaging mode once with the mode changeover switch 60, it may be possible to switch to one of these modes included in the still image imaging mode using other operating members. Similarly, the video imaging mode may also include multiple modes. The shutter button 61 is an operating unit for issuing imaging instructions. The first shutter switch 64 is turned on by half-pressing the shutter button 61 during its operation, and generates a first shutter switch signal SW1. The first shutter switch signal SW1 starts operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (auto flash light control) processing. That is, under the control of the system control unit 50, parameters for imaging are acquired. The user can select center one-point AF processing or face AF processing as the AF processing to be started upon receiving the signal SW1. Here, center one-point AF processing refers to processing to perform AF on one point at the center position in the imaging screen, and face AF processing refers to processing to perform AF on a face in the imaging screen detected by the face detection function. The second shutter switch 62 is turned ON when the shutter button 61 is operated, that is, fully pressed (imaging instruction), and generates a second shutter switch signal SW2. The system control unit 50 starts a series of imaging processing operations from reading a signal from the imaging unit 22 to writing image data to the recording medium 200 by the second shutter switch signal SW2. Each operating member of the operating unit 70 is assigned a function appropriate for each situation by selecting and operating various functional icons displayed on the display unit 28, and acts as various function buttons. Examples of function buttons include an end button, a back button, an image forward button, a jump button, a filter button, and an attribute change button. For example, when the menu button is pressed, a menu screen in which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the four directional buttons (up, down, left, and right), and the SET button. The power switch 72 switches the power of the digital camera 100 on and off.

The digital camera 100 further comprises a power supply control unit 80, a power supply unit 40, and a recording medium I/F 18. The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to be energized, and the like, and detects whether a battery is attached, the type of battery, and the remaining battery power. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the necessary voltage to each unit including the recording medium 200 for the necessary period. The power supply unit 40 is composed of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and Li batteries, and an AC adapter. The recording medium I/F 18 is an interface with the recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, and the like.

Next, we will explain focus bracketing imaging for depth stacking, which is one of the synthesis functions in this embodiment.

FIG. 2 is a diagram for explaining a display image on the display unit when a depth stacking image in this embodiment is live-viewed. Position 201 is the close-side focus position of focus bracketing imaging indicated by an AF frame, position 202 is the infinity-side focus position, and position 203 is the subject (insect). The AF frame indicating the close-side focus position 201 and the subject 203 are displayed on the display unit 28. The user operates the operation unit 70 to specify a reference focus position on the image displayed on the display unit 28. Alternatively, the reference focus position may be automatically specified for the subject detected by the AF evaluation value detection unit 23. In FIG. 2, the closest location of the subject 203 is specified as the reference focus position. As a result, the system control unit 50 recognizes the specified reference focus position as the close-side focus position 201 of focus bracketing imaging and displays the AF frame at that location. Once the closest focus position 201 is determined, the focus position where focus bracketing imaging ends, i.e., the infinity focus position 202, is determined in the Z-axis direction (depth direction) based on the focus interval according to the focus step setting and the number of images captured to generate one depth composite image. In FIG. 2, the entire subject 203 is assumed to fall within the focus range indicated by the closest focus position 201 to the infinity focus position 202. Also, the number of images captured to generate one depth composite image is illustrated as 10, and the depth stacking unit 25 performs depth stacking processing using 10 captured images.

Next, we'll explain an example of the depth stacking process.

First, the image processing unit 24 performs position alignment on the image to be subjected to depth stacking. The image processing unit 24 sets a plurality of blocks in a reference image, which is one of the plurality of images to be subjected to depth stacking. It is preferable that the image processing unit 24 sets the size of each block to be the same. Next, the image processing unit 24 sets a search range in the image to be subjected to position alignment, which is wider than the block of the reference image, at the same position as each block of the reference image. Finally, the image processing unit 24 calculates a corresponding point in each search range of the target image, which has a minimum sum of absolute difference (SAD) in brightness with the block of the reference image. The image processing unit 24 calculates the positional deviation as a vector from the center of the block of the reference image and the corresponding point described above. In calculating the corresponding points described above, the image processing unit 241 may use, in addition to SAD, the sum of squared differences (hereinafter referred to as SSD) or normalized cross correlation (hereinafter referred to as NCC), etc.

Next, the image processing unit 24 calculates a conversion coefficient from the amount of positional deviation between the reference image and the target image. The image processing unit 24 uses, for example, a projection transformation coefficient as the conversion coefficient. However, the conversion coefficient is not limited to the projection transformation coefficient, and an affine transformation coefficient or a simplified conversion coefficient that only includes a horizontal and vertical shift may be used.

For example, the image processing unit 24 can perform the transformation using the formula shown in (Formula 1).

（式１）では、（ｘ´，ｙ´）は変形を行った後の座標を示し、（ｘ，ｙ）は変形を行う前の座標を示す。行列Ａは変形係数を示す。

In (Equation 1), (x', y') indicates the coordinates after transformation, and (x, y) indicates the coordinates before transformation. Matrix A indicates the transformation coefficients.

After alignment, the depth stacking unit 25 calculates a contrast value for the image after alignment.

As an example of a method for calculating the contrast value, for example, first, a luminance Y is calculated from the color signals Sr, Sg, and Sb of each pixel using the following (Equation 2).
Y = 0.299Sr + 0.587Sg + 0.114Sb ... (Equation 2)
Next, a contrast value I is calculated for a matrix L of luminance Y of 3×3 pixels using a Sobel filter as shown in the following (Equation 3) to (Equation 5).

The above-mentioned method of calculating the contrast value is merely one example. For example, it is also possible to use an edge detection filter such as a Laplacian filter or a bandpass filter that passes through a specified band.

Next, the depth stacking unit 25 generates a synthesis map. To generate the synthesis map, the depth stacking unit 25 compares the contrast values of pixels at the same position in each image and calculates a synthesis ratio according to the magnitude of the contrast value.

An example of a specific calculation method is shown below.

The depth stacking unit 25 generates a synthesis map Am(x,y) using the contrast value Cm(x,y). Here, m is the mth image among multiple images with different focus positions, x is the horizontal coordinate of the image, and y is the vertical coordinate. To generate the synthesis map, the depth stacking unit 25 compares the contrast values of pixels at the same position in each image and calculates a synthesis ratio according to the magnitude of the contrast value. Specifically, among the images at the same position, a synthesis ratio of 100% is assigned to the pixel with the largest contrast value, and a synthesis ratio of 0% is assigned to other pixels at the same position. In other words, the following (Equation 6) holds.

However, the blending ratio must be adjusted appropriately so that the boundaries do not look unnatural. As a result, the blending ratio of the blending map for one image is not a binary ratio of 0% and 100%, but rather changes continuously. The blending ratio after adjustment is Bm(x, y).

The depth stacking unit 257 generates an all-focus image O(x, y) by synthesizing the captured images according to the calculated synthesis map. If the captured original image is Im(x, y), the image is generated by the following (Equation 7).

The above is an explanation of one example of the depth stacking process.

Next, we will explain the flow of the synthesis process in this embodiment.

Figure 3 is a flowchart explaining the composition process in this embodiment. The flowchart shown in Figure 3 shows that when the digital camera 100 captures an image, it identifies selectable functions based on the determined angle of view, and executes one of the selectable functions. Examples of selectable functions include normal imaging, HDR composition imaging, and depth composition imaging.

In step 301, the system control unit 50 determines the angle of view based on the user's operation on the operation unit 70. The user sets, for example, 100%, 80%, 70%, or 60% of the entire screen as the angle of view of the image that the user wants to save. In other words, for example, if the user sets it to 60%, this means that the angle of view of the composite image that the user ultimately wants to save will be 60% of the angle of view of the image viewed in live view.

The following are some examples of ways that a user can set the angle of view:

For example, multiple options for the saved angle of view may be provided in advance in the non-volatile memory 56, and the user may select one. In this case, the angle of view that maximizes the number of switchable functions in step S302, or the angle of view that minimizes the number of processes that are not performed in step S303 may be provided as a default value.

The display unit 28 may specify the saved area by the saved angle display means and the user's operation of the operation unit 70. FIG. 5 is a diagram for explaining the display of the saved angle of view in this embodiment. There may be a plurality of display formats such as image 501, image 503, or image 505. Area 502 in image 501 represents the saved angle of view boundary. Areas 504 and 506 in images 503 and 505 indicate areas that are not saved, with area 504 being semi-transparent and area 506 being covered with black. The display format may be selected and switched to a format that does not interfere with the user's framing. Regarding the method of determining the angle of view, for example, in the case of image 501, when the display means has a display means that sets the inside of the frame as the saved angle of view, the user may specify the angle by performing a pinch operation via the touch panel to enlarge or reduce the size of the frame. Also, the enlargement and reduction functions may be assigned to various buttons.

In step S302, the system control unit 50 identifies a switchable function based on the angle of view determined in step S301. The switchable functions include, but are not limited to, the normal imaging, HDR composite imaging, and depth stacking imaging described above.

In step 302, the system control unit 50 determines that a switchable function is a function that can satisfy the angle of view determined by the system control unit 50 in step S301 for the storable area in the overlapping area when the target images captured by the imaging unit 22 are aligned. In addition, with regard to the depth stacking function, the wider the saved angle of view determined by the system control unit 50 in step S301, the stronger the constraints on alignment accuracy, in that compositing is only possible when the deviation of the compositing target images from the alignment reference image is small. In other words, depth stacking has the characteristic that the depth of field tends to become shallower as the number of images combined decreases. As an example of this embodiment, the switchable function determination may be made as shown in Table 1 below.

In the case of strong constraints in Table 1, synthesis is possible only when the alignment accuracy is good (the amount of misalignment is small), so the depth of field of the synthesized image is shallower. In the case of weak constraints, synthesis is possible even when the alignment accuracy is poor (the amount of misalignment is large), so the depth of field of the synthesized image is deeper.

In step S303, the system control unit 50 performs scene determination on images for live view captured by the imaging unit 22. Details of scene determination will be described later.

In step S304, the system control unit 50 determines which of the switchable functions identified in step S302 will actually be implemented in step S307 (described later). When the system control unit 50 determines the function in step S304, the determination may be based on the result of the scene determination in step S303, or on the user's operation on the operation unit 70, or on both.

In step S305, if the system control unit 50 detects a change in the evaluation value relating to the output result of the AF evaluation value detection unit 23, the motion detection unit 26, or the state detection unit 27 during live view that is greater than a predetermined threshold, the flow returns to step S302. If not, the flow proceeds to step S306.

In step S306, the system control unit 50 receives the signal SW2 from the second shutter switch 62 and switches to the still image recording mode.

In step S307, the system control unit 50 performs the function selected by the system control unit 50 in step S304 from among the functions included in the still image recording mode. If the system control unit 50 selects, for example, the aforementioned focus stacking in step S307, the selected function is performed.

Next, an example of scene determination in step S303 will be described in detail.

Figure 4 is a flowchart that explains an example of scene determination in this embodiment. The following explanation is merely an example for implementing this embodiment.

In step S401, the system control unit 50 performs moving object detection. If the system control unit 50 detects a moving object, the flow proceeds to step S408, and switches to normal imaging in step S304. If the system control unit 50 does not detect a moving object, the flow proceeds to step S402, and performs a brightness determination. In step S402, the system control unit 50 compares the brightness of the image with a brightness threshold. If the brightness of the image is less than the threshold, the flow proceeds to step S405, and switches to HDR imaging in step S304. If the brightness of the image is equal to or greater than the threshold, the flow proceeds to step S403. In step S403, the system control unit 50 determines whether the image was captured with a macro lens. If the image was captured with a macro lens, the flow proceeds to step S407, and the system control unit 50 switches to imaging for depth stacking in step S304. If the image was not captured with a macro lens, the flow proceeds to step S404. In step S404, the system control unit 50 compares the brightness difference of the image with a brightness difference threshold. If the contrast between the images is less than the threshold, the flow proceeds to step S406, and the system control unit 50 switches to normal imaging in step S304. If the contrast between the images is greater than or equal to the threshold, the system control unit 50 switches to HDR imaging in step S304.

The above scene determination flow is merely an example, and various modifications can be applied. In addition, in the above scene determination, it is also possible to restrict switching in step S304 by setting a specific function as a non-switchable function by user settings, etc. For example, in the case of the flow shown in FIG. 4, if depth stacking is non-switchable, in the scene determination of step S303, in the flow transitioning from step S402 to step S403, the determination of step S403 is not performed, and the process transitions to step S404. As another example, if HDR imaging is non-switchable, in the scene determination of step S303, in the flow transitioning from step S401 to step S402, the determination of step S402 is not performed, and the process transitions to step S403. In addition, in the flow transitioning from step S403 to step S404, the determination of step S404 is not performed, and the process transitions to step S406. However, the above description is merely an example, and various modifications can be applied in design.

The above description is merely an example for implementing this embodiment, and various modifications can be applied. For example, the angle of view in step S301 can be determined based on the function that the user wants to execute. In other words, the user can select the functions that he or she wants to enable in advance. At this time, the angle of view at which all the functions selected by the user are determined to be switchable is set as the angle of view determined in step S301. For example, using Table 1, if the user selects to enable HDR compositing and depth compositing (constrained), the saved angle of view is determined to be 70%. Similarly, a configuration may be adopted in which functions to be disabled can also be selected. In this case, step S302 does not need to be performed in the flow shown in FIG. 3.

According to this embodiment, an imaging method is selected according to the determined angle of view, and ultimately, an image having the determined angle of view can be obtained.

Other Embodiments
The above embodiment has been described based on the implementation in a digital camera, but the present invention is not limited to a digital camera. For example, the present invention may be implemented in a mobile device with a built-in image sensor, or in a network camera capable of capturing images.

The present invention can also be realized by supplying a program that realizes one or more of the functions of the above-mentioned embodiments to a system or device via a network or storage medium, and having one or more processors in the computer of the system or device read and run the program. It can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions.

100 Digital camera 101 Shutter 102 Barrier 103 Focus lens 13 D/A converter 15 Memory control unit 18 Recording medium I/F
22 Imaging section 23 AF evaluation value detection section 24 Image processing section 25 Depth stacking section 26 Motion detection section 27 Status detection section 28 Display section 32 Memory 40 Power supply section 50 System control section 52 System memory 53 System timer 56 Non-volatile memory 60 Mode changeover switch 61 Shutter button 62 Second shutter switch 64 First shutter switch 70 Operation section 72 Power switch 80 Power supply control section 90 Strobe 200 Recording medium

Claims (26)

A determination means for determining an angle of view;
a synthesis means for selecting one of a plurality of predetermined synthesis methods based on the angle of view determined by the determination means, and performing synthesis on a plurality of images to generate a synthetic image. The image processing device according to claim 1, characterized in that the synthesis means selects one of the plurality of synthesis methods so that the angle of view of the synthesized image becomes the angle of view determined by the determination means. The image processing device according to claim 1 or 2, characterized in that the multiple synthesis methods include at least one of HDR synthesis and depth synthesis. A determination means for performing scene determination,
3. The image processing apparatus according to claim 1, wherein the combining means selects one of the plurality of combining methods based on a result of the scene determination. The image processing device according to claim 4, characterized in that the synthesis means determines whether or not to perform the synthesis based on the result of the scene determination. When the synthesis means does not perform the synthesis,
6. The image processing apparatus according to claim 5, wherein the angle of view of at least one of the plurality of images is the same as the angle of view determined by the determination means. The image processing device according to claim 4, characterized in that the determination means performs moving object detection in the scene determination. The image processing device according to claim 4, characterized in that the determination means detects luminance in the scene determination. The image processing device according to claim 4, characterized in that the determination means detects brightness and darkness in the scene determination. The image processing device according to claim 4, characterized in that the determination means detects whether a macro lens is attached in the scene determination. The image processing device according to claim 1 or 2, characterized in that the compositing means identifies selectable compositing methods from among the plurality of compositing methods based on the angle of view determined by the determining means, and further selects one of the selectable compositing methods by a user operation. A determination means for determining an angle of view;
and imaging means for selecting one of a plurality of predetermined imaging methods based on the angle of view determined by the determination means and performing imaging using the selected imaging method. Further comprising a synthesis means,
13. The imaging apparatus according to claim 12, wherein, when the imaging means captures a plurality of images, the synthesis means synthesizes the plurality of images to generate a synthetic image. The imaging device according to claim 13, characterized in that the imaging means selects one of the plurality of imaging methods so that the angle of view of the composite image is the angle of view determined by the determination means. The imaging device according to claim 12 or 13, characterized in that the multiple imaging methods include at least one of imaging of a single image, imaging for HDR synthesis, and imaging for depth synthesis. A determination means for performing scene determination,
14. The image pickup apparatus according to claim 12, wherein the image pickup means selects one of the plurality of image pickup methods based on a result of the scene determination. The imaging device according to claim 16, characterized in that the determination means performs moving object detection in the scene determination. The imaging device according to claim 16, characterized in that the determination means detects luminance in the scene determination. The imaging device according to claim 16, characterized in that the determination means detects the difference in brightness in the scene determination. The imaging device according to claim 16, characterized in that the determination means detects whether a macro lens is attached in the scene determination. The imaging device according to claim 12 or 13, characterized in that the imaging means identifies selectable imaging methods from among the plurality of imaging methods based on the angle of view determined by the determination means, and further selects one of the imaging methods selectable by a user operation. A determination step of determining an angle of view;
a synthesis step of selecting one of a plurality of predetermined synthesis methods based on the angle of view determined in the determination step, and performing synthesis on a plurality of images to generate a composite image. A determination step of determining an angle of view;
an imaging step of selecting one of a plurality of predetermined imaging methods based on the angle of view determined in the determination step and performing imaging using the selected imaging method. A program for causing a computer to operate,
A determination step of determining an angle of view;
a synthesis step of selecting one of a plurality of predetermined synthesis methods based on the angle of view determined in the determination step, and performing synthesis on a plurality of images to generate a composite image. A program for causing a computer to operate,
A determination step of determining an angle of view;
an imaging step of selecting one of a plurality of predetermined imaging methods based on the angle of view determined in the determination step and capturing an image using the selected imaging method, A computer-readable recording medium having the program according to claim 24 or 25 recorded thereon.

Images