JP6811935B2 - Imaging equipment, image processing methods and programs - Google Patents

Description

The present invention relates to an image pickup apparatus, an image processing method, and a program including an image pickup unit capable of wide-angle shooting with a wide-angle lens.

The fisheye lens (wide-angle lens) used in image pickup devices such as digital still cameras can take pictures over a wide range, for example, with an angle of view of approximately 180 °, but because it uses a projection method, it is taken with a fisheye lens. The images (fisheye image, all-sky image) are distorted more toward the end (peripheral part) from the central part. As a technique for displaying a fisheye image taken with such a fisheye lens, for example, an image in a predetermined area is cut out from the fisheye image after shooting, and distortion is applied to the image in the cut out area. A technique is disclosed in which a distortion-free image (corrected image) is provided to a user by performing a correction process (see Patent Document 1).

Utility Model Registration No. 3066594

By the way, in general, a photographed image taken by a wide-angle lens such as a fisheye lens is susceptible to an adverse effect of unnecessary external light (harmful external light). For example, when a fisheye lens, which is a wide-angle lens, is used to take an image outdoors during the daytime, when the fisheye lens is directed toward the sky, sunlight is reflected from the center of the wide-angle lens (fisheye lens), and the photographed image is affected by the effect. May have an adverse effect on. Further, for example, when the camera optical axis is oriented in a direction parallel to the horizontal direction during the daytime, the external light from the sun may affect the peripheral portion of the fisheye lens. Further, for example, when the fisheye lens is imaged toward the sky at night, external light such as an electric lamp may be reflected from the peripheral portion of the fisheye lens, which may adversely affect the captured image. In such a case, as in the technique of the patent document described above, an image in a predetermined region is cut out from the photographed image (fisheye image, all-sky image), and the image in the cut out region is distorted. Even if the processing for correcting the above was performed, it was not possible to suppress even the adverse effect of the external light received at the time of imaging.

An object of the present invention is to make it possible to appropriately suppress the adverse effect of external light received during wide-angle imaging on a captured image.

In order to solve the above-mentioned problems, the present invention
An imaging device equipped with an imaging unit capable of wide-angle photography with a wide-angle lens.
A detection means for detecting a predetermined subject from an image captured by the imaging unit , and
When imaging with the wide-angle lens of the imaging unit, a predetermined region that is adversely affected by external light is excluded from the captured wide-angle image, and another region based on a predetermined subject detected by the detection means. And the setting means to set as the processing target area,
A processing means for executing a predetermined process for recording and saving the captured wide-angle image as a captured image for the processing target area set by the setting means, and a processing means.
It is characterized by having.

According to the present invention, it is possible to appropriately suppress the adverse effect of the external light received during wide-angle imaging on the captured image.

(1) is an external view showing a state in which an image pickup device 10 constituting a digital camera applied as an image pickup device and a main body device 20 are integrally combined, and (2) is an external view showing a state in which the image pickup device 10 and the main body device 20 are separated. External view showing the state of the camera. (1) is a block diagram showing the configuration of the imaging device 10, and (2) is a block diagram showing the configuration of the main body device 20. (1) shows a state in which the optical axis direction of the fisheye lens 16B is directed to the sky (zenith posture) as the posture of the image pickup device 10 at the time of imaging, and (2) is a wide-angle image (fisheye image) captured in that posture. ) Is illustrated. (1) and (2), (3) and (4) are for explaining a case where a circular wide-angle image (fisheye image) captured by the fisheye lens 16B is digitally zoomed and converted into a rectangular panoramic image. Figure. (1) and (2) are diagrams for explaining a case where a fisheye image is digitally zoomed and converted into a panoramic image, following FIG. 4. The flowchart which starts execution when it is switched to the panorama image generation mode (fisheye panorama shooting mode) using the fisheye lens 16B. The flowchart which showed the operation following FIG. In the second embodiment, the flowchart which is started to be executed when the panorama image generation mode (fisheye panorama shooting mode) is switched. The flowchart which showed the operation following FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First Embodiment)
First, the first embodiment of the present invention will be described with reference to FIGS. 1 to 7.
This embodiment illustrates a case where it is applied to a digital camera as an image pickup device, and the digital camera can be separated into an image pickup device 10 having an image pickup unit described later and a main body device 20 having a display unit described later. It is a separate digital camera. FIG. 1 (1) shows a state in which the image pickup device 10 and the main body device 20 are integrally combined, and FIG. 1 (2) shows a state in which the image pickup device 10 and the main body device 20 are separated. The image pickup device 10 and the main body device 20 constituting this separate digital camera can be paired (wireless connection recognition) using the wireless communication that can be used by each, and the wireless communication is a wireless LAN (Wi). -Fi) or Bluetooth® is used. The main body device 20 receives and acquires an image captured by the image pickup device 10 side, and displays the captured image (live view image) on the touch screen.

FIG. 2 (1) is a block diagram showing the configuration of the imaging device 10, and FIG. 2 (2) is a block diagram showing the configuration of the main body device 20.
In FIG. 2 (1), the image pickup apparatus 10 includes a control unit 11, a power supply unit 12, a storage unit 13, a communication unit 14, an operation unit 15, an image pickup unit 16, a posture detection unit 17, and the like. The control unit 11 operates by supplying power from the power supply unit (secondary battery) 12, and controls the overall operation of the image pickup device 10 according to various programs in the storage unit 13. Is provided with a CPU (Central Processing Unit) and a memory (not shown). The storage unit 13 has, for example, a configuration including a ROM, a flash memory, and the like, and stores a program, various applications, and the like for realizing the present embodiment. The communication unit 14 is a communication interface for transmitting a captured image to the main body device 20 side and receiving an operation instruction signal or the like from the main body device 20. The operation unit 15 includes basic operation keys (hardware keys) such as a power switch.

The image pickup unit 16 constitutes a camera unit capable of photographing a subject with high definition, and the lens unit 16A of the image pickup unit 16 is provided with a fisheye lens 16B, an image pickup element 16C, and the like. In the camera of the present embodiment, a normal image pickup lens (not shown) and a fisheye lens 16B can be exchanged, and the illustrated example shows a state in which the fisheye lens 16B is attached. This fisheye lens 16B is, for example, a circumferential fisheye lens (all-around fisheye lens) that is composed of a three-element lens system and can take a wide range of images with an angle of view of approximately 180 °, and is a wide-angle image (a wide-angle image) taken by the fisheye lens 16B. The entire fisheye image (fisheye image, all-sky image) is a circular image. In this case, since the projection method is adopted, the wide-angle image (fisheye image) taken by the fisheye lens 16B becomes greatly distorted from the center toward the end (peripheral part).

When a subject image (optical image) by such a fisheye lens 16B is imaged on an image sensor (for example, CMOS or CCD) 16C, an image signal (analog value signal) photoelectrically converted by the image sensor 16C is shown in the figure. It is converted into a digital signal by the omitted A / D conversion unit, and after being subjected to predetermined image processing, it is transmitted to the main unit 20 side and displayed on the monitor. The posture detection unit 17 is a 3-axis acceleration sensor that detects the acceleration applied to the image pickup device 10, and detects the camera posture of the image pickup device 10 at the time of imaging and gives it to the control unit 11. Here, the camera posture means, for example, a direction in which the camera optical axis (optical axis direction of the fisheye lens 16B) is in the zenith direction (anti-gravity direction) or within a predetermined angle range with respect to the zenith direction (approximately zenith direction). Imaging in the camera orientation (zenith orientation) when imaging toward the camera, in the direction parallel to the horizontal direction of the camera optical axis, or in the direction within a predetermined angle range with respect to the horizontal direction (approximately horizontal direction). It means the camera posture (horizontal posture) when doing so.

In FIG. 2 (2), the main body device 20 has a reproduction function of reproducing an image taken by using a fisheye lens or the like, and has a control unit 21, a power supply unit 22, a storage unit 23, a communication unit 24, and an operation unit 25. , Touch display unit 26, clock unit 27, and the like. The control unit 21 operates by supplying electric power from the power supply unit (secondary battery) 22, and controls the overall operation of the main body device 20 according to various programs in the storage unit 23. Is provided with a CPU (Central Processing Unit) and a memory (not shown). The storage unit 23 has, for example, a configuration including a ROM, a flash memory, and the like, and is necessary for the main body device 20 to operate the program memory 23A in which the program for realizing the present embodiment and various applications are stored. It has a work memory 23B or the like that temporarily stores various kinds of information (for example, flags).

The communication unit 24 is a communication interface for transmitting and receiving various data to and from the image pickup apparatus 10. The operation unit 25 is provided with various push-button type keys such as a power button, a release button tongue, and a setting button for setting shooting conditions such as exposure and shutter speed. The control unit 21 is operated from the operation unit 25. Processes according to the input operation signal of the above are executed, and the input operation signal is transmitted to the image pickup apparatus 10. The touch display unit 26 has a configuration in which a touch panel 26B is laminated on a display 26A such as a high-definition liquid crystal, and the display screen thereof is a monitor screen (live view screen) that displays a captured image (fisheye image) in real time. , A playback screen for playing back captured images, or a selection screen for selecting various operation modes. Here, in the present embodiment, as an operation mode for shooting using the fisheye lens 16B, in addition to the fisheye shooting mode for recording and saving a circular fisheye image, the circular fisheye image is converted into a rectangular panoramic image. It has a fisheye panoramic shooting mode for recording and saving. The clock unit 27 measures the current date and time information (year, month, day, hour, minute, second), and the control unit 21 acquires this date and time information as the shooting date and time.

When the release button (not shown) of the two-step pressing configuration is half-pressed (half-shutter operation) on the main unit 20 side, the control unit 21 instructs the imaging device 10 to perform a shooting preparation operation to perform imaging. The device 10 is made to perform automatic focus adjustment (AF processing), automatic exposure adjustment (AE processing), and the like. When the release button is fully pressed (full shutter operation), a shooting instruction is given to the imaging device 10, the captured image at that time is acquired, and the captured image is subjected to development processing, image compression processing, and the like. Is generated, and after conversion to a standard file format, a shooting process is performed in which the captured image is recorded and saved on the recording medium of the storage unit 23. In this case, the control unit 21 performs a process of correcting distortion on the fisheye image.

FIG. 3 is a diagram illustrating the posture of the imaging device 10 at the time of imaging and the wide-angle image (fisheye image) captured in that posture.
FIG. 3 (1) is taken with the camera optical axis (the optical axis direction of the fisheye lens 16B) oriented toward the zenith direction (anti-gravity direction) or a direction within a predetermined angular range with respect to the zenith direction (approximately zenith direction). The camera posture (zenith posture) is shown, and FIG. 3 (2) shows a fisheye image (live view image) captured in this camera posture (zenith posture). The illustrated example shows an image of a fisheye lens 16B taken toward the sky (zenith) in a place surrounded by a group of buildings, and a blue sky appears in the central region of the fisheye image, and the peripheral region thereof. Is the case where a group of buildings is shown.

FIG. 4 is a diagram for explaining a case where a circular wide-angle image (fisheye image) captured by the fisheye lens 16B is digitally zoomed (trimmed) and converted into a rectangular panoramic image.
FIG. 4 (1) shows a state in which the entire fisheye image is virtually divided into a plurality of areas in order to set a target area for panoramic zoom in the fisheye image. That is, in the fisheye image, the entire image is virtually divided into a plurality of regions (8 regions) a1 to a8 by a plurality of concentric circles (8 in the present embodiment) that coincide with the center point. ..

The division region a1 indicates the innermost region (circular region) formed by the concentric circles closest to the center point of the fisheye image among the plurality of concentric circles. The division region a2 indicates a region formed by the next closest (closest to the second) concentric circles, that is, a region (annular region) located on the outer side of the division region a1. The division region a3 indicates a region formed by concentric circles that are the next closest (closest to the third), that is, a region (annular region) located outside the division region a2. Hereinafter, the same applies, and the division region a8 indicates a region formed by concentric circles farthest from the center point of the fisheye image, that is, the outermost region (annular region).

FIG. 4 (2) shows a panoramic image obtained by performing panoramic processing on a fisheye image virtually divided into a plurality of regions a1 to a8 as shown in FIG. 4 (1) and panoramicly developing the fisheye image. The positional relationship between the plurality of division areas a1 to a8 and the plurality of division areas a1 to a8 of the panoramic image is shown. The aspect ratio of this panoramic image is, for example, 1: 2.85, and the upper regions a1 and a2 of the panoramic image are the regions a1 and a2 in the inner direction (center direction) of the fisheye image. ..., The lower regions a7 and a8 correspond to the regions a7 and a8 in the outer direction (direction opposite to the center direction) of the fisheye image. That is, the panoramic image is divided into a plurality of division areas a1 to a8 in order from above.

FIG. 4 (3) shows the central region (inner region) of the plurality of compartmentalized regions a1 to a8 in the fisheye image in the medial direction near the center point of the fisheye image, and the outer region away from the central point. With the division area in the direction as the peripheral area (outer area), the other division areas (intermediate area) excluding the central area and the peripheral area are subjected to predetermined processing (panorama zoom processing, exposure processing, etc.) described later. It shows the case where it is set as the processing target area to be processed. In the illustrated example, the division region a1 closest to the center point of the fisheye image is set as the central region (inner region), and the outermost division region a8 and the next farthest division region a7 from the center point of the fisheye image are designated. This is the case of the peripheral region (outer region).

That is, the central region a1 and the other compartmentalized regions (intermediate regions) a2 to a6 excluding the peripheral regions a7 and a8 are set as the processing target regions for executing the predetermined processing, and the other compartmentalized regions excluding this processing target region are set. This is a case where the central region a1 and the peripheral regions a7 and a8, which are regions, are set as non-processed regions that do not execute a predetermined process. The overall shape of the set processing target area is a circular area, and the processing target area and the non-processing target area are in a relative relationship, and the width thereof (the distance between two concentric circles constituting the processing target area). The position and position change relatively depending on how the non-processed area is set.

In the present embodiment, the processing target area and the non-processing target area are automatically set in the fisheye image at the time of imaging, and the main body device 20 is detected by the posture detection unit 17 of the imaging device 10. After acquiring the obtained posture information, the date and time information of the current date from the clock unit 27, and the brightness information from the fisheye image (live view image), the posture information, the date and time information, and the brightness information are used. Therefore, the processing target area and the non-processing target area are set in the fisheye image. For example, when the camera is in a posture in which the optical axis direction of the fisheye lens 16B is toward the zenith (zenith posture) and the sky is bright, the brightness information of the fisheye image may be equal to or higher than a predetermined threshold. For example, as shown in FIG. 4 (3), the processing target area is set as “a2 to a6” and the non-processing target area is set as “a1, a7, a8”.

In FIG. 4 (4), as shown in FIG. 4 (3), the fisheye image in which the processing target area is “a2 to a6” and the non-processing target area is “a1, a7, a8” is subjected to digital zoom processing. When the panoramic image developed in panorama is shown and the image portions of the processing target areas a2 to a6 are subjected to digital zoom processing to be panoramicly developed, as shown in FIG. 4 (3), the radius r1 of the entire fisheye image and The image is magnified at a zoom magnification determined by the ratio to the maximum radius of the processing target areas a2 to a6 (radius r2 of the area a6). That is, since the zoom magnification is determined according to the bandwidth of the processing target area, the zoom magnification becomes large when the set width of the processing target area is narrow. When a predetermined subject (for example, a person) is imaged with the fisheye lens 16B, if the distance to the predetermined subject is long, the predetermined subject appears small, but the processing target area is subjected to digital zoom processing to perform panorama. When unfolded, the predetermined subject becomes larger according to its zoom magnification.

On the other hand, as shown in FIG. 4 (3), the fisheye image includes a predetermined subject (for example, a person), but when the processing target areas a2 to a6 are set in the fisheye image, this Since the entire predetermined subject does not fit in the processing target area and a part of it (the toe part of the person in the illustrated example) protrudes from the processing target area, the panoramic image also includes the toe part of the person. It will not be possible. Therefore, in the present embodiment, the settings of the processing target area and the non-processing target area are changed according to the appearance of a predetermined subject.

FIG. 5 is a diagram for explaining a case where the fisheye image is digitally zoomed and converted into a panoramic image, following FIG. 4.
FIG. 5 (1) shows a state after changing the settings of the processing target area and the non-processing target area so that the entire predetermined subject fits within the processing target area, and is processed in the fisheye image. This is a case where the target area is changed from “a2 to a6” to “a3 to a7”. That is, in the illustrated example, the width (area) of the outer non-processed area is reduced from "a7 and a8" to "a8" so as to be one step narrower, and the area of the inner non-processed area is increased by one step. As a result, the case where the change from “a1” to a1 and a2 is performed is shown, and the processing target area is changed from “a2 to a6” to “a3 to a7”.

As described above, in the present embodiment, when a predetermined subject included in the fisheye image is detected and the processing target area is set based on the predetermined subject, the protruding portion of the predetermined subject is reduced. The processing target area is set so as to.
In FIG. 5 (2), as shown in FIG. 5 (1), the processing target area is set from “a2 to a6” to “a3 to a7”, and the non-processing target area is set from “a1” to “a1 and a2, a8”. A panoramic image developed by performing digital zoom processing on the changed fisheye image is shown, and the whole body of a person who is a predetermined subject is included in the panoramic image.

Next, the operation concept of the digital camera in the first embodiment will be described with reference to the flowcharts shown in FIGS. 6 and 7. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. It is also possible to sequentially execute operations according to the above-mentioned program code transmitted via a transmission medium such as a network. This also applies to other embodiments described later, and in addition to the recording medium, it is also possible to execute an operation peculiar to the present embodiment by using a program / data externally supplied via a transmission medium. Note that FIGS. 6 and 7 are flowcharts showing an outline of the operation of the featured portion of the present embodiment in the overall operation of the camera, and when the flow of FIGS. 6 and 7 is exited, the overall operation is performed. Return to the main flow (not shown).

6 and 7 are flowcharts that are started to be executed when the panoramic image generation mode (fisheye panorama shooting mode) using the fisheye lens 16B is switched.
First, the control unit 21 on the main unit 20 side starts an operation of sequentially displaying the fisheye image acquired from the image pickup device 10 on the touch display unit 26 as a live view image (step A1 in FIG. 6), and in FIG. The process of initializing the panoramic zoom position is performed so as to be in the state shown in 1) and (2) (the state in which the processing target area is not set) (step A2). After that, the release state is in a waiting state for a half-press operation (half-shutter operation) (step A3).

Now, when the release half-press operation is performed (YES in step A3), the image pickup device 10 is instructed to perform the shooting preparation operation to perform automatic focus adjustment (AF processing) (step A4). Then, after performing a process (step A5) of temporarily storing the fisheye image (live view image) acquired from the image pickup device 10, the detection result (posture information) is acquired from the posture detection unit 17 of the image pickup device 10 and imaged. The camera posture at the time is determined (step A6). For example, based on the posture information from the posture detection unit 17, for example, the camera posture (zenith posture) in which the camera optical axis is imaged in the zenith direction or substantially the zenith direction, or a direction parallel to the horizontal direction. Or, it is determined whether the camera is in a camera posture (horizontal posture) for capturing images in a substantially parallel direction.

Further, the timekeeping information is acquired from the clock unit 27, and the current time zone is determined based on the timekeeping information (current date and time) (step A7). For example, it is determined whether it is a daytime time zone or a nighttime time zone according to the season. Further, the brightness information of a predetermined region is acquired from the fisheye image (live view image) and compared with the brightness of the other region (step A8). For example, as shown in FIG. 4 (1), when the entire fisheye image is virtually divided into a plurality of regions (8 regions) a1 to a8, the zenith posture is due to external light. The brightness information is detected with the innermost division region (central region) a1 that is susceptible to adverse effects as a predetermined region, but in the horizontal posture, the outermost region (peripheral region) a8 that is susceptible to adverse effects from external light. The brightness information is detected with the area as a predetermined area. Then, the brightness information of this predetermined area is compared with the brightness information of another division area, and the difference is obtained. In the present embodiment, the maximum values of the three primary colors R, G, and B of the pixel are obtained as the brightness value of the pixel, and the average brightness value of all the pixels in one division area is acquired as the brightness information of the division area. However, the brightness information may be acquired for each division area by another method.

Here, as a result of comparing the brightness information of the predetermined region with the brightness information of the other region (step A8), it is examined whether the difference is equal to or greater than the predetermined threshold value (step A9), and if it is less than the predetermined threshold value, That is, if the difference in brightness is small (NO in step A9), it is judged that the adverse effect of external light is small, and the process proceeds to step A10, and the predetermined basic processing target area and non-processing target area are set as fish. Performs the process of setting in the eye image. For example, in the zenith posture, the innermost division area (central area) a1 is set as a basic non-processing target area, and all other division areas a2 to a8 are basic regardless of the time zone. Set as the processing target area. In the horizontal posture, the outermost division area a8 is set as the basic non-processing target area, and all other division areas a1 to a7 are set as the basic processing target areas regardless of the time zone. To do. When the adverse effect of external light is small, the processing target area is not limited to this, and may be arbitrarily set. For example, the division areas a1 and a8 may be set as non-processing target areas, and may be set in a time zone. It may be set accordingly, or a1 to a8 may be set as the processing target area without setting the non-processing target area.

On the other hand, if the difference is equal to or greater than a predetermined threshold value (YES in step A9), it is determined that there is a large adverse effect due to external light, and the process proceeds to step A11. Performs processing to set the processing target area in the fisheye image. For example, in the case of the zenith posture and in the daytime time zone, the inner central region a1 + a2 or a1 + a2 + a3, which are easily adversely affected by external light (natural light), is set as the non-processing target region depending on the brightness. That is, if the adverse effect of natural light is particularly large, "a1 + a2 + a3" is set as the non-processing target area, the other division areas a4 to a8 are set as the processing target area, and if it is less than that, "a1 + a2" is not set. It is set as a processing target area, and the other division areas a3 to a8 are set as processing target areas. Needless to say, the setting of the processing target area is not limited to this when there are many adverse effects due to external light.

Further, for example, in the case of a horizontal posture and at night time, the outer region a7 + a8 or a6 + a7 + a8 that is easily adversely affected by external light (artificial light such as neon light) is not processed depending on the brightness. Let it be an area. That is, if the adverse effect of artificial light is particularly large, "a6 + a7 + a8" is set as the non-processing target area, the other areas a1 to a5 are set as the processing target area, and if it is less than that, "a7 + a8" is not processed. It is set as a target area, and the other areas a1 to a6 are set as a processing target area. Similarly, in the case of other postures, different processing target areas and non-processing target areas are set in the fisheye image according to the time zone and brightness. In this embodiment, as described in FIG. 4 (3), the inner region a1 and the outer regions a8 and a7 are set as non-processing target regions. In this way, the posture information , Date and time information, In addition to the non-processed area set based on the brightness information, for example, if the inner central area is the non-processed area, the outer area is the non-processed area, or if the outer area is the non-processed area. The inner central region may be set as a basic non-processing target region as an region where the subject is unlikely to exist in the first place.

When the process of setting the processing target area and the non-processing target area is completed in this way, the process proceeds to the flow of FIG. 7 and it is examined whether or not a predetermined subject (for example, a person) is included in the set processing target area (for example). Step A12). Here, if a predetermined subject is not included (NO in step A12), the process proceeds to step A16, but if a predetermined subject is included in the processing target area as shown in FIG. 4 (3) (step). YES in A12), analyze the appearance of the person (step A13), and determine whether a part of the predetermined subject protrudes from the processing target area, that is, whether the whole body of the person is within the processing target area. (Step A14). Note that this discrimination process may be performed by the control unit 11 or by a discrimination unit prepared separately from the control unit 11.

Now, in the case shown in FIG. 4 (3), since a part of the predetermined subject (the toe part of the person) protrudes from the processing target area (YES in step A14), a part of the predetermined subject. Does not protrude from the processing target area, that is, the portion of the predetermined subject that protrudes from the processing target area is reduced (so that the entire subject fits as much as possible) in the processing target area and the non-processing target area. Change the setting (step A15). In this case, the outer non-processed area is "a7 and a8", the inner non-processed area is "a1", the processed area is "a2 to a6", and the toes of the person are non-processed. Since it is included in the processing target area a7, the division area "a7" set as the outer non-processing target area is changed to the processing target area so that the whole body of the person fits in the processing target area. The division area "a2" set as the processing target area is changed to the inner non-processing target area. That is, instead of narrowing the area of the outer non-processing target area by one step (one division area), the area of the inner non-processing target area is widened by one step (one division area).

As a result, as shown in FIG. 5 (1), the outer non-processed area in the fisheye image is changed from "a7 and a8" to "a8", and the inner non-processed area is "a1". Is changed to "a1 and a2", and the processing target area is changed from "a2 to a6" to "a3 to a7". That is, the setting of the processing target area is changed so that the areas of the central region and the peripheral region, which are non-processing target regions, increase or decrease in an inversely proportional relationship. By changing the setting of the processing target area in this way, and then performing digital zoom processing on this fisheye image to develop a panorama, the panoramic image becomes as shown in FIG. 5 (2), and the panorama The whole body of a person who is a predetermined subject is included in the image.

Note that FIG. 4 (3) shows a case where the non-processed area is set on the outside and the inside, and the area of the non-processed area on the inside and the outside is increased or decreased so as to have an inverse proportional relationship. , When only the outer non-processing target area or the inner non-processing target area is set, the area of the non-processing target area may be reduced by one step. If the head of the person protrudes from the processing target area, the area of the inner non-processing target area can be narrowed by one step, and instead, the area of the outer non-processing target area can be expanded by one step. Good. Further, in the example of FIG. 5 (1), the case where the outer non-processed area exists even if the area of the outer non-processed area is narrowed by one step (1 division area) is shown, but the outer non-processed area is present. When the area is only "a8", it may occur that the outer non-processed area does not exist by narrowing the area by one step (one division area).

When the processing target area is determined in this way, as a shooting preparation operation, processing such as exposure adjustment (AE processing), white balance adjustment, and hue correction is performed on the processing target area (step A16). If the automatic focus adjustment (AF processing) is a contrast detection method, the AF processing may be executed together with the exposure adjustment and the hue correction when the processing target area is determined. When this shooting preparation operation is completed, it is checked whether the release full push operation has been performed (step A17), and the process returns to step A4 in FIG. 6 until the release full push operation is performed (NO in step A17). Repeat the operation.

Now, when the release full press operation is performed (YES in step A17), the fisheye distortion correction processing, digital zoom processing, panorama processing, and development processing are executed for the processing target area set in the fisheye image to take a picture. An image (panoramic image) is generated (step A18), the generated captured image is subjected to image compression processing to be converted into a standard file format, and then recorded and saved in the recording medium of the storage unit 23 (step A19). ). Next, it is checked whether the panoramic shooting mode is canceled and the end of the mode is instructed by the user operation (step A20), and if the panoramic shooting mode remains (NO in step A20), the flow returns to FIG. The panorama position initialization process (step A2) is performed, and the state waits for the release half-press operation (step A3). Hereinafter, the above operation is repeated until the end of the panoramic shooting mode is instructed.

As described above, in the first embodiment, the main body device 20 excludes a predetermined region of the wide-angle image captured by the wide-angle lens (fish-eye lens 16B) of the image pickup unit 16 that is adversely affected by external light. Since another area is set as the processing target area and the predetermined processing performed until the captured wide-angle image is recorded and saved as the captured image is executed for the set processing target area, the wide-angle imaging is performed. It is possible to appropriately suppress the adverse effect of the external light that is sometimes received on the captured image.

The main body device 20 sets a region other than at least one of the central region and the peripheral region of the captured wide-angle image (fisheye image) as a processing target region, and sets the captured wide-angle image as a processing target region. Since the predetermined processing performed before recording and saving as a captured image is executed for the set processing target area, it is possible to appropriately suppress the adverse effect of the external light received during wide-angle imaging on the captured image. In addition, since a predetermined process is executed for the narrowed process target area, the process can be efficiently performed.

The fisheye image has a plurality of division areas a1 to a8 formed by virtually dividing the entire image by a plurality of concentric circles corresponding to the center points of the fisheye image, and the main body device 20 has the plurality of division areas a1 to a1. Of a8, the inner division region near the center point of the fisheye image is the central region, the outer division region away from the center point is the peripheral region, and at least one of the central region and the peripheral region is defined as the peripheral region. Since the other division areas to be excluded are set as the processing target areas, it is possible to set the other division areas excluding the division areas that are easily adversely affected by external light as the processing target areas.

The image pickup device 10 includes a posture detection unit 17, and the main body device 20 acquires the posture of the image pickup device 10 detected by the posture detection unit 17 from the image pickup device 10, and based on this posture, from the fisheye image. Since at least the other division areas other than the central region and the peripheral region are set as the processing target regions, the division regions that are susceptible to adverse effects from external light differ depending on the posture of the image pickup apparatus 10. However, the processing target area suitable for the posture can be set.

Based on the current date and time measured by the clock unit 27 at the time of imaging by the image pickup unit 16, the main unit device 20 obtains other division regions from the fisheye image excluding at least one of the central region and the peripheral region. Since the processing target area is set, the processing target area suitable for the current date and time can be set even if the division area that is easily affected by external light differs depending on the season or time zone.

The main unit 20 acquires brightness information from the captured wide-angle image, and based on this brightness information, processes another division area other than at least one of the central region and the peripheral region of the wide-angle image. Since it is set as an area, the processing target area can be set more appropriately.

The main unit device 20 detects a predetermined subject (for example, a person) included in the fisheye image and sets the processing target area based on the predetermined subject. Therefore, the processing is performed based on the appearance of the predetermined subject. The target area can be set appropriately.

Since the main unit device 20 sets the processing target area so that the portion of the predetermined subject protruding from the processing target area is reduced, the processing target area including the entire predetermined subject can be set.

When the main unit 20 sets a region other than the central region and the peripheral region of the captured wide-angle image as the processing target area and then is instructed to change the setting of the processing target area, the main unit 20 sets the processing target area. Since the setting of the processing target area is changed so that the areas of the central area and the peripheral area, which are non-processing target areas, increase or decrease in an inversely proportional relationship, the area of the processing target area is not changed before and after the change. Only the position of that area can be changed.

Since the main unit 20 executes at least one of exposure adjustment, white balance adjustment, and hue correction as a predetermined process for the set processing target area, the adverse effect of external light is exerted at the stage of the shooting preparation operation. It can be suppressed. For example, when a blue sky is photographed in a zenith posture, it is possible to solve the problem that the exposure, white balance, and hue of a desired subject are not matched due to the influence of the brightness and blueness of the sky. Further, since it is possible to perform shooting preparation operations such as exposure adjustment, white balance adjustment, and hue correction for the narrowed processing target area, it is possible to efficiently perform the preparation operations.

Since the main unit device 20 performs image processing on the set processing target area and performs image processing for recording and saving, it is possible to suppress adverse effects due to external light and efficiently perform the image processing. ..

The main unit 20 performs digital zoom processing on the set image portion of the processing target area and panoramicly expands the image portion after the zoom processing. Therefore, the narrowed processing target area is enlarged by digital zoom to panorama. It can be expanded, and the visibility is significantly higher than that of a fisheye image.

(Modification example 1)
In the first embodiment described above, the processing target area is set so that the portion of the predetermined subject (for example, a person) protruding from the processing target area is reduced (so that the entire subject fits as much as possible). Although it has been changed, the width of the processing target area (the distance between two concentric circles that divide the processing target area) may be adjusted so that the predetermined subject fits within the processing target area. For example, if the subject is large in the fisheye image, the width of the processing target area is changed to be wide according to the size, and if the subject is small, the processing target is adjusted to the size. It may be changed so that the width of the area becomes narrower. In this way, after changing the width of the processing target area according to the size of the predetermined subject, digital zoom processing is performed on the image portion of the processing target area, and the image portion after the zoom processing is panoramicly expanded. Should be executed.

By the way, in general, when an image is taken using a wide-angle lens such as a fisheye lens, the peripheral portion of the wide-angle image (fisheye image) becomes a stretched image, the central portion thereof becomes a compressed image, and the subject is displayed from the imaging device 10. At a distance, the image of the subject is small and difficult to see. Even if such a wide-angle image is panoramicly developed, the size of the subject does not change and remains small. Therefore, it is conceivable to enlarge and correct the panoramic image after the panoramic development, but in such a method, it becomes necessary to create a large panoramic image, which makes the processing heavy. If the width of the processing target area is adjusted so that the subject fits within the processing target area, and then digital zoom processing and panoramic processing are performed on the image portion of the processing target area, the subject will be large and easy to see. Become.

Further, in the above-described first embodiment, after setting the processing target area in the fisheye image based on the posture of the imaging device 10 at the time of imaging, the current date and time, and the brightness information of the fisheye image, this processing target area A predetermined subject included in the image was detected, and the setting of the processing target area was changed based on the image quality of the predetermined subject. However, the posture of the image pickup device 10 at the time of imaging, the current date and time, and the image were captured. The processing target area may be set in the fisheye image based on the brightness information of the fisheye image and the appearance of a predetermined subject. That is, when setting the processing target area, the appearance of a predetermined subject may be taken into consideration.

Further, in the first embodiment described above, the processing target area is set and the setting is automatically changed, but the posture information of the image pickup apparatus 10, the current date and time information, and the brightness information of the fisheye image are used. Based on this, after setting the processing target area, the setting of the processing target area may be changed (fine-tuned) by a user operation. That is, the processing target area may be automatically set and the setting may be changed (fine adjustment) by user operation.

Further, in the above-described first embodiment, the processing target area is set by using all of the posture information, the date and time information, and the brightness information, but any one of the posture information, the date and time information, and the brightness information, or The processing target area may be set by a combination of the two.

(Second Embodiment)
Hereinafter, the second embodiment of the present invention will be described with reference to FIGS. 8 and 9.
In the first embodiment described above, the processing target area is set in the fisheye image based on the attitude information of the image pickup device 10 at the time of imaging, the current date and time information, and the brightness information of the captured fisheye image. After that, a predetermined subject included in the processing target area is detected, and the setting of the processing target area is changed based on the image quality of the predetermined subject. However, in the second embodiment, the processing target area is changed. The processing target area is set in the fisheye image according to the user operation, and the setting of the processing target area is changed according to the user operation. Here, those having the same basic or nominal name in both embodiments are indicated with the same reference numerals, the description thereof will be omitted, and the feature portions of the second embodiment will be mainly described below. ..

8 and 9 are flowcharts that are started to be executed when the panoramic image generation mode (fisheye panorama shooting mode) using the fisheye lens 16B is switched to in the second embodiment.
First, the control unit 21 on the main unit 20 side starts an operation of sequentially displaying the fisheye image received and acquired from the image pickup device 10 on the touch display unit 26 as a live view image (step B1 in FIG. 8), and FIG. The process of initializing the panoramic zoom position is performed so as to be in the state shown in (1) and (2) (the state in which the processing target area is not set) (step B2). In this state, it is checked whether the digital zoom operation described later is performed (step B3), whether the move operation described later is performed (step B7), or whether the release half-press operation is performed. (Step B11 in FIG. 9).

This digital zoom operation is a pinch-in or pinch-out operation performed on the touch display unit 26 in which the fisheye image captured in the fisheye panorama shooting mode is displayed as a live view image, and is within the captured fisheye image. It is an area setting operation that instructs that the processing target area and the non-processing target area should be set. That is, when the digital zoom operation is performed (YES in step B3), it is checked whether the digital zoom operation is a pinch-out operation (step B4), and if it is a pinch-out operation (YES in step B4), the zoom-out process is performed. , Perform the process of setting the processing target area and the non-processing target area in the fisheye image (step B5). This zoom-out process expands the area of the non-processed area in the fisheye image by one step (1 segmented area) for each pinch-out operation, that is, narrows the area of the processed target area by one step (1 segmented area). Since this is a process and the panoramic zoom position is initially initialized, if a pinch-out operation is performed in this initial state, a new non-process target area will appear in the fisheye image.

If the digital zoom operation is a pinch-in operation (NO in step B4), a process of setting a processing target area and a non-processing target area in the fisheye image is performed as the zoom-in process (step B). This zoom-in process is a process of narrowing the area of the non-processing target area in the fisheye image by one step (one division area) for each pinch-in operation, that is, a process of expanding the area of the processing target area by one step (one division area). is there. The pinch-in operation is invalid when the panoramic zoom position is initialized. In addition, whether the non-processed area is the central part, the peripheral part, or both of the fisheye image is arbitrarily selected by the user at the first touch position during the digital zoom operation. However, the selection may be made automatically based on the posture information of the image pickup device 10.

The above-mentioned move operation is an upper flick or a lower flick operation performed on the touch display unit 26 in which the fisheye image captured in the fisheye panoramic shooting mode is displayed as a live view image, and is included in the fisheye image. The area setting change operation is performed to change the set processing target area or non-processing target area according to the appearance of a predetermined subject (for example, a person). That is, when the move operation is performed (YES in step B7), it is checked whether the operation is an upper flick operation (step B8), and if it is an upper flick operation (YES in step B8), the move-in process is performed on the predetermined subject. The settings of the processing target area and the non-processing target area are changed so that all of them are included in the processing target area (step B9). That is, the setting of the processing target area is changed so that the portion where the predetermined subject protrudes from the processing target area is reduced.

If the move operation is a down flick operation (NO in step B8), the settings of the processing target area and the non-processing target area are changed so that the predetermined subject is hidden in the non-processing target area as the move-out process. (Step B10). That is, the setting of the processing target area is changed so that the portion where the predetermined subject protrudes from the processing target area increases. For example, instead of making the whole body of the person fit within the processing target area, the setting of the processing target area is changed so that the upper body and the face part fit within the processing target area. As in the first embodiment described above, when the non-processing target area is set in both the central portion and the peripheral portion, the areas of the central portion region and the peripheral portion region increase or decrease in an inversely proportional relationship. The setting of the non-processing target area is changed so as to.

Now, when the release half-press operation is performed (YES in step B11 in FIG. 9), AF processing, exposure adjustment (AE processing), and white balance adjustment of the shooting preparation operation are performed for the processing target area set as described above. , Hue correction and other processes are executed (step B12). After that, it is checked whether the release full push operation is performed (step B13), and if the release full push operation is not performed (NO in step B13), the process returns to the above step B12 to perform the shooting preparation operation, but the release full push operation is performed. When the operation is performed (YES in step B13), fisheye distortion correction processing, digital zoom processing, panorama processing, development processing, etc. are executed on the processing target area to generate a captured image (step B14), and this generation is generated. The captured image is subjected to image compression processing to be converted into a standard file format, and then recorded and saved in the recording medium of the storage unit 23 (step B15).

Next, it is checked whether the panoramic shooting mode is canceled and the end of the mode is instructed by the user operation (step B16), and if the panoramic shooting mode remains (NO in step B16), the flow returns to FIG. Initialize the panorama position (step B2). Hereinafter, the above operation is repeated until the end of the panoramic shooting mode is instructed.

As described above, in the second embodiment, when the main unit device 20 is instructed by the user operation (digital zoom operation: pinch-in operation or pinch-out operation) that the processing target area should be set in the fisheye image at the time of imaging. , Based on this user instruction, the fisheye image is set to the area other than at least the central area and the peripheral area as the processing target area, so that the adverse effect of the external light received at the time of imaging is adversely affected. Can be appropriately suppressed, and the processing target area can be arbitrarily set according to the user's intention.

When the change of the set processing target area is instructed by a user operation (move operation: up flick operation or down flick operation), the main unit 20 changes the setting of the processing target area based on the user instruction. Therefore, the setting of the processing target area can be changed according to the intention of the user, which makes it possible to finely adjust the appearance of a predetermined subject (for example, a person).

In the second embodiment described above, the processing target area desired by the user is set by the digital zoom operation (pinch-in operation or pinch-out operation), but the operation is not limited to the pinch-in operation or the pinch-out operation. May indicate that the processing target area should be set, and in the second embodiment described above, the processing target area setting is changed by a move operation (up flick operation or down flick operation). However, you may instruct that the setting should be changed by other operations.

In the second embodiment described above, when the move operation is performed, the setting of the processing target area is changed (fine-tuned) according to the image condition of a predetermined subject (for example, a person). The processing target area may be set in consideration of the appearance of a predetermined subject (for example, a person) during the digital zoom operation.

Further, in each of the above-described embodiments, the circular wide-angle image (fisheye image) captured by the fisheye lens 16B is converted into a rectangular panoramic image and recorded and saved, but the fisheye image is also recorded and saved. You may try to do it. Further, when the entire fisheye image is virtually divided into a plurality of areas, it is not limited to the case where it is divided by a plurality of concentric circles, and it is not limited to the concentric circles as long as the adverse effect of external light can be suppressed. is there.

In each of the above-described embodiments, 180 ° imaging is exemplified in the range of imaging using the fisheye lens 16B, but the present invention is not limited to this, and for example, 360 ° imaging is divided into two times of front 180 ° imaging and rear 180 ° imaging. May be performed to form a set of the plurality of fisheye images. Further, the lens is not limited to the fisheye lens 16B, and other wide-angle lenses may be used.

In each of the above-described embodiments, a person is illustrated as a predetermined subject, but the present invention is not limited to this, and a pet, a flower, a tree, a building, or the like may be a predetermined subject.

Further, in each of the above-described embodiments, the image pickup device 10 and the main body device 20 are applied to a separate type digital camera that can be separated, but it may be an integrated digital camera, and further, a personal computer with a camera function.・ PDA (Personal Digital Camera) ・
It may be applied to a tablet terminal device, a mobile phone such as a smartphone, an electronic game, a music player, or the like.

Further, the "device" and "part" shown in each of the above-described embodiments may be separated into a plurality of housings according to functions, and are not limited to a single housing. Further, each step described in the above-mentioned flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or may be processed separately and independently.

Although the embodiments of the present invention have been described above, the present invention is not limited to this, and includes the invention described in the claims and the equivalent range thereof.
Hereinafter, the inventions described in the claims of the present application will be added.
(Additional note)
(Claim 1)
The invention according to claim 1
An imaging device equipped with an imaging unit capable of wide-angle photography with a wide-angle lens.
A setting means for setting a region other than a predetermined region that is adversely affected by external light in the captured wide-angle image as a processing target region during imaging using the wide-angle lens of the imaging unit.
A processing means for executing a predetermined process for recording and saving the captured wide-angle image as a captured image for a processing target area set by the setting means, and a processing means.
It is characterized by having.
(Claim 2)
The invention according to claim 2 is the imaging device according to claim 1.
The setting means processes at least a central region and / or a peripheral region of the captured wide-angle image in order to suppress an adverse effect of diplomacy during imaging using the wide-angle lens of the imaging unit. Set as the target area,
It is characterized by that.
(Claim 3)
The invention according to claim 3 is the imaging device according to claim 2.
The wide-angle image has a plurality of division regions formed by virtually dividing the entire image by a plurality of concentric circles corresponding to its center point.
Of the plurality of division regions, the setting means has an inner division region close to the center point of the wide-angle image as a central region, and an outer division region away from the center point as a peripheral region, at least the central portion thereof. Set other division areas other than either the area or the peripheral area as the processing target area.
It is characterized by that.
(Claim 4)
The invention according to claim 4 is the imaging device according to any one of claims 1 to 3.
Further equipped with a posture detecting means for detecting the posture of the imaging device,
The setting means sets a region other than the predetermined region from the wide-angle image as a processing target region based on the posture of the imaging device detected by the posture detecting means at the time of imaging by the imaging unit. To do
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the imaging device according to any one of claims 1 to 4.
Further equipped with a timekeeping means to measure the current date and time,
The setting means sets a region other than the predetermined region from the wide-angle image as a processing target region based on the current date and time measured by the timing means at the time of imaging by the imaging unit.
It is characterized by that.
(Claim 6)
The invention according to claim 6 is the imaging device according to any one of claims 1 to 5.
Further provided with an acquisition means for acquiring brightness information from a wide-angle image captured by the imaging unit.
The setting means sets a region other than the predetermined region from the wide-angle image as a processing target region based on the brightness information acquired by the acquisition means.
It is characterized by that.
(Claim 7)
The invention according to claim 7 is the imaging device according to any one of claims 1 to 6.
Further, a setting instruction means for instructing the setting of the processing target area by a user operation at the time of imaging by the imaging unit is provided.
The setting means sets a region other than the predetermined region from the wide-angle image as a processing target region based on a user instruction from the setting instruction means.
It is characterized by that.
(Claim 8)
The invention according to claim 8 is the imaging device according to any one of claims 1 to 7.
Further provided with a means for detecting a predetermined subject included in the wide-angle image.
The setting means sets a processing target area based on a predetermined subject detected by the detection means.
It is characterized by that.
(Claim 9)
The invention according to claim 9 is the imaging device according to claim 8.
The setting means sets a processing target area so that a portion of a predetermined subject detected by the detecting means protruding from the processing target area is reduced.
It is characterized by that.
(Claim 10)
The invention according to claim 10 is the imaging device according to claim 8.
The setting means sets the processing target area so that the predetermined subject detected by the detecting means fits within the processing target area.
The processing means performs a process of enlarging the image portion of the processing target area set by the setting means, and then executes a process of panoramic expansion of the image portion after the enlarging process.
It is characterized by that.
(Claim 11)
The invention according to claim 11 is the imaging device according to any one of claims 1 to 10.
Further provided with a change instruction means for instructing a change of the processing target area set by the setting means by a user operation.
The setting means changes the setting of the processing target area based on the user instruction from the change instruction means.
It is characterized by that.
(Claim 12)
The invention according to claim 12 is the imaging device according to any one of claims 1 to 11.
The setting means is a non-processing target when the setting of the processing target area is changed after setting other areas other than the central region and the peripheral region from the captured wide-angle image as the processing target area. Change the setting of the processing target area so that the areas of the central area and the peripheral area, which are the areas, increase or decrease in an inversely proportional relationship.
It is characterized by that.
(Claim 13)
The invention according to claim 13 is the imaging device according to any one of claims 1 to 12.
The processing means executes at least one of exposure adjustment, white balance adjustment, hue correction, enlargement processing, and panoramic expansion processing on the processing target area set by the setting means.
The imaging device according to any one of claims 1 to 12, wherein the image pickup apparatus is characterized by the above.
(Claim 14)
The invention according to claim 14 is the imaging device according to any one of claims 1 to 13.
When the processing means acquires an image captured by the imaging unit in response to a shooting instruction, performs image processing, and then records and saves the image, the processing target area set by the setting means is used. Performs image processing and shooting processing to record and save,
It is characterized by that.
(Claim 15)
The invention according to claim 15
It is an image processing method of an image pickup apparatus provided with an image pickup unit capable of wide-angle shooting with a wide-angle lens.
A step of setting a region other than a predetermined region in the captured wide-angle image that is adversely affected by external light as a processing target region during imaging using the wide-angle lens of the imaging unit.
A step of executing a predetermined process for recording and saving the captured wide-angle image as a captured image for the set processing target area, and
It is characterized by including.
(Claim 16)
The invention according to claim 16
For a computer of an imaging device equipped with an imaging unit capable of wide-angle shooting with a wide-angle lens,
A function of setting a region other than an region affected by external light in the captured wide-angle image as a processing target region during imaging using the wide-angle lens of the imaging unit.
A function of executing a predetermined process for recording and saving the captured wide-angle image as a captured image for the set processing target area, and
It is a program to realize.

10 Image sensor 20 Main unit 11, 21 Control unit 13, 23 Storage unit 23A Program memory 14, 24 Communication unit 16 Image sensor 16B Fisheye lens 16C Image sensor 17 Posture detection unit 25 Operation unit 26 Touch display unit 27 Clock unit a1 to a8 region

Claims (15)

An imaging device equipped with an imaging unit capable of wide-angle photography with a wide-angle lens.
A detection means for detecting a predetermined subject from an image captured by the imaging unit , and
When imaging with the wide-angle lens of the imaging unit, a predetermined region that is adversely affected by external light is excluded from the captured wide-angle image, and another region based on a predetermined subject detected by the detection means. And the setting means to set as the processing target area,
A processing means for executing a predetermined process for recording and saving the captured wide-angle image as a captured image for the processing target area set by the setting means, and a processing means.
An imaging device characterized by comprising. In order to suppress the adverse effect of external light during imaging using the wide-angle lens of the imaging unit, the setting means captures at least a central region and / or a peripheral region of the captured wide-angle image. Set as the processing target area,
The imaging device according to claim 1. The wide-angle image has a plurality of division regions formed by virtually dividing the entire image by a plurality of concentric circles corresponding to its center point.
Of the plurality of division regions, the setting means has an inner division region close to the center point of the wide-angle image as a central region, and an outer division region away from the center point as a peripheral region, at least the central portion thereof. Other division areas other than either the area or the peripheral area are set as the processing target area.
2. The imaging device according to claim 2. Further equipped with a posture detecting means for detecting the posture of the imaging device,
The setting means sets a region other than the predetermined region from the wide-angle image as the processing target region based on the posture of the imaging device detected by the posture detecting means at the time of imaging by the imaging unit. Set,
The imaging device according to any one of claims 1 to 3. Further equipped with a timekeeping means to measure the current date and time,
The setting means sets a region other than the predetermined region from the wide-angle image as the processing target region based on the current date and time measured by the timing means at the time of imaging by the imaging unit.
The imaging device according to any one of claims 1 to 4, wherein the image pickup apparatus is characterized by the above. Further provided with an acquisition means for acquiring brightness information from a wide-angle image captured by the imaging unit.
The setting means sets a region other than the predetermined region from the wide-angle image as a processing target region based on the brightness information acquired by the acquisition means.
The imaging device according to any one of claims 1 to 5, wherein the image pickup apparatus is characterized by the above. Further, a setting instruction means for instructing the setting of the processing target area by a user operation at the time of imaging by the imaging unit is provided.
Based on the user instruction from the setting instruction means, the setting means sets other areas other than the predetermined area from the wide-angle image as the processing target area.
The imaging device according to any one of claims 1 to 6, wherein the image pickup apparatus is characterized by the above. The setting means sets a processing target area so that a predetermined subject detected by the detecting means has a small portion protruding from the processing target area.
The imaging apparatus according to any one of claims 1 to 7. The setting means sets the processing target area so that the predetermined subject detected by the detecting means fits within the processing target area.
The processing means performs a process of enlarging the image portion of the processing target area set by the setting means, and then executes a process of panoramic expansion of the image portion after the enlarging process.
The image pickup apparatus according to claim 8. Further provided with a change instruction means for instructing a change of the processing target area set by the setting means by a user operation.
The setting means changes the setting of the processing target area based on the user instruction from the change instruction means.
The imaging device according to any one of claims 1 to 9, wherein the image pickup apparatus is characterized by the above. The setting means is a non-processing target when the setting of the processing target area is changed after setting other areas other than the central region and the peripheral region from the captured wide-angle image as the processing target area. The setting of the processing target area is changed so that the areas of the central area and the peripheral area, which are the areas, increase or decrease in an inversely proportional relationship.
The imaging apparatus according to any one of claims 1 to 10. The processing means executes at least one of exposure adjustment, white balance adjustment, hue correction, enlargement processing, and panoramic expansion processing on the processing target area set by the setting means.
The imaging device according to any one of claims 1 to 11. When the processing means acquires an image captured by the imaging unit in response to a shooting instruction, performs image processing, and then records and saves the image, the processing means sets the processing target area set by the setting means. Perform image processing and perform shooting processing to record and save,
The imaging device according to any one of claims 1 to 12, wherein the image pickup apparatus is characterized by the above. It is an image processing method of an image pickup apparatus provided with an image pickup unit capable of wide-angle shooting with a wide-angle lens.
The step of detecting a predetermined subject from the captured image and
When imaging with the wide-angle lens of the imaging unit, a predetermined region that is adversely affected by external light is excluded from the captured wide-angle image, and another region based on the detected predetermined subject is processed. And the steps to set as
A step of executing a predetermined process for recording and saving the captured wide-angle image as a captured image for the set processing target area, and
An image processing method characterized by including. For a computer of an imaging device equipped with an imaging unit capable of wide-angle shooting with a wide-angle lens,
A function of detecting a predetermined subject from an image to be captured and a predetermined region of the wide-angle image to be captured that is adversely affected by external light are excluded and detected during imaging using the wide-angle lens of the imaging unit. A function to set another area based on a predetermined subject as a processing target area, and
A function of executing a predetermined process for recording and saving the captured wide-angle image as a captured image for the set processing target area, and
A program to realize.

Images