JP4536527B2 - Electronic camera and image generation apparatus for generating stereo image - Google Patents

Description

  The present invention relates to an electronic camera and an image generation apparatus that are applied to imaging of a stereo image, and more specifically, a stereo capable of obtaining an appropriate printed photograph even when a multi-view stereo image is captured or generated. The present invention relates to an electronic camera and an image generation apparatus that generate an image.

  There are a wide variety of proposals for a method of photographing and recording an image including three-dimensional information and reproducing and observing the image. Among them, the so-called binocular stereo system that records two images with parallax corresponding to the viewpoints of the left and right eyes and presents them to the left and right eyes is the simplest and cheapest configuration. Since it is large, it has been used from the old days to today.

  In this binocular stereo, for so-called personal use, there is a restriction that only one person can observe at the same time, but the most basic and classic method using stereo pair images is extremely inexpensive. As a method for observing a clear image, it is still widely used today.

As a stereo imaging device using a stereo adapter, the system controller detects a stereo adapter detection unit for detecting the mounting of the stereo adapter, and analyzes the subject image signal related to the photometric area to calculate photometric information necessary for exposure control. An automatic exposure (AE) control unit and a photometry area setting unit for setting the above-described photometry area are provided, and the photometry area setting unit has a function of setting different photometry areas in the normal shooting mode and the stereo shooting mode. A technique for setting an optimal photometric area for each of the normal shooting mode and the stereo shooting mode is known (see, for example, Patent Document 1).
JP 2002-218506 A

  By the way, when a stereo image is picked up by the apparatus described in Patent Document 1 described above, it is expected that the exposure of the recorded stereo image will be appropriate. The following problems may occur in printing at a print service laboratory that is widely used in Japan.

  That is, when a recording medium on which an image is recorded is brought into a general laboratory and printing is performed, various image processing suitable for the state of each image is automatically performed for each recorded image (frame). It is generally printed out after it has been made. A typical example of this is exposure compensation. Even if an image is slightly overexposed or underexposed at the time of shooting, the image processing system of the printing machine performs a level analysis of the image signal to print the image. An image with an appropriate luminance level can be obtained by correcting the luminance level (reflectance or density) at that time.

  In the case of a normal image, the exposure correction at the time of printing is often an average process in which the central portion of the image is weighted when the image signal level is analyzed. That is, on the print machine side, if it is compared with camera exposure control, signal level analysis corresponding to center-weighted average metering (used to focus on the main subject but not cause a breakdown) is performed. A desired image is appropriately printed out by correcting the luminance level (print density of the print) output based on the analysis result.

  However, when printing the above-described stereo pair image, a problem may occur unlike a normal image. This is because the stereo pair image has two monocular images corresponding to the left and right viewpoints juxtaposed, so that the center of the subject is located at the left and right, and the boundary of the monocular image is at the center of the entire stereo image. Since the portion is located, there is a high possibility that unintentional exposure correction (erroneous correction) will occur when the normal image exposure correction is applied. That is, since this boundary portion is a portion where vignetting is likely to occur when the stereo adapter is mounted, it tends to be at a low level regardless of the original levels of both monocular images. Accordingly, it is misunderstood that the main subject is dark, and an overexposure state in which the luminance level of the original image is abnormally high is caused by exposure correction.

  Furthermore, the problem of miscorrection of exposure at the time of printing arises not only from the vignetting when the stereo adapter is mounted but also from the structure of the stereo image when the target image is not a conventional film image but a digital image. It was what you get. This is due to the following circumstances.

  In other words, a general stereo pair image that has been used conventionally has a difficulty in understanding the boundary between the two left and right monocular images. In other words, as long as you look on the display screen, it is difficult to distinguish whether it is a monocular image that is left and right that constitutes a stereo image or an image that has a similar pattern to the left and right in a normal image. .

  Only in this respect, if the vignetting due to the stereo adapter occurs remarkably, it becomes a mark for discriminating that it is a stereo photograph, and there is also an advantageous aspect. Of course, the vignetting caused by this adapter is essentially a disturbance to the image, and even if it is different from this, it is not always useful because it varies depending on the characteristics of the main imaging optical system, for example, the aperture value. .

  Therefore, in order to ensure such visual discrimination, one stereo image generated by utilizing the fact that digital image processing (image processing) is extremely easy. If the left and right monocular images are arranged apart from each other and the area between them is filled with, for example, black (luminance level 0), this area becomes a separation band of two images, so that a stereo image becomes a stereo image. It becomes possible to directly determine that the Such a region is not limited to only the region between the two images, and may be provided as an image frame surrounding the two images (for example, in the shape of a frame of glasses), and of course can perform the same function. It is.

  Therefore, it is preferable to adopt a recording format for stereo images having the above-described separation band or image frame. In this case, the black separation band is the same as the vignetting of the stereo adapter. Since it exists in the position, the same exposure error correction would occur.

  In the above, for the sake of easy understanding, the stereo method has been described as a two-lens method corresponding to both the left and right eyes, and the print system has been described as a print service laboratory that is widely used in the market. However, it is of course common to printing an image recorded by a general multi-lens stereo system having three or more eyes with a printing apparatus having an exposure correction (automatic brightness level adjustment) function. .

  Accordingly, the present invention has been made in view of the above circumstances, and a stereo in which proper brightness level (print density) control is performed even when printed out by a printing apparatus having an exposure correction function. An object of the present invention is to provide an electronic camera and an image generation apparatus that can generate an image.

In order to achieve the above object, an electronic camera for generating a stereo image according to the first aspect of the present invention includes a stereo imaging optical system that separates a subject image into a plurality of parallel subject images and has a predetermined parallax. Imaging means for photoelectrically converting a subject image formed by the stereo imaging optical system to obtain a subject image signal; exposure level detection means for calculating exposure information relating to a predetermined photometric area relating to imaging of the subject image; A partition that is an area that is inserted in the stereo image generated based on the image data of the parallel subject images separated and imaged by the stereo imaging optical system so as to separate the monocular images of the parallel subject images. a partition area setting means for setting a region, the image signal level of the partition area that is set in the partition area setting means the dew A signal level control means for controlling based on the detected exposure information by the level detection means,
It is characterized by comprising.

In order to achieve the above object, an image generation apparatus according to a second aspect of the present invention includes:
An image generation device that generates a stereo image by arranging a plurality of monocular images recorded with a predetermined parallax under a predetermined condition,
  Luminance information calculating means for calculating luminance information relating to the plurality of monocular images;
  In the stereo image, a partition area setting means for setting a partition area, which is an area inserted in order to separate the monocular images,
  Signal level control means for controlling the image signal level of the partition area set by the partition area setting means based on the luminance information about the plurality of monocular images calculated by the luminance information calculation means;
  It is characterized by comprising.

  According to the present invention, an electronic camera capable of generating a stereo image in which proper brightness level (print density) control is performed even when printed out by a printing apparatus having an exposure correction function. In addition, an image generation apparatus can be provided.

According to the first aspect of the present invention, a stereo image is generated in which proper brightness level (print density) control is performed even when printed out by a printing apparatus having an exposure correction function. An electronic camera that can be provided can be provided. Furthermore, according to the first aspect of the present invention, the apparatus further comprises exposure level detection means for calculating exposure information relating to a predetermined photometric area relating to the imaging of the subject image, and the signal level control unit is configured to detect the exposure level. Since the image signal level of the partition area is controlled based on the exposure information detected by the means, appropriate exposure level control according to the brightness of the subject can be performed.

  According to the second aspect of the present invention, the average signal level of the partition area used as a main part of the luminance level adjustment information in the printing apparatus is matched with the average exposure level of the entire monocular image. Therefore, it is possible to perform appropriate luminance level (print density) control according to the brightness of the subject.

  According to the third aspect of the present invention, the average signal level of the partition area used as a main part of the brightness level adjustment information in the printing apparatus is matched with the exposure level at the center of each monocular image. Therefore, it is possible to perform appropriate brightness level (print density) control according to the brightness of the subject.

  According to the fourth aspect of the present invention, since the partition area is set to a uniform pattern, it is very easy to perform appropriate brightness level (print density) control according to the brightness of the subject. can do.

  According to the fifth aspect of the present invention, since at least most of the inside of the partition area is set to a single color with high saturation, it is easy to determine the visual recognition as a stereo image and the brightness of the subject. In addition, appropriate brightness level (print density) control can be performed.

  According to the sixth aspect of the invention, since the partition area is set with a non-uniform pattern and including a bright part and a dark part, visual recognition as a stereo image is facilitated, and Appropriate brightness level (print density) control according to brightness can be performed.

According to the seventh aspect of the present invention, since the partition area is set to a plurality of stripes that are the repeated pattern of the bright part and the dark part, visual discrimination as a stereo image is facilitated and the brightness of the subject is set. Accordingly, it is possible to perform appropriate brightness level (print density) control according to the above.

According to the eighth aspect of the invention, since at least a large part of the interior of the partition area is set to a checker pattern that is a pattern in which the bright part and the dark part are alternately repeated vertically and horizontally, it is possible to perform visual discrimination as a stereo image. It is possible to easily control the brightness level (print density) according to the brightness of the subject.

According to the ninth aspect of the present invention, since the partition region is formed as a partial region of the stereo frame pattern that continuously configures the stereo frame pattern configured to surround the entire parallel subject image, the stereo image As a result, it is possible to make it easy to perform visual discrimination and to perform appropriate luminance level (print density) control according to the brightness of the subject.

Further, according to the invention described in claim 1 0, since the number of the plurality of parallel object image formed by the stereoscopic imaging optical system is 2 corresponding to the left and right eyes, the present invention, the most widespread The present invention can be applied to a binocular stereo image.

According to the invention of claim 1 1, the stereoscopic imaging optical system, since it is obtained by mounting a removable stereo adapter monocular (non stereo) optical system, the problems caused by vignetting of the stereo adapter occurs As a result, an appropriate luminance level (print density) control according to the brightness of the subject can be performed.

According to the invention of claim 1 2, and generates a stereo image that proper brightness level when it is printed out by the printing apparatus having a correcting function (printing density) control was made to take place of the exposed It is possible to provide an image generation apparatus that can perform the above-described processing. Furthermore, according to the twelfth aspect of the present invention, there is further provided luminance level detecting means for calculating luminance information relating to the plurality of monocular images, wherein the signal level control means is the luminance detected by the luminance level detecting means. Since the image signal level of the partition area is controlled based on the information, appropriate exposure level control according to the brightness of the monocular image can be performed.

According to the invention described in claims 1 to 3, to align at the printing apparatus a mean signal level of the partition area that is used as a major part of the luminance level adjustment information, the average exposure level of the entire respective monocular images Therefore, it is possible to perform appropriate brightness level (print density) control according to the brightness of the subject.

According to the invention described in claim 1 4, adjust the average signal level of the partition area that is used as a major part of the luminance level adjustment information, the exposure level of the center of each monocular images at the printing device Therefore, appropriate brightness level (print density) control according to the brightness of the subject can be performed.

According to the invention described in claim 15 , since the partition area is set to a uniform pattern, an appropriate luminance level (print density) control according to the brightness of the subject can be performed very easily. Can be.

According to the invention described in claim 16 , since at least most of the inside of the partition area is set to a single color with high saturation, it is easy to determine the visual recognition as a stereo image and the brightness of the subject. Appropriate brightness levels (print density) can be controlled accordingly.

According to the invention described in claim 17 , since the partition area is set with a non-uniform pattern and including a bright part and a dark part, visual recognition as a stereo image is facilitated, and Appropriate brightness level (print density) control according to brightness can be performed.

According to the invention described in claim 18 , since the partition area is set to a plurality of stripes which are the repetitive pattern of the bright part and the dark part, visual recognition as a stereo image is facilitated, and the brightness of the subject is set. Accordingly, it is possible to perform appropriate brightness level (print density) control according to the above.

According to the nineteenth aspect of the present invention, since at least most of the inside of the partition area is set to a checker pattern that is a pattern in which the bright part and the dark part are alternately repeated vertically and horizontally, it is possible to perform visual discrimination as a stereo image. It is possible to easily control the brightness level (print density) according to the brightness of the subject.

According to the invention of claim 2 0, since the formation of the partition area as partial area of the stereo frame pattern for continuously forming a stereo frame pattern that is configured to surround the entire the parallel object image, stereo Visual discrimination as an image can be made extremely easy, and appropriate brightness level (print density) control according to the brightness of the subject can be performed.

Further, according to the invention described in claim 2 1, because the number of the plurality of parallel object image formed by the stereoscopic imaging optical system is 2 corresponding to the left and right eyes, the present invention, the most widespread The present invention can be applied to a binocular stereo image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a configuration of an electronic camera according to the first embodiment of the present invention.

  This electronic camera is composed of a camera body 1, a lens unit 5 having a lens barrel, and a stereo adapter 10 which is a stereo adapter means for taking a stereo image.

  In the electronic camera of this embodiment, a mirror type stereo adapter 10 can be attached to and detached from the lens unit 5. This stereo adapter 10 has a configuration in which mirrors 11 and 12 are arranged at positions separated by a parallax, and mirrors 13 and 14 for guiding light reflected by these mirrors 11 and 12 to the camera side are arranged. It has become.

  Light that has passed through the mirrors 11 and 13 and the mirrors 12 and 14 in the stereo adapter 10 is guided to the exposure control mechanism 22 and further to the half mirror 31 in the camera body 1 through the photographing lens group 21 in the lens unit 5. It is burned.

  The lens unit 5 includes a photographing lens group 21, an exposure control mechanism 22, a lens driving mechanism 23, a lens driver 24, and an exposure control driver 25.

  The photographing lens group 21 is a main imaging optical system (non-stereo optical system) capable of normal (monocular) imaging in a state where the stereo adapter 10 is not attached, and adjustment of focusing and zooming is performed by a lens driving mechanism 23. Driven by. That is, the stereo adapter 10 and the main imaging optical system constitute a stereo imaging optical system. The lens driving mechanism 23 is controlled by the lens driver 24. The exposure control mechanism 22 is a mechanism for controlling the diaphragm and shutter device (not shown) of the photographic lens group 21. The exposure control mechanism 22 is controlled by an exposure control driver 25.

  The light guided from the lens unit 5 to the camera body 1 passes through the half mirror 31 and forms an image on a CCD color imaging device 34 as an imaging unit via a low-pass and infrared cut filter 32. . The CCD color image pickup device 34 is an image pickup means controlled by a CCD driver 35, where a subject image is photoelectrically converted into an electric signal. The CCD color imaging device 34 is, for example, an interline type with a vertical overflow drain structure and a progressive (sequential) scanning type.

  The signal photoelectrically converted by the CCD color imaging device 34 is a digital process for performing color signal generation processing, matrix conversion processing, and other various digital processing via a preprocessing circuit 36 including an A / D converter and the like. It is output to the circuit 39. In the digital process circuit 39, color image data is generated by processing the digitized image signal.

  The digital process circuit 39 is connected with an LCD display unit 40 and a memory card 42 such as a CF (Compact Flash Memory Card) or a smart media via a card interface (IF) 41. The LCD display unit 40 displays color image data, and the memory card 42 stores color image data.

  The memory card 42 can be loaded into an external personal computer 60. Therefore, the image recorded on the memory card 42 can be displayed on the personal computer 60, image processing, and the like. Furthermore, it is possible to print out by a printer (not shown).

  The half mirror 31 is configured such that a part of an incident subject image is reflected, and the reflected light is guided to the AF sensor module 45. The AF sensor module 45 is for performing focus detection based on a light beam incident through the photographing lens group 21. The AF sensor module 45 includes a pupil-division separator lens 46 and an AF sensor 47 composed of a line sensor.

  A system controller (CPU) 50 is for comprehensively controlling each part in the camera body 1 and the lens unit 5. The system controller 50 includes the lens driver 24, the exposure control driver 25, the CCD driver 35, the preprocess circuit 36, the digital process circuit 39, the AF sensor module 45, the operation switch unit 52, An operation display unit 53, a nonvolatile memory (EEPROM) 51, and a stereo changeover switch (SW) 54 are connected.

  The operation switch unit 52 includes various switches such as a release switch and a shooting mode setting. The operation display unit 53 is a display unit for displaying the operation state and mode state of the camera.

  The EEPROM 51 is a memory for storing various setting information and the like. The stereo changeover switch 54 is a changeover switch for switching modes when the stereo adapter 10 is attached to the lens unit 5. Here, the switching of the shooting mode is performed by operating the stereo switch 54, but the present invention is not limited to this. For example, a detection function may be provided in the stereo adapter 10 to automatically switch the shooting mode.

  The system controller 50 controls the exposure of the CCD color imaging device 34 by the exposure control mechanism 22 and the CCD driver 35 to perform exposure (charge accumulation) and signal readout. Then, it is taken into the digital process circuit 39 via the pre-process circuit 36, and after various signal processing is performed here, it is recorded on the memory card 42 via the card interface 41.

  The strobe 57 emits flash as a light emitting means, and is controlled by the system controller 50 via the exposure control driver 25 in the lens unit 5.

  The system controller 50 further includes a partition area setting unit 50a which is a partition area setting unit, a stereo pair image (SPM) composition unit 50b, and an electronic image file SGM (Stereo Gram in Multimedia) generation unit 50c of a predetermined format. The exposure control unit 50d is a photometry and exposure control unit, and the photometry area setting unit 50e is a photometry area setting unit. For the SPM and SGM described above, see Japanese Patent Application Laid-Open No. 2002-77942, which is an earlier application by the present applicant.

  The partition area setting unit 50a is the specific data (image pattern) of the boundary part of the monocular image constituting the stereo image when the stereo image is captured, in other words, the area that is a separation band (hereinafter referred to as the partition area). Functionally, it can be said to be a part of the SPM synthesizing unit 50b described below in terms of function, but because of the central role in the present invention, this part is illustrated separately. Is.

  The SPM synthesis unit 50b is for obtaining an SPM image from a monocular image, and serves as a signal level control unit that controls the image signal level of the partition area set by the partition area setting unit 50a. It also fulfills. Furthermore, the SGM generation unit 50c is provided for generating SGM image data from the SPM image.

  The exposure control unit 50d is a control means for calculating exposure information necessary for exposure control by analyzing a subject image signal related to a photometric area, or for calculating luminance information related to a plurality of monocular images. Exposure (luminance) It also serves as a level detector. The photometric area setting unit 50e is for setting the photometric area described above.

  The photometry area setting unit 50e has a function of setting different photometry areas in the normal shooting mode and the stereo shooting mode, and sets an optimal photometry area for each of the normal shooting mode and the stereo shooting mode. Here, in the normal mode, the entire shooting range (shooting image frame) on the image sensor, and in the stereo shooting mode, the left and right image frames (image frames for each monocular image) provided on the image sensor. Average photometry is applied to the entire area. Therefore, in each shooting mode, almost proper exposure control is performed on the entire subject. Of course, this is not a simple average metering, but various conventionally known photometry methods for each image frame (center-weighted average metering with a weight in the center, or, for example, 70% of the image frame concentric both vertically and horizontally) Of course, rectangular (partial photometry of an appropriate area such as an area of about 50%) may be applied.

  FIG. 2 is a diagram showing a configuration of a mirror type stereo adapter attached to the electronic camera of the present embodiment.

  In FIG. 2, a mirror-type stereo adapter 10 is detachably attached to a lens unit 5 having a lens barrel attached to the camera body 1. The stereo adapter 10 includes mirrors 11 and 12 arranged at positions separated by a parallax, and mirrors 13 and 14 for guiding the light reflected by the mirrors 11 and 12 to the camera side. The

  The light incident on the left-eye viewing mirror 12 of the stereo adapter 10 forms an image on the region L of the image sensor 34 via the mirror 14 and the photographing lens group 21. Similarly, the light incident on the right-eye viewing mirror 11 is imaged in the region R of the image sensor 34 via the mirror 13 and the photographing lens group 21.

  In the subject image formed in each area of the LR, vignetting actually occurs at the boundary portion as described above, or the imaging position is deviated. Therefore, the vignetting is avoided or the misalignment is corrected. Therefore, two left and right image frames are set by trimming a predetermined portion in each region, and two image signals in the two left and right image frames read from the image sensor 34 are recorded. Monocular image. As described above, at the time of shooting (exposure), exposure control is performed so that the exposure of these two monocular images is appropriate, and one stereo image (SPM) in which these two images are arranged at predetermined positions. ) Is finally generated, and after being compressed as necessary, it is recorded in the memory card 42 as a digital image file (SGM) of a predetermined format with attached data (metadata) added. It is the same as each patent document cited in the above, and detailed description is omitted. However, since the setting of the partition area data (image pattern) is performed when the SPM is generated, it is the main point of the present invention, and will be described in detail below.

  Next, the data setting operation of the partition area of the electronic camera according to the first embodiment of the present invention will be described with reference to the flowchart of FIG. This operation is controlled by the system controller 50. Since the data setting of the partition area is related only to stereo imaging, it is not performed when the mode switch 54 provided in the camera body 1 is set to the normal mode, that is, during normal imaging. Needless to say.

  Then, in step S1, the average luminance signal level of the image is calculated as the average exposure level for the entire left and right monocular images.

  Supplementally, in the sense that the control target value of the exposure control system is the luminance signal level of the image, “exposure level” and “luminance signal level” correspond to each other equivalently. That is, the exposure level controlled by the exposure control unit 50d corresponds to the luminance signal level of the image recorded as a result, and particularly the luminance of the captured video signal as in the electronic camera of this embodiment. In the case of a method of obtaining exposure information by analyzing the signal level, this correspondence is straightforward. Therefore, for a general stereo image generation apparatus that does not have an imaging function, for example, generates one SPM from two (typically a plurality of) recorded monocular images corresponding to two left and right viewpoints. However, in many cases, it can be applied in exactly the same manner if the gamma characteristic (nonlinear processing) added to the image is properly considered.

  In addition, when using, for example, a photodiode sensor dedicated to photometry separately from the CCD 34 that is an image pickup device, the luminance signal level of the video signal is not necessarily analyzed, and the above-described equivalent relationship is relied upon based on the equivalent relationship described above. It is possible to calculate the exposure level based on information from the sensor.

The calculation of the average luminance signal level here is performed, for example, as follows using the captured image signal. That is, the RGB value (signal level) of each pixel is represented by R, G, B, omitting the coordinate notation, and the average luminance level is L.
L = 1 / N · ΣY
However, Y = C ₁ R + C ₂ G + C ₃ B
Is required. Here, Σ represents the sum relating to the target pixel region, N represents the number of pixels in the region, C _{1 to} C ₃ are luminance matrix coefficients, and for example, in the NTSC system, C ₁ = 0.3, C ₂ = 0.59, a C ₃ = 0.11.

  In order to prevent erroneous exposure correction due to the partition area during printing, the simplest way is to fill the partition area with a uniform pattern having the same luminance signal level as the obtained average luminance signal level, that is, luminance L. It ’s fine. In the present embodiment, from the viewpoint of further improving the visibility discrimination, monochromatic blue ((R, G, B) = (0, 0, B)), which is a highly saturated color, is used.

For this reason, in step S2, the value of B that fills the partition area is calculated. From the luminance matrix coefficient, B = L / C ₃ . That is, (R, G, B) = (0, 0, L / C ₃ ) for all the pixels in the partition area, and only one color of the blue component with high saturation is obtained.

  Thereafter, in step S3, a partition area is generated according to the value of B calculated as described above.

  FIG. 4 is a diagram showing an example of an SPM made up of left and right monocular images and partition areas created in this way. In the figure, a partition area 34Sa indicated by diagonal lines in the figure is formed between the left image 34L and the right image 34R. In the case of the first embodiment, as described above, the partition region 34Sa has only one color of B (blue) that does not include R (red) and G (green) components.

  Such a pattern based on color components is determined to be clearly different from that of a normal subject. Therefore, the image shown in FIG. 4 is not a normal (monocular) image in which subjects similar to the left and right are arranged, but can be easily determined to be a stereo image including the partition area 34Sa. Since the brightness level of the partition area is controlled, it is possible to prevent the exposure from being erroneously corrected during printing.

  In the above-described embodiment, the partition area 34a is described with only one color of the B (blue) component as a uniform pattern. However, the present invention is not limited to this, but only the R (red) component or G (green). Of course, only the component may be used. Further, the partition area may be configured by any same color (for example, neutral gray) that is not one color of the R, G, and B components. Further, it is possible to make most of the interior of the partition area a single color with high saturation without filling the partition area with a single color with high saturation.

  Furthermore, in the first embodiment described above, the partition area is generated using the average exposure level (average luminance level) detected by the exposure control unit 50d as the exposure level detection means. The partition area may be generated by detecting the exposure level (luminance level) at the center of the monocular image frame. In addition, since each monocular image in the stereo image has a substantially similar pattern, the exposure level (luminance level) may be detected by using one image instead of all the images.

(Second Embodiment)
In the first embodiment described above, an example in which the partition area is formed with only one color of the same component has been described. However, other than this, it is also possible to form a pattern that is clearly different from the subject and use it as a partition area. Therefore, in the second embodiment, an example in which a repeating pattern of stripes of two colors is formed will be described. Here, white (bright part) and black (dark part) are used as two colors, and (255, 255, 255) and (0, 0, 0) are used as saturation levels (maximum value, minimum value), that is, RGB values. .

  Since the configuration of the electronic camera in the second embodiment is basically the same as that shown in FIG. 1, the same parts are denoted by the same reference numerals, Description is omitted.

  FIG. 5 is a flowchart for explaining the operation of setting a partition area in SPM generation during stereo shooting of the electronic camera according to the second embodiment of the present invention. This operation is controlled by the system controller 50.

  First, in step S11, the average luminance level L of the left and right images is calculated as in the first embodiment.

  Subsequently, in step S12, the stripe of the partition area is calculated. Specifically, for example, when the partition region 34Sb as shown in FIG. 6 is formed, a black and white stripe pattern is formed in which the outer portion in contact with each monocular image is arranged in black. In this case, the black stripes are black and the white stripes are equal in width to each other. However, under the condition that the widths of black and white can be arbitrarily set, the total width of the black stripe pattern is WB. When the total of the white stripe patterns is WW and the width of the partition area 34Sb is WP, WB and WW are calculated as follows.

That is, the average brightness level of this partition area is
255 × WW / (WB + WW) = 255 × WW / WP
In order to make this equal to the average luminance level L obtained in step S11,
255 × WW / WP = L
Therefore
WW = WP × L / 255,
WB = WP × (255−L) / 255
What should I do? In the case of 6 white stripes and 7 black stripes as illustrated in FIG. 6, the width of each stripe is WW / 6 and WB / 7, respectively.

  In step S13, the partition area 34Sb thus calculated is actually generated as an image.

  Such a partition area 34Sb is determined to be clearly different from a normal subject. Therefore, the image shown in FIG. 6 is not a normal (monocular) image in which subjects similar to the left and right are arranged, but can be easily determined to be one stereo image including the partition region 34Sb. As described above, since the brightness level of the partition area is controlled, it is possible to prevent exposure from being erroneously corrected during printing.

  In the above-described second embodiment, the outer stripe of the partition area 34Sb is configured as a dark portion and the inner stripe is configured as a bright portion. .

(Third embodiment)
FIG. 7 is a flowchart for explaining the partition area setting operation of the electronic camera according to the third embodiment of the present invention. This operation is controlled by the system controller 50.

  In the third embodiment, the partition area is configured by repeating a stripe pattern, whereas the second embodiment described above is configured by a checker pattern.

  The configuration of the partition area according to the third embodiment is the same as that of steps S11 to S13 in the flowchart of FIG. 5 according to the second embodiment described above, except for step S22.

  In the case of the checker pattern, unlike the case of the stripe, even if the pattern interval (corresponding to the width of the stripe) is changed, the black-and-white area ratio (except for the border) remains 50%. In this case, the average luminance level of the entire pattern is made equal to the average luminance level L obtained in step S21 by adjusting the level without setting the black and white as the saturation level.

Therefore, in step S22, a signal level (RGB value) assigned to each monochrome pixel of a predetermined checker pattern is calculated. The specific calculation formula is an example
When L <128: White (2L, 2L, 2L) Black (0, 0, 0)
For L> 127:
White (255, 255, 255) Black (2L-255, 2L-255, 2L-255)
What should I do?

  FIG. 8 is a diagram showing examples of left and right images and partition areas created in this way. In the figure, a partition region 34Sc is formed between the left and right images 34L and 34R by a checker pattern of two colors of black and white. Since the partition area 34Sc is determined to be clearly different from a normal subject, the image shown in FIG. 8 is not a normal (monocular) image in which subjects similar to the left and right are arranged, but the partition area 34Sc. It is possible to easily determine that the image is a single stereo image including the image, and at the same time, since the brightness level of the partition area is controlled as described above, it is possible to prevent the exposure from being erroneously corrected during printing. .

(Fourth embodiment)
In the first to third embodiments described above, the example in which the partition area is arranged at the center of the left and right images has been described. However, the present invention is not limited to this. That is, since a partition area is provided to distinguish between a normal image and a stereo image, for example, as shown in FIG. 9, the periphery of the left image 35L and the right image 35R is covered (as a frame of glasses as a whole. The partition area 35S may be formed. Further, the partition area 35S
Only a part of the area may be provided as the partition area.

  Of course, the pattern of the partition area in this case may be one that can be reliably identified from the subject image, such as one color, repeated stripes, checker pattern, or pattern.

  In the above-described embodiment, for the sake of simplicity of explanation, the number of bits of the digital value is represented by 8 bits, and the γ correction is not particularly mentioned and is assumed to be linear. However, in order to set the average luminance level of the partition area more strictly, the same luminance characteristic as that of the main image (two monocular images) is assumed for the partition area. In the case of being influenced by the above, it is desirable to calculate after de-γ correction and returning to linear.

  Moreover, although the said embodiment was an electronic camera, ie, an imaging recording device, this invention is not limited to this. As an example, it has a slot that can be connected to and removed from a memory medium, or is configured to input and output an image via a network connection. A stereo image generation apparatus having a function of generating one SPM (SGM) from two recorded monocular images corresponding to two left and right viewpoints imaged by the apparatus is an embodiment of another aspect of the present invention. Are listed in It goes without saying that all of the above embodiments are also applied as they are to this embodiment, except for parts related to imaging.

  In the above description, the stereo system has been described as a binocular system corresponding to both the left and right eyes. However, the present invention can be similarly applied to a general multi-view stereo system having three or more eyes. It is.

It is a block diagram which shows the structure of the electronic camera which concerns on the 1st Embodiment of this invention. It is the figure which showed the structure of the mirror type stereo adapter with which the electronic camera of this embodiment is mounted | worn. It is a flowchart explaining the operation | movement of the partition area | region setting of the electronic camera by the 1st Embodiment of this invention. FIG. 4 is a diagram showing an example of left and right images and partition areas created according to the partition area setting operation of FIG. 3. It is a flowchart explaining the operation | movement of the partition area | region setting of the electronic camera by the 2nd Embodiment of this invention. FIG. 6 is a diagram illustrating an example of left and right images and partition areas created according to the partition area setting operation of FIG. 5. It is a flowchart explaining the operation | movement of the partition area | region setting of the electronic camera by the 3rd Embodiment of this invention. FIG. 8 is a diagram showing an example of left and right images and partition areas created according to the partition area setting operation of FIG. 7. It is the figure which showed the example of the left and right image and partition area which were produced according to the partition area setting operation | movement of the electronic camera by the 4th Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Camera body, 5 ... Lens unit, 10 ... Stereo adapter, 11, 12, 13, 14 ... Mirror, 21 ... Shooting lens group, 22 ... Exposure control mechanism, 25 ... Exposure control driver, 31 ... Half mirror, 32 ... Filters 34... CCD color imaging device 35. CCD driver 36. Preprocess circuit 39. Digital process circuit 40. LCD display unit 41 Card interface (IF) 42 Memory card 45 AF sensor module , 46 ... Separate lens, 47 ... AF sensor, 50 ... System controller (CPU), 50a ... Partition area setting unit, 50b ... SPM synthesis unit, 50c ... SGM generation unit, 50d ... Exposure control unit, 50e ... Photometry area setting unit 51 ... Nonvolatile memory (EEPROM) 52 ... Operation switch (SW , 53 ... operation display unit, 54 ... stereo switching switch, 60 ... personal computer.

Claims (21)

A stereo imaging optical system that separates a subject image into a plurality of parallel subject images having a predetermined parallax; and
Imaging means for photoelectrically converting a subject image formed by the stereo imaging optical system to obtain a subject image signal;
Exposure level detection means for calculating exposure information relating to a predetermined photometric area relating to the imaging of the subject image;
A partition that is an area that is inserted in the stereo image generated based on the image data of the parallel subject images separated and imaged by the stereo imaging optical system so as to separate the monocular images of the parallel subject images. Partition area setting means for setting the area;
Signal level control means for controlling the image signal level of the partition area set by the partition area setting means based on the exposure information detected by the exposure level detection means ;
An electronic camera for generating a stereo image, comprising:   2. The electronic camera for generating a stereo image according to claim 1, wherein the signal level control means controls the average signal level of the partition area to a level that substantially matches the average exposure level of the parallel subject images. .   2. The stereo according to claim 1, wherein the signal level control means controls the average signal level of the partition area to a level that substantially matches an exposure level of a central portion of the monocular images of the parallel subject images. An electronic camera that generates images.   4. The electronic camera for generating a stereo image according to claim 1, wherein the partition area setting means sets the partition area to a uniform pattern.   The electronic camera for generating a stereo image according to any one of claims 1 to 3, wherein the partition area setting means sets at least most of the interior of the partition area to a single color with high saturation. .   The stereo image according to any one of claims 1 to 3, wherein the partition area setting means sets the partition area with a non-uniform pattern and includes a bright part and a dark part. Electronic camera to generate. 7. The electronic camera for generating a stereo image according to claim 6, wherein the partition area setting means sets the partition area to a plurality of stripes which are a repetitive pattern of the bright part and the dark part . 7. The stereo image according to claim 6, wherein the partition area setting means sets a checker pattern which is a pattern in which the bright part and the dark part are alternately repeated vertically and horizontally for at least most of the interior of the partition area. Producing electronic camera. The partition area setting means forms the partition area as a partial area of the stereo frame pattern that continuously constitutes a stereo frame pattern configured to surround the entire parallel subject image. An electronic camera that generates the stereo image according to any one of 1 to 8 . 10. The stereo image according to claim 1, wherein the number of parallel subject images formed by the stereo imaging optical system is 2 corresponding to the left and right eyes. Electronic camera. The electronic camera for generating a stereo image according to any one of claims 1 to 10 , wherein the stereo imaging optical system is a monocular optical system with a detachable stereo adapter attached thereto. An image generation device that generates a stereo image by arranging a plurality of monocular images recorded with a predetermined parallax under a predetermined condition,
  Luminance information calculating means for calculating luminance information relating to the plurality of monocular images;
  In the stereo image, a partition area setting means for setting a partition area, which is an area inserted in order to separate the monocular images,
  Signal level control means for controlling the image signal level of the partition area set by the partition area setting means based on the luminance information about the plurality of monocular images calculated by the luminance information calculation means;
  An image generation apparatus comprising: 13. The image generation apparatus according to claim 12, wherein the signal level control means controls the average signal level of the partition area to a level that substantially matches the average luminance level of the plurality of monocular images. 13. The image according to claim 12, wherein the signal level control means controls the average signal level of the partition area to a level that substantially matches a luminance level of a central portion of each of the plurality of monocular images. Generator . 15. The image generation apparatus according to claim 12, wherein the partition area setting means sets the partition area to a uniform pattern . 15. The image generation apparatus according to claim 12, wherein the partition area setting means sets at least a large part of the partition area to a single color with high saturation . 15. The image generation apparatus according to claim 12, wherein the partition area setting unit sets the partition area with a non-uniform pattern and including a bright part and a dark part. . 18. The image generation apparatus according to claim 17 , wherein the partition area setting unit sets the partition area to a plurality of stripes that are repetitive patterns of the bright part and the dark part . 18. The image generation according to claim 17 , wherein the partition area setting means sets a checker pattern, which is a pattern in which the bright part and the dark part are alternately repeated vertically and horizontally, at least most of the interior of the partition area. apparatus. The partition area setting means forms the partition area as a partial area of the stereo frame pattern that continuously constitutes a stereo frame pattern configured to surround the entire parallel subject image. 20. The image generation device according to any one of 12 to 19 . 21. The image generation apparatus according to claim 12, wherein the number of the parallel subject images formed by the stereo imaging optical system is two corresponding to the left and right eyes .

Images