JP4309740B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention relates to a photographing apparatus and a photographing method.

As a conventional technique, there is disclosed a digital camera having a two-shot mode in which a photographed image of a previously photographed subject and a photographed image of another subject different from the subject photographed next are combined to generate a two-shot image ( For example, see Patent Document 1).
In the above-described digital camera, when the two-shot mode is set, the previously captured image is read from the memory and displayed on the LCD device (liquid crystal display device), and the reflected light from the subject is reflected on the LCD of the LCD device at the next shooting. Since the image captured last time is displayed on the LCD, the photographer can visually recognize the superimposed image of the subject and the last photographed image. Adjust the camera angle so that the included subject and the subject to be captured this time are aligned, that is, a two-shot photograph, or the background of the subject included in the previously captured image and the background of the subject to be captured this time are approximately the same Adjust the camera angle as follows.
JP 2003-189160 A (paragraphs 0020 and 0038)

However, in order to generate a composite image (two-shot image), the above-described conventional digital camera reads the previously captured image into the memory, reads the previously captured image again from the memory, and then reads it from the memory. The next subject must be photographed so that it is superimposed on the previously photographed image that has been taken out and displayed on the LCD device (liquid crystal display device), and the photographing is performed in multiple (two) times. In addition, there is a problem that the photographing work is troublesome.
In addition, in order to obtain a composite image (two-shot image), photographing is performed in multiple times (twice), so it is impossible to avoid a change in photographing state due to a deviation in photographing time. That is, there is a problem in that the brightness of the surroundings, the appearance of shadows, the positions of people and objects in the background, etc. change, and there is a risk of inconsistency in the composite image.

  The problem to be solved by the present invention is that it is impossible to solve the troublesome shooting work that has occurred in the above-mentioned prior art and to avoid changes in the shooting situation due to a shift in shooting time, and there is a contradiction in the composite image. Examples of solutions to problems that may occur are examples.

The imaging apparatus according to claim 1, a first imaging unit that images a first subject to form a first captured image, and a second imaging unit that images a second subject to form a second captured image. When the first imaging means and second imaging means simultaneously drives the, simultaneously imaging means to perform imaging at the same time, an image synthesizing means for synthesizing the second captured image with at least the first captured image, advance possess a memory means for storing the image created or captured partial human body, said image combining means, in addition to the synthesizing function of the said first captured image a second photographic image, the second The image processing apparatus includes means for combining the captured image and the partial human body image to form a human body combined image and combining the human body combined image and the first captured image .

According to a seventh aspect of the present invention, there is provided a photographing method in which a first photographing unit for photographing a first subject to form a first photographed image and a second photographing unit for photographing a second subject to form a second photographed image. An imaging method using an imaging device having a photographing means, wherein a partial human body image created or photographed in advance is stored in a built-in memory means, and the first photographing means and the second photographing means Are simultaneously photographed, and the photographed second photographed image and the partial human body image are combined to form a human body combined image, and the first photographed image and the human body jointed It is characterized by combining with an image .

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a functional block diagram of a photographing apparatus according to an embodiment of the present invention.
As shown in FIG. 1, the photographing apparatus 10 in the present embodiment is a first photographing means that is a first photographing means for photographing a subject on the front side of the photographing apparatus (a front subject) to form a first photographed image. A, a rear side photographing means B which is a second photographing means for photographing a subject on the back side of the photographing apparatus (a subject on the back side) to form a second photographed image, a front side photographing means A and a rear side photographing means B And an electronic shutter unit 25 that is a simultaneous photographing unit that simultaneously performs photographing, and an image composition unit 27 that is an image composition unit that synthesizes the first photographed image and the second photographed image simultaneously photographed. It is characterized by that.

  Further, the photographing apparatus 10 will be described in detail. As shown in FIG. 1, the lenses 11 and 12 include an autofocus mechanism and a zoom mechanism that can adjust the focal position by a stepping motor or the like. In addition, you may use the focal distance fixed lens provided with the auto-focus mechanism as the lenses 11 and 12.

  In addition, imaging elements (CCD) 13 and 14 having an electronic shutter mechanism are arranged at positions corresponding to the focal positions of the lenses 11 and 12. Light reflected from the subject and incident on the lenses 11 and 12 is imaged on the light receiving surfaces of the image sensors 13 and 14. The image sensors 13 and 14 are driven in synchronization with a predetermined timing signal, and output a signal corresponding to the amount of light received by the photoelectric conversion cell on the light receiving surface. The lens 11 and the image pickup device 13 and the lens 12 and the image pickup device 14 constitute a front side photographing means A and a back side photographing means B, respectively, as an image pickup optical system.

  The analog signal processing units 15 and 16 amplify the signals input from the image sensors 13 and 14 and shape the waveforms. These analog signal processed outputs are converted into digital data at the timings by the A / D converters 17 and 18, respectively, and connected to the digital signal processors 19 and 20, respectively.

  The digital signal processing units 19 and 20 perform predetermined digital signal processing on the input digital signals and store them in the memory 22 through the data bus 21 as image files. The memory 22 can also temporarily store an image file read for search. At this time, if there is an instruction to write to the memory card, the stored image file can be written to the memory card via the external interface 23 after being compressed by the compression / decompression unit 29.

In addition to the digital signal processing units 19 and 20, the memory 22 and the external interface 23 via the data bus 21, the CPU (Central Processing Unit) 24 has an electronic shutter unit 25 as a simultaneous photographing unit, a display unit 26, an image. A combining unit 27 and an input unit 28 are connected.
Here, a signal is generated by the operation of the shutter button (trigger generating means) 49, and when the signal is input to the electronic shutter unit 25, the signal is triggered and the electronic shutter unit 25 is actuated, and a plurality of signals are simultaneously generated. By driving the shutter gates of the image sensors (CCDs) 13 and 14 (two in this case) and sweeping the accumulated charges to the shutter drain, exposure and shutter speed are controlled.

  The display unit 26 also displays a shooting / playback mode, zoom magnification, remaining battery level, date and time, a screen for setting a mode, a subject image, and the like. The image synthesis unit 27 generates a synthesized image by synthesizing the image signals from the digital signal processing units 19 and 20 temporarily stored in the memory 22. The CPU 24 manages and controls the operation of each circuit block from the digital signal processing units 19 and 20 connected to the data bus 21 to the input unit 28.

FIG. 2 is an explanatory diagram showing a preview screen displayed on the display unit 26 prior to generation of a composite image.
In the present embodiment, a part of the second photographed image obtained by photographing the back side of the photographing device 10 (for example, a photographer) on the first photographed image obtained by photographing the front side of the photographing device 10. Are displayed on the display unit 26 so as to overlap each other. As a result, the position of the second subject (photographer itself) to be placed side by side in the first subject (photographing target) is determined while adjusting the camera angle, the display image size, and the like.

FIGS. 2A and 2B show captured images 34 and 31 that are simultaneously obtained on the display unit 26 by the front-side imaging unit A and the back-side imaging unit B. FIG.
In the present embodiment, the second subject 32 in the captured image 31 on the display unit 26 is positioned virtually relative to the first subject 35 in the captured image on the same display unit 26 as indicated by a dotted line. The captured images as shown in FIG. 2C are obtained. After the captured image shown in FIG. 2C is obtained, appropriate image processing is performed on the subject size, background, and the like, and the shutter button 49 is pressed once to obtain a photograph of the desired composite image 36.

  FIG. 3 is an external view of the photographing apparatus 10 in the present embodiment. The housing of the photographing apparatus 10 is substantially box-shaped, and the front and rear lenses 11 and 12 for the front-side photographing means A capable of photographing the front side and the rear-side photographing means B capable of photographing the rear side are provided on the front and back sides. It is provided independently or separately.

Then, a signal is generated by operating the shutter button 49, and the signal is input to the electronic shutter unit 25, so that the electronic shutter unit 25 is actuated by the signal as a trigger, and the lenses 11 and 12 are connected to the photographing device 10. Take a picture of the subject on the front side and back side at the same time.
Further, a finder 42 is provided on the back surface of the photographing apparatus 10.

Further, a photometric sensor 43, a distance measuring sensor 44, a strobe 45 for emitting illumination light when photographing in a dark environment, and the like are provided on the front surface of the photographing apparatus 10. A battery storage unit 46 for a battery is provided on the left side of the photographing apparatus 10, and a memory card storage unit 47 for a memory card as an information recording medium is provided on the right side.
In the example shown in FIG. 3, only one strobe 45 is provided. However, a plurality of strobes may be provided by installing another strobe in the housing of the photographing apparatus 10 or attaching an electric contact to provide a strobe. May be used so that illumination light can be emitted simultaneously to the front side and the back side.

  A mode dial 48 for selecting a shooting mode and the like is provided on the upper surface of the photographing apparatus 10, and a shutter button 49 is provided at the center of the mode dial 48. The mode dial 48 can select any of an auto shooting mode, a manual shooting mode, a self-timer shooting mode, a playback mode, a PC mode for connecting to a personal computer and outputting an image, and various initial condition setting modes. .

  In addition to the lens 12, a display unit 26 such as a liquid crystal display device, a cross button 50, a strobe button (not shown), and the like are provided on the rear surface of the photographing apparatus 10. The cross button 50 is used to select a button on the display screen when the display unit 26 is in the various item selection screen, move the cursor, or enlarge, reduce, or combine the displayed images. Also, a photometric sensor 51 and a distance measuring sensor 52 are provided on the back surface.

Next, a procedure for displaying a photographed image (preview image) and composite photograph processing executed by the CPU 24 and the image composition unit 27 will be described.
First, when a composite photo is to be taken, the photographer (second subject 32) gathers in a composite photo (group photo), for example, three photographed subjects (first subject 35). get.

  Next, as shown in FIG. 4, the lens 11 on the front side of the photographing apparatus 10 is directed toward three first subjects 35 who are people who gathered, while the lens 12 on the back side is the first photographer himself / herself. Aimed at the second object 32. Thereby, the captured image (preview image) of the first subject 35 and a part of the captured image (preview image) of the second subject 32 are displayed on the display unit 26. Here, as in the case described with reference to FIG. 2, it is determined on which position of the first subject 35 on the display unit 26 the second subject (photographer) 32 is to be placed side by side.

In this case, as shown in FIG. 4, the photographer himself extends his hand holding the photographing device 10 to obtain a photographed image of his / her preview.
At this time, the person or the like who is the first subject 35 can take an arbitrary distance from the photographing apparatus 10, so that the whole body can be captured, but the second subject 32. Since the distance from the photographer is only the arm length, it is usually difficult to obtain a photographed image of the entire body of the photographer. For example, when the photographer's own face is photographed, only the portion above the chest may be photographed.
Therefore, in the above case, the photographed image is entered as shown in FIG. 5 up to the area P near the photographer's face and chest, which is the second subject 32, and the area Q is entered from the chest. Apply a partial “human body image” that includes the lower abdomen, lower back and legs.
Thereby, a composite image of a preview in which the entire body of the photographer who is the second subject 32 is projected can be displayed on the display unit 26.
In addition, the “human body image” is created in advance by computer graphics or the like, and a photographed image that has been photographed in advance is stored in the memory. The “human body image” may be selected so that different clothes, colors, and body shapes can be selected in accordance with the photographer's image. Further, the “human body image” displayed in the region Q is displayed so as to be able to be enlarged, reduced, and aligned so as to be naturally combined with the vicinity of the photographer's face and chest displayed in the region P. Create and fit. An image obtained by combining such a partial image of the photographer and the “human body image” stored in the memory is referred to as a human body combined image.

  Further, as shown in FIG. 6, in the display unit 26, for example, a graduation photo, the second image of the photographer himself / herself in a certain region R provided in the upper left corner with respect to the captured image of the first subject 35 A photographed image of the subject 32 may be displayed.

Further, as shown in FIG. 7, the captured image of the first subject 35, which is the person to be photographed, displayed on the display unit 26 has the lens 11 used for the front side photographing means A as the telephoto lens (or the telephoto side of the zoom lens). It may be an upper body image taken from the waist.
At this time, since the distance between the photographer himself as the second subject 32 and the photographing apparatus 10 is the distance of the hand extended by the photographer, in order to reliably photograph the upper body from the waist of the photographer himself, The lens 12 used for the side photographing means B may be photographed as a wide-angle lens capable of obtaining a wider angle of view (or set on the wide-angle side of the zoom lens).
In this case, since both the first subject 35 and the second subject 32 are images of the upper body from the waist, the second subject 32 can be displayed in the predetermined area S as shown in FIG. As in the example of FIG. 5, the “human body image” may not be used.
Further, at this time, the first subject 35 and the second subject 32 can be adjusted to substantially the same size. For example, the image enlargement / reduction mode is set, and the image (second subject 32) in the predetermined area S is enlarged or reduced so that the size matches the size of the first subject 35 using the cross button 50. You may make it reduce.

Furthermore, the photographer himself / herself can hold the photographing apparatus 10 in his / her hand and take a photographed image of his / her whole body with the rear-side photographing means B using a super wide-angle lens such as a fisheye lens for the lens 12. In this case, as shown in FIG. 8, the whole body captured image of the second subject 32 can be displayed side by side in the predetermined region T, along with the whole body captured image of the first subject 35 that is the subject of photographing. Note that the fish-eye lens mainly distorts the periphery of the image, and it is necessary to correct this distortion.

In the case of FIGS. 5 to 8 described above, it is desirable that the boundary between the first subject 35 and the second subject 32 is not conspicuous so that the composite image does not become unnatural. For this purpose, it is effective to perform a gradient process or a blur process.
Further, the second subject 32 is cut out of its outline and synthesized by removing the background image of the photographer, so that the unnaturalness of the composite image is eliminated. It is easy to cut out the outline by wearing clothes.

  Next, the photographer enters a photographing operation as shown in FIG. 9 while viewing the composite image of the photographed image obtained on the display unit 26 as described above. Thus, the photometric sensors 43 and 51 take in photometric values of the subjects 35 and 32 (S60). The distance measuring sensors 44 and 52 capture distance values up to the subjects 35 and 32 (S61). The CPU 24 receives these photometry values and distance measurement values, and performs autofocus control and aperture control (S62). Based on these control values, the lenses 11 and 12 are driven so that the subjects 35 and 32 are in focus, and the shutter speed and aperture value are set.

  Subsequently, the shutter button 49 is fully pressed only once (S63). A signal is generated by the operation of the shutter button 49, and this signal serves as a trigger. The electronic shutter unit 25 drives the shutter gates of the CCDs 13 and 14, and simultaneously images the subjects 35 and 32 at a predetermined shutter speed. take in. The image data is subjected to necessary signal processing such as amplification and waveform shaping by the analog signal processing units 15 and 16 and input to the A / D conversion units 17 and 18. The A / D converters 17 and 18 convert the input analog data into digital data, which are input to the digital signal processors 19 and 20, respectively. The digital signal processing units 19 and 20 perform predetermined digital signal processing on them, and are once recorded in the memory 22 through the data bus 21 as image files.

  Next, in S64, it is determined whether or not the image composition (image collection) mode is set. If the image composition mode is not set (in the case of No), the front side photographing means A and the rear side photographing means are set. The captured image (usually an image including the first subject 35) captured by any of B is read from the memory 22 and displayed on the display unit 26 (S65). The photographed image can be connected to an external computer through the external interface 23, and can be stored in a memory card.

On the other hand, when it is determined in S64 that the image composition mode is set (in the case of Yes), composite image processing is executed (S66).
In this composite image processing, image processing is performed as if both subjects 35 and 32 that entered one shooting area were shot simultaneously. In this case, matching such as the hue and size of the subjects 35 and 32 and the background is manually adjusted while pressing the cross button 50 during the image processing. Then, a composite photograph is printed out as necessary from the composite image.

  In the above-described embodiment, there are two cases where the photographing unit is the front side photographing unit A and the back side photographing unit B, but a plurality of, for example, three or more photographing units may be provided. In this case, a panoramic photograph can be synthesized from a plurality of preview images.

  As described above in detail, the photographing apparatus 10 in the present embodiment is a front side photographing that is a first photographing unit that photographs a subject (first subject) on the front side of the photographing apparatus to form a first photographed image. Means A, a rear side photographing means B which is a second photographing means for photographing a rear side subject (second subject) to form a second photographed image, a front side photographing means A and a rear side photographing means B. The electronic shutter unit 25 is a simultaneous photographing unit that simultaneously drives and performs photographing, and the image composition unit 27 that is an image composition unit that synthesizes the first photographed image and the second photographed image.

  As a result, a photographer presses the shutter button 49 only once to obtain a composite image as if the subject 32 (photographer himself) as the front subject is lined up with the subject 35 as the rear subject. Therefore, it is possible to solve the troublesome shooting work that has occurred in the prior art, and the problem that there is a risk of inconsistency in the composite image because it is impossible to avoid changes in the shooting situation due to a shift in shooting time. Can be planned.

It is a block diagram which shows the electric system of the imaging device by embodiment of this invention. It is explanatory drawing which shows an example of the image composition method by embodiment of this invention. 1 is a perspective view showing a schematic shape of a photographing apparatus according to an embodiment of the present invention. It is explanatory drawing which shows the imaging | photography condition by the imaging device by embodiment of this invention. It is explanatory drawing which shows the synthesis | combination method of the preview image by embodiment of this invention. It is explanatory drawing which shows the other synthetic | combination method of the preview image by embodiment of this invention. It is explanatory drawing which shows the other synthetic | combination method of the preview image by embodiment of this invention. It is explanatory drawing which shows the other synthetic | combination method of the preview image by embodiment of this invention. It is a flowchart which shows the implementation procedure of the imaging | photography method by embodiment of this invention.

Explanation of symbols

A Front side photographing means (first photographing means)
B. Back side photographing means (second photographing means)
13, 14 Image sensor (CCD)
24 CPU
25 Electronic shutter (simultaneous shooting means)
26 Display unit 27 Image composition unit (image composition means)
49 Shutter button (trigger generation means)

Claims (7)

First photographing means for photographing a first subject to form a first photographed image;
Second imaging means for imaging a second subject to form a second captured image;
Simultaneous photographing means for simultaneously driving the first photographing means and the second photographing means to perform photographing simultaneously;
An image synthesizing means for synthesizing the at least the first captured image and the second captured image,
Memory means for storing pre-created or photographed partial human body images;
I have a,
In addition to the function of combining the first captured image and the second captured image, the image composition unit combines the second captured image and the partial human body image to form a human body combined image, An imaging device comprising means for synthesizing the human body combined image and the first captured image . 2. The human body combined image according to claim 1, wherein at least a face or an upper body is the second photographed image, and a lower body is an image of the partial human body, thereby becoming a whole body image of the human body . Shooting device.   The imaging apparatus according to claim 1, further comprising a display unit that displays at least one of the first captured image and the second captured image.   The photographing apparatus according to claim 3, wherein the display unit displays an image synthesized by the image synthesizing unit.   The first photographing means is a front side photographing means capable of photographing a front subject with respect to the photographing apparatus, and the second photographing means is a rear side photographing means capable of photographing a rear subject with respect to the photographing apparatus. The photographing apparatus according to claim 1, wherein the photographing apparatus is provided.   The simultaneous photographing means has a trigger generating means for generating a trigger, and the first photographing means and the second photographing means are simultaneously driven in accordance with a trigger output from the trigger generating means. The imaging device according to any one of claims 1 to 5. A photographing method using a photographing device having a first photographing unit that photographs a first subject to form a first photographed image and a second photographing unit that photographs a second subject to form a second photographed image. Because
A partial human body image created or photographed in advance is stored in a built-in memory means,
The first photographing means and the second photographing means are driven at the same time to perform photographing at the same time,
The photographed image obtained by combining the photographed second photographed image and the partial human body image to form a human body combined image, and further compositing the first photographed image and the human body combined image. Method.