JP2011223175A - Imaging apparatus, image processing method thereof, program thereof, and imaging system using the imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate a preferred stereoscopic image, even if a preferred viewpoint image for generating a stereoscopic image is not obtained, by receiving the viewpoint image from the outside.SOLUTION: A compound-eye camera 1 comprises: imaging units 21A and 21B that generate a viewpoint image for each frame; a communication circuit 32 that receives a viewpoint image different from the generated viewpoint image for each frame; a monitor 7 that displays the generated viewpoint image for each frame and the received viewpoint image for each frame; a release button 2 for performing an operation for instructing a imaging start; and a three-dimensional processing unit 30 that generates a stereoscopic image based on the viewpoint image generated at timing at which the imaging start is instructed and the viewpoint image received at the timing.

Description

  The present invention relates to an imaging apparatus, an image processing method and program for the imaging apparatus, and an imaging system.

  Conventionally, a compound-eye imaging device that includes a plurality of imaging units and generates a stereoscopic image has been proposed. The compound-eye imaging device generates a stereoscopic image based on a plurality of viewpoint images respectively generated by a plurality of imaging units, and displays the stereoscopic image on a stereoscopic display monitor.

  Since the stereoscopic effect of the stereoscopic image captured by the compound-eye imaging device depends on the distance between the user's eyes and the distance from the stereoscopic display monitor to the user, there are large individual differences in the stereoscopic function of the compound-eye imaging device. There is a problem. Therefore, in the compound-eye imaging device, the parallax of the plurality of viewpoint images can be adjusted according to the user's operation, thereby adjusting the stereoscopic effect of the stereoscopic image.

  However, if a plurality of subjects existing at a distance or in the vicinity are to be photographed at one location, the amount of parallax varies greatly depending on the distance from the compound-eye imaging device to the subject, and there is a problem that an optimal stereoscopic image cannot be obtained. For this reason, it is conceivable to obtain an optimal stereoscopic image by obtaining a viewpoint image from another imaging device.

  Therefore, a technique has been proposed in which a camera image is captured in a desired direction within a range desired by a user in a situation where a plurality of cameras are shooting (see Patent Document 1). As shown in FIG. 1 of the same document, the technology of Patent Document 1 specifies a monitor 20 that displays a camera-capable range as a map, a shooting range desired by the user on the map, and sets the shooting range in any direction. A mouse for the user to specify whether to shoot from the camera and a video receiving terminal 18 for receiving a camera video from the specified direction. Then, the monitor 20 arranges and outputs the video of one or more cameras received by the video receiving terminal 18.

  In addition, a technique has been proposed in which one of a plurality of video channels photographed from different positions by a plurality of cameras is selected and displayed one after another according to the subject that the viewer wants to see (Patent Document 2). . In the technique disclosed in Patent Document 2, when a frame-out of a subject of interest is detected, another video channel is searched using the subject of interest as a search key, and the detected video channel is displayed on the display unit.

JP 2009-272710 A JP 2005-130462 A

  However, the invention of Patent Document 1 does not set a range and an angle that the user wants to see in consideration of a stereoscopic image. Further, the invention of Patent Document 2 does not select a subject that the user wants to see in consideration of displaying a stereoscopic image. For this reason, there is a problem that a suitable viewpoint image for generating a stereoscopic image cannot be obtained from the outside.

  The present invention has been proposed in view of such circumstances, and even when a suitable viewpoint image for generating a stereoscopic image cannot be obtained, a suitable stereoscopic image is received by receiving the viewpoint image from the outside. It is an object to provide an imaging apparatus, an image processing method and program for the imaging apparatus, and an imaging system.

  The imaging apparatus according to claim 1 includes an imaging unit that generates a viewpoint image for each frame by imaging a subject, a receiving unit that receives a viewpoint image different from the viewpoint image for each frame, and the imaging Display means for displaying the viewpoint image for each frame generated by the means and the viewpoint image for each frame received by the receiving means, a first instruction means for performing an operation for instructing start of photographing, A stereoscopic image is generated based on the viewpoint image generated by the imaging unit corresponding to the timing when the photographing start is instructed by the first instruction unit, and the viewpoint image received by the receiving unit corresponding to the timing. And a stereoscopic image generation means for generating.

  An imaging apparatus according to a second aspect of the present invention is the imaging apparatus according to the first aspect, wherein the display means further displays a stereoscopic image generated by the stereoscopic image generation means.

  An imaging apparatus according to a third aspect of the present invention is the imaging apparatus according to the first or second aspect, wherein the recording means records the stereoscopic image generated by the stereoscopic image generation means on a recording medium. Is further provided.

  An imaging apparatus according to a fourth aspect of the present invention is the imaging apparatus according to any one of the first to third aspects, wherein the receiving means receives a viewpoint image generated by another imaging apparatus. Receive.

  An imaging apparatus according to a fifth aspect of the invention is the imaging apparatus according to the fourth aspect, in which at least one of a shooting direction, a shooting position, and a zoom magnification is instructed to the other imaging apparatus. A second instruction means for performing an operation for receiving the image, and the reception means receives the viewpoint image of the subject imaged by the other imaging device according to the instruction of the second instruction means.

  The image processing method of the imaging apparatus according to claim 6, wherein a viewpoint image is generated for each frame by imaging a subject, a viewpoint image different from the viewpoint image is received for each frame, and the generated frame Each viewpoint image and the received viewpoint image for each frame are displayed, and the generated viewpoint image corresponding to the timing at which shooting is instructed by the instruction means, and the received viewpoint image corresponding to the timing. A stereoscopic image is generated based on the above.

  An image processing method for an image pickup apparatus according to a seventh aspect of the present invention is the image processing method for an image pickup apparatus according to the sixth aspect, wherein the generated stereoscopic image is displayed.

  An image processing method for an imaging apparatus according to an eighth aspect of the present invention is the image processing method for an imaging apparatus according to the sixth or seventh aspect, wherein the generated stereoscopic image is recorded on a recording medium.

  The image processing method of the imaging device according to the ninth aspect of the invention is the image processing method of the imaging device according to any one of the sixth to eighth aspects, and is generated by another imaging device. Receive viewpoint images.

  An image processing method of an imaging apparatus according to a tenth aspect of the present invention is the image processing method of the imaging apparatus according to the ninth aspect, wherein a shooting direction, a shooting position, and a zoom with respect to the other imaging apparatus. An operation for instructing at least one of the magnifications is performed, and a viewpoint image of the subject imaged according to the instruction is received.

  An image processing program of an imaging apparatus according to an eleventh aspect of the invention causes a computer to display a viewpoint image for each frame generated by the imaging unit and a viewpoint image for each frame received by the reception unit on the display unit. Corresponding to the viewpoint image generated by the imaging unit corresponding to the timing when the imaging start is instructed by the display control unit and the first instruction unit for performing the operation for instructing the imaging start, and corresponding to the timing It functions as a stereoscopic image generation unit that generates a stereoscopic image based on the viewpoint image received by the reception unit.

  An imaging system according to a twelfth aspect includes the imaging device according to the fourth or fifth aspect, and another imaging device that images the subject and transmits a viewpoint image to the imaging device. ing.

  According to the present invention, the viewpoint image for each frame generated by the imaging unit and the viewpoint image for each frame received by the receiving unit are displayed, and generated by the imaging unit corresponding to the timing when the start of shooting is instructed. Even when a suitable viewpoint image for generating a stereoscopic image cannot be obtained by generating a stereoscopic image based on the generated viewpoint image and the viewpoint image received by the receiving unit corresponding to the timing described above. A viewpoint image can be received from the outside and a suitable stereoscopic image can be generated.

1 is a front perspective view of a compound eye camera according to an embodiment of the present invention. It is a back side perspective view of a compound eye camera. It is a schematic block diagram which shows the internal structure of a compound eye camera. It is a figure which shows the structure of an imaging | photography part. It is a figure which shows the file format of the image file of a stereoscopic vision image. It is a figure which shows the structure of a monitor. It is a figure which shows the structure of a lenticular sheet. It is a figure for demonstrating the three-dimensional process with respect to the 1st and 2nd image. It is the schematic which shows the structure of the imaging system which concerns on embodiment. It is a flowchart which shows a 1st camera image transfer routine. It is a figure which shows the state by which the interlace image is displayed on the monitor. It is a flowchart which shows a 2nd camera image transfer routine. It is a figure which shows the state which a photographer instruct | indicates the imaging position of a camera, and the direction of imaging.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a front perspective view of a compound eye camera 1 according to an embodiment of the present invention, and FIG. 2 is a rear perspective view.

  A release button 2, a power button 3, and a zoom lever 4 are provided on the compound eye camera 1. In front of the compound-eye camera 1, the flash 5 and the lenses of the two photographing units 21A and 21B are disposed. Further, on the back of the compound-eye camera 1, a liquid crystal monitor (hereinafter simply referred to as “monitor”) 7 for performing various displays and various operation buttons 8A, 8U, 8D, 8R, 8L are disposed. The operation button 8 is used not only for the operation of the compound eye camera 1 but also for the operation of other cameras, which will be described in detail later.

  FIG. 3 is a schematic block diagram showing the internal configuration of the compound eye camera 1. The compound eye camera 1 includes two photographing units 21A and 21B, a photographing control unit 22, an image processing unit 23, a compression / decompression processing unit 24, a frame memory 25, a media control unit 26, an internal memory 27, a display control unit 28, and a communication circuit. 32 and CPU 35. Note that the photographing units 21A and 21B are arranged so as to have a predetermined baseline length with a convergence angle at which the subject is viewed. Information on the convergence angle and the baseline length is stored in the internal memory 27.

  FIG. 4 is a diagram illustrating the configuration of the imaging units 21A and 21B. As shown in FIG. 4, the imaging units 21A and 21B include lenses 10A and 10B, apertures 11A and 11B, shutters 12A and 12B, image sensors 13A and 13B, analog front ends (AFE) 14A and 14B, and an A / D conversion unit 15A. , 15B.

  The lenses 10A and 10B have a plurality of functional lenses such as a focus lens for focusing on a subject and a zoom lens for realizing a zoom function. The positions of the lenses 10A and 10B are not determined based on the focusing data obtained by the AF processing unit 22a of the imaging control unit 22 and the zoom data obtained when the zoom lever 4 shown in FIGS. 1 and 2 is operated. It is adjusted by the lens driving unit shown in the figure.

  The apertures 11A and 11B are adjusted in aperture diameter by an unillustrated aperture driving unit based on aperture value data obtained by the AE processing unit 22b of the imaging control unit 22.

  The shutters 12A and 12B are mechanical shutters, and are driven by a shutter driving unit (not shown) according to the shutter speed obtained by the AE processing unit 22b.

  The imaging elements 13A and 13B have a photoelectric surface in which a large number of light receiving elements are two-dimensionally arranged, and subject light is imaged on the photoelectric surface and subjected to photoelectric conversion to obtain an analog photographing signal. In addition, color filters in which R, G, and B color filters are regularly arranged are disposed on the front surfaces of the image sensors 13A and 13B.

  The AFEs 14A and 14B remove noise from the analog shooting signal and adjust the gain of the analog shooting signal (hereinafter referred to as “analog processing”) for the analog shooting signals output from the image sensors 13A and 13B. Apply.

  The A / D converters 15A and 15B convert the analog photographing signals subjected to the analog processing by the AFEs 14A and 14B into digital signals. Note that an image represented by digital image data acquired by the photographing unit 21A is a first image G1, and an image represented by image data acquired by the photographing unit 21B is a second image G2.

  The imaging control unit 22 includes the AF processing unit 22a and the AE processing unit 22b as described above. When the release button 2 is pressed halfway, the AF processing unit 22a acquires distance measurement information from the distance measurement sensor, determines the focal positions of the lenses 10A and 10B, and outputs them to the photographing units 21A and 21B. The AE processing unit 22b determines an aperture value and a shutter speed based on the pre-image, and outputs them to the photographing units 21A and 21B.

  Note that the focus position detection method by the AF processing unit 22a is not limited to the active method using the distance measurement information, and a passive method that detects the in-focus position using the contrast of the image may be used.

  In a state where the release button 2 is not operated, the shooting control unit 22 displays a through image having a smaller number of pixels than the main images of the first and second images G1 and G2 for confirming the shooting range at a predetermined time interval ( For example, the photographing units 21A and 21B are controlled so as to be sequentially generated at an interval of 1/30 seconds. Then, when the release button 2 is fully pressed, the shooting control unit 22 causes the shooting units 21A and 21B to generate the main images of the first and second images G1 and G2 so as to start the main shooting. Control.

  Although the above description is in the case of the still image shooting mode, in the compound eye camera 1 according to the present embodiment, the moving image shooting mode can also be set. In the moving image shooting mode, moving image shooting starts when the release button 2 is pressed, first and second images G1 and G2 are generated for each frame, and moving image shooting stops when the release button 2 is pressed again. To do.

  The image processing unit 23 performs image processing such as white balance adjustment, gradation correction, sharpness correction, and color correction on the digital image data of the first and second images G1 and G2 acquired by the imaging units 21A and 21B. Apply processing.

  The compression / decompression processing unit 24 compresses the image data representing the main images of the first and second images G1 and G2 subjected to image processing by the image processing unit 23 in a compression format such as JPEG. To generate an image file F0 for stereoscopic viewing. The stereoscopic image file F0 includes image data of the first and second images G1 and G2, and additional information such as a base line length, a convergence angle, and a shooting date and time based on the Exif format, And viewpoint information representing the viewpoint position.

  FIG. 5 is a diagram illustrating a file format of a stereoscopic image file. The stereoscopic image file F0 includes supplementary information H1 of the first image G1, viewpoint information S1 of the first image G1, image data of the first image G1, supplementary information H2 of the second image G2, and second information. The viewpoint information S2 of the second image G2 and the image data of the second image G2 are stored. Although not shown, information indicating the start position and end position of data is included before and after the supplementary information, viewpoint information, and image data for the first and second images G1 and G2.

  The incidental information H1 and H2 includes information on the shooting dates, baseline lengths, and convergence angles of the first and second images G1 and G2. The supplementary information H1 and H2 includes thumbnail images of the first and second images G1 and G2. As the viewpoint information, for example, the viewpoint position number assigned in order from the left photographing unit can be used.

  The frame memory 25 is used when performing various processes including the processes performed by the image processing unit 23 described above on the image data representing the first and second images G1 and G2 acquired by the photographing units 21A and 21B. This is a working memory.

  The media control unit 26 accesses the recording medium 29 to control writing and reading of image files and the like.

  The internal memory 27 stores various constants set in the compound-eye camera 1, programs executed by the CPU 35, and the like.

  The display control unit 28 causes the monitor 7 to display the stereoscopic image GR recorded in the frame memory 25 or the recording medium 29 when stereoscopically viewing.

  FIG. 6 is an exploded perspective view showing the configuration of the monitor 7. As shown in FIG. 6, the monitor 7 is configured by stacking a backlight unit 40 that emits light from LEDs and a liquid crystal panel 41 for performing various displays, and attaching a lenticular sheet 42 to the surface of the liquid crystal panel 41. .

  FIG. 7 is a diagram illustrating a configuration of the lenticular sheet 42. As shown in FIG. 7, the lenticular sheet 42 is configured by arranging a plurality of cylindrical lenses 43 in parallel in a direction along the base line.

  Further, the compound eye camera 1 includes a three-dimensional processing unit 30. The three-dimensional processing unit 30 performs a three-dimensional process on the first and second images G1 and G2 in order to stereoscopically display the first and second images G1 and G2 on the monitor 7, thereby providing a stereoscopic image. Generate a GR.

  FIG. 8 is a diagram for explaining a three-dimensional process for the first and second images G1 and G2. As shown in FIG. 8, the three-dimensional processing unit 30 cuts each of the first and second images G1 and G2 into a strip shape in a direction perpendicular to the base line, and positions each of the cylindrical lenses 43 on the lenticular sheet 42. A three-dimensional process is performed so that the first and second images G1 and G2 cut into strips corresponding to are alternately arranged to generate a stereoscopic image GR. The image pairs of the first and second images G1 and G2 constituting the stereoscopic image GR are respectively arranged corresponding to one cylindrical lens.

  The three-dimensional processing unit 30 can also adjust the parallax between the first and second images G1 and G2. Here, the parallax is a shift in pixel position in the horizontal direction of the subject included in both the first and second images G1 and G2, that is, the direction along the base line, of the first and second images G1 and G2. Say quantity. By adjusting the parallax, the stereoscopic effect of the subject included in the stereoscopic image GR can be made appropriate.

  In addition, the three-dimensional processing unit 30 may adjust the parallax between the first and second images G1 and G2 obtained by the photographing units 21A and 21B in real time, or may be recorded in advance on the recording medium 29. The parallax between the first and second images G1 and G2 may be adjusted.

  By the way, when the parallax between the first and second images G1 and G2 is too small and the stereoscopic image is not appropriate, a communication circuit is used instead of one of the images (in this embodiment, for example, the second image G2). The image received at 32 can be used.

  FIG. 9 is a schematic diagram of an imaging system according to the embodiment. As shown in the figure, the compound-eye camera 1 can receive an image taken by the camera 50 or an image stored in advance in the server 70 and use the received image instead of the second image G2. .

  In the present embodiment, the camera 50 is installed on an extension of the base line of the compound eye camera 1. By installing the camera 50 on the extension line of the base line of the compound eye camera 1, the base line length of the images taken by the compound eye camera 1 and the camera 50 is lengthened to increase the convergence angle, and a distant subject can be captured by the compound eye camera 1 alone. By making the parallax larger than the parallax at the time of shooting, it is possible to improve the stereoscopic view of a distant subject.

  The camera 50 is configured in the same manner as the compound eye camera 1. Note that a monocular camera may be used instead of the compound eye camera 1. The camera 50 is not limited to a compound eye camera, and may be a monocular camera.

  Although not shown, the server 70 includes a communication circuit for transmitting and receiving images and other information, a storage unit that stores received images, and a control unit that controls image search and other overall control. And.

  In the compound eye camera 1 configured as described above, when an image generated by the camera 50 is used instead of the second image G2, the following camera image transfer routine is executed. The camera 50 is set in advance to permit image transfer. In addition, programs for the following routines are stored in the internal memory 27.

(First camera image transfer routine)
FIG. 10 is a flowchart showing a first camera image transfer routine. In step 100, the CPU 35 searches for a camera for which image transfer permission is set.

  In step 102, the CPU 35 determines whether or not a camera for which image transfer permission has been set has been detected. If detected, the process proceeds to step 104. If not detected, the process returns to step 100.

  In step 104, the CPU 35 selects the camera 50 closest to the compound eye camera 1 from the detected cameras, and instructs the camera 50 to start image transfer via the communication line 32. However, the present invention is not limited to this, and it is also possible to select a camera with a longer distance as the distance to the subject increases. Then, the CPU 35 receives the image transferred from the camera 50 by the communication circuit 32.

  In step 106, the CPU 35 displays the first image G1 on the monitor 7 in an odd field, for example, and displays the image received by the communication circuit 32 on the monitor 7 in an even field (interlaced display).

  At this time, as shown in FIG. 11, the photographer of the compound-eye camera 1 performs an operation of changing the shooting conditions such as changing the zoom magnification, adjusting the angle of view, and adjusting the exposure while checking the interlaced image on the monitor 7. When the subject indicated by the first image G1 matches the size and exposure state of the subject indicated by the image transmitted from the camera 50 as much as possible, and the amount of deviation of the corresponding subject position constitutes a stereoscopic image. Adjustment is made so that a suitable shift amount is obtained.

  Therefore, in step 108, the CPU 35 determines whether or not an operation for changing the shooting condition has been performed. If the determination is affirmative, the process proceeds to step 110, and after changing the shooting condition in accordance with the change operation, the process proceeds to step 112. If the determination is negative, the process proceeds to step 112 without executing step 110.

  The photographer presses the release button 2 after the adjustment by the photographing condition changing operation is completed.

  Therefore, in step 112, the CPU 35 determines whether or not the release button 2 has been pressed. If the release button 2 has been pressed, the process proceeds to step 114, and if not, the process returns to step 106.

  In step 114, the CPU 35 causes the three-dimensional processing unit 30 to generate a stereoscopic image based on the first image G1 corresponding to the timing when the release button 2 is pressed and the image received by the communication circuit 32. And the generated stereoscopic image is displayed on the monitor 7. In addition, the media control unit 26 records the generated stereoscopic image on the recording medium 29. Then, this routine ends.

(Second camera image transfer routine)
FIG. 12 is a flowchart showing a second camera image transfer routine. Here, only differences from the first camera image transfer routine will be described, and redundant description will be omitted.

  In the first camera image transfer routine, the photographing condition changing operation is performed by the photographer of the compound eye camera 1. On the other hand, in the second camera image transfer routine, the photographer of the camera 50 performs the same operation as the change operation according to the instruction of the photographer of the compound eye camera 1. Specifically, steps 106a and 107 are executed instead of step 106 in FIG.

  In step 106a, the CPU 35 displays the first image G1 on the monitor 7 in an odd field, for example, and displays the image received by the communication circuit 32 on the monitor 7 in an even field (interlaced display).

  At this time, as shown in FIG. 13, the photographer operates the operation buttons 8A, 8U, 8D, 8R, and 8L to instruct the shooting position (vertical direction and horizontal direction) of the camera 50 and the shooting direction. Here, photographing conditions such as zoom magnification change, angle of view adjustment, and exposure adjustment may be further instructed.

  In step 107, the CPU 35 transmits instruction information such as the shooting position and the shooting direction to the camera 50 via the communication circuit 32.

  The photographer of the camera 50 confirms the instruction information transmitted from the compound-eye camera 1 on a monitor (not shown) and adjusts the camera 50 according to the instruction information.

  Then, the photographer of the camera 1 confirms that the sizes and exposure states of the two images match as much as possible, and that the amount of deviation of the corresponding subject position is suitable for constructing a stereoscopic image. The release button 2 is pressed at the same timing.

  Therefore, in step 112, the CPU 35 determines whether or not the release button 2 has been pressed. If it has been pressed, the process proceeds to step 114, and if not, the process returns to step 106a. Thus, the shooting position, the shooting direction, and the like of the camera 50 are adjusted until the release button 2 is pressed. When the release button 2 is pressed, a stereoscopic image is generated in step 114 based on the first image G1 corresponding to the pressed timing and the image received by the communication circuit 32.

  As described above, the compound-eye camera 1 according to the embodiment of the present invention uses an image taken by the camera 50 instead of one of the first and second images G1 and G2 that are viewpoint images. A stereoscopic image can be generated. Thereby, even when the compound eye camera 1 cannot generate a suitable stereoscopic image using the first and second images G1 and G2, the camera 50 is replaced with either the first image G1 or the second image G2. By using the captured image, it is possible to generate a stereoscopic image in which the subject's stereoscopic effect is in a suitable state.

  In addition, the compound-eye camera 1 has the same size and exposure state as the first image G1 and the received image as much as possible with respect to the camera 50, and the amount of deviation of the corresponding subject position constitutes a stereoscopic image. A stereoscopic image can be generated by instructing a suitable shift amount.

  In addition, although the example which uses the compound eye camera 1 was demonstrated above, it replaced with the compound eye camera 1, the monocular camera in which the lenticular sheet etc. were not provided was provided separately from the said monocular camera, and the lenticular sheet etc. were provided. The image captured by the monocular camera and the image captured by the camera 50 may be transferred to the display device, and a stereoscopic image may be displayed for stereoscopic viewing.

  In the above-described embodiment, the compound-eye camera 1 acquires the viewpoint image from the camera 50. However, a suitable viewpoint image may be acquired from a server device in which a plurality of viewpoint images are stored in advance. For example, the camera 50 captures a still object and transmits to the server device, along with the viewpoint image, the imaging conditions at that time, such as the distance to the subject, zoom magnification, field angle, exposure, and imaging time. Then, the compound-eye camera 1 may read a viewpoint image in which the same subject exists in the same region and the viewpoint is shifted from the server device, and generate a stereoscopic image.

7 Monitors 21A and 21B Imaging unit 22 Imaging control unit 30 Three-dimensional processing unit 32 Communication circuit 35

Claims (12)

Imaging means for generating a viewpoint image for each frame by imaging a subject;
Receiving means for receiving a viewpoint image different from the viewpoint image for each frame;
Display means for displaying the viewpoint image for each frame generated by the imaging means and the viewpoint image for each frame received by the receiving means;
First instruction means for performing an operation for instructing to start photographing;
A stereoscopic image based on the viewpoint image generated by the imaging unit corresponding to the timing when the start of imaging is instructed by the first instruction unit, and the viewpoint image received by the receiving unit corresponding to the timing Stereoscopic image generation means for generating
An imaging apparatus comprising: The imaging apparatus according to claim 1, wherein the display unit further displays a stereoscopic image generated by the stereoscopic image generation unit. The imaging apparatus according to claim 1, further comprising a recording unit that records the stereoscopic image generated by the stereoscopic image generation unit on a recording medium. The imaging device according to any one of claims 1 to 3, wherein the receiving unit receives a viewpoint image generated by another imaging device. A second instruction means for performing an operation to instruct at least one of a photographing direction, a photographing position, and a zoom magnification with respect to the other imaging device;
The imaging device according to claim 4, wherein the reception unit receives a viewpoint image of a subject captured by the other imaging device according to an instruction of the second instruction unit. Generate a viewpoint image for each frame by imaging the subject,
Receiving a viewpoint image different from the viewpoint image for each frame;
Displaying the generated viewpoint image for each frame and the received viewpoint image for each frame;
An image processing method for an imaging apparatus, which generates a stereoscopic image based on the generated viewpoint image corresponding to a timing at which shooting start is instructed by an instruction unit, and the received viewpoint image corresponding to the timing. The image processing method of the imaging device according to claim 6, wherein the generated stereoscopic image is displayed. The image processing method of the imaging device according to claim 6 or 7, wherein the generated stereoscopic image is recorded on a recording medium. The image processing method of the imaging device according to any one of claims 6 to 8, wherein a viewpoint image generated by another imaging device is received. The operation for instructing at least one of a shooting direction, a shooting position, and a zoom magnification with respect to the other imaging device is performed, and a viewpoint image of a subject imaged according to the instruction is received. Image processing method of imaging apparatus. Computer
Display control means for displaying the viewpoint image for each frame generated by the imaging means and the viewpoint image for each frame received by the receiving means on the display means, and a first instruction for performing an operation for instructing the start of imaging A stereoscopic view that generates a stereoscopic image based on the viewpoint image generated by the imaging unit corresponding to the timing when the imaging start is instructed by the unit and the viewpoint image received by the receiving unit corresponding to the timing Image generation means,
An image processing program for an imaging apparatus for functioning as An imaging device according to claim 4 or 5,
Another imaging device that images the subject and transmits a viewpoint image to the imaging device;
An imaging system comprising:

Images