JP4771671B2 - Imaging device and imaging display device - Google Patents

Description

  The present invention relates to a stereoscopic image capturing device using a plurality of imaging means, a display device capable of displaying a stereoscopic image, and a photographing display device capable of capturing and displaying a stereoscopic image.

  2. Description of the Related Art Conventionally, there has been proposed an apparatus that captures and records a stereoscopic image by providing two cameras with a single camera. For example, in the electronic camera described in Patent Document 1, stereoscopic vision is obtained by photographing the same subject using two imaging means arranged in parallel in the horizontal direction of the camera body and recording it as a pair of left and right image information. Possible still image shooting and recording. Furthermore, a switch for switching between normal shooting mode and stereoscopic shooting mode is provided, and by switching the image pickup means that is driven in conjunction with the operation of the switch, it is possible to perform normal shooting and stereoscopic shooting with one electronic camera. .

  When the objective is to take a stereoscopic image as in the prior art, the two imaging means are generally arranged with a distance of about the distance between the human eyes. By doing so, it is possible to obtain a natural three-dimensional image by photographing a video that approximates the human visual field. Also, the arrangement of both image pickup means is usually arranged in the horizontal direction of the photographing apparatus as shown in the prior art, also in accordance with the human field of view.

  Although the above-described conventional electronic camera targets a still image, the above-described configuration is not limited to a still image and can be applied to shooting a moving image. That is, it is possible to configure an electronic camera that can capture a stereoscopic image of a moving image in addition to a still image by applying the prior art.

In order to view the captured stereoscopic image, display means capable of displaying the stereoscopic image is necessary. For example, a display device described in Non-Patent Document 1 can be used. If the display device is mounted on the electronic camera, the captured stereoscopic image can be viewed on the spot.
JP-A-8-317425 Jacobs et al., “2D / 3D Switchable Display” Sharp Technical Report April 2003 issue

  However, it is said that the average distance between human eyes is 65 mm. If two image pickup means are arranged in the horizontal direction of the camera as in the case of the above-described conventional electronic camera, it naturally has the width. A housing is required. Actually, since there are the thickness of the components of the imaging means and the thickness of the casing member, the apparatus cannot be established unless it has a width wider than 65 mm.

  On the other hand, so-called digital cameras have been miniaturized in recent years, and there are many products that do not have the above width. In particular, there are “shooter” style models that can be used to capture moving images in addition to still images, and the width of the camera housing is almost equal to the lens width of the imaging means. There are many examples of equality. Therefore, the method of arranging the image pickup means in the horizontal direction as in the prior art is not necessarily suitable as a means for realizing a stereoscopic image shooting function.

  The above problems are not limited to digital cameras. With recent downsizing and higher performance of image sensors and microprocessors, mobile phones such as so-called mobile phones and PHS, and information terminals called PDAs are equipped with still and moving image shooting functions. The number of cases is increasing, and these portable phones and information terminals can be used in the same way as digital cameras. However, when these devices are intended to have a stereoscopic image shooting function, as in the case of the above-described digital camera, a sufficient interval is secured to mount two imaging means in the horizontal direction of the device. Hard to do. In particular, in the case of a mobile phone, it is difficult to mount two image pickup means in the horizontal direction of the device because the shape of the device tends to be vertically long due to the usage as a phone.

  Furthermore, as a problem specific to mobile phones, the display unit for displaying images tends to be vertically long with the shape of the device, and is not necessarily suitable as a means for displaying a stereoscopic image that feels stereoscopic effect from the parallax in the horizontal direction. There is also a point.

  In addition, in the above-described prior art, stereoscopic imaging is possible by providing two imaging means. However, as an imaging mode that takes advantage of the characteristics of having a plurality of imaging means, outputs from a plurality of imaging means are further connected. A so-called panoramic shooting for obtaining one large image, a method for simultaneously shooting different subjects as many as the number of imaging means, and the like can be considered. In the prior art, there is no mention of a configuration for making such various shooting modes and stereoscopic shooting modes compatible.

  The present invention has been made in view of the above problems, and the first object thereof is not only a horizontally long device such as a general digital camera, but also a portable phone. An object of the present invention is to provide a photographing / displaying device that can easily shoot and display a stereoscopic image even with a vertically long device.

  A second object of the present invention is to provide a display device that can display various image data effectively and without complicated operations by the user, regardless of the shape of the device. .

  A third object of the present invention is to provide an imaging device that can smoothly switch and control various imaging modes that can be provided by providing a plurality of imaging means, and further, a normal image. And a display unit capable of displaying a stereoscopic image, and providing an imaging display device capable of smoothly switching and controlling various display modes.

  In order to solve the above-described problems, an imaging device, a display device, and an imaging display device according to the present invention have the following features.

The imaging device of the present invention includes a plurality of imaging units that can be individually controlled to be in an operating / non-operating state, an imaging control unit that controls the plurality of imaging units, and a plurality of imaging modes depending on the operating state of the imaging unit. Mode switching control means for performing switching control, and at least one of the plurality of imaging means is arranged in a configuration capable of changing a distance from other imaging means, and is predetermined in advance. of the plurality of iMAGING means arranged to each other a predetermined distance or by moving at least one member spaced apart, at least two image pickup means is operational, and the imaging when the optical axis of the unit is in a working state intersect in front of the parallel or the plane from each other be on the same plane, the imaging mode switching control means is photographed as a stereoscopic image is output And switches to determine over de in three dimensional mode.

In addition, the mode switching control unit is a panoramic image that is normally taken when at least two imaging units are in an operating state in which the optical axes of the imaging units are on the same plane and intersect each other at the rear of the plane. The photographing mode is determined and switched to the panoramic photographing mode so that an image is output .

The mode switching control unit may output a normal image including a plurality of subjects when at least two imaging units are in an operating state in which the optical axes of the imaging units are not on the same plane. The imaging mode is determined and switched to the multiple subject imaging mode.

The photographing display device of the present invention is a photographing display device including the photographing device of the present invention and a display unit capable of displaying a normal image and a stereoscopic image, wherein the mode switching control unit includes the photographing mode. The display means selects whether to display a normal image or a stereoscopic image according to an image output based on the above.

  By including the above-described means, the imaging device, display device, and imaging display device of the present invention have the following effects.

  That is, according to the imaging apparatus of the present invention, a plurality of captured images can be obtained without being restricted by the shape of the apparatus, and in particular, using two imaging means arranged with a predetermined interval or an arbitrary interval. Thus, a stereoscopically viewable image can be taken.

  In addition, according to the display device of the present invention, it is possible to obtain display effects that make use of the shape of the device, such as panoramic images and multiple subject images, as well as displaying stereoscopically visible images. .

  Further, according to the photographing display device of the present invention, various image data such as a stereoscopic image, a panoramic image, and a plurality of subject images can be obtained from image data obtained by a plurality of imaging means. The display mode can be switched without a complicated operation by the user.

  Each embodiment of the present invention will be described below. In this specification, when “image” is described without “still” or “moving”, it means either or both of a still image and a moving image.

<Description of First Embodiment>
First, the 1st Embodiment of this invention is described with reference to FIGS. 1-3 and FIG.

  FIG. 1 is a block diagram showing an internal configuration of the photographing display device according to the first embodiment of the present invention.

  As shown in FIG. 1, the imaging display device of the present invention includes a plurality of imaging units 101-1 to 101-n, an imaging control unit 102, an image processing unit 103, an image encoding unit 104, an image display unit 105, and mode switching control. Part 106.

  Each of the plurality of imaging units 101-1 to 101-n includes a lens, a photoelectric conversion element, and the like, and obtains image data from optically input information. The imaging control unit 102 performs state management and operation control of the plurality of imaging units 101-1 to 101-n, outputs image data from each imaging unit to the image processing unit 103, and changes the status of each imaging unit. The mode switching control unit 106 is notified. The image processing unit 103 performs image processing such as correction, synthesis, or recognition of a difference in characteristics between the image capturing units on the image data obtained by the image capturing units, and generates image data for display and encoding. At the same time, information indicating the format of the image data is also generated. Information for performing image processing, such as the number of input images and shooting conditions in each imaging unit, is obtained from a mode switching control unit 106 described later. The image encoding unit 104 performs encoding for recording or transmitting the image data processed by the image processing unit 103. Also, information indicating the format of the image data is obtained from the image processing unit 103, and is sent to the recording / transmission means together with the encoded image data. Any encoding method is applicable regardless of whether it is for still images or moving images. The image display unit 105 includes a display device capable of displaying a stereoscopic image in addition to displaying a normal planar image, such as the above-described conventional technology “2D / 3D Switchable Display” (Non-Patent Document 1). The image data processed by the image processing unit 103 is displayed in an appropriate display mode. The mode switching control unit 106 obtains the state of each imaging unit from the imaging control unit 102, determines various shooting modes such as normal shooting, stereoscopic shooting, panoramic shooting, multiple subject shooting, and the corresponding display mode, The imaging control unit 102, the image processing unit 103, and the image display unit 105 are notified.

  Next, regarding the photographing display device, operations when performing various photographings will be described.

  The normal shooting mode is a shooting mode in which image data is obtained using only a single imaging unit. Whether to operate in the normal shooting mode may be determined by the mode switching control unit 106 knowing the operating state of each of the imaging units 101-1 to 101-n via the imaging control unit 102, or by the user. Alternatively, it may be determined by specifying using an operating means (not shown). The operating state of each imaging unit can be identified by the open / close state of a cover provided for each imaging unit, the orientation of each imaging unit, and the like. When the shooting mode is determined from the operating state of the imaging unit, the main shooting mode may be determined when only a single imaging unit is operating.

  In the main photographing mode, image data obtained from a single image pickup unit is transmitted to the image encoding unit 104 and the image display unit 105 after being corrected by the image processing unit 103 as necessary. . The image display unit 105 displays the image in the normal display mode because it is a normal planar image. Of course, there is a case where display is not required at the time of shooting, and in this case, the image display unit 105 does not perform display.

  The stereoscopic shooting mode is a shooting mode in which image data is obtained using at least two of the plurality of imaging units. Whether to operate in the stereoscopic shooting mode is determined by the operating state of each imaging unit and user operation, as in the normal shooting mode. When determining the shooting mode from the operating state of the imaging unit, two or more imaging units arranged at a predetermined interval are operating, and the imaging direction of each imaging unit, that is, the optical axis is on the same plane When the optical axes are parallel to each other or intersect with each other in front of the plane, the main photographing mode may be determined.

  In the main shooting mode, image data obtained from at least two of the plurality of imaging units is corrected as necessary by the image processing unit 103, and then the image encoding unit 104 and the image display are displayed. Each of the data is transmitted to the unit 105. Since the image display unit 105 is a stereoscopic image, it is displayed in the stereoscopic display mode. Alternatively, some users are not good at shooting while viewing a stereoscopic display. In that case, the display may be performed in a normal display mode. Alternatively, as in the normal shooting mode, the image display unit 105 may not display.

  FIG. 2A is a conceptual diagram showing a configuration of image data shot in this stereoscopic shooting mode. A stereoscopic image 207 is configured based on an image 201 captured by a certain imaging unit and an image 202 captured by another imaging unit. The image 201 and the image 202 are image data obtained by photographing the same subject from different directions, and one of them forms a left viewpoint image of a stereoscopic image, and the other forms a right viewpoint image.

  Note that the stereoscopic image is not necessarily composed of a set of left viewpoint image and right viewpoint image, and may be composed of a plurality of images obtained by photographing the same subject from different viewpoints. As a result, an image corresponding to the position of the observer can be reproduced, and a more natural stereoscopic image can be obtained. In this case, there are more than two image capturing units that operate in the stereoscopic shooting mode.

  The panoramic shooting mode is a shooting mode in which image data is obtained using two or more imaging units. Whether to operate in the panoramic shooting mode is determined by the operating state of each imaging unit and user operation, as in the above-described shooting modes. When determining the shooting mode from the operating state of the imaging unit, with respect to two or more imaging units, the imaging direction of each imaging unit, that is, the optical axis is on the same plane, and the optical axes intersect with each other at the rear on the plane. In this state, the main shooting mode may be determined.

  In the main photographing mode, image data obtained from a plurality of imaging units is corrected and combined as necessary in the image processing unit, and then transmitted to the image encoding unit and the image display unit, respectively. The image display unit displays the synthesized image. Alternatively, as in the normal shooting mode, the image display unit does not have to display.

  FIG. 2B is a conceptual diagram showing the configuration of image data shot in this panoramic shooting mode. A panoramic image 208 is composed of an image 203 captured by a certain imaging unit and an image 204 captured by another imaging unit. The image 203 and the image 204 are images obtained by capturing a continuous space including overlapping spaces. A hatched portion is a portion overlapping between two images. The image processing unit recognizes, corrects, and combines so that the shaded portion is smoothly connected. FIG. 2B shows an example in which the image is captured by two image capturing units for simplicity, but a panoramic image composed of three or more captured images can be obtained in the same way.

  The multiple subject shooting mode is a shooting mode in which image data is obtained using two or more imaging units. Whether to operate in the multiple subject shooting mode is determined by the operating state of each imaging unit and user operation, as in each of the shooting modes. When the shooting mode is determined from the operating state of the image pickup unit, two or more image pickup units are operating and are in states other than the above modes, that is, the optical axes of the image pickup units are not on the same plane. Sometimes the main shooting mode may be determined.

  In the main photographing mode, image data obtained from a plurality of image capturing units is transmitted to the image encoding unit 104 and the image display unit 105 after being corrected by the image processing unit 103 as necessary. In the image display unit 105, the display area is divided and images from the respective imaging units are displayed. Alternatively, as in the normal shooting mode, the image display unit 105 may not display. In the image encoding unit 104, a plurality of images may be encoded independently, or may be encoded as a single synthesized image.

  FIG. 2C is a conceptual diagram showing a configuration of image data shot in the multiple subject shooting mode. In the main photographing mode, the image 205 photographed by a certain imaging unit and the image 206 photographed by another imaging unit are independent images that are not related to each other. An image when this is simultaneously displayed as a plurality of subject images 209 on one display unit is shown in the figure. Reduction or correction at the time of display is performed by the image processing unit 103 or the image display unit 105. FIG. 2C shows an example in which the images are arranged in the horizontal direction, but of course, they may be arranged in the vertical direction or one of them may be displayed on a small screen. Here, for the sake of simplicity, an example in which images are captured by two imaging units is shown, but a plurality of subject images composed of three or more captured images can be obtained in the same way.

  Next, the arrangement of the imaging unit in the imaging display device of the present embodiment will be described.

  FIG. 3 is a simplified external view of an imaging display device including a plurality of imaging units. In the figure, an example of an imaging display device having two imaging units is shown, and a main imaging unit 301, a sub imaging unit 302, and a display unit 303 are illustrated. The figure is a front view of the apparatus viewed from the subject side to be photographed, and shows an example of an apparatus in which an imaging unit is arranged on the front surface and a display unit 303 is arranged on the back surface. (A) is an example of a horizontally long photographic display device found in a general digital camera or the like, and (b) is an example of a vertically long photographic display device found in a general portable phone or the like. It is.

  In both the shape of FIG. 3A and the shape of FIG. 3B, the two image pickup units are arranged at a predetermined distance in the horizontal direction of the device. In the shape of FIG. 3A, there is a sufficient width in the horizontal direction of the device, and both imaging units are arranged with a space between human eyes. In the shape of FIG. 3B, since there is not a sufficient width in the horizontal direction of the device, both the imaging units are arranged at an interval shorter than the interval between the human eyes, but one imaging unit is movable. Therefore, as shown in FIG. 3C, a configuration is provided in which a distance from another imaging unit can be increased as necessary. In addition, in order to enable panorama shooting and multiple subject shooting, not only the same subject is shot by a plurality of imaging units, but also a continuous space is shot by a plurality of imaging units, or different subjects are captured by a plurality of imaging units The at least one imaging unit is configured to be able to adjust the imaging direction, that is, the direction of the optical axis.

  In the imaging display device of the present embodiment, when shooting a normal still image or a normal moving image, either the main imaging unit 301 or the sub-imaging unit 302 is used to perform stereoscopic shooting, panoramic shooting, or multiple subject shooting. Sometimes both imagers are used. In addition, the main imaging unit 301 may always be used during normal still image / moving image shooting, and in that case, only the main imaging unit 301 needs to be operated at all times during normal shooting regardless of still images / moving images. Thus, it becomes possible to simplify user operation and control.

  Here, the relationship between the distance between the imaging units (referred to as the base line length) at the time of stereoscopic image shooting and the distance from the imaging unit to the subject will be described with reference to FIG. The subject in FIG. 7 is a subject to be used as a reference at the time of shooting, and actually there may be other foreground and background. FIG. 7A shows an example in which two imaging units are arranged such that the base line length is equal to the distance e between both eyes of a human when a stereoscopic image is captured. This means that shooting is performed in accordance with the human's actual field of view. When a captured stereoscopic image is viewed, the distance between the imaging unit at the time of shooting, that is, the viewer and the subject, is reproduced as it is. 3D images can be obtained. On the other hand, FIG. 7B is an example in which two imaging units are arranged so that the base line length is an interval e ′ shorter than the distance e between the human eyes when stereoscopic images are taken. This is because the distance from the observer to the subject is too close, and it is difficult to view the captured stereoscopic image as a natural stereoscopic image if the distance between the imaging units remains e. This is an arrangement example for facilitating viewing of a stereoscopic image by reducing the distance between the parts. In such a case, if the distance e ′ between the imaging units is adjusted according to the distance to the subject to be photographed, a more comfortable stereoscopic image can be viewed. Specifically, the triangle having the base of the straight line having the length e seen in FIG. 7A and the triangle having the base of the straight line having the length e ′ seen in FIG. In addition, the distance e ′ may be determined. In the present embodiment, as shown in FIGS. 3B and 3C, since the distance between the two imaging units is variable, a stereoscopic image with a high degree of freedom can be obtained by adjusting this distance. Is possible. Further, by recording or transmitting the adjusted e ′ together with the captured image data, it is possible to view or edit as an appropriate stereoscopic image in a display device or an image editing device other than the imaging display device of the present embodiment. Is possible.

  In this embodiment, the “photographing display device” is shown, but it may be configured as a “photographing device” that omits the display means and the control function related thereto. Even in such a case, the user operation and the simplicity of the control relating to photographing as shown in the explanation of the “photographing display device” are similarly secured.

<Description of Second Embodiment>
Next, a second embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing the internal configuration of the photographing display device according to the first embodiment of the present invention. The photographing display device according to the second embodiment also has an internal configuration similar to this internal configuration. Since FIG. 1 has already been described, the description thereof is omitted. Also, the basic internal operations when performing various types of shooting such as normal shooting, stereoscopic shooting, panoramic shooting, and multiple subject shooting are the same as those in the first embodiment, and detailed description thereof will be omitted. .

  The main difference between the second embodiment and the first embodiment is the usage form and arrangement form of a plurality of imaging units. FIG. 4 is a simplified external view of the photographing display device of the present embodiment. In the figure, an example of an imaging display device having three imaging units is shown, and a main imaging unit 301, a first sub imaging unit 302, a display unit 303, and a second sub imaging unit 304 are illustrated. . The figure is a front view of the apparatus viewed from the object side to be photographed, and shows an example of an apparatus in which the imaging units 301, 302, and 304 are arranged on the front surface and the display unit 303 is arranged on the rear surface. (A) is an example of a horizontally long photographic display device found in a general digital camera or the like, and (b) is an example of a vertically long photographic display device found in a general portable phone or the like. It is. Both the shape of (a) and the shape of (b) have two sub imaging units 302 and 304 in addition to the main imaging unit 301, and the two sub imaging units are arranged at a predetermined distance from each other. Yes. The predetermined distance is a distance suitable for photographing a three-dimensional image, that is, a distance of about the distance between human eyes. In addition, in order to enable panorama shooting and multiple subject shooting, not only the same subject is shot by a plurality of imaging units, but also a continuous space is shot by a plurality of imaging units, or different subjects are captured by a plurality of imaging units. The at least one imaging unit is configured to be able to adjust the imaging direction.

  The arrangement of the imaging unit in FIG. 4B is an example in which the shape of the apparatus is vertically long and the predetermined distance cannot be secured in the horizontal direction. In this figure, the two sub-imaging units 302 and 304 are arranged at a predetermined distance in the vertical direction, but at least one sub-imaging unit is movable as shown in FIG. In addition, a configuration may be adopted in which the distance from other sub-imaging units can be increased as necessary. In that case, it is not always necessary to arrange a plurality of sub-imaging units in the vertical direction of the apparatus.

  In the photographing display device of the present embodiment, when photographing a normal still image or a normal moving image, either the main imaging unit 301 or the sub-imaging units 302 and 304 are used, and two images are taken at the time of stereoscopic shooting or panoramic shooting. The sub-imaging units 302 and 304 are used, and at the time of photographing a plurality of subjects, only the two sub-imaging units 302 and 304 or the main imaging unit 301 and the two sub-imaging units 302 and 304 are used. The main imaging unit 301 may be an imaging unit having a higher resolution imaging capability than the sub imaging units 302 and 304. In this case, the main imaging unit 301 is used during normal shooting of still images, The first sub imaging unit 302 is used during normal shooting. With such a configuration, it is possible to shoot high-definition still images, reduce the load such as filter processing during moving image shooting, and minimize correction processing during panoramic shooting and multiple shooting. It becomes possible to suppress to.

  By making a difference between the resolutions of the main imaging unit 301 and the sub imaging units 302 and 304, these functions can be realized while suppressing an increase in cost associated with an increase in the number of components of the imaging unit. Note that the main imaging unit 301 may be used during normal moving image shooting. In this case, only the main imaging unit needs to be operated during normal shooting regardless of still images and moving images. Can be simplified.

  Whether or not to use the main imaging unit 301 at the time of shooting a plurality of subjects described above is determined if the main imaging unit 301 is used for shooting the subject when there is a subject of particular interest among the plurality of subjects, and otherwise. What is necessary is just to determine by the importance of a to-be-photographed object, such as imaging | photography with the sub imaging parts 302 * 304.

  Although the present embodiment is also shown as a “photographing display device” as in the first embodiment, it may be configured as a “photographing device” that omits display means and related control functions. Even in such a case, as described in the description of the “photographing display device”, the convenience of user operation and control related to photographing is ensured in the same manner as described in the first embodiment.

<Description of Third Embodiment>
Next, a third embodiment of the present invention will be described with reference to FIG. 5, FIG. 6, and FIG.

  FIG. 5 is a block diagram showing an internal configuration of a photographing display apparatus according to the third embodiment of the present invention.

  As illustrated in FIG. 5, the imaging display device includes a plurality of imaging units 111-1 to 111-n, an imaging control unit 112, an image processing unit 113, an image encoding unit 114, an image display unit 115, and a mode switching control unit 116. , An image decoding unit 117, a display mode determination unit 118, and a display mode selection unit 119. The main difference from the first imaging / displaying device is that it includes an image decoding unit 117, a display mode determination unit 118, and a display mode selection unit 119, and the operation is related to these additional elements. This will be described below.

  The image decoding unit 117 decodes encoded image information from a recording / transmission unit (not shown), and outputs image data as a decoding result and auxiliary data indicating the format of the image data. The image data is output to the image processing unit 113, and the auxiliary data is output to the display mode determination unit 118. The auxiliary data includes information indicating the size of the image, whether the image data is a normal image or a stereoscopic image, and information indicating the number of viewpoints, the distance between viewpoints, the distance to the subject, etc. in the case of a stereoscopic image. The display mode determination unit 118 determines a display mode suitable for the image data from the auxiliary data, and outputs image identification information necessary for displaying the image to the mode switching control unit 116. The display mode selection unit 119 determines an image display mode according to the image identification information, the usage pattern of the apparatus, or a user operation, and notifies the mode switching control unit 116 of the mode. The mode switching control unit 116, according to notifications from the imaging control unit 112, the display mode determination unit 118, and the display mode selection unit 119, various shooting modes and displays such as normal shooting, stereoscopic shooting, panoramic shooting, and multiple subject shooting. The mode is determined and notified to the imaging control unit, the image processing unit, and the image display unit. The image processing unit 113 performs correction processing and synthesis processing on the image data from the image decoding unit 117 in the same manner as the image data obtained by the imaging units 111-1 to 111-n.

  Here, the determination and selection of the display mode during image shooting will be described in detail.

  Regarding the display of the image data captured by the own apparatus, the mode switching control unit 116 determines the display mode basically according to the state of each imaging unit. However, a display mode different from the display mode determined above can be selected by the display mode selection unit 119. In this case, an image is displayed according to the display mode selected by the display mode selection unit 119. That is, it is possible to display in a display mode different from the shooting mode. For example, a user who is unfamiliar with stereoscopic display can select normal display even during stereoscopic shooting. The display mode can be switched in accordance with. Similarly, regarding the display of the image data decoded by the image decoding unit 117, the display mode is basically determined according to the auxiliary data indicating the format of the image data, but a different display mode is selected by the display mode selection unit 119. In this case, the image is displayed according to the display mode selected by the display mode selection unit 119.

  Further, the display mode selection unit 119 has a function of determining the usage pattern of the apparatus and determining the orientation of the image to be displayed according to the determination result. In order to determine the usage mode of the device, the display mode selection unit only needs to have a means such as a gravity sensor for detecting a spatial vertical relationship.

  Thereby, it is possible to determine whether the usage pattern of the apparatus is the vertical direction or the horizontal direction, that is, the orientation of the image display unit 115. For example, in a case where a vertically long device is used while being laid down, the image display unit also lies 90 degrees, and as it is, an image that was properly displayed with the device in a vertically long state is rotated horizontally. However, although the display mode selection unit detects the usage pattern of the apparatus and rotates the displayed image by 90 degrees, the user can appropriately view the image. Of course, as described above, if there is a designation from the user, the display direction may be determined regardless of the usage form of the device.

  The image display unit 115 includes a display device having a capability of displaying a stereoscopic image, and such a display device generally has a predetermined usage pattern for displaying a stereoscopic image. Only in such a usage form, the user can properly view the stereoscopic image. The display mode selection unit 119 determines whether to select the stereoscopic display mode in either the vertical direction or the horizontal direction according to the property of the image display unit. For example, with respect to a display device capable of stereoscopic display when in the horizontal direction, it is an imaging display device in which an imaging unit is arranged so that a stereoscopic image can be captured with the display device in the horizontal direction. If there is a photographing display device in which the imaging unit is arranged so as to photograph a stereoscopic image in a state where the display device is in the vertical direction, it may be automatically switched to the stereoscopic display mode. Is switched to the normal display mode even during stereoscopic shooting.

  If the display device included in the image display unit 115 has a capability of displaying a stereoscopic image both in the vertical direction and in the horizontal direction, the display mode may be determined simply according to the usage mode of the apparatus.

  Next, the arrangement of the imaging unit and the display control in the imaging display device of this embodiment will be described.

  FIG. 6 is a schematic external view showing a usage pattern of the device at the time of photographing or display of the photographing display device according to the third embodiment of the present invention. In the figure, an example of a vertically long photographing display device having three image pickup units is shown. The main image pickup unit 301, the first sub image pickup unit 302, the display unit 303, and the second sub image pickup unit 304 are illustrated. Show. The external appearance of the present photographing display device and the arrangement of the image pickup units and the display are the same as those in FIG. 4B, but in FIG. 6, as viewed from the user's side, which is opposite to FIG. 4B. It is a front view of an apparatus, and shows an example of an apparatus with which a display part is arranged on the front and an imaging part is arranged on the back.

  FIG. 6A shows a normal usage pattern of the present photographing display device. This form is used when normal image shooting is performed, or when recorded image data or image data received from the outside is displayed. During normal image shooting, only the main imaging unit 301 is operated, and the image being shot is displayed on the display unit 303. The recorded image and the image received from the outside are displayed on the display unit 303 in the same manner. Regarding the display mode of the display unit, the stereoscopic display mode is set when the recorded image or the image received from the outside is a stereoscopic image, and the normal display mode is set when the image is not.

  When the size of the image to be displayed is a size that does not fit in the display unit, the display mode switching control unit 116 may display the entire image in a reduced size so as to fit in the display area of the display unit. In addition, the display mode switching control unit 116 may move the range of the image to be displayed by so-called “scrolling” and display the whole according to the user's designation.

  At the time of stereoscopic shooting, panoramic shooting, and shooting of a plurality of subjects, the present photographing display device takes a usage pattern as shown in FIG.

  At the time of stereoscopic shooting, the two sub imaging units 302 and 304 are operated, and the image being shot is displayed on the display unit 303. At this time, the display unit 303 is set to the stereoscopic display mode and displays a stereoscopic image composed of the two images obtained from the two sub-imaging units 302 and 304.

  At the time of panorama shooting, the two sub-imaging units are operated in the same manner as described above, and an image being shot is displayed on the display unit 303. At this time, the display unit 303 is set to the normal display mode, and the two images obtained from the two sub imaging units 302 and 304 are combined and displayed as a panoramic image as shown in FIG. When displaying a panoramic image, the entire image may be displayed in a reduced size so as to fit in the display area of the display unit 303, or the entire image may be displayed by scrolling.

  At the time of shooting a plurality of subjects, two or more imaging units 301, 302, and 304 are operated in the same manner as described above, and an image being shot is displayed on the display unit 303. At this time, the display unit 303 is set to the normal display mode. When displaying a plurality of subject images, the images obtained from the plurality of imaging units may be combined and displayed as a plurality of subject images as shown in FIG. 2C, or an image obtained from a certain imaging unit. An image obtained from another image capturing unit may be displayed as a sub-screen, or an image obtained from each image capturing unit may be switched and displayed at regular time intervals or every user operation.

  For shooting modes other than stereoscopic shooting, the use of the device is controlled by controlling the shooting mode and display mode so that it can be used in either of the usage modes of FIGS. 6A and 6B according to the shooting target. The degree of freedom regarding can be improved.

  The operation when displaying while shooting in the shooting display device of the present embodiment has been described above. Next, the operation when displaying recorded image data or image data received from the outside will be described. .

  When displaying recorded image data or image data received from outside in the present photographing display device, the display mode determination unit 118 basically outputs according to auxiliary data indicating the format of the image data as described above. Although the display mode is determined by the mode switching control unit 116 in accordance with the image identification information, the display mode may be displayed in the display mode determined by the display mode selection unit 119 according to the user operation or the usage mode of the apparatus. The control method at that time will be described below.

  First, it is determined according to auxiliary data indicating the format of image data. That is, for example, when displaying horizontally long stereoscopic image data, the image is rotated 90 degrees horizontally even if the user uses the photographing display device of this embodiment in the form as shown in FIG. Display with status. Therefore, in order to properly view the displayed image, the user needs to change the apparatus to a form as shown in FIG. Second, it is determined according to the form of the photographing display device. That is, regardless of the format of the image data, if the user wants to prioritize the form in use, if the display mode selection unit indicates that fact, the image will not rotate horizontally even in the above example, for example. The image can be properly viewed in the form shown in FIG. Third, determine according to the user's arbitrary designation. In other words, after the display mode is determined according to the second standard, for example, when the user is lying down and continues to watch, it is inconvenient that the orientation of the image changes according to the second standard. Therefore, in such a case, if the user points at the display mode selection unit as described above, the image does not rotate horizontally even in the above example, and the user remains in the form of FIG. Appropriate viewing of images in a lying state is possible.

  Although the present embodiment has been described as the “photographing display device”, it may be configured as a “display device” in which the photographing unit and the control function related thereto are omitted. Even in such a case, the user operation and the simplicity of the control relating to the image display as described in the description of the “photographing display device” are similarly secured.

  Conversely, it may be configured as a “photographing apparatus” that omits the display means and the control function related thereto. Alternatively, a configuration may be employed in which an image being captured is not displayed while the display unit is provided. Even in such a case, the user operation and the simplicity of the control relating to image shooting as shown in the description of the “shooting display device” are similarly secured. Further, in the present embodiment, an example in which there are three imaging units has been described. However, it is possible to configure an imaging display device or an imaging device that includes four or more imaging units based on the same concept.

It is a block diagram which shows the internal structure of the imaging | photography display apparatus by the 1st Example of this invention. It is a conceptual diagram which shows the structure of the image data in each imaging | photography / display mode. 1 is a simple external view of a photographing display device according to a first embodiment of the present invention. It is a simple external view of the imaging | photography display apparatus by the 2nd Example of this invention. It is a block diagram which shows the internal structure of the imaging | photography display apparatus by the 3rd Example of this invention. It is a conceptual diagram which shows the usage condition of the imaging | photography display apparatus by the 3rd Example of this invention. It is a conceptual diagram which shows the relationship between the distance at the time of observing a stereo image, and the space | interval of two imaging parts (both eyes).

Explanation of symbols

101-1 to 101-n Imaging unit 102 Imaging control unit 103 Image processing unit 104 Image encoding unit 105 Image display unit 106 Mode switching control unit 111-1 to 111-n Imaging unit 112 Imaging control unit 113 Image processing unit 114 Image Encoding unit 115 Image display unit 116 Mode switching control unit 117 Image decoding unit 118 Display mode determination unit 119 Display mode selection unit 201-206 Image 207 Stereo image 208 Panoramic image 209 Multiple subject image 301 Main imaging unit 302 (first) Sub imaging unit 303 Image display unit 304 Second sub imaging unit

Claims (4)

A plurality of imaging means that can be individually controlled to be in an operating / non-operating state, an imaging control means that controls the plurality of imaging means, and a mode switching control that performs switching control of a plurality of shooting modes depending on the operating state of the imaging means Means, and
At least one imaging means among the plurality of imaging means is arranged in a configuration capable of changing a distance from other imaging means,
Among previously given or is spaced at least a plurality of IMAGING means arranged to each other a predetermined distance by moving one of the, at least two image pickup means is operational, and When the optical axes of the respective imaging means are on the same plane and are in an operating state such that they are parallel to each other or intersect in front of the plane, the imaging mode switching control means takes an image so that a stereoscopic image is output. An imaging apparatus characterized in that a mode is determined and switched to a stereoscopic imaging mode. The mode switching control unit, when at least two image pickup means is operational conditions such as the optical axes intersect each other at the rear on the plane be on the same plane of the imaging means, the normal image that is panorama The photographing apparatus according to claim 1, wherein the photographing mode is determined and switched to a panoramic photographing mode so as to be output . The mode switching control unit is configured to capture a normal image including a plurality of subjects when at least two imaging units are in an operating state in which the optical axes of the imaging units are not on the same plane. The photographing apparatus according to claim 1, wherein the plurality of photographing modes are determined and switched. An imaging display device comprising: the imaging device according to any one of claims 1 to 3; and display means capable of displaying a normal image and a stereoscopic image,
The mode switching control unit causes the display unit to select whether to display a normal image or a stereoscopic image according to an image output based on the shooting mode. Shooting display device to do.

Images