JP2012151536A - Image file generation device, image file reproduction device, image file generation method and image file reproduction method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide means for transmitting from an imaging device to a display device information on whether an image has been parallax-adjusted, which has not been provided conventionally.SOLUTION: An image file generation device includes: a first viewpoint image acquisition unit 101 and a second viewpoint image acquisition unit 102 for acquiring a plurality of images corresponding to a plurality of viewpoints to an identical scene; a parallax information file reading unit 201 for acquiring parallax information related to a protrusion or a recess when the plurality of images are viewed as a three-dimensional video image based on the plurality of images; a parallax condition decision unit 104 for deciding whether or not the parallax information acquired by the parallax information file reading unit 201 satisfies a preset parallax condition related to the protrusion or the recess; and a file generation unit 107 for generating an image file having the plurality of images, acquired by the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102, and a header mapped thereto. The header includes information related to the decision result of the parallax condition decision unit 104.

Description

  The present invention relates to an image file generation apparatus and the like for generating an image file in which two images constituting a stereoscopic video are associated with a determination result of a parallax condition when the two images are captured.

  Patent Document 1 discloses a stereoscopic image recording apparatus that records a stereoscopic image composed of a plurality of images corresponding to a plurality of viewpoints after performing parallax adjustment.

  When recording a stereoscopic image, the stereoscopic image recording apparatus also records adjustment information that is information related to parallax adjustment of the stereoscopic image. This adjustment information is recorded after being converted into a unit indicating a physical length independent of the display.

  As a result, the stereoscopic image recorded in the stereoscopic image recording apparatus can be adjusted for the amount of parallax according to the intention of the user who first performed the parallax adjustment without depending on the display.

JP-A-2005-73012

  The stereoscopic image recording apparatus disclosed in Patent Document 1 can record a plurality of images constituting a stereoscopic image and adjustment information related to parallax adjustment of the stereoscopic image.

  However, it has not been possible to determine whether or not parallax adjustment is necessary for a plurality of images constituting a stereoscopic image. In fact, parallax adjustment is often unnecessary when the parallax is within a predetermined range for a plurality of images constituting a stereoscopic image.

  Therefore, the present invention provides a user-friendly image file generation apparatus and the like by improving processing when generating or reproducing an image file in which a plurality of images constituting a stereoscopic image are associated with a header portion. The purpose is to do.

  In order to solve the above-described problems, an image file generation device according to the present invention relates to an image acquisition unit that acquires an image for stereoscopic viewing, and an image projection or withdrawal based on the acquired stereoscopic image. A parallax information acquisition unit that acquires parallax information to be determined, a determination unit that determines whether or not the parallax information acquired by the parallax information acquisition unit satisfies a predetermined parallax condition related to jumping out or retraction, and a header unit And a generation unit that generates an image file including an image storage unit that stores an image for stereoscopic viewing acquired by the image acquisition unit, and the generation unit includes a determination by the determination unit in the header unit. Stores information about results.

  In this way, when the image file is played back on the playback device, it is possible to confirm whether or not the parallax when the image is captured satisfies a preset parallax condition only by analyzing the header portion. As a result, in a playback apparatus that plays back an image file, it is possible to easily determine whether or not to perform parallax adjustment of a plurality of image files, and the playback operation of the image file can be simplified.

  Preferably, the generation unit stores information on other parallaxes in the header unit, and information on a determination result of the determination unit is read at a position that is read out in time before information on the other parallaxes. Store.

  In this way, when the image file playback apparatus plays back, it is necessary to refer to the determination result of the header portion first, and when the determination result does not require parallax adjustment, it is necessary to refer to information on other parallax. Therefore, the reproduction operation of the image file can be simplified.

  Further preferably, the generation unit further stores at least one information or information on a condition related to jumping out or retraction among parallax conditions used by the determination unit for determination in the header unit.

  In this way, in the playback device that plays back an image file, it is possible to easily confirm according to what parallax conditions are determined in the image file generation device, and the playback operation of the image file can be made more efficient.

  Also preferably, an image acquisition unit that acquires an image for stereoscopic viewing, a parallax information acquisition unit that acquires parallax information related to jumping out or retracting of the image based on the acquired stereoscopic image, and the parallax Based on the parallax information acquired by the information acquisition unit, a display information setting unit that sets display information related to a display size recommended when viewing the stereoscopic image, a header unit, and the image acquisition unit A generation unit that generates an image file having an image storage unit that stores an image for stereoscopic viewing, and the generation unit stores display information set by the display information setting unit in the header unit To do.

  In this way, when the image file is played back on the playback device, information relating to the recommended display size used for determining the parallax condition when the image is taken can be confirmed by simply analyzing the header portion. As a result, in a playback apparatus that plays back an image file, it is possible to easily determine whether or not to adjust the parallax of a plurality of images according to information related to the recommended display size.

  Preferably, an image acquisition unit that acquires a stereoscopic image and a distance from the display device that displays the stereoscopic image to a viewer recommended when viewing the stereoscopic image. Generating to generate an image file having a distance information setting unit that sets recommended viewing distance information indicating a certain recommended viewing distance, a header unit, and an image storage unit that stores an image for stereoscopic viewing acquired by the image acquisition unit And the generation unit stores the recommended viewing distance information set by the distance information setting unit in the header unit.

  In this way, when the image file is played back on the playback device, the recommended viewing distance from the display device to the viewer can be confirmed only by analyzing the header portion. Thus, in the playback device that plays back an image file, the recommended viewing distance information can be used without providing special processing, and whether or not to adjust the parallax of a plurality of images according to the information related to the recommended viewing distance. Easy to judge.

  Preferably, based on the acquired stereoscopic image, based on the parallax information acquiring unit that acquires parallax information related to the jumping out or retracting of the image, and the parallax information acquired by the parallax information acquiring unit, A display information setting unit configured to set display information related to a display size recommended when viewing an image for stereoscopic viewing, and the distance information setting unit includes display information set by the display information setting unit. Based on this, recommended viewing distance information is set.

  In this way, the image file generation device can set information related to the recommended viewing distance based on the display information. Thereby, the reproduction operation of the image file can be easily executed more safely in the reproduction apparatus of the image file.

  The image file playback device of the present invention also includes an image storage unit that stores a stereoscopic image, and information related to a determination result indicating whether or not the parallax information of the stereoscopic image satisfies a predetermined parallax condition. An acquisition unit that acquires an image file associated with a header portion that includes the analysis unit that acquires parallax condition determination result information included in the header portion of the acquired image file, and a parallax condition determination acquired by the analysis unit A playback unit that switches a video processing method for the stereoscopic image included in the image file according to the result information.

  In this way, the image file playback device can determine whether or not to adjust parallax only by analyzing the header part without determining whether or not parallax adjustment is possible based on the acquired pixel data of a plurality of images. Judgment can be made.

  Preferably, an image file in which an image storage unit that stores a stereoscopic image and a header unit that includes display information related to a display size recommended when viewing the stereoscopic image is acquired. An acquisition unit, an analysis unit that acquires display information included in the header portion of the acquired image file, and a display display that acquires display display information that is information related to a display of a display device that displays the stereoscopic image Whether or not to perform parallax adjustment on the stereoscopic image according to a comparison result between the information acquisition unit, the display information acquired by the analysis unit, and the display display information acquired by the display display information acquisition unit And a playback unit that switches between them.

  In this way, it is possible to perform the parallax adjustment with certainty according to the information of the actual display device.

  Preferably, the playback unit calculates a viewing distance when viewing the stereoscopic image from the display information acquired by the analysis unit and the display information acquired by the display display information acquisition unit, respectively. In accordance with the comparison result of the two viewing distances, whether to perform parallax adjustment on the stereoscopic image is switched.

  In this way, it is possible to perform the parallax adjustment with certainty according to the information of the actual display device.

  Also preferably, an image storage unit that stores an image for stereoscopic viewing, and a viewing distance from the display device that displays the stereoscopic image to a viewer recommended when viewing the stereoscopic image. An acquisition unit for acquiring an image file associated with a header portion including recommended viewing distance information indicating a recommended viewing distance, and an analysis unit for acquiring recommended viewing distance information included in the header portion of the acquired image file A display display information acquisition unit that acquires display display information that is information regarding a display of a display device that displays the stereoscopic image, and the display display information acquired by the display display information acquisition unit. Information indicating the viewing distance from the display device to the viewer when viewing the image is calculated, and the calculated information and the recommendation acquired by the analysis unit Depending on the comparison result of hearing distance information, and a reproduction unit for switching whether to perform the parallax adjustment for the image for the stereoscopic.

  In this way, it is possible to perform the parallax adjustment with certainty according to the information of the actual display device.

  According to the image file generation device of the present invention, when an image file is played back on a playback device, it is possible to check whether or not the parallax when the image is captured satisfies a preset parallax condition simply by analyzing the header portion. A simple image file can be generated.

Configuration diagram of an image file generation apparatus of the present embodiment Explanatory diagram regarding disparity information of popping out and retracting Explanatory drawing about parallax conditions Explanatory drawing of the data structure of the image file generated in this embodiment Configuration diagram of an image file playback device of the present embodiment

(Embodiment)
Hereinafter, the present embodiment will be described with reference to the drawings. In this embodiment, the case of two viewpoints will be described.

  FIG. 1 is a configuration diagram of an image file generation apparatus 1 according to the present embodiment. As the image file generation device, a digital camera, a digital movie, or the like is assumed. In short, any device can be used as long as it can generate a first viewpoint image and a second viewpoint image constituting a stereoscopic video.

  As shown in FIG. 1, the image file generation device includes a first viewpoint image acquisition unit 101, a second viewpoint image acquisition unit 102, a parallax analysis unit 103, a parallax condition determination unit 104, a video processing unit 105, a shooting control unit 106, A file generation unit 107, a file recording unit 108, and a memory card 109 are included.

  The first viewpoint image acquisition unit 101 sets shooting parameters such as zoom (change of focal length), focus, aperture, and camera shake correction based on control from the shooting control unit 106. Then, a first viewpoint image at the first viewpoint is generated based on the set shooting parameter. The generated first viewpoint image is output to the parallax analysis unit 103 and the video processing unit 105.

  The second viewpoint image acquisition unit 102 sets shooting parameters such as zoom (change of focal length), focus, aperture, and camera shake correction based on control from the shooting control unit 106. In this case, it is preferable to set shooting parameters similar to those of the first viewpoint image acquisition unit 101. Then, a second viewpoint image at the second viewpoint is generated based on the set shooting parameter. The generated second viewpoint image is output to the parallax analysis unit 103 and the video processing unit 105.

  Note that the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102 are based on the control signal from the imaging control unit 106 and between the viewpoints between the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102. The distance can be changed. Further, the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102 have optical axes of the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102 based on a control signal from the imaging control unit 106. The convergence angle formed can be changed.

  The parallax analysis unit 103 acquires parallax information from the two viewpoint images and outputs the parallax information to the parallax condition determination unit 104.

  FIG. 2 is an explanatory diagram relating to the disparity information of the popping out and retracting. For example, as shown in (a) or (b) in the figure, an object that protrudes or retracts toward the viewer side of the display screen is shifted in the horizontal direction between the first viewpoint image and the second viewpoint image. It is projected at the position. Information indicating the amount relating to the “deviation” is set as parallax information. The parallax information is expressed by, for example, a pixel value or a value obtained by dividing the pixel value by the width of the display screen. Note that the parallax information is not limited to the above value, and any index may be used as long as the deviation can be specified.

  The parallax condition determination unit 104 has a function of determining whether ideal parallax conditions are set in advance and the parallax information input from the parallax analysis unit 103 satisfies the parallax condition. The parallax condition determination unit 104 outputs the determination result to the file generation unit 107. Here, for the determination result, for example, a 1-bit value is assumed, and a setting such as 1 when the value falls within the parallax condition and 0 when the value falls outside the parallax condition can be considered. However, the determination result is not limited to a 1-bit value, and any value may be used as long as the determination result of the parallax condition can be identified.

  In addition, when the parallax information does not satisfy the parallax condition as a result of the determination, the parallax condition determination unit 104 calculates a shooting parameter that falls within the parallax condition. Then, the parallax condition determination unit 104 outputs the calculated shooting parameter to the shooting control unit 106. This shooting parameter is a parameter resulting from the projection or withdrawal of the stereoscopic video when the first viewpoint image and the second viewpoint image are viewed as a stereoscopic video, and includes information such as a convergence angle, a stereo base, a field angle, and zoom. Is applicable. Note that the parallax condition determination unit 104 may be configured to output the calculated shooting parameters to the video processing unit 105.

  Here, preset photographing conditions will be described with reference to the drawings.

  FIG. 3 is a diagram for explaining the parallax condition. As shown in FIG. 3A, based on the image information of the first viewpoint image and the second viewpoint image, the parallax condition determination unit 104 determines the parallax angle α on the display screen where the parallax is substantially 0, the protruding subject. Are set to the maximum parallax angle α1 and the maximum parallax angle α2 of the most retracted subject. Based on the set angle, the parallax condition determination unit 104 is based on the conventional fact that it is easy to see when the difference between α and α1 and the difference between α and α2 are within a predetermined range (for example, ± 1 °). The parallax conditions of α <1 ° and α−α2 <1 ° are set. The parallax conditions may be any conditions that allow safe and high-quality stereoscopic viewing, such as conditions that facilitate stereoscopic viewing and conditions that facilitate stereoscopic viewing.

  Further, as shown in FIG. 3B, the parallax condition determination unit 104 sets the parallax angle β1 of the most protruding subject and the parallax angle β2 of the most retracted subject. Based on the conventional fact that the depth range (β1-β2) is easy to see when it falls within a predetermined range (for example, 1 °), the parallax condition determination unit 104 assumes a parallax condition of β1-β2 <1 °. Also good. Further, it may be assumed that the maximum parallax of retraction is converted into a shift amount on the screen and the distance between human eyes (for example, 50 mm in the case of a child) or less. These conditions may be combined conditions.

  Note that the parallax condition determination unit 104 may be configured to allow the user to input information related to an assumed display size for displaying an image. Further, the recommended distance for viewing an image may be set based on the input information regarding the assumed display size. In this case, for example, a distance that is three times the vertical size of the assumed display size is set as the recommended distance.

  The video processing unit 105 performs various processes on the input two viewpoint images. For example, the video processing unit 105 performs various video processes such as gamma correction, white balance correction, and flaw correction on the first viewpoint image and the second viewpoint image. Further, the video processing unit 105 compresses the image with the compression format or the like conforming to the JPEG standard for the processed first viewpoint image and second viewpoint image. The video processing unit 105 outputs the compressed image to the file generation unit 107.

  Note that when the imaging parameter is input from the parallax condition determination unit 104, the video processing unit 105 performs parallax adjustment on the two viewpoint images that are input. The parallax adjustment refers to an operation of correcting two viewpoint images by signal processing so that an image satisfying the shooting parameters output from the parallax condition determination unit 104 is obtained. For example, there is an operation of trimming two viewpoint images or an operation of shifting pixel data. The parallax adjustment is not limited to the above method, and any method may be used as long as the stereoscopic effect is changed when viewing two viewpoint images as a stereoscopic video. Absent.

  The imaging control unit 106 zooms (changes the focal length) in the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102 based on the imaging parameters output from the parallax condition determination unit 104, and two viewpoint image acquisition units Shooting parameters such as the convergence angle between them, the interval between two viewpoint image acquisition units, focus, aperture, and camera shake correction.

  The file generation unit 107 generates an image file in which the determination result output from the parallax condition determination unit 104 and the two viewpoint images output from the video processing unit 105 are associated with each other. The file generation unit 107 outputs the generated image file to the file recording unit 108. The image file is generated in accordance with, for example, a multi-picture format. The file generation unit 107 uses any file format as long as it can store the determination result output from the parallax condition determination unit 104 and the two viewpoint images output from the video processing unit 105 in association with each other. It doesn't matter.

  When the shooting parameter is acquired from the parallax condition determination unit 104, the file generation unit 107 associates the determination result output from the parallax condition determination unit 104, the shooting parameter, and the two viewpoint images output from the video processing unit 105. Generate an image.

  FIG. 4 is an explanatory diagram of the data structure of the image file generated in the present embodiment. The image file generated by the image file generation apparatus of the present embodiment includes a plurality of image data, and the image file includes first viewpoint image data 503 and second viewpoint image data as shown in FIG. Here, the first viewpoint image data 503 is stored in a data area other than the header part area of the main header part 502. The second viewpoint image data is stored in a data area other than the header area of the second viewpoint image header section 506. In FIG. 4, two image data are stored in the image file. However, a plurality of image data can be stored. That is, the third viewpoint image can be stored in addition to the first viewpoint image and the second viewpoint image.

  The head identifier 501, the main header 502, the first viewpoint image data 503, and the tail identifier 504 are stored in the image file as one group related to the first viewpoint image.

  The head identifier 501 is a marker that represents the starting point of the group in which the first viewpoint image data 503 is stored. The head identifier 501 is, for example, file start information (xFFD8) defined by the JPEG standard.

  The main header portion 502 is a storage portion for management data of the entire image file. The main header unit 502 includes information on a parallax determination result indicating whether or not the parallax information of the recorded first viewpoint image data 503 and second viewpoint image data satisfies a predetermined parallax condition. The information on the parallax determination result is information generated based on the determination result acquired from the parallax condition determination unit 104. As the information on the parallax determination result, any information can be used as long as it can identify the determination result of the parallax condition. For example, 1-bit flag information can be used.

  Further, the main header section 502 includes display size information and viewing distance information assumed when the parallax condition is determined, a pop-up maximum parallax condition, a retraction maximum parallax condition, a depth range condition, an interocular parallax condition, and the like. It does not matter if it is configured.

  In addition, when parallax adjustment is performed by the video processing unit 105, a shooting parameter used for the parallax adjustment may be included.

  The first viewpoint image data 503 is, for example, the first viewpoint image compressed in JPEG format.

  The tail identifier 504 is a marker (xFFD9) indicating the end point of the first viewpoint image data 503. By providing this marker at the end of the first viewpoint image data 503, the image file is divided into two image files, an image file consisting of the first viewpoint image data 503 and an image file consisting of the second viewpoint image data. At this time, there is no need to newly add a head identifier (SOI) or tail identifier (EOI) to the file. Therefore, the image file can be easily divided.

  The head identifier 505, the second viewpoint image header 506, the second viewpoint image data, and the end identifier 508 are stored in the image file as one group related to the second viewpoint image.

  The head identifier 505 is a marker indicating the starting point of the group related to the second viewpoint signal. A table for managing this marker is provided in the main header section 502. Thereby, the second viewpoint image data can be easily searched. In addition, when dividing a file, a dividing point can be easily found. Further, by providing this marker, when dividing an image file into a plurality of image files, it is not necessary to newly add SOI or EOI to the file. Therefore, the file can be easily divided.

  The second viewpoint image header section 506 stores attribute information of the second viewpoint image data.

  The second viewpoint image data is, for example, the second viewpoint image compressed in the JPEG format.

  The tail identifier 508 is a marker indicating the end point of the group related to the second viewpoint signal. A table for managing this marker is provided in the main header section 502. Thereby, the second viewpoint image data can be easily searched. In addition, when dividing a file, a dividing point can be easily found. Further, by providing this marker, when dividing an image file, it is not necessary to newly add SOI or EOI to the file, and the file can be divided easily.

  The file recording unit 108 records the image file input from the file generation unit 107 on the memory card 109. The memory card 109 may be any recording medium that can record the image file generated by the file generation unit 107, such as a flash memory card such as an SD card.

  In the image file generation apparatus according to the present embodiment, the parallax analysis unit 103, the parallax condition determination unit 104, the video processing unit 105, the shooting control unit 106, and the file generation unit 107 may be implemented as microcomputer or DSP software. Good.

  FIG. 5 is a configuration diagram of an image file reproduction device that reproduces an image file generated by the image file generation device. As the image file reproducing apparatus, a digital television, a digital video player / digital video recorder and digital television system, a digital camera / digital movie and digital television system, and the like are assumed.

  The image file playback device includes a file reading unit 201, a file analysis unit 202, a parallax adjustment determination unit 203, an image playback unit 204, a parallax adjustment unit 205, and a video display unit 206.

  The file reading unit 201 reads an image file recorded on the memory card 109. Then, the file reading unit 201 outputs the read image file to the file analysis unit 202.

  The file analysis unit 202 analyzes the image file acquired from the file reading unit 201. Specifically, the file analysis unit 202 extracts information on the parallax determination result and image data of each viewpoint from the header portion of the image file. The file analysis unit 202 outputs the image data of each viewpoint in the extracted information to the image reproduction unit 204 and outputs information on the parallax determination result to the parallax adjustment determination unit 203. As a result of the analysis of the image file, the file analysis unit 202 is configured to output to the parallax adjustment determination unit 203 when the shooting parameter or the parallax condition is extracted from the header portion of the image file. In addition, the file analysis unit 202 displays information on display size, viewing distance, and the like assumed when the parallax analysis unit 103 determines the parallax condition, maximum pop-up parallax condition, maximum retraction parallax condition, depth range condition, and interocular parallax. When conditions and the like are extracted, they are output to the parallax adjustment determination unit 203.

  The parallax adjustment determination unit 203 determines whether or not to perform parallax adjustment on a plurality of images constituting the stereoscopic video output from the image reproduction unit 204 based on the information on the parallax determination result acquired from the file analysis unit 202. A control signal for setting is generated. For example, when the flag information whose parallax determination result information is “1” is received from the file analysis unit 202, a control signal indicating that the parallax adjustment is not performed is output to the parallax adjustment unit 205. On the other hand, when the flag information whose parallax determination result information is “0” is received from the file analysis unit 202, a control signal indicating that parallax adjustment is to be performed is output to the parallax adjustment unit 205. When a control signal indicating that the parallax adjustment is to be performed is output to the parallax adjustment unit 205, the parallax adjustment determination unit 203 uses information such as the shooting parameter and the parallax condition acquired from the file analysis unit 202 as the control signal. In addition, the result is output to the parallax adjustment unit 205.

  The image reproduction unit 204 decodes the image data of each viewpoint, processes the image data into a displayable format, and outputs the processed data to the parallax adjustment unit 205.

  Based on the control signal from the parallax adjustment determination unit 203, the parallax adjustment unit 205 switches whether to perform parallax adjustment on each viewpoint image acquired from the image reproduction unit 204. The parallax adjustment unit 205 outputs an image with parallax adjustment or an image without parallax adjustment to the video display unit 206.

  Note that the parallax adjustment unit 205 uses information acquired from the parallax adjustment determination unit 203 when performing parallax adjustment on the image acquired from the image reproduction unit 204.

  Further, the parallax adjustment unit 205, when information such as display size information and viewing distance assumed when determining the parallax condition is input from the parallax adjustment determination unit 203, the actual display size, the actual viewing distance, A configuration may be used in which the parallax adjustment is performed so as to match or be close to the assumption at the time of recording as compared with the viewing distance assumed in the actual display size. Also, the parallax adjustment unit 205 receives information such as display size information and viewing distance assumed when determining the parallax condition even when parallax adjustment is not performed based on information on the parallax determination result. The parallax adjustment may be performed so that the actual display size, the actual viewing distance, the viewing distance assumed for the actual display size, and the like are matched or close to the assumption at the time of recording.

  The video display unit 206 displays the image acquired from the parallax adjustment unit 205 as a stereoscopic video.

  In the image file reproduction device described above, the file analysis unit 202, the parallax adjustment determination unit 203, the image reproduction unit 204, and the parallax adjustment unit 205 may be implemented as microcomputer or DSP software.

  When the parallax adjustment unit 205 performs parallax adjustment and outputs a plurality of images to the video display unit 206, the parallax adjustment unit 205 may be configured to display information indicating that the parallax adjustment has been performed simultaneously with the plurality of images. Even if the parallax adjustment is performed, if the image does not fit in the parallax condition, a warning display may be displayed on the video display unit 206.

(Summary)
The image file generation device according to the present embodiment projects a first viewpoint image acquisition unit 101 and a second viewpoint image acquisition unit 102 that acquire an image for stereoscopic vision, and an image projection based on the acquired stereoscopic image. Alternatively, the parallax analysis unit 103 that acquires parallax information related to retraction, and the parallax condition that determines whether or not the parallax information acquired by the parallax analysis unit 103 satisfies a pre-set parallax condition related to jumping out or retraction A file generation unit that generates an image file that includes a determination unit 104, a header unit, and an image storage unit that stores images for stereoscopic viewing acquired by the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102. 107, and the file generation unit 107 stores information on the determination result of the parallax condition determination unit 104 in the header portion.

  In this way, when the image file is played back on the playback device, it is possible to confirm whether or not the parallax when the image is captured satisfies a preset parallax condition only by analyzing the header portion. As a result, in a playback apparatus that plays back an image file, it is possible to easily determine whether or not to perform parallax adjustment of a plurality of image files, and the playback operation of the image file can be simplified.

  Preferably, the file generation unit 107 stores information on other parallaxes in the header unit, and information on the determination result of the parallax condition determination unit 104 is temporally earlier than information on the other parallaxes. Is stored at the position to be read out.

  In this way, when the image file playback apparatus plays back, it is necessary to refer to the determination result of the header portion first, and when the determination result does not require parallax adjustment, it is necessary to refer to information on other parallax. Therefore, the reproduction operation of the image file can be simplified.

  Preferably, the file generation unit 107 further includes at least one piece of information or both of the conditions related to jumping out or retraction among the parallax conditions used for the determination by the parallax condition determining unit 104 in the header part. Store information.

  In this way, in the playback device that plays back an image file, it is possible to easily confirm according to what parallax conditions are determined in the image file generation device, and the playback operation of the image file can be made more efficient.

  Preferably, the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102 that acquire a stereoscopic image, and the parallax related to the jumping out or withdrawal of the image based on the acquired stereoscopic image. A parallax analysis unit 103 that acquires information, and a parallax condition determination unit that sets display information related to a display size recommended when viewing the stereoscopic image based on the parallax information acquired by the parallax analysis unit 103 104, a file generation unit 107 that generates an image file including a header unit, and an image storage unit that stores an image for stereoscopic viewing acquired by the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102; The file generation unit 107 stores the display information set by the parallax condition determination unit 104 in the header portion.

  In this way, when the image file is played back on the playback device, information relating to the recommended display size used for determining the parallax condition when the image is taken can be confirmed by simply analyzing the header portion. As a result, in a playback apparatus that plays back an image file, it is possible to easily determine whether or not to adjust the parallax of a plurality of images according to information related to the recommended display size.

  Preferably, the first viewpoint image acquisition unit 101 and the second viewpoint image acquisition unit 102 that acquire a stereoscopic image, and the stereoscopic image recommended when viewing the stereoscopic image. Parallax condition determination unit 104 for setting recommended viewing distance information indicating a recommended viewing distance that is a distance from a display device that displays the viewer to the viewer, a header unit, the first viewpoint image acquisition unit 101, and the second viewpoint image acquisition A file generation unit 107 that generates an image file including an image storage unit that stores an image for stereoscopic viewing acquired by the unit 102, and the file generation unit 107 includes the parallax condition determination unit in the header unit The recommended viewing distance information set in 104 is stored.

  In this way, when the image file is played back on the playback device, the recommended viewing distance from the display device to the viewer can be confirmed only by analyzing the header portion. Thus, in the playback device that plays back an image file, the recommended viewing distance information can be used without providing special processing, and whether or not to adjust the parallax of a plurality of images according to the information related to the recommended viewing distance. Easy to judge.

  Further preferably, based on the acquired stereoscopic image, the parallax analysis unit 103 that acquires parallax information related to the jumping out or withdrawal of the image, and the parallax information acquired by the parallax analysis unit 103, A parallax condition determining unit 104 that sets display information related to a display size recommended when viewing a stereoscopic image, and the parallax condition determining unit 104 is set by the parallax condition determining unit 104 Recommended viewing distance information is set based on display information.

  In this way, the image file generation device can set information related to the recommended viewing distance based on the display information. Thereby, the reproduction operation of the image file can be easily executed more safely in the reproduction apparatus of the image file.

  The image file playback device of the present invention also includes an image storage unit that stores a stereoscopic image, and information related to a determination result indicating whether or not the parallax information of the stereoscopic image satisfies a predetermined parallax condition. A file reading unit 201 that acquires an image file associated with a header portion that includes the file analysis unit 202, a file analysis unit 202 that acquires parallax condition determination result information included in the header portion of the acquired image file, and the file analysis unit 202. And an image reproduction unit 204 that switches a video processing method for the stereoscopic image included in the image file in accordance with the acquired parallax condition determination result information.

  In this way, the image file playback device can determine whether or not to adjust parallax only by analyzing the header part without determining whether or not parallax adjustment is possible based on the acquired pixel data of a plurality of images. Judgment can be made.

  Preferably, an image file in which an image storage unit that stores a stereoscopic image and a header unit that includes display information related to a display size recommended when viewing the stereoscopic image is acquired. File display unit 201, file analysis unit 202 that acquires display information included in the header portion of the acquired image file, and display display information that is information related to the display of the display device that displays the stereoscopic image. The display display information file reading unit 201 to be acquired, the display information acquired by the file analysis unit 202, and the display display information acquired by the display display information file reading unit 201 are used for the stereoscopic viewing. Whether to adjust the parallax for the image Ri includes an image reproduction section 204 changing, the.

  In this way, it is possible to perform the parallax adjustment with certainty according to the information of the actual display device.

  Further preferably, the image reproduction unit 204 views the stereoscopic image from the display information acquired by the file analysis unit 202 and the display display information acquired by the display display information file reading unit 201. A distance is calculated, and whether to perform parallax adjustment on the stereoscopic image is switched according to a comparison result between the calculated two viewing distances.

  In this way, it is possible to perform the parallax adjustment with certainty according to the information of the actual display device.

  Also preferably, an image storage unit that stores an image for stereoscopic viewing, and a viewing distance from the display device that displays the stereoscopic image to a viewer recommended when viewing the stereoscopic image. A file reading unit 201 for acquiring an image file associated with a header portion including recommended viewing distance information indicating a recommended viewing distance, and acquiring recommended viewing distance information included in the header portion of the acquired image file A file analysis unit 202; a display display information file reading unit 201 that acquires display display information that is information about a display of a display device that displays the stereoscopic image; and a display acquired by the display display information file reading unit 201. Viewing from the display device to the viewer when viewing the stereoscopic image from display information An image that calculates information indicating the distance and switches whether to perform parallax adjustment on the stereoscopic image according to a comparison result between the calculated information and the recommended viewing distance information acquired by the file analysis unit 202 A playback unit 204.

  In this way, it is possible to perform the parallax adjustment with certainty according to the information of the actual display device.

  As described above, in the image file generation device, the predetermined parallax condition for realizing easy-to-see and high-quality stereoscopic vision is determined, and the parallax determination result is recorded in the image file. By referring to the above, it is possible to simplify the parallax adjustment processing during reproduction. In addition, by recording information such as display size information and viewing distance assumed when determining the parallax condition in the image file generation device in the image file, the actual display size and viewing distance are recorded in the image file playback device. As a result, the parallax can be adjusted in accordance with the actual visual environment.

  According to the image file generation device and the image file reproduction device according to the present invention, a method for generating and reproducing an image file including information related to stereoscopic effect when viewed as a three-dimensional image in the header portion is provided. The present invention can be applied to digital cameras that shoot 3D images, broadcast cameras, recorders or players that record and reproduce 3D images, and display devices such as televisions, photo frames, and portable information terminals.

DESCRIPTION OF SYMBOLS 101 1st viewpoint image acquisition part 102 2nd viewpoint image acquisition part 103 Parallax analysis part 104 Parallax condition determination part 105 Image processing part 106 Shooting control part 107 File generation part 108 File recording part 109 Memory card 201 File reading part 202 File analysis part DESCRIPTION OF SYMBOLS 203 Parallax adjustment determination part 204 Image reproduction part 205 Parallax adjustment part 206 Image | video display part 501,505 Head identifier 502 Main header part 503 1st viewpoint image data 504,508 End identifier 506 2nd viewpoint image header part 507 2nd viewpoint image data

Claims (12)

An image acquisition unit for acquiring an image for stereoscopic viewing;
A parallax information acquiring unit that acquires parallax information related to the jumping out or retracting of the image based on the acquired stereoscopic image;
A determination unit that determines whether or not the disparity information acquired by the disparity information acquisition unit satisfies a disparity condition related to preset jumping or withdrawal;
A generation unit that generates an image file including a header unit and an image storage unit that stores an image for stereoscopic viewing acquired by the image acquisition unit;
The generation unit stores information on a determination result of the determination unit in the header unit.
Image file generator. The generation unit stores information on other parallax in the header unit, and stores information on a determination result of the determination unit at a position read out temporally before information on the other parallax.
The image file generation device according to claim 1.   The generation unit further stores, in the header portion, information on at least one of the conditions related to jumping out or withdrawal or information on both of the parallax conditions used by the determination unit for determination. The image file generation device according to claim 2. An image acquisition unit for acquiring an image for stereoscopic viewing;
A parallax information acquiring unit that acquires parallax information related to the jumping out or retracting of the image based on the acquired stereoscopic image;
A display information setting unit configured to set display information related to a display size recommended when viewing the stereoscopic image based on the parallax information acquired by the parallax information acquiring unit;
A generation unit that generates an image file including a header unit and an image storage unit that stores an image for stereoscopic viewing acquired by the image acquisition unit;
The generation unit stores display information set by the display information setting unit in the header unit.
Image file generator. An image acquisition unit for acquiring an image for stereoscopic viewing;
A distance information setting unit that sets recommended viewing distance information indicating a recommended viewing distance that is a distance from a display device that displays the stereoscopic image to a viewer, which is recommended when viewing the stereoscopic image. When,
A generation unit that generates an image file including a header unit and an image storage unit that stores an image for stereoscopic viewing acquired by the image acquisition unit;
The generation unit stores the recommended viewing distance information set by the distance information setting unit in the header part.
Image file generator. A parallax information acquiring unit that acquires parallax information related to the jumping out or retracting of the image based on the acquired stereoscopic image;
A display information setting unit configured to set display information related to a display size recommended when viewing the stereoscopic image based on the parallax information acquired by the parallax information acquisition unit;
The distance information setting unit sets recommended viewing distance information based on the display information set by the display information setting unit.
The image file generation device according to claim 5. An image file in which an image storage unit that stores a stereoscopic image and a header unit that includes information on a determination result indicating whether or not the parallax information of the stereoscopic image satisfies a predetermined parallax condition An acquisition unit for acquiring
An analysis unit that acquires parallax condition determination result information included in the header portion of the acquired image file;
A playback unit that switches a video processing method for the stereoscopic image included in the image file in accordance with the parallax condition determination result information acquired by the analysis unit.
Image file playback device. An image storage unit for storing an image for stereoscopic viewing, an acquisition unit for acquiring an image file associated with a header portion including display information relating to a display size recommended when viewing the stereoscopic image, and
An analysis unit for acquiring display information included in the header portion of the acquired image file;
A display display information acquisition unit that acquires display display information that is information related to a display of a display device that displays the stereoscopic image;
A playback unit that switches whether to perform parallax adjustment on the stereoscopic image according to a comparison result between the display information acquired by the analysis unit and the display display information acquired by the display display information acquisition unit. And comprising
Image file playback device.   The reproduction unit calculates a viewing distance for viewing the stereoscopic image from the display information acquired by the analysis unit and the display information acquired by the display display information acquisition unit, and calculates the two viewing 9. The image file reproduction device according to claim 8, wherein whether or not parallax adjustment is performed on the stereoscopic image is switched according to a distance comparison result. An image storage unit that stores an image for stereoscopic viewing, and a recommended viewing that indicates a viewing distance from a display device that displays the stereoscopic image to a viewer, which is recommended when viewing the stereoscopic image. An acquisition unit for acquiring an image file associated with a header portion including recommended viewing distance information indicating a distance;
An analysis unit for acquiring recommended viewing distance information included in the header portion of the acquired image file;
A display display information acquisition unit that acquires display display information that is information related to a display of a display device that displays the stereoscopic image;
Information indicating the viewing distance from the display device to the viewer when viewing the stereoscopic image is calculated from the display information acquired by the display display information acquisition unit, and the calculated information and the analysis unit acquire A playback unit that switches whether to perform parallax adjustment on the stereoscopic image according to a comparison result of the recommended viewing distance information.
Image file playback device. Acquire a stereoscopic image,
Based on the acquired stereoscopic image, obtain parallax information related to the jumping out or withdrawal of the image,
Determining whether the acquired disparity information satisfies a disparity condition related to preset jumping or withdrawal;
Generating an image file having a header part including information on the result of the determination and an image storage part for storing the acquired stereoscopic image;
Image file generation method. An image file in which an image storage unit that stores a stereoscopic image and a header unit that includes information on a determination result indicating whether or not the parallax information of the stereoscopic image satisfies a predetermined parallax condition Get
Obtain parallax condition determination result information included in the header part of the obtained image file,
In accordance with the acquired parallax condition determination result information, a video processing method for the stereoscopic image included in the image file is switched.
Image file playback method.