WO2012096065A1 - Dispositif d'affichage d'image de parallaxe et procédé d'affichage d'image de parallaxe - Google Patents

Dispositif d'affichage d'image de parallaxe et procédé d'affichage d'image de parallaxe Download PDF

Info

Publication number
WO2012096065A1
WO2012096065A1 PCT/JP2011/077716 JP2011077716W WO2012096065A1 WO 2012096065 A1 WO2012096065 A1 WO 2012096065A1 JP 2011077716 W JP2011077716 W JP 2011077716W WO 2012096065 A1 WO2012096065 A1 WO 2012096065A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
parallax
value
region
color
Prior art date
Application number
PCT/JP2011/077716
Other languages
English (en)
Japanese (ja)
Inventor
矢作　宏一
敏 中村
雅子 末廣
三沢　岳志
友和 中村
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Publication of WO2012096065A1 publication Critical patent/WO2012096065A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00—Stereoscopic photography
    • G03B35/18—Stereoscopic photography by simultaneous viewing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals

Definitions

  • the present invention relates to a parallax image display device and a parallax image display method, and in particular, parallax image display in which the stereoscopic effect of a generated stereoscopic image can be confirmed on a two-dimensional display monitor before generating the stereoscopic image.
  • the present invention relates to a device and a parallax image display method.
  • the parallax value is a parallax value of two or more images that are the basis of a stereoscopic image and are captured from two or more different viewpoints.
  • a method of determining the stereoscopic effect of the generated stereoscopic image from the parallax value has been considered.
  • the parallax value indicating the degree of parallax is merely a numerical value, and it is difficult to sensuously grasp the actual stereoscopic effect from the numerical value of the parallax value.
  • a parallax image in which a parallax map in which the parallax value is associated with the pixel position of the first image of two or more images is generated, and the degree of the parallax value on the parallax map is expressed by a luminance difference or a color transition.
  • a technique for confirming the stereoscopic effect of an image for stereoscopic viewing by generating the image is known.
  • the parallax image in which the parallax value is expressed by a luminance difference or the like may not show the characteristics of the original image (left in FIG. 1) at all as shown on the right in FIG.
  • the subject existing in the foreground in the left original image in FIG. 1 has the largest parallax value, and the subject with the largest parallax value is displayed in a dark color close to black. ing.
  • the disparity value is smaller as the subject is farther, and in the right disparity image in FIG. 1, the subject is displayed such that the luminance is larger as the subject has a smaller disparity value.
  • the right image and the left image are segmented into a plurality of striped image pieces, and these striped striped image pieces are alternately arranged.
  • a so-called lenticular image is created, and a stereoscopic image forming system, a stereoscopic image forming method, a program, and a storage medium according to which a stereoscopic effect is confirmed with the created lenticular image are disclosed.
  • Japanese Patent Laid-Open No. 2008-103820 discloses a stereoscopic image processing apparatus that generates a lenticular image for a moving image using parallax data between a right image and a left image, and confirms a stereoscopic effect using the generated lenticular image.
  • the invention is disclosed.
  • a stereoscopic image processing apparatus disclosed in Japanese Patent Application Laid-Open No. 2008-103820 also uses a dedicated stereoscopic image reproduction apparatus (3D monitor) corresponding to a lenticular image in order to confirm the stereoscopic effect of a moving image converted into a lenticular image. ), There is a problem that the moving image must be reproduced.
  • the present invention has been made to solve the above problem, and a parallax image display device and a parallax image in which the stereoscopic effect of a stereoscopic image can be confirmed in advance on a 2D monitor before the stereoscopic image is created. It is an object to provide a display method and a parallax image display program.
  • a parallax image display device includes an acquisition unit that acquires a plurality of images taken from two or more different viewpoints, and a plurality of images acquired by the acquisition unit.
  • the disparity value represented by the difference in position for each corresponding region between the first image included and the second image different from the first image is made to correspond to the position of the region of the first image.
  • a parallax map generating unit that generates a parallax map, a color determining unit that determines a color of a corresponding region according to a parallax value for each region, and a color determining unit that determines a color of each region of the first image
  • a parallax image creation unit that creates a parallax color image that has been changed to the color, and an image synthesis unit that synthesizes the parallax color image and the first image.
  • the parallax value indicating the stereoscopic effect of the stereoscopic image generated from a plurality of images taken from two or more different viewpoints can be recognized by color.
  • a parallax color image is created, and the image synthesis unit synthesizes the parallax image and the first image, so that the pixels of the first image are mixed into the parallax color image by synthesis, and the parallax value is recognized by the luminance difference or the like In addition to being able to do so, an image is generated in which an outline of the subject can be grasped.
  • the image generated by the image composition unit does not require a special display device such as a display device having a lenticular lens, and is a bitmap image that can be displayed on a normal 2D monitor.
  • the effect of the stereoscopic effect of the stereoscopic image created from the second image can be confirmed in advance on the 2D monitor before creating the stereoscopic image.
  • the parallax image display method acquires a plurality of images taken from two or more different viewpoints, and the first image included in the acquired plurality of images is different from the first image.
  • a disparity map in which a disparity value represented by a position difference for each corresponding region with an image is associated with a position of the region of the first image is generated, and a region corresponding to the disparity value for each region Is determined, a parallax color image in which the color of each region of the first image is changed to the determined color is generated, and the parallax color image and the first image are synthesized.
  • the parallax image display program is an acquisition unit that acquires a plurality of images taken from two or more different viewpoints, and a first image included in the plurality of images acquired by the acquisition unit. And a second image different from the first image generate a parallax map in which a parallax value represented by a position difference for each corresponding region corresponds to a position of the region of the first image
  • a parallax map generation unit, a color determination unit that determines a color of a corresponding region according to a parallax value for each region, and a parallax color image obtained by changing the color of each region of the first image to a color determined by the color determination unit Is a program for functioning as a parallax image creation unit that creates the image, and an image synthesis unit that synthesizes the parallax color image and the first image.
  • the region includes not only one pixel but also a region in which several pixels are gathered in a square shape, such as 2 ⁇ 2 to 3 ⁇ 3.
  • the parallax values between the first image and the second image are associated with each region of the first image, and the degree of the associated parallax value is expressed in color.
  • 1 is a block diagram of a parallax image display device according to a first embodiment of the present invention. It is a flowchart which shows the process of the parallax image display apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows an example of two or more images image
  • FIG. 2 is a block diagram of the parallax image display device according to the first embodiment of the present invention.
  • the parallax image display device 200 is input with an image input unit 201 to which two or more images taken from two or more different viewpoints are input. Based on two or more images, the first image (left image in the first to seventh embodiments) and the second image (first to seventh embodiments) taken from different viewpoints of the left image.
  • the right image an image processing unit 202 for creating an image for confirming the stereoscopic effect of the stereoscopic image created from the image processing unit 202, an operation unit 203 for operating the parallax image display device 200, and image processing
  • a display unit 204 that displays a processing result of the unit 202; and a storage unit 205 that stores an input image or the like.
  • the image input unit 201 receives two or more images taken from two or more different viewpoints taken by a camera or the like that takes a stereoscopic image.
  • the image input unit 201 may be directly connected to a camera that captures a stereoscopic image, but an information storage medium (magnetic disk, optical disk, magneto-optical disk, memory card, IC card) that stores the image captured by the camera. Etc.) may be a data reading device that reads and inputs an image captured by the camera.
  • the operation unit 203 is a device for a user or the like to input an instruction to the parallax image display device 200, and input devices such as a touch panel, a keyboard, a mouse, and a pen tablet are used.
  • the display device 204 is a device such as an LCD that displays a processing process or a processing result of the image processing unit 202, and is a 2D monitor in the present embodiment.
  • the storage unit 205 is a storage device such as a RAM (Random Access Memory), a HDD (Hard Disk Drive), or a flash memory.
  • the image processing unit 202 calculates a parallax represented by a difference in position for each corresponding pixel between a left image included in two or more input images and a right image taken from a different viewpoint from the left image.
  • a parallax map creation unit 2021 that creates a parallax map corresponding to the pixel position of the left image
  • a parallax image creation unit 2022 that creates a parallax image indicating the magnitude of the parallax value of the created parallax map in luminance
  • An image synthesis unit 2023 that synthesizes the created parallax image with the left image.
  • the image processing unit 202 may be a computer having a CPU and a memory. In this case, the image processing unit 202 operates according to a program for causing the computer stored in the storage unit 205 to function as an image processing apparatus.
  • the image obtained by combining the parallax image and the left image by the image combining unit 2023 is output to the display device 204 as the processing result of the image processing unit 202.
  • the input image, the parallax map, the parallax image, the image synthesized by the image synthesis unit 2023, and the like are stored in the storage unit 205.
  • FIG. 3 is a flowchart showing processing of the parallax image display device according to the first embodiment of the present invention.
  • step 301 it is determined in step 301 whether or not two or more images taken from two or more different viewpoints are input to the image input unit.
  • FIG. 4 is an example of two or more images captured from two or more different viewpoints input to the image input unit, and a right image (right in FIG. 2) and a left image captured from the right viewpoint. It is a figure which shows the left image (left of FIG. 2) image
  • a parallax map is created from two or more images photographed from two or more different viewpoints shown in FIG. In the left image and the right image in FIG. 4, it is assumed that the parallax occurs in the horizontal direction (horizontal direction) of the image and no shift occurs in the vertical direction (vertical direction).
  • step 302 the parallax map creation unit 2021 shown in FIG. 2 performs stereo matching on the left image and the right image to generate a parallax map.
  • Stereo matching uses a set of two images taken from different viewpoints, specifies which region of the left image corresponds to which region of the right image, and the three-dimensional position of each region It is a method to guess.
  • corresponding pixels (x2, y2) on the right image corresponding to the pixels (x1, y1) on the left image are extracted.
  • the parallax value stored at the pixel position of the left image with the parallax d as a reference is taken as a parallax map.
  • the parallax value is calculated for each pixel of the image.
  • the parallax is calculated for a region in which several pixels are gathered in a square shape, such as 2 ⁇ 2 to 3 ⁇ 3.
  • a value may be calculated, and when the parallax value is calculated for a region where pixels are gathered in this way, it is considered that the processing speed can be improved.
  • This parallax map shows the parallax value for each pixel, but since it is just numerical data, what kind of stereoscopic effect the parallax value can produce in an actual stereoscopic image even when read by a user or the like? I can't recognize that.
  • Step 303 the parallax image creation unit 2022 shown in FIG. 2 converts the parallax value for each pixel of the parallax map into a luminance value so that the user or the like can recognize the stereoscopic effect of the stereoscopic image, A parallax image, which is an image representing the parallax value corresponding to each pixel of the image in luminance, is created.
  • step 304 it is determined whether or not the conversion process from the parallax value to the luminance value has been performed for all the pixels. If all the pixels have been converted, the parallax image file created by the conversion in step 305 is determined. Is stored in the storage unit 205 shown in FIG.
  • FIG. 5 is a diagram showing an example of a parallax image according to the first embodiment of the present invention.
  • a subject with a large parallax value is represented with low luminance
  • a subject with a small parallax value is represented with high luminance.
  • step 306 the image composition unit 2023 shown in FIG. 2 synthesizes the left image and the parallax image in FIG. 4 for each pixel.
  • the image composition unit 2023 performs weighting of w1: w2, for example, 1: 9, on the RGB values of the respective image pixels between the left image and the parallax image, and synthesizes both images.
  • step 306 the left image and the parallax image are synthesized by making the weight w2 for the parallax image heavier than the weight w1 for the left image and calculating the weighted average value according to the following equation (1).
  • . a is the pixel value of the left image
  • b is the luminance value of the pixel of the parallax image corresponding to the pixel of the pixel value a.
  • This weighted average value is obtained for all the pixels of the parallax image and the left image.
  • each pixel of the left image has RGB values aR, aG, and aB, respectively. Therefore, a weighted average is given for each of the RGB values of each pixel as in the following equation (2).
  • Ask for. (AR ⁇ w1 + b ⁇ w2) / (w1 + w2) (AG ⁇ w1 + b ⁇ w2) / (w1 + w2) (2) (AB ⁇ w1 + b ⁇ w2) / (w1 + w2)
  • the weighting is performed on the RGB value of each pixel of the left image.
  • the parallax value of the parallax image is calculated for a region where several pixels are gathered in a square shape, such as 2 ⁇ 2 to 3 ⁇ 3
  • the weighting of the RGB values of the left image is also the parallax image
  • the RGB values are weighted for the area corresponding to this area.
  • the image composition unit 2023 determines whether or not the composition processing for all pixels has been completed. If the composition processing for all pixels has been completed, in step 308, the left image and the parallax image are obtained. The synthesized image is displayed on the display device 204 shown in FIG. 2, and the processing in steps 301 to 308 is completed.
  • FIG. 6 shows an example of an image obtained by synthesizing the left image and the parallax image in the first embodiment of the present invention.
  • the pixels of the left image are mixed by synthesis, and the color difference component of the left image is also displayed lightly. Therefore, an outline of a subject such as a tree in a distant view can be grasped from the image of FIG.
  • the image obtained by combining the left image and the parallax image is a bitmap image that can be displayed on a normal 2D monitor, without requiring a special display device such as a display device having a lenticular lens.
  • the user or the like grasps the stereoscopic effect of the finally obtained stereoscopic image by visually recognizing an image obtained by combining the left image and the parallax image displayed on the screen of the 2D monitor.
  • the first embodiment of the present invention by creating an image obtained by synthesizing the parallax image obtained by converting the parallax value for each pixel of the left image into luminance and the left image, Even in the 2D monitor, the stereoscopic effect of the stereoscopic image generated from the captured image can be grasped.
  • the weights in the synthesis of the left image and the parallax image are changed according to the parallax value in the first modification and the second modification of the first embodiment described below.
  • the weight w1 of the left image is changed to the weight w2 of the parallax image in the pixel related to the subject near the cross point where the optical axes of the left and right lenses of the stereoscopic camera intersect. Make it heavier.
  • the pixel related to the subject in front of or behind the cross point increases the weight w2 of the parallax image and decreases the weight w1 of the left image as the distance from the cross point increases.
  • the absolute value of the parallax value is the smallest “0” in the pixel of the subject related to the cross point, and the absolute value of the parallax value increases as the distance from the cross point increases in the pixel of the subject far from the cross point.
  • the weight w1 for the value obtained from the RGB values of the pixels included in the left image area corresponding to the parallax image area is increased.
  • the ratio of the weight w1 of the left image and the weight w2 of the parallax image uses the following formula (3).
  • m is a predetermined coefficient statistically determined through an experiment, and is a positive real number.
  • Left image weight w1: Parallax image weight w2 A ⁇ m
  • the parallax value of the pixel related to the subject existing at the cross point is “0” and the absolute value of the parallax value is the minimum, using the above formula (3), the subject existing at the cross point
  • the weight w1 to the RGB value for the pixel of the left image at “A” is “A”
  • the weight w2 to the luminance value for the pixel of the parallax image at the subject existing at the cross point is “B”.
  • a correspondence table in which disparity values are associated with weights may be prepared in advance, and the weights may be changed according to the disparity values according to the correspondence table (lookup table), regardless of the above equation (3).
  • the weight w1 of the pixel of the left image, which is the original image is relatively heavier than the weight w2 of the pixel of the parallax image. Since the left image and the parallax image are combined, the state of the subject near the cross point in the original image can be confirmed. In addition, the farther away from the cross point the subject located at the position away from the cross point, the higher the pixel weight w2 of the parallax image compared to the left image pixel weight w1, which is the original image, and the left. Since the image and the parallax image are combined, it is easy to grasp the stereoscopic effect of the stereoscopic image generated from the captured image.
  • the parallax value is the maximum at the pixel of the subject closest to the camera, and the parallax value becomes smaller at the pixel of the subject far from the camera as the distance from the camera is longer.
  • the weight w1 for the value obtained from the RGB value of the pixel included in the region of the left image corresponding to the region of the parallax image is reduced.
  • the weight w2 for the value obtained from the luminance value of the pixel included in the parallax image area is increased.
  • the ratio of the weight w1 of the left image and the weight w2 of the parallax image uses the following formula (4).
  • p is a predetermined coefficient that is statistically determined through experiments, and is a positive real number.
  • dn is the parallax value of the pixel of the subject closest to the camera.
  • Left image weight w1: parallax image weight w2 A ⁇ p
  • a correspondence table in which disparity values and weights are associated with each other may be prepared in advance, and the weights may be changed according to the disparity values according to the correspondence table, regardless of the above equation (4).
  • the pixel weight w1 of the left image which is the original image
  • the pixel weight w2 of the parallax image is relatively heavier than the pixel weight w1 of the left image that is the original image. Since the parallax image is synthesized, it is easy to grasp the stereoscopic effect of the stereoscopic image generated from the captured image.
  • FIG. 7 is a flowchart showing processing of the parallax image display device according to the second embodiment of the present invention.
  • step 701 to 705 is the same as the processing from step 301 to 305 in FIG. 3 in the first embodiment of the present invention, and thus the description thereof is omitted.
  • step 706 which is a process after the parallax image is created, the image synthesis unit 2023 synthesizes the color difference component of the left image with the parallax image.
  • the left image and the parallax image are weighted 1: 9 to the RGB values of the pixels of both images, and the two images are combined.
  • only the color difference component is extracted from the left image, and the extracted color difference component is combined with the parallax image.
  • the color difference in the present embodiment is RY and BY obtained by subtracting the luminance value Y from the R and B pixel values among the RGB pixel values originally including the luminance value Y.
  • the relationship between the color differences RY and BY and the luminance value Y is expressed by the following equation (5), where the color difference BY is Cb and the color difference RY is Cr.
  • Y 0.29900R + 0.58700G + 0.11400B
  • Cr 0.50,000R-0.48869G-0.81131B
  • Cb ⁇ 0.16874R ⁇ 0.33126G + 0.50000B
  • the parallax image is a monochrome image expressed only by luminance values.
  • a pixel in the parallax image has a luminance value Y ′, and the color difference between the pixels of the left image corresponding to the pixel of the parallax image having the luminance value Y ′ is Cr and Cb in Equation (6). .
  • step 706 the image composition unit 2023 substitutes Y ′, which is the luminance value of the parallax image, for the luminance value Y of the above equation (6) for each pixel, thereby extracting the color difference component and the parallax image extracted from the left image. Is synthesized.
  • the image composition unit 2023 determines whether or not the composition processing has been completed for all pixels. If the composition processing has been completed for all pixels, in step 708, the color difference component and the parallax of the left image are determined. The image combined with the image is displayed on the display device 204 shown in FIG. 2, and the processing in steps 701 to 708 is completed.
  • FIG. 8 shows an example of an image obtained by synthesizing the color difference component of the left image and the parallax image in the second embodiment of the present invention.
  • the color difference component of the left image is displayed more clearly than in the case of the first embodiment, so that the difference in color of each subject can be recognized, As a result, the outline of each subject can be grasped.
  • the color difference is extracted for the RGB value of each pixel of the left image.
  • the number of pixels of the parallax image is 2 ⁇ 2 to 3 ⁇ 3.
  • the color difference extracted from the left image is also extracted for a region corresponding to the region of the parallax image.
  • the image obtained by synthesizing the color difference component and the parallax image of the left image does not require a special display device such as a display device including a lenticular lens, and is a bitmap image that can be displayed on a normal 2D monitor.
  • the user or the like grasps the stereoscopic effect of the finally obtained stereoscopic image by visually recognizing an image obtained by synthesizing the color difference component of the left image displayed on the screen of the 2D monitor and the parallax image.
  • the second embodiment of the present invention by creating an image obtained by combining the parallax image obtained by converting the parallax value for each pixel of the left image into luminance and the left image color difference component. Even in a normal 2D monitor, the stereoscopic effect of the stereoscopic image generated from the captured image can be grasped.
  • the parallax image display device according to the third embodiment of the present invention differs from the parallax image display device according to the first embodiment of the present invention shown in FIG. Other configurations are the same.
  • FIG. 9 is a flowchart showing processing of the parallax image display device according to the third embodiment of the present invention.
  • step 901 it is determined in step 901 whether or not two or more images taken from two or more different viewpoints are input to the image input unit. Similar to the first embodiment, the input images are two or more images taken from two or more different viewpoints shown in FIG.
  • the parallax map creation unit 2021 shown in FIG. 2 creates a parallax map from the left image and the right image by stereo matching, as in the first embodiment.
  • the parallax occurs in the horizontal direction (horizontal direction) of the image and no shift occurs in the vertical direction (vertical direction).
  • step 903 the parallax value corresponding to each pixel of the left image, for example, as the left image so that the user or the like can recognize the stereoscopic effect of the stereoscopic image from the parallax map by the parallax image creation unit 2022 shown in FIG. Is represented by a color, for example, a color difference value, and an image in which the color difference value for each pixel is shown at the position of the corresponding pixel on the left image is generated, and this is used as a parallax color image.
  • a color for example, a color difference value
  • a separate color determination unit (not shown) that determines the color of the corresponding left image region according to the parallax value for each region of the parallax map is provided, and the parallax image creation unit 2022 is provided. May create a parallax color image in which the resolution of each region of the left image is changed to the color determined by the color determination unit.
  • the conversion is performed according to the correspondence table describing the correspondence between the parallax value and the color difference value.
  • the color difference changes from red to blue as the parallax value is small when the parallax value is large, and the correspondence table associates the large parallax value with the red color difference, A smaller parallax value corresponds to a color difference in which red to blue are emphasized.
  • the disparity value is classified for each determined range, and a correspondence table in which the color is associated with the disparity value of the classified range is provided, and the color corresponding to the disparity value of the region of the left image is supported. You may make it determine based on a table
  • step 904 the parallax image creation unit 2022 determines whether or not the conversion process from the parallax value to the color difference value has been performed for all the pixels. If all the pixels have been converted, the conversion is performed in step 905.
  • the parallax color image file created by the above is stored in the storage unit 205 shown in FIG.
  • step 906 as in the first embodiment, the image composition unit 2023 shown in FIG. 2 applies 1: 9 weighting to the RGB values for each pixel of the left image and the parallax image. The two images are combined, but the weight ratio may be other than 1: 9.
  • the above-described weighting is performed on the RGB value of each pixel of the left image.
  • some pixels have a parallax value of 2 ⁇ 2 to 3 ⁇ 3 of the parallax image.
  • the RGB value is weighted for the region corresponding to the region of the parallax image.
  • the image composition unit 2023 determines whether or not the composition processing has been completed for all pixels. If the composition processing has been completed for all pixels, in step 908, the left image and the parallax color image are determined. 2 is displayed on the display device 204 shown in FIG. 2, and the processing of steps 901 to 908 is completed.
  • FIG. 10 shows an example of an image obtained by synthesizing the left image and the parallax color image in the third embodiment of the present invention.
  • the image is indicated by the front dot that is the region having the largest parallax value.
  • the part with the small parallax value is represented in blue.
  • the pixels of the left image are mixed by synthesis and the pixels of the left image are also displayed, so that an outline of a subject such as a grove of a distant view can be grasped.
  • the image obtained by combining the left image and the parallax color image is a bitmap image that can be displayed on a normal 2D monitor, without requiring a special display device such as a display device having a lenticular lens.
  • the user or the like grasps the stereoscopic effect of the finally obtained stereoscopic image by visually recognizing an image obtained by synthesizing the left image displayed on the screen of the 2D monitor and the parallax color image.
  • the third embodiment of the present invention by creating an image obtained by combining the parallax color image obtained by converting the parallax value for each pixel of the left image into a color difference and the left image, Even in a normal 2D monitor, the stereoscopic effect of the stereoscopic image generated from the captured image can be grasped.
  • the image composition unit 2023 in FIG. 2 extracts the color difference components of the pixels included in each region of the left image, and the color difference between the region of the left image corresponding to each region of the parallax color image and each region of the parallax color image.
  • the ingredients may be synthesized.
  • the image composition unit 2023 in FIG. 2 performs pixel conversion of the pixels of the left image that is the original image according to the parallax value, as in Modification 1 of the first embodiment or Modification 2 of the first embodiment. You may make it change the weight w1 and the weight w2 of the pixel of a parallax color image.
  • a parallax luminance image in which the parallax value of the parallax map area is expressed by luminance may be created, and the image synthesis unit 2023 in FIG. 2 may synthesize the parallax luminance image and the parallax color image.
  • a resolution determining unit that determines the resolution of the corresponding region of the left image according to the parallax value for each region of the parallax map, and the parallax resolution image in which the resolution of each region of the left image is changed to the resolution determined by the resolution determining unit
  • a parallax resolution image creating unit that creates a parallax resolution image, and the image synthesis unit 2023 in FIG. 2 may synthesize the parallax resolution image and the parallax color image.
  • the resolution determination unit may reduce the resolution of the region of the left image as the parallax value corresponding to the region in the parallax map becomes smaller, or the absolute value of the parallax value corresponding to the region in the parallax map The resolution of the area of the left image may be lowered as the value increases.
  • the resolution determination unit classifies the parallax value for each determined range, has a correspondence table in which the resolution is associated with the parallax value of the classified range, and corresponds to the position of the region of the left image in the parallax map
  • the disparity value being used may be the disparity value of the region of the left image, and the resolution corresponding to the disparity value of the region of the left image may be determined based on the correspondence table.
  • a range in which the included parallax value is small may correspond to a lower resolution as the included parallax value is small, or a range in which the absolute value of the included parallax value is large Alternatively, a lower resolution may be associated with an increase in the absolute value of the included parallax value.
  • the resolution determination unit may be a sharpness determination unit that determines the sharpness of the corresponding left image region in accordance with the parallax value for each region of the parallax map.
  • the disparity value in the disparity map area is converted into a luminance value
  • the position of the disparity map in which the absolute value of the disparity value is within a threshold is specified
  • the specified area is colored with a predetermined color.
  • a cross point image creating unit that creates a point image may be further included, and the image composition unit 2023 in FIG. 2 may compose the cross point image and the parallax color image.
  • the parallax value of the area where the absolute value of the parallax value is maximum is determined by converting the parallax value of the area of the parallax map into a luminance value, specifying the position of the area where the absolute value of the parallax value is maximum in the parallax map.
  • 2 further includes a parallax absolute value maximum image creating unit that creates a parallax absolute value maximum image in which the region is colored with different colors depending on whether the area is positive or negative.
  • the image composition unit 2023 in FIG. The maximum image and the parallax color image may be combined.
  • the parallax image display device according to the fourth embodiment of the present invention is different from the parallax image display device according to the first embodiment of the present invention shown in FIG. Although the functions are different, other configurations are the same.
  • FIG. 11 is a flowchart showing processing of the parallax image display device according to the fourth embodiment of the present invention.
  • step 1101 it is determined in step 1101 whether a right image and a left image taken from two or more different viewpoints are input to the image input unit. Similar to the first embodiment, the input images are two or more images taken from two or more different viewpoints shown in FIG.
  • the parallax map creation unit 2021 shown in FIG. 2 creates a parallax map from the left image and the right image by stereo matching, as in the first embodiment.
  • the parallax occurs in the horizontal direction (horizontal direction) of the image and no shift occurs in the vertical direction (vertical direction).
  • the parallax image creation unit 2022 shown in FIG. 2 converts the resolution of the left image for each pixel according to the parallax value of the parallax map so that the user or the like can recognize the stereoscopic effect of the stereoscopic image. . Specifically, an image having a large parallax value, that is, a high resolution of a pixel related to a subject close to the camera and a low parallax value, that is, a low resolution of a pixel related to a subject far from the camera is generated. A resolution image is used.
  • a resolution determination unit (not shown) that determines the resolution of the corresponding region of the left image according to the parallax value for each region of the parallax map is separately provided, and the parallax image creation unit 2022 Alternatively, a parallax resolution image in which the resolution of each region of the left image is changed to the resolution determined by the resolution determination unit may be created.
  • the image is divided into rectangular blocks such as 3 ⁇ 3, 5 ⁇ 5, and 7 ⁇ 7, and the pixel values in each block are changed to the pixel values in the block.
  • Mosaic filling with average values is used.
  • the square block is reduced, and in a region where the parallax value is desired to be reduced for the resolution, the square block is increased.
  • the correspondence between the parallax value and the size of the block to be mosaicked is based on, for example, a correspondence table in which the two are matched.
  • pixels near the crosspoint are clarified. Can also be displayed.
  • step 1104 the parallax image creation unit 2022 determines whether or not processing has been performed on all pixels. If processing has been performed on all pixels, in step 1105, the resolution of the left image is changed according to the parallax value.
  • the parallax resolution image file is stored in the storage unit 205 shown in FIG.
  • step 1106 which is a step after the parallax resolution image is created, the image synthesis unit 2023 synthesizes the color difference component of the left image with the parallax resolution image for each pixel.
  • the color difference is extracted for the RGB value of each pixel of the left image.
  • some pixels have a parallax value of 2 ⁇ 2 to 3 ⁇ 3.
  • the color difference extracted from the left image is also extracted for a region corresponding to the region of the parallax image.
  • step 1106 the color difference component of the left image is synthesized with the parallax resolution image.
  • the first modification, or the second modification the pixel of the left image and the parallax resolution image. These pixels may be combined.
  • the image composition unit 2023 determines whether or not the composition process for all pixels has been completed. If the composition process for all pixels has been completed, in step 1108, the image composition unit 2023 An image obtained by synthesizing the color difference component and the parallax resolution image is displayed on the display device 204 shown in FIG. 2, and the processing of steps 1101 to 1108 is completed.
  • FIG. 12 shows an example of an image obtained by combining the color difference component of the left image and the parallax resolution image obtained by changing the resolution of the left image according to the parallax value in the fourth embodiment of the present invention.
  • the color difference component of the original left image is also displayed, so the difference in color of each subject can be recognized, and this allows the outline of each subject to be grasped. ing.
  • An image obtained by combining the color difference component of the original left image and the parallax resolution image does not require a special display device such as a display device having a lenticular lens, and can be displayed on a normal 2D monitor. It is a bitmap image.
  • the user or the like grasps the stereoscopic effect of the finally obtained stereoscopic image by visually recognizing an image obtained by combining the color difference component of the original left image displayed on the screen of the 2D monitor and the parallax resolution image. To do.
  • the image resolution is changed, but the sharpness of the image may be changed.
  • a separate sharpness determination unit (not shown) that determines the sharpness of the corresponding left image region according to the parallax value for each region of the parallax map is provided.
  • 2022 may create a parallax sharpness image in which the resolution of each region of the left image is changed to the sharpness determined by the sharpness determination unit.
  • Gaussian blur that smoothes an image using a Gaussian function is used to change the sharpness of the image.
  • the region is the center pixel, and the range of the surrounding pixels when calculating the weighted average of the pixel values of the center pixel and the surrounding pixels by a Gaussian function is used. Make it smaller.
  • the region is the central pixel
  • the surrounding pixels when calculating the weighted average of the pixel values of the central pixel and the pixels around the central pixel by a Gaussian function Increase the range.
  • an image in which a parallax resolution image obtained by converting a parallax value for each pixel of a left image into a difference in resolution and a left image color difference component is created.
  • the parallax image creation unit 2022 shown in FIG. 2 has the resolution of the left image for each pixel so that the user can recognize the stereoscopic effect of the stereoscopic image.
  • the parallax image creation unit 2022 in FIG. 2 classifies the parallax values for each determined range, and has a correspondence table in which resolutions corresponding to the classified ranges are set in advance. .
  • the parallax image creation unit 2022 identifies the parallax value corresponding to the pixel of the left image from the parallax map, identifies the resolution corresponding to the identified parallax value with reference to the correspondence table, and determines the pixel of the left image Is changed to the specified resolution.
  • the image is divided into rectangular blocks of 3 ⁇ 3, 5 ⁇ 5, 7 ⁇ 7, etc.
  • Mosaicing is used in which the pixel values are filled with the average value of the pixel values in the block. In a region where the parallax value for which the resolution is desired to be increased is large, the square block is reduced, and in a region where the parallax value is desired to be reduced for the resolution, the square block is increased.
  • the pixel of the left image whose parallax value is 0 to 2 has a 5 ⁇ 5 mosaic size and the parallax value is 3 to 5
  • the pixel of the left image has a resolution of the pixel of the left image corresponding to the range to which the parallax value of the pixel belongs, such as the size of the block to be mosaicized is 3 ⁇ 3. Apply and change the size.
  • the larger the parallax value included in this range the smaller the size of the block to be mosaicked, and the corresponding parallax value range.
  • the smaller the included parallax value the higher the resolution of the pixels related to the subject close to the camera, and the higher the resolution of the pixels related to the subject far from the camera. It is possible to generate and display an image that is intermittently lowered according to the distance from the image.
  • the smaller the absolute value of the parallax values included in this range the smaller the size of the block to be mosaicked, and the parallax value range.
  • the larger the absolute value of the disparity value included in this range the larger the size of the block to be mosaicked is associated, thereby clearly displaying the pixels near the crosspoint, and the crosspoint It is possible to generate and display an image in which the resolution of the subject away from the screen is intermittently lowered according to the distance from the cross point.
  • the parallax value corresponding to each pixel of the left image corresponds to the parallax map, that is, the case where the parallax value of the parallax image is calculated for each pixel.
  • the parallax value of the parallax image may be calculated for a region where several pixels are gathered in a square shape, such as 2 ⁇ 2 or 3 ⁇ 3.
  • the parallax image creation unit 2022 in FIG. 2 can determine the parallax value. And a correspondence table in which resolutions corresponding to the classified ranges are set in advance.
  • the parallax image creation unit 2022 identifies the parallax value corresponding to the area of the left image from the parallax map, identifies the resolution corresponding to the identified parallax value by referring to the correspondence table, and determines the area of the left image Is changed to the specified resolution.
  • step 1103 in FIG. 11 The processing after step 1103 in FIG. 11 is the same as that of the fourth embodiment in the modification of the fourth embodiment, and the resolution is changed according to the parallax value as described in step 1106 in FIG.
  • the color difference component or pixel of the left image may be combined with the processed image.
  • the parallax image creation unit 2022 in FIG. 2 classifies the parallax values for each determined range, and presets sharpness corresponding to the parallax values in the classified range.
  • the disparity value corresponding to the left image area is identified from the disparity map, the sharpness corresponding to the identified disparity value is identified with reference to the correspondence table, and the sharpness of the left image area is determined. May be changed to the specified sharpness.
  • the higher the parallax value included in this range the higher the sharpness, and the smaller the parallax value included in this range of the parallax value range.
  • the lower the sharpness of the range the higher the sharpness of the pixels related to the subject closer to the camera, and the lower the sharpness of the pixels related to the subject far from the camera is generated and displayed according to the distance from the camera. can do.
  • the smaller the absolute value of the parallax values included in this range the higher the sharpness is associated, and the parallax value ranges included in this range.
  • the higher the absolute value of the parallax value the lower the sharpness, so that the pixels near the crosspoint are clearly displayed, and the sharpness of the subject away from the crosspoint is intermittent according to the distance from the crosspoint. It is possible to generate and display an image with a low height.
  • Gaussian blur that smoothes an image using a Gaussian function is used to change the sharpness of the image.
  • the area is set as the central pixel, and the range of the surrounding pixels when the weighted average of the pixel values of the central pixel and the surrounding pixels is calculated by a Gaussian function is reduced.
  • the area is set as the central pixel, and the range of the surrounding pixels when calculating the weighted average of the pixel values of the central pixel and the surrounding pixels by a Gaussian function is increased. To do.
  • the stereoscopic effect of the stereoscopic image generated from the left image is changed by stepwise changing the resolution of the image for each predetermined range of parallax values. It becomes easy to grasp.
  • the parallax image display device according to the fifth embodiment of the present invention differs from the parallax image display device according to the first embodiment of the present invention shown in FIG. Other configurations are the same.
  • FIG. 13 is a flowchart showing processing of the parallax image display device according to the fifth embodiment of the present invention.
  • Steps 1301 to 1304 is the same as the processing from Steps 301 to 304 in FIG. 3 in the first embodiment of the present invention, and a description thereof will be omitted.
  • the parallax image creation unit 2022 identifies pixels whose absolute value of the parallax value in the parallax map is equal to or smaller than a predetermined threshold on the parallax image created in step 1303, and colors the identified pixels.
  • pixels having an actual parallax value of ⁇ 2 or more and 2 or less are colored in a predetermined color.
  • the color may be red or blue if it can be easily distinguished from other pixels.
  • the parallax image creation unit 2022 determines whether or not the parallax value is not less than ⁇ 2 and not more than 2 for all pixels, and when the confirmation process is completed, the parallax value 2 is displayed on the display device 204 in FIG. 2 by coloring the pixels of ⁇ 2 to 2 and displaying the cross points.
  • FIG. 14 shows a case where the cross point is in the foreground
  • FIG. 15 shows a case where the cross point is in the foreground.
  • FIGS. 14 and 15 a subject with a large parallax value is represented with low luminance, and a subject with a small parallax value is represented with high luminance.
  • the pixels other than the cross-point pixels are expressed in monochrome shades, but the outline of each subject is unclear, and the parts with the same parallax value are expressed with the same brightness. I can't figure out the details at all.
  • step 1308 the image composition unit 2023 shown in FIG. 2 synthesizes the left image and the cross point image for each pixel.
  • the above-described weighting is performed on the RGB value of each pixel of the left image.
  • some pixels have a parallax value of 2 ⁇ 2 to 3 ⁇ 3 of the parallax image.
  • the RGB value is weighted for the region corresponding to the region of the parallax image.
  • step 1309 the image composition unit 2023 determines whether or not the composition processing for all pixels has been completed. If the composition processing for all pixels has been completed, in step 1310, the left image, the crosspoint image, 2 is displayed on the display device 204 shown in FIG. 2, and the processing of steps 1301 to 1310 is completed.
  • the image obtained by synthesizing the left image and the cross-point image is a bitmap image that can be displayed on a normal 2D monitor, without requiring a special display device such as a display device having a lenticular lens.
  • the user or the like grasps the stereoscopic effect of the finally obtained stereoscopic image by visually recognizing an image obtained by synthesizing the left image and the crosspoint image displayed on the screen of the 2D monitor.
  • a crosspoint image is created from a parallax image obtained by converting the parallax value for each pixel of the left image into luminance, and the created crosspoint image and the left
  • the stereoscopic effect of the stereoscopic image generated from the captured image can be grasped even with a normal 2D monitor.
  • the parallax image display device according to the sixth embodiment of the present invention differs from the parallax image display device according to the first embodiment of the present invention shown in FIG. Other configurations are the same.
  • FIG. 16 is a flowchart showing processing of the parallax image display device according to the sixth embodiment of the present invention.
  • Steps 1601 to 1604 is the same as the processing from Steps 301 to 304 in FIG. 3 in the first embodiment of the present invention, and the description thereof will be omitted.
  • the parallax image creation unit 2022 identifies the region where the absolute value of the parallax value in the left image is the maximum on the parallax image created in step 1603 based on the parallax map created in step 1602, It is determined whether or not the specified region has the maximum parallax value in the pop-out direction, that is, whether or not it is the foreground portion of the left image.
  • the parallax value is 0 at the cross point where the optical axes of the left and right lenses of the stereoscopic image shooting camera intersect, and the farther away from the cross point, that is, the closer to the camera, or the farther from the camera across the cross point, the more.
  • the absolute value of the parallax value increases.
  • the position where the parallax value is positive is assumed to be a position close to the camera from the cross point, that is, the foreground, and the position where the parallax value is negative is set to the camera rather than the cross point. It is assumed that the position is far from the camera, that is, a distant view.
  • the parallax image creation unit 2022 determines that the pixel has the maximum parallax value in the pop-out direction. In step 1606, the parallax image The creation unit 2022 creates a parallax absolute value maximum image in which the pixel is colored with a predetermined color, red.
  • the color is not limited to red, and it is sufficient that the area can be distinguished from other areas.
  • the parallax image creation unit 2022 determines whether or not processing has been performed for all pixels. If processing has been performed for all pixels, in step 1608, the region where the parallax value is maximum in the pop-out direction. Is displayed on the display device 204 shown in FIG.
  • FIG. 17 is a parallax absolute value maximum image displaying a pixel region having the maximum parallax value in the pop-out direction in the sixth embodiment of the present invention.
  • a subject with a large parallax value is represented with low luminance
  • a subject with a small parallax value is represented with high luminance.
  • the parallax value is the largest in the pop-out direction, it is expressed in monochrome shades, but the outline of each subject is unclear, and the parts with the same parallax value are expressed with the same brightness. I cannot grasp details of subjects such as trees in a distant view.
  • step 1609 the image composition unit 2023 shown in FIG. 2 synthesizes the left image in FIG. 4 that is the left image and the parallax absolute value maximum image that displays the region of the pixel having the maximum parallax value in the pop-out direction. .
  • the image composition unit 2023 uses a left image and a parallax absolute value maximum image displaying a region of a pixel having the maximum parallax value in the pop-out direction. Is applied to the RGB values of the pixels of the respective images to synthesize both images.
  • the above-described weighting is performed on the RGB value of each pixel of the left image.
  • some pixels have a parallax value of 2 ⁇ 2 to 3 ⁇ 3 of the parallax image.
  • the RGB value is weighted for the region corresponding to the region of the parallax image.
  • the image composition unit 2023 determines whether or not the composition process for all pixels is completed. If the composition process for all pixels is completed, in step 1611, the image composition unit 2023 performs a parallax with the left image in the pop-out direction. An image obtained by combining the parallax absolute value maximum image displaying the pixel region having the maximum value is displayed on the display device 204 shown in FIG. 2, and the processing of steps 1601 to 1611 is completed.
  • step 1605 If it is determined in step 1605 that the parallax value has the maximum absolute value in the depth direction, the processing in steps 1627 to 1631 is performed.
  • the processing in steps 1627 to 1631 is the same as the processing in steps 1607 to 1611 described above except that the region having the maximum parallax value in the depth direction in step 1626 is colored with blue, which is a different color from step 1606. The description is omitted.
  • FIG. 18 shows a parallax absolute value maximum image displaying a region having the maximum parallax value in the depth direction in the sixth embodiment of the present invention.
  • the region where the parallax value in the depth direction is the maximum is displayed in blue.
  • the region where the absolute value of the parallax value is the maximum is in the pop-out direction (before the cross point) or in the depth direction (behind the cross point). it can. Furthermore, as in the fifth embodiment of the present invention described above, the cross point area can be displayed together with the area where the absolute value of the parallax value is maximum.
  • the seventh embodiment is an operation display unit of an apparatus capable of processing in the above first to sixth embodiments.
  • the configuration of the seventh embodiment is basically the same as that shown in the block diagram of the parallax image display device according to the first embodiment of the present invention in FIG. The difference is that 204 is an operation display unit 500 integrated in a touch panel format.
  • the operation display unit 500 may use an LCD or the like as the display unit and a pointing device such as a mouse or a pen tablet as the operation unit, in addition to the touch panel.
  • the operation display unit 500 illustrated in FIG. 19 displays the left image 501 that is the original image on the left of the top row, and the parallax created based on the parallax value calculated from the left image and the right image on the right side An image 502 is displayed.
  • pixel mixing that combines the left image and the parallax image by weighting the RGB values as in the first embodiment of the present invention.
  • a pixel mixing button 503 for selecting and a color difference mixing button 504 for selecting “color difference mixing” for synthesizing the color difference of the left image with the parallax image as in the second embodiment of the present invention are provided. ing.
  • a slider 505 for changing the weighting of RGB values when “Pixel mixture” is selected is provided on the middle right of FIG. 19. The user moves the slider 505 on the touch panel left and right. By performing the operation, the weighting ratio of the RGB values of the left image and the parallax image can be arbitrarily changed within the range of 0:10 to 10: 0.
  • a crosspoint adjustment interface 506 that is an interface that can change the crosspoint of the stereoscopic image.
  • the user can display the crosspoint according to the fifth embodiment of the present invention.
  • the position of the cross point can be changed in the front-rear direction from the near side to the depth while confirming on the parallax image displayed on the upper right of FIG.
  • the region having the maximum parallax value according to the sixth embodiment of the present invention can be reflected in the parallax image displayed on the upper right of FIG.
  • a size designation button 509 for designating is provided.
  • the user can determine what kind of stereoscopic effect from two or more images read from the image input unit 201 in FIG. Whether the image is created is confirmed by the processing according to the first to sixth embodiments of the present invention described above, and in some cases, a desired stereoscopic effect can be obtained by changing the cross point. it can.
  • the parallax value is adjusted for the entire parallax image, and the parallax image is created again based on the adjusted parallax value and displayed.
  • the left image and the right image are stereo-matched using the left image as a reference to generate a parallax map is described, but the right image may be used as a reference.
  • a parallax map may be generated for each of the images as the first image (reference image) and the other image as the second image.
  • the image processing unit 202 in FIG. 2 is a computer having a CPU and a memory
  • the processing routines of the first to sixth embodiments are programmed, and the program is executed by the CPU. May be.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention porte sur un procédé d'affichage d'image de parallaxe au moyen duquel : une pluralité d'images capturées à partir d'au moins deux points de vue différents sont acquises, une carte de parallaxe est générée, ladite carte de parallaxe associant des valeurs de parallaxe représentées par les différences entre les positions de régions correspondantes entre une première image et seconde image capturées à partir d'un point de vue différent de celui de la première image, qui sont comprises dans la pluralité d'images acquises, et les positions des régions de la première image ; les couleurs des régions correspondantes sont déterminées selon la valeur de parallaxe pour chaque région ; une image de couleur de parallaxe, obtenue par changement de la couleur de chaque région de la première image à la couleur déterminée, est créée, et l'image de couleur de parallaxe et la première image sont synthétisées.
PCT/JP2011/077716 2011-01-13 2011-11-30 Dispositif d'affichage d'image de parallaxe et procédé d'affichage d'image de parallaxe WO2012096065A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011005011 2011-01-13
JP2011-005011 2011-01-13

Publications (1)

Publication Number Publication Date
WO2012096065A1 true WO2012096065A1 (fr) 2012-07-19

Family

ID=46506982

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/077716 WO2012096065A1 (fr) 2011-01-13 2011-11-30 Dispositif d'affichage d'image de parallaxe et procédé d'affichage d'image de parallaxe

Country Status (1)

Country Link
WO (1) WO2012096065A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014053655A (ja) * 2012-09-05 2014-03-20 Panasonic Corp 画像表示装置
JP2015046177A (ja) * 2014-10-15 2015-03-12 グリー株式会社 画像表示装置、画像表示方法及びプログラム

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001346226A (ja) * 2000-06-02 2001-12-14 Canon Inc 画像処理装置、立体写真プリントシステム、画像処理方法、立体写真プリント方法、及び処理プログラムを記録した媒体
JP2003047027A (ja) * 2001-07-31 2003-02-14 Canon Inc 立体画像形成システム、立体画像形成方法、プログラムおよび記憶媒体
JP2006041811A (ja) * 2004-07-26 2006-02-09 Kddi Corp 自由視点画像ストリーミング方式
JP2008082870A (ja) * 2006-09-27 2008-04-10 Setsunan Univ 画像処理プログラム及びこれを用いた路面状態計測システム
JP2008103820A (ja) * 2006-10-17 2008-05-01 Sharp Corp 立体画像処理装置
JP2010506287A (ja) * 2006-10-04 2010-02-25 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 画像強調

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001346226A (ja) * 2000-06-02 2001-12-14 Canon Inc 画像処理装置、立体写真プリントシステム、画像処理方法、立体写真プリント方法、及び処理プログラムを記録した媒体
JP2003047027A (ja) * 2001-07-31 2003-02-14 Canon Inc 立体画像形成システム、立体画像形成方法、プログラムおよび記憶媒体
JP2006041811A (ja) * 2004-07-26 2006-02-09 Kddi Corp 自由視点画像ストリーミング方式
JP2008082870A (ja) * 2006-09-27 2008-04-10 Setsunan Univ 画像処理プログラム及びこれを用いた路面状態計測システム
JP2010506287A (ja) * 2006-10-04 2010-02-25 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 画像強調
JP2008103820A (ja) * 2006-10-17 2008-05-01 Sharp Corp 立体画像処理装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014053655A (ja) * 2012-09-05 2014-03-20 Panasonic Corp 画像表示装置
JP2015046177A (ja) * 2014-10-15 2015-03-12 グリー株式会社 画像表示装置、画像表示方法及びプログラム

Similar Documents

Publication Publication Date Title
US8638329B2 (en) Auto-stereoscopic interpolation
US8977039B2 (en) Pulling keys from color segmented images
US8213711B2 (en) Method and graphical user interface for modifying depth maps
US9544576B2 (en) 3D photo creation system and method
CN101635859B (zh) 一种实现平面视频转立体视频的方法和装置
US9992473B2 (en) Digital multi-dimensional image photon platform system and methods of use
JP7387434B2 (ja) 画像生成方法および画像生成装置
CN104081768B (zh) 异视点图像生成装置以及异视点图像生成方法
KR101825759B1 (ko) 3ｄ 디스플레이 장치에서 3차원 영상을 시각화하는 방법 및 3ｄ 디스플레이 장치
AU2005331138A1 (en) 3D image generation and display system
TW201029443A (en) Method and device for generating a depth map
JP2014056466A (ja) 画像処理装置及び方法
CN102124749A (zh) 立体图像显示装置
CN106664397A (zh) 用于生成三维图像的方法和装置
JP5862635B2 (ja) 画像処理装置、立体データ生成方法、及びプログラム
KR20110113923A (ko) 영상 변환 장치 및 이를 포함하는 입체 영상 표시 장치
JP5356590B1 (ja) 画像処理装置及びその方法
JP6611588B2 (ja) データ記録装置、撮像装置、データ記録方法およびプログラム
GB2585197A (en) Method and system for obtaining depth data
US11043019B2 (en) Method of displaying a wide-format augmented reality object
CA2674104C (fr) Methode et interface utilisateur graphique permettant de modifier des cartes de profondeur
WO2012096065A1 (fr) Dispositif d'affichage d'image de parallaxe et procédé d'affichage d'image de parallaxe
WO2011071978A1 (fr) Rendu d'image en trois dimensions
WO2012096054A1 (fr) Dispositif d'affichage d'image de parallaxe, procédé d'affichage d'image de parallaxe et programme d'affichage d'image de parallaxe
KR20150029216A (ko) 3d 이미지 변환 장치 및 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11855290

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11855290

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP