JP5663857B2 - Image display device and image display method - Google Patents

Image display device and image display method Download PDF

Info

Publication number
JP5663857B2
JP5663857B2 JP2009234646A JP2009234646A JP5663857B2 JP 5663857 B2 JP5663857 B2 JP 5663857B2 JP 2009234646 A JP2009234646 A JP 2009234646A JP 2009234646 A JP2009234646 A JP 2009234646A JP 5663857 B2 JP5663857 B2 JP 5663857B2
Authority
JP
Japan
Prior art keywords
image
left
right
eye
viewpoint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2009234646A
Other languages
Japanese (ja)
Other versions
JP2011081272A (en
Inventor
嘉次郎 潮
嘉次郎 潮
裕 市原
裕 市原
Original Assignee
株式会社ニコン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ニコン filed Critical 株式会社ニコン
Priority to JP2009234646A priority Critical patent/JP5663857B2/en
Publication of JP2011081272A publication Critical patent/JP2011081272A/en
Application granted granted Critical
Publication of JP5663857B2 publication Critical patent/JP5663857B2/en
Application status is Active legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39Control of the bit-mapped memory
    • G09G5/393Arrangements for updating the contents of the bit-mapped memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/111Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/302Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/305Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/349Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0464Positioning
    • G09G2340/0478Horizontal positioning
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/363Graphics controllers

Description

  The present invention relates to an image display device and an image display method.

  Conventionally, there is an apparatus that displays a stereoscopic image in a plurality of directions using a lenticular sheet. Further, a technique for interpolating an additional image by manipulating real images taken from different angles is known (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 5-210181

  However, when an additional image for a plurality of viewpoints is generated by interpolating from a real image, complicated processing such as calculating a motion vector for each predetermined pixel area is executed. For this reason, it takes time to generate an image for multiple viewpoints. In particular, when a plurality of multi-view images are streamed such as a moving image, image processing of each frame is not in time.

  In order to solve the above-mentioned problem, in the first aspect of the present invention, there is provided an image display device that displays a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints, respectively, A multi-viewpoint image generation unit that receives a right image and a left image corresponding to two viewpoints, and generates a right-eye image and a left-eye image for a plurality of viewpoints by shifting the received right image and the entire left image, respectively. And an image display device including a display unit that displays the right-eye image and the left-eye image generated by the multi-viewpoint image generation unit toward the corresponding viewpoint, and an image display method using the image display device. provide.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

It is a figure which shows the structural example of the image display apparatus 100 which concerns on one embodiment. 2 is a diagram illustrating a configuration example of an image processing unit 10. FIG. It is a figure which shows an example of the left image and right image which the image acquisition part 12 acquired. 6 is a diagram illustrating an operation example of a multi-viewpoint image generation unit 14. FIG. 6 is a diagram illustrating an operation example of the display unit 50. FIG. 3 is a diagram illustrating a configuration example of a display unit 50. FIG. 3 is a diagram illustrating another configuration example of the image processing unit 10. FIG. It is a figure which shows the process example in the right-and-left image generation part. 3 is a diagram illustrating a configuration example of a multi-viewpoint image generation unit 14. FIG. FIG. 11 is a diagram illustrating another configuration example of the display unit 50. 3 is a diagram illustrating another configuration example of the image processing unit 10. FIG. 3 is a diagram illustrating another configuration example of the image processing unit 10. FIG.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 is a diagram illustrating a configuration example of an image display device 100 according to one embodiment. The image display apparatus 100 displays a plurality of sets of right images and left images from the corresponding viewpoint 1 to viewpoint n. One viewpoint corresponds to the position of the user's right eye or left eye, for example. That is, the image display apparatus 100 displays a set of right image and left image with respect to two adjacent viewpoints. Further, the image display device 100 generates a right image or a left image corresponding to each viewpoint from a given two-dimensional image.

  The image display apparatus 100 of this example includes an image processing unit 10 and a display unit 50. The image processing unit 10 acquires a two-dimensional image. The image processing unit 10 may acquire one two-dimensional image corresponding to one viewpoint, or may acquire two two-dimensional images corresponding to two viewpoints. In the latter case, the two two-dimensional images may be stereo images obtained by capturing the subject from two positions corresponding to the positions of both eyes of a human.

  The image processing unit 10 generates n images corresponding to n (for example, an even number of 4 or more) viewpoints from the acquired two-dimensional image. For example, the image processing unit 10 may generate n / 2 right-eye images and n / 2 left-eye images. Here, the right-eye image is an image to be displayed on the user's right eye, and the left-eye image may be an image to be displayed on the user's left eye.

  The display unit 50 displays n images generated by the image processing unit 10 toward n viewpoints. For example, the display unit 50 may display n images toward n viewpoints by a lenticular method or a parallax barrier method. The display unit 50 of this example displays a stereoscopic image for multiple viewpoints by displaying the corresponding right-eye image and left-eye image toward the adjacent viewpoints.

  FIG. 2 is a diagram illustrating a configuration example of the image processing unit 10. The image processing unit 10 in this example acquires a right image and a left image for two predetermined viewpoints. The predetermined two viewpoints may be viewpoints corresponding to the right eye and the left eye of the user. That is, the right image and the left image may be the above-described stereo image.

  The image processing unit 10 of this example includes an image acquisition unit 12 and a multi-viewpoint image generation unit 14. The image acquisition unit 12 acquires a right image and a left image for two predetermined viewpoints. The image acquisition unit 12 may acquire the right image and the left image from an external device, and may acquire the right image and the left image by imaging the subject from two different positions.

  The multi-viewpoint image generation unit 14 receives the right image and the left image for the predetermined two viewpoints from the image acquisition unit 12, and shifts the received right image and the entire left image, respectively. A right eye image and a left eye image for different viewpoints are generated. That is, the display unit 50 displays a stereoscopic image in which the position of the subject is shifted for each viewpoint. Thereby, a stereoscopic image corresponding to each viewpoint can be displayed.

  The multi-viewpoint image generation unit 14 of this example supplies the right-eye image and the left-eye image for the n viewpoints to the display unit 50 together with the right image and the left image received from the image acquisition unit 12. More specifically, the multi-viewpoint image generation unit 14 supplies the display unit 50 with right-eye images for n / 2 viewpoints and left-eye images for n / 2 viewpoints. The display unit 50 receives the right image and the left image received by the image acquisition unit 12 and the image generated by the multi-viewpoint image generation unit 14 and displays them for the corresponding viewpoints. The display unit 50 may display each image in parallel.

  FIG. 3 is a diagram illustrating an example of the left image and the right image acquired by the image acquisition unit 12. The left image and the right image in this example are stereo images obtained by capturing the same subject from two different positions corresponding to both human eyes. Note that the subject in the left image and the right image has a parallax corresponding to the distance from the imaging device to the subject. In FIG. 3, the subject 62 has a parallax d1 between the left and right images, and the subject 64 has a parallax d2 between the left and right images.

  FIG. 4 is a diagram illustrating an operation example of the multi-viewpoint image generation unit 14. In FIG. 4, a case where n / 2 left-eye images are generated based on the left image received from the image acquisition unit 12 will be described. However, based on the right image received from the image acquisition unit 12, n / The same applies when two right-eye images are generated.

  The multi-viewpoint image generation unit 14 generates n / 2 left-eye images by sequentially shifting the entire received left image by a predetermined shift amount. For example, the multi-viewpoint image generation unit 14 includes a plurality of right-shifted left-eye images that are sequentially shifted rightward by shift amounts da and a plurality of left images that are sequentially shifted leftward by shift amounts da. A shifted left-eye image may be generated.

  FIG. 4 shows an example in which seven left-eye images are generated with the number of viewpoints n = 14. In this case, as shown in FIG. 4, the multi-viewpoint image generation unit 14 generates three right-shifted left eye images and three left-shifted left eye images in addition to the original left image. It's okay. In addition to the original left image, the multi-viewpoint image generation unit 14 may generate six right-shifted left eye images, or may generate six left-shifted left eye images.

  FIG. 5 is a diagram illustrating an operation example of the display unit 50. The display unit 50 of this example displays a plurality of right-eye images and a plurality of left-eye images generated by the multi-viewpoint image generation unit 14 in parallel in the same frame. For example, as illustrated in FIG. 4, the display unit 50 includes a plurality of left-eye images in which the entire original left image is sequentially shifted in the x-axis direction. L (3)) is extracted from (-3). Similarly, in the plurality of right-eye images in which the entire original right image is sequentially shifted in the x-axis direction, the display unit 50 displays pixel rows at the same position on the x-axis (in this example, R (−3) to R ( 3)) is extracted. Note that the pixel column may have a width in the x-axis direction of one pixel or a plurality of pixels.

  The display unit 50 displays a region at the same position on the x-axis in the plurality of left-eye images and right-eye images in a predetermined arrangement in a region corresponding to the position on the x-axis on the display surface. For example, the display unit 50 may alternately display each pixel column in the plurality of left-eye images and right-eye images by a predetermined number of columns. In the example of FIG. 5, the display unit 50 alternately displays the pixel columns of the left eye image and the right eye image one by one. Similarly, for other areas on the display surface, corresponding areas in the plurality of right-eye images and left-eye images are displayed in a predetermined arrangement.

  FIG. 6 is a diagram illustrating a configuration example of the display unit 50. The display unit 50 of this example includes a lens array 54 and a display element 52. As described with reference to FIG. 5, the display element 52 displays each pixel column of the plurality of left-eye images and right-eye images in a predetermined arrangement. The lens array 54 has a plurality of lenses arranged in a predetermined pattern. The lens array 54 may be a lenticular lens array having a plurality of semi-cylindrical lenses arranged at a predetermined pitch along the x-axis direction.

  In the lens array 54, each lens is provided for every predetermined number of pixel columns corresponding to the number of viewpoints. For example, when the number of viewpoints n = 14 as shown in FIGS. 4 and 5, each lens is provided for every 14 pixel columns on the display surface of the display element 52. Each lens displays each pixel column toward a corresponding viewpoint (in this example, viewpoints 1, 2,..., K-2, k-1, k, k + 1, k + 2,..., 13, 14). To do.

  With the above configuration, a multi-viewpoint left-eye image and right-eye image can be easily generated from a given set of right and left images. Further, the generated left-eye image and right-eye image for multiple viewpoints can be displayed at the corresponding viewpoints. In addition, although the case where the display unit 50 of this example is a lenticular method has been described, the display unit 50 may be a parallax barrier method.

  Further, the multi-viewpoint image generation unit 14 has a maximum shift amount between images generated from the right image and the left image acquired by the image acquisition unit 12 smaller than the maximum parallax amount between the right image and the left image. It is preferable to generate a shift image for each viewpoint. For example, referring to the examples of FIGS. 3 and 4, the multi-viewpoint image generation unit 14 determines that the shift amount 6da between the left-eye image at the left end and the left-eye image at the right end is the maximum parallax amount d1. The unit shift amount da is set so as to be sufficiently smaller than that. Similarly, the multi-viewpoint image generation unit 14 sets the unit shift amount da so that the maximum shift amount 6da in the right-eye image is sufficiently smaller than the maximum parallax amount d1. In this example, the unit shift amount da is the same in the right-eye image and the left-eye image.

  In the above-described example, the multi-viewpoint image generation unit 14 generates the left-eye image and the right-eye image obtained by sequentially shifting the original left image and the right image by the uniform shift amount da. The multi-viewpoint image generation unit 14 may generate a left-eye image and a right-eye image obtained by sequentially shifting the original image with a non-uniform shift amount. For example, for the left-eye image and the right-eye image corresponding to the viewpoint near the center among the plurality of viewpoints, the shift amount with respect to the adjacent left-eye image and right-eye image is relatively small, and the end portion For left-eye images and right-eye images corresponding to nearby viewpoints, the shift amount with respect to adjacent left-eye images and right-eye images may be relatively large. In this case, when the user's viewpoint is switched in the vicinity of the center among the plurality of viewpoints, the difference in displayed images is small, so that the images can be switched smoothly.

  In addition, for the left-eye image and the right-eye image corresponding to the viewpoint near the center among the plurality of viewpoints, the shift amount with respect to the adjacent left-eye image and right-eye image is relatively increased, and the end portion For the left-eye image and the right-eye image corresponding to the nearby viewpoint, the shift amount with respect to the adjacent left-eye image and right-eye image may be relatively small. In this case, when the user's viewpoint is switched in the vicinity of the end portion of the plurality of viewpoints, the images can be switched smoothly.

  FIG. 7 is a diagram illustrating another configuration example of the image processing unit 10. The image processing unit 10 of this example includes an image acquisition unit 12, a left / right image generation unit 16, and a multi-viewpoint image generation unit 14. The image acquisition unit 12 acquires one two-dimensional image. The image acquisition unit 12 may acquire a two-dimensional image from an external device, or may acquire a two-dimensional image by imaging a subject.

  The left and right image generation unit 16 generates a right image and a left image for two adjacent viewpoints among a plurality of viewpoints by shifting the entire two-dimensional image acquired by the image acquisition unit 12, and a multi-viewpoint image generation unit 14 The left and right image generation unit 16 may shift the entire two-dimensional image by an eye width shift amount corresponding to the distance between human eyes. For example, the left and right image generation unit 16 shifts the entire two-dimensional image so that the shift amount between the generated right image and the left image becomes an eye width shift amount of about 6.5 cm, thereby shifting the right image and the left image. Is generated.

  The multi-viewpoint image generation unit 14 generates n / 2 right eye images and left eye images based on the right image and the left image received from the left and right image generation unit 16. The process in which the multi-view image generation unit 14 generates a plurality of right-eye images and left-eye images may be the same as that of the multi-view image generation unit 14 described with reference to FIG. With such a configuration, a multi-viewpoint left-eye image and a right-eye image can be easily generated from one two-dimensional image.

  FIG. 8 is a diagram illustrating a processing example in the left and right image generation unit 16. The left and right image generation unit 16 generates a left image and a right image in which the entire image is relatively shifted in the x-axis direction by a predetermined eye width shift amount d based on the received two-dimensional image. By selectively displaying the left image and the right image on the user's left eye and right eye, a stereoscopic image in which each subject exists at infinity can be provided.

  Note that the multi-viewpoint image generation unit 14 has a maximum shift amount of each of the left-eye image and the right-eye image generated from the right image and the left image that is larger than the eye width shift amount d in the left-right image generation unit 16. It is preferable to generate a right image and a left image for each viewpoint so as to be smaller. Similarly to the multi-viewpoint image generation unit 14 described with reference to FIG. 2, the multi-viewpoint image generation unit 14 outputs the left-eye image and the right-eye image obtained by sequentially shifting the left and right images with a non-uniform shift amount. It may be generated.

  FIG. 9 is a diagram illustrating a configuration example of the multi-viewpoint image generation unit 14. The multi-viewpoint image generation unit 14 of this example includes a memory 30, a plurality of delay units 32, an output unit 34, and a control unit 36. 9 illustrates a configuration for processing either the left image or the right image in the configuration of the multi-viewpoint image generation unit 14, but the multi-viewpoint image generation unit 14 has the same configuration as that of FIG. Or further to process the other of the right images.

  The memory 30 stores the right image or the left image, and outputs data in units of pixel columns in order from the end pixel column. The pixel column refers to a pixel column along a direction perpendicular to the above-described x-axis direction. A number of delay units 32 (n / 2 in this example) corresponding to the number of viewpoints are provided in cascade connection. That is, the plurality of delay units 32 correspond to n / 2 left-eye images or right-eye images output from the multi-viewpoint image generation unit 14 with respect to the left image or the right image.

  The control unit 36 sets the delay amount in each delay unit 32 according to the shift amount in the corresponding left-eye image and right-eye image. For example, with respect to the delay unit 32 corresponding to the left-eye image or the right-eye image whose shift amount with respect to the immediately previous left-eye image or right-eye image is a 10-pixel array, the control unit 36 uses the memories 30 to The time for reading out the pixel column is set as the delay time. As described above, the control unit 36 may set a uniform delay amount corresponding to the uniform shift amount, or may set a non-uniform delay amount corresponding to the non-uniform shift amount.

  The output unit 34 receives in parallel the pixel column data output from the plurality of delay units 32. As described above, since each delay unit 32 delays data from the memory 30 by a delay amount corresponding to the shift amount, the output unit 34 outputs the pixel columns L (3) and L (2) shown in FIG. ..,... Are received in parallel such that the positions in the image are shifted in the x-axis direction.

  The output unit 34 supplies the combined data in which the pixel columns received in parallel are arranged in a predetermined order to the display unit 50. In addition, since the display unit 50 displays a large number of viewpoint images on one screen, a pixel row is thinned out for an image for one viewpoint compared to the original image. The output unit 34 generates one composite data and supplies it to the display unit 50 for each period in which the number of pixel columns corresponding to the number of viewpoints is read from the memory 30, so that the pixel columns correspond to the number of viewpoints. Data obtained by thinning out may be generated.

  With such a configuration, a plurality of left-eye images and right-eye images in which pixel rows are thinned according to the number of viewpoints can be easily displayed on the display unit 50. In addition, the shift amount in the left-eye image and the right-eye image can be easily adjusted.

  FIG. 10 is a diagram illustrating another configuration example of the display unit 50. The display unit 50 of this example includes a display element 52 and a barrier unit 56. In the barrier portion 56, a transmission portion that transmits light and a shielding portion that blocks light are arranged in a predetermined arrangement pattern. In the barrier unit 56, it is preferable that shutter elements for controlling whether or not to transmit light are formed in a matrix, and the arrangement pattern can be changed by controlling whether or not each shutter element transmits light. For example, the barrier unit 56 may include a liquid crystal panel.

  The display element 52 may be the same as the display element 52 described with reference to FIG. The display element 52 displays an area corresponding to the arrangement pattern of the transmission part and the shielding part in the barrier unit 56 of each shift image toward the barrier unit 56. For example, in the barrier unit 56, strip-shaped transmission units and shielding units having a predetermined width from the upper end to the lower end of the display element 52 may be alternately arranged in a region facing the display element 52. In this case, the display element 52 extracts a strip-like pixel column having a width obtained by dividing the width of the transmission part of the barrier unit 56 by the number of viewpoints from each shift image, and sets the pixel column of each shift image to a predetermined value. Are displayed in the order of.

  Further, the display element 52 may change the pattern of the region extracted from the left-eye image and the right-eye image in accordance with the change in the arrangement pattern of the transmission part and the shielding part in the barrier part 56. For example, when the width of the strip-shaped transmission part in the barrier unit 56 is changed, the width of the pixel column extracted from each of the left-eye image and the right-eye image is adjusted according to the changed width of the transmission part You can do it.

  Moreover, the arrangement pattern of the transmission part and the shielding part of the barrier part 56 can have various patterns. For example, the transmission part and the shielding part of the barrier part 56 may be provided obliquely from the upper end to the lower end of the display element 52, and may be provided from the right end to the left end of the display element 52. Moreover, the transmission part and the shielding part of the barrier part 56 may be arranged in a staggered manner. That is, the transmission part and the shielding part of the barrier part 56 may be alternately arranged in both the vertical direction and the horizontal direction of the display element 52. The display element 52 may determine the shape of the region to be extracted from the left-eye image and the right-eye image in accordance with the arrangement pattern of the transmission part and the shielding part of the barrier part 56.

  FIG. 11 is a diagram illustrating another configuration example of the image processing unit 10. The image processing unit 10 of this example further includes a viewpoint setting unit 20 in addition to the configuration of any one of the image processing units 10 described with reference to FIGS. In FIG. 11, a configuration in which the viewpoint setting unit 20 is added to the configuration of the image processing unit 10 described with reference to FIG. 2 will be described.

  The viewpoint setting unit 20 sets the number of viewpoints n for the multi-viewpoint image generation unit 14. The viewpoint setting unit 20 may set the number of viewpoints n in the multi-viewpoint image generation unit 14 according to the number of viewpoints set by the user or the like. The multi-viewpoint image generation unit 14 generates a shift image corresponding to each viewpoint according to the set number of viewpoints n. Further, the multi-viewpoint image generation unit 14 may change the shift amount in the left-eye image and the right-eye image according to the set number of viewpoints n. For example, the multi-viewpoint image generation unit 14 calculates the shift amounts of the left-eye image and the right-eye image by dividing a preset total shift amount by a number corresponding to the set number of viewpoints. You can do it.

  The viewpoint setting unit 20 may include a subject determination unit 22 that sets the number of viewpoints in the multi-viewpoint image generation unit 14 based on subjects included in the image acquired by the image acquisition unit 12. For example, the subject determination unit 22 may relatively reduce the number of viewpoints in the multi-viewpoint image generation unit 14 when the subject includes a subject that is preferably displayed with higher resolution. More specifically, the subject determination unit 22 may reduce the number of viewpoints in the multi-viewpoint image generation unit 14 when the spatial frequency of the subject included in the image acquired by the image acquisition unit 12 is higher.

  Further, the viewpoint setting unit 20 acquires distance information of the subject included in the image acquired by the image acquisition unit 12, and sets the number of viewpoints in the multi-viewpoint image generation unit 14 according to the acquired distance information. A portion 24 may be included. The distance acquisition unit 24 may acquire shooting condition data attached to the image. When the image acquisition unit 12 acquires a stereo right image and left image, the distance acquisition unit 24 may acquire subject distance information based on the amount of parallax of the subject included in the right image and the left image. .

  The distance acquisition unit 24 may increase the number of viewpoints in the multi-viewpoint image generation unit 14 when the distance to the subject is closer. The viewpoint setting unit 20 may set the number of viewpoints in the multi-viewpoint image generation unit 14 by combining the subject determination unit 22 and the distance acquisition unit 24.

  Further, the multi-viewpoint image generation unit 14 may change the shift amount of the left-eye image and the right-eye image with respect to the adjacent left-eye image and right-eye image based on the position of the user. For example, the shift amount may be smaller for the left-eye image and the right-eye image corresponding to the viewpoint closer to the user's position. Thereby, the motion of the image can be smoothed from the viewpoint near the user's position. The image processing unit 10 may further include a position detection unit that detects the position of the user and notifies the multi-viewpoint image generation unit 14. The position detection unit may include an imaging device such as a CCD element.

  FIG. 12 is a diagram illustrating another configuration example of the image processing unit 10. The image processing unit 10 of this example further includes an image evaluation unit 40 and an interpolated image generation unit 38 in addition to the configuration of any one of the image processing units 10 described with reference to FIGS. FIG. 12 shows a configuration in which an image evaluation unit 40 and an interpolated image generation unit 38 are added to the configuration of the image processing unit 10 described with reference to FIG. Other configurations may be the same as any one of the image processing units 10 described with reference to FIGS. 1 to 11.

  The interpolated image generation unit 38 separates the right-eye image and the left image for a plurality of viewpoints separately from the multi-view image generation unit 14 based on the relationship between corresponding points in the right image and the left image given to the multi-view image generation unit 14. An ophthalmic image is generated. The interpolated image generation unit 38 may calculate a motion vector between corresponding points in the right image and the left image, and may calculate parallax. The interpolated image generation unit 38 calculates a motion vector or parallax that each viewpoint image should have with respect to the right image or the left image based on the position of each viewpoint. The interpolation includes a process of interpolating values at the viewpoints inside the two viewpoints based on the values of the two viewpoints, and a process of extrapolating values at the viewpoints outside the two viewpoints based on the values of the two viewpoints. .

  For example, the interpolation image generation unit 38 calculates the ratio between the difference between the viewpoint positions of the right image and the left image and the difference between the viewpoints of the right image and the other viewpoints between the right image and the left image. An interpolation vector or interpolation parallax obtained by multiplying the motion vector or parallax is calculated. Then, the interpolation image generation unit 38 generates an image having an interpolation vector or interpolation parallax for the right image as an image for the other viewpoint. Similarly, by generating the interpolation vector or the interpolation parallax at each viewpoint, the interpolation image generation unit 38 can generate images for a plurality of viewpoints from the given right image and left image.

  The image evaluation unit 40 evaluates the right-eye image and the left-eye image generated by the interpolation image generation unit 38. Here, evaluation refers to evaluation of whether or not an appropriate stereoscopic image can be provided by the right-eye image and the left-eye image. The image evaluation unit 40 may perform the evaluation based on the right image and the left image given to the interpolation image generation unit 38, and based on the right eye image and the left eye image generated by the interpolation image generation unit 38. Evaluation may be performed, and the evaluation may be performed based on a predetermined parameter detected in the course of image processing in the interpolated image generation unit 38.

  As an example, the interpolated image generation unit 38 detects a plurality of corresponding points where the same subject is imaged in the given right image and left image, and calculates the motion vector of the entire image from the motion vector or parallax between the corresponding points. Alternatively, the parallax is estimated. For this reason, the larger the number of corresponding points detected by the interpolated image generation unit 38, the more accurately the motion vector or parallax of the entire image can be estimated.

  The interpolated image generation unit 38 may detect corresponding points by comparing edge components and the like of the right image and the left image. For this reason, it is not always possible to detect a sufficient number of corresponding points. When the number of corresponding points detected by the interpolation image generation unit 38 is equal to or less than a predetermined value, the image evaluation unit 40 determines that the right eye image and the left eye image generated by the interpolation image generation unit 38 are appropriate three-dimensional images. It may be determined that the target image cannot be provided.

  In addition, as the corresponding points detected by the interpolated image generation unit 38 are distributed throughout the entire image, the motion vector or parallax of the entire image can be estimated with higher accuracy. The image evaluation unit 40 may evaluate the right eye image and the left eye image generated by the interpolation image generation unit 38 based on the distribution of corresponding points detected by the interpolation image generation unit 38. For example, the image evaluation unit 40 determines that the right-eye image and the left-eye image generated by the interpolation image generation unit 38 are appropriate when the maximum value of the distance between the corresponding points is equal to or greater than a predetermined value. It may be evaluated that a stereoscopic image cannot be provided.

  The display unit 50 displays the right-eye image and the left-eye image generated by the multi-viewpoint image generation unit 14 when the evaluation result in the image evaluation unit 40 is equal to or lower than a predetermined level. Moreover, the display part 50 displays the image for right eyes and the image for left eyes which the interpolation image generation part 38 produced | generated, when the evaluation result in the image evaluation part 40 is higher than the said level. For example, the display unit 50 is generated by the multi-viewpoint image generation unit 14 when it is evaluated that the right-eye image and the left-eye image generated by the interpolation image generation unit 38 cannot provide an appropriate stereoscopic image. The right eye image and the left eye image are displayed.

  The multi-viewpoint image generation unit 14 and the interpolation image generation unit 38 may generate images in parallel. In another operation example, the multi-viewpoint image generation unit 14 may generate a right-eye image and a left-eye image when the evaluation result in the image evaluation unit 40 is equal to or lower than the level. That is, when it is evaluated that the right-eye image and the left-eye image generated by the interpolation image generation unit 38 can provide an appropriate stereoscopic image, the multi-viewpoint image generation unit 14 selects the right-eye image. And the image for the left eye may not be generated.

  The interpolation image generation unit 38 may not generate the right eye image and the left eye image when the evaluation based on the number or distribution of corresponding points in the right image and the left image is equal to or lower than a predetermined level. In this case, as described above, the multi-viewpoint image generation unit 14 provides the display unit 50 with the right-eye image and the left-eye image for multiple viewpoints. The image evaluation unit 40 may control whether the multi-viewpoint image generation unit 14 and the interpolation image generation unit 38 generate the right-eye image and the left-eye image.

  In addition, the image evaluation unit 40 compares the maximum value of the parallax between the plurality of sets of right-eye images and left-eye images generated by the interpolation image generation unit 38 with a predetermined value, and determines the right You may evaluate the image for eyes, and the image for left eyes. The maximum value of the parallax is calculated by calculating the parallax of each corresponding point in the corresponding image for the right eye and the image for the left eye for each combination of the image for the right eye and the image for the left eye. Refers to the maximum value. The image evaluation unit 40 may evaluate that the right-eye image and the left-eye image cannot provide an appropriate stereoscopic image when the parallax maximum value is equal to or greater than a predetermined value. Further, the image evaluation unit 40 may receive information on the evaluation result by the user.

  In addition, the image acquisition unit 12 described with reference to FIGS. 1 to 12 may acquire a moving image including a plurality of images. In this case, the image processing unit 10 generates a plurality of left-eye images and right-eye images by performing the processing described in relation to FIGS. 1 to 12 for each frame image of the moving image. Since the image processing unit 10 can generate a plurality of left-eye images and right-eye images by a simple process, a plurality of images in each frame of the moving image can be obtained even when the moving image is distributed by streaming. The left-eye image and the right-eye image can be sequentially generated.

  Further, the multi-viewpoint image generation unit 14 described with reference to FIGS. 1 to 12 uses the same shift amount between the left image and the right image, respectively, and the left-eye image and the right-eye image. Was generated. In another example, the multi-viewpoint image generation unit 14 may generate the left-eye image and the right-eye image using different shift amounts between the left image and the right image. That is, in the left-eye image and the right-eye image, the shift amount between the images corresponding to the left and right may be varied depending on the viewpoint position. Thereby, it is possible to display an image in which a sense of depth changes according to the viewpoint position.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 ... Image processing part, 12 ... Image acquisition part, 14 ... Multi-viewpoint image generation part, 16 ... Left-right image generation part, 20 ... Viewpoint setting part, 22 ... Subject determination part , 24 ... Distance acquisition unit, 30 ... Memory, 32 ... Delay unit, 34 ... Output unit, 36 ... Control unit, 38 ... Interpolated image generation unit, 40 ... Image Evaluation unit 50... Display unit 52. Display element 54. Lens array 56. Barrier unit 62 62 64 Subject 100 Image display device

Claims (17)

  1. An image display device that displays a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints,
    The right image and the left image corresponding to two predetermined viewpoints are received, and the right image and the left eye image for a plurality of viewpoints are generated by shifting the received right image and the left image respectively. A multi-viewpoint image generation unit,
    A display unit that displays the right-eye image and the left-eye image generated by the multi-viewpoint image generation unit, respectively, toward a corresponding viewpoint;
    A subject determination unit that sets the number of viewpoints in the multi-viewpoint image generation unit based on a subject included in the image;
    The multi-viewpoint image generation unit generates the left-eye image and the right-eye image corresponding to each viewpoint according to the set number of viewpoints.
  2. An image display device that displays a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints,
    The right image and the left image corresponding to two predetermined viewpoints are received, and the right image and the left eye image for a plurality of viewpoints are generated by shifting the received right image and the left image respectively. A multi-viewpoint image generation unit,
    A display unit that displays the right-eye image and the left-eye image generated by the multi-viewpoint image generation unit, respectively, toward a corresponding viewpoint;
    A distance acquisition unit that acquires distance information of a subject included in an image and sets the number of viewpoints in the multi-viewpoint image generation unit according to the acquired distance information of the subject,
    The multi-viewpoint image generation unit generates the left-eye image and the right-eye image corresponding to each viewpoint according to the set number of viewpoints.
  3. An image display device that displays a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints,
    The right image and the left image corresponding to two predetermined viewpoints are received, and the right image and the left eye image for a plurality of viewpoints are generated by shifting the received right image and the left image respectively. A multi-viewpoint image generation unit,
    A display unit that displays the right-eye image and the left-eye image generated by the multi-viewpoint image generation unit, respectively, toward a corresponding viewpoint;
    Based on the relationship between corresponding points in the right image and the left image, apart from the multi-viewpoint image generation unit, an interpolation image generation unit that generates the right-eye image and the left-eye image for the plurality of viewpoints; ,
    An image evaluation unit for evaluating the right-eye image and the left-eye image generated by the interpolation image generation unit;
    The display unit displays the right-eye image and the left-eye image generated by the multi-viewpoint image generation unit when an evaluation result in the image evaluation unit is equal to or lower than a predetermined level.
  4. The image display according to any one of claims 1 to 3 , wherein the multi-viewpoint image generation unit acquires two-dimensional images captured from different positions as the right image and the left image for the predetermined two viewpoints. apparatus.
  5. The multi-viewpoint image generation unit is configured such that a maximum shift amount between the left-eye image and the right-eye image is smaller than a maximum parallax amount between the right image and the left image for the predetermined two viewpoints. The image display device according to claim 4 , wherein the left eye image and the right eye image are generated.
  6. The left and right image generation units that generate the right image and the left image for the predetermined two viewpoints by shifting the whole given two-dimensional image, and input to the multi-viewpoint image generation unit are further provided. 4. The image display device according to any one of items 3 .
  7. The left and right image generation unit generates the right image and the left image for two adjacent viewpoints among a plurality of viewpoints by shifting the entire two-dimensional image by a predetermined eye width shift amount,
    The multi-viewpoint image generator generates the left-eye image and the right-eye image so that a maximum shift amount of the left-eye image and the right-eye image is smaller than the eye-width shift amount. The image display device according to claim 6 .
  8. The display unit
    A barrier portion in which a transmission portion that transmits light and a shielding portion that blocks light are arranged in a predetermined arrangement pattern;
    Each of the left-eye image and the right-eye image, a region corresponding to the arrangement pattern, according to any one of claims 1 to 7 and a display device for displaying toward the barrier section Image display device.
  9. In the barrier section, shutter elements that control whether or not to transmit light are formed in a matrix, and the arrangement pattern can be changed by controlling whether or not light is transmitted to each of the shutter elements,
    The image display device according to claim 8 , wherein the display element changes a shape of a region to be displayed for each of the left-eye image and the right-eye image according to the change of the arrangement pattern.
  10. The image display device according to claim 3, wherein the multi-viewpoint image generation unit generates the right-eye image and the left-eye image when an evaluation result in the image evaluation unit is equal to or lower than the predetermined level. .
  11. The interpolated image generation unit detects a plurality of the corresponding points where the same subject is imaged in the right image and the left image, and based on the corresponding points, the right-eye image for the plurality of viewpoints and Generating the image for the left eye,
    The image evaluation unit evaluates the right-eye image and the left-eye image generated by the interpolation image generation unit based on the number of corresponding points detected by the interpolation image generation unit. 10. The image display device according to 10 .
  12. The interpolated image generation unit detects a plurality of the corresponding points where the same subject is imaged in the right image and the left image, and based on the corresponding points, the right-eye image for the plurality of viewpoints and Generating the image for the left eye,
    The image evaluation unit evaluates the right-eye image and the left-eye image generated by the interpolation image generation unit based on the distribution of the corresponding points detected by the interpolation image generation unit. 10. The image display device according to 10 .
  13. The image according to claim 11 or 12 , wherein the interpolation image generation unit does not generate the right-eye image and the left-eye image when an evaluation result in the image evaluation unit is equal to or lower than the predetermined level. Display device.
  14. The image evaluation unit compares a maximum value of parallax between the plurality of sets of the right-eye image and the left-eye image generated by the interpolation image generation unit with a predetermined value, and performs the interpolation The image display device according to claim 3 or 10 , wherein the right eye image and the left eye image generated by an image generation unit are evaluated.
  15. An image display method for displaying a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints,
    A right image and a left image for two predetermined viewpoints are received, and the received right image and the left image are respectively shifted, thereby generating the left eye image and the right eye image for a plurality of viewpoints. Viewpoint image generation stage,
    A display step of displaying the left-eye image and the right-eye image generated in the multi-viewpoint image generation step, respectively, toward a corresponding viewpoint;
    A subject determination stage for setting the number of viewpoints based on the subject included in the image,
    An image display method for generating the left-eye image and the right-eye image corresponding to each viewpoint according to the set number of viewpoints in the multi-viewpoint image generation step.
  16. An image display method for displaying a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints,
    A right image and a left image for two predetermined viewpoints are received, and the received right image and the left image are respectively shifted, thereby generating the left eye image and the right eye image for a plurality of viewpoints. Viewpoint image generation stage,
    A display step of displaying the left-eye image and the right-eye image generated in the multi-viewpoint image generation step, respectively, toward a corresponding viewpoint;
    A distance acquisition step of acquiring distance information of a subject included in an image and setting the number of viewpoints according to the acquired distance information of the subject,
    An image display method for generating the left-eye image and the right-eye image corresponding to each viewpoint according to the set number of viewpoints in the multi-viewpoint image generation step.
  17. An image display method for displaying a plurality of sets of right-eye images and left-eye images toward corresponding viewpoints,
    A right image and a left image for two predetermined viewpoints are received, and the received right image and the left image are respectively shifted, thereby generating the left eye image and the right eye image for a plurality of viewpoints. Viewpoint image generation stage,
    A display step of displaying the left-eye image and the right-eye image generated in the multi-viewpoint image generation step, respectively, toward a corresponding viewpoint;
    An interpolated image generating step for generating the right eye image and the left eye image for the plurality of viewpoints separately from the multi-view image generating step based on the relationship between corresponding points in the right image and the left image; ,
    An image evaluation stage for evaluating the right eye image and the left eye image generated by the interpolation image generation stage, and
    An image display method for displaying the right-eye image and the left-eye image generated in the multi-viewpoint image generation step when an evaluation result in the image evaluation step is equal to or lower than a predetermined level in the display step.
JP2009234646A 2009-10-08 2009-10-08 Image display device and image display method Active JP5663857B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2009234646A JP5663857B2 (en) 2009-10-08 2009-10-08 Image display device and image display method

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2009234646A JP5663857B2 (en) 2009-10-08 2009-10-08 Image display device and image display method
PCT/JP2010/005701 WO2011043022A1 (en) 2009-10-08 2010-09-17 Image display device and image display method
CN201080045445.1A CN102714030B (en) 2009-10-08 2010-09-17 Image display device and image display method
KR1020127010124A KR101427491B1 (en) 2009-10-08 2010-09-17 Image display device and image display method
TW099133663A TWI517136B (en) 2009-10-08 2010-10-04 Image display device and image display method
US13/441,921 US20120194905A1 (en) 2009-10-08 2012-04-09 Image display apparatus and image display method

Publications (2)

Publication Number Publication Date
JP2011081272A JP2011081272A (en) 2011-04-21
JP5663857B2 true JP5663857B2 (en) 2015-02-04

Family

ID=43856507

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009234646A Active JP5663857B2 (en) 2009-10-08 2009-10-08 Image display device and image display method

Country Status (6)

Country Link
US (1) US20120194905A1 (en)
JP (1) JP5663857B2 (en)
KR (1) KR101427491B1 (en)
CN (1) CN102714030B (en)
TW (1) TWI517136B (en)
WO (1) WO2011043022A1 (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103348688A (en) * 2011-02-08 2013-10-09 富士胶片株式会社 Stereoscopic image printing device and stereoscopic image printing method
WO2012108405A1 (en) * 2011-02-08 2012-08-16 富士フイルム株式会社 Stereoscopic image printing device and stereoscopic image printing method
JP5708395B2 (en) * 2011-09-16 2015-04-30 株式会社Jvcケンウッド Video display device and video display method
WO2013069608A1 (en) * 2011-11-11 2013-05-16 ソニー株式会社 Transmitting apparatus, transmitting method, receiving apparatus and receiving method
EP2807827A4 (en) * 2012-01-25 2015-03-04 Lumenco Llc Conversion of a digital stereo image into multiple views with parallax for 3d viewing without glasses
KR20130111991A (en) * 2012-04-02 2013-10-11 삼성전자주식회사 Multiple point image display apparatus for image enhancement and method thereof
TWI485654B (en) * 2012-06-28 2015-05-21 Imec Taiwan Co Imaging system and method
KR101983369B1 (en) * 2013-01-11 2019-05-28 엘지디스플레이 주식회사 Multiview image generation method and stereoscopic image display device using the same
KR101980352B1 (en) * 2013-01-16 2019-05-20 엘지디스플레이 주식회사 Stereoscopic image display device and method for driving the same
JP2014230251A (en) * 2013-05-27 2014-12-08 ソニー株式会社 Image processing apparatus and image processing method
WO2015193198A1 (en) * 2014-06-19 2015-12-23 Koninklijke Philips N.V. Method and apparatus for generating a three dimensional image

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3311832B2 (en) * 1992-10-14 2002-08-05 テルモ株式会社 Three-dimensional image display device
DE69434685D1 (en) * 1993-08-04 2006-05-18 Canon Kk Image processing method and apparatus
JPH08205201A (en) * 1995-01-31 1996-08-09 Sony Corp Pseudo stereoscopic vision method
JP3826236B2 (en) * 1995-05-08 2006-09-27 松下電器産業株式会社 Intermediate image generation method, intermediate image generation device, parallax estimation method, and image transmission display device
JP3516774B2 (en) * 1995-06-14 2004-04-05 三菱電機株式会社 3D image display device
JP3477023B2 (en) * 1996-04-05 2003-12-10 松下電器産業株式会社 Multi-view image transmission method and multi-view image display method
JP2000020707A (en) * 1998-07-07 2000-01-21 Dainippon Screen Mfg Co Ltd Image generating method and recording medium for image generation program
JP2000057350A (en) * 1998-08-10 2000-02-25 Toshiba Corp Image processor, image processing method and image transmitting method
JP2002159022A (en) * 2000-11-17 2002-05-31 Fuji Xerox Co Ltd Apparatus and method for generating parallax image
JP2005091447A (en) * 2003-09-12 2005-04-07 Canon Inc Stereoscopic display device
KR100786862B1 (en) * 2004-11-30 2007-12-20 삼성에스디아이 주식회사 Barrier device, three dimensional image display using the same and method thereof
KR100560464B1 (en) * 2005-03-30 2006-03-07 (주)디노스 Multi-view display system with viewpoint adaptation
EP1991963B1 (en) * 2006-02-27 2019-07-03 Koninklijke Philips N.V. Rendering an output image
JP5396877B2 (en) * 2009-01-21 2014-01-22 株式会社ニコン Image processing apparatus, program, image processing method, and recording method
JP5515301B2 (en) * 2009-01-21 2014-06-11 株式会社ニコン Image processing apparatus, program, image processing method, recording method, and recording medium
WO2010084724A1 (en) * 2009-01-21 2010-07-29 株式会社ニコン Image processing device, program, image processing method, recording method, and recording medium
JP2010259017A (en) * 2009-04-28 2010-11-11 Nikon Corp Display device, display method and display program

Also Published As

Publication number Publication date
TWI517136B (en) 2016-01-11
JP2011081272A (en) 2011-04-21
CN102714030B (en) 2015-07-15
CN102714030A (en) 2012-10-03
US20120194905A1 (en) 2012-08-02
TW201137854A (en) 2011-11-01
KR101427491B1 (en) 2014-08-07
KR20120053536A (en) 2012-05-25
WO2011043022A1 (en) 2011-04-14

Similar Documents

Publication Publication Date Title
US7557824B2 (en) Method and apparatus for generating a stereoscopic image
KR20110124473A (en) 3-dimensional image generation apparatus and method for multi-view image
EP2357838B1 (en) Method and apparatus for processing three-dimensional images
US20080199070A1 (en) Three-dimensional image display apparatus and method for enhancing stereoscopic effect of image
WO2011132422A1 (en) Three-dimensional video display device and three-dimensional video display method
US20090115780A1 (en) Rendering an output image
US9208396B2 (en) Image processing method and device, and program
US8654182B2 (en) Display device and control method of display device
JP2010062695A (en) Image processing apparatus, image processing method, and program
KR101629479B1 (en) High density multi-view display system and method based on the active sub-pixel rendering
JP2011064894A (en) Stereoscopic image display apparatus
JP5224124B2 (en) Imaging device
JPWO2012056686A1 (en) 3D image interpolation apparatus, 3D imaging apparatus, and 3D image interpolation method
US6608622B1 (en) Multi-viewpoint image processing method and apparatus
CN101394572A (en) Apparatus and method for processing three-dimensional images
US20110064299A1 (en) Image processing apparatus and image processing method
US20120249730A1 (en) Stereoscopic panoramic video capture system using surface identification and distance registration technique
US20110205226A1 (en) Generation of occlusion data for image properties
CN103595987B (en) Stereoscopic display device, image processing apparatus and image processing method
US9237335B2 (en) Three-dimensional image display apparatus
CN101271583B (en) Fast image drafting method based on depth drawing
US9749601B2 (en) Imaging device, image display method, and storage medium for displaying reconstruction image
US20150156476A1 (en) Image processing apparatus, image processing method, and program for generating a three dimensional image to be stereoscopically viewed
CN102170577B (en) Method and system for processing video images
JP2008146221A (en) Image display system

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20121009

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20130903

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20131025

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20140708

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140930

A911 Transfer of reconsideration by examiner before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20141008

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20141111

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20141124

R150 Certificate of patent or registration of utility model

Ref document number: 5663857

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250