US20080211737A1 - Three-dimensional display apparatus using intermediate elemental images - Google Patents

Three-dimensional display apparatus using intermediate elemental images Download PDF

Info

Publication number
US20080211737A1
US20080211737A1 US12/004,309 US430907A US2008211737A1 US 20080211737 A1 US20080211737 A1 US 20080211737A1 US 430907 A US430907 A US 430907A US 2008211737 A1 US2008211737 A1 US 2008211737A1
Authority
US
United States
Prior art keywords
image
elemental
images
dimensional
elemental images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/004,309
Other languages
English (en)
Inventor
Eun-Soo Kim
Dong-Choon Hwang
Jae-Sung Park
Seung-Chool Kim
Dong-Hak Shin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Research Institute for Industry Cooperation of Kwangwoon University
Original Assignee
Research Institute for Industry Cooperation of Kwangwoon University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research Institute for Industry Cooperation of Kwangwoon University filed Critical Research Institute for Industry Cooperation of Kwangwoon University
Assigned to KWANGWOON UNIVERSITY RESEARCH INSTITUTE FOR INDUSTRY COOPERATION, KIM, EUN-SOO reassignment KWANGWOON UNIVERSITY RESEARCH INSTITUTE FOR INDUSTRY COOPERATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HWANG, DONG-CHOON, KIM, SEUNG-CHEOL, SHIN, DONG-HAK, KIM, EUN-SOO, PARK, JAE-SUNG
Publication of US20080211737A1 publication Critical patent/US20080211737A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/307—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using fly-eye lenses, e.g. arrangements of circular lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/139—Format conversion, e.g. of frame-rate or size
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses

Definitions

  • the present invention relates to a three-dimensional display apparatus and a method thereof, more specifically to a three-dimensional display apparatus and a method thereof that displays a three-dimensional image by using an integral imaging.
  • the integral imaging technology which was designed by Lippmann for the first time, has been actively developed as one of the next generation three-dimensional image display technologies. Like a holographic method, considered as an ideal three-dimensional display method, the integral imaging technology can provide full parallax and successive observation perspectives.
  • the integral technology is classified into a pick-up step and a display step.
  • the pick-up step is realized by a two-dimensional sensor, such as a charge coupled device (CCD), and a lens array.
  • a three-dimensional object is provided in front of the lens array.
  • the two-dimensional sensor stores a variety of image information on the three-dimensional object, which has passed through the lens array. This stored image information is used for three-dimensional reproduction.
  • the following display step an inverse step of the pick-up step, is embodied by a display apparatus, such as an LCD, and another lens array.
  • a display apparatus such as an LCD
  • another lens array In the display step, an elemental image, provided from the pick-up step, is displayed on the display apparatus. Image information of the elemental image passes through the lens array, and a three-dimensional image is reproduced in a space.
  • One aspect of the present invention provides a three-dimensional image display apparatus using an intermediate elemental image and a method thereof that can output a high resolution three-dimensional image when a three-dimensional image is displayed.
  • Another aspect of the present invention provides a three-dimensional image display apparatus using an intermediate elemental image and a method thereof that require no mechanical movement of a lens array by reproducing a three-dimensional image with a plurality of intermediate elemental images generated by an algorithm of a computer.
  • Another aspect of the present invention provides a three-dimensional image display apparatus using an intermediate elemental image and a method thereof that do not consume long pick-up time by reproducing a three-dimensional image with an elemental image acquired through a single pick-up operation.
  • the apparatus may have an image input unit (or an intermediate elemental image generator), which generates a plurality of elemental images, having different perspectives, extracted from a three-dimensional object, an image processing unit (or an intermediate elemental image generator), which generates an intermediate elemental image, using parallax information between the elemental images inputted from the image input unit, and an image reproduction unit (or an image reproducer), which reproduces a three-dimensional image corresponding to the three-dimensional object by use of the elemental image and the intermediate elemental image.
  • an image input unit or an intermediate elemental image generator
  • an image processing unit or an intermediate elemental image generator
  • an image reproduction unit or an image reproducer
  • the image input unit can also have a first lens array for extracting elemental images of different perspectives from the three-dimensional object, and an image sensor, which stores the elemental images received from the first lens array.
  • the image reproduction unit can have an image display unit, which displays the elemental image and the intermediate elemental image, and a second lens array, which consists of a plurality of convex lenses reproducing a three-dimensional image corresponding to the three-dimensional object by projecting and overlapping and immersing the elemental image and the intermediate elemental image displayed on the image display unit.
  • the image reproduction unit can also have an image display unit (or an image display section), which displays the elemental image and the intermediate elemental image, and a second lens array, which consists of a plurality of concave lenses reproducing a three-dimensional image corresponding to the three-dimensional object by reflecting and overlapping and immersing the elemental image and the intermediate elemental image displayed on the image display unit.
  • an image display unit or an image display section
  • a second lens array which consists of a plurality of concave lenses reproducing a three-dimensional image corresponding to the three-dimensional object by reflecting and overlapping and immersing the elemental image and the intermediate elemental image displayed on the image display unit.
  • the intermediate elemental image can be combined as a linear combination of two adjacent images among the plurality of elemental image.
  • the intermediate elemental image can be generated by the following formula:
  • I P ( x,y ) (1 ⁇ ) ⁇ I L ( x+ ⁇ d ( x,y ), y )+ ⁇ I R ( x ⁇ (1 ⁇ ) d ( x,y ), y )
  • I P is a pixel of an intermediate elemental image
  • I L is a pixel of a left image of the two adjacent elemental images
  • I R is a pixel of a right image of the two adjacent elemental images
  • d is a spatial difference between I L and I R , and 0 ⁇ 1.
  • the number of the intermediate elemental images generated between the adjacent elemental images can be n ⁇ 1.
  • an apparatus for generating a three-dimensional image based on elemental images comprising: i) an elemental image generator configured to generate a plurality of elemental images from a three-dimensional object, wherein the elemental images comprise different perspectives, ii) an intermediate elemental image generator configured to generate at least one intermediate elemental image, based on parallax information between the generated elemental images and iii) an image reproducer configured to reproduce a three-dimensional image corresponding to the three-dimensional object based on the elemental images and the at least one intermediate elemental image.
  • Another aspect of the invention provides a method of generating a three-dimensional image based on elemental images, the method comprising: i) generating a plurality of elemental images from a three-dimensional object, wherein the elemental images comprise different perspectives, ii) generating at least one intermediate elemental image, based on parallax information between the generated elemental images and iii) reproducing a three-dimensional image corresponding to the three-dimensional object based on the elemental images and the at least one intermediate elemental image.
  • Still another aspect of the invention provides an apparatus for generating a three-dimensional image based on elemental images, the apparatus comprising: i) means for generating a plurality of elemental images from a three-dimensional object, wherein the elemental images comprise different perspectives, ii) means for generating at least one intermediate elemental image, based on parallax information between the generated elemental images and iii) means for reproducing a three-dimensional image corresponding to the three-dimensional object based on the elemental images and the at least one intermediate elemental image.
  • FIG. 1 illustrates a typical system for a three-dimensional image resolution.
  • FIG. 2 illustrates a three-dimensional image display apparatus in accordance with an embodiment of the present invention.
  • FIG. 3 illustrates projection and reflection integral imaging display apparatuses that can be applied to embodiments of the present invention.
  • FIG. 4 illustrates a method of generating an intermediate elemental image in an integral imaging system in accordance with an embodiment of the present invention.
  • FIG. 5 illustrates a method of generating a two-dimensional intermediate elemental image in an integral imaging system in accordance with an embodiment of the present invention.
  • FIG. 6 illustrates an elemental image and an intermediate elemental image generated according to parameters different from each other in accordance with an embodiment of the present invention.
  • FIG. 7 illustrates a principle of enlarging an image corresponding to a three-dimensional object by using an intermediate elemental image in accordance with a first embodiment of the present invention.
  • FIG. 8 illustrates a system for picking up an elemental image from a three dimensional object in accordance with one embodiment of the present invention.
  • FIG. 9 illustrates elemental images picked up and enlarged by the system in FIG. 8 .
  • FIG. 10 illustrates the elemental images in FIG. 9 and intermediate elemental images generated from the elemental images.
  • FIG. 11 illustrates a type of comparing vertically and horizontally generated intermediate elemental images and elemental images in accordance with one embodiment of the present invention.
  • FIG. 12 illustrates a three-dimensional image display apparatus for image enlarging in accordance with one embodiment of the present invention.
  • FIG. 13 illustrates an enlarged image in accordance with one embodiment of the present invention.
  • FIG. 14 illustrates a general integral imaging method for reproducing a three-dimensional image by using a computer.
  • FIG. 15 illustrates a structure of a system for reproducing a three-dimensional image by using a computer in accordance with a second embodiment of the present invention.
  • FIG. 16 illustrates an integral imaging method for reproducing a three-dimensional image by using a computer in accordance with one embodiment of the present invention.
  • FIG. 17 illustrates an optically acquired elemental image and a combined intermediate elemental image in accordance with one embodiment of the present invention.
  • FIG. 18 illustrates a three-dimensional images reconstructed from an elemental image by using a computer for comparison in accordance with one embodiment of the present invention.
  • a high resolution three dimensional image is not easy to reproduce because it is limited to completely pick up image information from a three-dimensional object.
  • the resolution of a three dimensional image depends on the number of elemental images. This means that many elemental images are used to reproduce a high resolution three-dimensional image.
  • the moving array-lenslet technique which increases the resolution of a three-dimensional reproduction image, was designed by Javidi group in 2002.
  • the MALT reproduces a high resolution three-dimensional image by acquiring many elemental images through a time-multiplexing method and representing the elemental images, acquired through the time-multiplexing method, on a display panel at a high speed while a lens array contrarily moves.
  • a recent research reports a method that applies the MALT to the enlargement of a three-dimensional reproduction image.
  • An operation of enlarging the reproduction image is performed by the MALT, which controls spatial ray sampling in the pick-up step of the integral technology.
  • the MALT enlarges the size of an image corresponding to a three-dimensional object, displayed in a spatial coordinate of three axes, by applying the same ratio to each axis.
  • the display step of the three-dimensional image is realized by a fixable lens array to get an enlarged image.
  • the resolution of a three-dimensional reproduction image in the integral imaging technology is determined by many system variables, such as the diffraction, the lenslet aberration, the system arrangement, a pixel of two-dimensional sensor and a display panel.
  • the diameter of a basic lens forming a lens array is one of the fundamental variables for restricting the reproduced three-dimensional image resolution.
  • P is randomly decreased to increase the resolution, a viewing angle is relatively reduced, and the diffraction of the basic lens is generated.
  • the MALT is designed to recover this restriction.
  • FIG. 1 illustrates a typical MALT system for increasing the resolution of a three-dimensional image.
  • a three-dimensional object 110 a three-dimensional object 110 , a first lens array 120 , an image sensor 130 , an image processing unit 140 , an imaging display unit 150 , a second lens array 160 and a three-dimensional image 170 are illustrated.
  • Light projected from the three-dimensional object 110 passes through the first lens array, and the light is stored in the image sensor 130 as a plurality of elemental images.
  • the elemental images undergo the process of the image processing unit 140 for the size and arrangement of an image, and are outputted from the image display unit 150 . Then, the elemental images are displayed as the three-dimensional image 170 by the second lens array 160 .
  • the spatial sampling ratio is increased by vibrating the lens array upwardly; downwardly, leftwardly and rightwardly.
  • the two-dimensional sensor is settled.
  • a two-dimensional sensor for high speed pick up may be needed to promptly write an unsettled elemental image provided through the vibrating lens array.
  • the MALT can be used to identically analyze three axes of spatial coordinate and enlarge an image corresponding to the three-dimensional object.
  • an integrated image system of projector type can be used to provide an image without distortion and wide perspective angle.
  • the integrated image system of projector type uses a convex mirror lens array. In this system, an operation of enlarging the reproduction image is performed by the MALT of the pick-up step.
  • n P/S
  • P the diameter of a basic lens
  • S the sampling interval.
  • the pick-up step is repeated within the size of one basic lens. All n ⁇ n picked elemental images are transmitted to the display system through a transmission line.
  • a new combination elemental image is formed by the image processing unit 140 with the n ⁇ n elemental images.
  • the MALT can be used to enlarge the three-dimensional combination image by using elemental images provided through the pick-up step, the mechanical movement and long pick-up time function as a blocking factor while the system is optimized in real time.
  • FIG. 2 illustrates a three-dimensional (3D) image display apparatus in accordance with an embodiment of the present invention.
  • a 3D object 210 a first lens array 220 , an image sensor 230 , an image processing unit 250 , a second lens array 260 and a 3D image 270 are illustrated.
  • a 3D image display apparatus using an intermediate elemental image in accordance with the integral imaging technology comprises a photographing unit and a display unit.
  • the photographing unit includes a first lens array 220 , which forms an image of a different perspective from the 3D object 210 , and the image sensor 230 , which stores an elemental image immersed by the first lens array 220 .
  • the display unit includes an image reproducing unit, which displays the elemental image stored in the image sensor 230 , and a second lens array 260 , which immerses the elemental image displayed from the image reproducing unit 250 and reproduces the immersed elemental image as the 3D image 270 .
  • the first lens array 220 and the second lens array 260 are formed by combining a plurality of lenses.
  • the image processing unit 240 combines intermediate elemental images by using an intermediate perspective reconstruction technique (IPRT). Elemental images, picked up once, can be transmitted in real time to the image processing unit 240 through pick-up devices that are used in a present communication channel. Since the elemental images that are picked up once cannot be used for the enlarging function of the integral imaging technology, the number of the elemental images is increased by using the IPRT, which generates the intermediate elemental image by the calculation of a computer. The use of the IPRT makes it possible to generate in real time the intermediate elemental image thanks to the recent prompt development of hardware and to process in real time an original elemental image and newly generated intermediate elemental image.
  • IPRT intermediate perspective reconstruction technique
  • the integral imaging system in accordance with one embodiment of the present invention can enlarge a 3D reproduction image through a simple computer calculation without a conventional multi pick-up step such as the MALT and a mechanical operation.
  • the number of elemental images acquired through the one-time-pick-up operation is increased with the IPRT.
  • the increased plurality of elemental images is additionally combined. This method can provide the same efficiency as the MALT, which reproduces a 3D image by using a plurality of elemental images.
  • the system in accordance with one embodiment of the present invention can be used for the real-time enlarging integral imaging system because additional time is not required for the mechanical movement of lens array and the pick-up operation of images corresponding to the 3D object.
  • an operation method of this system will be described, and then, the embodiments and results thereof will be described by way of example of an enlarging display experiment.
  • FIG. 3 illustrates projection and reflection integral imaging display apparatuses that can be applied to embodiments of the present invention.
  • a display apparatus 280 a projection lens array 283 , 3D images 285 and 295 , a projection device 290 and a reflection lens array 293 are illustrated for comparison.
  • FIG. 3 which shows the projection integral imaging display apparatus
  • the projection lens array 283 is provided in front of the display apparatus 280 .
  • the light emitted from the display apparatus 280 passes through the projection lens array 283 .
  • the 3D image 285 is formed by combining each elemental image.
  • the 3D image 295 is formed between the projection device 290 and the reflection array 293 .
  • the reflection array 293 is formed by coating a mirror to a surface of the projection lens array 283 .
  • a concave mirror can replace the reflection lens array 293 . With this configuration, the light emitted from the projection device 290 is reflected in the concave mirror and concentrated to form the 3D image 285 .
  • a big screen projection integral image system can employ the reflection integral imaging system, for example.
  • the reflection integral imaging display apparatus in (b) of FIG. 3 generally provides an image without distortion and a wide viewing angle as compared with the projection integral imaging display apparatus in (a) of FIG. 3 . Both the projection and reflection integral imaging display apparatuses in (a) and (b) of FIG. 3 can be applied to the 3D image display apparatus.
  • FIG. 4 illustrates a method of generating an intermediate elemental image in an integral imaging system in accordance with an embodiment of the present invention. Referring to FIG. 4 , a left image 310 and a right image 320 of two adjacent images in a plurality of elemental images and an intermediate elemental image 330 of the left and right images 310 and 320 are illustrated.
  • the left image 310 and the right image 320 are appointed as I L (x,y) and I R (x,y), respectively.
  • the disparity of the two images 310 and 320 is d(x,y).
  • the intermediate elemental image 330 is appointed as I P (x,y).
  • the disparity d(x,y) can be extracted with various methods.
  • the corresponding intermediate elemental image 330 is positioned at a distance ⁇ standardized from the left image 310 . For example, if the distance from the left perspective to the right perspective is converted into 1, ⁇ is within 0 to 1, that is 0 ⁇ 1.
  • An intermediate-perspective image can be combined as a linear combination of the two images with the interpolation.
  • the following formula (I) shows the method of the interpolation with a perspective ⁇ .
  • I P ( x,y ) (1 ⁇ ) ⁇ I L ( x+ ⁇ d ( x,y ), y )+ ⁇ I R ( x ⁇ (1 ⁇ ) d ( x,y ), y ) (1)
  • I P is the intermediate elemental image pixel.
  • I L is a pixel of the left image of the two adjacent elemental images.
  • I R is a pixel of the right image of the two adjacent elemental images.
  • d is the difference between I L and I R (i.e. the disparity), whereas 0 ⁇ 1.
  • FIG. 5 illustrates a two-dimensional intermediate elemental image in accordance with an embodiment of the present invention.
  • an elemental image 340 generated from the 3D object an intermediate elemental image 350 and an elemental image set 360 , including the intermediate elemental image 350 , for reproducing a 3D image are illustrated.
  • An IPRT is performed by applying a different weighted value to the disparity information in accordance with an intermediate-perspective for estimating and generating disparity information of a different perspective image.
  • a method of generating an intermediate image of three perspectives between each elemental image is illustrated. For example, 12 outside intermediate elemental images are generated in vertical and horizontal dimensions of the intermediate image of the respective elemental images. Then, 9 inside intermediate elemental images are generated. Accordingly, the elemental image set 360 having 25 elemental images is generated from 4 elemental images 340 formed from the 3D object.
  • the (i,j) th elemental image is appointed as E i,j (x,y), whereas x and y indicate pixel positions of the respective elemental images.
  • i and j correspond to the number of lenses that are vertically and horizontally disposed.
  • the IPRT has been mainly described for two adjacent elemental images, but is not limited thereto.
  • Each intermediate elemental image corresponding to ⁇ can be acquired from the formula (1) by using E i,j (x,y) and E i+1,j (x,y).
  • ⁇ is used as a size adjusting parameter. For example, if an image corresponding to a 3D object is enlarged n times,
  • Embodiments of the present invention are classified into a first method of enlarging an image corresponding to a 3D object by using an intermediate elemental image, and a second method of increasing the resolution of the image, which are below described in order.
  • FIG. 7 compares a case of using an elemental image only and another case of using an intermediate elemental image, when enlarging an image corresponding to a three-dimensional object in accordance with a first embodiment of the present invention.
  • display apparatuses 510 and 550 elemental images 515 , 520 and 555 , lens arrays 517 , 522 , 557 , 562 and 567 , 3D images 530 and 570 and an intermediate elemental image 560 are illustrated.
  • the elemental images 515 and 520 outputted from the display apparatus 510 are passed through the lens arrays 517 and 520 . Then, the elemental images 515 and 520 forms the 3D image 530 of a size corresponding to a focus distance of lens and a distance between the elemental images 515 and 520 .
  • the distance between the elemental images 555 and 565 becomes larger than the distance between the elemental images 515 and 520 . Accordingly, considering a top point and a bottom point of the combined 3D image 570 , the paths of light passing through each lens array geometrical-optically extend more than the 3D image 530 , and cause an increase in the overall 3D image 530 .
  • the intermediate elemental image 560 inserted between the elemental images 555 and 565 , can increase the resolution.
  • a 3D image 570 is enlarged 3 times as much as the 3D image 530 , the number of intermediate elemental images that are inserted into elemental images becomes n ⁇ 1. That is, the distance between the elemental images 555 and 565 is increased n times as much as the initial distance therebetween, the 3D image 570 is enlarged n times as much as the 3D image 530 .
  • the number of the intermediate elemental images, which are inserted between the elemental images 555 and 565 is n ⁇ 1.
  • FIG. 8 illustrates a system for picking up an elemental image from a three dimensional object in accordance with one embodiment of the present invention.
  • the elemental image is captured by an image sensor 610 (e.g. a CCD camera) through picking up a lenslet array 620 .
  • a 3D object consists of two objects. That is, a toy vehicle 630 is separated by 3 cm from the lenslet array 620 , and an octopus doll 640 is separated by 10 cm from the lenslet array.
  • the lenslet array has a size of 33 ⁇ 25. Each lenslet is mapped with a size of 30 ⁇ 30 by the CCD camera.
  • the focus distance and magnification of lens are formed by 3 mm and 1.08 mm, respectively.
  • FIG. 9 illustrates elemental images picked up and enlarged by the system in FIG. 8 .
  • an output screen in (a) on which the picked elemental images are displayed, has a pixel size of 990 ⁇ 750.
  • Enlarged elemental images of a tire of the toy car 530 are displayed on the screen for the enlarged elemental images in (b).
  • every elemental image has a perspective of the respective 3D object.
  • FIG. 11 illustrates a method for image quality comparison of the intermediate elemental image vertically and horizontally calculated and produced from an elemental image in accordance with one embodiment of the present invention.
  • the horizontally adjacent elemental images (Ei,j), (Ei+1,j) and (Ei+2,j) and the vertically adjacent elemental images ((Ei,j), (Ei,j+1), (Ei,j+2) are extracted by the lens array.
  • the intermediate elemental image is calculated by a computer with (Ei,j) and (Ei+2,j) in accordance with the IPRT, and is compared with (Ei+1,j).
  • an average peak signal to noise ratio (PSNR) of 36.08 is taken.
  • the PSNR is generally used to measure the image loss.
  • the image loss is calculated by using an average square error of between pixels of the original elemental image and the generated intermediate elemental image. This result value shows that the image loss is not much in the integral imaging system when reproducing a 3D image.
  • FIG. 12 illustrates a three-dimensional image display apparatus for image enlarging in accordance with one embodiment of the present invention
  • FIG. 13 illustrates an image that is enlarged twice and three times as much by the system in FIG. 12 .
  • the display apparatus comprises a micro block mirror array 1010 , an imaging lens 1020 and a projector 1030 to enlarge the 3D image by using the intermediate elemental images generated by the IPRT.
  • the display projector 1030 has the resolution of 1280 ⁇ 1024.
  • the micro mirror array 1010 used for a lenslet array screen, is formed by coating a mirror on a surface of the projection lens array.
  • the size and clearness of respective elemental images projected from the projector 1030 are adjusted by the imaging lens 1020 .
  • the elemental images, which are reflected in the micro block mirror array are combined into the 3D image.
  • An original size image, a twice-enlarged image and a three-times-enlarged image are illustrated in (a), (b) and (c), respectively, of FIG. 13 .
  • This experiment shows that intermediate elemental images generated by the IPRT can be used to enlarge a 3D image.
  • FIG. 14 illustrates a general integral imaging method for reproducing a 3D image by using a computer and a pin hole array.
  • the integral imaging method represents the 3D image by receiving information on light of the 3D space with a micro lens array or the pin hole array.
  • the intensity and direction of the light passing through each lens or pin hole array are written by using an optical sensor such as a CCD to receive information on the light of an object in the 3D space with the integral image method.
  • Each elemental image is passed through the same lens or pin hole array as used for extracting the elemental image to combine the elemental image. By using this combined information (i.e. elemental image) the 3D image is reproduced.
  • the 3D image is extracted by reproducing and combining the pre-generated elemental image with the computer. That is, a reproducing method using the computer that copies the existing optical reproducing method of the elemental image can be used.
  • the method of acquiring the elemental image is identical to the optical reproducing method.
  • a method, for modeling the use of the lens (or pin hole) and enlarging and inverting and overlapping each elemental image can be used.
  • An enlarging rate M of the elemental image is determined by a ratio of a reproduced distance l (i.e.
  • the 3D image reproducing system using the computer when reproducing an increased number of elemental images, generated to increase the resolution, includes a 3D object 1310 , a lens array 1320 , an image sensor 1330 and a computer 1340 .
  • FIG. 16 illustrates an integral imaging method for reproducing a three-dimensional image by using a computer in accordance with one embodiment of the present invention.
  • elemental images 1410 , 1420 and 1470 , an intermediate elemental image 1405 , pin hole arrays 1430 and 1480 and reproduced image areas 1440 , 1450 , 1460 and 1490 are illustrated.
  • the enlarging rate M is l/k
  • an intermediate elemental image 1405 is generated and disposed between each elemental image 1410 , 1420 and 1470 .
  • FIG. 16 illustrate that a first elemental image 1470 , an (n ⁇ 1) th elemental image 1420 , an n th elemental image 1410 and the intermediate elemental image 1405 pass through the pin hole arrays 1430 and 1480 and a first reproduced image 1490 , an (n ⁇ 1) th reproduced image 1460 , an n th reproduced image 1440 and a reproduced image 1450 of the intermediate elemental image 1405 .
  • the method of reproducing the generated intermediate elemental image and elemental image is to enlarge at a distance and invert and overlap the intermediate elemental image 1405 generated between conventional elemental images reproduced by a computer.
  • the 3D image reproducing method in the integral imaging method in case that maximum elemental images are overlapped, can improve the resolution of the reproduced 3D image. Accordingly, in case that the intermediate elemental image generated between each elemental image by the IPRT, the increasing of the number of overlapped elemental images makes the improvement of the 3D image resolution.
  • FIG. 17 illustrates an optically acquired elemental image and a combined intermediate elemental image in accordance with one embodiment of the present invention
  • FIG. 18 illustrates a 3D images reconstructed from an elemental image by using a computer for comparison in accordance with one embodiment of the present invention.
  • the elemental image taken from the 3D object through the lens array and the intermediate elemental image generated by the IPRT are illustrated in (a) and (b), respectively.
  • the elemental image taken from the 3D object through the lens array in (a) of FIG. 17 has the resolution of 990 ⁇ 750.
  • Each elemental image consists of a pixel of 30 ⁇ 30.
  • a first case in which the 3D image is reproduced with the computer by using the elemental image only
  • a second case in which the 3D image is reproduced by using the intermediate elemental image
  • the second case has a higher resolution than the first case.
  • Embodiments of the present invention by no means limit or restrict the present invention. It is evident that a large number of permutations are possible by any person of ordinary skill in the art within the spirit of the present invention.
  • a three-dimensional image display apparatus and a method thereof in accordance with at least one embodiment of the present invention can output a high resolution three-dimensional image when reproducing a three-dimensional image.
  • a three-dimensional image can be reproduced without the mechanical movement of a lens array by using a plurality of intermediate elemental images generated by a computer algorithm.
  • a three-dimensional image can be reproduced without a long-pick-up time by using an elemental image acquired through a one-time-pick-up operation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
US12/004,309 2005-11-16 2007-12-19 Three-dimensional display apparatus using intermediate elemental images Abandoned US20080211737A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR1020050109801A KR100730406B1 (ko) 2005-11-16 2005-11-16 중간 요소 영상을 이용한 입체 영상 표시 장치
KR10-2005-0109801 2005-11-16
PCT/KR2006/000548 WO2007058409A1 (fr) 2005-11-16 2006-02-17 Appareil d'affichage tridimensionnel utilisant des images elementaires intermediaires

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2006/000548 Continuation WO2007058409A1 (fr) 2005-11-16 2006-02-17 Appareil d'affichage tridimensionnel utilisant des images elementaires intermediaires

Publications (1)

Publication Number Publication Date
US20080211737A1 true US20080211737A1 (en) 2008-09-04

Family

ID=38048775

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/004,309 Abandoned US20080211737A1 (en) 2005-11-16 2007-12-19 Three-dimensional display apparatus using intermediate elemental images

Country Status (3)

Country Link
US (1) US20080211737A1 (fr)
KR (1) KR100730406B1 (fr)
WO (1) WO2007058409A1 (fr)

Cited By (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2475162A2 (fr) * 2011-01-06 2012-07-11 Sony Corporation Appareil de capture d'images et procédé de traitement d'images
WO2014052974A2 (fr) 2012-09-28 2014-04-03 Pelican Imaging Corporation Création d'images à partir de champs de lumière en utilisant des points de vue virtuels
CN104104939A (zh) * 2014-07-11 2014-10-15 西安电子科技大学 一种宽视角的集成成像三维显示系统
JP2015091071A (ja) * 2013-11-07 2015-05-11 日本放送協会 立体映像生成装置、そのプログラム及び立体映像表示装置
JP2015104107A (ja) * 2013-11-28 2015-06-04 日本放送協会 Ｉｐ立体映像推定装置及びそのプログラム
US9497429B2 (en) 2013-03-15 2016-11-15 Pelican Imaging Corporation Extended color processing on pelican array cameras
US9576369B2 (en) 2008-05-20 2017-02-21 Fotonation Cayman Limited Systems and methods for generating depth maps using images captured by camera arrays incorporating cameras having different fields of view
US9706132B2 (en) 2012-05-01 2017-07-11 Fotonation Cayman Limited Camera modules patterned with pi filter groups
US9733486B2 (en) 2013-03-13 2017-08-15 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing
US9743051B2 (en) 2013-02-24 2017-08-22 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9749568B2 (en) 2012-11-13 2017-08-29 Fotonation Cayman Limited Systems and methods for array camera focal plane control
US9749547B2 (en) 2008-05-20 2017-08-29 Fotonation Cayman Limited Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view
US9754422B2 (en) 2012-02-21 2017-09-05 Fotonation Cayman Limited Systems and method for performing depth based image editing
US9774789B2 (en) 2013-03-08 2017-09-26 Fotonation Cayman Limited Systems and methods for high dynamic range imaging using array cameras
US9794476B2 (en) 2011-09-19 2017-10-17 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US9800859B2 (en) 2013-03-15 2017-10-24 Fotonation Cayman Limited Systems and methods for estimating depth using stereo array cameras
US9800856B2 (en) 2013-03-13 2017-10-24 Fotonation Cayman Limited Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
US9807382B2 (en) 2012-06-28 2017-10-31 Fotonation Cayman Limited Systems and methods for detecting defective camera arrays and optic arrays
US9813616B2 (en) 2012-08-23 2017-11-07 Fotonation Cayman Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US9813617B2 (en) 2013-11-26 2017-11-07 Fotonation Cayman Limited Array camera configurations incorporating constituent array cameras and constituent cameras
US9811753B2 (en) 2011-09-28 2017-11-07 Fotonation Cayman Limited Systems and methods for encoding light field image files
US9858673B2 (en) 2012-08-21 2018-01-02 Fotonation Cayman Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
US9924092B2 (en) 2013-11-07 2018-03-20 Fotonation Cayman Limited Array cameras incorporating independently aligned lens stacks
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
US9955070B2 (en) 2013-03-15 2018-04-24 Fotonation Cayman Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US9986224B2 (en) 2013-03-10 2018-05-29 Fotonation Cayman Limited System and methods for calibration of an array camera
US10009538B2 (en) 2013-02-21 2018-06-26 Fotonation Cayman Limited Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
US20180207051A1 (en) * 2012-08-06 2018-07-26 The Hong Kong Polytechnic University Methods and viewing systems for inhibiting ocular refractive disorders from progressing
US10067348B2 (en) 2013-12-17 2018-09-04 Marsupial Holdings, Inc. Integrated microoptic imager, processor, and display
US10091405B2 (en) 2013-03-14 2018-10-02 Fotonation Cayman Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10127682B2 (en) 2013-03-13 2018-11-13 Fotonation Limited System and methods for calibration of an array camera
US10205933B2 (en) 2014-08-29 2019-02-12 Samsung Electronics Co., Ltd. Depth image acquisition apparatus and method of acquiring depth information
US10218889B2 (en) 2011-05-11 2019-02-26 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10250871B2 (en) 2014-09-29 2019-04-02 Fotonation Limited Systems and methods for dynamic calibration of array cameras
US10261219B2 (en) 2012-06-30 2019-04-16 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US10306120B2 (en) 2009-11-20 2019-05-28 Fotonation Limited Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps
US10366472B2 (en) 2010-12-14 2019-07-30 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10412314B2 (en) 2013-03-14 2019-09-10 Fotonation Limited Systems and methods for photometric normalization in array cameras
US10455168B2 (en) 2010-05-12 2019-10-22 Fotonation Limited Imager array interfaces
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US11270110B2 (en) 2019-09-17 2022-03-08 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11302012B2 (en) 2019-11-30 2022-04-12 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
US11525906B2 (en) 2019-10-07 2022-12-13 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11580667B2 (en) 2020-01-29 2023-02-14 Intrinsic Innovation Llc Systems and methods for characterizing object pose detection and measurement systems
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US11953700B2 (en) 2020-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
US12020455B2 (en) 2021-03-10 2024-06-25 Intrinsic Innovation Llc Systems and methods for high dynamic range image reconstruction
US12069227B2 (en) 2021-03-10 2024-08-20 Intrinsic Innovation Llc Multi-modal and multi-spectral stereo camera arrays
US12067746B2 (en) 2021-05-07 2024-08-20 Intrinsic Innovation Llc Systems and methods for using computer vision to pick up small objects

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100897305B1 (ko) * 2007-07-03 2009-05-14 광운대학교 산학협력단 요소 영상을 이용한 3차원 집적 영상 방법, 시스템 및 이를실행하는 프로그램이 기록된 기록매체
KR100897307B1 (ko) * 2007-07-24 2009-05-14 광운대학교 산학협력단 집적 영상 방식에 의해 얻어진 3차원 영상을 홀로그램기법을 이용하여 재생하는 방법 및 장치
KR100927234B1 (ko) * 2007-07-30 2009-11-16 광운대학교 산학협력단 깊이 정보 생성 방법, 그 장치 및 그 방법을 실행하는프로그램이 기록된 기록매체
KR100927236B1 (ko) * 2007-07-30 2009-11-16 광운대학교 산학협력단 영상 복원 방법, 영상 복원 장치 및 영상 복원 방법을 실행하는 프로그램이 기록된 컴퓨터에서 판독될 수 있는 기록매체
KR100937768B1 (ko) * 2008-04-29 2010-01-20 동서대학교산학협력단 3차원 영상 재생 장치 및 방법
JP4538766B2 (ja) 2008-08-21 2010-09-08 ソニー株式会社 撮像装置、表示装置および画像処理装置
KR101129542B1 (ko) * 2009-10-08 2012-03-29 조열 형상 제공 시스템 및 그 장치
KR101121132B1 (ko) * 2009-12-09 2012-03-19 광운대학교 산학협력단 집적 영상 복원 방법 및 장치
WO2015034157A1 (fr) * 2013-09-04 2015-03-12 삼성전자주식회사 Procédé permettant de générer un eia et appareil capable de l'exécuter
KR101617514B1 (ko) * 2014-04-16 2016-05-13 광운대학교 산학협력단 멀티 프로젝션형 집적영상방법
KR102253320B1 (ko) * 2019-12-26 2021-05-17 충북대학교 산학협력단 집적영상 현미경 시스템에서의 3차원 영상 디스플레이 방법 및 이를 구현하는 집적영상 현미경 시스템

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030038921A1 (en) * 2001-03-15 2003-02-27 Neal Daniel R. Tomographic wavefront analysis system and method of mapping an optical system
US20040263964A1 (en) * 2003-05-27 2004-12-30 Fumio Okano Three-dimensional image optical system
US20060023197A1 (en) * 2004-07-27 2006-02-02 Joel Andrew H Method and system for automated production of autostereoscopic and animated prints and transparencies from digital and non-digital media
US20070109620A1 (en) * 2004-09-29 2007-05-17 Kabushiki Kaisha Toshiba Structure of three-dimensional image data, method of recording three-dimensional image data, and method of displaying and reproducing three-dimensional image data

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100375708B1 (ko) * 2000-10-28 2003-03-15 전자부품연구원 3차원 입체영상을 위한 다시점 비디오 시스템 및영상제조방법
WO2002051165A1 (fr) * 2000-12-18 2002-06-27 Lee Byoung-Ho Systeme d'affichage tridimensionnel reflechissant
KR100433276B1 (ko) * 2001-05-02 2004-05-31 대한민국 입체 영상 표시 장치
KR100424401B1 (ko) * 2001-11-02 2004-03-24 전자부품연구원 검색기능을 포함한 3차원 입체영상을 위한 다시점영상통신 시스템
KR100538227B1 (ko) * 2003-07-26 2005-12-21 삼성전자주식회사 완전시차를 이용한 3차원 영상표시장치에서의 모아레 패턴제거 방법
KR100561401B1 (ko) * 2003-07-28 2006-03-16 삼성전자주식회사 2차원 및 3차원 영상의 호환이 가능한 다 시점 3차원 영상시스템의 영상표시부

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030038921A1 (en) * 2001-03-15 2003-02-27 Neal Daniel R. Tomographic wavefront analysis system and method of mapping an optical system
US20040263964A1 (en) * 2003-05-27 2004-12-30 Fumio Okano Three-dimensional image optical system
US20060023197A1 (en) * 2004-07-27 2006-02-02 Joel Andrew H Method and system for automated production of autostereoscopic and animated prints and transparencies from digital and non-digital media
US20070109620A1 (en) * 2004-09-29 2007-05-17 Kabushiki Kaisha Toshiba Structure of three-dimensional image data, method of recording three-dimensional image data, and method of displaying and reproducing three-dimensional image data

Cited By (112)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9576369B2 (en) 2008-05-20 2017-02-21 Fotonation Cayman Limited Systems and methods for generating depth maps using images captured by camera arrays incorporating cameras having different fields of view
US10027901B2 (en) 2008-05-20 2018-07-17 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US9712759B2 (en) 2008-05-20 2017-07-18 Fotonation Cayman Limited Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras
US11792538B2 (en) 2008-05-20 2023-10-17 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US12041360B2 (en) 2008-05-20 2024-07-16 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US11412158B2 (en) 2008-05-20 2022-08-09 Fotonation Limited Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US10142560B2 (en) 2008-05-20 2018-11-27 Fotonation Limited Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US12022207B2 (en) 2008-05-20 2024-06-25 Adeia Imaging Llc Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
US9749547B2 (en) 2008-05-20 2017-08-29 Fotonation Cayman Limited Capturing and processing of images using camera array incorperating Bayer cameras having different fields of view
US10306120B2 (en) 2009-11-20 2019-05-28 Fotonation Limited Capturing and processing of images captured by camera arrays incorporating cameras with telephoto and conventional lenses to generate depth maps
US10455168B2 (en) 2010-05-12 2019-10-22 Fotonation Limited Imager array interfaces
US11423513B2 (en) 2010-12-14 2022-08-23 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US10366472B2 (en) 2010-12-14 2019-07-30 Fotonation Limited Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
US11875475B2 (en) 2010-12-14 2024-01-16 Adeia Imaging Llc Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
EP2475162A2 (fr) * 2011-01-06 2012-07-11 Sony Corporation Appareil de capture d'images et procédé de traitement d'images
US9432656B2 (en) 2011-01-06 2016-08-30 Sony Corporation Image capturing device including lens array and processing
US10218889B2 (en) 2011-05-11 2019-02-26 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10742861B2 (en) 2011-05-11 2020-08-11 Fotonation Limited Systems and methods for transmitting and receiving array camera image data
US10375302B2 (en) 2011-09-19 2019-08-06 Fotonation Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US9794476B2 (en) 2011-09-19 2017-10-17 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
US10019816B2 (en) 2011-09-28 2018-07-10 Fotonation Cayman Limited Systems and methods for decoding image files containing depth maps stored as metadata
US12052409B2 (en) 2011-09-28 2024-07-30 Adela Imaging LLC Systems and methods for encoding image files containing depth maps stored as metadata
US9811753B2 (en) 2011-09-28 2017-11-07 Fotonation Cayman Limited Systems and methods for encoding light field image files
US10430682B2 (en) 2011-09-28 2019-10-01 Fotonation Limited Systems and methods for decoding image files containing depth maps stored as metadata
US10984276B2 (en) 2011-09-28 2021-04-20 Fotonation Limited Systems and methods for encoding image files containing depth maps stored as metadata
US10275676B2 (en) 2011-09-28 2019-04-30 Fotonation Limited Systems and methods for encoding image files containing depth maps stored as metadata
US11729365B2 (en) 2011-09-28 2023-08-15 Adela Imaging LLC Systems and methods for encoding image files containing depth maps stored as metadata
US20180197035A1 (en) 2011-09-28 2018-07-12 Fotonation Cayman Limited Systems and Methods for Encoding Image Files Containing Depth Maps Stored as Metadata
US9754422B2 (en) 2012-02-21 2017-09-05 Fotonation Cayman Limited Systems and method for performing depth based image editing
US10311649B2 (en) 2012-02-21 2019-06-04 Fotonation Limited Systems and method for performing depth based image editing
US9706132B2 (en) 2012-05-01 2017-07-11 Fotonation Cayman Limited Camera modules patterned with pi filter groups
US10334241B2 (en) 2012-06-28 2019-06-25 Fotonation Limited Systems and methods for detecting defective camera arrays and optic arrays
US9807382B2 (en) 2012-06-28 2017-10-31 Fotonation Cayman Limited Systems and methods for detecting defective camera arrays and optic arrays
US10261219B2 (en) 2012-06-30 2019-04-16 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US11022725B2 (en) 2012-06-30 2021-06-01 Fotonation Limited Systems and methods for manufacturing camera modules using active alignment of lens stack arrays and sensors
US20180207051A1 (en) * 2012-08-06 2018-07-26 The Hong Kong Polytechnic University Methods and viewing systems for inhibiting ocular refractive disorders from progressing
US10898407B2 (en) * 2012-08-06 2021-01-26 The Hong Kong Polytechnic University Methods and viewing systems for inhibiting ocular refractive disorders from progressing
US10380752B2 (en) 2012-08-21 2019-08-13 Fotonation Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US12002233B2 (en) 2012-08-21 2024-06-04 Adeia Imaging Llc Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9858673B2 (en) 2012-08-21 2018-01-02 Fotonation Cayman Limited Systems and methods for estimating depth and visibility from a reference viewpoint for pixels in a set of images captured from different viewpoints
US9813616B2 (en) 2012-08-23 2017-11-07 Fotonation Cayman Limited Feature based high resolution motion estimation from low resolution images captured using an array source
US10462362B2 (en) 2012-08-23 2019-10-29 Fotonation Limited Feature based high resolution motion estimation from low resolution images captured using an array source
WO2014052974A2 (fr) 2012-09-28 2014-04-03 Pelican Imaging Corporation Création d'images à partir de champs de lumière en utilisant des points de vue virtuels
EP2901671A4 (fr) * 2012-09-28 2016-08-24 Pelican Imaging Corp Création d'images à partir de champs de lumière en utilisant des points de vue virtuels
US10390005B2 (en) 2012-09-28 2019-08-20 Fotonation Limited Generating images from light fields utilizing virtual viewpoints
US9749568B2 (en) 2012-11-13 2017-08-29 Fotonation Cayman Limited Systems and methods for array camera focal plane control
US10009538B2 (en) 2013-02-21 2018-06-26 Fotonation Cayman Limited Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information
US9743051B2 (en) 2013-02-24 2017-08-22 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9774831B2 (en) 2013-02-24 2017-09-26 Fotonation Cayman Limited Thin form factor computational array cameras and modular array cameras
US9774789B2 (en) 2013-03-08 2017-09-26 Fotonation Cayman Limited Systems and methods for high dynamic range imaging using array cameras
US9917998B2 (en) 2013-03-08 2018-03-13 Fotonation Cayman Limited Systems and methods for measuring scene information while capturing images using array cameras
US9986224B2 (en) 2013-03-10 2018-05-29 Fotonation Cayman Limited System and methods for calibration of an array camera
US10225543B2 (en) 2013-03-10 2019-03-05 Fotonation Limited System and methods for calibration of an array camera
US10958892B2 (en) 2013-03-10 2021-03-23 Fotonation Limited System and methods for calibration of an array camera
US11570423B2 (en) 2013-03-10 2023-01-31 Adeia Imaging Llc System and methods for calibration of an array camera
US11272161B2 (en) 2013-03-10 2022-03-08 Fotonation Limited System and methods for calibration of an array camera
US11985293B2 (en) 2013-03-10 2024-05-14 Adeia Imaging Llc System and methods for calibration of an array camera
US9733486B2 (en) 2013-03-13 2017-08-15 Fotonation Cayman Limited Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing
US9800856B2 (en) 2013-03-13 2017-10-24 Fotonation Cayman Limited Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies
US10127682B2 (en) 2013-03-13 2018-11-13 Fotonation Limited System and methods for calibration of an array camera
US9888194B2 (en) 2013-03-13 2018-02-06 Fotonation Cayman Limited Array camera architecture implementing quantum film image sensors
US10547772B2 (en) 2013-03-14 2020-01-28 Fotonation Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10091405B2 (en) 2013-03-14 2018-10-02 Fotonation Cayman Limited Systems and methods for reducing motion blur in images or video in ultra low light with array cameras
US10412314B2 (en) 2013-03-14 2019-09-10 Fotonation Limited Systems and methods for photometric normalization in array cameras
US10455218B2 (en) 2013-03-15 2019-10-22 Fotonation Limited Systems and methods for estimating depth using stereo array cameras
US9955070B2 (en) 2013-03-15 2018-04-24 Fotonation Cayman Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US9800859B2 (en) 2013-03-15 2017-10-24 Fotonation Cayman Limited Systems and methods for estimating depth using stereo array cameras
US10542208B2 (en) 2013-03-15 2020-01-21 Fotonation Limited Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
US10122993B2 (en) 2013-03-15 2018-11-06 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10638099B2 (en) 2013-03-15 2020-04-28 Fotonation Limited Extended color processing on pelican array cameras
US10674138B2 (en) 2013-03-15 2020-06-02 Fotonation Limited Autofocus system for a conventional camera that uses depth information from an array camera
US10182216B2 (en) 2013-03-15 2019-01-15 Fotonation Limited Extended color processing on pelican array cameras
US9497429B2 (en) 2013-03-15 2016-11-15 Pelican Imaging Corporation Extended color processing on pelican array cameras
US10540806B2 (en) 2013-09-27 2020-01-21 Fotonation Limited Systems and methods for depth-assisted perspective distortion correction
US9898856B2 (en) 2013-09-27 2018-02-20 Fotonation Cayman Limited Systems and methods for depth-assisted perspective distortion correction
JP2015091071A (ja) * 2013-11-07 2015-05-11 日本放送協会 立体映像生成装置、そのプログラム及び立体映像表示装置
US9924092B2 (en) 2013-11-07 2018-03-20 Fotonation Cayman Limited Array cameras incorporating independently aligned lens stacks
US10767981B2 (en) 2013-11-18 2020-09-08 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US10119808B2 (en) 2013-11-18 2018-11-06 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US11486698B2 (en) 2013-11-18 2022-11-01 Fotonation Limited Systems and methods for estimating depth from projected texture using camera arrays
US9813617B2 (en) 2013-11-26 2017-11-07 Fotonation Cayman Limited Array camera configurations incorporating constituent array cameras and constituent cameras
US10708492B2 (en) 2013-11-26 2020-07-07 Fotonation Limited Array camera configurations incorporating constituent array cameras and constituent cameras
JP2015104107A (ja) * 2013-11-28 2015-06-04 日本放送協会 Ｉｐ立体映像推定装置及びそのプログラム
US10067348B2 (en) 2013-12-17 2018-09-04 Marsupial Holdings, Inc. Integrated microoptic imager, processor, and display
US10574905B2 (en) 2014-03-07 2020-02-25 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
US10089740B2 (en) 2014-03-07 2018-10-02 Fotonation Limited System and methods for depth regularization and semiautomatic interactive matting using RGB-D images
CN104104939A (zh) * 2014-07-11 2014-10-15 西安电子科技大学 一种宽视角的集成成像三维显示系统
US10205933B2 (en) 2014-08-29 2019-02-12 Samsung Electronics Co., Ltd. Depth image acquisition apparatus and method of acquiring depth information
US11546576B2 (en) 2014-09-29 2023-01-03 Adeia Imaging Llc Systems and methods for dynamic calibration of array cameras
US10250871B2 (en) 2014-09-29 2019-04-02 Fotonation Limited Systems and methods for dynamic calibration of array cameras
US9942474B2 (en) 2015-04-17 2018-04-10 Fotonation Cayman Limited Systems and methods for performing high speed video capture and depth estimation using array cameras
US11562498B2 (en) 2017-08-21 2023-01-24 Adela Imaging LLC Systems and methods for hybrid depth regularization
US10482618B2 (en) 2017-08-21 2019-11-19 Fotonation Limited Systems and methods for hybrid depth regularization
US10818026B2 (en) 2017-08-21 2020-10-27 Fotonation Limited Systems and methods for hybrid depth regularization
US11983893B2 (en) 2017-08-21 2024-05-14 Adeia Imaging Llc Systems and methods for hybrid depth regularization
US11699273B2 (en) 2019-09-17 2023-07-11 Intrinsic Innovation Llc Systems and methods for surface modeling using polarization cues
US11270110B2 (en) 2019-09-17 2022-03-08 Boston Polarimetrics, Inc. Systems and methods for surface modeling using polarization cues
US11982775B2 (en) 2019-10-07 2024-05-14 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US12099148B2 (en) 2019-10-07 2024-09-24 Intrinsic Innovation Llc Systems and methods for surface normals sensing with polarization
US11525906B2 (en) 2019-10-07 2022-12-13 Intrinsic Innovation Llc Systems and methods for augmentation of sensor systems and imaging systems with polarization
US11842495B2 (en) 2019-11-30 2023-12-12 Intrinsic Innovation Llc Systems and methods for transparent object segmentation using polarization cues
US11302012B2 (en) 2019-11-30 2022-04-12 Boston Polarimetrics, Inc. Systems and methods for transparent object segmentation using polarization cues
US11580667B2 (en) 2020-01-29 2023-02-14 Intrinsic Innovation Llc Systems and methods for characterizing object pose detection and measurement systems
US11797863B2 (en) 2020-01-30 2023-10-24 Intrinsic Innovation Llc Systems and methods for synthesizing data for training statistical models on different imaging modalities including polarized images
US11953700B2 (en) 2020-05-27 2024-04-09 Intrinsic Innovation Llc Multi-aperture polarization optical systems using beam splitters
US12020455B2 (en) 2021-03-10 2024-06-25 Intrinsic Innovation Llc Systems and methods for high dynamic range image reconstruction
US12069227B2 (en) 2021-03-10 2024-08-20 Intrinsic Innovation Llc Multi-modal and multi-spectral stereo camera arrays
US11290658B1 (en) 2021-04-15 2022-03-29 Boston Polarimetrics, Inc. Systems and methods for camera exposure control
US11954886B2 (en) 2021-04-15 2024-04-09 Intrinsic Innovation Llc Systems and methods for six-degree of freedom pose estimation of deformable objects
US11683594B2 (en) 2021-04-15 2023-06-20 Intrinsic Innovation Llc Systems and methods for camera exposure control
US12067746B2 (en) 2021-05-07 2024-08-20 Intrinsic Innovation Llc Systems and methods for using computer vision to pick up small objects
US11689813B2 (en) 2021-07-01 2023-06-27 Intrinsic Innovation Llc Systems and methods for high dynamic range imaging using crossed polarizers

Also Published As

Publication number Publication date
KR100730406B1 (ko) 2007-06-19
KR20070052131A (ko) 2007-05-21
WO2007058409A1 (fr) 2007-05-24

Similar Documents

Publication Publication Date Title
US20080211737A1 (en) Three-dimensional display apparatus using intermediate elemental images
US6191808B1 (en) Image processing method with viewpoint compensation and apparatus therefor
Stern et al. Three-dimensional image sensing, visualization, and processing using integral imaging
US7525541B2 (en) Data processing for three-dimensional displays
JP4211292B2 (ja) 画像処理装置および画像処理方法、プログラム並びにプログラム記録媒体
JP5238429B2 (ja) 立体映像撮影装置および立体映像撮影システム
CN101422035B (zh) 光源推定装置、光源推定系统与光源推定方法以及图像高分辨率化装置与图像高分辨率化方法
JP4939639B2 (ja) 画像処理装置、画像処理方法、プログラム及び記録媒体
US5764236A (en) Image data processing apparatus and image reproduction apparatus
RU2690757C1 (ru) Система синтеза промежуточных видов светового поля и способ ее функционирования
KR101600681B1 (ko) 집적 영상시스템의 3차원 영상 표시깊이변환방법
CN113763301B (zh) 一种减小错切概率的三维图像合成方法和装置
JP6300346B2 (ja) Ｉｐ立体映像推定装置及びそのプログラム
JPH10500498A (ja) 空間有効画像生成方法
JP4875680B2 (ja) 三次元情報統合装置および三次元情報統合プログラム
JP4729011B2 (ja) 要素画像群変換装置、立体像表示装置及び要素画像群変換プログラム
KR101289283B1 (ko) 하이브리드 영상획득 장치 기반 홀로그래픽 영상 복원 방법
CN112634139B (zh) 光场超分辨成像方法、装置及设备
JP4377656B2 (ja) インテグラルフォトグラフィ撮影装置およびインテグラルフォトグラフィ表示装置
KR100937768B1 (ko) 3차원 영상 재생 장치 및 방법
JPH09200803A (ja) 画像処理装置及び画像処理方法
JPH0749944A (ja) 画像処理方法およびその装置
JPH1020754A (ja) 画像データ生成方法
CN109379577B (zh) 一种虚拟视点的视频生成方法、装置及设备
KR100464286B1 (ko) 입체 디스플레이 장치 및 그 방법

Legal Events

Date Code Title Description
AS Assignment

Owner name: KWANGWOON UNIVERSITY RESEARCH INSTITUTE FOR INDUST

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, EUN-SOO;HWANG, DONG-CHOON;PARK, JAE-SUNG;AND OTHERS;REEL/FRAME:020335/0095;SIGNING DATES FROM 20071107 TO 20071109

Owner name: KIM, EUN-SOO, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, EUN-SOO;HWANG, DONG-CHOON;PARK, JAE-SUNG;AND OTHERS;REEL/FRAME:020335/0095;SIGNING DATES FROM 20071107 TO 20071109

Owner name: KWANGWOON UNIVERSITY RESEARCH INSTITUTE FOR INDUST

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, EUN-SOO;HWANG, DONG-CHOON;PARK, JAE-SUNG;AND OTHERS;SIGNING DATES FROM 20071107 TO 20071109;REEL/FRAME:020335/0095

Owner name: KIM, EUN-SOO, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, EUN-SOO;HWANG, DONG-CHOON;PARK, JAE-SUNG;AND OTHERS;SIGNING DATES FROM 20071107 TO 20071109;REEL/FRAME:020335/0095

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION