WO2015160208A1 - Dispositif et procédé de compensation de marge d'erreur affichée en 2d - Google Patents

Dispositif et procédé de compensation de marge d'erreur affichée en 2d Download PDF

Info

Publication number
WO2015160208A1
WO2015160208A1 PCT/KR2015/003849 KR2015003849W WO2015160208A1 WO 2015160208 A1 WO2015160208 A1 WO 2015160208A1 KR 2015003849 W KR2015003849 W KR 2015003849W WO 2015160208 A1 WO2015160208 A1 WO 2015160208A1
Authority
WO
WIPO (PCT)
Prior art keywords
error
image
micro lens
panel
pixel
Prior art date
Application number
PCT/KR2015/003849
Other languages
English (en)
Korean (ko)
Inventor
리웨이밍
지오우밍차이
지아오샤오후이
홍타오
왕씨잉
왕하이타오
남동경
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201410157743.XA external-priority patent/CN105025284B/zh
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to US15/303,404 priority Critical patent/US10142616B2/en
Publication of WO2015160208A1 publication Critical patent/WO2015160208A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers

Definitions

  • It relates to a three-dimensional display device, and more particularly to a method and apparatus for correcting a display error for autostereoscopic IID.
  • IID Intelligent Image Display
  • LCD liquid crystal display
  • the actual position of the micro lens array may be out of the design position. Therefore, error correction of the actual position of the micro lens array is required for the high quality IID 3D display.
  • a single camera image acquisition unit for obtaining a first image of the IID image; And an error estimator for estimating the error by optimizing an error model representing an error between a design position of the micro lens array and an actual position of the micro lens array with respect to the micro lens array positioned on one surface of a 2D panel.
  • a display error correction device is provided.
  • the error estimator generates the initial error model with a preset initial error parameter value, and the initial error according to a corresponding position mapped to the two-dimensional panel with respect to any one point of the first image.
  • the error model can be optimized by updating parameter values.
  • the error estimator may be configured such that any point of the first image corresponds to the virtual image plane existing between the single camera and the micro lens array and is positioned on the image plane by the center position of each micro lens and the single camera.
  • a corresponding position determiner for determining a corresponding position to be used;
  • a first mapping position determiner configured to analyze a correspondence relationship between each pixel point of the first image and pixel points of the 2D panel to determine a first mapping position at which the corresponding position is mapped to the 2D panel;
  • a second mapping position determining unit configured to determine a second mapping position at which a connection line between the center position of the single camera and the corresponding position is mapped to the 2D panel;
  • an optimizer configured to optimize the error model according to a position difference between the first mapping position and the second mapping position.
  • Optimizing the error model according to an embodiment may be achieved by updating the error parameter value such that the distance between the first mapping position and the second mapping position is minimal, and at least one of the microlens array For each micro lens, the distance between the first mapping position and the second mapping position is calculated, and when the sum of the calculated distances is the minimum, the initial error parameter may be considered to be optimized.
  • a single camera image acquisition unit for obtaining a first image of the IID image;
  • An error estimating unit for estimating the error by optimizing an error model representing an error between a design position of the micro lens array and an actual position of the micro lens array with respect to the micro lens array positioned on one surface of a two-dimensional panel;
  • a rendering unit configured to render a second image of an EIA (Elemental Image Array) method with respect to the first image according to an error of the micro lens array.
  • the error estimator may be configured such that any point of the first image is located at the center position of each microlens and the single camera with respect to a virtual image plane existing between the single camera and the microlens array.
  • a corresponding position determiner for determining a corresponding position on the plane;
  • a first mapping position determiner configured to analyze a correspondence relationship between each pixel point of the first image and pixel points of the 2D panel to determine a first mapping position at which the corresponding position is mapped to the 2D panel;
  • a second mapping position determining unit configured to determine a second mapping position at which a connection line between the center position of the single camera and the corresponding position is mapped to the 2D panel;
  • an optimizer configured to optimize the error model according to a position difference between the first mapping position and the second mapping position.
  • the optimizer may optimize the error model by updating the error parameter value such that the distance between the first mapping position and the second mapping position is minimized.
  • the rendering unit may render the second image according to the ray model generated based on the actual position of each micro lens calculated according to the error of the micro lens array.
  • the rendering unit may further include: a position expansion unit configured to calculate an actual position of each micro lens based on an error of the micro lens array; A ray model generator for generating a ray model representing a 3D ray corresponding to each pixel of the 2D panel based on an actual position of each micro lens; And an EIA rendering unit that renders a second image of an EIA scheme with respect to a first image by using the ray model.
  • a ray model generator may include: an initialization unit configured to initialize a corresponding relationship between pixels of the 2D panel and each micro lens of the micro lens array; An updating unit for updating the correspondence relationship for each of the microlenses by using a projected point of the first image on the two-dimensional panel; And a direction drawing unit for indicating a direction of a pixel of the two-dimensional panel and a micro lens corresponding to the pixel by using points on two flat planes.
  • the update unit may include: a projection unit configured to obtain a first projection point at which any first observation point belonging to the first image is projected onto the two-dimensional panel through a specific micro lens; A window configuration unit forming a window having a predetermined size around the first projection point in the two-dimensional panel; And a local updating unit for updating a microlens mapped to each pixel of the window, wherein the local updating unit is configured to perform the micro-projection according to the initialized correspondence of the specific microlens that causes the first projection point to be acquired.
  • Confirmation unit for confirming whether the lens; If the particular microlens does not match the initialized correspondence, a second projection point projected on the first image according to the initialized correspondence with respect to the first pixel of the window is obtained, and the first A pixel projection unit obtaining a third projection point projected onto the first image according to the specific microlens with respect to one pixel; And calculating a first distance between the second projection point and the first observation point and a second distance between the third projection point and the first observation point, wherein the first distance is greater than the second distance or
  • it may include a mapping updating unit for updating the micro lens corresponding to the pixel of the two-dimensional panel with respect to the first projection point to the specific micro lens.
  • a display error correction method comprises the steps of: acquiring, by a single camera, a first image of the IID image; Generating an error model representing an error between a design position of the micro lens array and an actual position of the micro lens array with respect to the micro lens array positioned on one surface of the two-dimensional panel; And estimating the error by optimizing the error model.
  • FIG. 1 is a block diagram of an apparatus for compensating a display error according to an exemplary embodiment.
  • FIG. 2 is a detailed block diagram of an error estimating unit of a display error correcting apparatus according to an exemplary embodiment.
  • FIG. 3 is a conceptual diagram illustrating a relationship between a single camera, a 2D panel, and a micro lens array for correcting a display error, according to an exemplary embodiment.
  • FIG. 4 is a block diagram of a display device according to another exemplary embodiment.
  • FIG. 5 is a detailed block diagram of a renderer of a display apparatus, according to another exemplary embodiment.
  • FIG. 6 is a conceptual diagram illustrating a process of rendering by a display apparatus according to another exemplary embodiment.
  • FIG. 7 is a detailed block diagram illustrating a light ray model generator of a display device according to another exemplary embodiment.
  • FIG. 8 is a detailed block diagram illustrating an updater of the light model generator of FIG. 7.
  • FIG. 9 is a flow chart of a display error correction method according to another embodiment.
  • FIG. 10 is a flowchart illustrating a process of calculating a display error, according to another exemplary embodiment.
  • FIG. 11 is a flowchart illustrating a method of rendering by reflecting a display error, according to another exemplary embodiment.
  • FIG. 12 is a flowchart illustrating a method of updating a correspondence relationship of a microphone lens according to another exemplary embodiment.
  • the display error correcting apparatus includes an image obtaining unit 110 and an error estimating unit 120.
  • the image acquisition unit 110 acquires a first image in which a single camera photographs an IID image.
  • An error of a microlens is corrected for an image obtained by capturing an IID image for an autostereoscopic 3D display by one single camera.
  • the microlens array positioned on one surface of the 2D panel may display the autostereoscopic 3D image by refracting the first image in different directions. Code display is performed on the image of the IID image photographed for each pixel position of the two-dimensional panel.
  • the image of the IID image may be a black and white image of a two-dimensional gray code or a sinusoidal fringe type image including a phase shift change.
  • the decoding on the first image may indicate where the pixels on the two-dimensional panel are located on the image plane of the single camera.
  • a motion parameter for the single camera can be obtained.
  • the motion parameters are, for example, rotational parameters and translation parameters. Since the motion parameter may be obtained by various methods known in the art to which the embodiment belongs, the specific method is not described.
  • the error estimator 120 generates an error model representing an error between the design position of the microlens array and the actual position of the microlens array, and optimizes the error model for the microlens array positioned on one surface of the 2D panel. Estimate the error. In detail, a method of estimating a display error will be described with reference to FIGS. 2 and 3 below.
  • FIG. 2 is a detailed block diagram of an error estimator of a display error correction apparatus according to an exemplary embodiment.
  • the error estimator first generates an initial error model using a preset initial error parameter value and is two-dimensional with respect to any one point of the first image.
  • the error model is optimized by updating the initial error parameter values according to the corresponding values mapped to the panel.
  • the error estimator 120 of FIG. 1 includes a corresponding position determiner 121, a first mapping position determiner 122, a second mapping position determiner 123, and an optimizer 124.
  • FIG. 3 is a conceptual diagram illustrating a relationship between a single camera 301, a two-dimensional panel 302, and a micro lens array 303 for correcting a display error, according to an exemplary embodiment.
  • the error may be estimated by calculating the actual position of the microlens array.
  • the corresponding position determiner 121 first calculates the position of the microlens (indicated by L c in FIG. 3) based on the initial error parameter. At this time, the position (L c ) corresponds to the design position of the micro lens. Error parameter ( ) The difference between the actual position of the microlens and the design position, and the error model is a function representing the error of the actual position of the microlens with respect to the design position of the microlens with this error parameter.
  • Equation 1 indicates the actual position of the microlens and may be defined using a design position and an error model of the microlens.
  • Equation 1 [X ij , y ij , z ij ] T in Equation 1 represents three-dimensional coordinates of the actual position of the microlens. Denotes the three-dimensional coordinates of the design position of the microlens,
  • T represents the error between the three-dimensional coordinates of the actual position of the microlens and the three-dimensional coordinates of the design position.
  • the error of the design position and the actual position of the microlens array with respect to the two-dimensional panel can be expressed by the rotation angle ⁇ and the parallel shift vector [tx, ty] in one two-dimensional plane.
  • An error may be defined as shown in Equation 2 based on the center coordinates of each lens in the lens array.
  • Error parameter as shown in equation (2) May be defined including the rotation angle ⁇ and the parallel movement vector [tx, ty].
  • an error change in the Z direction may be defined using a single elliptical radial distortion model as shown in Equation 3 below.
  • Equation 3 [x 0 , y 0 ] represents the position in the horizontal plane of the radial distortion center, [a, b, c, d] represents the parameter of the lens array distortion type.
  • the error parameter Becomes [x 0 , y 0 , a, b, c, d].
  • equations (2) and (3) for the error model are equations for one embodiment. Since the error model can be defined in another way, the error models of the embodiments are not limited to the equations (2) and (3). do.
  • the corresponding position determiner 121 may determine the corresponding position based on the position of the micro lens.
  • the position of the micro lens in one embodiment may be represented by the center coordinates of the micro lens.
  • a point corresponding to an arbitrary point of the first image on the image plane by the center position of each micro lens and the single camera corresponds to the corresponding position (Fig. 3). Is denoted by I c ).
  • the center coordinate O c of the single marchea 301 is determined based on the motion parameter value, and the projected position L c of the microlens 303 is projected onto the virtual image plane of the single camera.
  • the corresponding position I c of the micro lens with respect to the first image ie, position in the image plane
  • the intersection where the connecting line for the microlens position L c and the center position O c of the single camera meets the image plane becomes the corresponding position I c .
  • the first mapping position determiner 122 analyzes the correspondence between each pixel point of the first image and the pixel point of the 2D panel 302 to determine a first mapping position where the corresponding position is mapped to the 2D panel. Analyzing the correspondence can be done by performing decoding on the first image. At this time, the position where the corresponding position I c is mapped on the two-dimensional panel 302 is the first mapping position P SL. It can be represented as. That is, the coordinates of the points displayed on the two-dimensional panel with respect to any point of the first image are determined.
  • the second mapping position determiner 123 determines the position where the connecting line between the center position of the single camera 301 and the corresponding position is mapped to the 2D panel 302 as the second mapping position. In other words, based on the motion parameter and the position L c of the microlens, the coordinate where the corresponding position I c is located in the two-dimensional panel is converted to the second mapping position P p. Represented by
  • the optimizer 124 optimizes the error model according to the position difference between the first mapping position and the second matching position.
  • the position difference between the first mapping position and the second mapping position may be a distance between the two, and the initial error parameter may be optimized using the distance.
  • the distance between the first mapping position and the second mapping position is calculated for each of the micro lenses of at least one micro lens array, and the initial error parameter is optimized when the sum of the calculated distances is minimum.
  • Equation 4 The sum of the distances for each of the micro lenses of the micro lens array may be expressed by Equation 4 below.
  • CC may represent the center position of the micro lens.
  • the microlens may be at least one included in the microlens array, and thus may be regarded as a subset of the microlens array.
  • P p I a second mapping position
  • an error parameter And the position L c of the microlens can be expressed as the center coordinate c of the microlens
  • P SL I the first mapping position
  • E Error parameter by minimizing Can be optimized.
  • a genetic nonlinear optimization algorithm such as genetic algorithm Can get the full optimal solution.
  • the error can be estimated by finally calculating the error value of the microarray according to the optimized error parameter.
  • the actual position of the microlens is calculated by substituting the error value after the optimization into a relative error model (for example, equation (1), (2), or (3)) between the actual position of the microlens and the design position.
  • a display apparatus which renders and shows an image correcting a display error with respect to an image of an image of an IID image.
  • 4 is a block diagram of a display device according to another exemplary embodiment.
  • the display apparatus includes an image acquirer 410, an error estimator 420, and a renderer 430.
  • the image acquirer 410 acquires a first image of a single camera photographing an IID image. By decoding the obtained first image, a correspondence relationship between each pixel point of the first image and the pixel point of the 2D panel may be known.
  • the error estimator 420 optimizes an error model representing an error between the design position of the micro lens array and the actual position of the micro lens array, with respect to the micro lens array positioned on one surface of the two-dimensional panel.
  • the error of can be estimated.
  • the error estimator 420 includes a corresponding position determiner, a first mapping position determiner, a second mapping position determiner, and an optimizer, which may be described in correspondence with each configuration of FIG. 2.
  • the corresponding position determiner is configured to determine a corresponding position on the virtual image plane existing between the single camera and the micro lens array such that an arbitrary point of the first image corresponds to the image plane by the center position of each micro lens and the single camera. You can decide. Referring to Fig. 3, each micro lens position, i.e., a design position here, is referred to.
  • the corresponding position I c on the virtual image plane can be determined by L c and the center position O c of a single camera.
  • the first matching position determiner analyzes a correspondence relationship between each pixel point of the first image and the pixel point of the 2D panel, and thus, the first mapping position where the corresponding position Ic is mapped to the 2D panel.
  • the second mapping position determining unit may determine a position at which the connecting line between the center position Oc and the corresponding position Ic of the single camera is mapped to the two-dimensional panel.
  • the optimizer may optimize the error model according to a position difference between the first mapping position and the second mapping position, that is, the distance.
  • the error model may be optimized by updating an error parameter value such that the distance between the first mapping position and the second mapping position is minimized.
  • the renderer 430 After calculating the error value for the micro lens, the renderer 430 renders the second image of the EIA (Elemental Image Array) method for the first image according to the error of the micro lens array.
  • the second image may be rendered according to the generated ray model based on the actual position of each micro lens calculated according to the error of the micro lens array. Details of the rendering unit 430 rendering the second image will be described in detail with reference to FIGS. 5 and 6.
  • the renderer 430 includes a position determiner 431, a ray model generator 432, and an EIA renderer 433.
  • the positioning unit 431 calculates the actual position of each micro lens based on the error of the micro lens array. For example, the actual position of the micro lens can be calculated based on Equation 1 described above.
  • the ray model generator 432 generates a ray model representing a 3D ray corresponding to each pixel of the 2D panel based on the actual position of each micro lens.
  • the ray model is needed to render an EIA image, which maps each pixel on a two-dimensional panel into a ray in three-dimensional space.
  • EIA image maps each pixel on a two-dimensional panel into a ray in three-dimensional space.
  • the EIA rendering unit 433 renders the second image of the EIA scheme with respect to the first image by using the ray model.
  • FIG. 6 is a conceptual diagram illustrating a process of rendering by a display apparatus according to another exemplary embodiment. In particular, it represents a process of generating a ray model in the rendering process.
  • FIG. 7 is a detailed block diagram illustrating a ray model generator of a display device according to another exemplary embodiment.
  • the ray model generator 432 of FIG. 5 includes an initialization unit 710, an update unit 720, and a direction drawing unit 730.
  • the initialization unit 710 initializes the correspondence relationship between the pixels of the 2D panel and the micro lenses of the micro lens array.
  • the correspondence relationship may be initialized to a preset value. For example, at initialization, each pixel of the 2D panel may be mapped to a predetermined microlens and initialized by displaying a predetermined microlens through an initial display code.
  • the initial marking code should be different from the marking code of each micro lens.
  • the mapping relationship between the pixels of the 2D panel and the microlens may be displayed by the following method. Assuming that the coordinates of one pixel of the two-dimensional panel are (m, n), the mapping for the microlens at each pixel is indicated by: (S (m, n), T (m, n), G (m, n)). S (m, n), T (m, n), and G (m, n) are coordinate values in the x, y, and z axes with respect to the center of the microlens mapped in the pixel, respectively.
  • the updater 720 updates the correspondence for each microlens by using a point of projecting an arbitrary point of the first image on the two-dimensional panel. Updating the correspondence will be described in detail with reference to FIGS. 6 and 8.
  • a two-dimensional panel 601, a micro lens array 602, and a first image (603 or observation plane with a first observation point) are shown.
  • FIG. 8 is a detailed block diagram of the updating unit 720 of the ray model generator of FIG. 7.
  • the updating unit 720 includes a projection unit 721, a window configuration unit 722, and a local updating unit 723, and updates a value of a ray model indicating a correspondence relationship between the two-dimensional panel and the microlens. .
  • the projection unit 721 obtains a first projection point at which any first observation point belonging to the first image is projected onto the two-dimensional panel through a specific micro lens.
  • a specific micro lens Referring to FIG. 6, an arbitrary first viewing point V c belonging to the first image or the viewing plane 603 is connected to a two-dimensional panel (through a specific micro lens H (j) of the micro lens array 602).
  • a first projection point T 1 projected on 601 may be obtained.
  • the window configuration unit 722 forms a window of a predetermined size around the first projection point in the two-dimensional panel.
  • the window may have various shapes, for example, may be circular, spherical, square, rectangular, and the like.
  • a rectangular window W including seven pixels was formed around the first projection point T 1 .
  • the length of the side of the window may be defined as in Equation 5 below.
  • p is the size of the microlens (e.g. the diameter of the microlens)
  • D is the distance from the point of view to the two-dimensional panel
  • s is the physical dimension of the two-dimensional panel pixel (e.g. the length of the sides of the square pixel)
  • g is a distance value between the design position of the microlens array and the two-dimensional panel.
  • the local updater 723 updates the microlens mapped to each pixel in the window by using the window over the 2D pixel.
  • the local updating unit 723 may perform the pixel projection for calculating the second projection point and the third projection point when the local updating unit 723 checks whether the initial correspondence is the same as the confirmation unit 723-1.
  • a mapping updater 723-3 for updating the correspondence relationship using the second projection point and the third projection point.
  • the verification unit 723-1 checks whether the specific microlens for acquiring the first projection point is based on the initialized correspondence. That is, in FIG. 6, the first observation point Vc is projected to the first projection point T1 of the two-dimensional panel through the micro lens H (j). At this time, the verification unit 723-1 determines whether the first projection point T1 and the microlens array H (j) of the pixels of the 2D panel are mapped in the initialized correspondence. When the initial relationship does not match, two projection points are acquired for the first pixel, which is one of the pixels constituting the window. Since the window contains one or more pixels in various forms, the first pixel corresponds to any pixel in the window.
  • the pixel projector 723-2 first observes the first pixel including the first image according to a correspondence initialized with respect to the first pixel, that is, a correspondence initialized with the pixels and the microlens of the 2D panel. Project onto a plane to obtain a second projection point.
  • the first pixel is the first pixel of the window W
  • P 1 is obtained as the second projection point in which the first pixel is projected onto the viewing surface through the microlens H (i) according to the initialized correspondence.
  • the first pixel of the window is projected onto the first image (observation plane) using a specific microlens, i.e., microlens H (j) which causes the first observation point V c to be projected to the first projection point T 1 .
  • P 2 can be obtained as the third projection point.
  • the mapping updater 723-3 may update the correspondence between the microlens and the pixels of the 2D panel using two projection points.
  • the first projection is called the first distance between the second projection point and the first observation point and the second distance between the third projection point and the first observation point
  • the first projection when the first distance is greater than or equal to the second distance
  • the microlenses corresponding to the pixels of the two-dimensional panel for the point are updated with the specific microlenses. In other words, the pixel of the two-dimensional panel corresponding to the first projection point and the corresponding microlens which brought the first observation point to the first projection point are corresponded.
  • the first distance becomes
  • the mapping updater 723-3 may update the correspondence between the 2D panel and the microlens by viewing any one point of the first image as the first observation point in this manner.
  • the direction depicting unit 730 may display the direction of the microlenses corresponding to the pixels of the 2D panel by using points on two parallel planes.
  • the two-dimensional panel and the microlens are parallel to each other and use a point on each of them to generate a ray model that determines the light rays traveling from the two-dimensional panel to the three-dimensional space.
  • the single camera may correct an error due to the micro array with respect to the first image photographing the IID image.
  • a single camera acquires a first image of capturing an IID image (901).
  • an IID image may be taken using a single camera to display an autostereoscopic 3D image.
  • an error model is generated (902) indicating an error between the design position of the microlens array and the actual position of the microlens array.
  • the error model may be defined using the relationship between the actual position of the microlens and the design position as shown in Equation 1, and may be expressed using the error parameter as shown in Equations 2 to 3.
  • the error for the micro lens array is estimated (903) by optimizing the error model.
  • an initial error model is generated with a preset initial error parameter value, and the error model is updated by updating the initial error parameter value according to the corresponding position mapped to the two-dimensional panel for any one point of the first image.
  • Optimize Specifically, the step of optimizing the error model is described in detail in FIG.
  • step 1001 with respect to the virtual image plane existing between the single camera and the micro lens array, an arbitrary point of the first image is determined corresponding position on the image plane by the center position of each micro lens and the single camera. do.
  • the corresponding position may be represented by I c in FIG. 3. That is, the intersection where the straight line connecting the camera center position O c and the position L c of the micro lens array meets the virtual image plane parallel to the single camera becomes the corresponding position I c .
  • the corresponding relationship between each pixel point of the first image and the pixel point of the 2D panel is analyzed to determine a first mapping position where the corresponding position is mapped to the 2D panel.
  • 1st mapping position P SL Is the error parameter
  • the microlens center position c and the corresponding relationship with the pixel point of the 2D panel can be known by decoding the first image.
  • step 1003 the second mapping position at which the connecting line between the center position of the single camera and the corresponding position is mapped to the 2D panel is determined.
  • 2nd mapping position P p Denotes the coordinate where the corresponding position Ic is located in the two-dimensional panel based on the motion parameter and the position L c of the microlens. Error parameter And micro lens center position c is defined.
  • the error model is optimized according to the position difference between the two positions.
  • the initial error parameter is considered to be optimized, and the error model is optimized.
  • the display error correction method may further include rendering a second image of the EIA method with respect to the first image according to an error of the micro lens array.
  • the method of rendering the second image is shown in FIG. 11. 11 is a flowchart illustrating a method of rendering by reflecting a display error, according to another exemplary embodiment.
  • the actual position of each micro lens is calculated based on the error of the micro lens array.
  • the actual position of the microlens may be calculated using Equation 1 for the error of the microlens array, the actual position of the microlens, and the design position.
  • a ray model representing a 3D ray corresponding to each pixel of the 2D panel is generated.
  • the ray model is used to render the EIA imagery and is responsible for mapping each pixel on the 2D panel to a ray in 3D space.
  • the ray model may be generated by initializing the correspondence relationship between each pixel of the two-dimensional panel and the microlens and updating the correspondence based on the point projected on the two-dimensional panel with respect to an arbitrary point on the first image. A detailed method of updating the correspondence will be described in detail with reference to FIG. 12.
  • the second image of the EIA scheme is rendered with respect to the first image using the ray model.
  • Rendering may be performed by various rendering methods, and all methods of rendering an EIA image may be applied.
  • generating a ray model may include initializing a correspondence between pixels of a two-dimensional panel and each micro lens of the micro lens array, and projecting any one point of the first image onto the two-dimensional panel.
  • the correspondence between the pixels of the two-dimensional panel and the microlens is updated using the points.
  • a ray model is generated by indicating the pixels of the two-dimensional panel and the direction of the microlenses corresponding to the pixels.
  • the method of updating the correspondence based on the initialized correspondence value may include obtaining a first projection point at which any first observation point belonging to the first image is projected onto the two-dimensional panel through a specific microlens, After the window having a predetermined size is formed around the first projection point, the microlens mapped to each pixel of the window is updated. In this case, a process of updating the microlens mapped to each pixel of the window will be described with reference to FIG. 12.
  • a specific microlens H (j) that causes the first projection point T 1 to be acquired in step 1201 is a microlens according to an initialized correspondence (for example, T 1 -H (j) ). If it corresponds to the initial value, the correspondence of T 1 -H (j) is appropriate and maps H (j) to the micro lens and ends. On the contrary, if the correspondence does not correspond to the initial value, the projection is performed to obtain two projection points. Referring to FIG. 6, a window W including seven pixels may be formed with respect to the first projection point T 1 in which the first observation point V c is projected on the two-dimensional panel through the specific microlens H (j) .
  • the first observation point V c is located again (first pixel-H (i) ) using the correspondence initialized for any one pixel of the window (first pixel in FIG. 6)
  • the point projected on 1) can be obtained as the second projection point P 1 .
  • the third projection point P 2 is obtained by projecting the first pixel to the observation plane through the specific microlens H (j) which allows the first projection point to be obtained.
  • the second projection point P 1 and the third projection point P 2 are obtained, and then the distance between the projection points and the first observation point is calculated.
  • the first distance indicates the distance between the second projection point P 1 and the first observation point V c
  • the second distance indicates the distance between the third projection point P 2 and the first observation point V c .
  • the first distance is compared with the second distance. If the first distance is less than the second distance (1204-no), it is more appropriate to project through the microlens H (j) , so the microlens for the pixel of the two-dimensional panel where the first projection point T 1 is located is Correspond to H (j) . (In this case, it is not necessary to substantially map because it has already been mapped to the corresponding initialization relationship) on the other hand, the first case the distance is equal to or greater than the second distance (for example, 1204-) microlenses H (i) As it is more appropriate to project through, the microlens for the pixel of the two-dimensional panel in which the first projection point T 1 is located corresponds to H (i) and ends.
  • mapping of each pixel of the two-dimensional panel with the microlenses is completed and a ray model is generated, a second image of the EIA scheme is rendered to the first image using the ray model.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention concerne un dispositif d'affichage 3D sans lunettes, et un dispositif et un procédé qui compensent une marge d'erreur affichée. Le dispositif d'affichage acquiert une image d'une image 2D capturée par une caméra unique, et compense une marge d'erreur due à une divergence entre la position désignée d'un réseau de microlentilles sur une surface d'un panneau 2D et sa position réelle, de sorte à fournir une image 3D de grande qualité.
PCT/KR2015/003849 2014-04-18 2015-04-16 Dispositif et procédé de compensation de marge d'erreur affichée en 2d WO2015160208A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/303,404 US10142616B2 (en) 2014-04-18 2015-04-16 Device and method that compensate for displayed margin of error in IID

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201410157743.XA CN105025284B (zh) 2014-04-18 2014-04-18 标定集成成像显示设备的显示误差的方法和设备
CN201410157743.X 2014-04-18
KR1020150052393A KR102276456B1 (ko) 2014-04-18 2015-04-14 Iid에서 디스플레이 오차를 보정하는 장치 및 방법
KR10-2015-0052393 2015-04-14

Publications (1)

Publication Number Publication Date
WO2015160208A1 true WO2015160208A1 (fr) 2015-10-22

Family

ID=54324322

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/003849 WO2015160208A1 (fr) 2014-04-18 2015-04-16 Dispositif et procédé de compensation de marge d'erreur affichée en 2d

Country Status (1)

Country Link
WO (1) WO2015160208A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110262048A (zh) * 2017-05-18 2019-09-20 中国人民解放军装甲兵工程学院 集成成像光场显示系统透镜阵列的校准方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010026891A (ko) * 1999-09-09 2001-04-06 구자홍 3차원 영상 디스플레이 시스템
KR20070112081A (ko) * 2007-07-18 2007-11-22 한국과학기술원 3차원 모니터에서 영상왜곡을 보상하는 방법
KR20100076222A (ko) * 2008-12-26 2010-07-06 주식회사 동부하이텍 이미지 센서에서 마이크로 렌즈의 위치 변경 장치 및 방법
JP2012084105A (ja) * 2010-10-15 2012-04-26 Nippon Hoso Kyokai <Nhk> 立体像生成装置およびそのプログラム
KR20120140665A (ko) * 2010-09-23 2012-12-31 돌비 레버러토리즈 라이쎈싱 코오포레이션 카메라 디바이스에 의해 결정된 피드백을 이용한 ３ｄ 디스플레이 교정을 위한 방법 및 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010026891A (ko) * 1999-09-09 2001-04-06 구자홍 3차원 영상 디스플레이 시스템
KR20070112081A (ko) * 2007-07-18 2007-11-22 한국과학기술원 3차원 모니터에서 영상왜곡을 보상하는 방법
KR20100076222A (ko) * 2008-12-26 2010-07-06 주식회사 동부하이텍 이미지 센서에서 마이크로 렌즈의 위치 변경 장치 및 방법
KR20120140665A (ko) * 2010-09-23 2012-12-31 돌비 레버러토리즈 라이쎈싱 코오포레이션 카메라 디바이스에 의해 결정된 피드백을 이용한 ３ｄ 디스플레이 교정을 위한 방법 및 시스템
JP2012084105A (ja) * 2010-10-15 2012-04-26 Nippon Hoso Kyokai <Nhk> 立体像生成装置およびそのプログラム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110262048A (zh) * 2017-05-18 2019-09-20 中国人民解放军装甲兵工程学院 集成成像光场显示系统透镜阵列的校准方法
CN110262048B (zh) * 2017-05-18 2021-03-23 中国人民解放军装甲兵工程学院 集成成像光场显示系统透镜阵列的校准方法

Similar Documents

Publication Publication Date Title
JP6576945B2 (ja) 較正装置、較正方法、光学装置、撮影装置、投影装置、計測システムおよび計測方法
CN101755190B (zh) 校准方法、校准装置及具备该校准装置的校准系统
KR102276456B1 (ko) Iid에서 디스플레이 오차를 보정하는 장치 및 방법
CN104155765B (zh) 在拼接式集成成像显示器中校正三维图像的方法和设备
JP4435145B2 (ja) 幾何情報を校正してパノラマ映像を提供する方法および装置
JP5999615B2 (ja) カメラ較正情報生成装置、カメラ較正情報生成方法およびカメラ較正情報生成プログラム
WO2012161431A2 (fr) Procédé de génération d&#39;une image d&#39;une vue autour d&#39;un véhicule
WO2005084017A1 (fr) Système multiprojection
CN111311682A (zh) 一种led屏校正过程中的位姿估计方法、装置及电子设备
WO2018110774A1 (fr) Procédé de correction automatique d&#39;une zone de projection basée sur une image photographiée par un dispositif de photographie, et système associé
CN114125411B (zh) 投影设备校正方法、装置、存储介质以及投影设备
CN113129451B (zh) 基于双目视觉定位的全息三维影像空间定量投影方法
JP2019020778A (ja) 情報処理装置、情報処理方法
WO2015056826A1 (fr) Appareil et procédé de traitement des images d&#39;un appareil de prise de vues
WO2022166868A1 (fr) Procédé, appareil et dispositif de génération de vue de visite, et support de stockage
CN111131801A (zh) 投影仪校正系统、方法及投影仪
CN110035273B (zh) 一种畸变校正方法、装置及使用其的显示设备
WO2015160208A1 (fr) Dispositif et procédé de compensation de marge d&#39;erreur affichée en 2d
WO2019155903A1 (fr) Dispositif et procédé de traitement d&#39;informations
JP4199641B2 (ja) プロジェクタ装置
JP4006657B2 (ja) 画像処理装置および画像処理方法
JP2010273091A (ja) 広域多視点カメラ校正方法、広域多視点カメラ校正装置、およびプログラム
WO2019004565A1 (fr) Procédé d&#39;étalonnage servant à ajuster un objet de réalité augmentée, et visiocasque permettant de mettre en œuvre ce procédé
Bushnevskiy et al. Multimode camera calibration
WO2021182793A1 (fr) Procédé et appareil d&#39;étalonnage de différents types de capteurs à l&#39;aide d&#39;un damier unique

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15779802

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15303404

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15779802

Country of ref document: EP

Kind code of ref document: A1