CN103348360A - Morphological anti-aliasing (MLAA) of re-projection of two-dimensional image - Google Patents

Morphological anti-aliasing (MLAA) of re-projection of two-dimensional image Download PDF

Info

Publication number
CN103348360A
CN103348360A CN201180063813XA CN201180063813A CN103348360A CN 103348360 A CN103348360 A CN 103348360A CN 201180063813X A CN201180063813X A CN 201180063813XA CN 201180063813 A CN201180063813 A CN 201180063813A CN 103348360 A CN103348360 A CN 103348360A
Authority
CN
China
Prior art keywords
pixel
projection
mixed
image
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201180063813XA
Other languages
Chinese (zh)
Other versions
CN103348360B (en
Inventor
B.M.吉诺瓦
T.伯戈霍夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment LLC
Original Assignee
Sony Computer Entertainment America LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US12/986,814 external-priority patent/US9041774B2/en
Priority claimed from US12/986,854 external-priority patent/US8619094B2/en
Priority claimed from US12/986,827 external-priority patent/US8514225B2/en
Priority claimed from US12/986,872 external-priority patent/US9183670B2/en
Application filed by Sony Computer Entertainment America LLC filed Critical Sony Computer Entertainment America LLC
Publication of CN103348360A publication Critical patent/CN103348360A/en
Application granted granted Critical
Publication of CN103348360B publication Critical patent/CN103348360B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • G06T15/20Perspective computation
    • G06T15/205Image-based rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/128Adjusting depth or disparity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178Metadata, e.g. disparity information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N2013/40Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene
    • H04N2013/405Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene the images being stereoscopic or three dimensional

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Computing Systems (AREA)
  • Library & Information Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Morphological anti-aliasing (MLAA) of a re-projection of a two-dimensional image can be implemented in a way that produces a better result while using fewer processor resources. One or more discontinuities between each neighboring pixel of the two-dimensional image are determined. One or more pre-defined patterns formed by the one or more discontinuities are identified. A blend amount is calculated for each pixel neighboring the identified pre-defined patterns. A re-projection is applied to the two-dimensional image and to the blend amount for each pixel thereby generating re-projected blend amounts. The neighboring pixels of the re-projection are then blended according to the re-projected blend amounts.

Description

The morphology anti aliasing (MLAA) of the projection again of two dimensional image
The cross reference of related application
The name that the application relates on January 7th, 2011 and submits to is called commonly assigned, the co-pending application number 12/986,814 (attorney docket SCEA10052US00) of " DYNAMIC ADJUSTMENT OF PREDETERMINED THREE-DIMENSIONAL RE-PROJECTION SETTINGS BASED ON SCENE CONTENT ".
The name that the application relates on January 7th, 2011 and submits to is called commonly assigned, the co-pending application number 12/986,827 (attorney docket SCEA10053US00) of " SCALING PIXEL DEPTH VALUES OF USER-CONTROLLED VIRTUAL OBJECT IN THREE-DIMENSIONAL SCENE ".
The name that the application relates on January 7th, 2011 is called commonly assigned, the co-pending application number 12/986,872 (attorney docket SCEA10055US00) of " MULTI-SAMPLE RESOLVING OF RE-PROJECTION OF TWO-DIMENSIONAL IMAGE ".
Background of invention
In the past few years, come to have become quite popular with the ability of sensed in three dimensions two dimensional image by many different technology.Provide a degree of depth aspect just may go out the stronger sense of reality for any scene creation of describing to two dimensional image.This introducing of 3D vision performance has strengthened spectators' experience, the especially experience in the video-game boundary widely.
The technology that has many three-dimensional renderings for given image.Recently, proposed a kind ofly for the technology that one or more two dimensional images is projected to three dimensions, described technology is called as play up (DIBR) based on depth image.With the key concept that usually depends on " solid " video (namely, to the video flowing-of two separation be used for left eye and one be used for right eye-collection, transmission and demonstration) former motion compare, this new idea is based on single as video (that is single video flowing) and the joint transmission more flexibly of pursuing pixel depth information that is associated.According to this data performance, can generate one or more " virtual " view of 3-D scene then by so-called DIBR technology in real time at receiver side.This new way that 3-D view is played up is brought the some advantages that surpass previous approach.
Generally exist dual mode to present two independent images in order to create the illusion of the degree of depth to spectators.In the system that is generally used for 3D rendering projected on the screen, there are two independent synchronization projectors that are used for left-eye image and eye image.The image that is used for eyes is projected to screen simultaneously, but has adopted orthogonal polarization, for example horizontal polarization of the vertical polarization of left-eye image and eye image.The secondary special polarization 3D of viewers wear one watches glasses, and described glasses have at the suitable eyeglass of polarization (for example, at the vertical polarization of left eye with at the horizontal polarization of right eye) of left eye and right eye.Since the polarization of image and eyeglass, spectators' only perception left-eye image of left eye and only perception eye image of right eye.The degree of the illusion of the degree of depth partly changes with the skew between two images on the screen.
In the 3D video system, left-eye image and eye image show by the video display screen curtain, but described demonstration is not fully simultaneously.On the contrary, left-eye image and eye image show with a kind of over-over mode.Viewers wear one secondary active shutter glasses, when showing eye image, described active shutter glasses blocks left eye, and vice versa.
The experience of 3-D video may be depended on the uniqueness of people's vision to a certain extent.For example, human eye has the light receptor of some, but the people can not distinguish any pixel, even the pixel in the peripheral vision.More amazingly being, the quantity of the sense look cone cell in the human retina can be significantly different between individuality-the factor up to 40.However, people are seemingly so that same mode perceived color-we are the brain that utilizes us basically.The human visual system also has the ability (vision hyperresolution) of finding out the alignment of object with the part of cone cell width.This has explained that space aliasing pseudomorphism (that is vision disorder) is than the significant more reason of color error.
Recognize this fact, graphic hardware supplier is placed on great effort by getting space continuity in return with the color accuracy and compensates on the aliasing pseudomorphism.Based on weighting color sample is mixed, be similar to the integration character of Digital Video, multiple technologies obtain the support of hardware.
Certainly, along with the raising of monitor resolution and sampling rate, any aliasing pseudomorphism finally will disappear.By calculating a plurality of samples and the averaged of each pixel, also may under low resolution, handle the aliasing pseudomorphism.However, play up algorithm (for example, ray tracing, playing up based on rasterisation) for most image, this may not be very practical, it has reduced overall performance significantly when calculating the color sample that finally is rejected via averaging.
Morphology anti aliasing (MLAA) is a kind of based on the technology to the identification of some pattern in the image.In case find these patterns, the color that just can around these patterns, be mixed, purpose is to obtain the most possible posterior estimation of given image.MLAA has one group of unique property that itself and other antialiasing algorithm is distinguished.MLAA is totally independent of rendering pipeline.It represents single post-processing kernels, even main algorithm moves at CPU, described single post-processing kernels also can be implemented at GPU.Even in the implementation that is not optimized, MLAA is still quickish, its per second on single 3GHz core is handled about 20M pixel.
MLAA is a kind of anti aliasing technology of having established for two dimensional image.Yet, to three-dimensional again the projection identical MLAA technology that carry out to be used for two dimensional image brought the other problem that must solve.
Embodiment of the present invention produce under this situation.
The accompanying drawing summary
Fig. 1 illustrates according to the three-dimensional that is used for two dimensional image of embodiment of the present invention process flow diagram of the method for the morphology anti aliasing (MLAA) of projection again.
Fig. 2 illustrates according to the three-dimensional that is used for two dimensional image of embodiment of the present invention block scheme of the equipment of the morphology anti aliasing of projection again.
Fig. 3 illustrates according to the three-dimensional that is used for two dimensional image of embodiment of the present invention block scheme of the embodiment of the Cell processor implementation of the equipment of the morphology anti aliasing of projection again.
Fig. 4 illustrates having for the three-dimensional of the implementing two dimensional image embodiment of the non-instantaneity computer-readable recording medium of the instruction of the morphology anti aliasing of projection again according to embodiment of the present invention.
The description of specific embodiments
Introduce
Aliasing refers to by show the generation of the caused vision distortion pseudomorphism of high-definition picture (that is the jagged edge between the neighbor) with low resolution.The morphology anti aliasing is that a kind of being mixed appears at the process of those jagged edges between the pixel uncontinuity in the given image, and it is to produce the more level and smooth gained image of outward appearance for spectators.Usually, the morphology anti aliasing process that is used for two dimensional image divides following three phases to take place: 1) find the uncontinuity between the given image pixel; 2) identify the predefine pattern that is produced by those uncontinuities; And 3) near those predefine patterns, be mixed color to produce more level and smooth image.
Yet the morphology anti aliasing that is used for the projection again of two dimensional image has caused another group problem, and these problems do not occur during the anti aliasing of two dimensional image.For being projected to the dimension of 2 in three-dimensional image again, must present two independent video images (image of every eyes) to spectators, so that the layout of described image causes the illusion of the degree of depth.The feasible technology that is difficult to use for two-dimentional morphology anti aliasing of the degree of depth dimension of this increase.
Be used for relating in first kind of possible solution of three-dimensional example anti aliasing: after each two dimensional image is projected in each viewpoint again, at described two dimensional image operation morphology anti aliasing.Therefore, under the situation that is projected to left eye and right eye again, at will with three dimensional constitution again each two dimensional image of projection will finish determining of twice pair of pixel uncontinuity and be mixed.Though this solution can be provided for the three-dimensional accurate rules of the morphology anti aliasing of projection more in theory, in fact, the enforcement of described solution is very expensive.In addition, at will with three dimensional constitution again each two dimensional image operation in the projection once above morphology anti aliasing will reduce the performance of some 3D video applications (for example, concerning video-game or video game system processor) significantly.In addition, can detect different edges between different images, the another eyes are still seen the edge of aliasing so eye can be seen the edge that is mixed.This is a kind of form of alteration,figural (retinal rivalry), and it reduces the confidence level of total stereoeffect and the 3D rendering of institute's perception is increased certain uncomfortable property.
The second kind of solution that is used for learning at the three-dimensional example anti aliasing relates to: in three-dimensional again before the projection, to morphology anti aliasing of each two dimensional image operation.Though this provides cost effective solution really, it also to three-dimensional again projection increased the halation pseudomorphism.Being mixed before projection again to cause foreground pixel and background pixel to be mixed.During projection again, foreground pixel will the displacement amount different with background pixel.This can stay leak once in a while between these pixels.The halation pseudomorphism refers to the color of the element in the scene or the opposite side that geological information appears at described leak.It is difficult during the morphology anti aliasing depth value being assigned to the two dimensional image pixel that has been mixed, because single value can not be represented the both sides of described leak.Single value can split into described leak two leaks, thereby reduces the leak size, but does not in fact deal with problems.Because there are not the enough methods for the pixel depth value of the two dimensional image of determining to be mixed, so when completion morphology was learned anti aliasing before the projection again in three-dimensional, these halation pseudomorphisms became the problem of existence repeatedly.
Embodiment of the present invention are utilized different approach.Replacement is being mixed before the projection again, is calculating the amount of being mixed before the projection again, but whether before the projection described being mixed is being applied to pixel again.Replace, with projection application again in the amount of calculating of being mixed to produce the projection amount of being mixed again.After projection again, with these again the projection amount of being mixed be applied to again related pixel in the projected image.Clear and definite, can determine the uncontinuity between each neighbor of two dimensional image.Can identify by the formed predefine pattern of described one or more uncontinuities, and can calculate the amount of being mixed of each pixel adjacent with described predefine pattern.Then can with three-dimensional again projection application in the amount of being mixed of two dimensional image and its correspondence.Then can with gained again the projection amount of being mixed be applied to the three-dimensional neighbor of projection again.This technology is favourable, is the lower and better result of the generation more harsh approach of ratio of computation-intensive because it is compared with the arbitrary solution in the aforementioned solution.
Embodiment
Fig. 1 is the process flow diagram that illustrates for the method for the morphology anti aliasing (MLAA) of the projection again of two dimensional image.Method 100 of the present invention reduces and the cost that is associated at the MLAA more than the given image operation once, also reduces the incidence of the halation pseudomorphism/aliasing that is associated with pre-projection MLAA more simultaneously.Method 100 is handled MLAA and is divided into two visibly different stages: one is being moved before the projection again, and an operation after projection has taken place again.
Method 100 can be applied to the projection again for two-dimentional left-eye image and the eye image of three dimensional display.The character that depends on employed disposal system, left-eye image and eye image can be continuously or are side by side experienced MLAA and projection again.Image 101 can be generated based on the data that are used for virtual environment by computer graphics program.Virtual environment, for example video game environment can generate according to the data of the physical characteristics (for example, size, position, texture, daylighting etc.) of representing the object in the described virtual environment.The view of environment can generate according to the definite viewpoint that is called as virtual camera position sometimes.If described viewpoint is known, can calculate the visual field so.The visual field can be considered to be 3D shape, for example circular cone, pyramid or frustum pyramid.Graphics software can determine that virtual objects is whether in described 3D shape.If, this class object is just in the visual field and can be part from the image of corresponding viewpoint so.Can be from the virtual objects of image eliminating in outside, the described visual field.Should note: relative to each other two independent viewpoints and the corresponding visual field of skew can be watched for generating left-eye image and the eye image 3D for virtual world a little.
At first, before given two dimensional image 101 can be used as level and smooth three-dimensional projection presents to audience again, described two dimensional image had experienced a series for the treatment of step.At first study two dimensional image 101 in great detail to determine pixel uncontinuity 103.At first can be vertically and flatly study given image then in great detail, or vice versa.When those pixels had inconsistent characteristic, the pixel uncontinuity just appeared between the neighbor (for example, vertical adjacent pixels and horizontal neighbor the two).For example and not with ways to restrain, these characteristics can comprise the color that is associated with given pixel or set for how much.Be important to note that: uncontinuity may be defined as any amount of different qualities that comprises between the pixel.
In case determine the pixel uncontinuity of given two dimensional image, just can identify by the formed predefine pattern 105 of these pixel uncontinuities.For example and not with ways to restrain, the uncontinuity between two pixels can be identified by the straight line of separating described two pixels.The feature of each pixel can be for reaching 4 different uncontinuities (that is, top, bottom, left side and right side).Pixel uncontinuity (located adjacent one another and quadrature the two) can form the predefine pattern that characterizes the variation between the pixel in the two dimensional image.For example and not with ways to restrain, these pre-identification icons can comprise L shaped, U-shaped and Z-shaped.L shaped pattern is to form when the positive interlinkage of the chain of one or more pixel uncontinuities and one or more pixel uncontinuities intersects.The U-shaped pattern is that chain one or more pixel uncontinuities forms when intersecting with the positive interlinkage of two one or more pixel uncontinuities on opposition side, and every positive interlinkage has equal length and towards equidirectional.Zigzag pattern is to form when the chain of one or more pixel uncontinuities is crossing with the positive interlinkage of two one or more pixel uncontinuities on opposition side, and every positive interlinkage is towards reverse direction.These predefine patterns are provided for the blueprint of the calculating pixel amount of being mixed.
At the identification of given two dimensional image by the pixel uncontinuity after the formed predefine pattern, can calculate the amount of being mixed with the pattern adjacent pixels of identifying, as indicating in 107 places.Depend on around the layout of the neighbor of predefine pattern, can select the different amounts of being mixed for each individual pixel.The amount of being mixed refers to be used for making the level and smooth weighting color/geometry setting value of conversion between the discontinuous pixel at given pixel.For example and not with ways to restrain, compare with a pixel from the nearer pixel of predefine pattern and can stand relatively large being mixed.The amount of being mixed that can be used for determining each pixel of image based on the various formula of the predefine pattern of identifying.This step is through with three-dimensional phase one of the morphology anti aliasing of projection again of two dimensional image.
After the determining of the amount of being mixed, still before being mixed of pixel, carry out projection again, as indicating in 109 places.Projection relates to one or more two dimensional images is mapped in the three dimensions again.The different views of same image is presented to every eyes, thereby creates the illusion of the degree of depth.In general, during projection again, each pixel of two dimensional image is assigned a color scheme and a depth value.Handle these at each view (that is, left-eye view, right-eye view) then and be worth to create three-dimensional projection again.In the method for the invention, be assigned to each pixel corresponding to the out of Memory of the amount of being mixed, and described information pointer is converted into suitable value (that is the projection again of the amount of being mixed of each pixel) to each view.Therefore, projection application again can be generated the amount of being mixed of projection again of each pixel in one or more projected images again and the described image in one or more two dimensional images and the amount of being mixed that is applied to each pixel.
After the projection again of image and the amount of being mixed, the projection amount of being mixed is applied to projection again (for example, three-dimensional each two dimension view of projection again) again, as in the indication of 111 places, so that the generation output image.According to the neighbor of described projected image again that is mixed of the projection amount of being mixed again, thereby produce one or more output images.Should note: comprise that at one or more two dimensional images 101 output image is corresponding to projection left-eye image again and the eye image of described scene under the situation of the left-eye view of scene and right-eye view.Described output image can be presented on the display, as indicating in 113 places.Should note: under the situation of 3 D stereo left-eye image and eye image, depend on the character of display, can be continuously or side by side show described image.For example, under the situation of the 3D television indicator that uses with active shutter glasses, can show left-eye image and eye image continuously.Alternatively, under the situation of the dual-projection escope of watching glasses (it has left eyeglass lens and right eye eyeglass painted or polarization by different way by different way) to use with passive 3D, can side by side show left-eye image and eye image.
Although determining the amount of being mixed before the projection again, the desired image edge does not change during projecting to three-dimensional again from two dimension significantly.Therefore, can under the situation without undergoing any consequence that is associated with above-described two kinds of possible solutions, produce smoothed image.
Fig. 2 illustrates the three-dimensional block scheme of the computer equipment of the method for the morphology anti aliasing (MLAA) of projection again that can be used for to implement be used for two dimensional image.Equipment 200 generally can comprise processor module 201 and storer 205.Processor module 201 can comprise one or more processor cores.The embodiment that uses the disposal system of a plurality of processor modules is Cell processor, and embodiment is described in detail in the 1.0th edition of on August 8th, 2005 for example Cell Broadband Engine ArchitectureIn, incorporate it into this paper with way of reference.The copy of this list of references can obtain with following URL online: http://www.ief.u-psud.fr/~lacas/ComputerArchitecture/CBE_Architecture_v10.pdf.
Storer 205 can be the form of integrated circuit, for example RAM, DRAM, ROM etc.Storer 205 can also be can be by the primary memory of all processor die block access.In some embodiments, processor module 201 can have the local storage that is associated with each core.Program 203 can be stored in the primary memory 205 in the form of the processor instructions that described processor module is carried out.Program 203 can be configured to carry out the morphology anti aliasing (MLAA) of the tripleplane of two dimensional image.Can any suitable processor readable language (for example, C, C++, JAVA, Assembly, MATLAB, FORTRAN) and many other Languages come coding 203.Input data 207 also can be stored in the storer.These class input data 207 can comprise about the neighbor uncontinuity, to the identification of predefine pattern and the information of the pixel amount of being mixed.In the implementation of program 203, the part of program code and/or data can be loaded in the local storage of storer or processor core, to be used for by a plurality of processor core parallel processings.
Equipment 200 can also comprise well-known support function 209, as I/O (I/O) element 211, power supply (P/S) 213, clock (CLK) 215 and high-speed cache 217.Equipment 200 can randomly comprise high-capacity storage 219, as disc driver, CD-ROM drive, tape drive or analog with storage program and/or data.Device 200 can comprise randomly that display unit 221 and user interface section 225 are to promote mutual between described equipment and the user.For example and not with ways to restrain, display unit 221 can be the form of the ready televisor of 3-D, it is shown as text, numeral, graphical symbol or other visual object will be watched the stereo-picture of glasses 227 perception by a pair of 3-D, and it can be the shutter glasses that is attached to I/O element 211 that described 3-D watches glasses.Alternatively, display unit 221 can comprise side by side left-eye image and eye image are projected in 3-D projector on the screen.In this case, 3-D watch glasses can be have by different way painted or by different way the polarization left eyeglass lens and the passive glasses of right eye eyeglass.Stereo refers to the amplification by plastic in the two dimensional image of slightly different image being presented to every eyes.User interface 225 can comprise keyboard, mouse, rocking bar, light pen, or other device that can be used in combination with graphical user interface (GUI).Equipment 200 can also comprise that network interface 223 communicates through network (as the internet) and other device to allow described device.
The parts of system 200 comprise that processor 201, storer 205, support function 209, high-capacity storage 219, user interface 225, network interface 223 and display 221 can operationally be connected to each other via one or more data buss 229.These parts can be embodied in hardware, software or firmware or these parts in two or more some combinations.
Exist many other modes to make the parallel processing streaming (streamline) of using a plurality of processors in the described equipment.For instance, for example by at two or more processor cores replicating code and make each processor core implement described code to handle the different pieces of information piece in the heart, might " untie " treatment loop.This implementation can be avoided and set the stand-by period that described loop is associated.When the invention that is applied to us, a plurality of processors can determine concurrently between the pixel of given image uncontinuity (for example, processor implementation level by and another processor carry out vertical by).Processing time of the ability saves valuable of deal with data concurrently, thus obtain for the three-dimensional of the two dimensional image system of the more effective and streaming of the morphology anti aliasing of projection again.
Except the embodiment that can implement the disposal system of parallel processings at three or more processors be Cell processor.Existence can be classified as the many different processor architecture of Cell processor.For example and not with ways to restrain, Fig. 3 illustrates one type Cell processor.Cell processor 300 comprises primary memory 301, single supply processor elements (PPE) 307, and eight coprocessor elements (SPE) 311.Alternatively, described Cell processor can be configured with any amount of SPE.With reference to Fig. 3, storer 301, PPE307 and SPE311 can communicate with one another and communicate by letter with I/O device 315 through ring-type element interconnect bus 317.Storer 301 contains the input data 303 with feature identical with above-described program.Among the SPE311 at least one can comprise two dimensional image in its local storage (LS) three-dimensional is the instruction 313 of the morphology anti aliasing of projection and/or the part that pending parallel processing is arranged of input data again, for example, and as described above.PPE307 can comprise the three-dimensional instruction 309 of the morphology anti aliasing of projection again of two dimensional image in its L1 high-speed cache, described instruction has the feature identical with above-described program.Instruction 305 and data 303 can also be stored in the storer 301 to be used for when needed by SPE311 and PPE307 access.It should be noted that: the related any amount of process of the method for the morphology anti aliasing of projection is parallel again to use three-dimensional that Cell processor can make two dimensional image of the present invention.MLAA has great parallelization potentiality, and can be used for realizing better load balance by the final output image of processing in idle thread (finish the thread played up or they are finished the thread of structure in the part of accelerating structure) on the multinuclear scheming device.
For instance, PPE307 can be 64 the PowerPC processor units (PPU) with the high-speed cache that is associated.PPE307 can comprise optional vector multimedia extension unit.Each SPE311 comprises coprocessor unit (SPU) and local storage (LS).In some implementations, local storage can have for example memory span of about 256 kilobyte for program and data.SPU is the uncomplicated computing unit of comparing with PPU, because described SPU does not carry out system management function usually.SPU can have single instruction multiple data (SIMD) ability and common deal with data and initiate any needed data and transmit (being limited by the access character that is set by PPE), in order to carry out the task that they obtain distribution.SPU permission system implements to need the application program of higher computing unit density and the instruction set that provides can be provided effectively.A large amount of SPU in the system that is managed by PPE allow to carry out cost through the application program of broad range and effectively handle.For instance, the feature of Cell processor can be for being called as the architecture of unit bandwidth engine architecture (CBEA).In the compatible architecture of CBEA, a plurality of PPE can be combined into a PPE group, and a plurality of SPE can be combined into a SPE group.For the purpose of embodiment, Cell processor is depicted as has the single SPE group that has single SPE and the single PPE group that has single PPE.Alternatively, Cell processor can comprise many group power programmer elements (PPE group) and many group coprocessor elements (SPE group).The CBEA compatible processor for example is described in detail in Cell Broadband Engine ArchitectureIn, it can be online with https: //www-306.ibm.com/chips/techlib/techlib.nsf/techdocs/1AEEE 1270EA277638725706000E61BA/$file/CBEA_01_pub.pdf obtains, and incorporates it into this paper with way of reference.
According to another embodiment, the three-dimensional that the is used for two dimensional image instruction of the morphology anti aliasing of projection again can be stored in computer-readable recording medium.For example and not with ways to restrain, Fig. 4 illustrates the embodiment according to the non-instantaneity computer-readable recording medium 400 of embodiment of the present invention.Storage medium 400 contain with a kind of can be by the computer-readable instruction of the form of computer processor unit retrieval, decipher and execution storage.For example and not with ways to restrain, computer-readable recording medium can be computer-readable memory, as random-access memory (ram) or ROM (read-only memory) (ROM), (for example be used for fixed disk drive, hard disk drive) computer-readable memory disk, or removable disk drive.In addition, computer-readable recording medium 400 can be flash memory device, computer-readable tape, CD-ROM, DVD-ROM, Blu-ray Disc, HD-DVD, UMD, or other optical storage medium.
Storage medium 400 contains the three-dimensional instruction 401 of the morphology anti aliasing of projection again that is useful on two dimensional image.The three-dimensional that the is used for two dimensional image instruction 401 of the morphology anti aliasing of projection again can be configured to learn anti aliasing according to above about the described method example of Fig. 1.Specifically, morphology anti aliasing instruction 401 can comprise the instruction 403 of determining adjacent uncontinuity, and described instruction is used for the uncontinuity between definite given image neighbor.Can divide two stages to finish determining of uncontinuity.The vertical uncontinuity between the adjacent vertical pixel can be in a stage, determined and horizontal uncontinuity between the adjacent level pixel can be in another stage, determined.Alternatively, can determine described vertical uncontinuity and horizontal uncontinuity simultaneously.When having any amount of other difference in the difference that has how much setting values between the difference that has the color setting value between two neighbors, two neighbors or the given image between the neighbor, uncontinuity may appear.
Morphology anti aliasing instruction 401 can also comprise the instruction 405 of identification predefine pattern, and described instruction identification is by the formed one or more predefine patterns of the uncontinuity between the pixel.These predefine patterns can comprise U-shaped pattern, zigzag pattern and L shaped pattern as discussed above.
Morphology anti aliasing instruction 401 may further include the instruction 407 of calculating the amount of being mixed, and described instruction is configured to calculate and the amount of being mixed by the formed predefine pattern of uncontinuity adjacent pixels.The amount of being mixed refers to be used for making the level and smooth weighting color/geometry setting value of conversion between the discontinuous pixel at given pixel.For example, the black picture element adjacent with white pixel can produce the amount of being mixed that described black picture element (and perhaps being other neighbor) is transformed into gray pixels, so that by spectators' perception the time, weakens by the caused jagged edge sense of uncontinuity.
Morphology anti aliasing instruction 401 can comprise the applying three-dimensional instruction 409 of projection again, described instruction again projection application in the amount of being mixed of two dimensional image and its correspondence the two.With will the amount of being mixed before projection again to be applied to two dimensional image different, these instructions are that the described amount of being mixed is carried out three-dimensional projection again (that is, the three-dimensional that the described amount of being mixed is transformed into their correspondences is projection value again), can take place in back one step so that be mixed.
Morphology anti aliasing instruction 401 can comprise the three-dimensional instruction 411 of projection again that is mixed in addition, the projection value of the being mixed three-dimensional projection again of two dimensional image that is mixed again of described instruction basis, thus produce one or more output images.
Morphology anti aliasing instruction 401 can comprise idsplay order 413 in addition, and described instruction makes described output image format to be used for being presented on display.
Embodiment of the present invention allow to realize in one way MLAA, and described mode can produce better MLAA result for comparing with conventional route, reduce the amount of the work that need be finished by the processor of implementing described MLAA simultaneously.
Wherein use passive or active 3D to watch glasses to watch the embodiment of the implementation of three-dimensional 3D rendering although described, embodiment of the present invention are not limited to this class implementation.Clear and definite, embodiment of the present invention go for not relying on the three-dimensional 3D video technique that the passive or active 3D of head tracking watches glasses.The embodiment of the three-dimensional 3D video technique that this class " is exempted from wear a pair of spectacles " is called automatic stereo technology or free stereo sometimes.The embodiment of this class technology includes but not limited to the technology based on the use of lenticular lens.Lenticular lens is the array of magnifier, and it is designed to make when watching from slightly different angle, amplifies different images.Can select different images so that three-dimensional viewing effect to be provided when watching lenticulated screen with different angles.The quantity of the image that generates with the number of views of described screen increase pro rata-learn anti aliasing for example in this type systematic, employed image is more many in this system, it is more useful that embodiment of the present invention can become.
Clearer and more definite, in the lenticular lens video system, can generate the projected image again from slightly different viewing angle of scene according to the depth information of each pixel in original 2D image and the described image.Use shadow casting technique again, can according to described original 2D image and depth information generate described scene from the different views of different viewing angles progressively.The image of expression different views can be divided into band and be presented on the automatic stereoscopic display device with staggered pattern, and described automatic stereoscopic display device has the indicator screen between lenticular lens array and viewing location.The eyeglass that constitutes described lenticular lens can be to align with described band and generally be the wide cylindrical magnifier of described band twice.Depend on the angle of watching screen, spectators perceive the different views of scene.Can select different views that the illusion of the degree of depth in shown scene is provided.
In addition, although certain embodiments of the present invention can solve in the three-dimensional of the two dimensional image aliasing problem under the situation of projection again, and relate to the more than one image that generates described projection again, but embodiment generally more is applicable to the projection again under the non-3D situation.In addition, in some three dimensional realization modes, may there is no need to generate two or more images.For example, under the situation of three-dimensional display, may there is no need via projection again generate left-eye image and eye image the two.Alternatively, can only generate a new image via projection again.For example, might with the color of each pixel of left-eye image and depth information begin and generate corresponding eye image (or vice versa) via projection again, show sufficient image thereby produce with three-dimensional display.This will relate to the image that only generates single projection again.
Although with reference to some preferred styles of the present invention the present invention is carried out quite detailed description, other pattern is possible.Therefore, the spirit and scope of appended claims should be not limited to the description to the contained preferred styles of this paper.On the contrary, should determine scope of the present invention together with the four corner of their equivalents with reference to appended claims.
Disclosed all features can identical by being used for, of equal value or similar purpose alternative features be replaced in this instructions (comprising any claim of enclosing, summary and graphic), unless clearly regulation is arranged in addition.Therefore, unless clearly regulation is arranged in addition, disclosed each feature only is an embodiment of a series of general equivalences or similar characteristics.Any feature (no matter whether being preferred) can make up with any further feature (no matter whether being preferred).In the claims of enclosing, indefinite article " one (individual/kind) " refer to the one or more amount in the described article item afterwards, unless the situation that clearly is defined as exception is arranged in addition.As specified in the 35th piece the 6th section of the 112nd article of United States code, any key element that clearly is not given in the claim of " device " of carrying out appointed function will be explained not according to " device " or " step " clause.Specifically, the use of " step (step of) " is not intended to quote the regulation of the 35th piece the 6th section of the 112nd article of United States code in this paper claims.
The reader notice can be turned to this instructions submit to simultaneously and with this instructions openly for All Files and the official document of public examination, and the content of any file and official document is incorporated this paper into way of reference.

Claims (24)

1. the method for the morphology anti aliasing (MLAA) of a projection again that is used for one or more two dimensional images, described method comprises:
A) determine one or more uncontinuities between each neighbors of described one or more two dimensional images;
B) identification is by the formed one or more predefine patterns of described one or more uncontinuities in a);
C) calculate with at b) in the amount of being mixed of adjacent each pixel of the described predefine pattern identified;
D) will be again projection application in described one or more two dimensional images and be applied to the described amount of being mixed of each pixel, thereby generate one or more projected images again and the projection amount of being mixed again;
E) according to the described amount of being mixed of the projection again neighbor of described one or more projected images again that is mixed, thereby produce one or more output images; And
F) show described one or more output images.
2. the method for claim 1, wherein said one or more output images comprise left-eye view and the right-eye view of scene, described output image is thus corresponding to projection left-eye image again and the eye image of described scene.
3. the method for claim 1, wherein f) comprise described projection left-eye image again and eye image are presented on the three dimensional display.
4. the method for claim 1 wherein when each pixel has different color settings, uncontinuity occurs between neighbor.
5. the method for claim 1 wherein when each pixel has how much different settings, uncontinuity occurs between neighbor.
6. the method for claim 1 wherein a) comprises and finds out the horizontal uncontinuity between the adjacent level pixel or find out vertical uncontinuity between the adjacent vertical pixel.
7. the method for claim 1 wherein a) comprises and finds out the vertical uncontinuity between the adjacent vertical pixel and find out horizontal uncontinuity between the adjacent level pixel.
8. the method for claim 1, f wherein) comprises described one or more two dimensional images are divided into band, make described band staggered with the band of one or more different two dimensional images of the different views of scene, thereby produce one group of images interlaced, and images interlaced is presented on the automatic stereoscopic display device, and described automatic stereoscopic display device has the lenticular lens between indicator screen and viewing location.
9. the method for claim 1, wherein b) in described predefine pattern comprise L shaped pattern.
10. the method for claim 1, wherein b) in described predefine pattern comprise the U-shaped pattern.
11. the method for claim 1, wherein b) in described predefine pattern comprise zigzag pattern.
12. an equipment that is used for the morphology anti aliasing, described equipment comprises:
Processor;
Storer; And
The computer code instruction, it is embodied in the described storer and can be carried out by described processor, the instruction of wherein said computer code is configured to implement a kind of method of morphology anti aliasing of the projection again for one or more two dimensional images, and described method comprises:
A) determine one or more uncontinuities between each neighbors of described one or more two dimensional images;
B) identification is by the formed one or more predefine patterns of described one or more uncontinuities;
C) calculate with at b) in the amount of being mixed of adjacent each pixel of the described predefine pattern identified;
D) will be again projection application in described one or more two dimensional images and be applied to the described amount of being mixed of each pixel, thereby generate one or more projected images again and the projection amount of being mixed again; And
E) according to the described amount of being mixed of the projection again neighbor of described one or more projected images again that is mixed, thereby produce one or more output images.
13. equipment as claimed in claim 12, it further comprises the 3D vision display that is configured to show described one or more output images.
14. equipment as claimed in claim 13, wherein said one or more two dimensional images comprise left-eye view and the right-eye view of scene, and described output image is thus corresponding to projection left-eye image again and the eye image of described scene.
15. equipment as claimed in claim 13, wherein said display are the automatic stereoscopic display devices with the lenticular lens between indicator screen and viewing location.
16. equipment as claimed in claim 15 wherein is divided into band with described one or more two dimensional images, makes described band staggered with the band of one or more different two dimensional images of the different views of scene, thereby produces one group of images interlaced.
17. equipment as claimed in claim 12 wherein when each pixel has different color settings, uncontinuity occurs between neighbor.
18. equipment as claimed in claim 12 wherein when each pixel has how much different settings, uncontinuity occurs between neighbor.
19. equipment as claimed in claim 12 wherein a) comprises the horizontal uncontinuity of at first finding out between the adjacent level pixel, finds out the vertical uncontinuity between the adjacent vertical pixel subsequently.
20. equipment as claimed in claim 12 wherein a) comprises the vertical uncontinuity of at first finding out between the adjacent vertical pixel, finds out the horizontal uncontinuity between the adjacent level pixel subsequently.
21. equipment as claimed in claim 12, wherein b) in described predefine pattern comprise L shaped pattern.
22. equipment as claimed in claim 12, wherein b) in described predefine pattern comprise the U-shaped pattern.
23. equipment as claimed in claim 12, wherein b) in described predefine pattern comprise zigzag pattern.
24. a computer program, it comprises:
Non-instantaneity, computer-readable recording medium, it has the computer readable program code that is embodied in the described medium, described computer readable program code is used for the morphology anti aliasing (MLAA) of the projection again of two dimensional image, and described computer program has:
A) computer-readable program code means, it is for the one or more uncontinuities between each neighbor of determining described two dimensional image;
B) computer-readable program code means, it is used for identification by the formed one or more predefine patterns of described one or more uncontinuities;
C) computer-readable program code means, its be used for to calculate with at b) amount of being mixed of each pixel that the described predefine pattern identified is adjacent;
D) computer-readable program code means, it is used for projection application in described two dimensional image again and is applied to the described amount of being mixed of each pixel, thereby generates projected image and the projection amount of being mixed again again; And
E) computer-readable program code means, it is used for according to the described amount of being mixed of the projection again neighbor of described projected image again that is mixed, thereby produces one or more output images; And
F) computer-readable program code means, it is used for showing described one or more output images.
CN201180063813.XA 2011-01-07 2011-12-02 The morphology anti aliasing (MLAA) of the reprojection of two dimensional image Active CN103348360B (en)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US12/986,814 US9041774B2 (en) 2011-01-07 2011-01-07 Dynamic adjustment of predetermined three-dimensional video settings based on scene content
US12/986,872 2011-01-07
US12/986,827 2011-01-07
US12/986,854 US8619094B2 (en) 2011-01-07 2011-01-07 Morphological anti-aliasing (MLAA) of a re-projection of a two-dimensional image
US12/986,854 2011-01-07
US12/986,827 US8514225B2 (en) 2011-01-07 2011-01-07 Scaling pixel depth values of user-controlled virtual object in three-dimensional scene
US12/986,872 US9183670B2 (en) 2011-01-07 2011-01-07 Multi-sample resolving of re-projection of two-dimensional image
US12/986,814 2011-01-07
PCT/US2011/063003 WO2012094076A1 (en) 2011-01-07 2011-12-02 Morphological anti-aliasing (mlaa) of a re-projection of a two-dimensional image

Publications (2)

Publication Number Publication Date
CN103348360A true CN103348360A (en) 2013-10-09
CN103348360B CN103348360B (en) 2017-06-20

Family

ID=46457655

Family Applications (7)

Application Number Title Priority Date Filing Date
CN201610191451.7A Active CN105894567B (en) 2011-01-07 2011-12-02 Scaling pixel depth values of user-controlled virtual objects in a three-dimensional scene
CN201610095198.5A Active CN105898273B (en) 2011-01-07 2011-12-02 The multisample parsing of the reprojection of two dimensional image
CN201180063836.0A Active CN103283241B (en) 2011-01-07 2011-12-02 The multisample of the reprojection of two dimensional image is resolved
CN201180063720.7A Active CN103947198B (en) 2011-01-07 2011-12-02 Dynamic adjustment of predetermined three-dimensional video settings based on scene content
CN201610191875.3A Active CN105959664B (en) 2011-01-07 2011-12-02 The dynamic adjustment of predetermined three-dimensional video setting based on scene content
CN201180063813.XA Active CN103348360B (en) 2011-01-07 2011-12-02 The morphology anti aliasing (MLAA) of the reprojection of two dimensional image
CN201180064484.0A Active CN103329165B (en) 2011-01-07 2011-12-02 The pixel depth value of the virtual objects that the user in scaling three-dimensional scenic controls

Family Applications Before (5)

Application Number Title Priority Date Filing Date
CN201610191451.7A Active CN105894567B (en) 2011-01-07 2011-12-02 Scaling pixel depth values of user-controlled virtual objects in a three-dimensional scene
CN201610095198.5A Active CN105898273B (en) 2011-01-07 2011-12-02 The multisample parsing of the reprojection of two dimensional image
CN201180063836.0A Active CN103283241B (en) 2011-01-07 2011-12-02 The multisample of the reprojection of two dimensional image is resolved
CN201180063720.7A Active CN103947198B (en) 2011-01-07 2011-12-02 Dynamic adjustment of predetermined three-dimensional video settings based on scene content
CN201610191875.3A Active CN105959664B (en) 2011-01-07 2011-12-02 The dynamic adjustment of predetermined three-dimensional video setting based on scene content

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201180064484.0A Active CN103329165B (en) 2011-01-07 2011-12-02 The pixel depth value of the virtual objects that the user in scaling three-dimensional scenic controls

Country Status (5)

Country Link
KR (2) KR101741468B1 (en)
CN (7) CN105894567B (en)
BR (2) BR112013016887B1 (en)
RU (2) RU2562759C2 (en)
WO (4) WO2012094076A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105323573A (en) * 2014-07-16 2016-02-10 北京三星通信技术研究有限公司 Three-dimensional image display device and three-dimensional image display method

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015049684A1 (en) * 2013-10-02 2015-04-09 Given Imaging Ltd. System and method for size estimation of in-vivo objects
WO2016010246A1 (en) * 2014-07-16 2016-01-21 삼성전자주식회사 3d image display device and method
EP3232406B1 (en) * 2016-04-15 2020-03-11 Ecole Nationale de l'Aviation Civile Selective display in a computer generated environment
CN107329690B (en) * 2017-06-29 2020-04-17 网易(杭州)网络有限公司 Virtual object control method and device, storage medium and electronic equipment
CN109398731B (en) 2017-08-18 2020-09-08 深圳市道通智能航空技术有限公司 Method and device for improving depth information of 3D image and unmanned aerial vehicle
GB2571306A (en) * 2018-02-23 2019-08-28 Sony Interactive Entertainment Europe Ltd Video recording and playback systems and methods
CN109992175B (en) * 2019-04-03 2021-10-26 腾讯科技(深圳)有限公司 Object display method, device and storage medium for simulating blind feeling
RU2749749C1 (en) * 2020-04-15 2021-06-16 Самсунг Электроникс Ко., Лтд. Method of synthesis of a two-dimensional image of a scene viewed from a required view point and electronic computing apparatus for implementation thereof
CN111275611B (en) * 2020-01-13 2024-02-06 深圳市华橙数字科技有限公司 Method, device, terminal and storage medium for determining object depth in three-dimensional scene
CN112684883A (en) * 2020-12-18 2021-04-20 上海影创信息科技有限公司 Method and system for multi-user object distinguishing processing
US11882295B2 (en) 2022-04-15 2024-01-23 Meta Platforms Technologies, Llc Low-power high throughput hardware decoder with random block access
US20230334736A1 (en) * 2022-04-15 2023-10-19 Meta Platforms Technologies, Llc Rasterization Optimization for Analytic Anti-Aliasing

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1659591A (en) * 2002-06-03 2005-08-24 皇家飞利浦电子股份有限公司 Adaptive scaling of video signals
CN1831556A (en) * 2006-04-14 2006-09-13 武汉大学 Single satellite remote sensing image small target super resolution ratio reconstruction method
US20080174659A1 (en) * 2007-01-18 2008-07-24 Mcdowall Ian Wide field of view display device and method
US20090168187A1 (en) * 2006-01-23 2009-07-02 Graham John Woodgate Lenticular Lens Array Element
US20100315412A1 (en) * 2009-06-15 2010-12-16 Microsoft Corporation Piecewise planar reconstruction of three-dimensional scenes

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2724033B1 (en) * 1994-08-30 1997-01-03 Thomson Broadband Systems SYNTHESIS IMAGE GENERATION METHOD
US5790086A (en) * 1995-01-04 1998-08-04 Visualabs Inc. 3-D imaging system
GB9511519D0 (en) * 1995-06-07 1995-08-02 Richmond Holographic Res Autostereoscopic display with enlargeable image volume
EP2357838B1 (en) * 2002-03-27 2016-03-16 Sanyo Electric Co., Ltd. Method and apparatus for processing three-dimensional images
US8369607B2 (en) * 2002-03-27 2013-02-05 Sanyo Electric Co., Ltd. Method and apparatus for processing three-dimensional images
EP1437898A1 (en) * 2002-12-30 2004-07-14 Koninklijke Philips Electronics N.V. Video filtering for stereo images
US7663689B2 (en) * 2004-01-16 2010-02-16 Sony Computer Entertainment Inc. Method and apparatus for optimizing capture device settings through depth information
US8094927B2 (en) * 2004-02-27 2012-01-10 Eastman Kodak Company Stereoscopic display system with flexible rendering of disparity map according to the stereoscopic fusing capability of the observer
US20050248560A1 (en) * 2004-05-10 2005-11-10 Microsoft Corporation Interactive exploded views from 2D images
US7643672B2 (en) * 2004-10-21 2010-01-05 Kazunari Era Image processing apparatus, image pickup device and program therefor
EP1851727A4 (en) * 2005-02-23 2008-12-03 Craig Summers Automatic scene modeling for the 3d camera and 3d video
JP4555722B2 (en) * 2005-04-13 2010-10-06 株式会社 日立ディスプレイズ 3D image generator
US20070146360A1 (en) * 2005-12-18 2007-06-28 Powerproduction Software System And Method For Generating 3D Scenes
US8044994B2 (en) * 2006-04-04 2011-10-25 Mitsubishi Electric Research Laboratories, Inc. Method and system for decoding and displaying 3D light fields
US7778491B2 (en) 2006-04-10 2010-08-17 Microsoft Corporation Oblique image stitching
US20080085040A1 (en) * 2006-10-05 2008-04-10 General Electric Company System and method for iterative reconstruction using mask images
GB0716776D0 (en) * 2007-08-29 2007-10-10 Setred As Rendering improvement for 3D display
KR101484487B1 (en) * 2007-10-11 2015-01-28 코닌클리케 필립스 엔.브이. Method and device for processing a depth-map
US8493437B2 (en) * 2007-12-11 2013-07-23 Raytheon Bbn Technologies Corp. Methods and systems for marking stereo pairs of images
BRPI0822142A2 (en) * 2008-01-29 2015-06-30 Thomson Licensing Method and system for converting 2d image data to stereoscopic image data
JP4695664B2 (en) * 2008-03-26 2011-06-08 富士フイルム株式会社 3D image processing apparatus, method, and program
US9019381B2 (en) * 2008-05-09 2015-04-28 Intuvision Inc. Video tracking systems and methods employing cognitive vision
US8106924B2 (en) 2008-07-31 2012-01-31 Stmicroelectronics S.R.L. Method and system for video rendering, computer program product therefor
US8743114B2 (en) * 2008-09-22 2014-06-03 Intel Corporation Methods and systems to determine conservative view cell occlusion
CN101383046B (en) * 2008-10-17 2011-03-16 北京大学 Three-dimensional reconstruction method on basis of image
JP5514219B2 (en) * 2008-10-28 2014-06-04 コーニンクレッカ フィリップス エヌ ヴェ 3D display system
US8335425B2 (en) * 2008-11-18 2012-12-18 Panasonic Corporation Playback apparatus, playback method, and program for performing stereoscopic playback
CN101783966A (en) * 2009-01-21 2010-07-21 中国科学院自动化研究所 Real three-dimensional display system and display method
RU2421933C2 (en) * 2009-03-24 2011-06-20 Корпорация "САМСУНГ ЭЛЕКТРОНИКС Ко., Лтд." System and method to generate and reproduce 3d video image
US8289346B2 (en) 2009-05-06 2012-10-16 Christie Digital Systems Usa, Inc. DLP edge blending artefact reduction
US9269184B2 (en) * 2009-05-21 2016-02-23 Sony Computer Entertainment America Llc Method and apparatus for rendering image based projected shadows with multiple depth aware blurs
CN101937079B (en) * 2010-06-29 2012-07-25 中国农业大学 Remote sensing image variation detection method based on region similarity

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1659591A (en) * 2002-06-03 2005-08-24 皇家飞利浦电子股份有限公司 Adaptive scaling of video signals
US20090168187A1 (en) * 2006-01-23 2009-07-02 Graham John Woodgate Lenticular Lens Array Element
CN1831556A (en) * 2006-04-14 2006-09-13 武汉大学 Single satellite remote sensing image small target super resolution ratio reconstruction method
US20080174659A1 (en) * 2007-01-18 2008-07-24 Mcdowall Ian Wide field of view display device and method
US20100315412A1 (en) * 2009-06-15 2010-12-16 Microsoft Corporation Piecewise planar reconstruction of three-dimensional scenes

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105323573A (en) * 2014-07-16 2016-02-10 北京三星通信技术研究有限公司 Three-dimensional image display device and three-dimensional image display method
CN105323573B (en) * 2014-07-16 2019-02-05 北京三星通信技术研究有限公司 3-D image display device and method

Also Published As

Publication number Publication date
CN105898273B (en) 2018-04-10
RU2013136687A (en) 2015-02-20
WO2012094077A1 (en) 2012-07-12
KR20140004115A (en) 2014-01-10
RU2562759C2 (en) 2015-09-10
KR101741468B1 (en) 2017-05-30
CN105959664A (en) 2016-09-21
CN105959664B (en) 2018-10-30
BR112013016887B1 (en) 2021-12-14
WO2012094074A2 (en) 2012-07-12
CN103947198A (en) 2014-07-23
WO2012094076A9 (en) 2013-07-25
BR112013016887A2 (en) 2020-06-30
CN105894567A (en) 2016-08-24
WO2012094076A1 (en) 2012-07-12
WO2012094074A3 (en) 2014-04-10
CN105894567B (en) 2020-06-30
BR112013017321A2 (en) 2019-09-24
KR101851180B1 (en) 2018-04-24
CN103947198B (en) 2017-02-15
RU2013129687A (en) 2015-02-20
WO2012094075A1 (en) 2012-07-12
CN105898273A (en) 2016-08-24
RU2573737C2 (en) 2016-01-27
KR20130132922A (en) 2013-12-05
CN103283241B (en) 2016-03-16
CN103329165A (en) 2013-09-25
CN103329165B (en) 2016-08-24
CN103283241A (en) 2013-09-04
CN103348360B (en) 2017-06-20

Similar Documents

Publication Publication Date Title
CN103348360A (en) Morphological anti-aliasing (MLAA) of re-projection of two-dimensional image
CN101729791B (en) Apparatus and method for image processing
CN103096106B (en) Image processing apparatus and method
CN102379127A (en) Video processing device, video processing method, and computer program
US8619094B2 (en) Morphological anti-aliasing (MLAA) of a re-projection of a two-dimensional image
TWI698834B (en) Methods and devices for graphics processing
KR20100109069A (en) Device for generating visual attention map and method thereof
CN103327357A (en) Three-dimensional picture presenting method and device
Baričević et al. User-perspective augmented reality magic lens from gradients
US20130329985A1 (en) Generating a three-dimensional image
Templin et al. Highlight microdisparity for improved gloss depiction
CN102136156A (en) System and method for mesoscopic geometry modulation
CN105898338A (en) Panorama video play method and device
US9165393B1 (en) Measuring stereoscopic quality in a three-dimensional computer-generated scene
Northam et al. Stereoscopic 3D image stylization
CN104717514A (en) Multi-viewpoint image rendering system and method
US20180109775A1 (en) Method and apparatus for fabricating a stereoscopic image
Yuan et al. Free-viewpoint image based rendering with multi-layered depth maps
CN102780900B (en) Image display method of multi-person multi-view stereoscopic display
Miyashita et al. Display-size dependent effects of 3D viewing on subjective impressions
Huang et al. 360° stereo image composition with depth adaption
Chen et al. A quality controllable multi-view object reconstruction method for 3D imaging systems
Jeong et al. Real‐Time Defocus Rendering With Level of Detail and Sub‐Sample Blur
Liao et al. Stereo matching and viewpoint synthesis FPGA implementation
Thatte Cinematic virtual reality with head-motion parallax

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant