CN103607582A - System, apparatus, and method for capturing and screening visual images for multi-dimensional display - Google Patents

System, apparatus, and method for capturing and screening visual images for multi-dimensional display Download PDF

Info

Publication number
CN103607582A
CN103607582A CN201310437139.8A CN201310437139A CN103607582A CN 103607582 A CN103607582 A CN 103607582A CN 201310437139 A CN201310437139 A CN 201310437139A CN 103607582 A CN103607582 A CN 103607582A
Authority
CN
China
Prior art keywords
image
picture
data
display
spatial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310437139.8A
Other languages
Chinese (zh)
Inventor
克雷格·莫里
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cedar Crest Partners Inc
Original Assignee
Cedar Crest Partners Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/447,406 external-priority patent/US8194168B2/en
Priority claimed from US11/481,526 external-priority patent/US20070122029A1/en
Application filed by Cedar Crest Partners Inc filed Critical Cedar Crest Partners Inc
Publication of CN103607582A publication Critical patent/CN103607582A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)

Abstract

A system, apparatus and method are provided for capturing visual images and spatial data for providing image manipulation options such as for multi-dimensional display.

Description

For multi-dimensional display is caught also system, the apparatus and method of screening visual images
The application is to be on July 27th, 2006 applying date, and application number is 200680034117.5, the dividing an application of the application that denomination of invention is " for multi-dimensional display is caught also system, the apparatus and method of screening visual images ".
The cross reference of related application
The application submitted to based on July 27th, 2005 and exercise question is " SYSTEM, METHOD AND APPARATUS FOR CAPTURING AND SCREENING VISUALS FOR MULTIDIMENSIONAL DISPLAY " U.S. Provisional Application sequence number 60/702, 910, submit on August 25th, 2005 and exercise question is " SYSTEM, METHOD APPARATUS FOR CAPTURING AND SCREENING VISUALS FOR MULTI-DIMENSIONAL DISPLAY (ADDITIONAL DISCLOSURE) " U.S. Provisional Application sequence number 60/711, 345, submit on August 25th, 2005 and exercise question is " A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY OF FILM CAPTURE " U.S. Provisional Application sequence number 60/710, 868, submit on August 29th, 2005 and exercise question is " AMETHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY AND EFFICIENCY OF FILM CAPTURE " U.S. Provisional Application sequence number 60/712, 189, submit on October 16th, 2005 and exercise question is " A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY OF DIGITAL IMAGE CAPTURE " U.S. Provisional Application sequence number 60/727, 538, submit on October 31st, 2005 and exercise question is " A METHOD, SYSTEM AND APPARATUS FORINCREASING QUALITY AND EFFICIENCY OF FILM CAPTUREWITHOUT CHANGE OF FILM MAGAZINE POSITION " U.S. Provisional Application sequence number 60/732, 347, the name of submitting on November 22nd, 2005 is called the U.S. Provisional Application sequence number 60/739 of " DUAL FOCUS ", 142, submit on November 25th, 2005 and exercise question is the U.S. Provisional Application sequence number 60/739 of " SYSTEM AND METHOD FOR VARIABLE KEY FRAME FILM GATE ASSEMBLAGE WITHIN HYBRID CAMERA ENHANCING RESOLUTION WHILE EXPANDING MEDIA EFFICIENCY ", 881, submit on December 15th, 2005 and exercise question is " A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY AND EFFICIENCY OF (DIGTTAL) FILM CAPTURE " U.S. Provisional Application sequence number 60/750, 912, and require its priority, the full content of these applications is merged in thus by reference.The exercise question that the application submitted to based on July 6th, 2006 is the U.S. Patent Application Serial Number 11/481 of " SYSTEM AND METHOD FOR CAPTURING VISUAL DATA AND NON-VISUAL DATA FOR MULTIDIMENSIONAL IMAGE DISPLAY ", 526, the exercise question of submitting on June 5th, 2006 is the U.S. Patent Application Serial Number 11/447 of " MULTI-DIMENSIONAL IMAGING SYSTEM AND METHOD ", 406, and requiring its priority, the full content of these applications is merged in thus by reference.
The application also intactly merges by reference: the exercise question of submitting on July 24th, 2006 be " SYSTEM; APPARATUS; AND METHOD FOR INCREASING MEDIA STORAGE CAPACITY " U.S. Patent Application Serial Number _ _ _ _,, require U.S.'s non-provisional application of the interests of the U.S. Provisional Application sequence number 60/701,424 submitted on July 22nd, 2005; And in the exercise question that on June 21st, 2006 submits to be " A METHOD; SYSTEM AND APPARATUS FOR EXPOSING IMAGES ON BOTH SIDES OF CELLOID OR OTHER PHOTO SENSITVE BEARING MATERIAL " U.S. Patent Application Serial Number _ _ _ _ _,, require U.S.'s non-provisional application of the interests of the U.S. Provisional Application submitted on June 21st, 2005 number 60/692,502; The full content of these two applications is as here intactly set forth.The application also intactly merges by reference: the exercise question of submitting on July 6th, 2006 is the U.S. Patent Application Serial Number 11/481 of " SYSTEM AND METHOD FOR CAPTURING VISUAL DATA AND NON-VISUAL DATA FOR MULTIDIMENSIONAL IMAGE DISPLAY ", 526, the exercise question of submitting on June 22nd, 2006 is the U.S. Patent Application Serial Number 11/473 of " SYSTEM AND METHOD FOR DIGITAL FILM SIMULATION ", 570, the exercise question of submitting on June 21st, 2006 is the U.S. Patent Application Serial Number 11/472 of " SYSTEM AND METHOD FOR INCREASING EFFICIENCY AND QUALITY FOR EXPOSING IMAGES ON CELLULOID OR OTHER PHOTO SENSITIVE MATERIAL ", 728, the exercise question of submitting on June 5th, 2006 is the U.S. Patent Application Serial Number 11/447 of " MULTIDIMENSIONAL IMAGING SYSTEM AND METHOD ", 406, and the exercise question of submitting on April 20th, 2006 is the U.S. Patent Application Serial Number 11/408 of " SYSTEM AND METHOD TO SIMULATE FILM OR OTHER IMAGING MEDIA ", 389, the full content of these applications is as here intactly set forth.
Technical field
The present invention relates to imaging, and more specifically, relate to and catch (capture) picture (visual) and spatial data thinks that for example multi-dimensional display provides image processing selecting scheme.The invention still further relates to for generation of light with dimensionally system, the apparatus and method of screening visual images.
Background technology
Along with film and TV tech reach unanimity, audio frequency-picture and selecting for example wherein display screen size, resolution and sound be enhanced and expanded, for example have by digital video disk, computer and the watching of media that present on the internet and select and quality.Family watches the development of technology negatively to affect the value that movie theatre (for example, cinema) is experienced, and family watches and the difference of the display quality of movie theatre between watching minimizes to the degree that may threaten motion picture projection place and whole industry.The beholder of family can and will continue enjoy once a lot of technical advantages that obtain in can only be at the cinema, thereby has increased the needs to new and unique experience effect proprietary at the cinema.
When so that for example general common " bidimensional " form is caught image in film and digital camera, unfortunately lose the three dimensional lifelike of objects in images.In the situation that there is no the special data of real image epitome (aspect), allow human eye to infer the depth relationship of objects in images, comprise general middle projection at the cinema and the image presenting on television set, computer and other displays.The picture clue that beholder is known or " mark " thereby " at heart " are also relative to each other assigned to prospect and background, the degree that can distinguish at least to brain.When people observes actual object, space or depth data are interpreted as the function of the deviation post of two eyes by brain, thereby people can be understood exceed the degree of depth of the object that for example bidimensional is caught in the video camera of prior art.Human perception can not be rule of thumb with logic automatically " layout " in fact generally by brain of beholder, distribute the degree of depth to arrange, to allow picture to produce " space sense " in human perception.
The transmission that relates to sending and receiving signal and/or electron production measure object spatial relationship technology as sonar and radar be known.Such technology relates generally to calculate the difference of " return time " of the transmission of electronic receiver, thereby device that range data, this range data be illustrated in broadcast singal or transmission and distance and/or the spatial relationship between the object in corresponding measured zone are provided.Spatial relationship data provides by for example distance samples and/or other multidimensional data collection techniques, and data and picture are caught coupling to produce the threedimensional model in region.
Current, the system of aesthetic good multidimensional picture or the method for providing is provided, the picture data that described multidimensional picture merging is for example caught by video camera and actual spatial data, this spatial data is relevant with the epitome of picture, and comprise the numeral description subsequently between image epitome, to present the enhancement mode layering of a plurality of images and/or image epitome, show.
Summary of the invention
The present invention relates to imaging, and more specifically, relate to capturing visual and spatial data and for example think that multi-dimensional display provides image processing selecting scheme as three dimensional display.The invention still further relates to for generation of light picture image is projected in to system, device or the method in three dimensional display.The invention provides by utilizing video camera to catch system or method that image provides multidimensional picture information, wherein image comprises picture epitome.Further, the spatial data relevant with picture epitome is hunted down, and view data is caught from caught image.Finally, this method comprises the function that view data is optionally converted to spatial data, so that multidimensional picture information to be provided, and three-dimensional picture information for example.
Provide a kind of for catching and revise the system of picture image, it comprises: IMAQ lens and the video camera that can operate capturing visual image on image recording media; The data acquisition module that can operate to collect the spatial data relevant with at least one picture element (element) in the picture image of catching, described data are also relevant to the spatial relationship of the assembly of at least one selection of video camera with described at least one picture element; Code element on described image recording media, this code element is relevant with described spatial data, makes from described at least one picture element of described picture image interrelated with respect to described spatial data; And can operate according to described at least one picture element of described spatial data change to produce the computing equipment of the picture image of at least one modification.
Described code element can be picture data element.Described code element can be non-picture data element.Described code element can be the recordable magnetic material providing as the part of described recording medium.Described system also can comprise display, and described display can produce light with the demonstration of the picture image of at least one modification described in projection and produce final picture image.Described final picture image can be projected from least two distances.Described distance can comprise along the different distance of possible beholder's sight line.Described picture image can be modified and produce the picture image of two or more modifications, to show final many image frames.Described image recording media can be photographic film.Described final picture image can be comprised of at least two different imaging planes.
Also provide a kind of for catching and revise the device of picture image, it comprises: IMAQ lens and video camera, and it can operate and on image recording media, catch described picture image; Data acquisition module, it can operate to collect the spatial data relevant with at least one picture element in caught picture image, and described data are also relevant to the spatial relationship of the position of selecting with described at least one picture element; Code element on described image recording media, described code element is relevant with described spatial data, interrelated with respect to described spatial data for making from described at least one picture element of described picture image; And computing equipment, it can operate according to described spatial data and change described at least one picture element to produce the picture image of at least one modification.
Described code element is the data element that can be read by least one data scanning equipment.Described data scanning equipment can be Laser Scanning Equipment.Described data element can be bar code.Described code element can be the data element of reference in the data storage medium that can store the media that comprise Audio and Video information.Described data element can be the recordable material of magnetic.Described device also can comprise display, and described display can produce light with the demonstration of the picture image of at least one modification described in projection and produce final picture image.The light that produces relevant from described final picture image can send possible described beholder to from least two different distances with respect to beholder's sight line.
The code element of system or device includes but not limited to picture data element, non-picture data element or is set to the recordable magnetic material of the part of recording medium.System can also comprise display, and this display produces light with the demonstration of the picture image of at least one modification described in projection and produces final picture image.Final picture image can be from least two apart from projection.This distance can comprise along the different distance of possible beholder's sight line.Picture image may be modified as the picture image of two or more modifications of generation to show final many image frames.Picture recording medium includes but not limited to photographic film.
A kind of method of revising picture image is provided, and it comprises: by picture, gather lens and video camera captures picture image on image recording media; Collect the spatial data relevant with at least one picture element in the picture image of catching; When referenced in the code element on described image recording media, make described at least one picture element and described spatial data interrelated; And change described at least one picture element according to described spatial data, to produce the picture image of at least one modification.
Described method also can comprise by computing equipment utilizes described spatial data to revise described at least one picture element.Described code element can be the data element being suitable for by least one bar coded.Described code element can be non-picture data element.Described code element can be the recordable magnetic material providing as the part of described recording medium.Described magnetic material can be the magnetic recording tape that appears at the selectable size in the length of described recording medium.Described recording medium can be photography raw stock.Described magnetic material can be to record the magnetic strips that can be stored in any data type in magnetic material, and described magnetic strips can provide data.Described method also can comprise and from display, produces light with the demonstration of the picture image of at least one modification described in projection and produce final picture image.Described method also can comprise final picture image described in the distance projection that at least two along beholder's sight line from the described beholder from possible are different.Described method also can comprise that the picture image that merges two or more modification is to produce described final picture image.Described image recording media can be photographic film.Described final picture image can be comprised of at least two different imaging planes.
Provide a kind of light that produces with the system of projected picture image, this system comprises picture display device, it produces at least two light sources that transmit to possible beholder from least two distances from beholder, wherein, described distance appears at the different depth place of interior height and width with respect to described equipment of described picture display device.
Described system also can comprise the image display area of the described equipment that occupies space.The epitome of described image can appear at least two differences in described space.The liquid assembly that it is described light that described picture display device also can comprise image information display.Described picture display device can be watch-dog.Described watch-dog can be plasma display.Described image display area can be for optionally transparent, can operate with respect to the height of at least one two dimensional image being produced by described picture display device and width and from described viewing area at least one optionally dark point produce light, the described spatial data that described optionally dark point can be relevant by the epitome of the image when being hunted down is notified.From described at least two light sources of described picture display device, can produce the visible epitome of described final picture image, described final picture image can comprise the point that at least two of produced light are different, wherein, the described point of light can be minimum visible epitome, and described picture display device can operate to maintain one or more visually recognizable characteristics.Described one or more visually recognizable characteristic can be color.Described visible epitome can be presented at respect to described beholder's single sight line the segment distance place from described beholder, and wherein, described distance can be subject to the impact of the data of collecting when initial image capture.Described picture display device can affect at least one region of optionally manufacturing according to size of described space.Described system also can comprise to the external module of the described picture display device transmitted signal in described at least one region of optionally manufacturing according to size of described space.Described external module can comprise that the impact of electron production is to stimulate at least one aspect of described picture display device.Described external module can comprise that at least one light produces equipment.Described light produces equipment and can operate to provide selectivity by the light in described at least one region of optionally manufacturing according to size of described space.The impact of described electron production can be magnetic.Described external module can comprise the sightless transmission that affects described display device.
Also provide a kind of for generation of light the device with projected picture image, it comprises: picture display device, it produces at least two light sources that transmit to possible described beholder from least two distances from beholder, wherein, described distance appears at the height with respect to described equipment in described picture display device and the different depth place of width.
Described device also can comprise the image display area of the described equipment that occupies space.The epitome of described image can appear at least two differences in described space.Described picture display device also can comprise the liquid assembly that image information is rendered as to light.Described picture display device can be watch-dog.Described watch-dog can be plasma display.Described image display area can be optionally transparent, allow possible beholder to receive the light relevant from different two dimensional image, described light can with respect in described two dimensional image at least one height and the selectable depth of width produce, the described degree of depth can be subject to the impact of the relevant spatial data of the epitome of the described image when being hunted down.
System can further comprise the image display area of the equipment that occupies space.In one aspect, the epitome of image appears at least two different points in space.The liquid assembly that it is light that picture display device can further comprise image information display.Picture display device can be watch-dog, includes but not limited to plasma display.
The method of the picture image of a kind of generation for optionally showing is provided, and it comprises that described light transmits from least two different depths of the height with respect to view display and width from least two light sources of view display equipment generation.In the method, the difference of different depth representings along possible beholder's sight line towards equipment.This equipment can show many image frames.The method providing can also comprise image is presented in the region that occupies space.Described method also can be included in the epitome that shows described image at least two differences in described space.It is light by image information display that described method also can be included in liquid assembly.Described picture display device can be watch-dog.Described watch-dog can be plasma display.The region that occupies described space can be optionally transparent, allow light to transmit from the height of at least one the different two dimensional image with respect to producing described district and at least two depths of width, the described degree of depth can be subject to the impact of the described image-related non-picture data when being hunted down.Described non-picture data can be the relevant spatial data of the epitome of the described image when being hunted down.Described method also can comprise that the visible epitome that produces described picture image from described at least two light sources is as one or more demonstration points.Described one or more demonstration point can be pixel.
According to the of the present invention following description with reference to accompanying drawing, other features and advantages of the present invention will become apparent.
Accompanying drawing explanation
For illustrating object of the present invention, should be appreciated that clear and definite layout and the instrument shown in the present invention is not limited to.According to the of the present invention following description with reference to accompanying drawing, the features and advantages of the present invention will become apparent, wherein:
Fig. 1 shows beholder and the screening area of watching from the side;
Fig. 2 shows cinema's example of watching from top;
Fig. 3 A and 3B show a plurality of screen displays place according to an embodiment, and comprise the mechanical screen construction according to an embodiment;
Fig. 4 shows a plurality of video cameras and the measuring equipment relevant to the degree of depth to different image epitome operations.
Embodiment
The present invention relates to imaging, and more specifically, relate to capturing visual and spatial data and think that for example multi-dimensional display provides image processing selecting scheme.The invention still further relates to for generation of light with dimensionally system, equipment and the method for screening visual images.A kind of system and method is provided, and it,, except the picture scene that is commonly referred to as " picture " here of being caught by video camera, also provides the spatial data of for example being caught by spatial data sample devices.The picture of being caught by video camera is commonly referred to as " image " here.Picture and spatial data are provided jointly, so that the data relevant with the three-dimensional epitome of picture can be used during the processing after for example producing.In addition, the non-picture data actual, that select with reference to image-related, provides the imaging of the image of catching for impact " bidimensional " to select; The multidimensional outward appearance that this has realized image, further provides other image processing selecting.
In one aspect, provide a kind of multiplanar imaging system, it comprises video camera, and comprises and can operate sending and receiving transmission with the one or more equipment of measurement space and depth information.In addition, data management module can operate to receive spatial data and on separated display, show different images.
Should be appreciated that, the invention is not restricted to concrete method, device or system, it can change certainly.Be also to be understood that term used herein, only for the object of describing specific embodiment, is not defined as restrictive.As used in this specification and claims, singulative " a ", " an " and " the " comprise plural reference implication, unless content is clearly stipulated in addition.Therefore, for example mention that " container " comprises combination of two or more containers etc.
Term used herein " approximately " when referring to measurable value such as quantity, temporary transient duration etc., mean comprise depart from specific value ± 20% or ± 10%, more preferably for ± 5%, even more preferably for ± 1% and will be more preferably ± 0.1% variation because such variation is suitable for carrying out disclosed method.
What unless otherwise defined, the implication of all technology used herein and scientific terminology or field term was generally understood with the those of ordinary skill in the field the present invention relates to is identical.Although can use in practice of the present invention and any method or material similar or of equal value described herein, still describe several method or material here.When describing and requiring right of the present invention, will use following term.As used herein, term " module " refers generally to contribute to the one or more discrete assembly of efficiency of the present invention.Alternatively, module can operate or depend on other one or more modules, so that operation.
" data acquisition module " refers to for reception information and continue to transmit this information for processing subsequently and/or the assembly (relating in this case imaging) of record/storage.
" image recording media " refers to physics (for example photographic emulsion) and electronics (for example tape and the computer data memory driver) assembly of most of image capture system, for example static or motion film camera or film or the static video camera (for example, digital) of electron capture.
" spatial data " refers to and the information that object is relevant with respect to the aspect of the adjacency of another object.In this case, element (for example object) in the selected part of the video camera aspect of system and the image of being caught in a structure by signal generating apparatus (signal that its transmission is selected, and record the reception of transmission equipment and the time of time measurement function of turning back to after this signal is deflected) is by depending on the reference information operate in tandem of spatial data and image capture and/or being linked to the operation of video camera.
The picture that " at least one picture element " catches as video camera, no matter be that potential image photochemistry is caught or electron capture, generally all have at least one different recognizable aspect, suppose that it is sky, rock etc.The image that major part is caught has a lot of such elements, the different image information of a part for the total image capture of conduct that such element generation is relevant from this aspect and relevant image information.
" code element " for example refers to the information flag added in the situation that be generally scanned to extract the bar code of the visible code element of its information comprising, or the time code data of the track of electronical record or file record for example relevant with Video Image Capturing time.Scanning device can be Laser Scanning Equipment.
" picture data element " finger shape code or comprise in addition generally makes object link and/or the data that combine observable and/or icon, mark and/or the marking that can scan, and its external information with at least one type appears on this object.Motion picture film generally include by film film manufacturer, arranged and/or as the digital reference mark of the function of video camera, allow emulsion itself that relevant non-picture data is provided, however these data with at same, there is catch in the raw stock (emulsion bearing film stock) of emulsion image-related.Object is connection layout picture and outside aspect, includes but not limited to audio frequency, other images and the additional image management option of record.
Different with bar code, " non-picture data element " refers to the data of electronical record, and after the physical record of data, the data of this electronical record are not conventionally changing aspect its medium visible of storage.Comprise that for Audio and Video data being read and are gathered into the electronics fetch equipment of the system of visible and audible result be an example.In this case, data storage medium for example tape and data driver is the example of stored possible non-picture data element, the spatial data that link is caught or be not other data of view data with storage separately or as the respective image of the different aspect of identical data storage medium.
" assembly of at least one selection of video camera " refers to an aspect: spatial data measuring equipment can not occupy definite position as the capture point of camera review, the plane of the photosensitive emulsion for example exposing in film gate or CCD chip.Therefore, in the image capture selectable skew of Existential Space between point of contact and/or lens and/or other video camera parts really, one of them is spatial point, collected spatial data will optionally be adjusted to this spatial point with reference, adjust spatial data select to make spatial data collector unit occupy the space identical with the video camera of selecting " part " or assembly to infer that the mathematics of gross space data result provides according to the skew of selecting.
As with reference to spatial data and optionally other standards and the computer of parameter and the function of specific program, " picture image of at least one modification " refers to that single two dimensional image is caught and is modified as at least two separated final images, to produce at least two visibly different data files from single image.Each represents the modification of original image of catching independent data file, and represents at least on the image of a modification.
" final picture image " refers to that the single two dimensional image of different revisions catches, so that the demonstration of the selective layering of the image of partly revising according to the spatial data gathering between initial pictures trapping period to be provided.For possible beholder, the final result showing is single final picture image, in fact it be included in a structure of at least two the different two dimensional image showing of optionally pulling together, function as display, so that the effect of selection to be provided, multidimensional (comprising " 3D ") impression and performance that for example two dimensional image is once caught.
" final many image frames " refer to caught single two dimensional image, and it is partly resolved into its image epitome according to the relevant separated data of the actual element occurring in the district with at image IT.If spatial data be special with from lens and/or actual point or the degree of depth of picture structure (and/or catching) or the separated data of distance dependent, the specific computer program as assembly of the present invention can partly move the epitome to separate original image according to the selected threshold value definite with respect to spatial data.Therefore, at least two different images that partly obtained by the information of appearance in original image is caught are presented at the different distance place from possible beholder that the single image impression with multidimensional impression is provided in tandem, and this image impression is shown final many image frames.
" final picture image is projected from least two distances " refers to obtain a possible outcome of the present invention, according to the spatial data of collecting when catching, by two dimensional image, revise, to major general's original resolve into " prospect " produce with " background " data separated image file (do not limit complete original version of catching image can be optionally as the image of shown one or more modifications and occur), distance projection and/or the propagation of the 3-d reproduction of the original original scene of catching image with those versions from separating, to simulate truly the spatial diversity of the original image epitome that comprises the scene of catching or picture.
" distance comprises along the different distance of beholder's sight line " is called the degree of depth along the distance of beholder's sight line: with respect to sight line of the present invention, be from measurable distance of possible beholder's eyes and can measure the distance of all images of straight line along this.Therefore, if tape measure extends through from beholder's eyes two dimensional image or the more multidisplay two dimensional image that display arrives two demonstrations, tape measure appears at that beholder's eyes point to or the position of his sight line, and the image that different depth place shows with respect to the height of the display of the side of the beholder towards expection and width in multi-dimensional display also appears on different measurable points.
" at least two different imaging planes " refers in one aspect: wherein the present invention shows a plurality of two dimensional image that produced by original two dimensional image in whole or in part, and wherein that gather and image-related other data (being spatial data in this case) can be to original image notices towards expectation aesthetic demonstration and/or the optionally modification (being digital modifications in this case) of observable result.
" height of at least one image being shown by equipment and width " refer to when the lateral dimension of projection equipment towards and during the beholder of the most close expection image with respect to the height of projection equipment and the height of width and width.
" height of equipment and width " refer to towards and the lateral dimension of the beholder's of close expection projection equipment.
The instruction (for example, software) that computer is carried out is provided to optionally prospect and background (or priority of other the different image correlations) epitome of allocation scenarios, and these epitomes are separated into different image informations.In addition, carry out known spatial data method of reseptance, to produce three-dimensional map and to produce the various three-dimensional epitome of image.
Can with in a plurality of media first for example film catch the picture in image, and in a plurality of medium second can be digital storage equipment for example.Non-picture, can be stored in arbitrary medium with the data of space correlation and/or be transferred to arbitrary medium or from arbitrary medium, and use during processing, for example, to be stored in a medium by contrast (, film) image on and the spatial data being for example stored in, on other media (, digital storage equipment) are revised image.
Provide computer software optionally to contrast spatial data and corresponding image, and can in the situation that not needing manual user input or instruction, revise image, to identify various piece and the spatial information about picture.Certainly, those skilled in the art will appreciate that there is no need to remove all aesthstic users who regulates that for example produces inputs.Therefore, software in fact automatically moves." conversion " program of computer run can operate, to revise the view data of initial captured for unlimited in fact finally displayable " version ", determined as user's aesthstic target.
In one aspect, provide a kind of video camera that is connected with depth survey element.Video camera can be a kind of in several types, comprises motion picture, numeral, high definition digital movie theatre video camera, television camera or film camera.In one aspect, video camera is to be for example that on June 5th, 2006 submits to and exercise question is " hybrid camera " that describe and prescription in the U.S. Patent Application Serial Number 11/447,406 of " MULTI-DIMENSIONAL IMAGING SYSTEM AND METHOD ".Such hybrid camera provides biconjugate burnt (dual focus) to catch, for example, for the burnt projection of biconjugate.According to an aspect of the present invention, hybrid camera is correspondingly provided with depth survey element.Depth survey element can provide for example sonar, radar or other depth survey features.
Therefore, hybrid camera can operate to receive image and the space correlation data that appear at the object in the view data of catching.The combination of feature makes extra creativeness select after production and/or during projection processing, to be provided.Further, available various mode provides view data from traditional motion-picture projection and/or television indicator to beholder.
In one aspect, hybrid camera for example digital high-definition camera system be configured to merge depth survey transmission and receiving element in the shell of video camera.Relevant with the degree of depth data based by the digitally captured picture data of identical video camera received and record optionally, thereby optionally provide depth information or range information from the relevant camera data in the key images district with catching.
In one aspect, the data relevant to the degree of depth are recorded in for storing same tape or the storage medium of digital visual data.Data (no matter whether being recorded on identical medium) are time codes or in addition by synchronously, for catch and store or catch and transmit, suitable reference between data that the respective picture of broadcast etc. is relevant.As mentioned above, the data relevant to the degree of depth can be stored on the medium that is different from the particular medium that stores picture data.When isolated ground is visually current, spatial data provides a kind of " relief map " of the image-region of structure.As used herein, the image-region of structure is commonly referred to as image " zone of action ".This relief map can then be used in optionally and revise view data in discrete and specific level, as intended for last demonstration, for example, for three-dimensional image effect.
In addition, catching and during stored picture data, collecting and data that record is relevant to the degree of depth simultaneously.Alternatively, depth data can be captured to each frame of DID within one short period, and/or video data is hunted down.Further, as disclosed in the interim and non-interim unsettled patent application of the Mowry confirming on be all incorporated in by reference here, its key frame that relates to numeral or film image generates, to provide, affect for example every width view data content of the enhancing of resolution, depth data needn't be with respect to each image collection of catching.The image of conventional images (for example, to distortion) is inferred to feature can allow 24 frames that are less than per second, with for example during image capture by spatial sampling and storage.Numeral infers that feature can also allow regular space to catch, and with the lenticular image with respect to catching, affects the image area in a lot of images of catching between the relevant spatial data sample of the object with image.For system is preserved acceptable spatial data sample, to obtain acceptable aesthetic results and effect, image " district " or epitome are changed between each spatial data sample simultaneously.Naturally, in static video camera or single frame application of the present invention, single spatial aggregation or " map " are aggregated and store according to each caught independent rest image.
Further, as disclosed in the interim and non-interim unsettled patent application of the Mowry confirming on be all incorporated in by reference here, and in addition as known in the art, other devices and selection scheme can optionally be coupled with space data collection imaging system described here.For example, catch the image that the lens of different focusing (or in addition due to optics or the impact of other image change and different) version gather, it can comprise the collection of spatial data disclosed herein.This can for example allow to be captured as application and the use of more separation of different editions of the lens picture of two different images.For example above-described key frame method has increased image resolution ratio (by allowing key frame very high at view data content intermediate-resolution, to inject image subsequently by these data), and also can be coupled with the spatial data acquisition device here, thereby produced unique key frame, generate hybrid device.With the method, (it can also optionally be caught to increase the key frame of total imaging resolution of material to key frame, extend the writing time of traditional sucrose simultaneously, as according to Mowry, be all incorporated in here by reference) can also make the spatial data relevant with it be saved.Therefore, key frame may be not only for picture data, and key frame is for providing the other side of image-related otherwise data of view data and the information relevant with other image details with allowing key frame; Such a example is image epitome distribute data (demonstration about such epitome with respect to beholder's position).
As disclosed in being all incorporated in by reference in the interim and non-interim unsettled patent application of the Mowry confirming above here, with extra selection scheme, strengthen and improve and produce rear and/or show and process, as the result of such data, these data are supplementing of picture to being caught by video camera.For example, can provide for showing the double screen of the image of the difference focusing of being caught by single lens.According to a aspect here, the parameter of the data based user expectation relevant to the degree of depth is selectively used for image area.Data are employed with optionally feature and/or priority, and can comprise the computing of usage data, and these data are being determined and/or determined that it is useful which view data is passed to aspect corresponding screen.For example, prospect and background data can be chosen to produce the viewing experience with special-effect or entertaining.According to the instruction here, the effect of three-dimensional visual effect as the view data occurring together with spatial diversity can be provided, thereby the prospect that simulation occurs during image capture and the spatial diversity true to nature of background image data, although needn't have identical distance between trapping period between display screen and actual foreground and background element.
The user's specification of separated screen display can be chosen to allow projection or independent " shooting " or image adjusted (for example dimensionally) to obtain the final image effect of expectation naturally.Be chosen in a plurality of displays of the distance changing from beholder or the possibility that display unit allows completely separated and strict multidimensional to show.Possibly, for example, compare equally little or even less image epitome with single " pixel " can have its own unique distance in the position with respect to beholder in the demonstration of revising, and as single real screen, can comprise with respect to beholder or movable scene or the video camera of catching it unique distance to each epitome of the things up to just viewed.
In being arranged on video camera or be provided with data relevant to the degree of depth that the depth measurement device of video camera collects make all images data and wherein selected region be treated as especially possibility.For example, disclosed skew screen method in above-mentioned interim and non-temporary patent application is for example passed through in copying of the three-dimensional picture entity of object, or by other known technology, is implemented as relevant with the view data of catching alternatively.The existence of the excessive data relevant with the object of visually catching therefore no matter for film, TV or static photography too much production is all provided after and special processing selecting, otherwise traditional photography or digitally captured in will lose these and produce after and special processing selecting.Further, from single image, produce and can optionally all epitomes of the image of initial captured be kept at each produced new image file according to the different images file of Conversion of Spatial Data.According to spatial data, force specific modification, to obtain the project effect of expectation, thereby produce different final image files, described different final image file needn't " reduce " image epitome to become different mutually.
In a structure more of the present invention, second (adding) space/depth survey equipment can operate together with video camera, and needn't be a part for video camera or the physics immediate area that is even positioned at video camera physically.Consider outside the camera lens visual field, for the data of the object part of other effect objects and digital operation, a plurality of transmission/receptions (or other degree of depth/spaces and/or 3D measuring equipment) can be optionally for example with respect to Camera Positioning, to provide extra position, shape and the range data (and other relevant location and shape datas) of the object in the camera lens visual field, to strengthen the selection after production.
In one aspect, a plurality of space measurement Array selections ground is with respect to camera lens location, so that the clearly and optionally detailed three-dimensional data map of the relevant environment of the things taken with video camera and object to be provided.Data map is used for revising the image of being caught by video camera, and optionally produces unique projection experience and the visual effect of experiencing close to the actual mankind, or the multidimensional impression of at least layering providing in two-dimentional movie theatre is provided.Further, can consider known imaging selection with image-related spatial data, it will be only three-dimensional nature in " imitation " or the image that temporarily provides that known imaging is chosen in, and even there is no " some " spatial datas or exceed other data of the view data of the information that provides relevant with the dimension of the increase of image.More than one image capture camera can be further used for collecting such multiposition image and the information of space data collection system.
Only for the object of levying property of example, rather than be used for limiting the scope of the invention by any way, provide for realizing the example of concrete aspect of the present invention.
Relate to by video camera, numeral or film capture and record picture and the open of range information is further expanded here.Further, here disclose and comprised the Biscreen display of translucent the first screen (two temporarily all in a structure, and be physically translucent in other are open) method of the present invention, particularly to demonstrate in manageable structure in current techniques.
The invention provides a kind of selectivity catches with the digital camera of registered depth data (by optionally from the advantage point of video camera or with respect to the analysis of other location transmission of video camera and the reception of this transmission, be included in the situation of use to the more than one advantage point of the degree of depth in image data), and in one aspect, video camera is digital.
Here, film camera (and/or digitally captured system or mixing film and digital system) and the coupling of depth data harvester, to allow for example camera lens position or optionally carry out optionally record near this position of advantage point from selecting, this depth information (or data) can belong to the image area of Selective Separation in collection, or can optionally be distributed to each pixel of display system of Selective Separation or optionally little image area, optionally width and the degree of depth with initial collection form, for example, the depth data numeral relevant with each pixel of high definition digital image capture and tape deck (for example, SONY CINE ALTA and relevant video camera).
Optionally, such depth data can carry out record by " dual system " record, comparison device (is for example provided between the image of taking and depth data, there is the dual system SoundRec that utilizes film), or actual film negative (for example can be supported magnetic or other tape decks, magnetic " sound bar " or magnetic devices for example KODAK for record DATAKODE on film), in particular for record about the depth data of image area and/or epitome.
Mention with depth-sampling and tape deck numeral, film or other image capture apparatus coupling, corresponding to the image of catching by image capture apparatus and can comprise that static digital or film or other static picture capture cameras or tape deck are important.The present invention is directly involved in the static of " photography " is caught, as to the capturing movement of film and/or TV and/or other moving image display systems.
In the projection stage, numeral and/or film projection can optionally be used.Consider by by " distribution " to the image area (or object and/or epitome) of projection arrangement or make district become different from other such districts, object and/or epitome in capturing visual, relate to coming the rear device of production of the view data of digitally captured or film capture disclosed herein freely may be subject to the impact of depth data.
An example is main screen, and it is than another screen that is called as rear projection screen here closer to spectators, and the former is called as prospect screen.
Prospect screen can be a kind of physically (or electronically) transparent type, with (partly), allows image to be presented on this prospect screen, also allows to watch discontinuously rear projection screen simultaneously.
In a possible structure, screen can be two shells (sheath) on roller bearing, optionally have normal movie theatre screen size, this structure is never restricted to the claim here the possible structure (or other translucent screen creation apparatus) of all physics, electronics and chemistry.
Here, should " shell " be screen, there is optionally large part and/or the band that can reflect, and other parts and/or band do not reflect.Object is the image that shows front projection in portion of time, and in portion of time, allowing spectators " to see through " prospect screen to rear projection screen, this makes optionally image display device, and for example back projection or other common images show and select to be not limited to projection (or any type).
Image display device can optionally be connected by electronics, take and allow the image that shows on prospect screen as stable and clearly, as interruption or digital projection to experience (film or numeral) the same.
Described " shell " optionally has the horizontal or vertical or means of " movement " otherwise; Have the object of (optionally reflection) projection surface of the solid and partially transparent of generating portion, the spectators that optionally allow to be positioned at both the place aheads watch the experience of two images on prospect and rear projection screen completely continuously.
Two screens described here are exemplary.Significantly, allow to consider and/or show that the more very many disclosure of screen and aspects of invention of multidimensional epitome can be included in structure of the present invention.Further, for example the complicated projecting device in solid material or liquid or other image display surface devices can allow not limit in fact the demonstration of dimension, the view data of not only being distributed and distributing (in general bidimensional display unit) by vertical and level in the degree of depth is provided, allows third dimension degree to show that at it in result be optionally discrete.
For example, have screen that 100 degree of depth select for example wherein cubical district show that the laser of (" screen ") or other external drive systems allow to be assigned with (and no matter catch film or numeral) in the separated simulation of spatial diversity of the actual object that view data represents in the picture of catching.For example " magnetic resonance " imaging, such display system can have external magnetic or other electronic effect devices and will change or " instruction " is imposed to such complex multi-dimensional projecting device (aspect), (or " cube " screen, although the shape of screen needs not be similar square or cuboidal certainly) image is presented in the degree of depth when impact is hunted down in the simulation of spatial relationship (or degree of depth) of image of object of (digitally or on film or other image data recording apparatus) be assigned with.
The laser effect device that shows image can also be the inner result of impact thereby the example that affects the external device (ED) of the image being presented by multidimensional projecting device (and/or material), and the assembly of multidimensional projecting device (and/or material) and/or aspect can be presented at the color of selection or image epitome on the Chosen Point in multidimensional screening zone according to laser (or other outside or inner device of forcing).Series of displays device also can be configured to such multidimensional screen, when the screen of selecting is when showing the target (or selection) of image epitome (and/or pixel or equivalent) according to the degree of depth or from the spectators that watch " distance " or the reference point of other selections, this multidimensional screen permission is watched by the part of other screens.
The present invention provides catching of depth data here, this depth data is enough separated optionally to utilize enough " degree of depth " and picture data that (with " providing ") so following Display Technique is provided, to provide partly the disclosed multidimensional that may be movie theatre is experienced here to show result.
Here the possible ownership character of technology obviously allows to select to catch with projecting device optionally to get rid of other such catching and projecting device, wherein uses multidimensional of the present invention to catch and demonstration aspect.For example, " film " can be considered to an image capture apparatus relevant with this system, but is unique acquisition equipment.
Consider similarly two or more " focusings " priority of the one or more lenticular images of (or the same) scene of selectivity for catching, the present invention is also applied to the image of catching as described herein, for example " biconjugate Jiao " picture.The catching (static or motion) and here can optionally be presented on the different screen of multidimensional effect of such record of the different scenes that focus on.For example prospect and the rear projection screen of the reception view data relevant with background focus version with the prospect of same scene and/or lenticular image.
Very clear, the major advantage of a lot of structures of the present invention is that view data can be optionally, and (with on purpose and/or automatically) is assigned to the image display device (for example screen) at (rather than only on screen of the single distance from spectators) of the selectable distance from spectators.Utilization can select such depth image of quantity to show select/device, such selection can produce the powerful viewing experience of watching close to " real life " by two " skew " eyes, and it has embodied distance and the degree of depth (different from single lens viewing apparatus).
The creativeness of photography, film and TV (and other display systems) selects to comprise now the ability of " object " that creatively affect image area and catch, how to be hunted down or optionally to change and synchronize for creative effect with them.
With reference to accompanying drawing, wherein similar reference number refers to similar element.Fig. 1 shows beholder 102 and display of the present invention 110 from end view.This structural table is clear occupies three-dimensional projection " region ", and in this structure, it comprises display itself.Here, not limiting other selects and the inner demonstration possibility producing, the impact that generation is forced in outside itself exerts an influence to demonstration aspect, affect selected quality and brightness (and naturally, colors component forms) the outward appearance of " color ", it may optionally appear at have three-dimensional any some place of " viewing area ".
Pixel 104 appears on the display plane with respect to the prospect of beholder.This plane in essence with the two-dimensional plane synonym of movie theatre (and most of display system, comprise computer, TV etc.).Here, pixel 106 and 108 shows the character of the light-transmissive of display, allows these pixels not only with respect to height and width (with respect to pixel 104) but also with respect to the difference place of the degree of depth.With regard to the degree of depth, with reference to being size to display from left to right in the end view of Fig. 1, the degree of depth also refers to along the distance between the epitome that may show recently and farthest of beholder's sight line.In screening zone, the quantity of possible location of pixels and/or imaging plane can be according to the picture target selection of structure and expectation.
In important structure, screening zone (for example) is " cube " of clear (or translucent), and wherein the combination of cube inner (material and/or assembly) allows to appear at the generation of light of visible ray, selectable color and the brightness (and generally other the relevant traditional Show Options to watch-dog and digital projection) at any some place in cube.Probably, when single " picture " that be captured as two dimensional image by lens is by cube (or other three-dimensional) viewing area during with respect to height and width quilt " distribution ", in the structure of expection for example, by the image epitome being produced of only having one to occur with single height and width (pixel, although producing or transmit the display light of epitome is not limited to as the pixel that produces the device of observable image section), as two dimensional image.But, the distance of the actual acquisition object in the image that more than one image epitome can for example, be caught according to () appears at the same depth identical screen distance of beholder's sight line (or with respect to) and locates, when being caught by video camera, object may appear at the same distance place from video camera really.
Fig. 2 shows movie theatre example according to content above.Again see the beholder 102 with respect to three dimensional display and/or viewing area 104, here, aspect, characteristic and/or the assembly (and as successively working to produce the function of display and the external equipment of view data in viewing area) in the example 202 impact excitation viewing areas of outside imaging.This example shows the color component (for example laser is possible method and/or the effect of impact) by the array transmission of optical transmission device, here, the generation that three such equipment is shown visible ray in little district in cube very much (for example, if be not in fact pixel, the region of synchronizeing with pixel), wherein, three lasers or provide the equipment of light to allow concentrating (for example, separated color component selection ground intersects) of impact.
In a structure, the material character of display itself or display part provides display unit by the light working and/or provide for outside.Fig. 2 has shown a single point of the light being produced.Naturally, a lot of such points (copying of whole picture of catching is provided ideally) are provided by such array, comprise that the image that such outside provides forms necessary speed and the coverage (again, the function of display or exemplary " cube " viewing area and/or other characteristic and assembly are pulled together) affecting.
Magnetic resonance imaging is the example of atypical imaging device, and (magnetic) allows the watching of cross section of three dimensional object, and other parts of this object the from then on particular display of " thin slice " are removed.Here, mean the inverted structure of such method of the imaging effect that outside (for example magnet of MRI) electronic effect produces here will similarly the region of (externally in the demonstration result of impact) impact selection, the cross section except the region of other viewing areas for example, although allow total screen distance of (from beholder) possible selected quantity or how many " inverted MRI " can be provided in essence with the form changing fast.
Further, as watch-dog the same, the display of visibly different chromatic zones and the optionally transparency of device that produce pixel or synonym can intactly be provided in inside, as the function of display.The variation of display, displacement or other variable aspect will provide with respect to other points " darker " on some points and see the ability in display (or farther along its sight line) to beholder.In essence, partly providing may equally little with conventional pixel (or less), or with the equally large darker transparency that is suitable for aesthetically the display effect of expectation.
With reference now to Fig. 3 A and 3B,, show multi-panel monitor displaying place, comprise that the prospect of watching catches the beholder 307 of version 3 01, prospect is caught version 3 01 and can optionally be revised by system user.Prospect is caught version 3 01 and for example by data administrator and synchronizer, by data storage, is provided.Further, image-generating unit 300 projection and/or provide prospect to catch version 3 01 on the foreground image display of light-transmissive optionally, this display may be provided in display screen, comprises reflecting part 303 in mechanical screen construction as shown in FIG 3 B of example and the part 302 of transparent/light-transmissive.
In the mechanical screen construction shown in Fig. 3 A and 3B, the length of removable screen transmits via roller bearing motor 304.Screen is optionally mobile to allow screen to be rendered as solid fast enough, the aspect of light-transmissive disappears with enough fast leg speed from part 302, permission is when being shown or being shown on display band 303 by display band 303, " by " apparent foreground image information watches continuously, display band 303 can be the aspect of direct viewing equipment aspect or image reflection in due course.
Prospect shows can have non-mechanical character, comprises the selection of the equipment with semi-transparency property, or is assembled into the semi-transparency property that provides variable.Further, prospect shows it can is the direct viewing equipment of change, it take the image information relevant with the view data of foreground focused is feature, meanwhile, for being positioned at optionally continuous background thereafter, showing and maintains transparency, translucence or transmissive photosensitiveness.
The view data of optionally revising that the background that since backdrop display curtain 306, free imaging device 305 provides is caught version 3 08 is feature, imaging device 305 can be rear projector equipment, direct viewing watch-dog or other direct viewing equipment, comprise being optionally the front projection equipment of same unit, this same unit is for watching 300 foreground image data is provided.Background is caught version image 308 and can optionally be produced continuously or discontinuously, as long as the character by light-transmissive or the observable image setting of mechanical structure of being interrupted transmission have sufficient continuity beholder is maintained to continuous, continual background frame (that is, by people " visual perseveration ").By this way, beholder's advantage point 307 has been experienced the layer-stepping multidimensional effect of a plurality of focuses, and these difference of focus seldom appear at the different distance place from them.Therefore,, when human eye is limited to while only selecting one " focus " in one case naturally, the constant outward appearance of a plurality of layers of the epitome of a plurality of focusing or same scene causes the new dramatic aesthetic experience can not find in the prior art.
Although a lot of examples described here refer to arenas display, the present invention is not so limited.Family's display, computer display, computer game and other typical consumers and Professional display monitor place can merge the layered displays of the physical separation as instructed here, the similar effect producing to realize the validity of a plurality of versions of the scene of being caught by identical lens.In addition, although produced, be mainly the picture of foreground focused, traditional bidimensional product in prior art for example, catching of " key frame " of a background focus even per second is also valuable.Such data are not at present for film issue, TV or other available places.But, the current key frame of focusing and the whole bag of tricks of other data managements selection that occurs utilizing the data for watching, example is method as described herein.
Therefore, when being even used for strengthening the production reprocessing of image can not inferring a lot of image information of catching completely when focus disclose picture detail, even in interim " key frame ", the data that second of focusing catches version also will allow product " reservation " and have otherwise the effective image information all lost.
Therefore, the feature here providing today relates to the method for catching valuable data, and when in the future development is when showing the new innovation of key frame data, the user of tomorrow (the same with the color film of prior art) is by the information having compatible and more interesting projection necessity, for watching following system and the technical development that can utilize additional picture data.
With reference now to following exemplary and relevant discussion,, further describe the present invention.
Thereby after the product aspect of image that the multifocal video camera apart from structure is taken and the projection of system or production, aspect is for example included in multi-screen demonstration place.
At first, picture enters video camera via the single lens of catching.The lenticular image steering gear of selecting two selectivity that for example prism or mirror equipment are divided into lenticular image the picture (that is, light) of identical gathering equate the part of (or not etc.).Thereafter, separated digitlization (video camera) unit occurs side by side, and each receives a selected separated lenticular image.
The corresponding digital quantizer that is delivered to these camera units at light is for example before CCD, relevant chip or other known digital quantizers, and additional lens mechanism (is shown the optics aspect of focusing for each corresponding lenticular image partly provides independent focusing ring; See the United States serial 11/447,406 that on May 5th, 2006 submits to, its disclosure is here all incorporated to by reference).Focusing ring is unique for each in two or more image version, and allows a unit optionally to focus on the version of the lenticular image in foreground elements and optionally to focus on other version digitlizations in background element.
Each video camera can operate to record the digitized image of same lens image, and the difference submitting to according to the second lens of forcing (or other focusing arrangements) aspect focuses on priority.Record can be selected in tape, DVD or other known digitlizations or videograph.The explanation here means to be restricted to the digitized video to TV or video camera, and alternatively comprises all aspects of film and static photography gathering-device.Therefore, " recording medium " is not to be solved, and the more specifically collection of lenticular image and processing.
Illumination and video camera setting provide the scope that strengthens various object lens, comprise the common apparatus that affects the depth of field and other photography aspects.
Fig. 4 shows video camera 402, it can be formatted as for example film camera or high definition digital video camera, and with single or a plurality of spatial data sample devices 404A and 404B coupling, for catching image and the spatial data of the exemplary screen of two object-trees and desk.In the example shown in Fig. 4, spatial data sample devices 404A is coupled to video camera 402, and spatial data sample devices 404B does not have.Foreground spatial sampled data 406 has especially realized the possible separated of desk and tree in final demonstration with spatial context sampled data 410, thereby provides at each element from the different depth/distance place of beholder along the epitome about projection of beholder's sight line.Further, background sampled data 410 provides view data to process basis or reality " relief map " record of separated image epitome optionally, it is general for example, with the recognizable object (, the desk shown in Fig. 4 and tree) in caught image relevant.Image high definition recording medium 408 can be for example film or electronic media, and film or electronic media are optionally synchronizeed with the spatial data being provided by spatial data sample devices 404 and/or be successively recorded with spatial data.Referring to for example on July 6th, 2006, submit to and exercise question be the U.S. Patent Application Serial Number 11/481 of " SYSTEM AND METHOD FOR CAPTURING VISUAL DATA AND NON-VISUAL DATA FRO MULTIDIMENSIONAL IMAGE DISPLAY ", 526, its content is here all incorporated to by reference.
During the lookization of black and white motion picture is processed (colorization), colouring information is generally added to " key frame ", and some frames of uncoloured film have the color of the result for inferring conventionally, and conventionally never in any form with initial captured the actual color of the object on black and white film time relevant.(in the different films of taking in black and white) color " information recording " is caught and stored to " three colour band technicolors (technicolor3strip) " color separated technique, for rebuild original scene displayable version, show color " increases ", as the demonstration that presented by actual color is informed during initial shooting.
Similarly, according to the instruction here, the spatial information of catching during initial image capture can be informed " version " of the unlimited amount in fact of the raw frames that (the same with three colour band technicolor techniques) catches by camera lens potentially.For example, because " how red (how much red) " is variable in the manufacture printing from three colour band technicolor printings, do not get rid of modification and be actually redness rather than blue, the present invention for example, considers the aesthstic choice and application of such scope when obtaining the effect (, three-dimensional visual effect) of expectation from picture and its corresponding space " relief map " record.Therefore, for example, can assemble and have the optionally spatial data of details, meaning " each image is assembled how many spatial datas " is the variable of being informed best by the predetermined display apparatus of " tomorrow " or the assembly of expection display device.According to thering is sound, there is the historical effect of the original film of color etc., even at it to catching and show before such material having cost benefit, to the value of such scheme of use in future, application and system compatibility, be known.In today of imaging development, even if be not for many years applied to the version of display of the image of catching, the value of collection spatial information described here may be also huge, and therefore very appropriate to the business nominator of present image projection, comprise motion picture, still photography, video game (gaming), TV and relate to other projections of imaging.
For a person skilled in the art, other purposes provided by the invention and product are apparent.For example, in one aspect, the unrestricted image display area of quantity presents at the different depth place of the sight line along beholder.For example, each " pixel " that 10 inches of dark displays of cube clearly provide image according to each pixel apart from space and the depth location of video camera at different depth place.On the other hand, three-dimensional television screen is provided with the background area of " finally ", in this video screen pixel for example from left to right and optionally from closely to far away (for example, by level, provided from front to back), compared with at some other depths, more data may appear at the background area of " finally ".Before last background, foreground data has occupied " sparse " depth areas, perhaps only has a small amount of pixel to appear at specific depth point.Therefore, image file can be preserved image epitome by the form optionally changing, and for example, in a file, background provides (for example, being forced) with very soft focus.
Although clear for what understand, by illustrating and giving an example and described aforesaid invention with some details,, to those skilled in the art, apparent, according to instruction of the present invention, can carry out some variation and modification and not depart from purport and the scope of claims it.

Claims (10)

1. for the system of catching and revising of picture image, it comprises:
IMAQ lens and video camera, it can operate and on image recording media, catch described picture image;
Data acquisition module, it can operate to collect the spatial data relevant with at least one picture element in caught picture image, and described data are also relevant to the spatial relationship of the assembly of at least one selection of described video camera with described at least one picture element;
Code element on described image recording media, described code element is relevant with described spatial data, interrelated with respect to described spatial data for making from described at least one picture element of described picture image; And
Computing equipment, it can operate according to described spatial data and change described at least one picture element to produce the picture image of at least one modification.
2. system according to claim 1, wherein, described code element is picture data element.
3. system according to claim 1, wherein, described code element is non-picture data element.
4. system according to claim 1, wherein, described code element is the recordable magnetic material providing as the part of described recording medium.
5. system according to claim 1, also comprises display, and described display produces light with the demonstration of the picture image of at least one modification described in projection and produces final picture image.
6. system according to claim 5, wherein, described final picture image is projected from least two distances.
7. system according to claim 6, wherein, described distance comprises along the different distance of possible beholder's sight line.
8. system according to claim 5, wherein, described picture image is modified and produces the picture image of two or more modifications, to show final many image frames.
9. system according to claim 1, wherein, described image recording media is photographic film.
10. system according to claim 5, wherein, described final picture image is comprised of at least two different imaging planes.
CN201310437139.8A 2005-07-27 2006-07-27 System, apparatus, and method for capturing and screening visual images for multi-dimensional display Pending CN103607582A (en)

Applications Claiming Priority (22)

Application Number Priority Date Filing Date Title
US70291005P 2005-07-27 2005-07-27
US60/702,910 2005-07-27
US71134505P 2005-08-25 2005-08-25
US71086805P 2005-08-25 2005-08-25
US60/710,868 2005-08-25
US60/711,345 2005-08-25
US71218905P 2005-08-29 2005-08-29
US60/712,189 2005-08-29
US72753805P 2005-10-16 2005-10-16
US60/727,538 2005-10-16
US73234705P 2005-10-31 2005-10-31
US60/732,347 2005-10-31
US73914205P 2005-11-22 2005-11-22
US60/739,142 2005-11-22
US73988105P 2005-11-25 2005-11-25
US60/739,881 2005-11-25
US75091205P 2005-12-15 2005-12-15
US60/750,912 2005-12-15
US11/447,406 2006-06-05
US11/447,406 US8194168B2 (en) 2005-06-03 2006-06-05 Multi-dimensional imaging system and method
US11/481,526 2006-07-06
US11/481,526 US20070122029A1 (en) 2005-07-06 2006-07-06 System and method for capturing visual data and non-visual data for multi-dimensional image display

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN200680034117.5A Division CN101268685B (en) 2005-07-27 2006-07-27 System, apparatus, and method for capturing and screening visual images for multi-dimensional display

Publications (1)

Publication Number Publication Date
CN103607582A true CN103607582A (en) 2014-02-26

Family

ID=39989869

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201310437139.8A Pending CN103607582A (en) 2005-07-27 2006-07-27 System, apparatus, and method for capturing and screening visual images for multi-dimensional display
CN200680034117.5A Expired - Fee Related CN101268685B (en) 2005-07-27 2006-07-27 System, apparatus, and method for capturing and screening visual images for multi-dimensional display

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN200680034117.5A Expired - Fee Related CN101268685B (en) 2005-07-27 2006-07-27 System, apparatus, and method for capturing and screening visual images for multi-dimensional display

Country Status (1)

Country Link
CN (2) CN103607582A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107230187A (en) * 2016-03-25 2017-10-03 北京三星通信技术研究有限公司 The method and apparatus of multimedia signal processing
CN110609616A (en) * 2019-06-21 2019-12-24 哈尔滨拓博科技有限公司 Stereoscopic projection sand table system with intelligent interaction function

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101717787B1 (en) * 2010-04-29 2017-03-17 엘지전자 주식회사 Display device and method for outputting of audio signal
US9971153B2 (en) * 2014-03-29 2018-05-15 Frimory Technologies Ltd. Method and apparatus for displaying video data

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1014112A2 (en) * 1998-12-22 2000-06-28 Matsushita Electric Industrial Co., Ltd. Rangefinder and imager
CN1275871A (en) * 2000-07-21 2000-12-06 清华大学 Multi-camera video object took video-image communication system and realizing method thereof
CN1427961A (en) * 2000-05-09 2003-07-02 崔富辰 Movie camera and photographing method for obtaining 3-D image

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1014112A2 (en) * 1998-12-22 2000-06-28 Matsushita Electric Industrial Co., Ltd. Rangefinder and imager
CN1427961A (en) * 2000-05-09 2003-07-02 崔富辰 Movie camera and photographing method for obtaining 3-D image
CN1275871A (en) * 2000-07-21 2000-12-06 清华大学 Multi-camera video object took video-image communication system and realizing method thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107230187A (en) * 2016-03-25 2017-10-03 北京三星通信技术研究有限公司 The method and apparatus of multimedia signal processing
US11081137B2 (en) 2016-03-25 2021-08-03 Samsung Electronics Co., Ltd Method and device for processing multimedia information
CN107230187B (en) * 2016-03-25 2022-05-24 北京三星通信技术研究有限公司 Method and device for processing multimedia information
CN110609616A (en) * 2019-06-21 2019-12-24 哈尔滨拓博科技有限公司 Stereoscopic projection sand table system with intelligent interaction function

Also Published As

Publication number Publication date
CN101268685A (en) 2008-09-17
CN101268685B (en) 2013-10-30

Similar Documents

Publication Publication Date Title
CN104935905B (en) Automated 3D Photo Booth
US6795241B1 (en) Dynamic scalable full-parallax three-dimensional electronic display
US20180338137A1 (en) LED-Based Integral Imaging Display System as Well as Its Control Method and Device
JPH04504333A (en) How to convert 2D image to 3D image
RU2453922C2 (en) Method of displaying original three-dimensional scene based on results of capturing images in two-dimensional projection
CN101542536A (en) System and method for compositing 3D images
Devernay et al. Stereoscopic cinema
CN2667827Y (en) Quasi-panorama surrounded visual reproducing system
US20070122029A1 (en) System and method for capturing visual data and non-visual data for multi-dimensional image display
CN101268685B (en) System, apparatus, and method for capturing and screening visual images for multi-dimensional display
Brown Avatar: Stereoscopic cinema, gaseous perception and darkness
KR101177058B1 (en) System for 3D based marker
Antlej et al. Real-world data for virtual reality experiences: Interpreting excavations
CN101292516A (en) System and method for capturing visual data
US20070035542A1 (en) System, apparatus, and method for capturing and screening visual images for multi-dimensional display
Lucas et al. 3D Video: From Capture to Diffusion
KR100938410B1 (en) System, apparatus, and method for capturing and screening visual images for multi-dimensional display
Flaxton HD Aesthetics and Digital Cinematography
Markiewicz-Patkowska et al. Three-dimensional photography as a new technique to make didactic presentations more attractive
Richardt et al. Video for virtual reality
Tanaka et al. A method for the real-time construction of a full parallax light field
Regalbuto Remote Visual Observation of Real Places through Virtual Reality Headsets
WO2000035204A1 (en) Dynamically scalable full-parallax stereoscopic display
Holbrook Three-dimensional stereographic visual displays in marketing and consumer research
AU649530B2 (en) Improvements in three-dimensional imagery

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20140226