KR100938410B1 - System, apparatus, and method for capturing and screening visual images for multi-dimensional display - Google Patents

Abstract

Systems, apparatus, and methods are provided for capturing visual images and spatial data to provide image manipulation options such as for multidimensional displays.

Multidimensional Display, Visual Image, Spatial Data, Capture, Screening

Description

SYSTEM, APPARATUS, AND METHOD FOR CAPTURING AND SCREENING VISUAL IMAGES FOR MULTI-DIMENSIONAL DISPLAY} for Capturing and Screening Visual Images for Multidimensional Display

Cross Reference to Related Application

This application is filed on July 27, 2005, entitled "SYSTEM, METHOD AND APPARATUS FOR CAPTURING AND SCREENING VISUALS FOR MULTI-DIMENSIONAL DISPLAY," the entire contents of which are incorporated herein by reference. U.S. Provisional Patent Application No. 60 / 711,345, filed Aug. 25, 2005, entitled "SYSTEM, METHOD APPARATUS FOR CAPTURING AND SCREENING VISUALS FOR MULTI-DIMENSIONAL DISPLAY (ADDITIONAL DISCLOSURE)" , U.S. Provisional Patent Application No. 60 / 710,868, filed Aug. 25, 2005, entitled "A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY OF FILM CAPTURE," "A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY OF FILM CAPTURE," U.S. Provisional Patent Application No. 60 / 712,189, filed August 29, 2005, entitled OF FILM CAPTURE, 16 October 2005, entitled "A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY OF DIGITAL IMAGE CAPTURE" On day US Provisional Patent Application No. 60 / 727,538, filed on October 31, 2005, entitled "A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY AND EFFICIENCY OF FILM CAPTURE WITHOUT CHANGE OF FILM MAGAZINE POSITION" U.S. Provisional Patent Application No. 60 / 739,142, filed November 22, 2005, entitled "DUAL FOCUS", "SYSTEM AND METHOD FOR VARIABLE KEY FRAME FILM GATE ASSEMBLAGE WITHIN HYBRID CAMERA ENHANCING RESOLUTION US Provisional Patent Application No. 60 / 739,881, filed November 25, 2005, entitled "WHILE EXPANDING MEDIA EFFICIENCY," and "A METHOD, SYSTEM AND APPARATUS FOR INCREASING QUALITY AND EFFICIENCY OF (DIGITAL) FILM CAPTURE." US Patent Application Serial No. 60 / 750,912, filed December 15, 2005, and claims priority thereto. This application is filed on July 6, 2006, entitled "SYSTEM AND METHOD FOR CAPTURING VISUAL DATA AND NON-VISUAL DATA FOR MULTIDIMENSIONAL IMAGE DISPLAY," the entire contents of which are incorporated herein by reference. And claims priority to US patent application Ser. No. 11 / 447,406, filed Jun. 5, 2006, entitled " MULTI-DIMENSIONAL IMAGING SYSTEM AND METHOD. &Quot;

This application, SYSTEM, APPARATUS, AND METHOD FOR, which claims priority to U.S. Provisional Patent Application No. 60 / 701,424, filed on July 22, 2005, as its entirety is described herein in its entirety. US Patent Application No. __________, filed Jul. 24, 2006, titled INCREASING MEDIA STORAGE CAPACITY; And A METHOD, SYSTEM AND APPARATUS FOR EXPOSING IMAGES ON BOTH SIDES OF CELLOID OR OTHER PHOTO SENSITVE BEARING MATERIAL, claiming priority over U.S. Provisional Patent Application No. 60 / 692,502, filed June 21, 2005. The entire contents of US Patent Application No. __________, filed June 21, 2006, are further incorporated by reference. This application is filed on July 6, 2006, entitled "SYSTEM AND METHOD FOR CAPTURING VISUAL DATA AND NON-VISUAL DATA FOR MULTIDIMENSIONAL IMAGE DISPLAY", as its entirety is described herein in its entirety. US Patent Application No. 11 / 473,570, filed June 22, 2006, entitled "SYSTEM AND METHOD FOR DIGITAL FILM SIMULATION," "SYSTEM AND METHOD FOR INCREASING EFFICIENCY AND QUALITY FOR EXPOSING IMAGES ON CELLULOID. OR OTHER PHOTO SENSITIVE MATERIAL, filed U.S. Patent Application No. 11 / 472,728, filed Jun. 21, 2006; U.S. Patent Application, filed June 5, 2006, entitled "MULTI-DIMENSIONAL IMAGING SYSTEM AND METHOD." The entirety of US Patent Application No. 11 / 408,389, filed April 20, 2006, filed 11 / 447,406, and entitled “SYSTEM AND METHOD TO SIMULATE FILM OR OTHER IMAGING MEDIA”, is further incorporated by reference.

FIELD OF THE INVENTION The present invention relates to imaging, and more particularly to capturing visual and spatial data to provide image manipulation options, such as for multidimensional displays. The invention additionally relates to a system, apparatus or method for generating light to project a visual image in three dimensions.

As the convergence of cinema and TV technology, for example, with digital video discs, as well as the viewing options and quality of media presented by the computer and via the Internet, among other things, the display screen size, resolution, and sound, Likewise, audio-visual selection has been improved and expanded. The development of home viewing technology has negatively impacted the value of the cinema (eg movie theater) experience, and the difference in display quality between home viewing and cinema viewing can threaten cinema screening sites and the industry as a whole. Has been minimized to a degree. Home viewers can and will continue to enjoy many of the technical advantages that were once available only in movie theaters, thereby increasing the need for new and unique experience effects that are only available in cinemas.

When an image is captured in a familiar "two-dimensional" format, such as those common in film cameras and digital cameras, the three-dimensional reality for the objects in the image is unfortunately lost. In the absence of specific data of the actual image aspects, the human eye infers the depth relationship of the objects within the image, including the image that is typically projected in a cinema and presented on TV, computers and other displays. Done. Accordingly, visual cues or "instructions" known to the viewer are assigned "intellectually" to the foreground and background and in relation to each other, at least to the extent that the intellect can perceive them. If a real object is viewed by a person, the spatial or depth data is interpreted by the brain as a function of the offset position of the two eyes, for example, beyond what is captured in a quadratic fashion with a prior art camera. Allow the human to interpret the depth of the object. What human perceptions cannot automatically "arrange" based on experience and logic is, in fact, deeply laid out in the usual way by the viewer's intellect, in order to allow the visual "spatial sensation" in human perceptions. Is assigned to.

Techniques such as sound waves and radars are known that involve transmitting and receiving signals and / or electronically generated transmissions to measure the relationship of objects. Such techniques typically indicate the distance and / or spatial relationship between objects within an individual measurement area and within the unit that is broadcasting the signal or transmission by calculating the "return time" difference of the transmission to the electronic receiver. It involves providing the data. Spatial relationship data is provided by, for example, distance sampling and / or other multidimensional data collection techniques, which data is coupled with visual capture to create a three dimensional model of the region.

Presently, visual data captured by, for example, a camera may be included, including subsequent digital delineation identification between image features to present an enhanced and layered display of multiple images and / or image features. There is no system or method for providing an aesthetically superior multidimensional visual that integrates with the actual spatial data related to the aspect of the visual.

TECHNICAL FIELD The present invention relates to imaging and, more particularly, to capturing visual and spatial data to provide image manipulation options such as for multidimensional displays, such as three dimensional displays. The invention additionally relates to a system, apparatus or method for generating light to project a visual image onto a three dimensional display. The present invention provides a system or method for providing multidimensional visual information by capturing an image comprising a visual aspect with a camera. Furthermore, spatial data related to the visual aspect is captured, and image data is captured from the captured image. Finally, the method includes selectively transforming image data as a function of spatial data to provide multidimensional visual information, for example, three-dimensional visual information.

An image convergence lens and camera operable to capture a visual image to an image recording medium, a data convergence module operable to collect spatial data related to at least one visual element in the captured visual image, wherein the data additionally includes at least A data convergence module, relating to the spatial relationship of at least one visual element to one selection component, an encoding element on an image recording medium relating to the spatial data, for correlating at least one visual element from the visual image with respect to the spatial data And a computing device operable to change the at least one visual element in accordance with the spatial data to produce at least one modified visual image. A device for capturing and modifying visual images is also provided.

Encoding elements of a system or apparatus include, but are not limited to, a visual data element, a non-visual data element, or a recordable magnetic material provided as a component of a recording medium. The system may further comprise a display for projecting a representation of the at least one modified visual image and generating light to generate a final visual image. The final visual image can be projected from at least two distances. The distance may include different distances along the line of sight of the potential viewer. The visual image may be altered to produce two or more altered visual images for displaying the final multi-image visual. The image recording medium includes, but is not limited to, photographic film.

Capturing a visual image to an image recording medium via an image converging lens and a camera, collecting spatial data relating to at least one visual element in the captured visual image, wherein the one or more visual elements are in an encoding element on the image recording medium. As referenced, correlating one or more visual elements with spatial data, and changing one or more visual elements with spatial data to generate one or more modified visual images. Is provided.

A system is provided for projecting a visual image by generating light, comprising a visual display device for generating at least two light sources that are directed towards a potential viewer from at least two distances from the viewer, the distance being the height and width of the device. With respect to different depths in the visual display device. An apparatus is also provided for generating light to project a visual image. The system may further comprise an image display area of the device occupying a three-dimensional area. In one aspect, the aspect of the image occurs at at least two different points within the three-dimensional zone. The visual display device may further comprise a liquid component that specifies image information as light. The visual display device may be a monitor, including but not limited to a plasma monitor display.

There is provided a method for generating a visual image for a selective display, comprising generating at least two light sources from the visual display device, wherein light is transmitted from at least two distinct depths relative to the height and width of the visual display. In this method, the discrete depths represent discrete points of view toward the potential viewer's device. The device can display multi-image visuals. The provided method may further comprise displaying the image in an area occupying a three-dimensional zone.

Other features and advantages of the invention will be apparent from the following description of the invention which refers to the accompanying drawings.

It is to be understood that the invention is for the purpose of illustrating the invention and is not limited to the precise construction and means presented. The features and advantages of the present invention will become apparent from the following detailed description of the invention which refers to the accompanying drawings.

1 shows a viewer and a screening area viewed from the side.

2 is a diagram showing an example of a theater viewed from above.

3A and 3B illustrate a multi-screen display site according to an embodiment and include a mechanical screen configuration according to one embodiment.

4 illustrates a plurality of cameras and depth-related measurement devices that operate on various image aspects.

TECHNICAL FIELD The present invention relates to imaging and, more particularly, to capturing visual and spatial data to provide image manipulation options such as for multidimensional displays. The invention additionally relates to a system, apparatus or method for generating light to project a visual image in three dimensions. Systems and methods are provided for providing spatial data, such as captured by a spatial data sampling device, in addition to a visual picture, generally referred to herein as "visual", that is captured by a camera. The visuals captured by the camera are commonly referred to herein as "images." Visual and spatial data are collectively provided such that data relating to three-dimensional aspects of the visual can be used, for example, during post-production processes. Furthermore, imaging options for affecting the captured "two-dimensional" image are provided with reference to the actual selected non-image data related to the image; This enables the multidimensional appearance of the image, while further providing other image processing options.

In one aspect, a multidimensional imaging system is provided that further includes one or more devices operable to send and receive transmissions to measure spatial and depth information. Furthermore, the data management module is operable to receive spatial data and to display separate images on separate displays.

It should be understood that the present invention is naturally not limited to the specific method, apparatus or system and may be modified. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” include plural references unless the content clearly dictates otherwise. Thus, for example, a reference to "a container" is such that it includes two or more container combinations.

The term "about" as used herein when referring to a measurable figure, such as an amount, a temporal duration, or the like, is defined as ± 20 from the specified figure, to the extent that such modification is suitable for carrying out the disclosed method. % Or ± 10%, more preferably ± 5%, more preferably ± 1%, and more preferably ± 0.1%.

Unless defined otherwise, all technical and scientific terms or terms in the art used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention relates. Although any method or material similar or equivalent to that described herein can be used in the practice of the present invention, the method or material is described herein. In describing and claiming the present invention, the following terminology will be used. As used herein, the term "module" generally refers to one or more discrete components that contribute to the effectiveness of the present invention. A module may operate or may rely on one or more other modules to function.

"Data gathering module" means a component (in this case related to imaging) for receiving information and conveying this information for subsequent processing and / or recording / storage.

"Image recording media" refers to physical and magnetic tape and computer data storage drives (such as photo emulsions) of most image capture systems, such as still or motion film cameras or films or electronic capture still cameras (such as digital). Electronic components).

"Spatial data" means information related to an aspect (s) of proximity of one object to another object. In this case, the selected portion of the camera aspect of the system and the reference information in series with the operation of the camera and / or linked to the operation of the camera in operation (transmitting the selection signal and deflected back towards the reception and time measurement function of the transmitting device). Elements (such as objects) in the image captured in one configuration by the signal (s) generating device, which later measure the return time of the signal, are coupled to both spatial data and image capture.

“At least one visual element,” as in camera capture visual, typically includes at least one distinction, whether it is a photo-chemical capture or an electronic capture of latent imagery, typically only sky, rock, etc. Possible separate embodiments exist. The majority of the captured images have a number of such elements that generate separate image information related to that aspect as part of the overall image capture and associated visual information.

An "encoding element" is a visually encoded element that is typically scanned to extract an electronically recorded track or file, such as its inclusion information or concurrently recorded time code data related to video image capture. In this case, it means an added information marker, such as a barcode.

A "visual data element" is typically a barcode or otherwise viewable and / or scannable icon, mark and / or effect implementation data (impression) that links and / or combines the object from which it occurs with at least one type of external information. embodying data). Movie films often contain numbered reference marks placed by film makers or as a function of the camera, such that the emulsion itself is related to the image captured in the same strip of emulsion bearing film stock. To provide. The purpose is to link an image with an external aspect, including but not limited to recorded audio, other images, and additional image management options.

By "visual data element" is meant electronically recorded data that involves the actual recording of the data and, unlike barcodes, does not traditionally change the visible aspect of the media in which it is stored. One example is an electronic reading device that includes a system for reading video and audio data and assembling it into a viewable and audible result. In this case, data storage media, such as tape and data drives, potentially non-visual data that links data other than captured spatial data or image data with corresponding images stored separately or as separate aspects of the same data storage medium. An example of an element.

“At least one selection component of the camera” is an aspect in which the spatial data measurement device (s) cannot occupy an accurate position as a capture point of a camera image, such as a plane of photo emulsion exposed at a film gate or CCD chip (s). Means. As such, there is a selectable spatial offset between the exact point of image capture and / or the lens, and / or other camera portion, one of the other camera portions being the spatial point from which the spatial data is collected, In order to infer the data result, based on the selected offset, it will be optionally adjusted to refer to the calculation providing option (s) for adjusting the spatial data, and the spatial data collection unit occupying the same space as the selected camera "part" or component ( spatial data collecting unit).

"At least one altered visual image" is a function of a computer and a particular program that references spatial data and other selection criteria and parameters for generating at least two separate data files from a single image, the function of a single two-dimensional image capture. Means a change to at least two final separate images. The individual data files each represent a change in the original image captured and at least one of the changed images.

“Final visual image” means a modified separate version of a single two-dimensional image capture to provide a selectively layered presentation of the image, partially changed based on the spatial data collected during the initial image capture. The final result displayed to potential viewers is at least optionally serially displayed as a function of the display to provide optional effects, such as multidimensional effects and representations (including "3D") of previous two-dimensional image captures. It is a single final visual image consisting of virtually one configuration of two separate two-dimensional images.

"Final multi-image visual" means a single captured two-dimensional image that is partially decomposed into its image aspect, based on separate data relating to the actual element, occurring in the region captured in the image. Based on the selection threshold determined in relation to the spatial data, spatial data, in particular the depth or distance from the lens and / or the actual point, or separate data relating to image formation (and / or) capture, which is a particular computer program as a component of the present invention It may also function partially to separate aspects of the original image. Accordingly, at least two separate images derived in part from the information occurring within the original image capture provide a single image effect from the potential viewer (s), while providing a multidimensional effect that is the final multi-image visual displayed. Displayed in series at different distances.

"The final visual image is projected from at least two distances" means that from a separate distance to accurately mimic the spatial difference of the original image aspect with the captured screen or visual, the change is made that the version of the complete original captured image is displayed. A version in which the original captured image is projected and / or relayed, without limiting that it may optionally occur as one or more of the images, decomposing the original data into at least "foreground" and "background" data. Apart from the image file created while doing so, it is meant to realize one result possibility of the present invention, which is a three-dimensional reproduction of the original screen by a two-dimensional image change based on the spatial data collected at the time of capture.

By “distance includes different distances on the viewer's line of sight” is meant depth as the distance on the viewer's line of sight: the line of sight in accordance with the present invention refers to the measurable distance from the eyes of potential viewer (s) and the entirety of this measurable linear image. Distance. Accordingly, images displayed at different depths within a multidimensional display may occur where the viewer (s) eye is drawn or in the viewer's line of sight, even with respect to the display height and width of the side facing the intended viewer (s). If the tape measure extends from the viewer (s) eye through the display toward two or more displayed two-dimensional images, it will occur at different measurable points.

“At least two separate imaging planes” means, in one aspect, that the present invention displays a two-dimensional or more image in which all or part of the original two-dimensional image is generated, and other data collected in relation to the image (in this case, Spatial data) may inform selective change (s) (in this case, digital change) to the original image with some aesthetic displayable results and / or viewable results.

"Specifying the height and width of at least one image by the device" means the height and width of the image relative to the height and width of the screening device as dimensions of the nearest screening device side facing the intended viewer (s). do.

"Height and width of the device" means the dimensions of the nearest screening device side facing the intended viewer (s).

Computer-executable instructions (eg, software) are provided for selectively assigning the foreground and background (or other different image related priorities) aspects of the screen and separating the aspects as separate image information. Furthermore, known methods of receiving spatial data are performed to generate three-dimensional maps and to generate various three-dimensional aspects of the image.

The first of the plurality of media may be used, for example, in a film for capturing the visual of the image (s), and the second of the plurality of media may be, for example, a digital storage device. Non-visual, space related data may be stored on either one of the two media and / or may be transmitted to either one of the two media or from either of the two media, and during the process, one medium (eg , Image (s) stored in a film) are used to alter the image (s) by cross-referencing with spatial data stored in another medium (eg, digital storage device).

Computer software is provided for selectively cross-referencing spatial data as individual image (s), the image (s) requiring manual user input or instructions to identify individual portions and spatial information in relation to the visual. If not, it can be changed. Of course, those skilled in the art will appreciate that not all user input, for example to perform an aesthetic adjustment, is necessarily removed. Thus, the software runs in effect automatically. The computer-operated "conversion" program may be operable to change the original image data captured to a virtually unlimited number of final, "displayable" versions, as determined by the user's aesthetic purpose.

In one aspect, a camera is provided in connection with the depth measuring element. The camera may be one of several types, including movie, digital, high definition (HD) digital cinema camera, TV camera, or film camera. In one aspect, the camera is a "hybrid camera", as described and claimed in US patent application Ser. No. 11 / 447,406, filed June 5, 2006, entitled "MULTI-DIMENSIONAL IMAGING SYSTEM AND METHOD." Such hybrid cameras provide, for example, bifocal capture for bifocal screening. Thus, according to one aspect of the invention, a depth measuring element is provided in a hybrid camera. The depth measuring element may, for example, provide sound waves, radar or other depth measurement specifications.

As such, the hybrid camera is operable to receive both image and spatially related data of the object occurring within the captured image data. The combination of specifications allows additional generation options to be provided during the post-production and / or screening process. Furthermore, image data can be provided to the audience in a modified way from traditional cinema projection and / or TV displays.

In one aspect, a hybrid camera, such as a digital HD camera unit, is configured to integrate depth measurement transmission and reception elements into the camera's housing. Depth-related data is received and selectively logged in accordance with visual data captured digitally by the same camera, thereby selectively providing depth information or distance information from camera data related to the captured key image area.

In one aspect, depth-related data is recorded on the same tape or storage medium used to store digital visual data. The data is synchronized for proper reference between the data with respect to the corresponding visual, whether it is timecode or otherwise captured and stored, captured and transmitted, captured and broadcasted (whether or not recorded on the same medium). As noted above, depth-related data may be stored on a medium other than the particular medium on which the visual data is stored. When visually separated, the spatial data provides a kind of "relief map" for the framed image area. As used herein, a framed image area is generally referred to as an image "live area". This elevation map may then be applied to selectively change image data at a sensible and specific level, such as for a three-dimensional image effect, as intended for ultimate display.

Furthermore, depth-related data is optionally collected and recorded as soon as visual data is captured and stored. Alternatively, depth data may be captured within a time period close to each frame of digital; Image data, and / or video data is captured. Furthermore, its entire contents are incorporated herein by reference, and are related to the core frame generation of digital or film images to provide enhanced data content that affects, for example, the resolution. As disclosed in the pending alias and regular patent application previously identified by Mowry, depth data is not necessarily collected for each of all captured images. An image inference specification for an existing image (eg, for morphing) may allow fewer than 24 frames per second to be spatially sampled and stored, for example, during image capture. The digital inference specification may additionally cause periodic spatial capture to affect image regions of multiple captured images between spatial data sampling related to objects in the image with respect to the captured lens images. Acceptable spatial data sampling is maintained such that the system realizes acceptable aesthetic results and effects while the image “zone” or aspect moves between each spatial data sampling. Naturally, in still cameras or single frame applications of the present invention, a single spatial convergence or "map" is converged and stored for each individual still image captured.

Furthermore, the entire contents thereof are incorporated herein by reference, and other means and options as disclosed in the pending aliases and regular patent applications previously identified by Mori and otherwise known in the prior art. This may be optionally connected with a spatial data collection imaging system described herein. For example, differently focused (or otherwise different due to optical effects or other image alteration effects) of the lens-collected image, which may include the set of spatial data disclosed herein, are captured. This may, for example, allow for more discrete applications and uses for separate versions of the lens visual captured as two different images. As described above, the key frame approach increases image resolution (by allowing key frames that are significantly rich in image data content to inject such data into subsequent images), and the spatial data collection aspect herein. In conjunction with, it is possible to create a unique core frame generation hybrid. In this way, (according to Mori, its entire content is incorporated herein by reference, and may be a key frame that has been selectively captured to extend the recording time of traditional media while simultaneously increasing the overall imaging resolution of the material. The core frame may additionally have spatial data stored in relation to it. Thus, not only are the key frames potentially for visual data, but the key frames for other aspects of the data related to the image allow the key frames to provide image data and information related to other image details; One such example is image aspect assignment data (relative to the specification of such aspect in relation to the viewer's location).

The post-production and / or screening process may be applied to visuals captured by the camera, as disclosed in pending patent applications and formal patent applications identified earlier by Mori, the entire contents of which are incorporated herein by reference. With further options as a result of additional such data. For example, dual screens may be provided for displaying differently focused images captured by a single lens. According to an aspect herein, the depth-related data is selectively applied to the image zone according to a user's predetermined parameter. The data may be applied with optional specificity and / or priority and may include a computing process with the data useful for determining and / or determining which image data is relayed to the individual screen. For example, foreground or background data may be selected to create a viewing experience with special effects or importance. According to the teachings here, the three-dimensional visual effect can be provided as a result of image data generated by different spaces, whereby the display screen and the actual foreground and background elements during capture do not necessarily have to be the same distance However, it can mimic true different spaces of foreground and background image data generated during image capture.

The user criteria for the split screen presentation may naturally be selectable so that the project, individual "shot", or image may be adjusted (eg, dimensionally) to achieve the desired final image result. The option of multiple displays or display aspects at varying distances from the viewer (s) allows for the possibility of very discrete and accurate multidimensional displays. Potentially, an image aspect that is as small as a single "pixel" or even smaller than a single "pixel" is as if all the actual visuals are being viewed, for example with respect to the viewer, the live screen, or the camera capturing it. As may involve a unique distance to each aspect, for example, it may have its own unique distance with respect to the position of the viewer (s) within the modified display.

Depth-related data collected by the depth measuring equipment provided to or provided with the camera allows for special handling of the overall image data and the selection zone therein. For example, replication of a three-dimensional visual reality for an object may be captured through the offset screen method described in the above-mentioned pseudonym and regular patent application, or alternatively, as captured by other known techniques. It becomes possible in connection with. As such, the presence of additional data in relation to visually captured objects, whether for cinema, TV or still photography, would otherwise result in excessive post-production and special handling options that would be missed in traditional capture or digital capture. To provide. Furthermore, different image files generated from a single image and converted according to spatial data may optionally retain all aspects of the original captured image in each of the new image files generated. Special modifications in accordance with the spatial data are used to realize the desired screening effect, resulting in different final image files that do not necessarily have to "miss" image aspects in order to be distinct from one another.

In another configuration of the present invention, the secondary (additional) space / depth measurement device may be operable with the camera without having to be a physical part of the camera or even disposed within an adjacent physical vicinity of the camera. Many transmit / receive (or other depth / space and / or 3D measurement) devices post-production, while allowing data in the object portion beyond the lens view of the camera for other effect purposes and digital work. It may optionally be placed, for example with respect to the camera, to provide additional position, shape and distance data (and other related positioning and shape data) for the object within the lens view of the camera to enhance the option.

In one aspect, a plurality of spatial measuring units are selectively disposed in relation to the camera lens to provide a separate and optionally detailed three-dimensional data map of the environment and objects related to the camera being photographed. The data map alters the image captured by the camera and optionally generates a unique screening experience and visual results closer to the real human experience or closer to at least layered multidimensional effects beyond the cinema provided in two dimensions. Used. Furthermore, the spatial data associated with an image may be “falsified” by known imaging options that are simple three-dimensional quality in an image, even without data other than “some” spatial data or image data that provides added dimensions of image related information. "Or improvised formation. More than one image capture camera may additionally be used to collect information for such a multi-position image and spatial data collection system.

Examples of specific embodiments for carrying out the invention are provided for illustrative purposes only and are not intended to limit the scope of the invention in any way.

Referring now to the drawings, wherein like reference numerals refer to like elements, FIG. 1 may be formed, for example, as a film camera or an HD digital camera, and includes two objects: an image of an exemplary visual of a tree and a table and Illustrates camera 102 in connection with single or multiple spatial data sampling devices 104A and 104B for capturing spatial data. In the example shown in FIG. 1, the spatial data sampling device 104A is connected to the camera 102 and the spatial data sampling device 104B is not. The foreground space sampling data 106 and the background space sampling data 110 enable, among other things, the potential separation of the table from the tree in the final display, whereby different depths / distances from the viewer along the viewer's line of sight. Each element is provided in a screening aspect in. Further, the background sampling data 110 may be of an image data processing basis or optionally discrete aspects of the image, typically associated with distinguishable objects (eg, the tables and trees shown in FIG. 1) within the captured image. Provide a real "high map" record. The image high definition recording medium 108 is, for example, film or electronic media, which is selectively synchronized with and / or serially recorded with the spatial data provided by the spatial data sampling device 104.

The documentation relating to the capture and recording of both visual and distance information by camera, digital or film is further extended here. Furthermore, an approach to the invention of a dual screen display that includes a semi-opaque first screen (temporarily in one configuration and physically semi-opaque in other manuals) is disclosed herein, and for current manageable configurations It explains in particular.

The present invention relates to the transmission analysis from a camera or vantage point elsewhere associated with the camera and optionally to the reception analysis of the transmission (including situations where one or more vantage points for depth are used to collect data. Provide a digital camera that selectively captures and records depth data, and in one aspect, the camera is digital.

Here, the film camera (and / or digital capture system or hybrid film and digital system) is connected with the depth data collection means from the selected vantage point (s), such as the lens position of the camera or optionally the position close to that position. Allow selective recording of This depth information (or data) may relate to an optionally discrete image region at the time of collection, or optionally to a discrete display system; For example, in the form of an initial acquisition that is optionally assigned to every pixel or optionally to a small image area for the number of depth data associated with every pixel of a high-definition digital image capture and recording means (such as Sony CINE ALTA and associated cameras). It may optionally be wide and deep.

Optionally, such depth data can be recorded by "dual system" recording, with cross-reference means provided between the captured image and the depth data (as by dual system sound recording with film), Or the actual negative film is magnetic or other recording (such as magnetic “sound stripe” or magnetic aspect, such as KODAK, used to record DATAKODE on the film, especially for recording of depth data relating to image regions and / or aspects) It may contain a means.

It should be noted that the digital, film or other image capture means associated with the depth sampling and recording means, corresponding to the image captured by the image capture means, may comprise still digital or film or other still visual capture cameras or recording means. Very important. The present invention relates directly to still capture for "photographing" as by motion capture for film and / or TV and / or other motion image display systems.

In the screening step, digital and / or film projection may optionally be used. As disclosed herein, since post-production means including image data from digital capture or film capture may be affected by depth data, an image region (or object and / or aspect) is “assigned” to the projection means. &Quot; are different from those other zones, objects and / or aspects within the capture visual.

One example is the primary screen, which is closer to the audience than the other screen here called the background screen, which is called the foreground screen.

The foreground screen may be of a physical (or electronically) transparent type to allow (partially) image specification on such a foreground screen while allowing for viewing intermittently of the background screen.

In one potential configuration (or other semi-transparent screen generating means) that never limits the claims herein to all physical, electronic, and chemical potential configurations, the screen optionally comprises two rollers of a regular cinema display screen size (s). It may be sheath.

Here, the "exterior" that is the screen optionally has large sections and / or strips, which are reflective and the rest are not reflective. The objective is to specify a projected image from the front for a period of time and allow the audience to skim from the foreground screen to the background screen for a period of time, and the background screen can be combined with other familiar image display options that are not limited to rear projection or projection (or any kind). Likewise, it will have an optional image specification means.

The image specifying means may be electronically selected and linked so that the image specified in the foreground screen is constant and sharp, as in a conventional intermittent or digital projection experience (film or digital).

The "exterior" described will optionally have means for "moving" vertically, horizontally, or in other ways; Its purpose is a partially solid and partially transparent (optionally reflective) projection surface, while allowing a continuous viewing experience for both the image of the foreground and background screens by an audience positioned selectively in front of both. To generate

Two screens as described herein are exemplary. It is also an obvious aspect of this manual and the invention that more screens may be included in the configuration of the present invention, allowing more dimensions of the aspect to be considered and / or displayed. Furthermore, complex screening means, such as solid materials, liquids, or other image expressing surface means, can be vertically and horizontally (in conventional two-dimensional display means), while the third dimension is selectively discrete in its display results. It can also allow for virtually unlimited display, providing image data that will be assigned depth as well.

For example, in a screen of 100 depth options, such as a laser or other external stimulation system, the area of the "cube" display ("screen") is captured visual (regardless of whether the capture was film or digital). The image data will be assigned to a sensible simulation of the spatial differences of the actual objects represented within. Such display systems, such as "magnetic resonance" imaging, may be used to impart changes or "commands" to complex multidimensional screening means (or "cubic" screens, although the shape of the screen does not necessarily have to be square or cubic). May have external magnetic or other electronic influence means for the image specification accordingly to the depth in the simulation of the spatial (or depth) relationship of the captured image influence object (digitally or on film or other image data recording means). Is assigned.

Laser influence means for specifying an image is also the color or image selected at a selected point within the multi-dimensional screening area, based on an internal result, and thus its components and / or aspects are laser (or other externally or internally arranged means). It may be an example of external means for affecting an image rendered by multidimensional screening means (and / or material) that may display the aspect. A series of displays also displays other screen portions when the selected screen is an object (or selection) for specifying an image aspect (and / or pixel or equivalent) based on depth or "distance" from the viewing audience or other selection reference point. It may also consist of such a multi-dimensional screen that allows viewing through.

The present invention provides a "depth" sufficient to provide a multi-dimensional display result, a potential cinematic experience, partially disclosed herein, and a discernable depth sufficient to selectively handle (and "feed") such future display technology with visual data. Provide a capture of this data.

A potential proprietary feature of the technology herein is to explicitly allow the selection of capture and screening means to selectively exclude other such capture and screening means, in which case the multidimensional capture and display aspects of the present invention are used. For example, "film" may be considered as one image capture means, but is not the only capture means associated with this system.

In addition, the present invention “doubles” the captured image as described herein while allowing two or more “focus” priorities for one or more lens image (s) of an optionally similar (or identical) screen for capture. Focus "applies as a visual. Such recorded, captured (still or motion) shots of the scene, which are differently focused, for the dimensional effect herein, the foreground and background receiving image data related to the foreground and background focus versions of the same screen and / or lens image. Screens and the like may be selectively displayed on different screens.

Obviously, the main advantage of the multiple configurations of the present invention is that it is optional (and intentionally and / or not) to image specifying means (such as a screen) at a selectable distance from the audience (rather than for a single distance screen from the viewer). Or automatically) image data may be assigned. Such options by the selectable number of such depth image specification options / means provide a powerful viewing experience closer to "real life" viewing, through two "offset" eyes interpreting distance and depth (unlike single lens viewing means). You can also create

Now, creative options for photography, film, and television (and other display systems) can be adapted to the way it was captured or optionally changed for creative effects, so that the image area and the captured "object" Include the ability to influence.

Referring to the drawings, wherein like reference numerals refer to like elements, FIG. 1 illustrates the viewer 102 and the display 110 of the present invention from the side. This configuration represents a three dimensional screening "area" with the display itself. Herein, without limiting the remaining options and the internally generated display potential, the externally enforced generated impact may be "selected in quality and brightness" that may appear at any optional point by the three-dimensional "display area". Affects the appearance of the display itself, affecting the appearance of "colors" (and naturally color component composition).

Pixel 104 occurs in the frontmost display plane with respect to the viewer. This plane is essentially the same as the theater's two-dimensional screen (and most display systems including computers, TVs, etc.). Here, pixels 106 and 108 represent the light transmissible quality of the display, taking into account those pixels located at different points in depth as well as in relation to height and width (relative to pixel 104). Depending on the depth, reference is to the dimensions of the display from left to right in the side view of FIG. 1, and the depth also refers to the distance between the closest and farthest aspects displayed along the viewer's line of sight. The number of potential pixel locations and / or imaging planes within the screening area is selectable based on the configuration and the desired visual purpose.

In an important configuration, the screening area is a (eg) transparent (or semi-opaque) "cube" and the interior configuration (material and / or component) of the cube is the generation of viewable light occurring at any point within the cube; Allows light generation of selectable color and brightness (and conventional display options related to other monitors and digital projections). In terms of height and width, since a single "visual" captured as a two-dimensional image by the lens is "distributed" through a cube (or otherwise three-dimensional) display area, in the expected configuration, as with a two-dimensional image, There is likely to be only one generating image aspect that occurs at a single height and width (such as pixels, although display light generating or relaying aspects are not limited to pixels as a means for generating a viewable image portion). However, when captured by a camera, one or more aspects of the image, potentially objects that actually occur at the same distance from the camera, are based on the distance (or viewer) of the same depth (or viewer, for example) based on the distance of the actual capture object within the captured image. The same screening distance relative to the line of sight).

2 illustrates an example of a performance hall as described above. Viewer 102 is again responsible for external imaging influences 202 that excite aspects, characteristics, and / or components within the display area (and function as functions of the display and external devices that function in series to generate image data within the display area). It is shown in connection with an example three-dimensional display and / or display area 104. This example illustrates a component of color delivered by an array of light transmissive devices (where the laser is an effect, for example, a potential approach and / or effect), where three such devices are located within a cube. Three lasers or light providing devices (such as separate color components that selectively intersect) indicate the generation of viewable light within a small area (e.g., not actually a pixel, but the same meaning as a pixel). Allow convergence of

In one configuration, the material properties of the display itself or the display portion will react with the specifying means for externally provided light and / or provide the specifying means for the externally provided light. 2 shows a single point of light generated. Naturally, such multiple points (which provide ideal reproduction of the entire captured visual) are provided externally (this time in series with components, functions, and / or other properties of the display or example “cubical” display area). Will be provided by such an array, including the necessary speed and coverage of such image forming effects.

Magnetic resonance imaging is an anomalous imaging means that (magnetically) allows viewing of the cross seconds of a three-dimensional object while excluding other portions of the object from this particular display of "slices." It is an example. Here, the opposite configuration of such an approach, meaning an external situation (such as an MRI's magnet) that affects the electronically generated imaging effect, is used herein, for example, in a selective area such as a cross section, for example, In order to exclude the display zone area, but in a rapidly changing format, to allow a selected number of possible total screening distances (from the viewer), or essentially, how many slices of the “inverted MRI” will be available (external) Will affect similarly as in the affected display results.

Furthermore, as with conventional monitors, the selective transparency of the display and means for generating pixels or discrete color regions of the same meaning may be provided internally as a function of the display as a whole. Changing, moving or varying aspects of the display will provide the viewer with the ability to see more "deeply" (or further along his gaze) towards the display at some point relative to the other. In essence, perhaps it is as small as (or smaller than) traditional pixels or provides greater transparency in areas that are large enough to be aesthetically suitable for certain display effects.

Referring now to FIGS. 3A and 3B, a multi-screen display scene including a viewer 307 viewing a foreground capture version 301, which may be an optionally modified system user, is shown. The foreground capture version 301 is provided by data storage, for example via a data manager and a synchronization device. Furthermore, imaging unit 300 projects and / or provides foreground capture version 301 to an optional light transmissive foreground image display, which may be provided as a display screen, for example the mechanical shown in FIG. 3B. The screen configuration includes a reflective portion 303 and a transparent / light transmissible portion 302.

In the mechanical screen configuration shown in FIG. 3, the length of the movable screen is transported by roller motor 304. The screen is optionally "through" vividly visible foreground image information, as specified by the display strip 303 (or on the display strip 303), which may suitably be a direct viewing device aspect or an image reflection aspect. Allowing seamless viewing, the light transmissive aspect moves fast enough to make the screen appear solid, with the light fade from the moving portion 302 at a sufficiently high speed.

The foreground display may have non-mechanical features, including device options equipped to have semi-opaque characteristics or to provide variable semi-opaque characteristics. Furthermore, the foreground display is a modified direct viewing device characterized by image information related to the image data focused in the foreground, which is optionally continuously placed behind it while maintaining transparency, translucency or light transmission for the background display. It may be.

Background display screen 306 is imaging means 305, which may be a rear projector, direct viewing monitor, or other direct viewing device, including a front projector that is optionally the same unit providing foreground image data for viewing 300. As provided by IA, it features optional altered image data from the background capture version 308. The background capture version image 308 is consistent enough that the viewable image through light transmissive quality or intermittent transmissive structure is sufficient to maintain a continuous and seamless background visual for the viewer (i.e., human " images " may be generated either continuously or intermittently. In this way, the vantage point 307 of the viewer actually experiences the multi-focus stratified multidimensional effect presented at different distances from them. Thus, the human eye is naturally limited to selecting only one " focal point " at the same time, so that the constant appearance of multiple focusing aspects or hierarchies of the same picture results in a new aesthetic experience in the theater that was not found in the prior art.

Although many of the examples described herein refer to theater displays, the present invention is not so limited. Home displays, computer displays, computer games and other conventional consumer and professional display scenes also derive from the availability for multiple versions of the same lens capture screen, including physical separation of layered displays, as taught herein. Similar effects or effects may be realized. Furthermore, although a visually focused visual is generated, such as a traditional two-dimensional production in the prior art, it is useful even for example to capture a "core frame" focused on only one background per second. . Such data is not currently available for film distribution, television or other available sites. However, as described herein, various methods for utilizing the focused key frame of data for viewing and other data management options are not currently specified.

As a result, the focused second capture version data, even if it is sometimes the focused second capture version data in the "core frame", even in the post-production process to refine the image, the visual details are out of focus. When you reveal this, you will not be able to predict much of the captured visual information, which would otherwise allow the production to "save" and have available visual information that would otherwise be lost in its entirety.

As such, the specifications provided here are about how to capture data that is currently valuable, and as new innovations are developed in the future to specify key frame data, future users (such as technical films of conventional technologies) For the development of future viewing systems and technologies where additional visual data is available, we will have the information needed to make the project compatible and more interesting.

The invention is now elucidated with reference to the following illustrative examples and related discussion.

Multi-focus configuration cameras, production aspects of the images taken by them, and screening or post-production aspects of the system, such as multi-screen display scenes.

Initially, the visual enters the camera through a single capture lens. A selected lens image diverter, such as a prism or mirror device, decomposes the lens image into two selectively identical (or different) portions of the same visual (ie light) collected. A separate digitization (camera) unit then takes place side by side, each receiving a selected one of the divided lens images.

Before relaying the light (lens image portion) to the individual digitizer, such as a CCD, associated chip, or other known digitizer of this camera unit, an additional lens mechanism is placed on each of the individual lens image portions (shown as a focal optical aspect). A separate focus ring is provided (see US Patent No. 11 / 447,406, filed June 5, 2006, the disclosure of which is incorporated herein by reference in its entirety). The focus ring is unique to each of the two or more image versions and allows one unit to digitize the version of the lens image that is selectively focused on the foreground element and the remaining version that is selectively focused on the background element.

Each camera is operable to record a digitized image of the same lens image, which is governed by different focusing characteristics by a secondly forced lens (or other focusing means) aspect. The recording may be for tape, DVD, or any other known digital or video recording option. The description herein is limited to digital video for a TV or cinema, but instead includes all aspects of film and still photo collection means. As such, collection and processing of lens images is an issue, and "recording media" is not an issue.

Lighting and camera settings provide latitude for improving various purposes, including general means for affecting depth-of-field and other photographic aspects.

4 may be configured, for example, as a film camera or an HD digital camera and is connected to a single or multiple spatial data sampling devices 404A and 404B for capturing image and spatial data of two objects: trees and tables. 402 is illustrated. In the example shown in FIG. 4, the spatial data sampling device 404A is connected to the camera 402 and the spatial data sampling device 404B is not. The foreground space sampling data 406 and the background space sampling data 410 enable, among other things, the potential separation of the table from the tree in the final display, whereby different depths / distances of the viewer from the viewer along the viewer's gaze. Each element is provided to a screening aspect. Further, the background sampling data 410 may be based on an image data processing basis or an optionally identifiable aspect of an image, typically associated with distinguishable objects (eg, the tables and trees shown in FIG. 4) within the captured image. Provide a real "high map" record. The image high definition recording medium 408 may be, for example, film or electronic media, which is selectively synchronized with and / or serially recorded with the spatial data provided by the spatial data sampling device 404. For example, in the United States, filed July 6, 2006 under the name "SYSTEM AND METHOD FOR CAPTURING VISUAL DATA AND NON-VISUAL DATA FOR MULTIDIMENSIONAL IMAGE DISPLAY", the contents of which are incorporated herein by reference in their entirety. See patent application 11 / 481,526.

During the colorization of black and white movies, color information is typically added to "core frames" and several frames of achromatic film usually have color that is the result of a guesswork, and most of the time when captured in black and white film in any way It is not related to the actual color of the object. The "Technical 3 Strips" color separation process is characterized by "color" information for use in the playback of a displayable version of the original screen, characterized by "added" colors as informed by the actual color representations presented during the original photo shoot. Records "were captured and stored (in separate strips of black and white film).

Likewise, according to the teachings here, the spatial information captured during the original image capture may possibly inform a virtually infinite number of "versions" of the original visual captured through the camera lens (like the Technical 3 strip process). For example, the invention is visual and its corresponding, since the "how red" is variable in creating a print from a Technical 3 strip print, without ignoring that the dress was actually red and not blue. It allows for such a range of aesthetic options and applications in realizing certain effects (such as three-dimensional visual effects) from spatial "high map" records. Thus, for example, spatial data may be collected as optional details, and the meaning of "how much spatial data is collected per image" means that the intended display device or "future" expected display device (s) Is the best variable that is notified by the discreteness of Based on the hysteretic effects of the film starting with sound, color, etc., the value of such projects for future use, application and system (s) compatibility is known, even before it is cost effective to capture and screen such materials. . In today's imaging advances, although not applied to the displayed version of the captured image for many years, the value of gathering the dimensional information described herein can potentially be substantial and thus, now, film, still photography, video gaming, Of great importance to commercial presenters of imaged projects, including TV and other projects involving imaging.

Other uses and products provided by the present invention will be apparent to those skilled in the art. For example, in one aspect, an unlimited number of image specification regions are presented at different depths along the viewer's gaze. For example, a crisp cubic display 10 feet deep provides each "pixel" of an image at different depths based on the spatial and depth position of each pixel from the camera. In another aspect, a three-dimensional TV screen is provided in which pixels are provided horizontally, for example, from left to right, but optionally in the "final" background area where more data appears than at some other depth. It may be provided far away (eg from front to back). In front of the final background, the foreground data occupies a "sparse" depth region, perhaps only a few pixels appearing at a particular depth point. As such, the image file may retain image aspects in a selectively varying form, for example, in one file, the background is provided (eg forced) with very soft focus.

While the invention has been described in some detail by way of illustration and example for purposes of clarity of understanding, those skilled in the art will, in view of the teachings of this invention, make certain changes thereto without departing from the spirit and scope of the appended claims. It will be readily appreciated that changes may be made.

Claims (67)

A system for capturing and modifying visual images, An image converging lens and a camera operable to capture the visual image to an image recording medium; A data convergence module operable to collect and store spatial data indicative of a spatial relationship between the camera and the distinguishable aspects identified in the captured visual image; And Computing device configured to generate final images Including, The final images comprise an image focused in the foreground and an image focused in the background, the distinguishable aspect being located in the final images based on the spatial data . The method of claim 1, The spatial data is stored on the image recording medium as a bar code. The method of claim 1, The spatial data is stored as electronic data. The method of claim 1, The spatial data is stored on an image recording medium of recordable magnetic material provided as a component of the recording medium. The method of claim 1, And a display for generating light to project the representation of the final images. The method of claim 5, And the final images are projected from at least two distances. The method of claim 6, The distances include different distances along the line of sight of a potential viewer. The method of claim 5, And the final images comprise two or more images. The method of claim 1, And the image recording medium is a photographic film. The method of claim 5, And the final images consist of at least two separate imaging planes. As a way to change the visual image, Capturing the visual image on an image recording medium through an image converging lens and a camera; Collecting spatial data related to at least one distinguishable aspect identified within the captured visual image; Correlating the at least one distinguishable aspect to spatial data on the image recording medium; And Generating final images from the visual image Including, Wherein the final images comprise an image focused in the foreground and an image focused in the background, wherein the distinguishable aspect is located in the final images based on the spatial data. The method of claim 11, The spatial data is stored on the image recording medium. The method of claim 11, The spatial data is stored on the image recording medium as a bar code. The method of claim 11, The spatial data is stored as electronic data. The method of claim 11, Wherein the spatial data is stored on an image recording medium of recordable magnetic material provided as a component of the recording medium. The method of claim 15, And the magnetic material is a magnetic strip of selectable size that occurs over the length of the image recording medium. The method of claim 15, And the image recording medium is a photographic film stock. The method of claim 15, The magnetic material is a magnetic strip capable of recording any data type that can be stored in the magnetic material and providing data. The method of claim 11, Generating light from a display to project the representation of the final images. The method of claim 19, Projecting the final images from at least two separate distances from the potential viewer along the line of sight of the potential viewer. The method of claim 19, And the final images comprise two or more images. The method of claim 11, And the image recording medium is a photographic film. The method of claim 19, And the final images consist of at least two separate imaging planes. Device for capturing and changing visual images, An image converging lens and a camera operable to capture the visual image to an image recording medium; A data convergence module operable to collect spatial data that relates a spatial relationship of the distinguishable aspect identified within the captured visual image to a selected location; And Computing device configured to generate final images Including, The final images comprise an image focused in the foreground, and an image focused in the background, wherein the distinguishable aspect is located in the final images based on the spatial data. The method of claim 24, The spatial data is encoded in a form readable by a scanner. The method of claim 25, And the scanner is a laser scanning device. The method of claim 25, The spatial data is stored on the image recording medium as a bar code. The method of claim 24, And the spatial data is stored in a data storage medium capable of storing a medium comprising video and audio information. The method of claim 28, And the data storage medium is a magnetic recordable material. The method of claim 24, And a display for generating light to project the representation of the final images. The method of claim 30, Light generated in relation to the final images is transmitted to the potential viewer from at least two distinct distances with respect to the potential viewer's gaze. delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images