WO2001006316A1 - Appareil et procede pour programmer un systeme de projection lumineuse en couleur - Google Patents

Appareil et procede pour programmer un systeme de projection lumineuse en couleur

Info

Publication number
WO2001006316A1
WO2001006316A1 PCT/US2000/016331 US0016331W WO0106316A1 WO 2001006316 A1 WO2001006316 A1 WO 2001006316A1 US 0016331 W US0016331 W US 0016331W WO 0106316 A1 WO0106316 A1 WO 0106316A1
Authority
WO
WIPO (PCT)
Prior art keywords
color
recited
light
window
selecting
Prior art date
Application number
PCT/US2000/016331
Other languages
English (en)
Inventor
Daniel R. Gosselin
R. Emerson Washburn
Original Assignee
Chromasync, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chromasync, Ltd. filed Critical Chromasync, Ltd.
Priority to AU60504/00A priority Critical patent/AU6050400A/en
Publication of WO2001006316A1 publication Critical patent/WO2001006316A1/fr

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00—Projectors or projection-type viewers; Accessories therefor
    • G03B21/005—Projectors using an electronic spatial light modulator but not peculiar thereto
    • G03B21/006—Projectors using an electronic spatial light modulator but not peculiar thereto using LCD's

Definitions

  • the invention relates to a color light projector system capable of projecting light of various colors and intensities in accordance with a displayed image and more particularly to a method and apparatus for developing a control program for the light projector system.
  • U.S. patent 5,739,928, U.S. patent 5,488,434, and U.S. patent 3,813,686, are representative of patents disclosing the control of image parameters, such as brightness, based on ambient lighting conditions.
  • U.S. patent 5,111,113, U.S. patent 5,056,399, and U.S. patent 4,205,585 are representative of patents disclosing the control of light based on sound.
  • U.S. patent 4,378,466 discloses an apparatus for converting spoken words to a displayed color. Recently the "home theater" or "home cinema” industries have expanded greatly.
  • Products such as large screen and wide screen televisions, video cassette recorders, CD- ROM drives, DVD players, DIVX players, DOLBY PROLOGIC SURROUND SOUND devices, and DOLBY DIGITAL SURROUND SOUND devices have permitted the theater atmosphere to be reproduced in the home.
  • the object of these products is to make the viewer feel enveloped by the movie or other program being watched.
  • existing image displays while relatively large, do not create the effect that the viewer is in the middle of the action because the viewer still has surrounding objects, the furniture in the room for example, in his peripheral vision. Darkening the room merely creates a sort of black frame around the image and is harsh on the viewer's eyes.
  • IMAX projectors and screens that provide a 180° viewing angle, i.e. field of vision.
  • IMAX movies require very expensive specialized cameras, projectors, and screens and thus have limited practicality in commercial theaters and even less practicality in home theater situations. Accordingly, there is no practical solution for extending the feel of a movie or other program beyond the edges of a display screen to a viewer's peripheral field of view. As a result, the feeling of envelopment achieved by home theater systems is limited. Further, existing lighting systems have limited value in enhancing a home theater experience.
  • a first aspect of the invention is an apparatus for developing a control program for controlling a light projector system in accordance with a displayed image.
  • the apparatus comprises means for displaying an image frame of a video recording, means for selecting at least one color and intensity to be displayed by the light projector in association with the image frame, and means for recording data relating to the selected color and intensity in accordance with the image frame.
  • a second aspect of the invention is a method for creating a control program for a light projector system for a video recording comprising the steps of, selecting a frame of a video recording, selecting at least one color and intensity to be displayed by a light projector in association with the selected frame, and recording data indicative of the selected color and intensity.
  • Fig. 1 is a schematic view of a color light projector system that can be used with the preferred embodiment of the invention
  • Fig. 2 is a top view of optical components of the light projectors of Fig. 1 ;
  • Fig. 3 is a perspective view of the optical components of the light projectors of Fig. 1;
  • Fig. 4 is a schematic illustration of the preferred embodiment in use with a typical home theater system.
  • Fig. 5 is a flow chart of a programming routine in accordance with the preferred embodiment of the invention.
  • Fig. 6 is a schematic block diagram of a programming terminal for use with the preferred embodiment
  • Fig. 7 is an illustration of a main window and toolbar of a user interface for creating a control program according to the preferred embodiment
  • Fig. 8 is an illustration of a color palette window of the preferred embodiment
  • Fig. 9 is an illustration of an editing window of the preferred embodiment
  • Fig. 10 is a block diagram illustrating the steps in selecting colors for a video/movie frame(s) in accordance with the preferred embodiment;.
  • Fig. 11 is a graphical view of the multi-track editing window of the preferred embodiment
  • Fig. 12 is a graphical view of a pop-up window
  • Fig. 13 is a list view of the multi-track editing window of the preferred embodiment.
  • the human retina has a central portion known as the "macula lutea” that has closely packed photo receptors. There is a central depression in the macula lutea known as the “fovia centralis” on which light is focused. Accordingly, the fovia is responsible for our acute vision. However, the retina outside of t e fovia is used also. The outer portions of the retina are responsible for our peripheral vision with which we may be unable to focus on objects but are aware of their existence. For example, when we are watching television, we may not be consciously aware of the furniture in the room. However, if someone were to enter the room into our peripheral field of view, we would become aware of their presence prior to being able to focus on the person. Further, our immediate emotional reaction to the presence might be more extreme if we are watching a horror movie than if we are watching a comedy.
  • a home theater viewing experience can be enhanced by controlling light in the peripheral view of the viewer in synchronism with the image viewed on a screen, thus creating a three-dimensional synchronous representation of perceived on-screen light functions over time to envelope the viewer in the on-screen image.
  • Controller 300 can be any type of device capable of controlling light projectors 200 in a desired manner.
  • controller 300 is a microprocessor based device, such as a personal computer, and includes central processing unit (CPU) 340, random access memory (RAM) 360, and memory device 320.
  • Memory device 320 stores a control program developed by the preferred embodiment disclosed below, an operating system, and any other software required for operation of controller 300.
  • Memory device 320 can be a magnetic device, such as a hard disk or a removable diskette drive, an optical device, such as a CDROM drive, or any other known memory device.
  • Memory device 300 can be integral to controller 300 or can be external.
  • RAM 360 serves as a workspace for CPU 340 in a known manner and can include known types of memory chips, such as dynamic RAM (DRAM) chips, magnetic core memory, or the like.
  • DRAM dynamic RAM
  • Controller 300 also includes input/output device (I/O) 380 which includes any interfacing circuitry for coupling other portions of controller 300 to light projectors 200 or other peripherals, such as an input device or display (not illustrated).
  • I O 380 can include standard RS232 serial, Centronics parallel, or universal serial bus (USB) physical ports and any required digital to analog conversion, filtering, or other circuitry. All elements of controller 300 can communicate using known protocols over data bus 310.
  • data bus 310 can be an Industry Standard Architecture (ISA) bus or the like.
  • I/O 380 of controller 300 is coupled to light projectors 200 through communication links 390 which can be any appropriate type of electrical conductor, such as a serial, parallel, or USB cable, or an optical conductor, such as an optical fiber bundle.
  • links 390 can be accomplished in a wireless manner using radio frequency, infra-red, or other techniques.
  • links 390 can be twisted pair or coaxial cables using a network protocol, such as 10 base T, 100 base T, or TCPIP communication.
  • Links 390 can be any mechanism for transferring control signals from I/O 380 to light projectors 200 in a local or remote manner. While controller 300 is illustrated as being coupled to light projectors 200 in a hub-like manner, the connection can be daisy-chained from one light projector 200 to the next depending on the hardware and protocol used for links 390.
  • Figs. 2 and 3 schematically illustrate the optical components of one of projectors 200 in accordance with the preferred embodiment.
  • Light source 200 is a white light source, such as a high intensity tungsten halogen lamp. Other white light sources can be used or sources of other colors can be used and corrected to eliminate or attenuate unwanted color components or add or increase necessary color components.
  • Lens system 204 is provided to collimate light from light source 202 to produce input light beam 206 of substantially white light.
  • Lens system 204 can optionally include a polarization filter to polarize light beam 206.
  • Dichroic filters 220, 221, 222, and 223 reflect a certain bandwidth, i.e.
  • Dichroic filter 220 is a blue filter and is arranged in the path of light beam 206, at a 45° angle for example, to reflect component light beam 240 which consists of primarily light of wavelengths corresponding to the color blue.
  • Remaining wavelengths of light beam 206 pass through dichroic filter 220 as light beam 250.
  • Dichroic filter 222 is a red filter and is arranged in the path of light beam 250, at a 45° angle for example, to reflect component light beam 242 which consists of primarily light of wavelengths corresponding to the color red. Remaining wavelengths of light beam 250 pass through dichroic filter 222 as component light beam 252. Since component light beam 252 has had red and blue components removed therefrom, by dichroic filters 222 and 220 respectively, light beam 252 consists primarily of wavelengths corresponding to the color green. Light beam 252 is reflected 90° by mirror 224. Accordingly, light beam 206 is divided into three component light beams 240, 242, and 252 that are of wavelengths corresponding to blue, red, and green respectively.
  • Component light beams 240, 242, and 252 are directed through LCD panels 230, 232, and 234 respectively, which preferably are of a twisted nematic field effect type or any other type capable of attenuating a light beam passing therethrough.
  • LCD panels 230, 232, and 234 preferably are of a twisted nematic field effect type or any other type capable of attenuating a light beam passing therethrough.
  • LCD panels sold under part numbers 738MA by LXD, Inc. can be used. Twisted nematic field effect type LCD panels are preferred because of a high contrast ratio (ordinarily on the order of 2000:1) and extinction ability (roughly 98%). Twisted nematic field effect LCD panels are effective only on polarized light.
  • a polarization filter is not included in lens system 204, or at another point along the path of light, such a filter can be incorporated onto a surface of LCD panels 230, 232, and 234.
  • LCD panels 230, 232, and 234 serve as light attenuators for the respective component beams 240, 242, and 252, i.e. colors, of light.
  • Component light beam 240 passes through LCD panel 230 and is selectively attenuated thereby in accordance with a blue color control signal generated by controller 300 based on a control program executed by CPU 340.
  • Component light beam 242 passes through LCD panel 232 and is selectively attenuated thereby in accordance with a red color control signal generated by controller 300 based on the control program.
  • component light beam 252 passes through LCD panel 234 and is selectively attenuated thereby in accordance with a green color control signal generated by controller 300 based on a control program executed by CPU 340.
  • Each LCD panel 230, 232, and 234 can be driven by the respective control signals at plural discrete voltage levels applied to a single pin thereof.
  • LCD panels 230, 232, and 234 can be driven independently at 20 voltage levels from 1.6v to 6.5v in roughly 245mv increments.
  • the control signals can be a voltage modulated DC square wave, a pulse width modulated signal approximating a square, wave, a linear voltage modulated signal, or any other form.
  • filters, or color correctors, 231 (blue), 233 (red), and 235 (green) can be placed anywhere in the component light paths to provide color saturation of the respective bandwidth of each component light beam by further attenuating unselected wavelengths.
  • the filters can be disposed immediately before or after the respective LCD panels. Filters sold under part numbers D43456, D43457, and D43458 by Edmunds Scientific can be used as filters 231, 233, and 235 respectively.
  • component light beam 240 After passing through LCD panel 230, component light beam 240 is reflected by blue dichroic filter 221 into light beam 258. Similarly, after passing through LCD panel 232, component light beam 242 is reflected by red dichroic filter 223 into light beam 256. After passing through LCD panel 234, component light beam 252 is reflected by mirror 225 into light beam 254. As illustrated in Fig. 2, the light beams 258, 256, and 254 are superposed on one another. Accordingly, the three component light beams are attenuated in accordance with a respective color control signal and recombined, i.e. superposed on one another, into output light beam 260 of a desired color.
  • Output light beam 260 is reflected by mirror 226 and directed through LCD panel 236 which is similar to LCD panels 230, 232, and 234 and which serves to attenuate output light beam 260 to render the desired output light intensity.
  • LCD 236 can be driven by an intensity control signal generated by controller 300 at plural discrete voltage levels. For example, LCD panel 236 can be driven at 40 voltage levels in roughly 122.5 mv increments.
  • the intensity control signal can be of the same type as the color control signals.
  • mirror 226 can be omitted, and LCD panel 236 can be repositioned, to direct output light beam 260 in a direction parallel to input light beam
  • each element of light projector 200 can be varied in accordance with the dimensions of a housing of light projector 200 and other practical variables.
  • the color and intensity of output light beam 260 is adjusted based on a control signal or signals generated by controller 300 in accordance with a control program stored in memory device 320 and executed by CPU 340.
  • the electrical connections and associated circuitry of light projectors 200 are not illustrated in detail but will be apparent in view of the disclosure herein.
  • light projectors 200 can each include a dedicated power supply or power can be supplied from a central power supply located in controller 300 or elsewhere.
  • the color and intensity of light outputted by plural light projectors 200 are controlled in accordance with an image displayed on a viewing screen to enhance the viewing experience by simulating a relative location of an on-screen object or event or otherwise being driven in synchronism with the image displayed on the viewing screen to enhance the viewing experience. While particular light projectors are disclosed above, any light source capable of providing the desired colors and intensities can be used.
  • Fig. 4 is a schematic illustration of the preferred embodiment used in connection with a typical home theater system.
  • the home theater system includes screen 400 on which an image is displayed.
  • Screen 400 can be CRT, LCD, projection system, or the like.
  • the image signal can be from a broadcast television program, a video cassette, a DVD, a CDROM, photographic film or from any other source.
  • the home theater system further includes speakers 410 distributed throughout the area surrounding screen 400 to provide realistic multi-channel sound, such as SURROUND SOUNDTM, to a viewer in viewing area 430 which can be a couch, chair, or the like.
  • subwoofer 420 can be provided to simulate low frequency sounds to add to the realistic effect.
  • Light projectors 200 are distributed throughout the area surrounding screen 400, preferably close to walls of the room in which the home theater system is contained to enhance the effect of the displayed image.
  • the output light beams 260 of projectors 200 are directed to fall incident on the walls and/or ceiling of the room.
  • the use of nine light projectors 200 permits nine independent channels of light color and intensity.
  • any number or arrangement of light projectors 200 can be used.
  • the light projector can be centrally located and directed outward to the appropriate surface. Note that in the preferred embodiment three of the light projectors
  • Controller 300 controls light projectors 200, in the manner described above, to be operated in synchronism with the image displayed on screen 400. For example, if a lightning strike is displayed on-screen or indicated off-screen, one or more appropriate light projectors can be driven to provide a flash of white light (with no color components attenuated).
  • onscreen images that can be enhanced by proper control of light projectors 200 are sunrises, moonlit scenes, police beacons, vehicle headlights, shadow events, and explosions.
  • Fig. 5 is a flow chart of a basic programming routine for creating a control program in accordance with the preferred embodiment for permitting controller 300 to output the control signals described above.
  • the programming sequence can be stored in storage device 320 of controller 300 and run when a control program is to be created.
  • the control program can be developed on a separate programming device, such as a personal computer, running the programming routine as disclosed below.
  • the control program includes a "lighting track" coordinated with the video and audio tracks of a movie or other program.
  • light track refers to data or signals that represent the status, e.g. color and intensity, of the light projector.
  • control program refers to any data, information, signal, or signals which controls the lighting system and can include a lighting track alone, or other data, information, signal, or signals for operating the light projector system.
  • step A parameters of an image frame of an event recorded on film, tape, CD, or the like, are read. For example, the average color and relative intensity of the entire frame, or particular zones of the frame, can be read. Any device for reading the image signal can be used depending on the format on which the image signal is recorded. For example, a VHS cassette player/editing device can be used to read the signal. If the image is on film, it may be necessary to convert the image to an electrical image signal in a known manner.
  • step B the color for each light projector 200 to be displayed in accordance with the frame is determined manually or based on a desired algorithm.
  • the average color and intensity values read from the frame can be matched by the output of light projectors 200 or a lookup table of corresponding color values can be used.
  • the color and intensity at the edges of the image corresponding to the frame can be used for respective light projectors 200 located proximate the edge.
  • the parameters of plural frames can be used to determine the color of light projectors 200 to simulate or enhance shadowing or movement.
  • an on-screen event such as moving clouds, can be enhanced by simulating the movement off-screen by synchronizing appropriately matched colors of white and sky blue.
  • the routine can display the image of the frame onscreen for the operator to select an appropriate color from a displayed pallette of colors.
  • the intensity of the light output from each projector 200 is determined in a manner similar to the manner for determining the color in step B. Note that the color and intensity of each light projector 200 can be the same at any given time, or each light projector 200 can display different and independent colors and intensities.
  • step D the color and intensity for each light projector 200 for the frame read in step A is recorded on tape, CDROM, a magnetic hard disk, or any other appropriate recording medium that can be read by processor 300 for playback.
  • Step E determines if the frame read in step A is the last frame to be read, i.e. the end of the movie or the end of a particular sequence. If so, the routine ends and the recorded data is incorporated into a control program for controller 300. This can include conventional compiling or other manipulation to render the control program. If not, the frame is incremented, by one for example, and the entire process is repeated. When the routine ends and the data is incorporated into a control program, a light track has been recorded and can be played back, i.e.
  • the light track is converted to discreet voltage levels for each channel by I/O 380 to drive the four LCD panels in each light projector 200 thereby producing the colors and intensities for achieving the desired effects.
  • Time synchronization can be accomplished by using a prerecorded time track on the video medium or merely by starting playback of the light track at the same time as playback of the video and sound tracks.
  • the light track can be added to the recording medium on which the sound and video tracks are recorded in an integral manner.
  • the light track can be produced in real time with the video and sound tracks.
  • the controller can control the light projection directly based upon the output signal of a video and/or audio device.
  • the playback hardware can be modified to output the necessary light track channel signals and can be coupled directly to light projectors 200.
  • the playback device such as a VHS player, a CDROM player, a DVD player, or the like, can serve as the controller.
  • Terminal 450 is a digital computer, such as a general purpose personal computer.
  • Terminal 450 includes a microprocessor based processing unit (CPU) 452, random access memory 454, input memory device 456, and output memory device 458.
  • Input memory device 456 can be a conventional hard disk, removable diskette drive, tape drive, CD ROM drive, DVD drive, or any type of memory device capable of storing and reading a video track (and optionally a sound track).
  • Input memory device 456 can also store and read identifying data, SMPTE timing data, and any other data necessary for accomplishing the function described below.
  • Output memory device 458 can be a hard disk, a removable diskette drive, a recordable CD ROM drive, or any other device capable of writing and storing data.
  • a development program including the programming routine discussed above, is stored on input memory device 456, or on another memory device, and is executed by CPU 452 to record a control program on output memory device 458 in the manner described below.
  • Terminal 450 also includes display 460 (such as a conventional CRT, LCD or the like), display interface 462 (such as a standard video card), speakers 464, audio interface 466, keyboard 468, pointing device 470 (such as a mouse, trackball, or stylus), and input device interface 472. All elements of terminal 450 communicate over data bus 474, which can be any type of physical bus using any appropriate protocols. For example, an ISA bus, a VME bus, or a PCI bus can be used.
  • Fig. 7 illustrates a user interface of the programming system of the preferred embodiment.
  • the user Upon initialization of terminal 450 running the development software of the preferred embodiment, the user is presented with main window 500 and toolbar 612.
  • Main window 500 is displayed on display 460 and provides an editing type of environment including five sub-windows; information display window 502, time code window 504, editing window 506, color palette window 508 and multi-track event window 510 (all of which are only schematically illustrated in Fig. 7).
  • Multi-track event window 510 includes two different views from which the user can select, a graphical view shown in Fig. 11 and a list view shown in Fig. 13.
  • Information display window 502 displays information read from one or both of input memory device 456 and output memory device 458 such as the movie name, the user's (i.e. the programmer's) name, the date of last modification, the file size, the total number of events or frames, the optimum number of tracks, the version number of the movie track and any other information relevant to identifying, describing, or cataloging the file being created.
  • Time code window 504 operates on standards developed and promulgated by the Society of Motion Picture and Television Engineers (SMPTE) which provides a standardized sequencing time base for conventional editing purposes. Time code window 504 dynamically displays the time within the movie recorded on input memory device 456, i.e., the frame time, which corresponds to both editing window 506 and multi-track event window 510.
  • SMPTE Society of Motion Picture and Television Engineers
  • the movie frame for that particular time will be displayed in edit window 506.
  • the cursor When in the graphical view, the cursor will be positioned to the proper event time in multi-track event window 510 in the manner described below. In the list view, the event closest to the displayed time code will be shown at the top of multi-track event window 510 also in the manner described below.
  • Figure 8 illustrates color palette window 508 used to choose a particular color to be displayed by a light projector at a particular time.
  • the cursor on any portion of color band 512 the associated RGB (red, green, blue) value is displayed in the respective color value boxes 514, 516 and 518.
  • Color band 512 can be of any appropriate shape and can display colors in any desirable geometry.
  • color band 512 can be circular, triangular, square, or of any shape.
  • Display box 520 at the top of window 508 is then filled with the chosen color. If the user right clicks on color band 512 the associated RGB values are shown in color value boxes 514, 516 and 518 and display box 522 is filled with that color.
  • the user may specify a specific set of RGB values by clicking and typing the values in boxes 514, 516 and 518.
  • the supported values of the preferred embodiment are 1 through 16 for each R, G and B value, yielding a total color palette of at least 4096 colors. However, any level of color resolution can be supported.
  • Fig. 9 illustrates editing window 506 which is used to provide the user with a virtual view of the editing process in action.
  • the corresponding frame from the movie or video is read from input memory device 456 and displayed in movie frame window 530.
  • the image can be displayed frame by frame, at normal viewing speed, at a slow speed, or at double speed.
  • Frame 530 has an aspect ratio of, for example, 16 x 9. Therefore a 4 x 3 frame will normally show black bars on the left and right. With cinemascope films having an aspect ratio of 2.35 x 1, as shown in Fig. 9, small black bars will appear on the top and bottom of frame 530. Only regular widescreen films having a 16 x 9 aspect ratio will entirely fill frame 530. Alternatively, the size and aspect ratio of frame 530 can be adjusted in accordance with the aspect ratio of the movie recorded on input memory device 456.
  • Surrounding movie frame window 530 are nine channel bars 532, 534, 536, 538, 540, 542, 544, 546 and 548 that correspond to nine light channels used in the control program to control corresponding ones of the nine light projectors 200 illustrated in Fig. 4.
  • the bars represent the light projector positions of rear left (channel bar 532), middle left (channel bar 534), front left (channel bar 536), rear center (channel bar 538), middle center (channel bar 540), front center (channel bar 542), front right (channel bar 544), middle right (channel bar 546) and rear right (channel bar 548).
  • up to nine different colors may be associated with the nine different channels respectively.
  • Colors can be assigned by clicking on the respective bars.
  • the color from the associated display box 520 (for a left click) or display box 522 (for a right click) of color palette window 504 is copied to the respective bar and recorded for the respective channel.
  • the color under the cursor is copied to the color palettes left or right display box 520, 522. This allows the user to choose colors directly from the movie frame to be used in one or more of the channel bars 532-548 and to be recorded in connection with the movie frame on output memory device 458.
  • Step B the color determination step (Step B) referred to in Fig. 5 will be described in greater detail using the preferred user interface illustrated in Fig. 7.
  • the frame of a movie recorded on input memory device 456 and read in step A of Fig. 5 is displayed in Step Bl in window 530 and the corresponding frame time is displayed in time code window 504.
  • the user right or left clicks on a portion of color bar 512 of color pallette window 508 using pointing device 470 in Step B2.
  • the respective red, green and blue values are displayed in color value boxes 514, 516 and 518.
  • the user can directly input the color values into the color value boxes 514, 516, and 518 using keyboard 458 in Step B2.
  • the respective display box 520 or 522 will display the chosen color in Step B3.
  • the user may, as previously described, choose the color directly from the image displayed in frame 530 in Step B2 " .
  • the chosen color will be displayed in the respective display box 520 or 522.
  • Step B4 the user can select any of the nine channel bars 532-548 by clicking directly thereon in Step B4. This results in the color selected in Step B2, B2 , or B2 , and displayed in the respective display box 520 or 522 in Step B3, being copied into the selected channel bar in Step B5. This is repeated for each channel bar of the frame by determining if the color for the last channel bar has been selected. Once all the colors for the nine channel bars have been chosen, a new frame is chosen and the process repeats until the control program is completed. Data is periodically saved to output memory device 458.
  • slider 550 (only some of which are marked in Fig. 9) is provided in each of the channel bars 532-548. Sliders 550 can be moved up or down, or left to right for center channels 538-542. Sliders 550 represent the intensity level for the projectors for a given channel for a given frame. By dragging slider 550 along slider index 552 (only some of which are indicated in Fig. 9) the user can set the intensity level for each channel in each frame.
  • the color selection process described above in connection with Fig. 10 associates colors to be projected by light projectors 200 with an image frame one frame at a time. While this provides a high degree of creative control, it can be time consuming and tedious when a large amount of lighting events are to be recorded. Therefore, the user interface also permits real time recording of a light track, i.e. programming.
  • one of channel bars 532-548 is selected in visual surround edit window 506 and the cursor is positioned over a desired portion of movie frame window 530.
  • pressing the space bar of keyboard 468 will alternately start and stop playback of the video or film and recording of color data for the control program at the selected speed.
  • the color under the cursor will automatically be assigned to the selected channel bar 532-548 during playback, i.e. recorded in the control program in correspondence to the channel of the selected channel bar.
  • the cursor can be moved over the displayed image during playback to dynamically change the recorded color for the selected channel bar 532-548. This procedure is repeated for each channel bar 532-548.
  • plural channel bars 532-548 can be selected if colors for plural channels are desired to be the same.
  • the nine channel bars 532-538 will display the programmed color events associated with each frame of the movie and the channel sliders will indicate the chosen intensity. This allows the user to see the overall effect of light projector system 100 on a particular segment of film over time using the programming operator interface. Since light projectors 200 will continue displaying the same color and intensity until another light event is received, edit window 506 mimics this by continuing to show the same colors and intensity levels in respective channel bars 532-538 from a past light event until the occurrence of a new event. Accordingly, a new light event will only have to be entered upon a change in lighting, not for every single channel in every single frame. Each channel receives an individual light event.
  • the multi-track event window 510 has two views, the graphical view 576 shown in Fig. 11 and the list view 578 shown in Fig. 13.
  • Graphical view 576 is similar to edit window 506, in that graphical view 576 shows the colors for all nine channels at one time. However, graphical view 576 represents these colors simultaneously over a span of time.
  • Graphical view 576 also differs in that it does not directly display any intensity level data for any of the channels 532-548.
  • the span of time displayed in Fig. 11 varies according to the interval chosen on the toolbar 612 (Fig. 7), as described below. As shown in Fig. 11, the interval of one frame is chosen, meaning that each box of color 580, from left to right, represents l/24th or l/30th of a second of movie run time, depending on whether film or video is being edited. With fifteen frames being shown in total, Fig. 11 represents just over '/_ second of film or exactly V 2 second of video.
  • a pop-up window 584 By double-clicking on any one of channel bars 532-548 shown in the leftmost column 582, a pop-up window 584, as shown in Fig. 12, appears and shows intensity over time. Thus, the user can monitor changes of intensity over time with pop up window 548.
  • pop-up channel intensity window 586 shows an amount of data which is dependent upon the time interval selected on toolbar 612 as discussed below.
  • selection of light events is possible by dragging the cursor over the grid area where the colors or intensities are displayed. By selecting a region over time for one or more channels, users may apply any number of color functions that are available on toolbar 612.
  • List view 577 of multi-track event window 510 is shown in Fig. 13.
  • events are displayed in text mode in a tabular form in accordance with column headings 579 of the top of list view 577. This allows the users to see the colors and intensities simultaneously in a numerical view along with the exact event time for when the particular event is triggered.
  • list view 577 can be monitored during playback. During monitoring the events can scroll from bottom to top over time.
  • Fig. 7 illustrates toolbar 612 which allows the user to control the "flow" of the action.
  • Toolbar 612 is displayed on display 460 just above main window 500.
  • Toolbar 612 can be located or sized as desired.
  • Toolbar 612 preferably is displayed at all times with main window 500 if the size of display 460 is adequate.
  • the user can advance the current movie or video one frame at a time or in normal time using standard VCR controls.
  • Toolbar 612 includes stop button 614, record button 615, play button 616, pause button 618, full rewind button 620, advance one frame button 628, reverse one frame button 622, slow motion forward button 630, slow motion reverse button 624, regular speed reverse button 625, double speed forward button 632, full advance button 633, and double speed reverse button 626.
  • Toolbar 612 also includes drop-down list control 634 to select the time scale for graphical view 576 of multi-track event window 510. The default time scale corresponds to one frame for each horizontal grid increment, but other time scales may be chosen producing a different look to the graphical view.
  • toolbar 612 also supports standard new, open and save file functionality in buttons 635, 636 and 637. The user will be prompted to save the file each time the play button on toolbar 612 is pushed or the user can save the file by pressing the save button on the pull down file menu.
  • the program development sequence also includes built-in color functions to aid the user during control program creation.
  • the color functions can be accessible from toolbar 612 or by right clicking on multi-track event window 510 after a selection is made.
  • the color functions can include fade, transition, shadow, color burst or any other effect.
  • fade button 638 only affects intensity. The color remains the same but the intensity either drops off or increases by a certain percentage over a given time span.
  • Transition button 640 affects only color. A change from one color to another occurs using the shortest path possible on the color palette over a predetermined period of time while the intensity remains constant.
  • Shadow button 642 also affects intensity. With this function, intensity drops off for a brief instant and then returns to the original selected value.
  • Color burst button 644 affects both color and intensity.
  • the colors get richer (darker) and the intensity increases to produce a rich, bright color before returning to the original selected color and intensity.
  • Each preprogrammed color function modifies the colors and/or intensity chosen by the user as described above. Pop up dialog boxes can be used to specify details of the color functions.
  • Function libraries of stored lighting sequences can be created. For example canned sequences for lightning, headlights, beacons, and the like can be stored and edited for time duration and the like. Various methods of color and intensity calibration can be used to ensure that the proper colors and intensities are displayed.
  • the purpose of the programming routine is to create a file which controller 300 can read and whose data can be passed to light projectors 200.
  • a user can synchronize tracks of data with video or film events on a frame by frame basis or based on portions of the video or film.
  • the programming routine can be effected by computer software and can be a standalone product with the capability to read in movie tracks or a "plug in" to an industry standard movie-editing tool such as those produced by AVIDTM or ADOBETM.
  • the programming routine can be run under, for example, Microsoft WindowsTM 95/98/NT, on a variety of different computer systems. In most circumstances the control program will be small enough to fit on a floppy disk.
  • Date/time of last modification 14 bytes 14 bytes (date: 8, time: 6, both ASCII decimal values)
  • the file includes an undetermined number of light events in a continuous stream. Each light event will be 8 bytes containing:
  • Intensity level 1 byte (0-255, currently 0-16)
  • the lighting event is compiled and another event is selected for the process.
  • the track contains the entire sequence of lighting events, i.e. a light track, that is inserted into a control program to be read by controller 300 to control light projectors 200 as a movie is displayed on screen 400.
  • Time delay functions can be incorporated into the program development routine for multiple light projectors 200. Functions can be thus executed by plural light projectors 200 in sequence. For example, if an event such as a sunset occurs on-screen in a time lapse fashion, the color, intensity, and shadow cast would be subject to gradual but observable change. The change in color and intensity in one area of the on-screen image is enhanced by a commensurate change in color and intensity of light in portions of the surrounding room. This is accomplished by changing those same characteristics in the light output by light projectors 200 in positions corresponding with the location of the area of the on-screen image. The light projectors 200 change color and intensity over time in sequence with one another to execute a movement function. Also, the function of the light projectors 200 can be shifted to be slightly in advance of the on-screen image to set a context in the viewers peripheral view and to "prepare" the viewer for the on-screen image.
  • the invention permits a control program to be developed which includes signals or data indicative of the color and intensity of the light projectors over time during playback of film or a video image.
  • the development software can be run on any machine (i.e. terminal).
  • the controller and the terminal can be the same computer.
  • the various memory devices need not be distinct devices.
  • the input memory device and the output memory device can be the same physical and/or logical drive of a computer.
  • a standard programming interface can be used to create the development software and user interface. For example, if the software is to be run on Windows 98TM, the Windows API can be used.
  • the controller can take any form depending on the application of the light projector or plural light projectors.
  • the controller can be contained in the same housing as the light projector to provide an integral unit.
  • the controller can include various manual or programmable controls for changing colors and intensity in a desired manner.
  • the invention can be applied to home theater, television sets, video players, film projectors, commercial theater, or in any application where variable color and intensity lighting is desired. Any type of light projector can be used.
  • the invention has been described in connection with video recordings or movies. However, the term "video”, as used herein encompasses all visual recordings including video tape, CDROM, movies on film, DVD, and the like.
  • the invention has been described through a preferred embodiment. However, various modifications can be made without departing from the scope of the invention as defined by the appended claims.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention concerne un procédé et un appareil permettant de programmer un système de projection lumineuse en couleur (100), capable à la fois de produire une lumière de différentes couleurs en même temps qu'une image affichée, et de projeter cette lumière de différentes couleurs sur des surfaces qui entourent cette image affichée. Ce procédé consiste tout d'abord à lire la trame d'une image, à sélectionner des couleurs pour plusieurs voies qui correspondent à cette trame de l'image, puis à enregistrer ces couleurs, qui peuvent être sélectionnées pour n'importe quelle trame d'image nécessitant l'utilisation dudit système de projection lumineuse en couleur (100). Enfin, une interface utilisateur de type édition facilite l'application de ce procédé de programmation.
PCT/US2000/016331 1999-07-14 2000-07-14 Appareil et procede pour programmer un systeme de projection lumineuse en couleur WO2001006316A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU60504/00A AU6050400A (en) 1999-07-14 2000-07-14 Apparatus and method for programming a color light projector system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US35313299A 1999-07-14 1999-07-14
US09/353,132 1999-07-14

Publications (1)

Publication Number Publication Date
WO2001006316A1 true WO2001006316A1 (fr) 2001-01-25

Family

ID=23387894

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/016331 WO2001006316A1 (fr) 1999-07-14 2000-07-14 Appareil et procede pour programmer un systeme de projection lumineuse en couleur

Country Status (2)

Country Link
AU (1) AU6050400A (fr)
WO (1) WO2001006316A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1408362A1 (fr) * 2002-10-10 2004-04-14 FER Fahrzeugelektrik GmbH Lampe, en particulier lampe de véhicule
WO2009158514A1 (fr) 2008-06-26 2009-12-30 Telelumen, LLC Création, enregistrement et reproduction d'éclairage
US8922570B2 (en) 2011-03-11 2014-12-30 Telelumen, LLC Luminaire system
US9066404B2 (en) 2008-06-26 2015-06-23 Telelumen Llc Systems and methods for developing and distributing illumination data files
US9974141B2 (en) 2008-06-26 2018-05-15 Telelumen, LLC Lighting system with sensor feedback

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5565933A (en) * 1992-06-08 1996-10-15 Hughes-Jvc Technology Corporation Color switching apparatus for liquid crystal light valve projector
US5946513A (en) * 1992-03-17 1999-08-31 Sony Corporation Photographic and video image system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5946513A (en) * 1992-03-17 1999-08-31 Sony Corporation Photographic and video image system
US5565933A (en) * 1992-06-08 1996-10-15 Hughes-Jvc Technology Corporation Color switching apparatus for liquid crystal light valve projector

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1408362A1 (fr) * 2002-10-10 2004-04-14 FER Fahrzeugelektrik GmbH Lampe, en particulier lampe de véhicule
US9066404B2 (en) 2008-06-26 2015-06-23 Telelumen Llc Systems and methods for developing and distributing illumination data files
US8021021B2 (en) 2008-06-26 2011-09-20 Telelumen, LLC Authoring, recording, and replication of lighting
US8469547B2 (en) 2008-06-26 2013-06-25 Telelumen, LLC Lighting system with programmable temporal and spatial spectral distributions
US9028094B2 (en) 2008-06-26 2015-05-12 Telelumen, LLC Creating and licensing illumination
WO2009158514A1 (fr) 2008-06-26 2009-12-30 Telelumen, LLC Création, enregistrement et reproduction d'éclairage
US9534956B2 (en) 2008-06-26 2017-01-03 Telelumen, LLC Recording illumination
US9974141B2 (en) 2008-06-26 2018-05-15 Telelumen, LLC Lighting system with sensor feedback
US10172204B2 (en) 2008-06-26 2019-01-01 Telelumen, LLC Multi-emitter lighting system with calculated drive
US10339591B2 (en) 2008-06-26 2019-07-02 Telelumen Llc Distributing illumination files
US10433392B2 (en) 2008-06-26 2019-10-01 Telelumen, LLC Lighting having spectral content synchronized with video
US8922570B2 (en) 2011-03-11 2014-12-30 Telelumen, LLC Luminaire system
US9345117B2 (en) 2011-03-11 2016-05-17 Telelumen, LLC Luminaire executing scripts for dynamic illumination
US9888539B2 (en) 2011-03-11 2018-02-06 Telelumen, LLC Lighting system using sensors

Also Published As

Publication number Publication date
AU6050400A (en) 2001-02-05

Similar Documents

Publication Publication Date Title
EP0564247B1 (fr) Méthode et appareil d'édition vidéo
AU681665B2 (en) Method and user interface for creating, specifying and adjusting motion picture transitions
US6898309B2 (en) Color matching image data
US5359712A (en) Method and apparatus for transitioning between sequences of digital information
US6072537A (en) Systems for producing personalized video clips
US5808628A (en) Electronic video processing system
US5640320A (en) Method and apparatus for video editing and realtime processing
US6204840B1 (en) Non-timeline, non-linear digital multimedia composition method and system
US6913362B2 (en) Projection display apparatus and method of display
US5812216A (en) Method and apparatus for creating motion picture transitions according to non-linear light response
RU2427986C2 (ru) Управление окружающим освещением на основе событий
JP2002262179A (ja) ビデオミキサー装置
US7483619B2 (en) System for authoring and viewing detail on demand video
US20030068161A1 (en) Media program with selectable sub-segments
JP2011055548A (ja) リアルタイム・アンサープリント・タイミング・システム及び方法
WO2001006316A1 (fr) Appareil et procede pour programmer un systeme de projection lumineuse en couleur
US10834298B1 (en) Selective audio visual synchronization for multiple displays
Hunter Computer animation survey
WO2007104061A2 (fr) Effets d'éclairage commandés par console
US6525765B1 (en) Image processing
JP2939001B2 (ja) 情報編集装置
Ambrogi Color grading: influences and differences between cinema and advertisement
WO2010110766A1 (fr) Procédé et appareil pour l'enregistrement d'affichages d'écran
JP2009145523A (ja) 画像表示装置、画像表示装置を備えたプロジェクタ及び画像表示装置の制御方法
KR20000024126A (ko) 네트워크를 통한 영상제공방법 및 영상제공시스템

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP