JP2024508738A - Light valve surface image and light beam projector - Google Patents

Abstract

Lighting systems and methods control light to prioritize different elements of a light beam output by a lighting fixture. The LCD surface acts as a color occlusion filter, providing pixel-level control of the light beam transmitted by this layer. Inside, an LED light source is projected perpendicularly onto a concave reflector that is movable in one axis and thus capable of zooming to widen or narrow the light emitted forward as a light beam. The system also has a cooling function.

Description

Although solid-state light sources have introduced a variety of new options to designers, the basic form of the light itself has not changed much since the mid-2000s. There is a soft light defined by the plane of the LED light source that can be covered with a diffuser. However, one problem with these soft lights is that they require diffusion to avoid artifacts caused by multiple light sources arrayed in front of the fixture. This creates a stepped shadow visible on a flat surface.

Movie and television lighting has changed little since the 1970s, despite the incorporation of mappable LED lighting fixtures such as the Arri Skypanel. Mappable LED lighting fixtures have been around since the mid-2000s, but they have not been able to overcome the limitations of light source diversity that rely on diffusion to avoid creating multiple shadows. The mapping capabilities of these luminaires outweigh their disadvantages. Both Arri Skypanels and LED video displays are commonly used to animate light and are effective in near-field environments.

However, the light from these lighting fixtures reaches everywhere. Since these are approximately Lambertian sources that emit hemispherically uniformly, they cannot be easily masked. Good for soft light, but not good for creating structured light beams. Therefore, large video projectors are sometimes used. However, video projectors have limitations because they are point light sources that produce a single point of bright light that causes unnatural reflections. Engineers are working against optical engineering to create a softer output. But these solve the problem.

Many works use large LED displays to digitally create landscapes that can be perspective mapped as the output of a game engine's virtual camera. Such environments are often referred to as "digital twins" because they are often associated with physical locations or real sets. The term has been in use for some time, but became popular in recent years due to the work The Mandalorian. In this work, Unreal Engine was used to create a digital background that can maintain proper perspective as the camera moves, creating a motion parallax that adds a layer of realism to the digital reproduction. Also, when using lighting mapping, the light source must be fixed relative to its position within the digital twin. The actor's lighting should change as he moves relative to the sun or an artificial light source, or an object that obscures the light source, but this is only possible with great effort from the production team. Creating such a mappable array of lights is complex, and the lighting often needs to be physically adjusted from shot to shot.

There are also wash lights that may have an LED light source but are still soft zoomable lights. Some profiles can project light and integrate gobo lighting and slides to create textures and still images.

Advances in computing and light sources, as well as new requirements in design and production, require new types of light. These new lights can leverage a variety of existing technologies to provide designers with new types of dynamic control. However, achieving this will require the core technology to diverge from the way it is currently used.

Video projection is a good example. When optimizing for general video applications, a key requirement concerns performance at the screen surface. The level of control required encourages the use of very small imaging devices. The history of video projection is tied in part to the steady miniaturization of imaging devices, along with improvements in optical efficiency and advances in optics and light sources. Some early rear projection systems used large LCD panels due to lack of alternatives.

Early LCD rear projection displays were sometimes made using large LCD panels designed for laptops or other large capacity commercial displays. By using a large single light source and a Fresnel lens, it was possible to create a projection system from these LCDs. This is still alive today by hobbyists and in low-cost video projectors using LCD displays on smartphone devices.

LCD displays were established by brands such as Epson and Sony based on LCD display research that began in the late 1960s. The first LCD-based light bulbs were manufactured earlier by Marconi. Through the acquisition, Marconi continued as English Electric Valve, producing an LCD-based product called Starvision.

Liquid crystal displays are based on the ability of liquid crystals to modulate light by switching between two states. By using polarizers on the front and back of the liquid crystal, it is possible to turn the light on and off. When the liquid crystal is facing a certain position, the polarizing plate on the front blocks that polar light, so the screen appears black. When the liquid crystal cell is rotated 90 degrees, the polarization of the light aligns with the polarizing plate on the front, and the display transmits the light.

Recently, LCD panels have been considered for application in the automotive industry to create movable headlights.

The entertainment industry is looking elsewhere for LCD driven light sources that include large light emitting surfaces. The ideal light emitting surface is a spherical array of light field emitters, each perfectly replicating the light output emitted from that point in space, both in shape and polarization. This computer-controlled mapped wavefront can bathe a scene with light that replicates a real-life space, or that is needed for a digital representation of the space recreated by a camera for a movie scene. It is possible.

Some important elements of stage lights can be driven by this abstracted goal. The systems described herein can generate light at various angles, and the output can be controlled so that only light at a desired angle is output at any given time.

Currently, stages may be lit with soft lights, wash lights, and video projectors. However, none of these, individually or in combination, can illuminate the stage in such a way that the light can be actively controlled. Such stages make less use of large video display surfaces driven by real-time game engines that generate background scenery on display panels for camera shots. By doing this, what previously required a separate back plate for special effects can now be captured with a camera. However, these shots are degraded by the failure of the lighting to faithfully represent the environment of the digital scene.

By using a new variant of the LCD lighting system designed around the quality of light created by the light projector rather than the video image, we have developed a new variant of the LCD lighting system that is designed around the quality of light created by the light projector rather than the video image. The general term for light sources may be light source, but other terms for light sources are also used). Such light sources have the ability to change the beam angle, soften or sharpen the light, and can be used in large arrays to create dynamic virtual light sources. Examples of these may include the sun wrapping around behind a building, the sun passing behind a hill or tree, headlights moving across a building, like the sun shining through an open window on an airplane, etc.

This uses a game engine like Unreal or Unity (although it's called a game engine, this content generation engine may simply create video output unrelated to the game) to create a virtual image on the display. It is possible to create a Using digital lighting of the scene, it is possible to create large virtual light source outputs. This can be integrated with ray tracing by determining what light is coming from the position of the lighting fixture. Then, it is possible to output the combined 4K frame as a video signal together with the video signals of all other lighting equipment. Since each light may have a specific position and orientation in 3D space, the output of each luminaire may be different. Each luminaire represents light that is reproducible from the position of that light, rather than a subset of a larger image. In a sense, this is a type of light field display.

Light field arrays are part of the system herein and can work with these displays and game engines. A single unit of light within a system-wide light source has many interesting capabilities, but the ability to integrate into a three-dimensional array in the same way as volumetric capture and recreate complex illumination from inside a digital 3D scene is This is difficult with existing technology.

To achieve this, it is necessary to manage the intertwining of interactions within the system.

First, some of the lighting information may be available within the game engine, meaning the game engine itself may have programming to set the lighting and effects.

Second, lighting information may be supplemented by numerous components within the game engine that also exist in physical space.

Third, the lighting units in the physical space create an overall mapping system that incorporates not only the virtual space, but also other physical elements in the scene, including display walls, physical characteristics of the environment, and performers present in the environment. It may be part of. This may be integrated across multiple computer servers and may include elements of the system located on the cloud. The timing between all these elements may be accurate and synchronized with all cameras used to capture the scene.

A system that does this could be able to properly illuminate voluminous performers while eliminating unnecessary stray light that mars the performance of large displays that already incorporate digital elements of light that illuminate the performers.

The array of lighting fixtures described herein can be virtual light sources that replicate natural and artificial lighting elements of the environment. In a simplified description, an array of luminaires may represent a light source that moves relative to the object being illuminated.

These system components can support multifocal output by integrating different groups of LEDs within the center of the reflector. The movements of the different groups can be unified or split so that one half of the luminaire is at one beam angle and the other half of the luminaire is at another beam angle.

In this way, the system is able to illuminate natural scenes and match the computer-generated lighting of digital scenes. This is also applicable to other aspects of lighting allowing dynamic cycloramas and footlights. As the light source is motor-driven and movable to adjust the position of the light source relative to the reflector, convincing beam angle and focus control is possible with cycle lights or footlights as well.

A further feature is the system's ability to track performers within a scene. This is important for two reasons. Generally, the camera (or the audience) focuses on the performer. The lighting of the scene may then be determined based on how its performers are lit. However, the total amount of resolution available for this function may always be finite. In order to focus on the performer, it may be desirable to de-emphasize the lighting of the scene where the performer is not in focus. In this way, one 4K (3840x2160) output could allocate 1920x1920 to the performer, with the remaining resolution driving the lighting that illuminates the rest of the scene. And this 1920x1920 region of interest might be where we want to track the performer. That is, the illumination that provides high-resolution information and the illumination that provides low-resolution information can change dynamically over the course of a scene.

In addition to this, digital masks that prevent light from hitting the large displays used in virtual productions are comprised of high-resolution regions of interest, while areas outside the mask are typically exposed to light that does not hit the performers. This can be low-resolution information directed towards. For smooth tracking, the light needs to operate in the 240-480Hz range, but while the mask follows the performer at 240-480Hz, the performer's high-resolution content may only be rendered at 60-120Hz. unknown. This may improve the appearance of tracking and improve masking of light from the display screen.

This mask can be created locally at the lighting fixture using a sensor integrated into the light (sometimes referred to herein as a light source). This system is capable of creating 2D masks that define active and inactive areas of the projected light source. A lighting texture map representing the projected light field is generated using the same sensor data or other available data with a second content engine. The latency and frame rate of the two layers are locked, meaning that the 2D mask can be updated at a higher refresh rate with lower latency, while the texture map is updated at a lower frame rate and slightly higher latency. It may not be possible. The output of the luminaire can be a composite of these two feeds, with the mask tracking the subject with low latency while the projected content is slightly delayed. The resulting lighting effects are better than current options. Because camera capture more accurately renders the light in the scene while minimizing the light on the LED wall, it allows for a more complete representation of the filmmaker/creative director's vision. It is.

The sensor for this may be external, but it is also possible for the sensor to be integrated in the center of the light, either in front of or behind the light modulating surface in front of the light.

The light may also incorporate a polarizing filter, which can be tuned to improve the light's performance when used with various specular materials and polarizing filters.

In order to use lighting in a planar mapped array, it may be necessary to match the colors between the lighting fixtures. This is because both the color temperature of the light source and the color characteristics of the front light modulator are known in the abstract and can be determined in a closed-loop calibration system during manufacturing or as part of lighting service and maintenance. It might be possible.

This system can be integrated into existing luminaires by creating an accessory module that can be placed in the focal plane of an existing luminaire to create a dynamic gobo and provide some (but not all) of the functionality of a dedicated fixture. It is possible to apply it to the lighting of

In some cases, the light modulator may be thermally sensitive, so thermal management of the luminaire may be integrated directly into the accessory. In this example, a polarization recycling prism can be used as a thermal break to separate the light source from the light modulator while increasing optical efficiency. The prism can create a thermal isolation between the light source and the LCD, allowing closed-loop cooling or ambient convection cooling to keep the liquid crystal within the required operating range.

In the future, it may be desirable to replicate these functions in flat lighting fixtures such as today's soft lights. Such lights are often ideal for near-field applications where the light source is close to the subject of the light. Eventually, light field displays may fill this role, but until then, users may value the ability to dynamically control the beam angle of each ray output from the system. This can be achieved with wedge optics and diffractive or holographic light guides.

In such a system, it is possible to incorporate an anamorphic lens into the imaging device to improve resolution in one axis direction. In such a system, it may be possible to combine a small imager with a distributed laser phosphor light source to create such an array.

Such lights may require full network connectivity internally so that the sensor data and distributed processing required to provide a high frame rate lighting solution is not hampered by local controller limitations. Each light has a network switch with separate paths for light control, sensor integration, and local processing, allowing for asynchronous integration of all these elements.

The light may also include a GPU to locally compute mask requirements. This local GPU system ingests a distributed video map from a media server, so that the mask is optimized by the highest frame rate possible with the light modulator, while the content is limited only by the highest frequency output from the source. It is possible to synthesize the output. This source can be a general game engine or a specially developed media server. In either case, the data path limitations between the light source and the light may be more restrictive than those between the local computing system and the light modulation panel. The system can be optimized around this source to support tracking as smooth as possible.

A typical LCD display is shown. 2 shows an LCD as a modulator of light. A new LCD application is shown. Demonstrates the lighting approach. A virtual production volume by a projector is shown. Fig. 3 shows a virtual production volume by LCD system. An LCD is shown as a light source. Figure 3 shows variable resolution in the LCD array. Shows the topology of the system. Figure 3 is a front view of the proposed design. Figure 3 is a side view of the proposed design. FIG. 3 is a perspective view of a design with a yoke; FIG. 3 is a rear perspective view of the proposed design; Figure 2 is a front perspective view of the proposed design; FIG. 3 is a front view of the array of lighting fixtures. FIG. 3 is a perspective view of the rear of the array of lighting fixtures. FIG. 3 is a front perspective view of the moving light. FIG. 3 is a perspective view of a moving light floating in the air. FIG. 3 is a cutaway perspective view of the moving light. FIG. 2 is a cutaway perspective view of a moving light with an exposed reflector. A cross section through the optical system is shown. FIG. 3 is a perspective view of an LED light source. A cross section of the light source is shown. This shows the processing in front of the light source. Figure 3 shows a cutaway view of the moving light showing the cooling system. Figure 3 shows a cutaway view of the moving light showing the rear of the cooling system. Showing the thermal management system. A block diagram of an electronic device is shown. It is an expression of content management. The components of a dynamic mask are shown. Demonstrates the process of dynamic masking. Calibration details are shown.

introduction

Light valve surface image and light beam projector

It is an object of the present invention to provide both a visually animated surface image and a projected light beam in order to create a final visual image that is well presented to the user. As elements of the system to achieve this purpose, mention may be made of a light source with a fixed position or one side of a motorized moving cube, with a recessed mechanical frame surrounding the light-emitting surface, which acts as a protective cowl. . It may be the LCD panel that is set back to this frame. This panel consists of a matrix of pixels. A total of 960x960 pixels forms a two-dimensional surface with a suitably high contrast ratio of no less than 3500:1. Due to its physical embodiment, this liquid crystal display (LCD) functions as a light source with a luminous value. In this system, light projected from within a light source can be advanced as a computer-controllable light beam.

Swing gimbal mechanical structure

It is also an object of the invention to move the projected light beam within a rotating gimbaled mechanical light source cube. Movement attributes can be remotely controlled via external computer control to affect proportional movement in two axes. That is, a panning motion with a total rotation not exceeding 540 degrees and a tilt axis motion of 250 degrees, and when these are combined, it becomes a substantially three-axis motion.

Optical system

It is also advantageous to control the emitted light beam by influencing its width. This remote proportional electric control of the zoom attribute allows the beam width to be quickly adjusted from 140° to a narrow 4°. The light beam can be reversed up to -90°. Within the moving body (ie, gimbal cube), the LED light source may be back-projected onto a moving square parabola or spherical or concave reflector. This highly reflective mirror collimates or focuses the light emitted from the diode through the LCD occlusion layer. As a result, light is projected forward. Additionally, the entire surface of the LCD board may be obstructed by a central emitting light source, and a second forward-facing LED light source replaces the obstructed or lost surface light at the center of the LCD panel. , it is possible to maintain perfect light uniformity across the LCD substrate when viewed directly or indirectly.

air cooling system

LCD substrates may have an optimum operating temperature under normal backlight conditions that is suitable for high ambient continuous use. Another feature of the system relates to extra high backlight requirements. This embodiment continually reduces heat build-up as photons of light are internally generated and emitted in a sealed environment and are partially absorbed or reflected by the nature of the LCD substrate design. An internal radiant heat exchange system is capable of capturing the radiant heat build-up produced by the LED light source. On the other hand, up to 30% of the total heat generated in the light generation process is emitted forward within the light beam. Multiple radiators fitted with fans push and pull air within the moving cube. This creates a moving sheet of air across the inner surface of the LCD board by an internal air conduit formed from the internal metal box structure, which travels along the inner surface of the LCD board from bottom to top, similar to gravity. Guide the air according to the direction.

liquid cooling system

Another embodiment of the present system may include the feature that the transfer cube is substantially sealed from external ingress of particulates and moisture. In powerful, high-density LED lighting arrays, it is possible to cool the light source with an integrated liquid cooling system. This liquid cooling system operates even below normal freezing temperatures. Liquid is pumped through a dual redundant impeller pump system. The effect of this cooling system is to divert liquid through the LED assembly. A uniaxially mounted manifold is attached to a single inner and outer tube directly behind the reflector. This may be located in the center of the light reflector component. Liquid cooling systems extract radiant heat by including air-cooled radiators within the system arranged in a motorized movable design. Additionally, liquid cooling water enters both sides of the tilt pivot point and is mechanically guided through the syndipan pivot point to the static base. The base radiator radiates heat directly to the atmosphere with forced air cooling, removing heat from the system. This closed loop liquid cooling system can pass through a universal orientation liquid reservoir before being recirculated and repeated.

Electronic real-time internal sensing and remote monitoring

Another embodiment relates to the deployment of various electronic sensors. These sensors provide accurate real-time status of internal functions. This sensory information can be analyzed remotely via a local external computer, a remote application, or a dual data connection to a remote monitoring station at the manufacturer's headquarters. The system provides remote analysis and is capable of advising on technical issues that may arise from harsh operating conditions.

Critical sensing of the system includes LED temperature monitoring. Elevated temperatures may indicate a defect in the integrated liquid cooling system, such as a failed pump or fan failure. Within the fixed base, an anemometer measures airflow past a plurality of radiators located within the fixed base. A weak point in the system can be lint and particulates that adhere to the radiator surface due to smoke liquid condensation. This often happens with stage lights located near such smoke generators. Because radiators allow for forced air movement, the buildup of this unwanted particulate can disrupt normal air flow, degrade the liquid cooling system, and lead to increased core temperatures. This phenomenon usually only becomes apparent when the system overheats. Our sensor array has several reference points for water temperature, ambient temperature, and screen surface temperature to alert you to a gradual decline in optimal performance. Another sensing function includes the battery charge status of the universal battery backup included in the present invention.

Asset monitoring system

These sensors can disseminate this information in several forms with a good range of electronic sensors placed within the system. It is localized to the current environment whereas a person skilled in the art or a creator controlling the product via a remote computer can be alerted to problems via the remote device management form of DMX (RDM DMX). When the system is connected to a data network, the device can "ping" or transmit sensor information to the manufacturer or asset owner, providing a detailed real-time picture of product performance.

electronic power backup

Another feature of this embodiment is that it provides universal battery backup in the event of a power outage under certain harsh environmental operating conditions such as outdoor stages. In the event of an accidental power loss, providing a universal battery backup can eliminate the loss of time in rebooting or powering up the system. Its use maintains internal power for electronic processes critical to the system. If mains power is removed from the device, rather than a complete catastrophic failure, the present invention will alert the local operator by means of a flashing visual warning triangle on the touchscreen graphical user interface that provides local control over the device. issue a power outage signal. Additionally, several different data protocols allow the system to alert the user of power outages to external computers used for remote control.

Modular fixed base electronics architecture

The system can be equipped with alternative electronic components to allow maximum versatility in image processing, especially for LCD boards. Generally, it may be desirable to have multiple different data inputs suitable for different applications. With a setup similar to a standard rack mount system, 1U of small width rack space provides high data transfer distribution over fiber optics.

Additionally, control of the video images transmitted to the LCD board can be controlled externally from a video source such as the SDI data protocol, or internally from an internal DMX controlled graphics engine. This engine also functions as a localized video scaler. With the ability to adjust pixel resolution to suit different applications, the video and lighting signals of the DMX-controlled internal graphics engine can be sent to an adjacent lighting fixture that acts as a master, and the adjacent lighting fixture Operates as a slave.

This internal graphics engine can eliminate the need for external video signals and the subsequent skills of people skilled in the art of video content production. Deliver video content directly to the LCD screen by internally producing the video content in a generative manner. These internal video attributes are completely directly controlled by only the DMX lighting signals received from the external computer. The above electronic requirement options can be installed or removed due to the modular mechanical architecture that embodies the fixed base of this system.

explanation

A display system using a liquid crystal display as a light source may consist of a liquid crystal matrix sandwiched between a front polarizer and a rear polarizer, as shown in FIG. Light source 100 may be solid state or conventional. This light source 100 passes through a first linear polarizer 101 placed between the light source 100 and the liquid crystal display 102 . Then, mainly one polarized light passes through the liquid crystal display 102. This light passes through a second linear polarizer 103 rotated 90 degrees from the first linear polarizer 101 . This allows the display to turn the light on and off.

Liquid crystals are established modulators of light with a long history in segment displays, panel displays, and video projection. Many of the early projectors used typical LCD panels, and a community of hobbyists built home projection systems similar to the one shown in Figure 2 using 15- to 20-inch diagonal LCD displays. Established. In some cases, this is as simple as placing a standard light bulb 200 behind the liquid crystal display 201.

Liquid crystal displays are being considered for new applications where dynamic steering of light is important. One such application is the European Union's VoLiFa program, where a liquid crystal matrix 302 is used to control the output of automobile headlamps, as depicted in FIG. Such a headlamp uses an array of light emitting diodes 300 to project light through a polarizer 301 before passing through a liquid crystal display 302 and a second polarizer 305. Thereafter, the lens 305 is used to control the output of the headlamp.

Movie and television lighting has remained largely unchanged since the 1970s, despite the integration of mappable LED lighting fixtures such as the Arri Skypanel. Mappable LED lighting fixtures have been around since the mid-2000s, but they have not been able to overcome the limitations of light source diversity that rely on diffusion to avoid creating multiple shadows. The ability to map these luminaires outweighs the disadvantages. Both Arri Skypanels and LED video displays are commonly used to animate light and are effective in near-field environments.

A typical LED lighting fixture, such as that shown in FIG. 4, may include a grid of light emitting diode packages 410. These packages can be surface mount packages or DIP packages. It is also possible to use a high-output package. Each of these LED packages outputs light over a particular beam angle 411, 412, 413, and these beam angles overlap 420 across the array. Also, since the beam angles of the LED dice are different, a color shift also occurs. When these overlapping light sources A, B, C fall on the object 415, multiple shadows 421, 422, 423 are possible.

The problem is that the light from these luminaires goes everywhere. It is almost a Lambertian source and radiates uniformly in a hemispherical shape, so it cannot be easily masked. This is good for soft light, but not for creating structured light beams. For this reason, large video projectors are sometimes used. However, since video projectors are point light sources, they are limited in that they produce a single point of bright light that causes unnatural reflections. Engineers sometimes compete with optical engineering to create a softer output.

Many productions are using large LED displays to digitally create landscapes that can be perspective mapped as the output of a game engine's virtual camera. This has been used for some time, but was recently made popular by the movie The Mandalorian. For this work, Unreal Engine was used to create a digital background that maintained proper perspective as the camera moved, and motion parallax added a layer of realism to the digital reproduction. Also, lighting mapping is used as the light source needs to be fixed, something that is only possible with a lot of effort from the production team. Creating such a mappable lighting array is complex, and the lighting often needs to be physically adjusted from shot to shot.

FIG. 5 shows an overview of a mapped lighting system 500 where a particular virtual production volume has different lighting requirements than a typical stage. The lighting design can be fully integrated with the content output from the computer source 515 driving the LED video display 511. These displays 511 are provided with perspective mapped content that tracks the movement of the camera 520. Some experiments have been conducted using video projectors as light sources for LED volumes used in virtual productions. However, since video projectors are point light sources with a directional light beam, they are not suitable for this application. Video projectors have a long history and have been used in film and television production for process photography using the projector's reflected output.

The virtual production volume 510 is a light emitting diode-based device that can be curved or shaped like a truncated cone, such that the camera 520 is movable within the LED display space. A large array of display panels 511 can be included. It is possible to extend the image beyond the edges of the LED display 512 and use set extension to generate content 513 in the finished work. This content is generated by computer 515, which tracks the movement of camera 520 and relays that data to the computer. Computer 515 can output video and graphical content configured based on the motion data to any type of display or system that can be managed as an output of a display or data port within computer 515. In this way, and as explained below, computer 515 serves as a source of real-time data within the present invention, monitors camera and object movement, controls the lighting output at the light sources, and distributes it to the display panel. control what content is displayed.

Very high frame rate systems between 240 and 960 Hertz can be controlled directly from the motherboard's data bus. The system can also utilize a dynamic refresh rate that can vary depending on the content of each pixel. Projector 516 can be used in this way as a light source, similar to how projectors are used in projection mapping. However, since the light from a video projector is a hard-edged point source, it may not be suitable for most film and television applications.

Light sources for film and television production may be capable of reproducing different beam angles, as shown in FIG. Such systems may be capable of reproducing light from a variety of environments. This can be driven by the same real-time content engine computer 515 that is generating the content for the LED wall 511. However, in this example of FIG. 6, virtual lighting array 616 is capable of outputting various ambient lighting appropriate for the environment (in the illustrated example, a forest environment). This lighting changes as camera 520 moves to maintain the correct perspective mapped light for the shot. In this way, the lighting matches the background video content on the LED wall 511. Such systems can also be used with green screens and various accessories designed to further control light distribution. Virtual lighting array 616 may also include a free-form array of lighting fixtures surrounding a volume, although this may have limitations.

By using the array of lighting fixtures of the described system, it is possible to create a virtual lighting array light source as shown in FIG. 7, which can represent different types of light sources in a shot. Although three different beam angles are shown, a variety of symmetrical and asymmetrical patterns can be achieved. The figure shows light sources 2 meters behind the front of the light array 732, 3 meters behind the front of the light array 731, and 4 meters behind the front of the light array 730. This can be dynamically adjusted to move the light source closer to or farther from the front emitting surface of the virtual array.

Another feature of the system is that the resolution can be varied across the array, as shown in Figure 8, so that real-time computing power and network bandwidth can be reduced relative to the area of focus at the time. This means that you will save money. As the actor 830 in the configured volume moves from the back of the volume 831 to the center of the volume 832 to the front of the volume 833, the area of high resolution content moves from the left side 841 of virtual light array A to the left side of virtual light array B. Move to bottom center 842 and to bottom right 843 of virtual illumination array C.

The virtual production system shown in FIG. 9 includes a combination of sources, sensors, and processors in addition to displays, lights, and cameras. These systems are also capable of tracking the exact location of actors within a volume for motion capture and additional special effects work. The lights described in this system can be easily integrated into these systems. Lights may also include sensors, processors, and real-time content engines. Film and television production needs to manage timing and reduce latency. All displays and lighting systems can be refreshed at a rate linked to the camera. Colors may also be controlled system-wide. The color temperature and spectral distribution of a light source are very important and are often reviewed to avoid metamerism (the difference in reflected light depending on the spectral content of the light source).

Virtual production system 900 includes a light emitting diode display 911 that can include walls, ceilings, and floors. This display system is driven by one or more computers 930 that are capable of generating content 931 requested by the client. The system may have a separate control system 929 and separate means of integrating sensor data 921. Sensor inputs range from tracking devices 918 within the volume, to systems 919 that track lens movement and camera position, to sensors 917 integrated into mapped lighting systems. Some sensor data may be used locally 932 to reduce latency and generate all or part of the content that drives the light sources 916 of the mapped lighting system.

Luminaires as light sources can be integrated into the device in various ways. As shown in Figure 10, the design may need to accommodate different types of physical connections. A fixed rigging point 1000 is provided by a 12mm/1/2" hole to which a scaffold clamp/gas line component (as shown) can be attached to allow for a pivot/pan point. Static. The suspension frame/yoke 1001 may comprise a 25mm/1'2'' tubular frame. The frame 1001 can be attached to the main chassis of the device, and the yoke 1001 can be removed so that the device can be used in another environment (as shown below).

When used as a lighting fixture, commonly referred to as a washlight, it may be desirable to equip the device with an anti-glare radial baffle 1002. This baffle 1002 reduces off-axis illumination glare that is common in this type of device that emits light forward in a beam. The radial fines 1003 are arranged in a circular radiation pattern to mask as much unnecessary light as possible. Since this device has a variable light beam from approximately 4° to over +60°, the surrounding frame 1002 is angled at 30° to avoid blocking the light beam at the widest possible angle. There is.

Located in the center of anti-glare baffle 1002 may be a lidar sensor 1004. This sensor 1004 provides a machine vision perspective that is fed back to the image processing electronics and computer to sense the volumetric space within the illumination field of the device.

A positive lock-off knob 1005 is shown in FIG. 11 to allow for firm locking of the vertical tilt function. FIG. 12 shows two horizontal telescoping tubes 1006 within the yoke frame to provide a carrying handle for the user. Additionally, a second yoke main pivot point 1007 is provided, which can be used where ceiling height is limited. This second pivot 1007 reduces the gap between the device and the yoke 1001 and, in normal operation, allows the yoke 1001 to pivot all the way around so that the device can be placed on the floor and oriented upwards. is possible.

To increase versatility of use, it may be desirable to use the device in a non-uniplexed format, as shown in FIGS. 13 and 14. A rigging frame 1008 can be attached to the device. This frame 1008 has one pivot axis that is positively adjustable in four positions, designed to allow side-by-side and top-to-bottom stacking 1011 from either floor-mounted 1012 or ceiling-mounted 1013 configurations. Rigging points 1009 are provided. Pivot point 1009 may be threadably adjustable for precise alignment. This rigging frame provides a structural form that supports the weight of multiple fixtures, such as up to 24 (or more/less than) devices. This frame can be interconnected with other devices and secured to the main device by quarter-turn quick release connections 1010, known as cam locks, as previously discussed and shown in FIGS. 15 and 6. It is.

The system may also be suitable for integration as a pan and tilt movement cube, as shown in FIGS. 17 and 18, while the two axes of movement of cube 1700 are controlled by digitally controlled stepper motors within yoke 1702. It is possible to control via. The positions of these stepper motors 1703 (exposed in Figure 26) can be controlled and monitored via optical encoder wheels 1704 (exposed in Figure 26) and infrared optical switches, which by their nature provide precise positioning of the motors. Submit feedback. A limit switch is mounted at the maximum extent of the motor drive mechanism 1705 (exposed in FIG. 26) to allow the motor to be positioned in the "home" position upon power up.

Both tilt axis mechanisms may be located internally 1706 within the translation cube 1700. Cube 1700 may be a substantially aluminum design with a nominally 2 mm thick outer shell 1707 and a 3 mm thick inner chassis frame 1708.

On the light-emitting side of the moving cube 1700, a frame 1709 provides mechanical protection from potential hazards. The 4 mm UV stabilized polycarbonate optically clear protective substrate 1710 is further reinforced with a UV stabilized scratch resistant coating.

A liquid crystal display substrate 1711 is set immediately behind the transparent polycarbonate substrate. This display has a high contrast ratio of at least 3500:1. The polarizing filter to the outer (visible) side is adapted not to provide an anti-glare haze coating, thus improving the light transmission of this LCD occluding layer.

This liquid crystal panel uses a plurality of separate pixels to achieve a high density of 960 or more RGB pixels in order to achieve what is generally called high-definition video reproduction.

The translation yoke variation shown in FIG. 19 provides gimbal mounts for both pan and tight remote control attributes and allows for the attachment of hidden locks 1712. These locks 1712 secure the display in a locked position to aid in storage for shipping. In normal operation, the lock 1712 is recessed so that it is not noticeable to onlookers.

To aid in the aesthetics of the invention, a carry handle 1713 can be placed on the outside of the main chassis, and in case of a fixed installation, it can be removed as a carry cradle 1714. A quarter turn quick release cam lock connection 1715 allows for the attachment of an omega bracket for suspension purposes. A secondary suspension protection mount 1716 is centrally mounted to this metal cradle.

Both the pan and tilt mechanisms have helical composite cable and water-cooled pipe cable harness assemblies designed to provide superior strain protection to the composite pipe cable assembly 1717. This combined pipe and cable harness assembly is designed to pass through the pivot of the yoke and up to the fixed base of the present invention.

The LCD panel may have an enhanced method of cooling due to the internal closed loop air flow designed to flow from the bottom 1719 to the top 1720 of the internal air volume of the moving cube 1700.

An internal set of aluminum panels 1721 are mounted to guide force air through the air gap from the rear of the fixture. Air is guided across the back inward facing surface of the LCD board. The warmer air is extracted through the upper air gap 1720 and recycled through the fan 1722 and radiator 1723 combination [detailed in FIG. 26] where the radiant heat is extracted and sent again. The inner walls are finished with non-reflecting surfaces, so that indirect light is not sent forward, but rather is absorbed within the confines of the inner cube.

The parabolic or spherical or concave high-reflection reflector 1745 of FIG. 20 with a reflectivity greater than 85% is designed in a square shape factor and mounted on two diametrically opposed slide mechanisms 2146. These are coupled to a timing belt and stepper motor arrangement. This reflector is designed to move quickly towards or away from the light source 2147.

This movement of reflector 1745 provides the light beam zoom effect of FIG. The zoom can go from widest above 60° down to a nearly parallel beam and then reverse to above -60°. The emitted light is collimated perpendicular to the light source and the resulting variable width light beam is projected substantially forward and continues to generate a beam through the LCD board 1748 and its The beam can be widened or narrowed remotely via an external computer.

The light source is housed in a central column, shown in Figure 22, that integrates the LED and a thermal management system to extract heat from the LED and expel heat from the envelope between the reflector and the LCD.

The LEDs 2324 are mounted to a wedge-shaped PCB 2325 on the inner surface of the head block in a radial pattern 2326 and essentially operate as one unified light source 2320. Each segment within the light source includes multiple LED packages.

The main LED assembly can be mounted with a surface mounted thermistor near the LED heat source 2340 that provides electronic temperature sensing for each of the six radial segments 2326 arranged radially around the tube assembly mount. A machined lip 2341 around the periphery of the head assembly catches unwanted scattered light so that it is not visible when viewed from the front of the assembly. Further light masking provides further light control or "zoning".

This light emitting assembly is connected to column 2321 which connects to the rest of the luminaire via manifold 2342. This manifold handles the luminaire's mechanical, electrical, and thermal management connections.

This light source, consisting of multiple LEDs, can be controlled in intensity via a remote computer. The width of the electron beam can also be adjusted by lighting the LEDs in concentric circles. With fewer LEDs, the light beam will be sharper and more distinct. Increasing the number of LEDs makes the beam softer, more diffuse, and less focused.

The light source thermal management system is incorporated into the mechanical design of the system of FIG. Light is emitted forward toward LCD 2301 from a small centrally mounted group of LEDs 2334 and back toward reflector 2302 by a segmented array of LEDs 2324. Thermal management is done through the material sandwiched between these two groups of LEDs. This section shows how the LED PCBS 2325 for the reflector facing array is attached to a machined copper piece known as the head front block 2327. The rear or inner side of this copper part 2327 is machined into radial fins 2328 and head midblock 2329 to allow coolant to flow in the most efficient manner. These fins are arranged to provide suitable space for the cable tube 2379 to pass through. The head rear block 2330 is a copper component designed to seal the coolant system and act as a heat sink for the forward facing LEDs.

This liquid cooling system, by its design, extracts heat directly from the LED through the copper components by direct thermal conduction. The entire arrangement is soldered at joints 2331 to provide a watertight seal.

A 3/8” BSP steel tube 2332 is screwed into the copper head assembly and a 10mm diameter copper connecting tube 2333 is attached inside this tube. This cable tube acts as a duct and the power cable is routed through the moving cube. It is fed along the tube from the rear.Four high output white LEDs 2334 are attached to the copper part of the head rear block.

The LED head assembly may be attached to an inner tube 2333 and an outer tube 2332, with the two tubes attached to a manifold 2342 that is attached directly behind the center of the mechanically moveable reflector. Manifold 2342 directs cooling water in both directions with a feed (center) and return (outer tube) relationship.

A second cone-shaped reflector 2335 can be attached to the main head assembly, as also shown in FIG. A graphics filter 2336 is attached. A second smaller but substantially wider reflector 2337 continues the conical shape of the combined reflector and provides more diffused white light.

On the front side of this reflector arrangement, a second opaque plastic disk 2338 may be glued to a circular concave lip 2339, as shown in FIG. The overall assembly provides a diffused backlight that compensates for the light lost from the head assembly blocking the chief beam. This forms a complete visual image on the surface of the LCD substrate without compromising the light intensity.

The light source assembly, FIG. 25, connects to the fixture at the back 1743 of the cavity that holds the reflector and LCD.

The LCD panel 1711 shown in FIG. 26 is connected to a dedicated video driver 1718 that manages external video signals, locally distributes data, and provides DC power to the LCD display.

Coolant is passed through multiple radiators 1723 using fans 1722 as needed to reduce radiant heat buildup from the LED array sealed within the cube mechanical design.

The closed loop cooling/thermal management system 2700 of FIG. 27 is based on a liquid coolant design that removes heat from a closed volume 2701 that exists around an LCD display 2702, an LED light source 2703, and a light reflector 2705. The liquid cooling system is supported by an internal radiator and fan 2706. The system is connected by a manifold 2704, includes an expansion vessel 2707, and is designed to work with any device.

The system includes a thermal sensor 2708, a Hall effect flow sensor 2710, and a pump 2709. The system may also include a visual flow indicator 2711. A quick release connector 2712 is included for charging the system.

The system includes the necessary arrangement of radiators 2713 to remove heat 2716 from the system, and the necessary openings 2714 to draw cool air 2715 into the system.

The coolant can have additives that lower the freezing point of the coolant to below freezing. In this embodiment, ethanol with a freezing point of -20° is used in a 5:1 water to coolant additive ratio. Lower temperatures can be achieved by changing the coolant additive and the water-to-coolant ratio.

The electronics system of Figure 28 is designed to have remote monitoring and sensing equipment within the core of the system. Coolant Flow 2856, Coolant Temperature 2857, LCD Display Temperature 2880, Power Sense 2858, Ambient Temperature 2859, Internal Ambient Temperature 2860. LED temperature sensor 2881, base box air velocity 2861, signal 2862, optical encoder 2863 for all stepper motor attributes including pan, tilt and zoom, switching physical extent 2882, battery sense 2879, shock sense 2883. All sensors are processed through the internal CPU 2864.

All internal parameters are adjusted from this graphical user interface.

A universal battery backup designed to provide 15 minutes or less of uninterrupted power may be provided in the event of a main power failure. This universal battery backup keeps the internal CPU powered along with Ethernet and DMX data flows and can send internal fault codes to remote computers and remote applications running both Android and iOS operating systems. All this information is also transmitted remotely to the manufacturer's headquarters, where it is possible to monitor a more detailed analysis of normal operation.

Each lighting fixture may have an internal computing system for content management that manages a combination of internally and externally generated sources, as shown in FIG. The external source may be a media server 2901 connected to display processor 2902. The display processor acts as the primary video connection where the entire system is displayed as a single display area to the server. The system can be configured locally on the processor or via an external computer 2903 such as a laptop or iPad. The connection from the processor to the lighting system may be a network cable terminating in an RJ45 connector fixture 2910. The system may then allow network cables to be daisy-chained to the next lighting fixture, allowing multiple lighting fixtures to be configured as part of one display area. This information is decompressed by the receiving card 2904 within the lighting fixture. This card takes a portion of the display area and outputs it to the lighting 2905 control system. This control system may be a machine vision and computing optimized computer such as the NVIDIA Jetson. The system may capture sensor data 2906 from lidar or other suitable mapping system to create locally generated effects with low latency. This output may be integrated with data from receiver card 2904 in final output to LCD panel 2920. Servos and light sources can also be controlled from this computing system 2907.

Remotely generated content 2930 is fed into the mapped light via receiver card 2904 and incorporated into locally hosted computation 2905 . Content is typically provided at 24 to 60 frames per second. Receiver card 2904 delivers a clock signal 2931 to computing system 2905 that synchronizes the optical output mapped with the rest of the system.

FIG. 30 shows the components of a dynamic mask. Mapped lighting fixtures in the dynamic environment 3001 including the LED wall 3011 and the actor 3002 may be required to separate the light for the actor from the light for the LED wall or floor 3005.

To do this, the light needs to generate a real-time mask for the actor from the perspective of the mapped lighting fixture 3020. This mask allows the creation of content mapped to actor 3021 and content mapped around actor 3022. This may include additional separation between the walls and the floor, or the floor and physical background elements on the stage. These elements are combined together with 3030 and output from the mapped light.

LED wall 3011 can include content 3006 including interleaved blue or green frames used in post-production. Mapped lights can be synchronized with these displays.

FIG. 31 shows the dynamic mask process. Ideally, content mapped to a moving person is processed at a frame rate that is significantly higher than the camera frame rate. The light's output can be synchronized with the camera when operating at multiples of common camera frame rates, including 24, 29.97, and 30 frames per second. FIG. 31 shows a simplified version of the workflow using 480 Hz 3010 and in which a subject 3002 is mapped by a sensor 3040 attached to a mapped light 3041. Sensor data 3042 is used to generate a mask 3020 and is combined with a texture map 3021 to create a final output 3043 that includes a combined mask 3030. By combining this locally, the dynamically changing mask can track the subject at 480Hz3010, while data inserted into and outside the mask can be updated at a lower frame rate. .

The output of the combining system for mapped light is synchronized with the other parts of the system 2931.

FIG. 32 shows calibration details that allow each unit 3200 to be calibrated by knowing the characteristics of the light source 3201 and color mask 3211. A sensor can be included in each mapped lighting fixture 3250 to track the color temperature of the light source. The color characteristics of the optical filter are fixed at the time of manufacture. It is also possible to calibrate the unit via a closed loop system to minimize natural deviations in the components and processes used to manufacture the lighting system.

The closed loop system positions the mapped lighting system 3200 at a constant distance 3205 relative to the neutral diffuse screen surface 3232 such that the beam angle 3206 fills the screen surface in a consistent manner for all luminaires manufactured. do.

Light from the mapped illumination system 3212 is diffused by the screen material and continues into a dark non-reflective volume 3213. This light is measured by a colorimeter 3252 and a luminance meter 3251. It is also possible to use a digital single-lens reflex camera as part of such a system. This information is sent to a processing computer that creates a profile 3241 that is stored in the mapped lighting system.

Although the invention has been described with reference to the embodiments described above, those skilled in the art will appreciate that various changes or modifications can be made without departing from the scope of the claims. It is.

Claims (15)

a liquid crystal display 102 including a first controlled light source 100,516,616 and a second controlled light source 100,516,616;
a reflector that moves along axis 2147 and magnifies or zooms the light from the controlled light source;
a thermal management system 2700 to which each of the light sources is attached, the thermal management system 2700 managing heat within the light source;
a real-time data source 515 configured to generate illumination output of each of the control light sources and movement of the reflector along the axis. The mapped lighting system 500 of claim 1, further comprising a display panel, wherein the real-time data source 515 controls lighting and graphical content based on each other. The mapped lighting system 500 of claim 2, wherein the real-time data source 515 receives camera input from a camera 520 and further controls lighting and graphical content based on the camera input. The mapped lighting system 500 of claim 1, wherein at least one of the controlled light sources 516 comprises a sensor 1004 located at the center of at least one of the controlled light sources. 5. The mapped lighting system 500 of claim 4, wherein the sensor 1004 generates sensor data corresponding to lighting output from at least one of the controlled light sources. The mapped illumination system 500 of claim 1, wherein at least one of the controlled light sources 516 comprises a sensor 1004, the sensor located directly behind the center of the primary light modulator. 7. The mapped lighting system 500 of claim 6, wherein the sensor 1004 generates sensor data corresponding to lighting output from at least one of the controlled light sources. The mapped illumination system 500 of claim 1, wherein at least one of the control light sources is controllably polarized using a polarizer 101, the polarizer 101 being rotatable to change the output of the light source. . The mapped lighting system 500 of claim 1, wherein output to a digital source represented to a real-time data system can be replicated by an array of lights. The mapped map of claim 1, wherein sensor data may be used to generate a higher density of real-time data in an active area, while illuminated areas outside that area receive less data. Lighting system 500. The object to be illuminated is tracked by a sensor at one frequency, the data received by real-time data source 515 is generated at two or more frequencies, the real-time data source generates a mask at the higher frequency, and the content within the mask is The mapped lighting system 500 of claim 1, generated at low frequencies. The color of the light is controlled by the light source color and color filter in the light modulator, and the light source color and color filter color are controlled by closed-loop calibration so that the output color can be quantified and cloned to other light sources. The mapped lighting system 500 of claim 1, wherein the mapped lighting system 500 is established. The real-time data source controls the light source using high frequency modulation of light, and the output of the light source is interleaved with at least two different data such that the two interleaved outputs are synchronized with the sensor and another display system. The mapped lighting system 500 of claim 1, comprising a stream. a sealed casing containing a liquid crystal display 102;
Control light sources 100, 516, 616;
a reflector that moves along axis 2147 and magnifies or zooms the light from the controlled light source;
a thermal management system 2700 for passing air across the backside of a liquid crystal display, the thermal management system comprising a heat exchanger for removing heat from a sealed enclosure;
a mapped lighting system including a real-time data source 515 configured to generate illumination output of each of the control light sources and movement of the reflector along the axis. a first control light source 100, 516, 616;
a second control light source 100, 516, 616;
a real-time data source 515 configured to generate an output of each of the controlled light sources 516 and graphical content to the display panel 511;
The output is lighting and the real-time data source 515 is a mapped lighting system that controls lighting and graphical content based on each other.

Images