ZA201001914B - A method of facilitating filming - Google Patents

Description

2 22010701914

THIS INVENTION relates to a method of facilitating filming on a film set.

The applicant has found that, during filming on a film set, an unnecessary amount of time during filming is spent on configuring lighting and cameras to correct deficiencies, e.g. inadequate illumination of an actor, identified during filming. It is an aim of the present invention to at least ameliorate this problem by providing for proper configuration of lighting and cameras before filming.

Adjusting of a lighting arrangement, as used herein, may involve adjusting of at least one of a number of properties of the lighting arrangement, e.g.: the number of lights in the arrangement; the position of a light of the arrangement; the pan/tilt orientation of a light of the arrangement; the brightness of a light of the arrangement; and } the color temperature of a light of the arrangement.

Adjusting of a camera, as used herein, may involve adjusting of any of a position, a pan orientation, a tilt orientation, a zoom setting, and any other setting of the camera. “Machine”, as used herein, may be a single machine or any collection of machines that individually or jointly execute a set {or multiple sets) of instructions to perform any one or more of the methodologies mentioned herein.

According to the invention there is provided a method of facilitating filming on a film set, the method including the following steps before filming: providing a machine executing a set of instructions for directing its operation and having an output device in the form of a display; emitting light from a lighting arrangement of the film set; by means of a light measuring apparatus, taking measurements of at least one property of the emitted light at each of a plurality of positions on the film set; transmitting a signal incorporating the light property measurements to the machine;

for each of a plurality of possible positions and orientations of a face of an actor on the set, @ rendering on the display a corresponding picture including a simulated image of the face of the actor as viewed from a viewpoint of a virtual camera, the viewpoint corresponding to a proposed camera position; on at least a part of the picture, including the simulated image of the face of the actor, simulating the effect of the emitted light based on the light property measurements; and assessing the rendered picture for any deficiency in the simulated effect of the emitted light and, if a deficiency is found, adjusting the lighting arrangement of the film set to at least ameliorate the deficiency.

The simulated effect of the emitted light may include at least one of skin tone, light refraction, light reflection, light absorption, and shadow casting.

The adjusting of the lighting arrangement may include adjusting at least one of a plan position, a level, a pan setting, and a tilt setting. In this case, the lighting arrangement may include electrical actuation means for effecting the adjusting and the adjusting may be performed, at least in part, by the machine under direction of a set of instructions stored therein.

The adjusting of the lighting arrangement may include adjusting at least one of an illuminance setting and a color temperature setting of a light source of the lighting arrangement. In this case, the adjusting may be performed by the machine under direction of a set of instructions stored therein.

In a particular implementation of the method, the respective positions of the plurality of positions of the light measuring apparatus and the respective positions of the plurality of possible positions and orientations of the face of the actor on the set may correspond.

The said implementation may include: displacing the light measuring apparatus along a trajectory corresponding to a planned trajectory of the actor; taking the measurements of the at least one property of the emitted light along the trajectory; by means of position sensing means of the machine, tracking the position of the light measuring apparatus; and by means of a subset of instructions directing the operation of the machine, ® correspondingly moving the simulated image of the actor along a trajectory, relative to the virtual camera, corresponding to that of the light measuring apparatus, relative to the camera on the film set.

In the said implementation, the following may apply: the light sensing unit includes sensors for sensing the respective effects of key light, fill light, and backlight emitted hy the lighting arrangement; and in taking the measurements of the at least one property of the emitted light and the rendering of the picture on the display, the orientation of the light measuring apparatus and the orientation of the face of the simulated image of the actor are matched and the rendering is based on the respective effects.

The method may include generating by means of the machine a three dimensional virtual model of the film set, the actor on the film set, and the virtual lighting arrangement of the film set, the rendered picture being rendered from the virtual model.

In the case of the method including generating the virtual model, the method may include, before performing the adjusting of the lighting arrangement of the film set, adjusting the virtual lighting arrangement in the virtual model to ameliorate the deficiency in the rendered image and then performing the adjusting of the lighting arrangement of the film set accordingly.

In the case of the method including generating the virtual model, the method may include adjusting at least one of a viewpoint, a pan setting, a tilt setting, and a zoom setting of the virtual camera to optimize the rendered picture and adjusting the camera of the film set accordingly. In this case, the method may include: generating by means of the machine a set of instructions for an operator of the camera on film set to adjust the camera accordingly; and transmitting the set of instructions to a display at the camera.

In the latter case, an operator of the camera will adjust the camera according to the instructions.

The light measuring apparatus may be displaced on the film set by a person carrying it.

The light measuring apparatus may be displaced on the film set by a robotic vehicle carrying it. ® The robotic vehicle may be one of a floor roving robot and a helicopter.

In the case of the light measuring apparatus being displaced along a trajectory corresponding to a planned trajectory of the actor, as referred to above, and being carried by the said robotic vehicle, displacement of the vehicle along the trajectory may be controlled remotely by the machine.

The machine may have a database containing 3D virtual models of actors and the image of the face of the actor may be rendered from one of the models selected from the database.

The rendered picture may be a moving picture and the simulated image of the actor may be an animated image.

The invention is described below by way of an example of a method of facilitating filming on a film y 15 set, in accordance with the invention, with reference to the accompanying diagrammatic drawings. In the drawings:

Figure 1 is a flowchart illustrating a method of facilitating filming on a film set, in accordance with the invention;

Figure 2 shows a plan view of a television film set, including three walls, a lighting arrangement, and a camera, and a remote controlled helicopter being maneuvered within the film set as a part of the method of the flowchart of Figure 1;

Figure 3 shows an enlarged top view of the helicopter of Figure 2;

Figure 4 shows a system used in the method of the flowchart of Figure 1, the system including a light measuring apparatus, carried by the helicopter of Figure 3, and a computer including a storage/processing unit, a TFT display, an RF receiver, and a controller;

Figure 5 shows the display of Figure 4 displaying a rendered picture including a simulated image of a head of an actor;

Figure 6 shows the film set of Figure 2 with the actor therein, wearing a light measuring apparatus employed in the method of the invention;

Figure 7 shows an electronic display, mounted on the camera of Figure 2, for displaying instructions to an operator of the camera; and

Figure 8 shows a side elevation of a floor roving remote-controlled robot, which is an alternative to the helicopter of Figures 2 and 3.

Figure 1 is a flowchart illustrating a method of facilitating filming on a film set, in accordance with ® the invention. The method is implemented on a film set 10, shown in Figure 2.

With reference particularly to Figure 2, the film set 10 includes: three walls 13.1, 13.2, and 13.3, arranged as shown; a lighting arrangement 14 comprising a key light 14.1, a fill light 14.2, and a backlight 14.3; and a camera 16 at a position shown.

Figures 2 and 3 show a robotic vehicle in the form of a remote controlled helicopter 18 that is used to perform a survey of certain properties of light emitted by the lighting arrangement 14.

The helicopter 18 includes: a body 19, containing drive means, a controller, etc.; a double rotor assembly 21; opposite steering thrusters 23; and a light measuring apparatus 24, shown in Figure 4.

Figure 4 shows a system 30 used in the method illustrated in the flowchart of Figure 1. The system 30 includes: the light measuring apparatus 24, carried by the helicopter 18 and including: a battery-powered electronic controller 25; four light sensors 26.1, 26.2, 26.3, and 26.4; and an RF transmitter 28; and a machine in the form of a computer 32 including: a processing and storage unit 34 including a processor and a machine readable storage medium carrying a set of instructions for directing the operation of the computer as described below; an RF receiver 35 compatible with the RF transmitter 28; a TFT display 36; a wireless control interface 38 for remote controlling adjusting of the lighting arrangement 14 of Figure 2, for remote controlling the helicopter 18, and for sending operator instructions to a display on the camera 16; and user input means, which may be essentially conventional and, as such, are not described or illustrated herein. :

The sensors 26.1, 26.2, 26.3, and 26.4 are mounted on the helicopter 18 in the arrangement 4 @ shown in Figure 3. The sensors 26.1, 26.2, 26.3, and 26.4 are for measuring different properties of light, including color temperature and illuminance. In use of the system 30, the transmitter 28 of the light measuring apparatus 24 carried by the helicopter 18 transmits at short intervals, say 0.5s, real-time signals incorporating measurements taken by the respective sensors 26. These signals are received by the receiver 35, which relays them to the computer 32. The purpose of these signals will be reverted to below.

Reverting now to Figure 1, at 40 in the flowchart of Figure 1, the film set 10 of Figure 2 is set up, either in an initial dressing or in a swing, i.e. a striking and a dressing. The lighting arrangement 14 of the film set 10 is configured.

At 42 in the flowchart of Figure 1, using essentially conventional computer graphics techniques, a composite 3D virtual model is created in the computer 32. The composite model includes a 3D virtual model of the film set 10 (see Figure 2), a virtual lighting arrangement corresponding to the lighting arrangement 14 of the film set 10, a viewpoint of a virtual camera, and a 3D virtual model of an actor. The 3D virtual model of the actor is one of several stored in the storage medium of the computer 32, each being modeled on a real actor and including skin tone. A planned trajectory of a face of the actor across the film set 10 during filming of a scene on the set 10 is programmed in to the 3D virtual model of the film set 10, along with a varying orientation of the face along the trajectory. This may be done for a number of scenes and actors.

At 44 in the flowchart of Figure 1, the lighting arrangement 14 is activated and a survey of emitted light from the key light 14.1, the fill light 14.2, and a backlight 14.3 is performed as follows. In response to a user input, the computer 32 recalls the programmed trajectory and varying orientation of the face of the actor and autonomously remote controls the helicopter 18 via the controller 38, maneuvering it along a corresponding trajectory 47 (see Figure 2) and with a corresponding varying orientation. In order accurately to track the position and orientation of the helicopter 18, the computer system 32 may employ a Real Time Locating System (not shown).

Insofar as such a Real Time Locating System may be essentially conventional, it will not be described in detail herein.

In the position and orientation of the helicopter 18 as shown in Figure 2, the respective orientations of the sensors 26.1, 26.2, and 26.3 are such as to expose them respectively to light from predominantly the key light 14.1, the fili light 14.2, and the backlight 14.3. The sensor 26.4 is .

wld 0 5. 22010701914 orientated for measuring total light on the front of the helicopter 18. During the entire maneuver, ® the light measuring apparatus 24 (see Figure 4) carried by the helicopter 18 transmits, at the 0.5s intervals referred to above, the signals incorporating measurements taken by all of the sensors 26.1, 26.2, 26.3, and 26.4.

During such maneuvering of the helicopter 18, it is filmed by the camera 16. The camera 16 also is connected to the computer 32. The computer 32 records in its storage medium both the measurements from the sensors 26 and a video recording of the helicopter 18 as filmed by the camera 16.

At 46 in the flowchart of Figure 1, and referring also to Figure 5, in response to a user input, the computer 32 displays on the display 36, say in a window 53, the video recording (not shown} of the helicopter 18 and, in a window 55, corresponding, i.e. position synchronized, measurements from the light measuring apparatus 24. Measurements of illuminance may, e.g., be displayed in

Lux and measurements of color temperature in Kelvin.

At 48 in the flowchart of Figure 1, a user viewing the measurements assesses the measurements.

If any of the measurements is deficient, the corresponding position of the helicopter 18 along the trajectory 47 can be identified from the video recording. At 50 in the flowchart of Figure 1, at least one of the lighting arrangement 14 and the camera 16 is adjusted to at least ameliorate the deficiency.

In this example, each of the lights 14.1, 14.2, and 14.3 of the lighting arrangement 14 includes electrical actuation means for effecting adjusting of the plan position, level, pan setting, and tilt setting of the light. The lights are controlled by the computer 32, via the controller 38, under direction of a set of instructions stored in the computer to effect the adjusting. In other implementations of the method of the invention, adjusting of a lighting arrangement may be performed manually.

With reference to Figure 7, the camera 16 has a display 37 mounted in a location viewable by an operator. In order to effect adjusting of the camera 16, the computer 32 may generate instructions and transmit them to the display 37 for viewing and action. The display 37 thus serves as an electronic version of a shot card.

{gt

Alternatively, at 48 in the flowchart of Figure 1, by means of an assessment instruction set ® executed by the computer 32, the computer may identify any deficiencies in the measurements.

It may then create a log of these deficiencies in its memory means. It can then be operated to display on the display 36 a snapshot of the video recording of the helicopter 18 at the or each position where a measurement is deficient.

At 52 in the flowchart of Figure 1, by means of a set of instructions executed by the computer 32, the computer renders on the display 36 a picture 56 including a simulated image of at least the face of the actor, thereby to simulate an expected filmed image of the actor. In this case, the picture 56 is a moving picture which includes an animated simulated image 58 of the head, including the face, of the actor and also certain features of the set 10 of Figure 2, including the walls 13.2 and 13.3. The moving picture 56 is generated, using essentially conventional computer graphics techniques, from the 3D virtual models stored in the computer 32.

The position and orientation of the head, therefore also of the face, of the simulated image 58 is moved by the computer 32 along a trajectory corresponding, relative to the virtual camera, to the trajectory 47 of the light measuring apparatus 24. Although the simulated image 58 shown comprises only a part of an actor, a simulated image of the entire actor may be included in the picture displayed on the display 36, if required.

The simulated image 58 is rendered in accordance with measurements obtained from the light measuring apparatus 24 to simulate the effect of the lighting on the expected filmed image of the actor. The simulated effect includes skin tone, light refraction, light reflection, and light absorption. In simulating the effect, the computer 32 superimposes the respective effects of emitted light from the key light 14.1, the fill light 14.2, and the backlight 14.3.

The simulated image 58 includes a rendering simulating a shadow 61 expected to be cast on the face of the actor. The picture 56 includes also a rendering of a shadow 63 expected to be cast by the actor on the wall 13.2.

At 60 in the flowchart of Figure 1, the user views the moving picture 56 and assesses the effect of the lighting 14 for any deficiency. He also assesses the camera angle and zoom setting. The user may use the user input means to pause the simulated image 58 of the head of the actor in any position to assess the simulated image in that position.

-10- F906

If any deficiency is found, at 62 in the flowchart of Figure 1, the user decides on whether or not to ® adjust the virtual lighting arrangement before adjusting the lighting arrangement 14 (Figure 2). if yes, at 64 in the flowchart, the user adjusts the virtual lighting arrangement to at least ameliorate the deficiency. At 66 in the flowchart, the lighting arrangement 14 is adjusted accordingly. If no, at 68in the flowchart, the lighting arrangement 14 is adjusted to ameliorate the deficiency.

After adjusting of the lighting arrangement 14, the method reverts to 52 in the flowchart of Figure 1, i.e. rendering the picture on the display 36 of Figure 3.

In conjunction with assessment and adjusting of the lighting arrangement 14, as described above, adjusting of the camera 16 may be performed by means of operator instructions generated by the computer 32 and sent to display 37 of Figure 7.

At 60 in the flowchart of Figure 1, once the user is satisfied with the virtual lighting in the picture 56 and the measurements, rehearsal can commence, at 72 in the flowchart.

In Figure 6, the actor is shown, designated by the reference numeral 69. The actor 69 carries a light measuring apparatus 71, mounted on his chest via mounting means in the form of a strap harness 73. The light measuring apparatus 71 is similar to the light measuring apparatus 24 of

Figure 5 and includes sensors corresponding to the sensors 26.1, 26.2, 23, and 26.4 of the light measuring apparatus 24. Only the light sensor 26.4 is shown.

During rehearsal, at 72 in the flowchart of Figure 1, the face of the actor 69 is filmed by means of the camera 16 and the filmed moving picture is fed into the computer 32. Final assessment and adjusting, if necessary, of the lighting arrangement 14 may be performed in analogy with the method steps described above, except that light property measurements are performed by means of the light measuring apparatus 71 on the actor 69.

By this time, all pre-existing deficiencies in the lighting 14 should have been identified and corrected and final filming or recording can thus be proceeded with, at 76 in the flowchart of

Figure 1, without any interruption for further adjusting of the lighting arrangement 14.

Figure 8 shows a robotic vehicle in the form of a remote-controlled floor roving robot, designated by the reference numeral 80, which may serve as an alternative to the helicopter 18 of Figures 2 and 3. In this example, the robot 80 includes a body 82, a pair of drive tracks 84, a telescopically me 2e010/701g4, extendable neck (not shown), and a head 83 incorporating a light measuring apparatus 86. The ® light measuring apparatus 86 is equivalent in composition and function to the light measuring apparatus 24 of Figure 5 and, as such, is not described separately herein.

Clearly, many variations on the method of the invention are possible and, as such, the invention extends to any method including the essential features of a method, as defined herein.

Claims (20)

a CLAIMS cL ®

1. A method of facilitating filming on a film set, the method including the following steps before filming: providing a machine executing a set of instructions for directing its operation and having an output device in the form of a display; emitting light from a lighting arrangement of the film set; by means of a light measuring apparatus, taking measurements of at least one property of the emitted light at each of a plurality of positions on the film set; transmitting a signal incorporating the light property measurements to the machine; for each of a plurality of possible positions and orientations of a face of an actor on the set, rendering on the display a corresponding picture including a simulated image of the face of the actor as viewed from a viewpoint of a virtual camera, the viewpoint corresponding to a proposed camera position; on at least a part of the picture, including the simulated image of the face of the actor, simulating the effect of the emitted light based on the light property measurements; and assessing the rendered picture for any deficiency in the simulated effect of the emitted light and, if a deficiency is found, adjusting the lighting arrangement of the film set to at least ameliorate the deficiency.

2. A method as claimed in claim 1, in which the simulated effect of the emitted light includes at least one of skin tone, light refraction, light reflection, light absorption, and shadow casting.

3. A method as claimed in any of the preceding claims, in which the adjusting of the lighting arrangement includes adjusting at least one of a plan position, a level, a pan setting, and a tilt setting.

4. A method as claimed in claim 3, in which the lighting arrangement includes electrical actuation means for effecting the adjusting and in which the adjusting is performed, at least in part, by the machine under direction of a set of instructions stored therein.

5. A method as claimed in any of the preceding claims, in which the adjusting of the lighting o arrangement includes at least one of an illuminance setting and a color temperature setting of a light source of the lighting arrangement.

6. A method as claimed in claim 5, in which the adjusting is performed by the machine under direction of a set of instructions stored therein.

7. A method as claimed in any of the preceding claims, in which the respective positions of the plurality of positions of the light measuring apparatus and the respective positions of the plurality of possible positions and orientations of the face of the actor on the set correspond substantially.

8. A method as claimed in claim 7, which includes: displacing the light measuring apparatus along a trajectory corresponding to a planned trajectory of the actor; taking the measurements of the at least one property of the emitted light along the trajectory; by means of position sensing means of the machine, tracking the position of the light measuring apparatus; and by means of a subset of instructions directing the operation of the machine, correspondingly moving the simulated image of the actor along a trajectory, relative to the virtual camera, corresponding to that of the light measuring apparatus, relative to the camera on the film set.

9. A method as claimed in claim 7 or in claim 8, in which: the light sensing unit includes sensors for sensing the respective effects of key light, fill light, and backlight emitted by the lighting arrangement; and in taking the measurements of the at least one property of the emitted light and the rendering of the picture on the display, the orientation of the light measuring apparatus and the orientation of the face of the simulated image of the actor are matched and the rendering is based on the respective effects.

10. A method as claimed in any of the preceding claims, which includes generating by means of the machine a three dimensional virtual model of the film set, the actor on the film set, and the virtual lighting arrangement of the film set, the rendered picture being rendered from ® the virtual model.

11. A method as claimed in claim 10, which includes, before performing the adjusting of the lighting arrangement of the film set, adjusting the virtual lighting arrangement in the virtual ’ model to ameliorate the deficiency in the rendered image and then performing the adjusting of the lighting arrangement of the film set accordingly.

12. A method as claimed in any one of claims 10 to 11, which includes adjusting at least one of a viewpoint, a pan setting, a tilt setting, and a zoom setting of the virtual camera to optimize the rendered picture and adjusting the camera of the film set accordingly.

13. A method as claimed in claim 12, which includes: generating by means of the machine a set of instructions for an operator of the camera on film set to adjust the camera accordingly; and transmitting the set of instructions to a display at the camera.

14. A method as claimed in any of the preceding claims, in which the light measuring apparatus is displaced on the film set by a person carrying it.

15. A method as claimed in any of claims 1 to 13, in which the light measuring apparatus is displaced on the film set by a robotic vehicle carrying it.

16. A method as claimed in claim 15, in which the robotic vehicle is one of a floor roving robot and a helicopter.

17. A method as claimed in claim 6 and in claim 15, in which displacement of the vehicle along the trajectory is controlled remotely by the machine.

18. A method as claimed in any of the preceding claims, in which the machine has a database containing 3D virtual models of actors and the image of the face of the actor is rendered from one of the models selected from the database.

19. A method as claimed in any of the preceding claims, in which the rendered picture is a moving picture and the simulated image of the actor is an animated image.

(

20. A method as claimed in claim 1, substantially as described herein with reference to and as illustrated in any of the accompanying diagrammatic drawings.

DATED THIS 17" DAY OF MARCH 2010 (0 | Ib, ADAMS & ADAMS APPLICANT'S PATENT ATTORNEYS