CA2182290A1

CA2182290A1 - Device and process for creating an image sequence

Info

Publication number: CA2182290A1
Application number: CA002182290A
Authority: CA
Inventors: Zbigniew Rybczynski
Original assignee: Individual
Current assignee: Zbig Vision Gesellschaft fur neue Bildgestaltung mbH
Priority date: 1994-01-28
Filing date: 1995-01-26
Publication date: 1995-08-03
Also published as: WO1995020862A1; FI963003A0; ATE182046T1; JP3810432B2; NO963169D0; EP0775415B1; AU695502B2; JPH09509022A; AU1661695A; FI963003A; EP0775415A1; ES2138722T3; NO963169L; DK0775415T3

Abstract

The proposed device for creat-ing an image sequence with the aid of a photographic or video system com-prises a camera system for recording a primary image sequence, a transport system with a drive unit for the trans-lational movement of the camera sys-tem, and a control unit to control the transport system and adjust the angu-lar field and/or focal plane. The device also includes a rotating device for no-tating at least a first object in relation to the recording direction and a pro-cessor whose output is connected to a control input of the rotating device and to an unput of the control unit and/or to a control input of the camera system.
The transport system is designed and controlled in such a way that it moves the camera system in only one prede-termined plane.

Description

~iLE, P~ T~Z'S P~;L~
F~R~N~L~TION ~ ~ 8 ~ 2 ~ ~
APPARATUS AND PROCESS FOR ~RODUCING AN IMAGE SEQUENCE
The motion control is used in the film and video industry to achieve precise execution and repetition of a camera ' s movement. The need for such precise movement (which is programmed through a computer) developed for several 10 reasons. One of these is the automation of cameras in broadcast studios, i.e., TV news broadcasts. Another, and until now, the most important use, is in the production of special effects in multi-composite photography.
15 The current development of computer graphics ~CG) has created the need for a connection between the worlds of "real" images photographed by a camera Lens and "artificial" images generated by computers.
20 An illusion of three-dimensional (3-D) motion in space in a CG image is a ~-esult of mathematical calculations. Every element of the image, under consideration of the movement of the (virtual) "camera" which exists only theoretically, has to be precisely calculated on the basis of a 25 predetermined program. A CG "camera" is free from all physical limitations, w~lich strongly affect the motion of a real camera and the generation of images by it.
An image photographed by a real camera in motion ~real time 30 photography) is influenced by many physical disturbances.
Such disturbances are partly caused by the mass and corresponding kinetic energy of the camera and by fluctuations of its path. In the case of multi-composite photography, the results of these disturbances are improper 35 location and eventually jitter between the different components of the picture. These disturbances create an 2 21822~
especially significant problem when photographed components represent different scales. In many cases, there is no mechanical solution to avoid these oisturbances. If "real 5 time" photography must be used - especially when photographing living obj ects - then the simplest of motions must be used (linear travel, smooth side to side pan) for a short duration. In this context, there is also another problem. A computer generated image cannot be built on 10 camera position alone. Every component of the CG image has to have its own locatlon in space (defined by an X-Y-~coordinates). Existing motion control systems just allow for the planning and positioning of a camera (according to the X-Y-~ coordinates of the camera) but do not allow for 15 the planning and positioning of photographed objects. This is caused by focusing solely on the motion of the camera and not on the environment the camera is photographing.
The praduction of special effects e(when multi-composite 20 photography has to be applied) is a very complex process.
Few studios in the world can praduce multi-composite special effects. Also, the production of such effects is extremely expensive. Irl the past, the studios developed their own motion control systems without an industry 25 standard. Furthermore, CG software for the production of computer generated images (which become components of multi-composite images) is developed without any relation to e~isting or even standardized motion control system.
30 Therefore, it is necessary to build an integrated hardware and software system, which can "execute" the same motion in the above "worlds" and can solve the problem of jitter in real time photography.

3 218~29~
It is especially an object of the invention to provide an apparatus and a process for producing film or video sequences, resp-ectively, the production of which in a conventional manner re~uires a relatively complicated s motion of the camera, by means of a simplified and therefore less j itter-sensitive camera motion.
This object is solved by an apparatus having the features of claim 1 or a process, respectively, having the features lo of claim 15 A device, in accordance with the present invention, serves for simulating photographic images of an obj ect to be photo-graphed The device has a camera that is movable in 15 an X-Y plane and is rotatable about an axis that extends through the camera and is substantially perpendicular to the X-Y plane. The device also includes a rotatable stage or plat-form. The stage or rotatable platform selectively rotates an object to be photographed about an object axis 20 which is substantially perpendicular to the X-Y plane. The camera is provided on a camera mount, which mounts the camera such that the camera is at least rotatably movable along a camera axls which is substantially parallel to the object axis. Furthermore, a drive assembly is provided for 25 reciprocally moving the camera mount along a Y axis toward and away from the plat-form. A translating means "translates" a first spatial and angular relationship between the camera which is movable in an X-Y plane and rotatable about an axis therethrough, and the object, into 30 a second spatial and angular relationship between the camera and the object, which supposes that the camera is movably mounted on the camera mount so as to be rotatable along the camera axis and movable along the Y axis and the object is on a rotatable platform, such that a set of the 4 2~
seco~rd relationships will produce substantially the same photographic images as would be produced by a set of the first relationships. Controlling means is provided for 5 controlling the drive assembly to regulate movement of the camera along the Y axis, and for controlling rotational movement of the platfo rm and the camera according to the set of second relationships. The camera may also be moved along the Z-axis, perpe]ldicular to the X-Y plane.
In an advantageous embodiment, the apparatus comprises an image processing unit for superimpo-sing single images of plural primary image sequences which in part or completely have been produced by means of the image taking device or 15 in a synthetic way, especially as computer graphics, for forming a resulting imc~ge sequence. This superposition of several images can be carried out uslng means of the film copying technology or the digital (video) image processing which are known as such. Herein, the application o~ the 20 technique common be known as Blue-screen technique wherein during the takes a single-colored screen (Blue-screen) is provided as background for the take is especially useful.
For facilitating the synchronization between the several 25 image sequences and possibly for creating computer graphics (especially e.g. "virtual reality~) sequences which are fitted to the takes of real objects t~1e apparatus in useful manner, furthermore, comprises a memory means for storing the control signals which are output to the several 30 components of the apparatus (camera, drive of the camera mount, rotating stage or turntable, respectively, etc. ) during the taking of a primary image sequence.

%~
Its data input is connected with the output of the evaluating unit during the taking of at least one primary image sequence to store the evaluated control signals. The data output of the memory means optionally during the 5 taking of a further primary image sequence is connectable with the control inputs of the components or an input of the evaluating unit or is connectable with an input of the image processing unit during the production of the resulting image sequence from plural primary image 10 sequences such that the control signals are directly or indirectly read out for controlling the further takes and/or the image processing.
13specially, the evaluating unit comprises an interface for 1~ connecting it with a graphics computer for unidirectionally or bidirectionally transferrlng controL data for the apparatus to and/or from this computer for the synchronized production of phototechnically or videotechnically generated and of synthetic image sequences.
In a further useful embodiment, the evaluating unit and/or the image processing unit comprises a scaling unit for individually adjusting the control signals for the operation of the apparatus for producing several image 25 sequences with respect to different take conditions -especlally different scale (object distance, zoom) - and/or parameters of the several images to be superimposed and originating from different image sequences. ~ereby e.g. an adjustment of the relative image size, a rotation of the 30 image plane and/or the adjustment of a corresponding image-weighing factor for the superposition (mixing) of several images can be carried out.

` 2~822~0 Furthermore, the image processing unit advantageously comprises means for the later processing of an image sequence being formed by superposltion ("matting").
5 A further important embodiment of the apparatus is characterized in that a controllable, especially rotatable and~or luminance-controllable lighting means for the object (s) is provided which lighting means comprises a control unit being connected to an output of the evaluating o unit. Hereby, it is ensured that the illumination of each object is adapted to the special filming technology according to the invention.
To be able to simply p]-oduce takes in which translational 15 motions of humans, animals, vehicles, etc. shall be shown in or on the rotating neans further means for translating or additionally rotating an object with respect to the rotating means is provided, the means for translating or additionally rotating comprising a separate drive unit and 20 an input being connected to an output of the evaluating unit .
For the effective production of image sequences in which objects with very different size shall be shown at the same 25 time plural rotating means of different size for plural objects of different size can be provided, which rotating means are used time-sequentially for taking plural primary image sequences and comprising a control input which is connected to an output of the evaluating unit.
The image taking device, i.e. the "camera", especially can be a film or video camera, and the rotating means can be an essentially horizontal rotating stage, and the motion apparatus can comprise a camera ' mount or carriage, 2l8~2~v respectively, which is guided in a horizontal and a vertical track, each track being straight.
For medical applications, the image taking device can be a 5 medical imaging device, especially using ultrasound waves, X-rays or corpuscular rays or nuclear or electron spins for the image generation . The obj ect is then, of course, a human being or animal w]~ich is arranged on a rotatable bed.
10 In both latter - as well as in further possible -applications, the image taking device comprises a support which is rotatable or pivotable, respectively about three axes .
15 An advantageous embodiment of the process of the invention is that single images of plural primary image sequences are superimposed to a resulting image sequence, wherein the superposition especially can be carrled out in Blue-screen manner .
In a useful manner, during the process the drive data being used during the production of a primary image sequence are stored and optionally used for the production of a further primary image sequence and/or for the production of the 25 resulting image sequence from plural primary image sequences directly or following a transformation for the image generation.
The drive data for producing different image sequences can, 30 especially for adjusting the relative image size, for rotating the image plane and/or for adjusting an image-waiting factor for primary images for producing a resulting image be scaled and/or weighed.

218~2~
Figure l is a schematic diagram representing the spatial and angular relationshi.p between a camera location and an object providing a photograph image according to conventional photography, Figure 2 is a schematic diagram representing the spatial and angular relationship between a camera location and an obj ect accQrding to an embodiment of the invention which provides the same photo(~raph image as represented in Figure 10 1, Figure 3 is a schematic diagram representing the spatial and angular relationshi]?s between two camera locations and an object for providing photograph images according to con-15 ventional photography, Figures 4a and 4b are schematic diagrams representing thespatial and angular relationships between two camera locations and an obj ect according to an embodiment of the 20 invention which provide the same photograph images as represented in Figure 3, Figure 5 is a schematic diagram representing the spatial and angular relationships between five camera locations and 25 an obj ect for providing photograph images according to con-ventional photography.
Figures 6a to 6e are schematic diagrams representing the spatial and angular relationships between five camera 30 locati.ons and an object according to an embodiment of the invention which provide the same photograph images as represènted in Figure 5, 9 21~22~
Figure 7 is a schematic diagram reFresenting the spatial and angular relationships between five camera locations curving around an object for providing photograph images according to conventional photography, Figures 8a to 8e are schematic diagrams representing the spatial and angular relationships between five camera locations and an object accordlng to an embodiment of the invention which provide the same photograph images as lo represented in Figure 7, Figure 9 is a schematic diagram representing the spatial and angular relationships between five camera locations en-circling an object and the object for providing photograph 1~ images acco~ding to conventional photography, Figures lOa to lOe are schematic diagrams representing the spatial and angular relationships between five camera locations and an object according to an embodiment of the 20 invention which provide the same photograph images as represented in Figure 9, Figure 11 is a schematic diagram representing the spatial and angular relationships between a camera location and 2~ three obj ects for providing photograph images according to conventional photography, Figures 12a to 12c are schematic diagrams representing the spatial and angular relationships between three camera 30 locations and an obj ect according to the invention which will provide photograph images which, when combined, will form the same photograph image as represented in Figure 11, 29~

Figure 13 is a schematic diagram representing the spatial and angular relationships between a camera location and three: objects for providing photograph images according to conventional photography, Figures 14a to 14c are schematic diagrams representing the spatial and angular relationships between three camera locations and an object according to the invention which will provide photograph images which, when combined, will 10 form the same photograph image as represented in Figure 13, Figure 15 is a schematic diagram representing the spatial and angular relationships between a camera location and three; objects for providing photograph images according to 15 conventional photograph~, Figures 16a to 16c are schematic diagrams representing the spatial and angular relationships between three camera locations and an object according to the invention which 20 will provide photograph images which, when f r~mh; nf~d, will form the same photograph image as represented in Figure 15, Figure 17 is a schematic diagram representing the spatial and angular relationships between a camera location and 25 three sections for providing photograph images according to conventional photography, Figures 18, 19 and 20 are each schematic diagrams of a section illustrating the definition of terms describing the 30 spatial and angular relationship between a Section and a camera location, Figures 21a to 21c are schematic diagrams representing three different spatial and angular relationships between a 211 8~Q
Il camera locatlon and a section according to an embodiment of the invention which will provide photograph images which, when combined, will form the same photograph image as represented in Figure 17, Figure 22 is a schematic diagram representing the spatial and angular relationships between a camera location and three: sections for providing photograph images according to conventional photography, Figures 23a to 23c are schematic diagrams representing three; different spatial and angular relationships between a camera location and a section according to an emoodiment of the invention which wi] l provide photograph images which, 15 when combined, will form the same photograph image as represented in Figure 22, Figure 24 is a schematic diagram representing the spatial and angular relationships between a camera location and 20 three sections for providing photograph images according to conventional photograph~, Figures 25a to 25c are schematic diagrams representing three:different spatial and angular relationships between a 25 camera location and a section according to an embodiment of the invention which will provide photograph images which, when combined, will form the same photograph image as represented in Figure 2g, 30 Figure 26 is a schematic diagram representing the spatial and angular relationships between a camera location and three: objects of different sizes for providing photograph images according to conventional photography, 29~
Figures 27a to 27c are schematic diagrams representing three different spatial and angular relationships between a camera location and an object according to an embodiment of the invention which wi:Ll provide photograph images which, 5 when combined, will form the same photograph image as represented in Figure 21~, Figure 28 is a schemat:ic diagram representing the spatial and angular relationships between a camera location and o three. objects of different sizes for providing photograph images acco~ding to conventional photography, Figures 29a to 29c are schematic diagrams representing three different spatial and angular relationships between a 15 camera location and an obj ect according to an embodiment of the invention which will provide photograph images which, when combined, will form the same photograph image as represented in Figure 28, 20 Figure 30 is a schematic diagram representing the spatial and angular relationships between a camera location and three objects of different sizes for providing photograph images according to conventional photography, 25 Figures 31a to 31c are schematic diagrams representing three ;different spatial and angular relationships between a camera location and an object according to the invention which will provide photograph images which, when combined, will form the same ph~tograph image as represented in 30 Figure 30, Figure: 32 is a schematic diagram representing the spatial and angular relationships between a camera location and ~82290 three sections for provid~ng photograph images according to conventional photography, Figures 33a to 33c are schematic diagrams representing 5 three. different spatial and angular relationships between a camera location and three sections of different sizes according to an embodiment of the invention which will provide photograph images which, when combined, will form the same photograph image as represented in Figure 32, Figure 34 is a schematic diagram representing the spatial and angular relationships between a camera location and three: sections for providing photograph images according to conventional photography, Figures 35a to 35c are schematic ~diagrams representing three different spatial and angular relationships between a camera location and three sections of different sizes according to an embodiment of the invention which will 20 provide photograph images which, when combined, will form the same photograph image as represented in Figure 34, Figure 36 is a schematic diagram representing the spatial and angular relationships between a camera location and 25 three sections for providing photograph images according to conventional photography, Figures 37a to 37c are schematic diagrams representing three different spatial and angular relationships between a 30 camera location and three sections of different sizes according to an embodiment of the invention which will provide photograph images which, when combined, will form the same photograph image as represented in Figure 36, 14 ~i8~2~
Figure 38 i5 a schematic diagram representing the spatial and angular relationships between an actor "walking" along a straight line and a following camera at five different camera-actor spatial relations, s Figures 39-43 are schematic diagrams representing the actor walking around a circular board which is moving along the straight line AE illustrated in Figure 38, at each of the locations depicted in Figure 38, respèctively, Figure 44 is a composite of Figures 39-43, Figure 45 is a schematic diagram representing five different spatiai and angular relationships between a 15 camera location and an actor according to an embodiment of the invention which will provide photograph images corresponding to the images which can be taken in the positions represented in Figure 38, 20 Figure 46 is an elevated view of a motion control device according to an embodiment of the invention, Figure 47 is an elevated view of a camera portion or camera mount portion, respectively, of the motion control device 25 according to an embodiment of the invention, Figure 48 is a schematic (elevated) view of an arrangement according to the invention including two rotating stages and lighting for each stage, Figure 49 is a side elevated view of a motion control device. modified with respect to Fig. 46, and X2~
Figurg 50 is a block diagram of an embodiment of the motion control device.
To better understand the invention, it is preferable to 5 make a differentiation between the movement of a camera in space and the picture image resulting from this movement.
The actual camera movement (a 3-D movement in reality) will be called a "physical move".
10 Our experience tells us that a specific picture can be a result of only one specific "physical move", and existing motion control systems are based on this assumption.
However, the present invention is based on the observation that a specific picture can be the result of a different 15 and much simpler "physical move" in space, than our experience in reality would suggest. The present invention, the motion simulation control, transforms ~"translates") a motion of the ca~era in the X-Y plane into motion along the Y axis (straight travel forward and backward), camera pan 20 (side to side), and rotation of the photographed object on a rotating stage or turntable.
This is accomplished ~ith the use of three independent "machines" which each perform one of the simplest 25 mechanical motions, i.e. linear movement or rotation. The first machine is a linear track system, which moves the camera back and forth in the Y-direction. The second machine is a camera head or mount, respectively, which pans or rotates the camera about an axis which is perpendicular 30 to the X-Y plane. The third machine is the rotatable stage, which also rotates about an axis which is perpendicular to the X-Y plane. In operation, the object to be photographed is placed on the rotatable stage, and the stage, camera head and linear track system are driven in a coordinated ~ 230 manner so that the lnovemerit of these three machines together simulates the corlventional movement of a camera relative to an object.
To better understand the invention, it is helpful to establish a related vocabulary. The Cartesian plot in Figure 1 represents a bird's eye view of a photographing situation according to conventional photography. The center of this plot is the point B.
The camera 10 is located at point C having X and Y
coordinates of x_cam = -2 . 5, y_cam -- -1. 5 . Located in the middle of the plot, centered at point B, is a round board 12 with its center having X and Y coordinates of x_board =
0, y board = 0. The board has an arrow pointing in the north direction (i . e., in the direction of the Y axis) . The north direction will be used as a reference to describe the values of all the angles of a "physical move". The north direction has the value 0.
The camera 10 "looks" at target point T, having X and Y
coordinates of x_target = -0.5, y_target = 1.5. The angle between the north direction and the line between the camera 10 (point C) and point T is called the "camera look" angle 14. In Figure 1, the "camera look" angle 14 has a value of 33.69 (look = 33.69). The distance between the camera 10 (point C) and the center of the board 12 (point B) is called the "camera travel" distance 16, and has a value of 2.92 graph units (travel = 2.92).
The angle between the direction of the arrow and the line between the camera 10 (point C) and the center point of board 12 (point B) is called the "set rotation" angle 18 (s_rot), and has a value of -59.04 (s_rot = -59.04).

. .

The angular difference between the angle of the "set rotation" and the angle of the "camera look" is called the "camera pan" 20 ~c_pan), and has a value of -25.35 (c_pan s = -25 . 35 ) .
The values of the "camera travel" 16, the "camera pan" 20 and the "set rotation" 18 are collectively called the "conditions", and they describe the spatial and angular lo relationship between the camera 10 and the board 12 in Figure 1.
Figure 2 is a schematic of the same photographic image repr-esented in Figure 1, but generated by the motion IS simulation control of the invention. As shown in Figure 2, the motion simulation control ircludes a linear track 22, represented by a straight numbered line, and a round rotating stage 24 represented by a round circle. As can be seen from Figure 2, the rotating stage 24 depicts the same arrow illustrated in Figure 1. The center of the rotating stage is the reference for the camera position and has a value of 0 on the track 22. The motion simulation control also has a camera 26, which moves along the linear track 22 and which pivots or rotates in the same plane as the rotating stage 24.
Comparing Figure 2 with Figure 1, we see that all of the "conditions" established in Figure 1 are realized in Figure 2 by the motion simulation control ' s arrangement between the camera 26 and the rotating stage 24. In Figure 2, the camera 26 has the same distance from the center of the rotating stage 24 (i.e., travel = 2.92) as the camera 10 in Figure 1 from the center of the board 12. Also, in Figure 2 the camera 26 pans to the left from the center of the . . --18 ~ 2 ~ ~
rotating stage 24 at the same angle ~c pan = 25.35) as the camera ln Figure 1 pans to the left from the center of the board 12. LiXewise, tlle rotating stage 24 in Figure 2 rotates to the same angular position relative to the camera 26 as the board 12 in Figure 1 (s_rot = -59, 04) . The angle of this rotation in Figure 2 is indicated by the arrow 18 on the rotating stage 24.
In Figure 3, we see a camera lOa corresponding to camera 10 o in Figure 1, and a second camera lOb (point D) which has a different location in the Cartesian plot as camera lOa, but which "looks" at the same point in space (point T). New "conditions" are established for camera lOb in Figure 3.
Figures 4a and 4b illustrate the positions of the camera 26 relative to the stage 24 according to the invention, in order to "simulate" the camera positions of Figure 3. From Figure 4a, we can see that the camera 26 and rotating stage 24 of the invention arc rotated to provide an arrangement between the camera 26 and the rotating stage 24 which fulfiLls all of the "conditions" for camera lOa established in Figure 2. similarly, as shown in Figure 4b, the camera 26 and the rotating stage 24 of the invention can be rotated to provide an arrangement between the camera 26 and the rotating stage 24 which fulfills all of the "conditions" for camera lOb established in Figure 3. In this example, it is not necessary to move the camera along the linear track 22, because the "travel" distance, i.e., the distance from the camera at points C and D to the center B of the board 12 in Figure 3, is the same for both camera- locations.
From analyzing Figures 1-4, the conclusion can be drawn that if the motion simulation control can fulfill all of 21~
l9 the conditions of conventional photography for camera lOa and camera lOb, the can~eras being located in two different points of the X-Y plane (at point C and point D), then the motion simulation control system can fulfill the conditions 5 of any camera located on any point on the X-Y plane used by conventional photography.
Based on this assumption, it will next be discussed what happens when a camera travels in the X-Y plane. Figure 5, 10 depicts a physical move of a camera lO along a straight line according to conventional photography, where the camera lO travels from point C to point D. As it travels, the camera lO turns to always observe the same point T. The 5 represented camera locations, lOa, lOb, lOc, lOd, and lOe 15 show 5 phases of the "camera motion". In the drawing, the conditions for these 5 phases are established. The distance of the camera travel is 5 graph units (distance = 5. 0) .
Figures 6a-6e depict how the motion simulation control 20 "translates" the straight travel and the camera-to-object relationship illustrated in Figure 5 into a different kind of motion or relation, respectively. As can be seen in Figures 6a-6e, for each position of the camera lO shown in Figurè 5, the motion simulation control provides an 25 alternate camera position relative to the stage 24 which creates the same photographic image. For example, Figure 6a illustrates how the ca~nera 26 and the stage 24 can be rotated to provide the same conditions as the camera location lOa in Figure 5. To provide the same conditions as 30 the camera ~ location lOb in Figure 5, the camera 26 embodying the invention is moved closer to the stage 24, and both the camera 26 and the stage 2~ are rotated accordingly. A similar procedure is performed to recreate 2 ~ 0 the conditions for the camera locations l0c-lOe, as are illustrated in Figures 6c-6e.
From this, it will be understood that if the motion 5 simulation control can fulfill the ~conditions established in Figure 5 for each of the five camera positions which represent five phases of the travel, then it can fulfill the conditions for all other phases of the travel. The conclusion that can be reached is that the camera 26, moved 10 by the motion simulation control, observes the rotating stage 24 in the same way as the camera lD observes the board 12.
Observing Figure 5 and Figures 6a-6e, we can see the basic 15 difference between the two kinds of motion, the original "physical motion" ("PM distance") and the motion effected or translated by the motion simulation control. The travel of the camera l0 shown in Figure 5 occurs on the X axis.
The travel executed by the motion simulation control, 20 however, occurs only on the Y axis, along the linear track 22, as shown in Figures 6a-6e. One advantage of using the motion simulation control in this example is that the total travel of the camera 26 on the Y axis shown in Figures 6a-6e (MCS distance -- 2.82 graph units), executed in a forward 25 and backward direction, is much shorter than the travel on the X axis executed continuously in one direction by the camera in Figure 5 (PM distance = 5 . 0 graphs units) . The entire range of movement in the Y-axis direction (i.e., the travel maximum value minus the travel minimum value will be 30 called the "weg" . In Figure 6a-6e, the weg value is l . 42 (i.e., position at l0a or l0e minus position at l0c, 2.92 -1.5) . Figures 6a-6e show that the motion on the X axis is completely eliminated. T1~e difference between travel on the Y axis (MCS distance) and travel on the X axis (PM

2, ~1822~
distance) shows that the camera moved ~y the motion simulation control travels much slower than the camera had to be moved during the original travel. This decrease ln the speed of the camera travel is very important for the 5 quality of the photographed motion, producing less j itter .
Figure 7 depicts five locations lOa' to lOe' of a camera in reality, as the camera makes a motion on a curved path about point T. The various conditions of each camera 10 location can be seen from Figure 7. In Figure 7, the travel distance is 5 . 55 graph ~InitS .
Figures 8a to 8e illustrate how the same motion is trans-lated by the motion simulation control according to an IS embodiment of the invention. Figures 8a-8e depict five different locations of the camera 26 of the motion simulation control, eacl ~ Figure corresponding to a position shown in Figure 7. Each of the camera 26 positions shown in Figures 8a-8e, along with the relative rotation angles of 20 the camera 26 and the stage 24, provide the same set of conditions for its corresponding camera position in Figure 7. Accordingly, it will be understood that the camera positions illustrated in Figures 8a-Se will provide the same photographic images as the camera positions 25 illustrated in Figure 7. In analyzing these two drawings, the conclusion is reached that the motion simulation control "translates" a curved camera motion in the X-Y
plane to a linear, one dimensional camera movement along the Y axis. Figures 8a-8e demonstrate (as in Figures 6a to 30 6e) that camera motion along the X axis is completely eliminated by the motion simulation control.
Figure 9 depicts five locations lOa" to lOe" of a camera representing the points of a circular motion around a board ~ g229~
12 (where travel distarlce = 9.77 graph units). The camera is "looking" at target point T, (x_target = -0.5, y_target = 0.5~. As with the previously discussed examples, all conditions for each camera location- depicted in Figure 9 5 can be fulfilled by the motion simulation control's arrangement between the camera 26 and the rotating stage 24, as is shown in Figures lOa to lOe. It is interesting to note that in this example, the "MCS distance" = 0. This means that the camera 26 of the invention does not travel 10 at all, but instead simply rotates about its axis.
Building upon the basic principles of the invention discussed above, the operation of the invention wail now the discussed in more detail. In conventional photography, 15 the camera moves--and photographs the static "world". All physical work necessary to travel over a distance and to change the angles of the "look" are solely performed by the camera. The static "world" photographed by the camera does not have a clear reference. It exists with an infinite 20 amount of visual elements. This complexity and lack of a reference in the photographed "world" causes problems in the production of multicomposite images as well as in the construction of computer generated images.
25 The present invention is based on the idea that the camera performs only part of a motion in space and can photograph only part of the "world" ( i . e . that part which exists on the rotating stage) . Thi s part of the "world", through its own rotation, participates in the execution of a motion 30 along with the camera. The "world" is not static and its infinite amount of visual elements to be photographed are limited to the visual elements existing on the rotating stage.- The motion simulation control synthesizes a new motion in space between the camera and a chosen point in 23 ~18~
the "world". About this point, the (limited) real world rotates. The center of this rotation becomes a clear reference for the motion, the location of the photographed obj ects and the composition of the image .

Referring back to Figure 9, the depicted camera 10 moves in a circular motion aroun~ the board 12 and remains the same distance from the center of the board 12 as it travels. The travel executed by the motion simulation control represents 10 the change in the distance between the center of the board 12 and the camera 10. This is the reason why the camera 26 of the invention represented in Figures lOa-lOe does not travel at all . The entire distance of the camera ' s travel in Figure 9 (PM distance = 9.77) is translated into by the 15 rotation of the stage 24 and camera 2~ in Figures lOa-lOe.
The different relationships between the three movements described as conditions can be produced by forward and backward travel of the camera, camera pan and rotation of 20 the stage, which can imitate any two-dimensional camera notion in space. The results are correct images of a chosen part of the "world" which exists on the rotating stage. The forward and backward travel of the camera, camera pan and rotation of the stage form the three basic channels of the 25 motion simulation control. The synchronized work of these three channels form a virtual "vehicle" which can execute any motion in space. The motion of the vehicle depends on the vàrying percëntages of work performed by these three channels .
The operation of the motion simulation control will now be explained in greater detail with reference to Figures 11-25. Here it can be seen that the whole image of the "world"

24 ~ 29~
can be built from separate images of the parts existing on di f f erent boards .
Figures 11, 13, and 15 schematically show the same linear 5 traveL of camera 10 which was described in Figure 5. To simplify the description, however, only three phases of the camera motion are shown (at points C, Ca', and D). In these Figures there are three boards (12a, 12b, and 12c) located in different places on the X-Y plane. In each of Figures 11, 13, and 15, conditions are established between the camera 10, the boards 12a, 12b and 12c, and the target point T for each camera location.
Figures 12a-12c, 14a~ c and 16a-16C illustrate how the 15 motion simulation control, through different arrangements between the camera and the rotating stage, can fulfill all of the conditions established in Figures 11, 13 and 15.
For example, Figures 12a-12c depict three different angular and spatial relationships between the rotating stage 24 and 20 the camera 26. The first relationship, depicted in Figure 12a, recreates the conditions between the camera 10 and the board 12a shown in Figure ll. Similarly, the relationship shown in Figure 12b represents the same conditions that exist between the camera 10 and the board 12b in Figure 11.
25 Finally, the relationship depicted in Figure 12c corresponds with the relationship between the camera 10 and the board 12c in Figure 11.
In a similar fashion, the three different camera-stage 30 relationships shown in Figures 14a-14c correspond to the relationships between t~le camera 10 and each of the three boards, labeled 12a, 12b, and 12c depicted in Figure 13.
Additionally, the three different camera-stage relationships shown in Figures 16a-16c correspond to the ~ 8~29~

relatlonships ~etween the camera lO and each of the three boards 12a, 12b, and 12c depicted in Figure 15. From these examples, it will again be understood that by means of the invention one can recreate the photographic image of each of three objects by sim]~ly rotating the camera 26 and stage 24 and by moving the camera 26 relative to the stage 24 along a linear track 22 Up until now, the examples of the invention discussed have only been made with reference to a board with a two-dimensional arrow. However, as will now be explained, the present invention can also be used with two- or three-dimensional objects Figure 17 illustrates a long arrow-like obj ect 28 (with points a, d, h, 1, i, e) built from three smaller Sections 28a, 28b, and 28c (formed of points a, b, f, j, i, e, points b, c, g k j, and f, and points c, d, h, 1, k, and g, respectively). Each Section rests on a different circular board 30a, 30b, and 30c, respectively, and each of the boards includes an arrow pointing i~ the north direction ( i . e ., the Y-axis direction) .
Figures 18, 19 arLd 20 ~pict the section conditions which can be used to mathematically describe the spatial and angular rPl~ti~nch;ps between the camera and every corner of each section. These drawings explain the mathematical vocabulary used for secti~on conditions ~based on the "corner b"). For example, Figure 18 illustrates the corner-to-board distance (cor_board_dist) 32 between the center oi the board (x board, y_`ooard) and cor=ner b of the object (x_cor, y_cor), and the corner-board angle (cor-board-angle) 34 between the direction of the arrow and a line ~18~9~

running from the center o~ the board 30b to the corner b oi`
the object.
Figure 19 illustrates the camera pan (c_pan) 36, i.e., the angle between a line running from the center of the board 30b to the camera 10 and a line runnlng in the direction that the camera 10 is pointing (i . e ., toward the target point T) . Figure 19 also shows the corner-to-camera distance (cor_cam_distance) 38 between the camera lD and the corner b, and the corner angle (cor_angle) 40 between a line running from the corner b to the camera 10 and a line running in the direction that the camera 10 is pointing.
Further, Figure 19 illustrates the set rotation (s_rot) 42, i.e., the angle between the direction that the camera lO is pointing and the direction of the arrow.
Lastly, Figure 20: shows how each of the section conditions has an equivalent when section 28b is placed on the rotating stage 24 of the invention. The same vocabulary depicted in Figures 17-19 will be used later for the discussion of "scale section conditions".
As noted before, Figure 17 shows how three sections, 28a, 28b, and 28c rest on three circlllar boards, 30a, 30b, and 30c to present a conventional photographic image to camera 10 when camera lO is located at point C. In Figures 21a, 21b, and 21c, individual sections 28a, 28b, and 28c are illustrated resting on the rotating stage 24 of the invention in the identical position, relative to the camera 26, as these sections on the boards 30a, 30b, and 30c do in Figure~ 17, respectively. Figure 22 shows the relationship between the sections 28aJ 28b, and 28c when camera 10 is in a different location, at point Ca', relative to these sections. Again, Figures 23a, 23b, and 23c illustrate that, 27 ~22~
when the sections are placed on the rotating stage 24 of the irvention, and the stage 24 and camera 26 are rotated and dlstanced appropriately, the sections are in the identical position, relative to the camera 26, as the sections depicted in F' gure 22 . Figure 24 illustrates the relationships between the sections on the boards 30a, 30b, and 30c and the camera 10 when the camera 10 is in yet a third location at point D. Figures 25a, 25b, and 25c illustrate how these relationships can be created by placing the sections on the rotating stage 24 of the invention, and then rotating the camera 26 and the stage 24, and moving the camera 26 relative to the stage 24.
The reference for the location of every section in Figures 17, 22, and 24 is the center of every board and the north direction, which is indicated by the arrow on every board.
As noted before, Figures 21a, 21b, and 21c depict three separate relationships between the camera 26 and a section as shown in Figure 17. The first relationship depicted in Figure 21a, simulates tl1e conditions between the camera 10 and section 28a shown in Figure 17. ~ikewise, the relationship shown in Figure 21b, simulates the conditions between the camera 10 and section 28b shown in Figure 17.
Finally, the third relationship shown in Figure 21c, represents the conditions between the camera 10 and section 28c shown in Figure 17 . From Figuresi 21a-c, 23a-c and 25a-c, it can be seen that the motion simulation control through the arrangement between the camera 2 6 and the rotating stage 24, can fulfill all of the section conditions depicted in Figures 17, 22 and 24 for three-dimensional objects. (It will be understood that, since both the object and the camera view have height, the camera photographs the nLove in three dimensions. ) 28 ~ g ~
rt will be easily understood that if each section on the rotating stage is photographed separately, the three resultlng separate images of the sections can be superimposed onto each other to produce a final image. If 5 the three separate images produced by the relationships shown in Figures 21a, 21b, and 21c are superimposed on each other, then the resulting final image will be identical to the image deplcted in Figure 17. Likewise, if the three separate re-lationships depicted in Figures 23a, 23b, and lo 23c are used to produce three separate images, and these three separate images are combined to produce a final image, that final image will be identical to the image described in Figure 22. 1astly, if the three separate relationships shown in Figures 25a, 25b, and 25c are used 15 to produce three separate images, and these three images are ~ superimposed onto each other, the final image produced will be identical to the image resulting from the relationship depicted in Figure 24. This demonstrates that separate images of separate sections can be superimposed to 20 form an image of the larger object.
Since three separate images of the sections representing different locations on the X-Y plane (different parts of the "world" ) can be connected in one cohesive image of an 25 obj ect, then several conclusions can be drawn.
First, the whole image of the "world" can be built by superimposing separate images of the small parts of the "world", which exist on rotating stages. Second, the chosen 30 parts of the "world" can be located in any area of the X-Y
plane. There is no limit to the amount of such chosen partS
whose images can~be superimposed onto each other. Third, an image of an object, which rests on the rotating stage, is visually connected (synchronized) with a superimposed image 29 ~1~229~
of another object resting on the surface of a different rotating stage. Fourth, the dimension of the surface of the rotating stage theoretically has no limit. In Figures 17, 22, and 2~, the corners of the sections on the boards 30a 5 and 30b extend outside the perimeter of the boards. In Figures 21a, 21b, 23a, 23b, 25a, and 25b, we see that even though the corners of the sections extend outside the perimeter of the rotating stage, all the section conditions are still fulfilled. The dimensions of the surface of the o rotating stage are only dictated by the dimensions of the film studio.
Finally, the construction of existing motion control systems is based on the assumption that all components of a 15 picture are photographed with the same repetitive motions (scaled up or scaled down depending on the scale of the components) and that the camera has to execute a physical move to attain these motions. The construction of the present invention is based on a different assumption. All 20 components of the picture are photographed with different motions. The result is an image identical to that taken during a conventional physical move, but the conventional motion is never really executed in space by the camera.
25 The biggest problem in the production of multi-composite images is the problem of scale. When different components of an image have different scales (size), it is very difficult to make them "fit". This problem is caused by two ma j or f actors .
~he first is that the physical move of the camera has to be scaled up or scaled do~n depending on the scales of the components. The scaling up or down of a non-linear physical move creates different physical conditions (wherein 30 ~i82~D
di~ferent values of kinetic energy are of importance) for the motors and the construction of the motion control system. The results are different image "jitters" for the different components. The second factor is the lack of clear reference for the location in space of the photographed components (i.e., where to place an object in relationship to the camera).
The present invention solves these problems. During a conventional physical move, the j itter of a picture appears when the camera is changing its X-Y-Z position in space in a non-linear manner, since ~itter in camera takes is mainly caused by centrifugal forces. Jitter does not exist (or is so minute that it is not detectable in the picture1 when a physical move ls purely linear in nature. Because the motion simulation control transforms a non-linear movement to linear movement, the j itter problem is solved (assuming that the tracks used irl the motion simulation control are nearly or perfectly straight).
The full solution to tEle problems caused by scale can be seen from considering Figures 26, 28 and 30. These Figures depict three phases of straight travel for camera lO. The camera travels f~om point A (having coordinates x_cam =
2.5, y_cam = -1.5 in Figure 26) to point Al (having coordinates x_cam = 2.5, y_cam = 0 in~ Figure 28) to point D
(having coordinates x_cam = 2 . 5, y_cam = l . 5 in Figure 30) and observes target point T, which is located in the center of the Cartesian plot. In these Figures, there are three boards of different si7es, 44, 46, and 48, representing three ~different scales. Each of these boards has an arrow pointing in the north direction, which will be used as a reference again.

2~ g~%~
The refere~ce for the scale i~ the radius of the board. In the discussed examples, when the radius of the rotating stage 24 of the invention is l graph unit, the radius of the board, in scale l: l, has the value of l graph unit 5 ~RADIUS = l . 0), in scale 2: l, has the value of 2 graph units (RADIUS = 2.0) and in scale 1:2, has the value of 0.5 graph unit (RADIUS = 0.5). The different scales of the boards only effect the camera's travel according to the following formula: "scaled travel" = travel ~ RADIUS. In 10 other words, and as can be seen from Figure 26, the actual or "scaled travel" shown in Figure 26 is converted to travel for the invention by dividing the "scaled travel" by the radius. Applylng this formula to the conditions shown in Figures 26, 28 and 30, "scale conditions" can be 15 established for every phase of the camera lO movement relative to each of the three boards.
For example, Figures 27a-27c show three relationships between the camera 26 and the rotating stage 24 according 20 to the invention. The relationship in Figure 27a will produce the same image as the scale conditions created by the relationship between the camera lO and board 44 in Figure 26. That is, the travel between the camera 26 and the stage 24 in Figure 27a will produce the san e scale as 25 the scaled travel between the camera lO and board 44 in Fi gure 2 6 .
Similarly, the relationship depicted in Figure 27c will produce the same image as the scale conditions between the 30 camera lO and board 46 depicted in Figure 26. Likewise, the relationship depicted in Figure 27c will produce the same image as the scale conditions between the camera lO and board 48 in Figure 26.

~ o 2~ ~22~

In a similar fashion, tl1e relationships depicted in Figures 29a-29c correspond to the scale conditions depicted in Figure 28, while the relationships shown in Figures 31a-31c will produce the same images for each individual board as the scale conditions depicted in Figure 30. From Figures 27a-27c, 29a-29c, and 3Ia-31c, it can be seen that by arranging the camera 2 6 and the rotating stage 24, the motion simulation control can fulfill all of the scale conditions established from Figures 26, 28 and 30.
The scaling feature of the present invention can be applied to three-di~nensional objects as well. In Figures 32, 34 and 36, is shown a long arrow-like object 50, which is built from three smaller sections 50a, 50b, and 50c. Every section rests on a different board, 52a, 52b, or 52c. It is important to note that Figures 32, 34 and 36 show the desired visual result: one object composed from three sections representing different scales. The dimension of every section can be established by its relationship to the radius of every board. In Figure 32, 34 and 36 are established additional scale section conditions which describe the relationship between the camera and each corner of every section.
In Figures 33a-33c, 35a-35c, and 37a-37c, individual sections 54a, 54b, and 54c are illustrated corresponding to sections 50a, 50b, and 50c, respectively, resting on the rotating stage 24 in the identical position relative to the camera 26 as the sections in Figures 32, 34 and 36. The reference for the location of every section is the center of the rotating stage 24 and the direction of the arrow on the stage 24. The reference for the dimension of every section is its relationship to the radius of the rotating stage 24. Figures 33a-33c, 35a-35c, and 37a-37c demonstrate 21~
that the motion simulatlon control, through the arrangement between the camera 26 and the rotating stage 24, can fulfill the scale section conditions shown in Figures 32, 34, and 36.

If each section on the rotating stage as depicted in Figures 33a-33c is photographed separately and the three images of the sections depicted in each of the Figures are superimposed onto each other, the final image will be 10 identical to the image described in Figure 32. In the same fashion, if each section on the rotating stage as depicted in Figures 35a-35c is photographed separately and the three images are superimposed onto each other, the final image will be identical to the image described in Figure 34, 15 while if each section depicted in Figures 37a-37c is photographed separately and the three images of the sections depicted in Figure 37a-37c are superimposed onto each other, the final image will be identical to the image described in Figure 36. This shows that the superimposed 20 images of sections, which represent different scales, will form the image of the long arrow-like object.
If three separate imaçres of the sections and different scales and different locations on the X-Y plane can be 25 corlnected in a cohesive image of one object, then the following conclusions can be drawn:
First, the whole image of the "world" can be formed by superimposing separate images of the small parts of the 30 "world" which represent different sca~es. There is no limit to the amount of the scales which can be applied. Also, every part of the "world" can be composed from components representing different scales. The division of the "world"
into small parts allows for the composition of images ad 34 ~1~22~
infinitum. During the travel o~ the camera, "new" parts are entering and "old" parts are leaving t~le frame (the steady overlap of the parts). There are no limitations to the dimensions of the photographed "world".
s However, a problem could arise with conventional photography when moving objects have to be transported over a distance which would exceed the surface of the rotating stage, i.e., an actor walking in front of a traveling 10 camera The present invention in an embodiment solves this problem, as will be explained.
Figure 3a is a schematic view of an actor 56 walking from point A to point E as a camera lO tracks his movement. For 15 clarity, each position of camera lO relative to the actor 56 will be referred to by the point at which the actor is located for that image. For example, when the actor is at point A, the actor location and associated camera location will be identified as 56a and lOa, respectively. The 20 distance between point A and point E is calIed the "walk"
and has the value of 5. ~5 graph units in Figure 38 .
Figure 39 depicts a board 58a whose center is located on point G. The actor 56 is standing on the board 58a at point 25 A ~the angle GAE = 90~ The distance of the "walk" AE can be translated to the curved line AE on the board 58a. The length of the curved line AE is equal to the distance of the "walk". The curved line ~E is a part of the circumference of a circle whose radius is equal to the 30 distance between the actor (point A) and the center of the board ~point G). This radius (in the example) has the value of 0.82 graph units (walk radius = 0.82).

. ~ --35 ~2%~
Imagine that the board can "move" on the X-Y plane ~from point A to point E) in synchronism with the traveling camera lO, and can rotate clockwise. The actor walks counter clockwise Qn t~le board 58a (as if the actor were 5 walking on a treadmill) . Figures 39 ~- 44 show five phases of the "moving" board for points A-E, and "walk conditions"
are established for every phase. During the "walk"
function, the rotation of the board ("final s_rot") is the sum of two rotations: (l) the rotation from the original 10 conditions (the angle between the center of the board and the c~mera position, i.e., s_rot); and (2) the rotation of the board translating the distance of the walk (board-angle). Fig. 44 is a su~marizing view of the whole motion.
15 Figures 45a-45e show the arrangement accQrding to an embodiment of the invention between the camera 26, the rotating stage 24, and the walking actor 56, which fulfills all of the walk conditions established in Figures 39 - 43, respectively. The conclusion is drawn that any distance 20 and any direction of t~1e walk can be performed using the motion simulation control. In the previous description, no mention was made of the Z axis (height). The elevation of the camera does not participate in the function of the "vehicle", thus it can be freely designed. Its only 25 limitation is the level to which the camera 26 of the invention can be raised above the surface of the rotating stage. This level is limited by the dimension of the film studio (ceiling) and the practicality (size) of the construction of the motion simulation control.
This limitation of height only applies to photographed components whose images are influenced by the force of gravity (animate objects, fire, water etc. . . ) . All components which are not influenced by the force of gravity ~ 29~
(inanimate objects, arc]litectural models, stones, furniture etc. . . ) can be photographed in different positions (sideways or upside down). After rotating the camera sideways, the Z axis exchanges with the X axis. The 5 components which are in the sideways position appear to be in a normal position. The "vehicle" can now "move" in the ~Y plane. It can "move" up and down along an infinite length of a vertical wall. After rotating the camera upside down, obj ects in an upside down position appear normal . The 10 "vehicle" can "move" under an infinite ceiling. The height, however, like "camera travel" has to be scaled down or scaled up, depending on the scale of a photographed component .
15 Figures 46 - 49, are drawings of the construction of the device of the motion simulation control.
The overall construction, as illustrated in Figure 48, contains a large rotatir1g stage 24a for photographing human 20 beings and objects in scale 1: l, a small turntable 24b for photographing models and miniatures in small scales, and a horizontal linear track 22 which can be set up on the floor or hung from under the ceiling. Preferably, one end of the track 22 faces the center of the rotating stage 24a and the 25 other end faces the center of the small turntable 24b. A
tower-like structure 60 travels along this horizontal track 22. The tower 60 is illustrated in more detail in Figure 46. The tower 60 holds a vertical linear track 62. Along the vertical track travels a carriage 64 which holds a 30 camera head or mount 64, respectively.
Mounted inside the camera head 64 is the camera 26. The camera head 64 has several motors which can execute the camera pan, the camera tilt, the camera rotation (sideways 37 ~ 8~
and upside down), zoom, focus, and nodal point ad~ustment.
The camera is mounted in the nodal point position (the vertex of all angles inside the lens). The nodal point position has to be steadily adjusted according to the 5 position of the zoom (the nodal point depends on the focal length of the lens). T]1e X-Y-Z location of the nodal point represents the X-Y-Z location of the camera position.
The forward and backward motion of the tower 60, along the 10 horizontal linear track 22, executes the "condition" of camera travel. The reference for the camera travel (travel = 0) is the center of t~le rotating stage.
The up and down motion of the carriage with the camera head 15 on the vertical linear track 63 executes the height adjustment of the camera 26. The reference for the height (level = 0) is the position when the nodal point is on the same level as the surface of the rotating stage 24a.
20 The side to side motioll of the camera 26 (pan inside the camera head) executes the "condition" of camera pan. The reference for the pan (c_pan = 0) is the center of the rotating stage 24a.
25 The remalning camera functions (zoom, focus, tilt and rotation) do not participate in the functions of the "vehicle" and can be freely designed. The tower can be turned 180 degrees to face the center of the small turntable 24b. The center and the level of the surface of 30 the turntable 24b become the reference for the camera travel, pan and rotation (the values = 0). The turntable 24b may be used for photographing miniatures and models.
The separation of the large stage 24a and the small turntable 24b is for practical reasons. When working with 38 ,~1822~
miniatures and models, different lighting conditions are needed than when working with actors - what is a conse~uence of the small depth of focus caused by the shorter distance between the camera and photographed 5 components.
The rotation of the rotating stage 24a or the small turntable 24b executes the "condition" of set rotation (s rot).
The camera support 64 ~ith the camera 26 is shown in Fig.
47 in more detail; herein especially the several motion possibilities M" (rotation about a vertical axis through the camera = horizontal camera pan), M~ (rotation about a 15 first horizontal axis which is identical to the optical axis of the camera), ( rotation about a second horizontal axis, perpendicular to the optical axis of the camera =
vertical camera pan), Ml~ (vertical shift of the camera) and MN (nodal point ad]ust) can be recognized.
An additional part o~ the motion control system are rotating lighting grids 66, 68. These grids hang above the rotating stage and turntable and rotate in synchronism with the stage 24a and turntable 24b, respectively. The rotation 25 of the lights produces the same changes of lighting on the photographed components which occurs in the "world" during a conventional move.
Fig. 49 shows an embodilrent of the apparatus for moving the 30 camerà 26 which apparatus is modified with respect to the apparatus shown in Fig. 46 in elevated view. The reference numerals correspond to those in Figs. 46 to 48 wherein an " "' has been added to the numerals for differently designed components .

-- ~18~9~

Fig. 50 in the manner of a block diagram shows the:
essential functional units of an embodiment of the motion control system in more detail, showing the signal S connections and in detail the several control signals for the system as well.
The main functional components of the depicted system are a contral data evaluating unit lO0 with a control data memory lo 101 being connected to the input as well as to the output of the former, and an image processing unit 102 at the output of which plural monitors 103.1 to 103.n and at the input as well as the output thereof plural video memories or recorders 104.1 to 104.n, respectively, are arranged 15 (wherein in the Figure two devices of each kind are shown).
The outputs of the control data evaluating unit 100 and the control data memory 101 are, furthermore, connected to an input of the image processing unit 1~2 and the input of a 20 computer graphics unit 105, the in- and outputs of the latter also being connected to the image processing unit 102. Inputs of the control data evaluating unit 100 and the control data memory 101 are connected to an input unit 10~, an output of the image processing unit 102 and an output of 25 the computer graphics unit 105 by means of a scaling processor 106. The control data evaluating unit lO0 and the computer graphics unit 105 are immediately bidirectionally connected with one another by means of an interface 108.
30 As shown by means of broken lines bearing a direction arrow on both ends in the Figures, the control data evaluating unit lO0 is connected to (not specifically enumerated) actuators of the components of the motion and lighting arrangement by means of which the several control steps can .~ ~t $~9~

be carried out. It both works as an interface for those components. Preferably, sensors (which are not shown in the Figure) are connected with the actors, the sensors being able to sense the actuator positions vice versa. The 5 registration of the current parameters of the apparatus, however, alternatively can be carrled out such that all settings ~ including those of the camera mount 64 and the camera 26 in the case of manual control) are input by means of the central input unit 107 and the current values of the 10 control signals in their time dependence are immediately transmitted from the evaluating unit 100 into the control data memory 101.
Specifically, in 'che Example the fol~owing control signals 15 are used, i . e . input by manual control or evaluated, and transmitted to the corresponding actuators and optionally the memory areas of the memory 101:
As can be seen on the left side of the Figure, a control 20 signal Ll for the luminance of the lamp 66a of the lighting means 66 of the rotating stage 24a is transmitted to a luminance regulator (e.g. a thyristor control) being arranged at the input of the lamp 66a, and by means of this regulator the luminance of the lamp is adjusted. By means 25 of a sensor at the lurninance regulator or a separate photo-sensor the current luminance can be sensedi however, as mentioned above; the control signal L1 can immediately be stored. A control signal (P4 for adjusting the rotational angle of the lamp 66a above the rotating stage 24a is 30 transmitted to a motor (e.g. step motor) being arranged at the lighting means 66 and for rotating the lamp 66a. In a similar manner - as can be seen on the right side of the Figure - the luminance and the rotational angle of the lamp 68a of the lighting means 68 being provided for the 229~
turntable 24b are cont:~olled by using a luminance control signal ~2 and a rotatiorl angle control signal ~5.
The rotation of the rotating stage 24a is controlled by a 5 rotating angle control signal ~1 which is transmitted to a motor driving the rotating stage. A rotation of the rotating board 124a being arranged on or in the rotating stage 24a, respectively, is controlled by a rotating angle control signal ~3 and carried out by a separate motor, and o a motion of the travelling belt 224a on the rotating board 124a is controlled by a position control signal b and carried out by means of a separate travelling belt motor.
For each of the rotating stage 24a, the rotating board 124a and the travelling belt 224a a corresponding sensor for 15 sensing the time dependent position can be provided - for the above mentioned signals, however, the immediate transmission from the evaluating unit lO0 into the memory 101 is to be preferred since a control of the components 24a, 24b, 66, 68, 124a and 224a in a manual way just has to 20 be considered for special cases. In analogy to the control of the rotating stage 2 ~a, the turntable 24b is controlled by a rotating angle control signal q)2 which is transmitted to a separate motor being arranged at the turntable 24b.
25 The above mentioned control signals and control functions are related to the motion, especially rotation, of objects in relation to the camera 26 and the object lighting which together form one of the essential elements of the process for producing an image sequence. The other essential 30 element, namely, (two-dimensional) motion, pans and adjustments of the camera are carried out in the following way:

.~ 2~ 82~9~

A position controL signal a for predetl~rminin~ the distance between camera and object is transmitted to a motor (a conventional electric motor or a linear motor) being arranged at the rail track 22, and a further position 5 control signal h for predetermining the height of the camera position above the level of the rotatlng stage 24a or the turntable 24b, respectively, is transmitted to a motor~ being provided at the camera tower 60. The signals a and h (even in the case of manual control) effectively are 10 taken into the memory lOl from the evaluating unit lO0.
Finally, the control of the camera mount 64 and the camera 26 is executed by rotating angle control signals ~, ~ and r (corresponding to the rotations of the camera mount about 15 three axes referred to as Ma~ M~ and M~ in Fig. 47), the position control signal N (for the longitudinal adjustment of the camera position in the camera mount, referred to as MN in Fig. 47) which are transmitted to corresponding motors (not shown in the Figures) in the camera mount and 20 the zoom (focus length adjusting) signal f and the focussing signal F which are transmitted to the camera 26 itself. In the case of a central control of the camera mount and the camera even those signals can be brought to the control signal memory lOl immediately from the control 25 unit lO0.
The apparatus is, however, more variably applicable if sensors for the last-mentioned control or adjustment steps, respectively, are provided to sense the current position 30 and adjustment of the camera. Those sensors (not shown in the Figures ) which can be conventional electrical or photooptical position or angle sensors enable the registration of the adjustment parameters even in case of a manual camera control. Such manual control will be ~ ~18~2~
practicised in many pr~ctlcal cases, at least during the production of one or some image sequence(s), e.g. for the preparation of an initial control data set which can be used for later takes or (as explained below) for the image 5 processing.
Position, angle or further adjustment signals - shown in the left part of the Figure as input signals Pi (without specifying their origin) - which have been sensed by means 10 of sensors in the apparatus are transmitted to inputs of a (multi-channel) evaluating unit 109 from where they can be taken into the memory 101 or transmitted to the scaling processor 106. The optional character of this embodiment is expressed by the dotted lines.
The control data evaluating unit 100 specifically can be embodied as fast microcomputer system in a conventional manner, the installed software enabling the execution of the mathematical transformations of the motion coordinates 20 of the motions of camera and object relative to one another (explained in other parts of the specification) during a specific camera travel to be shown and a parallel (quasi multi-channel) processing of a record data set input for preparing the individual control data for those components 25 of the apparatus which have to be controlled to produce a specific image sequence. This means that e.g. following to the input of time dependent path coordinates of a (virtual) relative motion of camera and object and an (also virtual) camera pan an evaluatior of a complete control data set for 30 really carrying out the motions of camera, rotating stage and lighting means will be carried out, and those means are controlled by this data set completely automatically.

-- ~8~g~
As already mentioned above, furthermore, it is possible to use this apparatus to produce images under manual control, to sense the motions or adjustments, respectively, of the components and to store the corresponding data. Lateron, by using these data the recording process can be automatically repeated or optionally the primary data can be scaled and/or processed in another way, and on the basis of the thus obtained secondary data a modified motion can be executed .

Exemplary, a manually controlled take or filming, respectively, of an object on a rc~tating stage 24a can deliver the data for automatically producing an exactly synchronized take of a second (e.g. essentially smaller) object on the turntable 24b and additionally for the superposition or mixing, respectively, of both image sequences with different scales. For this, the control data first are transformed in accordance with the real sizes of the object in the scaling processor 106 for controlling the second taking or filming, and lateron for controlling the mixing process in the image processing unit 102 a second scaling data set can be provided. Of course, in this way plural image sequences - in a completely automatic manner or partly manually controlled - can be produced, stored in the video memories 10 ~ .1 to 104 .n and processed under control using the monitors 103.1 to 103.n.
In a similar manner, by means of the interface 108 a cooperation of the image producing apparatus with the computer graphics ~nit 105 can be brought about which cooperation enables a pre-synchronizing of the image and computer graphics sequences (or vice versa) and an essentially perfect mixing of both without perceptible ~8~30 asynchronism or ~ itter. Even in this process a scaling by means of the scaling processor 106 is possible.
The control data memory 101 is embodied as a random access, 5 multi-channel write-read-memory. In the embodiment according to Fig. 50 it has a direct connection to the scaling unit 106 what opens the poss:Lbility to transform a stored data set independently of the evaluating unit to other~ geometrical relations and to re-store it in its 10 scaled form.
The image processing unit 102 can be a conventional up-to-date studio device which has interfaces for connecting the evaluating unit 100, the computer graphics unit 105 and the scaling unit 106. The unit 106, furthermore, can comprise plural stages of "matte" and "ultimatte"-units what requires that the monitors and recorders or image memories, respectively, are hierarchically connected.
20 The invention is not limited to the above-mentioned preferred embodiment. In the contrary, a number of other embodiments is possible which use the explained solution even in essentially deviating embodiments . E . g . the above-explained functional units especially can be integrated 25 into a processor system and/or specific functional units can be embodied by means of software.
Motion simulation control can be controlled by computer software. Such software has - in an generalizing view -30 essentially the following six functions:
1. The design of the "world" (the locations and scales ofthe components );

`~ 2~ 82~3~

2. The design of the physical move of the camera ( including the velocity);
3. (possibly) The reception of data from a CG software about the "world" and "physical move" designed in a CG
5 environment. (Based on the CG data, visual parts of the "world" can be photographed by the motion control simulator);
4. The translation of a conventional physical move to the "vehicle" based on the location of a chosen point of the 10 "world" ( for the mat~1ematics for the conditions, see attached appendix A);
5. The communication of the "vehicle" data to the motors of the motion simulation control; and 6. (possibly) The communication of the "world" and 15 "vehicle" data to a CG software (based on the "vehicle"
data, visual parts of the "world" can be generated by a CG
so f tware ) .
In the foregoing description, the problem which exists in 20 the construction of computer generated images was discussed. These problems are caused by the complexity of the image of the "world" which comprises an infinite amount of visual information. The principles of the motion control simulator should be applied to the construction of the CG
25 image . The subj ect of mathematical calculations should not be the whole image of the "world". The "world" is divided into small parts which have different X-Y-Z locations (in the same way that a CG screen is divided into small pixels). With the invention, the image of a small part of 30 the "world" is the subj ect for the mathematical calculation. The principles of the above mentioned "vehicle" are applied in these calculations. The location of the CG "camera" in the X axis should be translated to the Y axis, pan and rotation of the part. Superimposed ~ 8~9~

images of the small parts will ~orm the correct and very complex image of the whole "world".

Claims

1. Apparatus for producing an image sequence which especially is suitable for giving an observer the visual impression of an event comprising a time dimension and including at least one object, utilizing photographic or video means, comprising an image taking device for taking a primary image sequence, a motion apparatus comprising a drive unit for moving the image taking device between different taking positions and/or different taking directions during taking the primary image sequence, and a control unit for controlling the motion apparatus and the angle of vision and/or the focus plane of the image taking device, characterized in that object rotating means for changing the angular position of an axis characterizing the spatial position of the object in relation to the taking direction of the image taking device and an evaluating unit the output of which is connected with a control input of the rotating means and an input of the control means and/or a control input of the image taking device are provided, the evaluating unit being arranged such that it transforms a time-dependent space coordinate and space angle relationship which represents a virtual spatial motion of the image taking device in relation to the object into a time dependent plane coordinate and plane angle relationship which represents a motion of the image taking device in a predetermined plane essentially parallel to the rotating axis of the rotating means to be really carried out by the image taking device, and into a time-dependent rotation angle relationship which represents a rotation of the rotating means to be really executed in synchronism with the motion of the image taking device to be really executed, wherein the motion apparatus is arranged or controlled such that it drives the image taking device only in the predetermined plane.

2. Apparatus according to claim 1, characterized in that an image processing unit is provided for superimposing single images of plural primary image sequences which in part or completely have been produced by means of the image taking device or in a synthetic way, especially as computer graphics, for forming a resulting image sequence.

3. Apparatus according to claim 2, characterized in that a control signal memory means being connected through a data input with the output of the evaluating unit being transmitted to the components of the apparatus during the taking of a primary image sequence is provided, the data output of the memory means during the taking of a further primary image sequence being optionally connectable with the control inputs of the components or an input of the evaluating unit or being connectable with an input of the image processing unit during the production of the resulting image sequence from plural primary image sequences such that the control signals are directly or indirectly read out for controlling the further takes and/or the image processing.

4. Apparatus according to one of the preceding claims, characterized in that the evaluating unit comprises an interface for connecting it with a graphics computer for unidirectionally or bidirectionally transferring control data for the apparatus to and/or from this computer for the synchronized production of phototechnically or videotechnically generated and of synthetic image sequences.

5. Apparatus according to one of the preceding claims, characterized in that the evaluting unit and/or the image processing unit comprises a scaling unit for individually adjusting the control signals for the operation of the apparatus for producing several image sequences and/or parameters of the several images to be superimposed and originating from different image sequences, especially for adjusting the relative image size, for rotating the image plane and/or for adjusting a corresponding image-weighing factor.

6. Apparatus according to one of claims 2 to 5, characterized in that the image processing unit comprises means for the later processing of an image sequence being formed by superposition.

7. Apparatus according to one of the preceding claims, characterized in that a single-colored screen forming the background of the taking is provided such that a superposition of images of plural primary image sequences being produced by means of the image taking device in Blue-screen manner can be carried out.

8. Apparatus according to one of the preceding claims, characterized in that a controllable, especially rotatable and/or luminance controllable, lighting means for the object (s) is provided which lighting means comprises a control unit being connected to an output of the evaluating unit.

9. Apparatus according to one of the preceding claims, characterized in that in or on the rotating means further means for translating or additionally rotating an object with respect to the rotating means is provided, the means for translating or additionally rotating comprising a separate drive unit and an input being connected to an output of the evaluating unit.

10. Apparatus according to one of the preceding claims, characterized in that plural rotating means of different size for plural objects of different size are provided, which rotating means are used time-sequentially for taking plural primary image sequences and comprising a control input which is connected to an output of the evaluating unit.

11. Apparatus according to one of the preceding claims, characterized in that the image taking device is a film or video camera and the rotating means is an essentially horizontal rotating stage.

12. Apparatus according to one of the claims 1 to 11, characterized in that the image taking device is a medical imaging device, especially using ultrasound waves, X-rays or corpuscular rays or nuclear or electron spins for the image generation.

13. Apparatus according to one of the preceding claims, characterized in that the motion apparatus comprises a camera support being guided in a horizontal and a vertical track, each of the tracks being straight.

14. Apparatus according to one of the preceding claims, characterized in that the image taking device comprises a support which is rotatable or pivotable, respectively, about three axes.

15. Process for producing an image sequence, which especially is suitable to give an observer the visual impression of an event comprising a time dimension and including at least one real or virtual object, during which process by means of an image producing means a primary image sequence is generated, wherein the physical or virtual angle of vision and optionally the physical or virtual image plane of the image producing means is changed between the image producing steps using a driving means characterized in that the object is physically or virtually rotated about a predetermined axis in relation to the angle of vision of the image producing means, the object being decoupled from its surrounding, and in that a time dependent space coordinate and space angle relationship which represents a virtual spatial motion of the object is transformed into a time dependent plane coordinate and plane angle relationship in a predetermined plane being parallel to the rotational axis of the object between the object and the angle of vision of the image producing means and into a time dependent rotation angle relationship for the object and the image producing means is driven in accordance with those relations.

16. Process according to claim 15, characterized in that single images of plural primary image sequences are superimposed to a resulting image sequence.

17. Process according to claim 15 or 16, characterized in that the superposition of images of plural primary image sequences is carried out in Blue-screen manner.

18. Process according to claim 15 to 17, characterized in that the drive data being used during the production of a primary image sequence are stored and optionally used for the production of a further primary image sequence and/or for the production of the resulting image sequence from plural primary image sequences directly or following a transformation for the image generation.

19. Process according to claim 15 to 18, characterized in that the control data for producing different image sequences, especially for adjusting the relative image size, for rotating the image plane and/or for adjusting an image-weighing factor for primary images for producing a resulting image are scaled and/or weighed.
*****