JPH0154748B2 - - Google Patents

Description

[Detailed description of the invention]

TECHNICAL FIELD OF THE INVENTION The present invention relates generally to computer-controlled video generation devices, and more particularly to computer-controlled video generation devices for analyzing video in real time or near real time by a natural operator or equivalent hardware/software. The present invention relates to a digital video processing apparatus capable of assembling and composing a sequential stream of scenes for display from a library of videos at processing speeds sufficient to provide a processing speed sufficient for processing the images. One example of the many uses of such devices is in the field of vehicle simulation, such as aircraft flight simulation. In such systems, a vision system within an aircraft's flight simulation system receives flight data from a flight simulation computer and terrain data from a database of defined areas or "gaming areas." A data processor within the vision system combines the flight data and terrain data to produce a visual display that simulates the viewer's presence in the cockpit of the aircraft. For example, the vision system of a vehicle simulator for a vehicle such as a helicopter includes "a view through a window of a simulated surrounding situation" and is used to guide the "vehicle" in any desired direction relative to such surrounding situation. Take control. The term "window view" for this device refers to a simulated environment, usually in the form of a video, representing a terrain covering a large area ^, e.g. means display.
This simulated surrounding situation will be referred to herein as a defined area or gaming area. Operation of the vehicle controller directs the vehicle within, around, and through the gaming area. It is the vision system's response to the vehicle controller that then determines what is visible through the window, the video display. What you can see through a "window" is called a field of view (FOV). [Prior art] “Computer-generated imagery” (CGI, i.e.
One conventional device, known as a computer generated imagery device, utilizes a computer device to generate a visual displayable image from a database. In CGI equipment,
The objects and ground surfaces for constructing the imageable scene are extracted from a purely mechanical model stored in the form of points defining the field of view between the objects and the ground surface. The strength of CGI equipment lies in the way it represents the earth's surface. The actual or artificial earth's surface can be measured at designated points (usually the intersections of a uniform grid or grid) to obtain altitude. By connecting the heights of the specimens, the earth's surface can be reconstructed by computer. In addition to realistic representations of the earth's surface, CGI equipment also controls the placement of objects on the earth's surface. Since altitude data is usually given on a uniform grid, the placement of other objects can be specified on the same grid. Typical objects such as trees, rocks, shrubs, houses, roads may have defined positions in the grid system of the database. Accurate illumination and perspective images are also major contributions of CGI equipment. Accurate illumination is achieved by finding the ground normal to each displayed pixel.
This perpendicular line is used to calculate the brightness of a pixel.
Used with line of sight, perpendicular from light source, and ambient brightness. Accurate perspective images are achieved because the distances from the observation point to each point on the earth's surface are known. This distance is an important variable in the conversion to a perspective image. The weakness of this CGI device is its lack of realism. Although an object can be accurately positioned, accurately displayed with illuminance, and a perspective image can be displayed correctly, the object itself cannot be realistically displayed. The current state of the art in displaying objects in CGI devices is such that objects are displayed in a very line drawing manner. Certain scenic elements such as barren terrain, sand and clouds can be displayed more realistically than complex objects such as trees, grass or detailed artifacts. Such complex objects simply lack realism. Another image generating device is "computer synthetic imagery"
i.e. CSI (Computer Synthesized Imagery)
It is called. CSI technology also generates images, such as video-displayable images, from a database, but the objects and ground surfaces stored in that database are not mathematical models of those objects, as in CGI equipment. , is expressed as an image of objects and the earth's surface via electromagnetic media in the real world. Therefore, whereas CGI devices use a computer to generate images from a purely mathematical database, CSI devices use stored real-world images to fit objects into a scene. Use a computer. Although CGI devices provide excellent control over the composition and the scenes to be displayed, the fidelity is low and therefore the scenes displayed lack a sense of realism. CSI devices are the exact opposite. Fidelity is extremely high, but control over the composition of the scene is limited. The strength of CSI equipment lies in the use of real images, such as photographs, in the scene. Currently available video equipment can easily handle photographic data.
Literally thousands of individual photographs can be recorded on a video disc, and their recall can be controlled by a traction device, just as is the case for digital data stored on magnetic discs. Furthermore, video fidelity is assured, and the output image is identical to the input and stored one. The weakness of the CSI device is that its view is limited to the point of view of the "camera". That is, a scene cannot be dynamically moved without using a series of photographs taken from beginning to end. For any gaming area of reasonable size, the number of sequence photographs from beginning to end is prohibitively large. [Summary of the invention] The present invention provides a newly developed CGI device.
A CGSI device can be configured in combination with CSI technology.
Here, the present invention is a CGSI (Computer Generated
It involves combining the best of two technologies, CGI and CSI, to create Synthesized Imagery. Scenes are constructed by placing detailed, high-fidelity (CSI) objects, usually detailed, on a specified ground or background generated by CGI or CSI. The sight of CGSI is
It can be created in much the same way as a CGI scene, with ground elevations and object positions placed on a uniform grid. Individual objects used in the view are adjusted for squint, and location and transformations, including dimensions, positions, rotations, warps, and brightness, are performed for each image as required. The ground surface can be a CGI composition, or it can be a series of CSI ground inlays.
The scene starts from the object farthest from the observation point, i.e. the scene recognition device, and continues to the nearest object.
It is usually constructed by placing objects. CGSI can be constructed from features from any part of the electromagnetic spectrum, including the visible spectrum, IR (infrared) spectrum, MMW (millimeter wave) spectrum, radar spectrum, etc. OBJECTIVES Accordingly, it is an object of the present invention to provide a new and improved computer-controlled video generator that utilizes real world images in a database. [Example] Hereinafter, the present invention will be described in detail with reference to the drawings. Figure 37 shows an aerial view of the battlefield.
The battlefield can be called a gaming area or a defined area, and within practical constraints, approximately 60
Areas covering ~260 km ² (approximately 25 to 100 square miles) are common. For example, if the apparatus of the present invention were to be used to simulate the operation of a helicopter, a simulated gaming area such as that shown in FIG. 37 could be selected as the environment for the helicopter flight. The helicopter simulator's visual system continuously displays a "through-the-window view" of the gaming area. The display is a video representation of the sequence of scenes seen by the pilot within the gaming area, corresponding to the position and altitude of the helicopter relative to the gaming area. The helicopter simulator incorporates a control device for guiding or navigating the helicopter in free flight in any direction within the gaming area, around the gaming area, and through the gaming area. The vision system responds to the controller to determine what is visible within the video displayed "window." Figure 38A shows a scene somewhere within the gaming area of Figure 37, perhaps in the shadow of a grove of trees. The scene appears on a video display that simulates a window in a helicopter simulator training room.
It appeared at a certain time. By successive manipulation of the control device by the trainee, the movements of the helicopter within the gaming area are determined one after another, and the scene displayed on the video display follows each instantaneous position of the helicopter. FIGS. 38A and 38B are actual copies of captured photographs of a displayed video display scene within a gaming area, generated in accordance with the principles of the present invention. Note the realism in the details of the objects, even though the images of the scenes have undergone several processing steps that blur the details. Additionally, the smooth transition from the object to the background indicates that the scene is not expressed in a cartoonish manner. FIG. 1 is a block diagram of the CGSI device. FIGS. 39-47 illustrate the steps in a typical CGSI system configuration, culminating in the special effects unit 12 of FIG. These figures are also photographs of the displayed images. The composition of a CGSI scene usually begins by placing the ground, water, and sky first. After that, place the large object and the small object. A tree as an object,
These include rocks, houses, shrubs, roads, lights, vehicles, helicopters, winged aircraft, animals, and women. Finally, you can add special effects if you wish, such as smoke, dust, clouds, shadows, etc.
To show how the CGSI equipment works,
Assembly of the illustrated scene will now be described with reference to FIGS. 39 to 47. Starting from FIG. 39, the sky is segmented and added to the background at a certain distance. By segmenting the sky, crests and valleys can form horizons like those shown in these figures. In this example, the sky is divided into five parts. In general, the lower edges of the segments need not be straight, but can be curved or jagged to simulate rolling hills, steep hills, or mountains. A detailed explanation of how the individual sections are warped based on the elevation angles and observation points based on the lowest and highest data will be provided later. In FIG. 40, a rough ground surface is added as a segment to form the foreground or the foothills of the mountain. The untouched area between the mountains and the sky appears as mountains in the distant background. The stored texture is then warped and added to the scene to fit the screen coordinates of the surface polygon. The brightness of each surface can be varied depending on distance and other desired parameters. Figure 41 shows the planned road section. For that road portion, the road representation in the database's surface library is warped to fit the screen coordinates. The library of surfaces can include various road surfaces and other specialized surfaces such as streams and ponds. Figure 42 shows a relatively small two-dimensional 2D
This is an example of an object. Those objects occupy less than a predetermined percentage of the total screen. In one embodiment, objects occupying less than 1/16 of the area of the scene are represented in two dimensions, 2D. This is because, in many applications, relatively small natural objects such as trees, bushes, and rocks can be represented from one side, i.e. as two-dimensional objects, with little loss of realism. . Objects that cannot be represented from one side, such as large buildings or objects of special interest such as tanks, ships, etc., are called three-dimensional 3D objects and are represented as such. Relatively small two-dimensional 2D objects can be processed with less expensive processing hardware and software than that required to process three-dimensional 3D objects and ground surfaces. When a two-dimensional 2D object, while flying through a scene, comes to occupy more than a preselected percentage of the area of the scene, it can be transferred to three-dimensional 3D processing. FIG. 43 shows a tank as a multi-view three-dimensional 3D object. A multi-view of the tank is stored and the appropriate screen is used to compose the scene based on the tank's path, altitude and observer viewpoint. The tank may be mobile and may be very large. FIG. 44 shows a house, which is an example of a multi-surface or three-dimensional 3D building. The house has several surface parts and several roof parts (one if both sides are the same).
(1), two ends, and two sides. The individual surfaces of the house can be formed by twisting the perspective images, directed by the screen coordinates, from the normalized screen, which are then stitched together. Figure 45 shows a large two-dimensional 2D object. Those objects can occupy more than a predetermined amount of the area of the scene. If necessary, the objects can be inflated to make them larger than the entire surface of the screen. Figure 46 illustrates special effects techniques used for translucent media including clouds, dust, smoke, and shadows. A mask controls the transparency function, and another input word controls the brightness and color. Figure 47 shows the view from the complete CGSI device. The scene appears somewhere in the gaming area shown in FIG. Reference is now made to the block diagram of FIG. Each item, from the database structure of the block diagram to the incorporation of special effects, will be briefly explained below, and will be explained in detail later. A: Brief Description of Items in the Block Diagram of FIG. 1 <Database Structure> The database contains two very different types of data: a library of objects and other items, and gaming area data. Library hardware 202a-202c generates features and stores the features on optical disks with high fidelity. The gaming area data hardware 203 is used to load the locations of objects, surfaces, and special effects. The library's flexibility is almost limitless.
Library hardware 202a to 202c
can include an image of the object, an image of the ground surface, and a special effect transmission mask. They can be represented by one of a number of electromagnetic radiation spectrum bands. This allows simulation of input/output based not only on the visible range but also on detected IR (infrared) spectrum, MMW (millimeter wave) spectrum, radar spectrum, etc. The library can also contain a mixture of two-dimensional 2D images and three-dimensional 3D images. These images can represent day and night conditions and daily conditions. Libraries of visible objects usually include photographs. When constructing a high-fidelity object from a library of objects, objects stored in the library of objects 202a-202c, such as individual real-world elements, highly accurate models, paintings, and photographs, are recalled. Forming a "nearly perfect" image. It restores edges, separates objects from the background, corrects brightness and color, generates realistic colors, positions objects from system reference points, and generates high-fidelity CGI objects. This is done by generating graphic data, ie, a light source. A landing point and altitude reference point are also added. "Near perfect" objects, terrain and special effects are stored on media that is fast accessible and has high data rates. "Close to perfect"
The term means high fidelity regarding the quality of the input video. The gaming area data provides the information necessary to place the contents of a library of objects, ground surfaces, and special effects onto a grid or gaming area. If the object can be placed by the operator,
It can also be placed randomly by the computer. Objects in the library can be kept stationary or moved. The output of this function determines the content of the scene. <Vehicle simulation calculation> The calculation by the vehicle simulation device 206 is based on a mathematical model of the vehicle and control input.
Determine the location and viewing direction of the primary vehicle visual or sensor device. Furthermore, calculations can be performed for secondary vehicles based on the vehicle model and the selected route. This output determines the observer's location. <Communication subsystem> Of course, the input/output of the vehicle simulation device 206, that is, the I/O, and the I/O of the CGSI device
O must interface in an efficient manner. Communications subsystem 208 can be a bidirectional link and buffer that interfaces two devices. <Field of View (FOV) and Coordinate Transformation Calculations> The field of view (FOV) processor 210 determines the presence of objects, ground surfaces, and special effects in the scene being constructed. The output of the transformation matrix (V) transforms real world coordinates to screen coordinates. This data from the transformation matrix allows rapid testing to determine whether any part of an object, ground surface, or special effect is present in the scene. To avoid testing the presence or absence of every object in the database, a "smart" algorithm can test only objects and surfaces that are close to the scene. The field of view (FOV) processor 210 maintains a list of objects within the field of view (FOV) and a list of channel assignments for those objects, ground surfaces, or special effects. The function of the field of view (FOV) processor 201 is to determine what the observer can see. Object, Surface, and Special Effects Controllers The controllers 212a-212c "fan out" and process control functions generated during field of view (FOV) calculations. Processed control functions are object, ground surface, and special effect processing channels 21
4a to 214c. Control device 212a~
The main functions performed by 212c are converting gaming area coordinates to screen coordinates, processing distance data from the operator-controlled vehicle to each object within the field of view (FOV), and identifying distances and objects. Libraries 202a to 2 determine the brightness of each object based on the image data and search for correct video data.
02c. Control device 212a
The function of ~212c is to "fan out" the field of view (FOV) data and generate precision control data for the sight. <Library of objects, ground surface, and special effects> The libraries 202a to 202c store images used for composing scenes. Control device 21
2a-212c are processing channels 214a-2
14c to select the video to be sent. The only function of libraries 202a-202c is to store video and provide the correct video on command. Object, Surface, and Special Effects Processing Channels Individual processing channels 214a-214c or "pipeline processors" typically process one large item (object, surface, or special effects) at a time per channel. Processing channel 21
4a-214c may have the ability to process multiple smaller items in parallel. All processing channels operate in the same manner for each such item. This is because the functionality of the channel is specified by the nature of the item. In one embodiment, each processing channel modifies one large item or 16 small items from the library with transformations specified by the control function. That is, processing channels for objects, surfaces, or special effects can modify images stored in normal eye-front projection by changing their position, dimensions, rotation, and twisting. ,
Modify based on scene coordinates. The brightness of the image can be changed based on distance and object type. The function of these parallel pipeline processing channels is then to modify each object, ground surface, and special effect used in a given scene as required. Scene Construction The scene construction module 216 takes the individual images from each processing channel, separates the images from the background, and assembles the scene based on distance.
In this way, closer objects obscure more distant objects. The high frequency parts generated by constructing a scene from individual images can be smoothed by a Gaussian function. This action matches the edge and internal frequencies. The scene construction module receives distance information from two objects and a ground control device. The distance is
Used to determine whether a particular object is in front of or behind other objects in the scene. A particular object pixel is displayed if it is the closest pixel in the scene. This is called "recently occupied" processing. The scene composition function is the field of view (FOV) processing device 2.
It receives video input from each video channel and background level source determined by 10. The output in this function can be a real-time video signal to a special effects module. The function of digital scene composition has the following sub-functions. 1) combination of object processing channels; 2) scene value adjustment for overall scene brightness modification; 3) smoothing to compensate for object-to-object boundaries and object-to-background boundaries. <Special Effects> A translucent special effect can be added after the scene occurs. The special effect inset module 12 adds special effects based on distance. Special effects such as smoke or dust can be generated before or after the image in the scene. A luminance mask stored in the library and processed in the special effects processing channel controls the transmittance of the special effects. Brightness value input controls the brightness and color of special effects like black smoke and white clouds. B: Detailed explanation of various items in the block diagram of Figure 1 <Database> The database hardware is similar to the database itself, and the library hardware 2.
It can be separated into two subsystems: 02a to 202c and gaming area data hardware 203. Library hardware 202a-2
02c can generate features in high fidelity and store them on optical disks. Gaming area data hardware 203 is used to load locations for objects, ground surfaces, special effects, etc.
Thus, the database hardware is the first
As shown in block 201 of the figure, it operates in non-real time to produce high quality video on a controlled background. The images are sent to an optical disk and stored there. Library hardware 202a-202
c consists of a disk controller, a disk drive mechanism, a signal conditioning module, and an optical disk. Either video (analog) disks or digital disks can be used for video storage.
Video discs are approximately 6 to 8 bits, or 64 to 8 bits.
Produces 256 gradations. Digital disks can provide up to 12 bits of data. In all cases (with the exception of very high resolution sensor images), industrial 525 line non-contact video disks produce images of adequate fidelity. The use of video discs is well known. The image is scanned in successive lines. It actually constitutes a column scan of the frame, as will be explained later. This is because it is usually more efficient to start the warping process described here by processing the columns in the first pass of the video disc output, which will be described later. From this point of view, it was possible to store the footage on a video disk with a 90 degree offset orientation so that the output of the disk was actually in the form of columns to facilitate processing the columns in the first pass. Very desirable. Of course, if for some reason it is desirable to store frames on a video disk in their normal or portrait orientation, they can easily do so. That is, a pre-processing device can be provided which directs the data in the buffer appropriately to the processing channels in order to match the processing characteristics of the twisting sequence used. While those skilled in the art will be able to think of other devices that can be combined with optical disks, the CGSI concept has been found to work very well and is neither particularly difficult nor particularly expensive to implement. not. Video discs have the following advantages: a) High-density recording: Approximately 54,000 frames per side of a 12-inch disk. b) Data recording costs are relatively low. c) Superior Random Access Performance: With certain improvements, industrial disks can easily jump plus or minus 50 to 100 frames every 60 cycle field times or 16 2/3 milliseconds. The actual jump occurs during the blanking period, so no image data is lost. d) High data rate: Produces data at video speed. e) Long life and data security: The disks are contactless and read-only, so data cannot be corrupted by head collisions or operator errors. f) Easy to reproduce. A block diagram of the non-real time database hardware is shown in FIG. In this device, the edges are restored, the background is separated from the object,
Brightness and color are corrected, realistic colors are generated, objects are positioned relative to system reference points, non-real time high fidelity CGI objects are generated, and graphical data (light sources) are generated. Ru. <Database...Gaming Area Data> The gaming area includes reference points for determining the locations of the ground surface, objects, and special effects. The gaming area can be set up in one of two ways: manual mode or automatic mode. In manual mode, the operator searches a library of objects and selects which objects to place within the gaming area. Object files include individual objects such as bushes, trees, ground, mountains, roads, lakes, or groups of small objects on one file. To place a two-dimensional 2D object within the gaming area, the operator selects an X, Y, Z ground reference point within the gaming area space. Incidentally, X, Y, and Z represent the horizontal axis, vertical axis, and distance axis, respectively. A second X, Y, Z reference point determines the height and position. Therefore, assuming the object is upright in its true vertical position, the X and Z references remain constant and the Y reference changes by the height of the object. When the object is tilted in one of those axes, at least one of the X and Z axis reference points changes. The earth's surface can be defined by four X, Y, and Z reference points corresponding to its four corners, respectively. This includes, for example, the sides of houses, lakes, roads, rivers, etc. 1 in each of the azimuth and elevation angles to represent details very accurately.
A three-dimensional multi-view object can be stored in a series of images representing increments of degrees. They have three reference points (i.e. a central landing point,
It can be determined by the height of the center and the direction vector (pointing vector). Automatic mode operates in much the same way as manual mode. A computer processes and controls objects. This will be explained later. Objects are placed according to type and density. <Database...Library> The library contains videos. These images can be categorized into three basic types: objects, surfaces, and special effects. In the case of objects and the ground surface, objects on solid surfaces can be further classified into two-dimensional, three-dimensional uniaxial, three-dimensional biaxial, and light sources. A method for recording objects and the ground surface on an optical disk with almost perfect high fidelity is shown in FIGS. 4 and 5. These figures will be explained in detail below. <Objects...Two-dimensional> As mentioned above, most objects found in the natural world, such as rocks, trees, bushes, and low trees, can be represented two-dimensionally with a sufficient sense of reality. A photograph of the object is taken at the average aspect angle used in the desired simulation. As altitude changes, objects are translated between reference points, becoming higher or lower depending on the viewing angle. In the case of trees and bushes, the surface of the object remains perpendicular to the observer throughout the flight path, but experience has shown that this is not noticeable. The relationship of an object to other objects and its dimensions and changes in dimensions, as well as the rate at which that relationship changes, indicates depth. For two-dimensional objects, a single photograph can be stored in a track on an optical disk and manipulated by twisting operations to obtain the appropriate rotation, dimensions and position. <Object...3-dimensional, uniaxial> When an object is flyovered, the visual angle of the object changes by 90 degrees. In this case, the simulation may require an additional series of photographs around the vertical axis. <Object...three dimensions and two axes> A three-dimensional, two-axis object, that is, a surface, can be handled using three different methods. The first is to store a series of photographs in small increments of 1 degree in both azimuth and elevation. This is a powerful representation technique and works extremely well when objects have details that require high surface fidelity. Precise incremental photographs can be obtained by rotating models of large objects, such as helicopters, tanks, or houses, on two highly precise rotating tables and photographing the object at each setting. A second method of generating three-dimensional objects is by dividing the object into smaller surfaces, such as the house shown in FIG. A house such as the one shown in this figure can be seen in various perspective views in a series of scenes on a video display, but cannot be combined into an image of the entire object without the use of a computer. The sides are separated and assembled using screw bending techniques. In this way, many objects can be constructed from a few photographs and approximate dimensions. The third method, which can be applied to large objects such as hills, is to move the object at a series of 30
It involves taking photographs from all directions at relatively large intervals such as degree intervals. For example, one altitude, typically 15 degrees, can be used for most simulations, and a series of photographs taken every 30 degrees around the object has been found to be adequate. <Object...Light Source> The light source is aligned from a series of points stored in memory, and the warping algorithm warps the normal screen to what it would look like from the vehicle. This method works very well and has been used to create demonstration landing tapes. <Special Effects> Regarding special effects, creating smoke, fog, shadows, dust, and haze on translucent objects or images can add more realism to the scene. These objects can be stored as masks that determine their contour, shape, and transmittance. Masks determine the balance of the combination of objects and special effects. Other variables control the brightness or color of the special effect. The mask has special effects and
Determine the combination ratio with the background while the variable control is fixed. This technique can be used, for example, to generate dust that is kicked up after a moving tank. A twisting operation involves a series of sequential frames used to create movement;
Special effects can also be added to distort. Therefore, a translucent object can be either stationary or moving. Special effects objects are defined in terms of transmission masks in a library of objects. This means that the data in the object library determines the percentage of display of background objects and the percentage of display of special effects by the following equations. Pixel value (gray level) = (1 - mask) x {background (gray level) + (mask) x (special effect value) - (gray value)} The special effect value determines the shade of gray of the special effect.
This is shown in FIG. Masks for static special effects can be easily drawn using a gray marker on a blank sheet of paper. In this way, many common or special clouds, dust, smoke, haze and fog can be easily drawn even by an inexperienced person. Special effects objects are typically processed as two-dimensional 2D objects. Mask combinations can be stored in a library. Four types of special effects are realized as follows. --1 Moving smoke Smoke masks, which determine the outline and transmittance, are generated by engineers based on photographs and mathematical characteristics of the smoke. The top and bottom must be in the same location and must be the same width as shown in Figure 48A. A series of frames (probably 480 frames) are then generated. Each pixel can be incremented by one or more pixels in the Y axis as the frame is played back to create a continuous circular loop. This is B in Figure 48.
Shown below. Next, shave off the top of the smoke in each frame (C in Figure 48) to resemble the smoke dispersing into the atmosphere. Record the frames sequentially on a video disk as shown in Figure 48C, inflate the top to simulate diffusion, crop the image to match wind speed, size the cloud based on distance, and Use the twist function within the special effects processing channel to position the image within the scene. The first condition parameter sets the cloud color or brightness. The playback speed of the smoke determines how fast it flows. --2 Moving dust For example, you can make 5 to 10 dust-transmitting masks. Various masks (1-2, 1-
3,...1-10,...9-10) a series of frames are generated by a series of linear interpolations. Those frames are recorded on a video disc. A contortion function within the special effects processing channel places the mask in the correct perspective, defines its dimensions and position within the scene, and determines its color and brightness according to the initial setup conditions. This is shown in FIG. --3 Yin Yin is treated as a translucent object similar to dust and smoke. A transmission mask for the shadows is generated from the screen in the library. A transmission mask, a shadow, can be created by setting all pixels in an object to one gray level, which determines the transmission of the shadow. In the gaming area, four reference points of the object are projected onto the ground.
The new point on the ground is the shadow reference point. The shadow, transmission mask is twisted to fit the scene based on the shadow reference point. This step is the seventh
As shown in the figure. ---4 Sparkle and sparkle Normally, shine and sparkle are normal data on the surface. However, in a CGSI device, surface normal data is not available unless the object is generated from the nodal data of the CGI device. To produce shine and shimmer, as shown in Table 1 below in conjunction with Figure 8,

【table】

Claims (1)

[Scope of Claims] 1. A computer-controlled video generation device that responds to the position and orientation of scene recognition means: It is equipped with a library containing a large number of two-dimensional video frames representing images in the electromagnetic spectrum band, a database comprising data on a predetermined region expressed in an axial coordinate system, including scene synthesis data that defines a location and a dimension occupied by each of the video frames in the coordinate system; : a simulation device for supplying observation data for determining the location and field of view of the scene recognition means with respect to the coordinate system of the defined area; an interface device for receiving the observation data; determining which of the video frames are included in the field of view and the distance to each of those video frames based on the observation data and the scene composite data; a view processing device comprising means for calculating coordinates in the output scene for each corner of each video frame included in the coordinate system of the defined region; That is, the control device receives data including the identification of the video frame included in the field of view, the distance up to that point, and the coordinates of each corner of the video frame, a control device also connected to a library; a processing channel means controlled by the control device, the library of the database being connected between the control device and included in the field of view; processing channel means for mapping said video frame into an enclosed space defined by the coordinates of each corresponding corner; said image connected to said processing channel means and included in said field of view closest to said scene recognition means; The output scene is digitally based on the distance of the video frames contained in the field of view, such that the frames include the more distant video frames of the video frames contained in the field of view. A computer-controlled video generating device comprising a scene composing device to be assembled.