JPS5931707B2 - How to display pattern occurrence - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention relates to a method for displaying pattern generation, on the ground surface, in space,
Image display of two-dimensional or three-dimensional visual objects from objects that move and move in any three-dimensional area (hereinafter referred to as moving objects), regardless of whether they are underwater, to the viewer on a display screen set in three-dimensional space. This invention relates to a method of generating and displaying patterns to give an observer a visual sensation as if he were directly observing a visual object.

More specifically, a method for generating and displaying a pattern is applied to a simulator device for an aircraft or the like to provide a visual display to a trainee so that the trainee can perform simulated training of aircraft operation while feeling a visual object within the trainee's vision. , which generates a pattern on a display screen in perspective based on the memory and arithmetic operations of digital electronic circuitry. Conventionally, this type of pattern generation and display method has been applied to automobile driving simulators.

However, there are many restrictions on the relative position, orientation, and attitude between the visual object and the vehicle body, and it cannot be applied to a simulator that takes various motion and movement modes, such as an aircraft. On the other hand, an extremely complicated system designed to expand the range of applications has the disadvantage of being too large and expensive when constructed into a device.

An object of the present invention is to eliminate constraints on the relative position of a visual object and a moving object, as well as orientation and posture with respect to the visual object, and to relate to constraints on the visual object environment, the relative movement of the moving object with respect to the visual object environment, and the motion area. The purpose of the present invention is to provide a method for generating and displaying patterns that can eliminate restrictions, have high versatility, and can be made into a small and inexpensive device, and is also applicable to simulator devices related to moving objects that perform complex movements and motions, such as aircraft. This makes it possible to realize a display device that generates a pattern that can be generated.

According to the present invention, there is provided a method for generating and displaying a pattern that causes an observer of the display screen to visually perceive a visual object having a two-dimensional or three-dimensional shape by generating and displaying a pattern on a display screen provided in a three-dimensional space. In this step, the position of a point on each limbal line of the visual object observed in a three-dimensional space is stored in advance in a storage means as a coordinate position from a fixed reference point in the three-dimensional space, and then A linear linear equation regarding the coordinate axes provided on the display screen for a straight line on the display screen corresponding to each limbal line of the visual object to be observed is calculated by an electronic arithmetic circuit based on the coordinate values stored in the storage means. Then, the pattern surface on the display screen corresponding to the surface surrounded by each limbal line of the visual object is determined by each straight line defined by each linear equation calculated and determined above. It is logically determined by an electronic arithmetic circuit as a display area on the display screen that is all coincidentally designated by one side, and at this time, each of the linear straight lines is For the straight line for which the sign change of the coefficient in the equation is calculated, the visual object caused by the change in the viewpoint of the observer can be obtained by changing the specified area on the display screen from one side to the other side. The color and brightness of the designated display area on the screen calculated and determined in advance are stored in a memory circuit, and the changes in the visibility range of objects are calculated and determined each time the specified display area on the display screen changes. The method is characterized in that a pattern is formed on the display screen via a color/brightness generation circuit.

Furthermore, according to the present invention, in addition to the above-mentioned feature points, when the same area is simultaneously designated for different sides of the visual object in the specified display area on the display screen calculated as above, the visual object The overall display priority is determined by adding, in a logic circuit, the unique display priority stored in advance in the storage means for each surface and the variable display priority for each surface that changes in response to changes in the observer's viewpoint. Then, the overall display priority of each of the different surfaces is compared and calculated using a logic circuit to determine the surface with the highest display priority, and the surface with the highest display priority is determined in advance. It is characterized in that the specified area on the display screen, which has been calculated and determined as described above, is made into a pattern via a color/brightness generation circuit based on the color and brightness stored in the memory circuit.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The basic principle of the method of the present invention and embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Now, Fig. 1a is a plan diagram of a visual object (scene) that is intended to be generated and displayed as a pattern, and Fig. 1b is a plan diagram of a visual object (scene) that is intended to be generated and displayed as a pattern on a virtual display screen. It is a figure explaining the principle of a case.

That is, for example, suppose that an aircraft is flying close to an airfield, and if the visual field seen through the pilot's front window in Figure 1 a is patterned on a virtual screen, the pattern will be as shown in Figure 1 b. The pilot will see a pattern.

Of course, the aircraft changes its position, altitude, orientation, and attitude while maintaining all degrees of freedom, so the shape of the visual object of the airfield patterned on the screen is the same as that from the pilot's viewpoint E. It changes depending on the position, altitude, direction and attitude of the aircraft. In this case, all visual objects, whether planar or three-dimensional, can be divided into planes as shown in FIGS. 2a and 2b at the planning stage of pattern generation.

and generating a pattern on the virtual screen by deforming the shape of each surface of the visual object according to changes in relative position, direction, and attitude from the operator's viewpoint E,
When an observer views this from viewpoint E as a virtual driver's field of view, the pattern gives the viewer the feeling of looking directly at the visual object. Here, if we take surface 1 in Figure 2a as an example, this surface 1 is defined by the area surrounded by straight lines Ll, L2, L3, 5, and L4 as shown in Figure 3a, and the straight line L1 is , the two points AL through which it passes,,
If BLl is specified, the straight line SLl projected on the screen shown in Fig. 3b is obtained, and if the straight lines SL2, SL3, and SL4 are similarly obtained for the straight lines L2, L3, and L4, surface 1 is placed on the screen as surface v. It can be projected as

Therefore, if all visual objects are divided and represented on each plane as illustrated in Figure 2 a and b, all visual objects can be displayed on the screen from any two points on the limbal line of each plane. Can be reproduced as a pattern. Therefore, in the method of the present invention, the visual object is composed of one or many planes, and the distance from the model reference point M to the point on the limbal line is stored in electronic storage means as basic data in advance, as shown in FIG. 3a. The shape of the visual object is determined from these basic data. Taking surface 1 in Figures 2a and 3a as an example again, in order to project surface 1 onto the screen, as shown in Figure 3b, from the viewpoint to points ALl and BLl on the limbal line, For this purpose, add the distance from the viewpoint E to the model reference point M to the distance from the model reference point M to the points ALl and BLl, and then calculate the distance from the viewpoint E.
The position coordinates of the above points ALl and BLl are determined with the origin of coordinates as the coordinate origin. However, as is clear from Equation (5) described later, the position of each point AL, BL, does not need to be an absolute distance, and in fact, it is a three-dimensional It is only necessary to determine a certain proportional relationship between the distances.

Therefore, the means for determining the position coordinates of the above-mentioned points can be constituted by an electronic circuit as shown in FIG. M1, a buffer memory B1 for the distance from the viewpoint E to the model reference point M, and a shifter circuit that is a combination of an adder and a shift register that adds these to calculate the distance of each point with the viewpoint E as the coordinate origin. Each point on the limbal line is stored in the buffer memory B3 as a relative point distance from the viewpoint E. Now, if the coordinate origin is the viewpoint E of a moving object, for example the pilot of an aircraft, as shown in Figure 4a, the position of any point A (X, y, z) will be determined by the change in viewpoint E due to the movement of the aircraft. The apparent point N(x″, Yl, z
’).

This can be expressed numerically as follows.

φ in the above equations (l), (2), (3) and (4)
, θ, and ψ are the bank angle, pitch angle, and heading angle of the aircraft, respectively.

Therefore, any point A on the straight line to define the above-mentioned surface,
For B, points A' and B' after coordinate changes due to the movement of the aircraft are determined using equation (l). Taking into consideration this apparent coordinate movement, if the virtual screen is a plane perpendicular to the Y-axis and a distance l in front of the viewpoint E as shown in Figures 4B and 4C, the straight line A', A linear equation when B' is projected onto the virtual screen can be expressed by equation (5). However, Xs and ys are coordinate axes provided on the virtual screen. The area surrounded by the straight lines projected onto these virtual screens is defined as a surface area.

In order to define a surface on the display screen in consideration of changes in the viewpoint due to the movement of the aircraft, an area of the display screen surface specified by a straight line on the virtual screen is given in advance. For example, straight lines L, , L2, L3, surrounding surface 1 in Figure 3a,
For L4, if you specify the area in the electronic circuit in advance as shown in Figure 5a, the straight lines SLI, SL2, SL3 on each virtual screen as shown in Figure 5B, c, d, and e.
, SL4 can be defined as a surface 1' as shown in FIG. 5f.

Expressing equation (5) using the coefficients of K, , K2 and K3, (
6), and by converting the above equation again, we get the general linear equation (8)
Find the formula.

The point P that satisfies equation (8) is the straight line SL shown in Figure 6a.
It means that it is on N. Now, let P' be a point moved by ΔXs in the Xs direction from point P as shown in Figure 6b.
x- at point P' can be expressed as in equation (9).

However, ΔXs>O Therefore, when the fortune of equation (9) is introduced into equation (8), it becomes.

If w is calculated again from equations (8) and (9), the Qυ equation is obtained.

Now, if K,>o, the positive region of w in equation 01) is to the right of the straight line SL, with respect to a certain arbitrary Ys, due to the straight line SLl on the virtual screen as shown in Figure 6c, It can be seen that the negative region is in the opposite direction.

It is clear from equation (self) that this relationship does not change unless the sign of K1 changes.

Also, which straight line SLN on the virtual screen (not shown)
Needless to say, there is a similar relationship to that described above. This means that with respect to the straight line SLl on the virtual screen of the straight line L1 in FIG. The code of formula (self) is from Figure 6 d to Figure 6 e.
When the change is from positive to negative or from negative to positive (from Figure 6 g to Figure 6 h), if the area defined by surface 11 by SLl is reversed, the position and orientation of surface 1 and viewpoint E can be determined. This means that surface 1'' can be defined without contradiction no matter how the surface and posture change. Therefore, for all straight lines LN to define surface 1, the direction in which the surface is given on the display screen is determined in advance. It is sufficient to set this in the memory means, and then reverse the Xs direction of the surface definition when the sign given by K1 in equation (7) of each virtual screen straight line SLN changes.

The above explanation relates to the definition of the surface in the X8 axis direction when the screen coordinate axis Ys is the reference, but when X8 is the reference, the surface is defined in the Ys axis direction using K3 in equation (7). Just define it.

Also, the surfaces that can be defined by this method are polygonal surfaces of various shapes, and any polygonal surface can be generated, excluding those in which one interior angle within the surface is 180 or more. Furthermore, if the visual object has a curved surface, a method is adopted in which the curved surface is divided into a number of planes in the pattern generation planning stage and a pattern is generated on the display screen for each of these divided planes. It is something. As described above, if the relationship between the visual object in the three-dimensional space and the viewpoint E is processed by a combination of electronic circuits according to the formulas (1) to (self), the visual object will appear on the actual display screen. A pattern corresponding to the object can be generated and displayed.

The electronic circuit in FIG. 7a calculates the limbal line LN according to equations (1) to (7) from the orientation and attitude of the viewpoint E with respect to the model reference point M and the position data of the points on the limbal line in the buffer memory B3.
The coefficients Kl, K2, and K3 of the projection straight line SLN on the virtual screen are calculated, and these are stored in the buffer memory B4.

The arithmetic circuit A3 in FIG. 7a consists of a combination of a multiplier and an adder. FIG. 7b shows the pattern plane from the projection straight line SLN according to equations (8) to (self),
For example, showing the combination of electronic circuits defining the aforementioned plane 1',
The arithmetic circuit A4 is an electronic circuit that calculates a projection straight line SLN from a combination of a multiplier, a divider, and an adder when a virtual screen is displayed on a display screen of a concrete display device from the contents of the buffer memory B4. 1
From the data supply device to the display device of the device shown in Figure 1 is the viewpoint E.
If data (position data, size data, etc.) indicating that the object is placed not only directly in front of the viewpoint E but also obliquely or laterally in front of the viewpoint E is sent to the arithmetic circuit A4. , it is possible to determine the projection straight lines that define the pattern plane on the display screen of these latter display devices.
The results obtained in this manner are stored in the buffer memory B5. Note that the arithmetic logic circuit A5 in FIG. 7b is an electronic circuit that synchronizes with the scanning display device, and finally specifies the area of the surface by the projection straight line SLN using the K of the buffer memory B4.
1, and the result is stored in the buffer memory B6. A vertical counter Vs and a horizontal counter Hs give the position that the display is displaying at a given time. Therefore, as illustrated in FIGS. 6-h, the contents of the buffer memory B6 indicate the logic as to whether or not the surface specified by the limbal line exists at the location scanned by the display device. Figure 7c
By combining the contents of the buffer memory B6 according to the combination of limbal lines constituting the surfaces of the visual object using an electronic circuit, the logical output F, ~
FN is required. Now, according to FIG. 2a, only the other surfaces on the runway surface 1, that is, surface 2, surface 3, surface 4, surface 5, surface 6, and surface 7, can see surface 1. Can not.

Also, from Figure 1a, depending on the positional relationship between the airport and the pilot, buildings may block runway surface 1 and surface 2, surface 3, surface 4, surface 5, surface 6, and surface 7 of the road markings. However, the opposite is not possible. In other words, each aspect can be said to have its own priority with respect to the other aspects.

On the other hand, taking FIG. 2b as an example, the surface 11 of the building is visible to the operator, but the surface 16 is on the back side and is not visible.

That is, a surface has directions that are visible from a certain viewpoint E and directions that are not visible. In such a relationship, it can be considered that the surface visible from a certain viewpoint E has a higher priority than the invisible surface.
This priority order changes depending on changes in the viewpoint E, so it can be considered as a variable priority order. Therefore, each plane has a certain viewpoint E
It can be assumed that there is a total priority that is a combination of a unique priority and a variable priority that changes depending on whether the object is visible or invisible. Now, according to the method described above, FIG. 8A,
When planes A and B of b are patterned on a screen, they overlap in some parts as shown in FIG. 8c.

If surface A has a higher overall priority than surface B, a part of surface B is hidden by surface A, and surface A can be displayed preferentially, as shown in FIG. 8d.

As shown in Figure 9a, a normal vector N is set in the visible direction for any surface, and the angle between it and the viewpoint E is α.If 1α1 is greater than π/2, it is given the lowest priority. Surfaces can be made invisible.

On the other hand, if lα1 is less than π/2, the priority is determined to be unique to that surface, and the following priority selection logic ensures that only one surface is specified at a certain point on the screen according to the priority. be. Therefore, surfaces A and B in FIG. 8c become as shown in FIG. 8d. The electronic circuit shown in FIG. 9b is a circuit for selecting the overall priority order mentioned above,
A normal vector in the visible direction of each divided surface of the visual object is given in advance to , and the visible or invisible logic is determined using the contents of the buffer memory B3 and the arithmetic logic circuit A3.

Now, let the visible direction normal components of the surface be XK, yNZN, and the distance from the viewpoint of a certain point on the surface to buffer memory B3 to X. If B, yOB, and ZOB are used to obtain equation A2), the logic of visibility and invisibility can be determined from equation A3). It is determined here.

If we take the AND logic of this visible/invisible logic and the logic outputs F1 to FN of the planes of the logic circuit A6 and combine this output with a priority determination logic circuit that determines plane-specific priorities, we can obtain the result shown in FIG. It can be displayed as shown in d.

As shown in FIG. 10, since the display device displays a certain location while scanning, the outputs FV1 to YN of this priority order determining logic circuit change their logic states in the order of scanning.

In order to display the final designated surface area on the screen in this way on a color display device, specific color information for each surface is given to the electronic memory means in advance, and the color display device displays the surface area. If it is displayed, it is sufficient to express the specified color for that surface. Fig. 10 uses a home TV as a color display device, and Fig. 8 d
This shows the display method when displaying. 11th
The figure is a system diagram combining electronic circuitry to implement the method according to the invention.

The simulator computer stores the distance content 1 from the viewpoint E to the model reference point M in the buffer memory 1B1, and the attitude content 2 from the viewpoint E with respect to the model reference point M in the buffer memory 1B2. The shape of the visual object is given as a point on the limbus line of the surface, and the distance from the model reference point M to each point is stored in the memory M1.

Contents 4 of buffer memory B1 and contents 3 of memory M1
is added and stored in buffer memory B3 as relative distance content from the viewpoint using a shifter circuit.

The arithmetic circuit A3 calculates the limbal line of the surface of the visual object from the viewpoint attitude of the buffer memory B2 and the contents of the buffer memory B3, and calculates the coefficient Kl in the linear linear equation of the line on the screen.
, K2, K3, and stores the obtained results in buffer memory B4.

When a specific display device is used, the contents of this buffer memory B4 include the arithmetic circuit A4 and the display device DATA1.
2 and stored in the buffer memory B5 again.

The arithmetic logic circuit A5 is a circuit that determines the area of the pattern surface on the display screen based on the projection straight line data 14 and the display position of the scanning display device, and is a circuit that determines the area of the pattern surface on the display screen from the projection straight line data 14 and the display position of the scanning display device.
Alternatively, in combination with the K3 data 11, all movements of the viewpoint E can be freely performed.

This surface area information of the projection straight line is temporarily stored in the buffer memory B6, and combined with the necessary surface area information of the limbal line.
A pattern surface is defined by logic circuit A6.

On the other hand, the visible surface normal component is stored in the memory M2, and the contents of the buffer memory B3 and the output 2 of the memory M2 are stored in the memory M2.
0 is processed to obtain visible/invisible logic 21, which is combined with the aforementioned logic output 23 to determine the overall priority of the pattern surface, and based on the color and brightness information 25 stored in advance in the memory M3 for the determined surface. Then, the color/brightness generating circuit A9 supplies the color information and brightness information displayed by the display device to each area on the display screen.

The display device displays the color/brightness generation circuit output 26 in synchronization with the signals of the vertical counter and horizontal counter in order to display the processed information at a certain predetermined display location.

Therefore, if the viewer's viewpoint is in front of the display device, the visual object can be recognized through the pattern displayed on the display screen of the display device.

As described above, according to the present invention, various visual objects that could not be displayed using conventional methods can be generated and displayed using a simple and inexpensive device. It is also superior in that it expands the degree of freedom of posture and eliminates restrictions on use, and it becomes possible to produce a highly versatile visual display device that is not limited to visual display devices for aircraft simulation training devices.

In other words, electronic circuits are generated and displayed on the display screen as patterns that change according to changes in viewpoint regarding visual objects that are planned to be displayed by applying generally easily available storage means, calculation means, logic circuit elements, etc. However, it can give the screen viewer exactly the same visual sensation as when actually viewing a visual object in three-dimensional space, and therefore, if applied to the pattern generation display of an aircraft simulator device, the simulator This has the effect of making the training effect more noticeable since the trainee can be given the same vision as the actual machine.

[Brief explanation of the drawing]

Figure 1a is a display plan of visual objects (scenes), Figure 1b
is a schematic diagram explaining the principle when the scene in Figure 1 a is displayed as a pattern on the screen, and Figures 2 a and b are explanatory diagrams explaining the method of dividing the visual object planned for display into planes. , Figure 3a is an illustration of one surface of Figure 2a, Figure 3b is an explanatory diagram explaining the pattern surface on the screen of the surface of Figure 3a, and Figure 3c is a visual object. Figure 4a is a diagram illustrating the relative relationship between the movement of the viewpoint and points in three-dimensional space when the viewpoint is the origin of coordinates. Figures 4B and c are explanatory diagrams explaining the state when a straight line is projected onto a virtual screen, Figure 5a is an explanatory diagram explaining the designated direction of the plane by the limbal line, and Figures 5b-e are the screens. The diagram above shows an example of the designated area of the projected straight line, Figure 5 f is an explanatory diagram when a surface is defined by being designated by the projected straight line on the screen, and Figure 6 a-h shows the area defined by the projected straight line on the screen. An explanatory diagram explaining the determination of surface area designation, FIG. 7a is a block diagram showing the configuration of an electronic circuit that calculates the linear coefficient of the pattern limbal line according to a mathematical formula, and FIG. FIG. 7c is a block diagram showing the configuration of an electronic circuit for determining surface definition, FIG. Explanatory diagram explaining the visible surface and invisible surface from E, FIG. 9b
10 is a block diagram showing the configuration of an electronic circuit that calculates and determines the overall priority order, FIG. 10 is an explanatory diagram illustrating a color display method using a television screen as an example, and FIG. 11 is a diagram for implementing the method of the present invention. FIG. 3 is a block diagram showing the connection state of the entire system.

Claims (1)

[Scope of Claims] 1. Generating and displaying a pattern that causes an observer of the display screen to visually sense a two-dimensional or three-dimensional visual object by the pattern generated and displayed on a display screen provided in a three-dimensional space. In the method, the position of a point on each outline of the visual object observed in a three-dimensional space is stored in advance in a storage means as a coordinate value from a fixed reference point in the three-dimensional space, and then Calculating linear linear equations regarding coordinate axes provided on the display screen with respect to straight lines on the display screen corresponding to each outline of the visual object to be observed, by an electronic arithmetic circuit based on the coordinate values stored in the storage means. Then, the pattern plane on the display screen corresponding to the plane surrounded by each contour line of the visual object is set to one side of each straight line defined by each straight line equation calculated and determined above. The electronic arithmetic circuit logically determines the display area on the display screen that is all coincidentally designated by Regarding the straight line for which the sign change of the coefficient has been calculated, by changing the specified area on the display screen from the one side to the other side, the visual object caused by the change in the viewpoint of the observer can be calculated. The change in the field of view is calculated each time as a change in the specified display area on the display screen, and the specified display area on the screen calculated above is determined by the color and brightness stored in advance in the memory circuit. A method for generating and displaying a pattern, characterized by forming a pattern on a display screen via a color/brightness generation circuit. 2. In a method for generating and displaying an image that causes an observer of the display screen to visually perceive the two-dimensional or three-dimensional shape of a visual object through a pattern generated and displayed on a display screen provided in a three-dimensional space, storing in advance a point position on each outline of the visual object observed within the space as a coordinate value from a fixed reference point in the three-dimensional space in a storage means;
Next, the storage means stores, by means of the electronic arithmetic circuit, a linear linear equation regarding the coordinate axes provided on the display screen for straight lines on the display screen corresponding to each outline of the visual object observed from the observer's viewpoint position. The pattern surface on the display screen corresponding to the surface surrounded by each contour of the visual object is calculated and determined based on the stored coordinate values of An electronic arithmetic circuit determines the display area on the display screen that is all coincidentally specified by one side of each straight line, and at this time, the display area is determined by an electronic arithmetic circuit as a display area on the display screen that is all coincidentally specified by one side of each straight line. Accordingly, for the straight line for which the sign change of the coefficient in each linear linear equation has been calculated, the specified area on the display screen is changed from one side to the other side, thereby changing the viewpoint of the observer. The change in the visual range of the visual object resulting from the fluctuation is calculated and determined each time as a change in the specified display area on the display screen, and then the same area is When different sides of the visual object are designated at the same time, a unique display priority stored in advance in the storage means for each side of the visual object and a variable display of each side that changes according to fluctuations in the viewpoint of the observer. The overall display priority is calculated and determined by adding the priority levels using a logic circuit, and the overall display priority of each of the different surfaces is compared and calculated using a logic circuit to find the highest display priority. The specified area on the display screen, which has been calculated and determined as above, is determined by the color and brightness stored in advance in the storage circuit for the surface with the highest display priority, and then the specified area on the display screen is determined through the color/brightness generation circuit. A pattern occurrence display method characterized by forming a pattern.