JP2013214162A - Image processing method, image processing device, and image processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing method in which a remote boundary of a drawing range is set at a farthest distance while suppressing deterioration of drawing quality.SOLUTION: A simulation device 10 determines, on the basis of a speed and a direction in which eye point moves in a virtual space, a position of backdrop satisfying a condition as to drawing quality and a condition as to a drawing processing amount, update frequency of a remote scene image, and a remote boundary of drawing range. The condition as to drawing quality is a condition for causing a displacement between a distant view image, in which a model existing at a distant view from backdrop up to a remote boundary of a drawing range is mapped on a backdrop including a two-dimensional plane disposed in a virtual space, and a real image in a case where a model existing at a distance view is perspective-projected to be within an allowable value. The condition as to a drawing processing amount is a condition for causing a total of an estimation of a processing amount required for drawing a model existing at a near view from a view point to backdrop and an estimation of a processing amount required for drawing a model existing at a distant view from a backdrop up to a remote boundary of the drawing range to be within a prescribed threshold value.

Description

  The present invention relates to an image processing method, an image processing apparatus, and an image processing program.

  Computer graphics that provide an image in which a three-dimensional solid is virtually represented is known. Such computer graphics may be applied to a traffic simulation in which traffic can be experienced from the viewpoint of a vehicle driver.

  As an example of traffic simulation, a large-scale one that reproduces the whole city has been developed. Thus, when the scale of the virtual space to be reproduced is large, it is desirable to be able to present an image that continuously moves in a wide virtual space by computer graphics. In particular, when recreating a scene where a vehicle travels on an elevated road such as an expressway or a bypass, the field of view is farther than the scene traveling on a road under the elevated road. Preferably it is possible.

  However, in order to draw a large number of objects, it is necessary for the computer to have an arithmetic processing capability suitable for it, but there is a limit to the arithmetic capability of the computer. For this reason, in order to reduce the drawing processing amount, a method called level of detail (LOD), a drawing method using a book split, and the like are employed.

  LOD is a method for reducing the number of model polygons according to the distance from the viewpoint. For example, for each object such as a building or bridge, prepare in multiple stages from a detailed model to a simplified model, and use the detailed model for drawing as the distance from the viewpoint is closer, while from the viewpoint A model that is simplified as the distance is increased is used for drawing. This reduces the amount of drawing processing compared to drawing everything with a detailed model.

  In order to apply the above LOD, it is necessary to perform an operation called authoring in order to create a model in advance for each object in a plurality of stages. Such authoring is a task that is difficult to fully automate, and the cost of the task increases as the virtual space of a wide area is reproduced.

  On the other hand, the drawing method using the book split can reduce the processing amount of drawing without authoring. In such a drawing method, a vertical object with a distant view image on which a model distant from the distance is pasted at a position that is a predetermined distance from the viewpoint, that is, a “paper cut” is added. Deploy. In addition, in the above drawing method, an object positioned in front of the book cut is drawn by perspective projection together with the book cut. As a result, an image including a near view closer to the book percent to a far view farther than the book percent is drawn.

  In such a drawing method, the amount of drawing processing can be reduced as the frequency of updating a distant view image to be pasted as a texture to the book is reduced. Then, the computer processing capacity remaining by reducing the drawing processing amount is distributed to set the far limit of the drawing range further.

JP-A-11-154244 JP 2001-43393 A JP 2009-165878 A

  However, as described below, there is a problem that the far limit of the drawing range cannot be set as far as possible while suppressing the deterioration of the drawing quality as described below.

  That is, in the drawing method using the above-described book splitting, it is not assumed that there is a change in the speed and direction in which the viewpoint moves. For example, when the moving speed of the viewpoint increases with the movement of the vehicle, or when the direction of movement of the viewpoint approaches a direction parallel to the writing, it is calculated by a distant view image pasted on the writing and simulation The difference in appearance that occurs with the landscape increases. For this reason, when the deviation of appearance is larger than expected, the process of updating the distant view image pasted to the book cannot keep up with the spread of the deviation, resulting in a reduction in drawing quality. On the other hand, if the speed at which the viewpoint moves decreases or the direction in which the viewpoint moves approaches a direction perpendicular to the writing, the distance between the distant view image pasted on the writing and the landscape calculated by the simulation The resulting visual shift is reduced. In this case, the frequency of updating the distant view image pasted on the book split is low. For this reason, in spite of the situation where the far limit of the drawing range can be set farther, there is a waste that the computing processing capacity of the computer is devoted to updating the far view image.

  The disclosed technology has been made in view of the above, and provides an image processing method, an image processing apparatus, and an image processing program capable of setting a far limit of a drawing range as far as possible while suppressing deterioration in drawing quality. For the purpose.

  In the image processing method disclosed in the present application, a computer executes a process of receiving a speed and a direction in which a viewpoint moves in a virtual space. Further, according to the moving speed and moving direction of the viewpoint in the virtual space, the computer can convert a book including a two-dimensional surface arranged in the virtual space from the book to the far limit of the drawing range. From the viewpoint, a condition relating to drawing quality in which a disparity between a distant view image in which a model in the distant view is mapped and a real image when the model existing in the distant view is perspective-projected on the display unit is within a predetermined allowable value, and the viewpoint The total of the amount of processing required to draw the model in the foreground until the book split and the amount of processing required to draw the model in the far view from the book to the far limit of the drawing range Satisfy the condition relating to the drawing processing amount that falls within a predetermined threshold, and the farthest limit of the drawing range and the far limit of the drawing range so that the far limit of the drawing range is the farthest , A process for determining Backdrop arrangement information including the frequency of updating the distant view image.

  According to one aspect of the image processing method disclosed in the present application, it is possible to set the far limit of the drawing range as far as possible while suppressing the deterioration of the drawing quality.

FIG. 1 is a block diagram illustrating a functional configuration of the simulation apparatus according to the first embodiment. FIG. 2 is a diagram illustrating an example of a schematic diagram of the virtual space. FIG. 3 is a diagram showing the correlation between the screen resolution and the allowable error of the drawing pixel position. FIG. 4 is a diagram illustrating an example of a schematic diagram of the virtual space. FIG. 5 is a diagram illustrating the relationship between the update frequency and the distance from the viewpoint when no book split is used. FIG. 6 is a diagram illustrating the relationship between the update frequency and the distance from the viewpoint when the book split is used. FIG. 7 is a diagram illustrating an example of the viewpoint position vector and the viewpoint speed vector. FIG. 8 is a diagram showing an example of the book layout information. FIG. 9 is a flowchart illustrating the procedure of the split allocation determination process according to the first embodiment. FIG. 10 is a flowchart illustrating the procedure of the split image update process according to the first embodiment. FIG. 11 is a flowchart illustrating the procedure of the simulation video update process according to the first embodiment. FIG. 12 is a schematic diagram illustrating an example of a computer that executes an image processing program according to the first and second embodiments.

  Embodiments of an image processing method, an image processing apparatus, and an image processing program disclosed in the present application will be described below in detail with reference to the drawings. Note that this embodiment does not limit the disclosed technology. Each embodiment can be appropriately combined within a range in which processing contents are not contradictory.

[Configuration of simulation device]
FIG. 1 is a block diagram illustrating a functional configuration of the simulation apparatus according to the first embodiment. A simulation apparatus 10 shown in FIG. 1 provides a simulation image in which a virtual space is simulated in real time by computer graphics, and is equipped with a large-scale traffic simulator that continues to move continuously in a wide virtual space. To do. In the following, it is assumed that the vehicle driven by the user is a wide area driving simulator that travels on a wide area map as an example of a traffic simulator.

  As shown in FIG. 1, the simulation apparatus 10 includes an operation input unit 11, a video output unit 12, a simulation execution unit 13, a book layout determination unit 14, a book layout storage unit 15, and a drawing unit 16. Have Note that the simulation apparatus 10 may include various functional units included in a known computer other than the functional units illustrated in FIG. 1, for example, functional units such as an audio output device and a communication interface.

  Among these, the operation input part 11 is an input device which inputs various information, for example, the information which carries out driving operation of the vehicle simulated by the simulation execution part 13 mentioned later. As an aspect of the operation input unit 11, a model imitating a steering wheel, an accelerator pedal, a brake pedal, a shift lever, or the like can be given. The operation amounts of the steering wheel, accelerator pedal, brake pedal, shift lever, and the like are input to the simulation execution unit 13 described later.

  The video output unit 12 is a display device that displays various types of information, for example, a video of a vehicle traveling as a simulation result. As an aspect of the video output unit 12, a liquid crystal display or a plasma display may be employed, and electronic paper or a projector that displays an image by reflection from another light source may be employed.

  The simulation execution unit 13 is a processing unit that executes a simulation using the above-described wide area driving simulator. As one aspect, the simulation execution unit 13 uses the operation amounts of the steering handle, the accelerator pedal, the brake pedal, the shift lever, and the like output from the operation input unit 11, and the position and speed of the vehicle in the virtual space, the building, Calculate the position of objects such as bridges. Here, in the following, it is assumed that the position of the viewpoint of the driver sitting in the driver's seat of the vehicle in the virtual space is used as a viewpoint by computer graphics. The viewpoint position vector and velocity vector calculated in this way by the simulation execution unit 13 are input to the later-described book placement determination unit 14.

  The document allocation determination unit 14 is a processing unit that determines information related to the allocation of the document allocation in the virtual space. Hereinafter, the information related to the allocation of the book split may be referred to as “book split allocation information”. The book layout information includes information such as the distance D from the viewpoint to the book split, the update frequency F for redrawing the texture mapped to the book split, and the distance E from the viewpoint to the end position for drawing the model. included. In the following description, the distance from the viewpoint to the book percent may be referred to as “the location of the book percent”. In the following description, the update frequency for redrawing the texture mapped to the book split may be referred to as “distant view image update frequency”. Further, hereinafter, the distance from the viewpoint to the position at which the model is drawn as the end may be described as “the far limit of the drawing range”.

  The term “book split” as used herein refers to a virtual perspective projection plane on which a distant view image in which a model farther than that distance is drawn is pasted at a position that is a predetermined distance from the viewpoint. For example, a rectangular plate-like object can be adopted. In the following, it is assumed that the book split is arranged in a direction facing the screen of the video output unit 12, but it is not always necessary to fix the orientation in which the book split is arranged, and the video is matched to the orientation of the viewpoint. It can also be tilted from the direction facing the screen of the output unit 12. In addition, here, the case where the book is a rectangular plate-like object is illustrated, but the shape of the book is not limited to this, and a shape other than a rectangle or a curved surface may be adopted. it can.

  As one aspect, the book layout determination unit 14 uses the following formulas (1) to (3) in which the conditions relating to the drawing quality and the conditions relating to the drawing processing amount are incorporated, D, the far-field image update frequency F, and the far limit E of the drawing range are determined.

F = {R / (2 × tan (θ / 2) × P)} × sin α × V / D (1)
E = sqr ((E ₀ ² × F ₀ − (F ₀ −F) × D ² ) / F) (2)
D = {X + sqr (X ² + 3 × E ₀ ² · F ₀ ² )} / (3 × F ₀ ) (3)
X = {R / (2 × tan (θ / 2) × P)} × sin α × v (formula 3.1)

  Among these, the expression (1) is a relational expression between the position D of the book split in which the condition relating to the drawing quality is incorporated and the update frequency F of the distant view image. The expression (1) includes: “At the position D of a book split, when the viewpoint moves at a speed v and a direction α, a distant view image pasted on the book split and an image that should originally be visible on the other side of the book split. In order for the deviation that occurs between the two to fall within P pixels on the screen, a condition relating to drawing quality such that the book split must be updated at a frequency of F times or more per second is incorporated.

  “V” in the above equation (1) indicates the moving speed of the viewpoint. “Α” in Expression (1) indicates the moving direction of the viewpoint. “D” in Equation (1) indicates the position of the book split. “F” in Equation (1) indicates the update frequency of the distant view image. “R” in Expression (1) indicates the resolution (number of pixels) in the horizontal direction of the screen. “P” in Expression (1) indicates an allowable error (number of pixels) of the drawing pixel position. Further, “θ” in the formula (1) indicates a viewing angle. The direction α represents an angle formed by the direction in which the viewpoint moves and the direction perpendicular to the book when the direction perpendicular to the book is zero. Hereinafter, the direction α may be referred to as a “viewpoint moving direction”.

  Here, the derivation of the above equation (1) will be described with reference to FIGS. FIG. 2 is a diagram illustrating an example of a schematic diagram of the virtual space. FIG. 3 is a diagram showing the correlation between the screen resolution and the allowable error of the drawing pixel position. FIG. 4 is a diagram illustrating an example of a schematic diagram of the virtual space. 2 and 4 illustrate the case where the viewpoint moves in a direction parallel to the surface of the book split.

  As shown in FIG. 2, the relative movement amount d with respect to the viewpoint of an object existing farther from the viewpoint than the viewpoint in the virtual space is obtained by dividing the moving speed v of the viewpoint by the update frequency F of the distant view image. It is expressed as the following formula (a). Further, the in-screen movement amount s can be expressed as the following equation (b) using the relative movement amount d with respect to the viewpoint. If the allowable error P of the drawing pixel position shown in FIG. 3 and the in-screen movement amount s coincide with each other, the ratio of the in-screen movement amount s and the book width W, the horizontal resolution R of the screen, and Since the ratio of the allowable error P of the drawing pixel position becomes equal, the in-screen movement amount s can be expressed by the following equation (c). Further, as shown in FIG. 4, when the book split is set to the size of the screen, the width W of the book split can be expressed by the following equation (d).

d = v / F Formula (a)
s = d × H / D Formula (b)
s = (P / R) × W Expression (c)
W = H × 2 × tan (θ / 2) Expression (d)

  From the above formula (a) and the above formula (b), the update frequency F of the distant view image can be expressed as “F = v / d = v × (H / D) / s”. Further, by substituting the above equation (c), the update frequency F of the distant view image can be expressed as “F = v × (H / D) × (R / P) / W”. Then, “F = {R / ((W / H) × P)} × v / D”. Further, by substituting the above equation (d), the distant view image update frequency F can be expressed as “F = {R / (2 × tan (θ / 2) × P)} × v / D”. it can. When the effect of the line-of-sight movement direction α is introduced to this, the above equation (1) is derived.

  Equation (1) derived in this way is the change in the appearance on the screen when the viewpoint is moved, as the book is farther from the viewpoint, that is, the distance D from the viewpoint to the book is larger. This means that the far-field image update frequency F is set low. Further, the expression (1) means that the change in the appearance becomes larger as the viewpoint moves faster, that is, the viewpoint moving speed v increases, so that the far-field image update frequency F is set higher.

  Next, the derivation of the above equation (2) will be described. The above formula (2) is a relational expression of the position D of the book split in which the condition regarding the drawing processing amount is incorporated, the update frequency F of the distant view image, and the far limit E of the drawing range. In this equation (2), “the estimation of the drawing processing amount required to draw an object in the foreground from the viewpoint to the book cut and the drawing of the object in the distant view from the book to the far limit of the drawing range” The condition relating to the drawing processing amount is incorporated, such that the sum of the drawing processing amount required for the above is equal to the drawing processing capability of the computer.

  First, in order to estimate the drawing processing amount, the relationship between the range in space and the update frequency of the distant view image and the drawing processing amount L per unit time is defined. This definition should be made based on the properties of the virtual space, and an example is shown below.

It can be estimated that the drawing processing amount estimate L per unit time is proportional to the update frequency F of the distant view image. Further, in the wide area driving simulator, the estimation L of the drawing processing amount per unit time can be approximated as “proportional to the area of the ground in the virtual space”. Because, in a space where a lot of objects such as buildings and bridges are in contact with the ground, it can be assumed that the amount of drawing processing is roughly proportional to the number of objects, and that the objects are arranged on the ground with a substantially uniform density. This is because the number of objects can be assumed to be proportional to the area of the ground. And the area of the ground in the visual field for the range from the distance a to the distance b from the viewpoint is proportional to (b ² −a ² ).

L = F × (b ² −a ² ) Formula (e)

  From these relations, the estimation L of the drawing processing amount per unit time can be expressed as in the above equation (e). If the arrangement of the objects is not uniform, a more accurate relational expression can be derived by using a distribution function or the like instead of the proportional function. Further, if the object is a virtual space that exists not only on the ground but also in the air, a relational expression that is proportional to the volume of the space instead of the area of the ground can be used.

FIG. 5 is a diagram illustrating the relationship between the update frequency and the distance from the viewpoint when no book split is used. As shown in FIG. 5, the frame rate (F ₀ times per second) of the simulation video output to the video output unit 12 in real time, that is, all objects from the viewpoint to the far limit E ₀ of the drawing range without using the splitting. ) Is assumed. Then, it is assumed that a value is set so that the distance E ₀ from the viewpoint to the far limit E of the drawing range uses up all the drawing processing capability of the computer. Under this assumption, the drawing processing amount estimate L ₀ can be expressed as the following equation (f).

L ₀ = F ₀ × E ₀ ² ... Formula (f)

FIG. 6 is a diagram illustrating the relationship between the update frequency and the distance from the viewpoint when the book split is used. As illustrated in FIG. 6, the drawing processing amount estimation L ₁ when using the percent is a processing amount required to draw an object in the foreground from the viewpoint to the percent, and a distance from the drawing range to the drawing range. This is the total of the processing amount required to draw an object in a distant view up to the limit E. Therefore, estimates L ₁ of the drawing process amount when using a Backdrop can be represented as in the following formula (g). At this time, it is assumed that the update frequency of drawing for drawing an object in the foreground from the viewpoint to the book split is the same update frequency as the frame rate F _{0 of the} simulation video output to the video output unit 12. On the other hand, the update frequency F for drawing an object in a distant view from the book split to the far limit E of the drawing range is a simulation in order to reduce the drawing processing amount and maximize the far limit of the drawing range. It shall be set lower than the frame rate F ₀ of the video.

^{_{L 1 = F 0 × D 2}} + F × (E 2 -D 2) ··· formula (g)

Here, if the computer always uses up the drawing processing capacity, L ₀ and L ₁ are equal, so the following equation (h) is obtained.

F ₀ × E ₀ ² = F ₀ × D ² + F × (E ² −D ² ) Expression (h)

When the above equation (h) is transformed so that the left side becomes E, the above equation (2) can be derived. In addition, “D” in the above formula (2) indicates the position of the book split. “E” in Equation (2) indicates the far limit of the drawing range. “F” in Equation (2) indicates the update frequency of the distant view image. “F ₀ ” in Expression (2) indicates a real-time update frequency, for example, 60 frames per second. “E ₀ ” in Expression (2) indicates the maximum value of the far limit when the entire drawing range is drawn in real time.

  Subsequently, the derivation of the above equation (3) will be described. The above formula (3) is a calculation formula for calculating the position D of the book split where the far limit E of the drawing range is maximum, and is derived using the above formula (1) and the above formula (2). .

  First, by substituting the above equation (1) into the above equation (2), the following equation (j) expressing the far limit E of the drawing range as a function of the position D of the writing is obtained. Note that “X” in the following formula (j) is represented by the following formula (k).

E ² = − (F ₀ / X) × D ³ + D ² + (E ₀ ² × F ₀ / X) × D Expression (j)
X = {R / (2 × tan (θ / 2) × P)} × sin α × v Equation (k)

By differentiating E in the above equation (j) by D and solving an equation in which it becomes 0, the above equation (3) for obtaining D at which E becomes the maximum value can be derived. Note that “V” in the above equation (3) indicates the moving speed of the viewpoint. “Α” in Expression (3) indicates the moving direction of the viewpoint. “D” in Expression (3) indicates the position of the book split. “F” in Equation (3) indicates the update frequency of the distant view image. “R” in Expression (3) indicates the resolution in the horizontal direction of the screen. “P” in Expression (3) indicates an allowable error of the drawing pixel position. “Θ” in Equation (3) indicates a viewing angle. “F ₀ ” in Equation (3) indicates a real-time update frequency. In addition, “E ₀ ” in Expression (3) indicates the maximum value of the far limit when the entire drawing range is drawn in real time.

  Using the expressions (1) to (3) derived in this way, the book layout determination unit 14 calculates the position D of the book split, the update frequency F of the distant view image, and the far limit E of the drawing range. .

  FIG. 7 is a diagram illustrating an example of the viewpoint position vector and the viewpoint speed vector. For example, it is assumed that the viewpoint position vector and the line-of-sight velocity vector illustrated in FIG. 7 are input by the simulation execution unit 13. Then, using the viewpoint position vector and the line-of-sight speed vector, the book layout determining unit 14 calculates the viewpoint moving speed magnitude v and the viewpoint moving direction, that is, the angle α with respect to the book normal. To do. Then, the book layout determining unit 14 calculates the position D “783.5” of the book by substituting the previously calculated line-of-sight movement speed v and line-of-sight movement direction α into the above equation (3). . Further, the text layout determining unit 14 substitutes the line-of-sight movement speed v, the line-of-sight movement direction α, and the text position D calculated using the above equation (3) into the above equation (1). The update frequency F “12.3” of the distant view image is calculated. Then, the text layout determination unit 14 substitutes the text layout position D calculated using Expression (3) and the distant view image update frequency F calculated using Expression (1) into Expression (2). Thus, the far limit E “5401.2” of the drawing range is calculated. After that, the book layout determination unit 14 uses the calculated book position D “783.5”, the far limit E “5401.2” of the drawing range, and the update frequency F “12.3” of the distant image as the book layout information. This is stored in a later-described book allocation storage unit 15.

  Note that each time the position allocation determination unit 14 receives a viewpoint position vector and a velocity vector from the simulation execution unit 13, it calculates the position D of the split, the far limit E of the drawing range, and the update frequency F of the distant view image. However, it is not always necessary to calculate for each input. For example, when the amount of change from the viewpoint position vector and the velocity vector at the time when the book layout information was previously determined becomes a predetermined threshold value or more, the book layout determination unit 14 determines the book layout information again. You can also Thus, it is possible to prevent the processing load of the image processing apparatus 10 from increasing due to frequent changes in the book layout information.

  The document allocation storage unit 15 is a storage unit that stores the document allocation information. As one aspect of the book layout information, data in which items such as the book position D, the far limit E of the drawing range, and the update frequency F of the far view image are associated can be employed. FIG. 8 is a diagram showing an example of the book layout information. In the example of FIG. 8, the far limit of the drawing range is set to “5401.2”, the text is placed at a position where the distance from the viewpoint is “783.5”, and the distant view image mapped to the text is “12.3” per second. Indicates that the setting to update at the frequency of times is made.

  The drawing unit 16 is a processing unit that draws a simulation video to be output to the video output unit 12 by computer graphics. As shown in FIG. 1, the drawing unit 16 includes a book drawing unit 16a, a book image storage unit 16b, and a video drawing unit 16c.

  Among these, the book drawing unit 16a is a processing unit that draws a distant view image that is a texture to be attached to the book. As one aspect, the document drawing unit 16a calculates the viewpoint calculated by the simulation executing unit 13 when the far-field image update frequency F determined in the book layout information has elapsed since the previous drawing of the distant view image. Refer to the position vector of. Then, the percent drawing unit 16 a refers to the percent arrangement information stored in the percent arrangement storage unit 15. After that, the book drawing unit 16a selects a model included in the distant view from the book position D defined in the book placement information to the far limit of the drawing range among the models calculated by the simulation execution unit 13. To do. Thereafter, the book drawing unit 16a draws a distant view image by perspectively projecting the previously selected model into the book. In addition, the percent drawing unit 16a texture-maps the distant view image drawn earlier to the percent. Then, the book split drawing unit 16a stores the book split image in which the distant view image is mapped to the book split in the book split image storage unit 16b.

The split image storage unit 16b is a storage unit that stores a split image. As an example, the split image storage unit 16b is updated by the split drawing unit 16a every time the distant view image update frequency F defined in the split allocation information elapses. As another example, Backdrop image storage unit 16b, to draw a simulation image is referred to every time the frame rate F ₀ of the simulation image is passed by the image rendering unit 16c described later.

The video drawing unit 16c is a processing unit that draws a simulation video. As one aspect, the video drawing unit 16 c starts processing at the frame rate (F ₀ times per second) of the simulation video output to the video output unit 12. The video drawing unit 16 c refers to the viewpoint position vector calculated by the simulation execution unit 13. Subsequently, the video drawing unit 16 c refers to the book layout information stored in the book layout storage unit 15. Then, the video drawing unit 16c reads the split image stored in the split image storage unit 16b. After that, the video drawing unit 16c selects a model of the foreground from the viewpoint of the virtual space from the model calculated by the simulation execution unit 13 to the position D of the book allocation determined in the book layout information. After that, the video drawing unit 16 c draws a simulation video by perspectively projecting the split image together with the previously selected model onto the screen of the video output unit 12. Then, the video drawing unit 16 c outputs the simulation video to the video output unit 12.

  Note that various integrated circuits and electronic circuits can be employed for the simulation execution unit 13, the book layout determination unit 14, the book drawing unit 16a, and the video drawing unit 16c. For example, examples of the integrated circuit include ASIC (Application Specific Integrated Circuit) and FPGA (Field Programmable Gate Array). Examples of the electronic circuit include a central processing unit (CPU) and a micro processing unit (MPU).

  In addition, the following devices can be employed for the secant arrangement storage unit 15 and the secant image storage unit 16b. For example, a semiconductor memory element such as a random access memory (RAM), a read only memory (ROM), or a flash memory can be employed. A storage device such as a hard disk or an optical disk can also be employed.

[Process flow]
Next, a processing flow of the image processing apparatus according to the present embodiment will be described. Here, after describing (1) the split allocation determination process executed by the simulation apparatus 10, (2) the split image update process will be described, and then (3) the simulation video update process will be described. I will do it.

(1) Split Arrangement Determination Process FIG. 9 is a flowchart illustrating a procedure of the split allocation determination process according to the first embodiment. This book allocation determination process is a process that is repeatedly executed as long as the wide area driving simulator is operating.

  As shown in FIG. 9, when an operation from the operation input unit 11 is accepted (Yes in step S <b> 101), the simulation executing unit 13 executes the following process. That is, the simulation execution unit 13 uses the operation amount of the steering wheel, the accelerator pedal, the brake pedal, the shift lever, and the like output from the operation input unit 11 to start the position and speed of the vehicle's viewpoint in the virtual space, The positions of various models existing in the virtual space, such as buildings and bridges, are calculated (step S102). In the virtual space, there are many vehicles in addition to the own vehicle, and such other vehicles change their positions and speeds as time elapses. Therefore, in step S102, the positions and speeds of the other vehicles are changed. In addition, the calculation is performed by the simulation execution unit 13.

  Subsequently, the book layout determination unit 14 receives parameters relating to the line of sight such as the position vector and the velocity vector of the viewpoint from the simulation execution unit 13 (step S103). Then, the book layout determination unit 14 determines whether or not the amount of change from the viewpoint position vector and the velocity vector when the book layout information was previously determined is greater than or equal to a predetermined threshold (step S104).

  Here, when the amount of change from the viewpoint position vector and the velocity vector at the time when the layout allocation information is determined last time is equal to or greater than a predetermined threshold (Yes in step S104), the allocation allocation determination unit 14 The process like this is executed. That is, the book layout determination unit 14 calculates the position D of the book by substituting the line-of-sight movement velocity v and the line-of-sight movement direction α obtained from the viewpoint position vector and the velocity vector into the above equation (3). (Step S105).

  Subsequently, the text layout determining unit 14 substitutes the line-of-sight movement speed v, the line-of-sight movement direction α, and the text position D calculated in step S105 into the above formula (1) to update the distant view image update frequency. F is calculated (step S106).

  Then, the splitting layout determination unit 14 substitutes the splitting position D calculated in step S105 and the distant view image update frequency F calculated in step S106 into the above formula (2) to thereby set the far limit E of the drawing range. Is calculated (step S107).

  Thereafter, the document allocation determination unit 14 uses the document allocation position D calculated in steps S105 to S107, the far limit E of the drawing range, and the distant view image update frequency F as the document allocation information, which will be described later. 15 (step S108).

  As described above, the processes from step S101 to step S108 are repeatedly executed until the wide area driving simulator is stopped.

(2) Document Image Update Processing FIG. 10 is a flowchart illustrating the procedure of the document image update processing according to the first embodiment. This book splitting process is also a process that is repeatedly executed as long as the wide area driving simulator is operating.

  As shown in FIG. 10, when the far-field image update frequency F defined in the text layout information has elapsed since the last time the far-field image was drawn (Yes in step S201), the text drawing unit 16a executes the simulation. The viewpoint position vector calculated by the unit 13 is referred to (step S202).

  Then, the percent drawing unit 16a refers to the percent allocation information stored in the percent allocation storage unit 15 (step S203). After that, the book drawing unit 16a selects a model included in the distant view from the book position D defined in the book placement information to the far limit of the drawing range among the models calculated by the simulation execution unit 13. (Step S204).

  Thereafter, the book drawing unit 16a draws a distant view image by perspectively projecting the previously selected model into the book (step S205). Then, the book drawing unit 16a texture-maps the distant view image drawn previously to the book (step S206). Then, the book drawing unit 16a stores the book image in which the distant view image is mapped to the book book in the book image storage unit 16b (step S207).

  As described above, the processing from step S201 to step S207 is repeatedly executed until the wide-area driving simulator is stopped at the distant view image update frequency F determined in the book layout information.

(3) Simulation Video Update Processing FIG. 11 is a flowchart illustrating a procedure of simulation video update processing according to the first embodiment. This simulation image is also a process that is repeatedly executed as long as the wide area driving simulator is operating.

As shown in FIG. 11, when the frame rate (F ₀ times per second) has elapsed since the simulation video was output to the video output unit 12 last time (Yes in step S301), the video drawing unit 16c performs the following processing. Run. That is, the video drawing unit 16c refers to the viewpoint position vector calculated by the simulation executing unit 13 (step S302). Subsequently, the video drawing unit 16c refers to the book layout information stored in the book layout storage unit 15 (step S303). Then, the video drawing unit 16c reads out the split image stored in the split image storage unit 16b (step S304).

  After that, the video drawing unit 16c selects a model of the foreground from the viewpoint of the virtual space from the model calculated by the simulation executing unit 13 to the position D of the book allocation determined in the book layout information (step) S305).

  Thereafter, the video drawing unit 16c draws a simulation video by perspectively projecting the split image together with the model selected in step S305 on the screen of the video output unit 12 (step S306). Then, the video drawing unit 16c outputs the simulation video to the video output unit 12 (step S307).

In this way, the processes from step S301 to step S307 are repeatedly executed at the simulation video frame rate (F ₀ times per second) until the wide area driving simulator is stopped.

[Effect of Example 1]
As described above, the simulation apparatus 10 according to the present embodiment updates the position D of the textbook that satisfies the conditions related to the drawing quality and the drawing processing amount based on the speed and direction in which the viewpoint moves in the virtual space, and updates the distant view image. The frequency F and the far limit E of the drawing range are determined. For this reason, in the simulation apparatus 10 according to the present embodiment, the far-field image update frequency F is set lower as the viewpoint movement is slower in a range where the drawing quality is not deteriorated, and the direction in which the viewpoint moves is perpendicular to the writing The update frequency F of the distant view image can be set lower as it approaches. Furthermore, in the simulation apparatus 10 according to the present embodiment, the calculation processing capability extracted by reducing the drawing processing amount by setting the update frequency of the distant view image to a frequency lower than the frame rate at which the simulation video is output. This can be done to maximize the far limit of the drawing range. Therefore, according to the simulation apparatus 10 according to the present embodiment, it is possible to set the far limit of the drawing range as far as possible while suppressing the deterioration of the drawing quality.

  Although the embodiments related to the disclosed apparatus have been described above, the present invention may be implemented in various different forms other than the above-described embodiments. Therefore, another embodiment included in the present invention will be described below.

[Application example of book split placement]
In the first embodiment described above, it is assumed that one book split is arranged in the virtual space, but it is not always necessary that one book split be arranged. In other words, the change in the appearance of the book split, that is, the deviation from the image that should be seen, depends only on the change in the position of the viewpoint, and is not related to the change in the direction of the line of sight. Therefore, when only the direction of the line of sight is changed without moving the viewpoint, there is no need to update the book split. However, if the line-of-sight direction changes greatly, it is possible that part or all of the field of view is not covered by the book split. In order to prevent this, the disclosed apparatus can arrange a plurality of planes so as to surround the viewpoint. And what is necessary is just to apply the process shown in FIGS. 9-11 independently about each book split. As described above, when a plurality of books are arranged, for example, a quadrilateral or a polygon as viewed from above may be used. When the line of sight moves greatly in the vertical direction, it is possible to add cubes to the top and bottom to form a cube or polyhedron as a whole.

[Distribution and integration]
In addition, each component of each illustrated apparatus does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the simulation execution unit 13, the book layout determination unit 14, the book drawing unit 16 a, or the video drawing unit 16 c may be connected as an external device of the simulation apparatus 10 via a network. Further, the functions of the simulation device 10 described above can be obtained by having each of the simulation execution unit 13, the book layout determination unit 14, the book drawing unit 16 a, or the video drawing unit 16 c each having a network connection to cooperate. May be realized.

[Image processing program]
The various processes described in the above embodiments can be realized by executing a prepared program on a computer such as a personal computer or a workstation. In the following, an example of a computer that executes an image processing program having the same function as that of the above embodiment will be described with reference to FIG.

  FIG. 12 is a schematic diagram illustrating an example of a computer that executes an image processing program according to the first and second embodiments. As illustrated in FIG. 12, the computer 100 includes an operation unit 110a, a speaker 110b, a camera 110c, a display 120, and a communication unit 130. Further, the computer 100 includes a CPU 150, a ROM 160, an HDD 170, and a RAM 180. These units 110 to 180 are connected via a bus 140.

  As shown in FIG. 12, the HDD 170 has image processing that exhibits the same functions as those of the simulation execution unit 13, the split allocation determination unit 14, the split drawing unit 16a, and the video drawing unit 16c described in the first embodiment. A program 170a is stored in advance. The image processing program 170a may be integrated or separated as appropriate, similar to the constituent elements of the simulation execution unit 13, the split allocation determination unit 14, the split drawing unit 16a, and the video drawing unit 16c shown in FIG. . In other words, all data stored in the HDD 170 does not always need to be stored in the HDD 170, but only data necessary for processing, for example, only a program related to a function performed by the allocation allocation determination unit 14 is stored in the HDD 170. It should be done.

  Then, the CPU 150 reads the image processing program 170 a from the HDD 170 and develops it in the RAM 180. Thereby, as shown in FIG. 12, the image processing program 170a functions as an image processing process 180a. The image processing process 180a expands various data read from the HDD 170 in an area allocated to itself on the RAM 180 as appropriate, and executes various processes based on the expanded data. Note that the image processing process 180a is a process executed by the simulation execution unit 13, the book layout determination unit 14, the book drawing unit 16a, and the video drawing unit 16c shown in FIG. 1, for example, as shown in FIGS. Includes processing. In addition, each processing unit virtually realized on the CPU 150 does not always require all processing units to operate on the CPU 150, and only the processing unit required for processing, for example, only the allocation allocation determination unit 14 is virtual. It only has to be realized.

  Note that the image processing program 170a is not necessarily stored in the HDD 170 or the ROM 160 from the beginning. For example, each program is stored in a “portable physical medium” such as a flexible disk inserted into the computer 100, so-called FD, CD-ROM, DVD disk, magneto-optical disk, or IC card. Then, the computer 100 may acquire and execute each program from these portable physical media. In addition, each program is stored in another computer or server device connected to the computer 100 via a public line, the Internet, a LAN, a WAN, etc., and the computer 100 acquires and executes each program from these. It may be.

DESCRIPTION OF SYMBOLS 10 Simulation apparatus 11 Operation input part 12 Image | video output part 13 Simulation execution part 14 Book allocation determination part 15 Book layout storage part 16 Drawing part 16a Book drawing part 16b Book image storage part 16c Video drawing part

Claims (4)

Computer
Accepts the speed and direction of movement of the viewpoint in the virtual space,
According to the moving speed and moving direction of the viewpoint in the virtual space,
A distant view image in which a model in a distant view from the book to the far limit of the drawing range is mapped to a book including a two-dimensional surface arranged in the virtual space, and a model existing in the distant view is displayed on the display unit A condition relating to the drawing quality within which a deviation from the actual image when it is projected in perspective is within a predetermined tolerance;
Estimating the amount of processing required to draw a model in the foreground from the viewpoint to the book split, and estimating the amount of processing required to draw a model in the far view from the book to the far limit of the drawing range So that the distance limit of the drawing range is the farthest, and the condition relating to the drawing processing amount within the predetermined threshold is satisfied.
An image processing method, comprising: executing a process of determining book layout information including a position of the book split, a far limit of the drawing range, and a frequency of updating the distant view image. As a process of determining the above-mentioned book allocation information,
The frequency of updating the distant view image is made lower than the frequency of drawing the map with the distant view image mapped and the model in the foreground from the viewpoint to the book cut. Image processing method. A calculation unit for calculating the speed and direction of movement of the viewpoint in the virtual space;
According to the moving speed and moving direction of the viewpoint in the virtual space,
A distant view image in which a model in a distant view from the book to the far limit of the drawing range is mapped to a book including a two-dimensional surface arranged in the virtual space, and a model existing in the distant view is displayed on the display unit A condition relating to the drawing quality within which a deviation from the actual image when it is projected in perspective is within a predetermined tolerance;
Estimating the amount of processing required to draw a model in the foreground from the viewpoint to the book split, and estimating the amount of processing required to draw a model in the far view from the book to the far limit of the drawing range So that the distance limit of the drawing range is the farthest, and the condition relating to the drawing processing amount within the predetermined threshold is satisfied.
An image processing apparatus, comprising: a book layout determination unit that determines book layout information including a position of the book split, a far limit of the drawing range, and a frequency of updating the distant view image. On the computer,
Accepts the speed and direction of movement of the viewpoint in the virtual space,
According to the moving speed and moving direction of the viewpoint in the virtual space,
A distant view image in which a model in a distant view from the book to the far limit of the drawing range is mapped to a book including a two-dimensional surface arranged in the virtual space, and a model existing in the distant view is displayed on the display unit A condition relating to the drawing quality within which a deviation from the actual image when it is projected in perspective is within a predetermined tolerance;
Estimating the amount of processing required to draw a model in the foreground from the viewpoint to the book split, and estimating the amount of processing required to draw a model in the far view from the book to the far limit of the drawing range So that the distance limit of the drawing range is the farthest, and the condition relating to the drawing processing amount within the predetermined threshold is satisfied.
An image processing program for executing a process for determining the secant arrangement information including a position of the secant, a far limit of the drawing range, and a frequency of updating the distant view image.

Images