JP4847572B2 - Image processing apparatus, image processing apparatus control method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, a control method for the image processing apparatus, and a program.

  There is known an image processing apparatus that displays a virtual three-dimensional space in which various objects such as game characters are arranged as viewed from a given viewpoint. Patent Document 1 describes a technique for reducing the processing load when displaying on the screen the appearance of snow or rain.

JP 2007-082859 A

  In the image processing apparatus as described above, when an object close to the viewpoint is clearly displayed and an object far from the viewpoint is blurred and displayed, a sense of perspective is expressed on the screen. As a method of expressing perspective, for example, a method of combining an image that does not blur the object and an image that is blurred of the object at a ratio according to the depth information of each pixel is conceivable. In this case, the ratio of the image in which the object is blurred increases as the pixel has a depth. That is, the object that is farther from the viewpoint is blurred and displayed on the screen.

  However, for example, when a large number of precise objects are arranged in the virtual three-dimensional space, the depth information creation process becomes complicated due to an increase in the number of polygons included in the virtual three-dimensional space. That is, there is a possibility that the processing load of the image processing apparatus increases when displaying a screen expressing a sense of perspective.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an image processing apparatus and an image processing apparatus capable of displaying a screen expressing a sense of perspective while reducing a processing load. It is providing the control method and program of this.

  In order to solve the above problems, an image processing apparatus according to the present invention is an image processing apparatus that displays a screen representing a state in which a first virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint. A first image creating means for creating a first image representing a state of viewing the first virtual three-dimensional space from the viewpoint; and a state of viewing the first virtual three-dimensional space from the viewpoint. A second image creating means for creating a second image subjected to the blurring process, and a second virtual three-dimensional space in which the number of polygons is reduced as compared with the first virtual three-dimensional space from the viewpoint. Depth information acquisition means for acquiring depth information regarding the distance from the viewpoint for each pixel of the image representing the appearance, and a ratio of synthesis of each pixel of the first image and the second image based on the depth information. The first image and the second image Display control means for displaying the synthesized screen, characterized in that it comprises a.

  The image processing apparatus control method according to the present invention is a control method for an image processing apparatus that displays a screen representing a state in which a first virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint. A first image creating step of creating a first image representing a state of viewing the first virtual three-dimensional space from the viewpoint; and a state of viewing the first virtual three-dimensional space from the viewpoint. A second image creation step for creating a second image subjected to the blurring process, and a second virtual three-dimensional space in which the number of polygons is reduced as compared with the first virtual three-dimensional space. A depth information acquisition step for acquiring depth information regarding the distance from the viewpoint for each pixel of the image representing the appearance, and a ratio of synthesis of each pixel of the first image and the second image based on the depth information. The first picture When the second image is characterized by comprising a display control step of displaying the screen which is synthesized, a.

  The program according to the present invention is a program for causing a computer to function as an image processing apparatus that displays a screen representing a state in which a first virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint. A first image creating means for creating a first image representing a state of viewing the first virtual three-dimensional space from the viewpoint; a state of viewing the first virtual three-dimensional space from the viewpoint; Second image creation means for creating a second image that has been subjected to the blurring process, and a second virtual three-dimensional space in which the number of polygons is reduced as compared to the first virtual three-dimensional space as seen from the viewpoint Depth information acquisition means for acquiring depth information regarding the distance from the viewpoint for each pixel of the image that represents the ratio of the synthesis of the pixels of the first image and the second image based on the depth information. The above And second images are characterized by causing the computer to function as a display control unit, to display a screen that has been synthesized.

  According to the present invention, it is possible to display a screen expressing perspective while reducing the processing load.

  Moreover, in one aspect of the present invention, the depth information acquisition unit includes each pixel of an image representing a state in which the second virtual three-dimensional space from which a predetermined object is removed from the plurality of objects is viewed from the viewpoint. It is characterized in that depth information regarding the distance from the viewpoint is acquired every time.

  In the aspect of the present invention, the second virtual three-dimensional space is obtained by removing the predetermined object whose distance from the viewpoint is a predetermined value or more from the plurality of objects. To do.

  In the aspect of the invention, the depth information acquisition unit may include the second virtual three-dimensional space in which the predetermined object among the plurality of objects is replaced with an object having a smaller number of polygons than the object. Depth information regarding the distance from the viewpoint is acquired for each pixel of an image representing a state viewed from the viewpoint.

  In the aspect of the present invention, the second virtual three-dimensional space may include an object in which the predetermined object having a depth with respect to the viewpoint of the plurality of objects is less than a predetermined number of polygons than the object. It is characterized by being replaced by.

  In one aspect of the present invention, the second image creating means includes a target pixel of an image representing a state in which the first virtual three-dimensional space is viewed from the viewpoint, and a plurality of surrounding pixels adjacent to the target pixel. If the difference in depth corresponding to the viewpoint with any of the above is equal to or greater than a reference value, an acquisition unit that acquires an image in which the color of the predetermined region based on the target pixel is changed based on the color of the surrounding pixel, The second image is created by performing a blurring process on the image.

  In the aspect of the invention, the first virtual three-dimensional space is a sports game space in which at least a character object and an object representing a sports venue are arranged, and the depth information acquisition unit includes the depth information acquisition unit, For each pixel of the image representing the state in which the second virtual three-dimensional space in which at least the number of polygons corresponding to the character object is reduced compared to the first virtual three-dimensional space is viewed from the viewpoint, the viewpoint It is characterized by acquiring depth information related to the distance from.

It is a figure which shows the hardware constitutions of the game device which concerns on embodiment of this invention. It is a figure which shows an example of 1st virtual three-dimensional space. 3 is a functional block diagram illustrating a functional group realized in the game device according to the first embodiment. FIG. It is a figure which shows an example of a 1st image. It is a figure which shows an example of a 2nd image. It is a figure which shows an example of the image which a display control part displays. It is a figure which shows an example of 2nd virtual three-dimensional space. It is a figure which shows an example of depth information. It is a flowchart which shows an example of the process performed at predetermined time in a game device. It is an example of depth information. It is an example of depth information. An example of the 1st virtual three-dimensional space in Embodiment 2 is shown. It is a figure which shows an example of the 2nd virtual three-dimensional space in Embodiment 2. FIG. It is a figure which shows an example of the depth information in Embodiment 2. It is a flowchart which shows an example of the process performed at predetermined time in a game device. It is a figure which shows an example of a 1st image. It is a figure which shows an example of the image which the acquisition part of a 2nd image creation part acquires. It is a flowchart which shows an example of the process performed at predetermined time in a game device. It is a figure for demonstrating the relationship between an attention pixel and surrounding pixels. It is a figure for demonstrating the 2nd virtual three-dimensional space in a modification.

[1. Embodiment 1]
Hereinafter, an example of an embodiment of the present invention will be described in detail based on the drawings. Here, a case where the present invention is applied to a game device which is an aspect of an image processing device will be described. The game device according to the embodiment of the present invention is realized by, for example, a home game machine (stationary game machine), a portable game machine, a mobile phone, a personal digital assistant (PDA), a personal computer, or the like. Here, a case where the game device according to the first embodiment is realized by a consumer game machine will be described.

[1-1. Hardware configuration of game device]
FIG. 1 is a diagram illustrating a hardware configuration of a game device according to an embodiment of the present invention. As shown in FIG. 1, in the game apparatus 10, an optical disk 25 and a memory card 28 that are information storage media are mounted on a consumer game machine 11. Further, the display unit 18 and the audio output unit 22 are connected to the game apparatus 10. For example, a home television receiver is used for the display unit 18, and its built-in speaker is used for the audio output unit 22.

  The home game machine 11 is a known computer including a bus 12, a microprocessor 14, an image processing unit 16, an audio processing unit 20, an optical disc playback unit 24, a main memory 26, an input / output processing unit 30, and a controller 32. It is a game system. Components other than the controller 32 are accommodated in a housing.

  The bus 12 is for exchanging addresses and data among the units of the consumer game machine 11. The microprocessor 14, the image processing unit 16, the main memory 26, and the input / output processing unit 30 are connected by the bus 12 so that mutual data communication is possible.

  The microprocessor 14 controls each unit of the consumer game machine 11 based on an operating system stored in a ROM (not shown), a program read from the optical disc 25, and data read from the memory card 28.

  The main memory 26 is configured to include, for example, a RAM, and a program read from the optical disc 25 and data read from the memory card 28 are written as necessary. The main memory 26 is also used as a working memory for the microprocessor 14.

  The image processing unit 16 includes a VRAM. The image processing unit 16 draws a game screen on the VRAM based on the image data sent from the microprocessor 14. The image processing unit 16 converts this content into a video signal and outputs it to the display unit 18 at a predetermined timing.

  The input / output processing unit 30 is an interface for the microprocessor 14 to access the audio processing unit 20, the optical disc playback unit 24, the memory card 28, and the controller 32. The audio processing unit 20, the optical disc playback unit 24, the memory card 28 and the controller 32 are connected to the input / output processing unit 30.

  The sound processing unit 20 includes a sound buffer. The audio processing unit 20 outputs various audio data such as game music, game sound effects, and messages read from the optical disc 25 and stored in the sound buffer from the audio output unit 22.

  The optical disk reproducing unit 24 reads a program recorded on the optical disk 25 in accordance with an instruction from the microprocessor 14. Here, the optical disc 25 is used to supply the program to the consumer game machine 11, but any other information storage medium such as a CD-ROM or a ROM card may be used. Further, the program may be supplied to the consumer game machine 11 from a remote place via a data communication network such as the Internet.

  The memory card 28 includes a nonvolatile memory (for example, EEPROM). The home-use game machine 11 includes a plurality of memory card slots for mounting the memory card 28, and the plurality of memory cards 28 can be mounted simultaneously. The memory card 28 is configured to be detachable from the memory card slot, and is used for storing various game data such as saved data.

  The controller 32 is for the player to input various game operations. The input / output processing unit 30 scans the state of each unit of the controller 32 at regular intervals (for example, every 1/60 seconds). An operation signal representing the scan result is input to the microprocessor 14 via the bus 12.

  The microprocessor 14 determines the game operation of the player based on the operation signal from the controller 32. The consumer game machine 11 is configured so that a plurality of controllers 32 can be connected. That is, in the consumer game machine 11, the microprocessor 14 performs game control based on the operation signal input from each controller 32.

[1-2. First virtual three-dimensional space]
In the game apparatus 10, for example, a soccer game is executed in which a player operated by a player plays a soccer game. This soccer game is realized by the microprocessor 14 executing a program read from the optical disc 25.

  When a soccer game is executed in the game apparatus 10, a virtual three-dimensional space corresponding to the game is constructed in the main memory 26. Hereinafter, this virtual three-dimensional space is referred to as a first virtual three-dimensional space 40.

  FIG. 2 is a diagram illustrating an example of the first virtual three-dimensional space 40. As shown in FIG. 2, an Xw axis, a Yw axis, and a Zw axis that are orthogonal to each other are set in the first virtual three-dimensional space 40. The position of each object arranged in the first virtual three-dimensional space 40 is specified by the world coordinate values (coordinate values of the world coordinate system) of these coordinate axes.

  The shape of each object arranged in the first virtual three-dimensional space 40 is represented by a polygon. For example, the surface of the object in the first virtual three-dimensional space 40 is divided into minute triangular polygons. As the number of objects increases or the number of objects increases, the number of polygons increases. Therefore, the processing load on the game apparatus 10 when displaying the game screen increases.

  When the game screen is displayed on the display unit 18, an image is created based on three-dimensional coordinates indicating the vertices of polygons included in the visual field of the virtual camera 52 described later. For example, the three-dimensional coordinates indicating the vertices of the polygon may be stored in the game data storage unit 60 described later, or may be calculated based on a predetermined calculation formula.

  Further, for example, the color to be displayed on each pixel of the game screen is specified based on the color information of the object stored in the game data storage unit 60. For example, the color of the player's uniform is specified. Note that the display method of the game screen is not limited to this. For example, the above color information may be displayed as a database in a ROM (not shown) and read out.

  As shown in FIG. 2, a field object 42 representing a ground where soccer is played is arranged in the first virtual three-dimensional space 40. For example, the field object 42 is arranged in parallel to the Xw-Zw plane.

  Stadium objects 44a, 44b, 44c, and 44d (hereinafter collectively referred to simply as the stadium object 44) are arranged so as to surround the four sides of the field object 42. The stadium object 44 may include, for example, an object representing a spectator or a signboard.

  On the field object 42, a goal object 46 representing a soccer goal, a character object 48 representing a player, a ball object 50 representing a soccer ball, and the like are arranged. That is, a soccer game venue is formed in the first virtual three-dimensional space 40.

  Note that an object representing a signboard or the like may be arranged in an area outside the pitch on the field object 42. The pitch is an area surrounded by the goal line and the touch line in the area of the field object 42.

  A plurality of character objects 48 are arranged in the first virtual three-dimensional space 40. That is, eleven character objects 48 belonging to one team and eleven character objects 48 belonging to the other team are arranged.

  When the player operates one team, any one of the character objects 48 belonging to the team is used for the player's operation by an input from the controller 32. The character object 48 and the ball object 50 move in the first virtual three-dimensional space 40 according to the game situation.

  A virtual camera 52 (viewpoint) is set in the first virtual three-dimensional space 40. The game apparatus 10 displays a game screen representing a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52 on the display unit 18. That is, each object included in the visual field corresponding to the virtual camera 52 is displayed on the display unit 18 as a game screen.

  The field of view of the virtual camera 52 is determined by, for example, the position coordinates of the virtual camera 52, the line-of-sight vector indicating the line-of-sight direction of the virtual camera 52, the field angle of the virtual camera 52, the aspect ratio of the game screen, and the like. These values are stored in the main memory 26 and appropriately changed according to the game situation.

  The game screen displayed on the display unit 18 is created based on, for example, a game data storage unit 60 described later. Specifically, the position coordinates (world coordinates) of each object arranged in the visual field of the virtual camera 52 are converted into two-dimensional coordinates (screen coordinates) corresponding to the game screen based on a predetermined matrix calculation. That is, the coordinates indicating the vertex of each polygon are converted into two-dimensional coordinates. The two-dimensional coordinates are information for specifying the position on the game screen where the object is to be displayed.

  The display of the game screen displayed on the display unit 18 is updated every predetermined time (for example, every 1/60 seconds). An Xs axis and a Ys axis that are orthogonal to each other are set on the game screen. For example, the upper left corner of the game screen is the origin O (0, 0), and coordinates corresponding to each pixel are assigned. That is, the two-dimensional coordinates corresponding to the object arranged in the field of view of the virtual camera 52 become the coordinates in the area corresponding to the game screen.

[1-3. Functions realized with game devices]
FIG. 3 is a functional block diagram showing a functional group realized in the game apparatus 10. As shown in FIG. 3, in the game apparatus 10, a game data storage unit 60, a first image creation unit 62, a second image creation unit 64, a depth information acquisition unit 66, and a display control unit 68 are realized. These functions are realized by the microprocessor 14 operating in accordance with a program read from the optical disc 25.

[1-3-1. Game data storage unit]
The game data storage unit 60 is realized mainly with the main memory 26 and the optical disc 25. The game data storage unit 60 stores various data necessary for the game. In the case of the present embodiment, the game data storage unit 60 stores game situation data indicating the current situation of the first virtual three-dimensional space 40 and the like.

  The first virtual three-dimensional space 40 shown in FIG. 2 is constructed in the main memory 26 based on the game situation data. The game situation data includes, for example, three-dimensional coordinates where each object is to be arranged, information indicating the vertex of a polygon corresponding to the object, three-dimensional coordinates of the virtual camera 52, color information regarding the color of the game screen, such as the color of the object. Is stored.

  In the game situation data, various types of information related to the visual field of the virtual camera 52 are stored. That is, the game situation data stores the line-of-sight vector of the virtual camera 52, the viewing angle, the aspect ratio of the game screen, and the like. The value stored in the game situation data is updated as appropriate according to the game situation.

[1-3-2. First image creation unit]
The first image creation unit 62 is realized mainly by the microprocessor 14. The first image creation unit 62 creates a first image representing a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52 (viewpoint). The first image is created by referring to the game data storage unit 60, for example. In other words, the first image is an image in which each object included in the visual field of the virtual camera 52 is not blurred and is given a color corresponding to the object.

  FIG. 4A is a diagram illustrating an example of the first image. The first image shows a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52. As shown in FIG. 4A, each object included in the visual field of the virtual camera 52 is given a predetermined color as it is. An image in the state is created.

[1-3-3. Second image creation unit]
The second image creation unit 64 is realized mainly by the microprocessor 14. The second image creation unit 64 represents a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52 (viewpoint), and creates a second image subjected to the blurring process. The blurring process is a process for blurring the color of each object arranged in the first virtual three-dimensional space 40. As the blurring process, a general blurring process can be used.

  FIG. 4B is a diagram illustrating an example of the second image. In FIG. 4B, the object subjected to the blurring process is schematically shown by a dotted line. That is, in the second image, the outline of each object and the color of the internal area are blurred compared to the first image shown in FIG. 4A.

  For example, the second image is created by referring to the game data storage unit 60 as in the case of the first image. The second image is different from the first image in that the color of each object stored in the game data storage unit 60 is blurred.

  The second image may be created by performing a blurring process corresponding to an object included in the field of view of the virtual camera 52 based on an arbitrary method. For example, the second image is generated based on the first image.

  More specifically, first, the first image is duplicated and stored in the main memory 26. By changing the pixel value of one pixel corresponding to the copied first image to the average value of the surrounding eight pixel values surrounding the pixel, blurring processing is performed to obtain a second image. May be. In addition, the pixel value of one pixel corresponding to the copied first image may be a value obtained by mixing the colors of four pixels above, below, left, and right of this pixel.

[1-3-4. Depth information acquisition unit]
The depth information acquisition unit 66 is an image representing a state in which the second virtual three-dimensional space 40 ′ in which the number of polygons is reduced compared to the first virtual three-dimensional space 40 is viewed from the virtual camera 52 ′ (viewpoint). For each pixel, depth information (distance information) related to the distance from the virtual camera 52 (viewpoint) is acquired. The second virtual three-dimensional space 40 ′ will be described later. Hereinafter, the depth information acquired by the depth information acquisition unit 66 is referred to as depth information corresponding to the second virtual three-dimensional space 40 ′.

  The depth information is information indicating the depth (distance) between the object portion represented by each pixel and the virtual camera 52 '. The depth refers to the distance of a straight line connecting the viewpoint and the object portion, that is, the distance in the viewpoint direction. The depth information is created by a programmable shader or the like stored in a ROM or the like (not shown) and stored in the main memory 26. The timing at which the depth information is created may be arbitrary. For example, the depth information is created at the update timing of the game screen displayed on the display unit 18.

  The depth information is expressed by, for example, an 8-bit gray scale image and stored in the main memory 26 or the like. In this embodiment, the pixel value of the pixel closest to the viewpoint is 255 (represents white), and the pixel value of the farthest pixel is 0 (represents black). That is, the pixel value is expressed between 0 and 255 according to the distance from the viewpoint. The depth information creation method is not limited to this, and various known methods can be applied.

[Second virtual three-dimensional space]
As described above, the depth information acquisition unit 66 acquires depth information based on the second virtual three-dimensional space 40 ′ in which the number of polygons is reduced compared to the first virtual three-dimensional space 40. In the present embodiment, the game apparatus 10 reduces the number of polygons by removing predetermined objects from the objects included in the first virtual three-dimensional space 40.

  FIG. 5 is a diagram illustrating the second virtual three-dimensional space 40 ′. As shown in FIG. 5, for example, the goal object 46, the character object 48, and the ball object 50 are removed from the first virtual three-dimensional space 40. That is, in the second virtual three-dimensional space 40 ′, the number of polygons corresponding to the total number of polygons included in these removed objects is reduced compared to the first virtual three-dimensional space 40. The object to be removed may be predetermined.

  As shown in FIG. 5, the shape of the stadium object 44 may be simplified. For example, the surfaces constituting the stadium object 44 are simplified so as to be parallel to the Yw axis direction. Hereinafter, this is referred to as a stadium object 44 '.

  The number of polygons included in the stadium object 44 ′ is smaller than that of the stadium object 44. In the second virtual three-dimensional space 40 ', the stadium object 44 is replaced with a stadium object 44'. The stadium object 44 ′ is arranged at a position corresponding to the position of the stadium object 44.

  The second virtual three-dimensional space 40 ′ includes stadium objects 44 a ′, 44 b ′, 44 c ′, and 44 d ′ so as to surround the four sides of the field object 42 ′. Due to the field object 42 ′ and the stadium object 44 ′, the second virtual three-dimensional space 40 ′ has a substantially box shape as shown in FIG. 5.

  A virtual camera 52 '(viewpoint) is arranged in the second virtual three-dimensional space 40'. In the present embodiment, it is assumed that the three-dimensional coordinates of the virtual camera 52 and the virtual camera 52 'are the same. The depth information acquisition unit 66 acquires depth information based on the second virtual three-dimensional space 40 ′ described above.

  FIG. 6 is a diagram illustrating an example of depth information. The example shown in FIG. 6 is depth information corresponding to the second virtual three-dimensional space 40 ′ shown in FIG. 5. That is, only the field object 42 and the simplified stadium object 44 in the first virtual three-dimensional space 40 are considered, and the depth information is created. In the example of FIG. 6, the depth information is virtually divided into four levels (region E1 to region E4 in FIG. 6).

  As shown in FIG. 6, the pixel area E1 that is close to the virtual camera 52 'is white (area without shading), and the pixel area E4 that is far from the virtual camera 52' is black (has shading). Area) is expressed. The density of the areas E2 and E3 between the areas E1 and E4 is determined according to the distance from the virtual camera 52 '. That is, the distance from the virtual camera 52 'is expressed by the pixel value.

  The depth information only needs to represent the depth corresponding to the second virtual three-dimensional space 40 ′, and the data configuration example of the depth information is not limited to this. For example, the image may be an image expressed by an RGB color model instead of the gray scale image as shown in FIG. 6, and the coordinates of each pixel and the value indicating the distance are associated with the data table in the main memory 26. May be stored.

[1-3-5. Display control unit]
The display control unit 68 is realized mainly by the microprocessor 14 and the image processing unit 16. The display control unit 68 determines the ratio of combining each pixel of the first image and the second image based on the depth information, and causes the display unit 18 to display a screen on which the first image and the second image are combined.

  FIG. 4C is a diagram illustrating an example of an image displayed by the display control unit 68. In the example of FIG. 4C, similarly to FIG. 4B, the object subjected to the blurring process is schematically indicated by a dotted line. In addition, the finer the dotted line, the more blurred the color of the object.

  The display control unit 68 can display an image obtained by combining the first image and the second image, thereby clearly displaying an object close to the viewpoint and blurring and displaying an object far from the viewpoint.

  As a method for the display control unit 68 to synthesize the first image and the second image, for example, translucent synthesis using a so-called alpha value (semi-transparent synthesis rate, transparency) is used. If the alpha value is a real number between 0 and 1, the pixel value of a pixel on the game screen (coordinate is (Xs, Ys)) is "(1-alpha value) x first image coordinate (Xs, Ys)" Pixel value + alpha value × pixel value of second image coordinates (Xs, Ys) ”.

  In this embodiment, the depth information value of the pixel (Xs, Ys) in the depth information (see FIG. 6) acquired by the depth information acquisition unit 66 is used as the first pixel and the second image pixel (Xs, Ys). ), The alpha values of the pixels (Xs, Ys) of the first image and the second image are calculated.

  That is, the alpha value is determined based on the depth information. In the present embodiment, the alpha value increases as the depth of the pixel increases. That is, the greater the distance from the viewpoint, the greater the degree of blurring. On the other hand, the smaller the depth, the smaller the alpha value. That is, the closer to the viewpoint, the smaller the degree of blurring.

  Note that the ratio of combining the pixels of the first image and the second image may be determined based on the depth information, and the image combining method is not limited to this. Any known method can be applied to the image composition method.

[1-4. Processing executed on game device]
FIG. 7 is a flowchart illustrating an example of processing executed at predetermined time intervals (for example, every 1/60 seconds) in the game apparatus 10. The processing of FIG. 7 is executed by the microprocessor 14 operating according to a program read from the optical disc 25.

  As shown in FIG. 7, first, the microprocessor 14 (first image creation unit 62) refers to the game data storage unit 60 stored in the main memory 26, and uses the first virtual three-dimensional space 40 as the virtual camera 52. A first image representing the state seen from the above is created (S101). The first image created in S101 (see FIG. 4A) is an image in which the color of each object is represented as it is without blurring each object included in the visual field of the virtual camera 52.

  The microprocessor 14 (second image creation unit 64) represents a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52, and creates a second image subjected to the blurring process (S102). The second image created in S102 (see FIG. 4B) is, for example, an image obtained by performing a predetermined blurring process on the first image.

  The microprocessor 14 (depth information acquisition unit 66) acquires depth information corresponding to the second virtual three-dimensional space 40 '(S103). In the present embodiment, depth information corresponding to the second virtual three-dimensional space 40 ′ obtained by removing the goal object 46, the character object 48, and the ball object 50 from the first virtual three-dimensional space 40 is acquired. As described above, the depth information is generated and stored in the main memory 26 or the like by the programmable shader or the like every time the game screen display timing comes.

  The microprocessor 14 (display control unit 68) determines the ratio of semitransparent composition of each pixel based on the depth information (S104). The ratio determined in S104 is, for example, an alpha value, and is stored in the main memory 26 in association with the pixel position coordinates.

  In S104, for example, the ratio of the translucent composition is determined based on the pixel value of the image (FIG. 6) corresponding to the depth information. More specifically, the display controller 68 calculates the pixel value of a certain pixel as “(1−alpha value) × pixel value of the first image + alpha value × pixel value of the second image”, so that the game screen is displayed. In S304, the alpha value = the maximum alpha value of the second image (for example, 0.95) * (1−pixel value of depth information / 255) is calculated in S304.

  By determining the ratio of semitransparent composition in this way, the ratio according to the depth information can be determined for each pixel. In the above example, since the alpha value is smaller as the pixel is closer to the virtual camera 52, the ratio of the second image can be reduced. That is, the degree of blurring of the object decreases as the pixel is closer to the virtual camera 52.

  In S304, the ratio of the semi-transparent composition may be determined based on the depth information, and the method for determining the ratio of the semi-transparent composition is not limited to this. For example, a data table in which the depth information and the ratio of the semi-transparent composition are associated may be prepared, or the ratio of the translucent composition may be calculated by substituting the depth information into a predetermined calculation formula. Also good.

  The microprocessor 14 (display control unit 68) combines the first image and the second image and causes the display unit 18 to display them (S105). For example, a composite image (FIG. 4C) in which the first image (FIG. 4A) and the second image (FIG. 4B) are combined based on the translucent combination ratio determined in S <b> 104 is displayed on the display unit 18. . That is, a composite image in which the pixel value of a certain pixel is “(1−alpha value) × pixel value of first image + alpha value × pixel value of second image” is displayed.

[1-5. Summary of Embodiment 1]
Based on the depth information corresponding to the second virtual three-dimensional space 40 ′, the game device 10 according to the first embodiment described above determines the ratio of the translucent composition of the first image and the second image, and Based on the ratio, the first image and the second image are combined and displayed on the display unit 18. According to the game device 10 in the first embodiment, an object close to the virtual camera 52 can be clearly displayed, and a distant object can be displayed in a blurred manner, thereby realizing a sense of perspective.

  In addition, according to the game apparatus 10, depth information is acquired based on the second virtual three-dimensional space 40 ′ in which the number of polygons is reduced compared to the first virtual three-dimensional space 40, thereby expressing perspective. Can be realized. According to the game device 10, for example, the processing load on the game device 10 can be reduced as compared with the case where depth information is acquired based on the first virtual three-dimensional space 40.

  More specifically, for example, when a large number of objects are included in the field of view of the virtual camera 52, when creating depth information in consideration of all of these objects, due to an increase in the number of polygons A processing load is applied to the game apparatus 10. However, when many objects are included in the field of view, the objects displayed on the game screen are often relatively small.

  Therefore, between the depth information created by removing the object and the depth information created by taking all the objects into consideration, for example, compared to when the object is zoomed and displayed on the game screen, etc. Therefore, the difference in data contents is relatively small. That is, as in the present embodiment, the perspective can be expressed even if the first image and the second image are synthesized based on the depth information acquired based on the second virtual three-dimensional space 40 ', and the processing Reduction of load can be realized.

  The present invention is not limited to the embodiment described above, and can be appropriately changed without departing from the spirit of the present invention. For example, although the home game machine has been described as an example in the present embodiment, an arcade game machine installed in a game center or the like may be used.

  In the present embodiment, the objects included in the second virtual three-dimensional space 40 ′ are the field object 42 ′ and the stadium object 44 ′, but the objects placed in the first virtual three-dimensional space 40 Of these, a predetermined object may be included. That is, the object removed from the first virtual three-dimensional space 40 is not limited to the example of this embodiment.

  Further, the second virtual three-dimensional space 40 ′ (FIG. 5) having a substantially box shape has been described as an example. However, the second virtual three-dimensional space 40 ′ is compared with the first virtual three-dimensional space 40. As long as the number of polygons is reduced, the field object 42 ′ may be surrounded by an inclined stadium object 44 ′. That is, it may be a mortar-shaped second virtual three-dimensional space 40 '.

  Moreover, although the process shown in FIG. 7 was demonstrated so that it might be performed at predetermined intervals, you may provide the conditions for performing the process of FIG. For example, an object that is close to the virtual camera 52 has a large area occupied by the object in the game screen. Since the area occupied by this object spans areas taking various values of depth information, the error of depth information in this area increases. That is, the object is partially blurred and displayed. In such a situation, the process of FIG. 7 may not be executed.

  For example, when the position of the virtual camera 52 is away from the field object 42 by a predetermined distance or more, the area occupied by each object arranged on the field object 42 in the game screen is reduced, and the depth information in this area is reduced. Since the error is small, there is no object that is partially blurred and displayed. Further, for example, when the ball object 50 is disposed at a position higher than a predetermined height, the virtual camera 52 may follow the movement of the ball object 50 and the position of the virtual camera 52 may be separated from the field object 42. . Even in such a case, as described above, there is no object that is displayed partially blurred. Only in these predetermined cases, the process of FIG. 7 may be executed.

  On the other hand, when the distance between the character object 48 and the virtual camera 52 is within a predetermined value (that is, when zooming in), the area occupied by each object arranged on the field object 42 in the game screen increases. Since an error in depth information in the area becomes large, there are objects that are partially blurred and displayed. In such a case, the process shown in FIG. 7 may not be performed.

[2. Embodiment 2]
The second embodiment will be described below. In the first embodiment, depth information corresponding to the second virtual three-dimensional space 40 ′ in which a predetermined object is removed from the first virtual three-dimensional space 40 is created.

  However, if an object to be removed from the first virtual three-dimensional space 40 is determined in advance, there is a possibility that screen display processing according to the game situation cannot be performed. For example, when the virtual camera 52 and the character object 48 approach each other, there is a possibility that the depth information for combining the first image and the second image may not be acquired accurately.

  FIG. 8A is an example of depth information acquired based on the first virtual three-dimensional space 40 when the virtual camera 52 and the character object 48 approach each other. In the example shown in FIG. 8A, the depth information is virtually divided into four stages (region E1 to region E4), as in FIG. Since the pixel on which the character object 48 is displayed is close to the virtual camera 52, it is included in the region E1. The other areas E2 to E4 are the same as in FIG.

  FIG. 8B is an example of depth information acquired by the game apparatus 10 of the first embodiment when the virtual camera 52 and the character object 48 approach each other. In the example shown in FIG. 8B, the area where the character object 48 is arranged in FIG. 8A is indicated by a dotted line.

  As shown in FIG. 8, the character object 48 is arranged over the areas E1 to E4, and pixels that should be originally expressed as the area E1 are also expressed in the areas E2 to E4. That is, an error occurs in the depth information. The closer the virtual camera 52 and the character object 48 are, the larger the area of the character object 48 becomes, so the number of pixels in which this error occurs increases. In this case, when the processing of the first embodiment is applied as it is, when the first image and the second image are combined, the head of the character object 48 is clearly displayed even though the feet of the character object 48 are clearly displayed. Will be displayed.

  In order to prevent the above, the second virtual three-dimensional space 40 ′ in the second embodiment is the virtual camera 52 (among the predetermined objects among the plurality of objects arranged in the first virtual three-dimensional space 40. It is characterized in that a predetermined object having a depth with respect to the (viewpoint) is removed from a predetermined value.

  Note that the hardware configuration and functional block diagram of the game apparatus 10 according to the second embodiment are the same as those in the first embodiment (see FIGS. 1 and 3), and thus the description thereof is omitted here. Also in the game apparatus 10 according to the second embodiment, the first virtual three-dimensional space 40 similar to that in FIG. 2 is generated and the game is executed.

  FIG. 9 is a diagram illustrating an example of the first virtual three-dimensional space 40 in the second embodiment. In FIG. 9, character objects 48 arranged on the field object 42 are character objects 48a, 48b, and 48c.

  The virtual camera 52 is disposed behind the character object 48a. In the example of FIG. 9, the distance between the virtual camera 52 and the character object 48 a is less than a predetermined value, and the distance between the virtual camera 52 and the character object 48 b and the character object 48 c and the distance between other objects such as the goal object 46 are as follows. , Is a predetermined value or more. The other objects are the same as in FIG.

[2-1. Second virtual three-dimensional space]
As described above, in the second virtual three-dimensional space 40 ′ according to the second embodiment, the depth from the virtual camera 52 (viewpoint) among a plurality of objects arranged in the first virtual three-dimensional space 40 is a predetermined value or more. This is different from the first embodiment in that the predetermined object is removed.

  FIG. 10 is a diagram illustrating a second virtual three-dimensional space 40 ′ according to the second embodiment. In the example of FIG. 10, the case where the character object 48a whose depth with the virtual camera 52 is less than a predetermined value exists in the first virtual three-dimensional space 40 shown in FIG.

  In the second virtual three-dimensional space 40 ′ according to the second embodiment, the predetermined object whose depth from the virtual camera 52 is equal to or larger than the predetermined value is removed, so that the character object 48 is arranged without being removed as shown in FIG. The This is a character object 48a '. That is, the field object 42 ′, the stadium object 44 ′, and the character object 48 a ′ are arranged in the second virtual three-dimensional space 40 ′.

  Similarly to the first embodiment, the depth information acquisition unit 66 performs the virtual camera 52 (viewpoint) for each pixel of the image representing the state in which the second virtual three-dimensional space 40 ′ is viewed from the virtual camera 52 ′ (viewpoint). ) To obtain depth information (distance information) related to the distance from.

  The depth information is information indicating the depth (distance) between the portion of the object represented by each pixel and the virtual camera 52 ', as in the first embodiment. The depth refers to the distance of a straight line connecting the viewpoint and the object, that is, the distance in the viewpoint direction.

  FIG. 11 is a diagram illustrating an example of depth information according to the second embodiment. The example in FIG. 11 shows depth information corresponding to the second virtual three-dimensional space 40 ′ in FIG. 10. That is, depth information indicating the depth of each of the field object 42 ′, the stadium object 44 ′, the character object 48 a ′, and the virtual camera 52 ′ is created. In this example, depth information is virtually divided into four stages (region E1 to region E4 in FIG. 11) as in FIG.

  That is, the depth information in the second embodiment is different from the depth information in the first embodiment (FIG. 6) in that the character object 48a 'is considered. In the example shown in FIG. 11, the area corresponding to the character object 48a 'is an area E1 that is closest to the virtual camera 52'. Other regions E2 to E4 are the same as those in the first embodiment.

[2-2. Processing executed on game device]
The process shown in FIG. 12 corresponds to the process shown in FIG. 6 in the first embodiment. That is, the process shown in FIG. 12 is executed at predetermined time intervals (for example, every 1/60 seconds) in the game apparatus 10.

  As shown in FIG. 12, S201 and S202 are the same as S101 and S102, respectively, and thus the description thereof is omitted.

  The microprocessor 14 determines whether or not an object whose depth from the virtual camera 52 is less than a predetermined value is arranged in the first virtual three-dimensional space 40 (S203). Specifically, for example, the determination is made based on whether or not the distance between the position coordinates of each object stored in the game data storage unit 60 and the position coordinates of the virtual camera 52 is equal to or greater than a predetermined value. . This predetermined value is stored in advance on the optical disc 25 or the like.

  Note that in S203, the determination may be made based on the positional relationship between the virtual camera 52 and each object, and the determination method in S203 is not limited to this. In addition, for example, it is determined based on whether or not the distance from the polygon closest to the virtual camera 52 among the polygons corresponding to each object arranged in the first virtual three-dimensional space 40 is a predetermined value or more. You may make it do.

  When an object with a depth less than a predetermined value is arranged (S203; Y), the microprocessor 14 (depth information acquisition unit 66) removes an object with a depth greater than or equal to a predetermined value and includes an object with a depth less than a predetermined value. The depth information corresponding to the second virtual three-dimensional space 40 ′ is acquired (S204).

  In S204, depth information is acquired by performing the same processing as in S103. The depth information acquired in S204 is depth information in a state where an object whose depth is less than a predetermined value is included. That is, as in the example of FIG. 11, the depth information includes the character object 48a '.

  When the object whose depth information is less than the predetermined value is not arranged (S203; N), the microprocessor 14 (depth information acquisition unit 66) acquires depth information corresponding to the second virtual three-dimensional space 40 ′ ( S205). In S205, as in S103, depth information corresponding to the second virtual three-dimensional space 40 'as shown in FIG. 5 is acquired.

  Since S206 and S207 are the same as S104 and S105, respectively, description thereof will be omitted.

[2-3. Summary of Embodiment 2]
The game apparatus 10 according to the second embodiment described above acquires depth information corresponding to the second virtual three-dimensional space 40 ′ from which a predetermined object having a depth with the virtual camera 52 of a predetermined value or more is removed. According to the game device 10 in the second embodiment, even when there is an object approaching the virtual camera 52, the perspective is expressed on the game screen while preventing the object from being partially blurred and displayed. Can be made.

  That is, according to the game device according to the second embodiment, for example, as described above, it is possible to avoid a situation in which an error occurs in depth information, so even if a predetermined object and a viewpoint approach, Perspective can be expressed according to the game situation while reducing the processing load.

[3. Embodiment 3]
The third embodiment will be described below. In the second embodiment, depth information is created in consideration of an object whose distance from the viewpoint is less than a predetermined value.

  However, for example, when the depth information is created as shown in FIG. 11, the head pixel of the character object 48a ′ is the region E1, but the surrounding pixels are the region E3 or the region E4. Have different values of depth information. That is, since the ratio determined by the display control unit 68 is different, the head of the character object 48a is clearly displayed, but the surrounding pixels are blurred and displayed.

  When creating the second image, a blurring process is performed on surrounding pixels. For example, the surrounding pixels of the outline of the character object 48a (that is, the pixels subjected to the blurring process) are the color of the surrounding pixels (the lawn color of the field object 42, etc.), the uniform of the character object 48a and the hair. Color and the like are mixed. There is a possibility that the color of the character object 48a may be expressed outside the outline of the player. That is, there is a possibility that the outline of the character object 48a 'flickers and becomes difficult to see.

  In order to prevent the above, the third embodiment is characterized in that the color around the predetermined area based on the object having the difference in depth information as described above is changed.

  Note that the hardware configuration and functional block diagram of the game apparatus 10 according to the third embodiment are the same as those in the first embodiment (see FIGS. 1 and 3), and thus the description thereof is omitted here. However, the second image creation unit 64 according to the third embodiment includes a target pixel of an image showing the first virtual three-dimensional space 40 viewed from the virtual camera 52 (viewpoint) and a plurality of surroundings adjacent to the target pixel. An acquisition unit configured to acquire an image obtained by changing a color of a predetermined region based on the target pixel based on a color of the surrounding pixel when a difference in depth corresponding to the viewpoint with any of the pixels is equal to or larger than a reference value; The second embodiment differs from the first and second embodiments in that a second image in which the image is subjected to the blurring process is created.

  Also in the game apparatus 10 according to the third embodiment, the first virtual three-dimensional space 40 similar to that in FIG. 2 is generated and the game is executed. Since the second virtual three-dimensional space 40 'of the third embodiment is the same as that of the second embodiment (see FIG. 10), description thereof is omitted.

  First, an image created by the game apparatus 10 according to the third embodiment will be described.

  FIG. 13A is a diagram illustrating an example of a first image created by the first image creation unit 62. The first image shows a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52 as in the first embodiment.

  FIG. 13B is a diagram illustrating an example of an image acquired by the acquisition unit of the second image creation unit 64. FIG. 13B shows an example in which the pixels constituting the head of the character object 48 shown in FIG. 13A have a difference in depth from the surrounding pixels.

  Although details of the processing will be described later, as shown in FIG. 13B, the color around the predetermined area based on the pixel of interest having a difference between the surrounding pixels and the depth information is changed. For example, the color of the predetermined area 49 on the head of the character object 48 is changed to a color corresponding to the surrounding pixels. In the example shown in FIG. 13B, the head region 49a is changed to the color of the stadium object 44 corresponding to surrounding pixels, for example. On the other hand, the head region 49b is changed to the color of the field object 42 corresponding to surrounding pixels, for example.

  The second image creation unit 64 is different from the first and second embodiments in that the second image creation unit 64 creates a second image obtained by performing blurring processing on the image shown in FIG. 13B. Since the blurring process is the same as in the first and second embodiments, the second image is not shown.

  The second image is obtained by blurring an image in which the color of a predetermined area around an object having a depth difference is filled with the color of surrounding pixels. That is, by setting the pixels close to the outline of the character object 48 as the colors of the surrounding pixels, the color of the character object 48 does not bleed out due to the blurring process, thereby preventing the screen from flickering as described above. Can do.

[3-1. Processing executed on game device]
The process shown in FIG. 14 corresponds to the process shown in FIG. 6 in the first embodiment and FIG. 12 in the second embodiment. That is, the process shown in FIG. 14 is executed in the game apparatus 10 every predetermined time (for example, every 1/60 seconds).

  As shown in FIG. 14, S301 and S302 are the same as S101 and S203, respectively, and thus the description thereof is omitted.

  When an object with a depth less than a predetermined value is arranged (S302; Y), the microprocessor 14 (depth information acquisition unit 66) removes an object with a depth greater than or equal to a predetermined value and includes an object with a depth less than a predetermined value. The depth information corresponding to the second virtual three-dimensional space 40 ′ is acquired (S303). S303 is the same process as S204.

  Next, the microprocessor 14 includes an arbitrary pixel (target pixel) corresponding to an image representing a state in which the first virtual three-dimensional space 40 is viewed from the virtual camera 52, and a plurality of surrounding pixels adjacent to the target pixel. It is determined whether or not the difference in depth is greater than or equal to a reference value (S304).

  In S304, the depth information of the pixel (Xs, Ys) of the depth information (see FIG. 11) obtained in S303 is the same position of the image showing the first virtual three-dimensional space 40 as viewed from the virtual camera 52. The processing of S304 is executed by regarding the depth information of the pixel (Xs, Ys).

  FIG. 15 is a diagram for explaining the relationship between a target pixel and surrounding pixels. As shown in FIG. 15, for example, the two-dimensional coordinate of the pixel of interest A1 is (Xs, Ys). The depth information value of the target pixel A1 is set to 230. Eight surrounding pixels surrounding the pixel of interest A1 are referred to as a surrounding pixel B1 to a surrounding pixel B8. Note that the depth information is acquired in S302.

  The two-dimensional coordinates of the surrounding pixel B1 are (Xs-1, Ys-1). The depth information value of the surrounding pixel B1 is set to 230. The two-dimensional coordinates of the surrounding pixel B8 are (Xs + 1, Ys + 1). The value of the depth information of the surrounding pixel B8 is 46. Similarly, the coordinates and depth information of the surrounding pixels B2 to B7 are as shown in FIG.

  In S304, for example, it is determined whether or not there is a difference in depth information between the target pixel A1 and each of the surrounding pixels B1 to B8 that is greater than or equal to a reference value. For example, if the reference value is 100, in the example of FIG. 15, there are four surrounding pixels B4, B6, B7, and B8 that have a depth difference equal to or greater than the reference value with respect to the target pixel A1. That is, the pixel of interest A1 is determined to have a depth difference equal to or greater than the reference value from any of the surrounding pixels B1 to B8.

  When the difference in depth between the target pixel and the surrounding pixels is greater than or equal to the reference value (S304; Y), the microprocessor 14 (second image creation unit 64, acquisition unit) is based on the target pixel based on the color of the surrounding pixels. An image in which the color of the predetermined area is changed is acquired (S305).

  When the target pixel and the peripheral pixels have the relationship shown in FIG. 15, the predetermined area based on the target pixel in S305 is, for example, an area inside the object including the target pixel. That is, the region includes the target pixel and a pixel group in which the depth difference from the target pixel is less than the reference value among the pixel group whose distance from the target pixel is within the reference distance. For example, the target pixel A1, the surrounding pixel B2, and the surrounding pixel B5 are configured by three pixels. The predetermined area based on the target pixel may be an area including the target pixel, and a method for determining this area is arbitrary. For example, an area within a circle having a radius of 16 pixels centered on the target pixel may be set as the predetermined area.

  The color of the predetermined area based on the target pixel is changed based on the color of the surrounding pixels. For example, the colors of the target pixel A1, the surrounding pixel B2, and the surrounding pixel B5 are changed to the average values of the colors of the surrounding pixels B4, B6, B7, and B8. The processes of S304 and S305 are executed for all the pixels corresponding to the image. That is, the color changing process of S305 is performed on all the target pixels whose difference between the surrounding pixels and the depth is equal to or greater than the reference value.

  In S305, the color of the predetermined area based on the target pixel may be changed based on the color of the surrounding pixels, and the color changing method is not limited to the above example. For example, the color of the predetermined area may be calculated based on a predetermined calculation formula.

  Returning to FIG. 14, the microprocessor 14 (second image creation unit 64) performs blurring processing on the image acquired in S <b> 305 to create a second image (S <b> 306).

  On the other hand, when the difference in depth between the target pixel and the surrounding pixels is not greater than or equal to the reference value (S304; N), the microprocessor 14 (second image creation unit 64) creates the second image in the same manner as S102 (S307). ).

  On the other hand, when an object having a depth less than the predetermined value is not arranged (S302; N), the microprocessor 14 (second image creation unit 64) creates a second image in the same manner as S102 (S308). Subsequent S309 is the same as S103 and will not be described.

  Since S310 and S311 are the same as S104 and S105, respectively, description thereof will be omitted.

[3-2. Summary of Embodiment 3]
In the game device 10 according to the third embodiment described above, when the difference in depth between the target pixel and the surrounding pixels is greater than or equal to the reference value, the color of the predetermined region based on the target pixel is changed based on the color of the surrounding pixels. Get an image. According to the game device 10 in the third embodiment, the color of an object having a difference between the surroundings and the depth is changed, and the color of the object does not bleed out. Therefore, the screen flickering that occurs when there is a depth difference between pixels. Can be prevented.

[Modification]
In the first to third embodiments, an example in which a predetermined object is removed from the first virtual three-dimensional space 40 to form the second virtual three-dimensional space 40 ′ has been described. The second virtual three-dimensional space 40 ′ may be any one in which the number of polygons included in the first virtual three-dimensional space 40 is reduced, and the state of the second virtual three-dimensional space 40 ′ is as shown in FIG. Or it is not restricted to the example demonstrated with reference to FIG.

  For example, as a modification of the first to third embodiments, the number of polygons may be reduced by simplifying the shape of a predetermined object. In this case, the depth information acquisition unit 66 replaces a predetermined object among a plurality of objects arranged in the first virtual three-dimensional space 40 with an object having a smaller number of polygons than the object. For each pixel of the image representing the appearance of the dimensional space 40 ′ viewed from the virtual camera 52 ′ (viewpoint), depth information indicating the depth of the viewpoint in the line-of-sight direction is acquired.

  FIG. 16 is a diagram for explaining the second virtual three-dimensional space 40 ′ according to the modification. As shown in FIG. 16, in the second virtual three-dimensional space 40 ′, the goal object 46, the character object 48, and the ball object 50 of the first virtual three-dimensional space 40 are, for example, rectangular objects having a small number of polygons. It becomes the replaced virtual three-dimensional space. As a result, the second virtual three-dimensional space 40 ′ becomes a virtual three-dimensional space in which the number of polygons is reduced compared to the first virtual three-dimensional space 40. The simplified shape is not limited to a rectangular parallelepiped as long as the number of polygons is reduced, and is an arbitrary shape.

  In the modification described above, the depth information is acquired based on the second virtual three-dimensional space 40 'in which the number of polygons is reduced. That is, depth information can be acquired based on a smaller number of polygons. As described above, when the number of polygons increases, the depth information creation process becomes complicated. According to the method of the modification, the number of polygons can be reduced as compared with the case where depth information is acquired based on the first virtual three-dimensional space 40, so that the processing load can be reduced.

  When this modification is applied to the third embodiment, the second virtual three-dimensional space 40 ′ is an object whose depth from the viewpoint is a predetermined value or more among a plurality of objects arranged in the first virtual three-dimensional space 40. However, the object is replaced with an object having a smaller number of polygons than the object. That is, an object close to the viewpoint is replaced with a simplified object.

  In the modification, the objects whose shape is simplified are the goal object 46, the character object 48, and the ball object 50, but it is sufficient that the shape of the predetermined object is simplified. For example, when the field object 42 has undulations, the field object 42 may be simplified so as to be flat. In addition, when the stadium object 44 includes a signboard object or the like, the shape may be simplified by omitting the signboard object.

  In the first to third embodiments and the modifications, the example in which the present invention is applied to a game device has been described. However, the image processing device according to the present invention is another device such as a personal computer. Also good.

  DESCRIPTION OF SYMBOLS 10 Game device, 11 Home-use game machine, 12 bus | bath, 14 Microprocessor, 16 Image processing part, 18 Display part, 20 Audio | voice processing part, 22 Audio | voice output part, 24 Optical disk reproduction | regeneration part, 25 Optical disk, 26 Main memory, 28 Memory Card, 30 input / output processing unit, 32 controller, 40 first virtual three-dimensional space, 40 'second virtual three-dimensional space, 42, 42' field object, 44, 44 ', 44a, 44a', 44b, 44b ', 44c, 44c', 44d, 44d 'Stadium object, 46, 46' Goal object, 48, 48 ', 48a, 48a', 48b, 48c Character object, 49 Predetermined area, 49a, 49b area, 50, 50 ' Ball object, 52, 52 'virtual camera, 60 games Data storage unit, 62 first image creation unit, 64 second image creation unit, 66 depth information acquisition unit, 68 display control unit, E1, E2, E3, E4 area, A1 target pixel, B1, B2, B3, B4 , B5, B6, B7, B8 Surrounding pixels.

Claims (8)

An image processing apparatus that displays a screen representing a state in which a first virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint,
First image creating means for creating a first image representing a state of viewing the first virtual three-dimensional space from the viewpoint;
A second image creating means for representing the first virtual three-dimensional space as viewed from the viewpoint, and creating a second image subjected to a blurring process;
Depth information relating to the distance from the viewpoint for each pixel of the image representing a state in which the second virtual three-dimensional space in which the number of polygons is reduced as compared to the first virtual three-dimensional space is viewed from the viewpoint. Depth information acquisition means for acquiring;
Display control means for determining a composition ratio of each pixel of the first image and the second image based on the depth information and displaying a screen on which the first image and the second image are composed;
Including
The second image creation means corresponds to the viewpoint of a target pixel of an image representing a state in which the first virtual three-dimensional space is viewed from the viewpoint, and any of a plurality of surrounding pixels adjacent to the target pixel. Including a obtaining unit that obtains an image in which the color of the predetermined region based on the target pixel is changed based on the color of the surrounding pixel when the difference in depth to be performed is greater than or equal to a reference value, and performing blur processing on the image An image processing apparatus that creates the second image in which an image in which the color of the predetermined area is changed based on the color of the surrounding pixels is blurred .   The depth information acquisition means relates to a distance from the viewpoint for each pixel of an image representing a state in which the second virtual three-dimensional space from which a predetermined object is removed from the viewpoint is viewed from the viewpoint. The image processing apparatus according to claim 1, wherein depth information is acquired.   3. The image processing according to claim 2, wherein the second virtual three-dimensional space is obtained by removing the predetermined object whose distance from the viewpoint is a predetermined value or more from the plurality of objects. apparatus.   The depth information acquisition unit is an image representing a state in which the second virtual three-dimensional space in which a predetermined object among the plurality of objects is replaced with an object having a smaller number of polygons than the object is viewed from the viewpoint. The image processing apparatus according to claim 1, wherein depth information related to a distance from the viewpoint is acquired for each pixel.   The second virtual three-dimensional space is obtained by replacing the predetermined object having a depth greater than or equal to a predetermined value among the plurality of objects with an object having a smaller number of polygons than the object. The image processing apparatus according to claim 4. The first virtual three-dimensional space is a sports game space in which at least a character object and an object representing a sports venue are arranged,
The depth information acquisition unit is an image representing a state in which the second virtual three-dimensional space in which at least the number of polygons corresponding to the character object is reduced compared to the first virtual three-dimensional space is viewed from the viewpoint. for each pixel of the image processing apparatus according to any one of claim 1 to 5, characterized in that to obtain the depth information about the distance from the viewpoint. A control method for an image processing apparatus for displaying a screen representing a state in which a first virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint,
A first image creating step for creating a first image representing a state in which the first virtual three-dimensional space is viewed from the viewpoint;
A second image creating step, wherein the second image creating means represents the first virtual three-dimensional space viewed from the viewpoint, and creates a second image subjected to the blurring process;
Depth information acquisition means, for each pixel of the image representing a state of viewing the second virtual three-dimensional space with a reduced number of polygons compared to the first virtual three-dimensional space from the viewpoint, from the viewpoint A depth information acquisition step of acquiring depth information regarding the distance of
Display control means, display control step of the proportion of combination of the pixels of the first image and the second image is determined based on the depth information, and displays the screen on which the first image and the second image are synthesized When,
Only including,
In the second image creation step, the acquisition unit includes a target pixel of an image representing a state in which the first virtual three-dimensional space is viewed from the viewpoint, and any one of a plurality of surrounding pixels adjacent to the target pixel. An acquisition step of acquiring an image in which a color of a predetermined area based on the target pixel is changed based on a color of the surrounding pixel when the difference in depth corresponding to the viewpoint is equal to or greater than a reference value; Means for performing blur processing on the image to create the second image in which an image in which the color of the predetermined area is changed based on the color of the peripheral pixels is blurred Control method of the device. A program for causing a computer to function as an image processing apparatus that displays a screen representing a state in which a first virtual three-dimensional space in which a plurality of objects are arranged is viewed from a given viewpoint,
First image creating means for creating a first image representing a state of viewing the first virtual three-dimensional space from the viewpoint;
A second image creating means for creating a second image subjected to a blurring process, representing a state in which the first virtual three-dimensional space is viewed from the viewpoint;
Depth information relating to the distance from the viewpoint for each pixel of the image representing a state in which the second virtual three-dimensional space in which the number of polygons is reduced as compared to the first virtual three-dimensional space is viewed from the viewpoint. Depth information acquisition means to acquire,
Display control means for determining a ratio of synthesis of each pixel of the first image and the second image based on the depth information, and displaying a screen on which the first image and the second image are synthesized;
Including
The second image creation means corresponds to the viewpoint of a target pixel of an image representing a state in which the first virtual three-dimensional space is viewed from the viewpoint, and any of a plurality of surrounding pixels adjacent to the target pixel. Including a obtaining unit that obtains an image in which the color of the predetermined region based on the target pixel is changed based on the color of the surrounding pixel when the difference in depth to be performed is greater than or equal to a reference value, and performing blur processing on the image A program for causing the computer to function as an image processing apparatus that creates the second image in which an image in which the color of the predetermined area is changed based on the color of the peripheral pixels is blurred .

Images