JP2009301309A - Image processing program, image processor, and image control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display a video to be projected on an object surface at an image display part with expressions with reality. <P>SOLUTION: This image processing program includes extracting at least one portion of texture data TG for a projection image based on the position of a virtual camera C and a gazing point PG0 of the virtual camera C. Then, the extracted texture data for the projection image are projected to a polygon P2 for the projection image. Thus, a polygon model PM2 for the projection image inside a polygon model PM1 for an object is generated. Then, the polygon model PM2 for the projection image inside the polygon model PM1 for the object is photographed by the virtual camera C from the outside of the polygon model PM1 for the object through the transparent section of the polygon model PM1 for the object. Then, the object and the image projected on the object surface are displayed at an image display part 3. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing program, and more particularly to an image processing program for processing data for displaying an object on an image display unit. The present invention also relates to an image processing apparatus capable of executing the image processing program, and an image control method controlled by a computer based on the image processing program.

  Conventionally, various display techniques for displaying an object on a monitor have been proposed. In particular, in recent years, with the improvement of computer performance, attempts have been made to display as realistic objects as possible on a monitor.

  For example, in a simulation game or a battle game, when an object like a building is displayed on a monitor, a realistic building is reproduced by improving the texture of the building or expressing the scenery reflected in the building window. (See Non-Patent Document 1).

Here, as an example of improving the texture of a building, for example, there is a method of increasing the resolution of the texture or increasing the number of polygons. Moreover, as an example of expressing the scenery reflected in the building window, for example, there is a method of pasting an image for the scenery in front of the building on the building window. In this way, by improving the texture of the building or expressing the scenery reflected in the building window, a realistic building was displayed and reproduced on the monitor.
Professional baseball spirits 3, Konami Digital Entertainment, PS2 version, April 6, 2006

  In a conventional game, when an object such as a building is displayed on a monitor, a realistic building is reproduced by improving the texture of the building or expressing the scenery reflected in the building window. By the way, in recent years, in urban areas and the like, buildings and buildings in which external scenery and other buildings are reflected on the entire wall surface can be seen by glazing almost the entire wall surface. When such a building is reproduced in a virtual space such as a game, a more realistic building is displayed compared to the case where the scenery reflected in the building window is not expressed or the external scenery is simply reflected in one window. can do. However, in the conventional game, even when reproducing a building or building that can reflect the outside scenery on the entire wall surface, the scenery in front of the building is simply pasted on the place corresponding to the window or wall surface of the building. Since the camera was moved and the angle of viewing the building changed, there was a problem that the scenery reflected on the windows and walls of the building did not change. In addition, there is a problem in that it is difficult to reflect the influence of parallax when the position of the camera moves and the angle at which the building is viewed changes in the scenery reflected in the window of the building. Furthermore, there has been a problem that the reflection of the outer wall of the building and the reflection of the window of the building cannot be reproduced properly.

  The present invention has been made in view of such problems, and an object of the present invention is to display an image reflected on the surface of an object on an image display unit in a realistic expression.

An image processing program according to claim 1 is for processing data for displaying an object on an image display unit. In this image processing program, the following functions are realized.
(1) A first texture storage function for storing texture data for an object in the storage unit.
(2) A second texture storage function for storing the texture data for the reflected image corresponding to the image that can virtually appear on the object surface in the storage unit.
(3) A first polygon placement function for placing the object polygon in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the object polygon.
(4) By causing the control unit to recognize coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the object, the polygon for the reflected image is arranged inside the polygon for the object. Second polygon placement function.
(5) A camera placement function for placing the virtual camera in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the virtual camera outside the polygon for the object.
(6) A gaze point arrangement function for arranging the gaze point of the virtual camera in the virtual space by causing the control unit to recognize coordinate data corresponding to the gaze point of the virtual camera.
(7) Based on the position of the virtual camera and the position of the gazing point of the virtual camera, by causing the control unit to execute a process of extracting at least a part of the texture data for the reflected image, the image displayed on the object surface Texture determination function that determines the texture.
(8) A first polygon generation function for generating a polygon model for an object that is at least partially transparent by causing the control unit to execute a process of projecting the texture data for the object onto the object polygon.
(9) A second polygon generation function for generating a polygon model for a reflected image by causing the control unit to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image.
(10) The control unit executes a process of photographing the polygon model for the reflected image inside the polygon model for the object with the virtual camera from the outside of the polygon model for the object through the transparent part of the polygon model for the object. An image display function for displaying an object and an image reflected on the object surface on the image display unit.

  In this image processing program, texture data for an object is stored in the storage unit in the first texture storage function. In the second texture storage function, the texture data for the reflected image corresponding to the image that can virtually appear on the object surface is stored in the storage unit.

  In the first polygon arrangement function, coordinate data for defining the arrangement position of the polygon for the object is recognized by the control unit. Thereby, the polygon for the object is arranged in the virtual space. In the second polygon arrangement function, the coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the object is recognized by the control unit. As a result, the polygon for the reflected image is arranged inside the polygon for the object. In the camera placement function, coordinate data for defining the placement position of the virtual camera outside the polygon for the object is recognized by the control unit. Thereby, the virtual camera is arranged in the virtual space. In the gazing point arrangement function, coordinate data corresponding to the gazing point of the virtual camera is recognized by the control unit. Thereby, the gazing point of the virtual camera is arranged in the virtual space.

  In the texture determination function, processing for extracting at least part of the texture data for the reflected image is executed by the control unit based on the position of the virtual camera and the position of the gazing point of the virtual camera. Thereby, the texture of the image reflected on the object surface is determined. In the first polygon generation function, a process of projecting object texture data onto an object polygon is executed by the control unit. Thereby, a polygon model for an object at least partially transparent is generated. In the second polygon generation function, a process of projecting the extracted reflected image texture data onto the reflected image polygon is executed by the control unit. Thereby, a polygon model for a reflected image is generated.

  In the image display function, the process of photographing the polygon model for the reflected image inside the polygon model for the object with the virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object, It is executed by the control unit. Thereby, the object and the image reflected on the object surface are displayed on the image display unit.

  In this case, at least a part of the texture data for the reflected image is extracted based on the position of the virtual camera and the position of the gazing point of the virtual camera. Then, the extracted texture data for the reflected image is projected onto the polygon for the reflected image. In this way, the texture of the portion of the image reflected on the object surface is determined from the image that can virtually appear on the object surface, and the polygon model for the reflected image inside the polygon model for the object is generated. Then, the polygon model for the reflected image inside the polygon model for the object is photographed by the virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object. Then, the object and the image reflected on the object surface are displayed on the image display unit.

  Thus, according to the first aspect of the present invention, the polygon model for the reflected image arranged inside the polygon model for the object is passed through the transparent portion of the polygon model for the object and the outside of the polygon model for the object. Since the image is captured by the virtual camera, different images (images reflected on the object surface) can be displayed on the image display unit depending on the position where the virtual camera captures the object.

  Here, the transparent part of the polygon model corresponds to a wall surface made of a mirror surface such as a building window or glass in the game space. That is, in terms of internal processing, the polygon model for the reflected image is viewed from the virtual camera through the transparent part of the polygon model as described above, but in the game space, the polygon model is transparent. The part is expressed in correspondence with the windows and walls of the building. For this reason, the polygon model for the internal reflection image is observed by the game player as if it were an external scene reflected on the window or wall of the building. As described above, according to the first aspect of the present invention, an image reflected on the object surface can be displayed on the image display unit with a realistic expression.

  Furthermore, according to the first aspect, an effect in which an image reflected on a window or a wall of a building changes according to the viewpoint of the moving virtual camera (the viewpoint viewed from the character in the game) with a very low processing load. realizable. That is, when trying to express an image reflected on the window or wall of a building that changes with the movement of the virtual camera using the conventional well-known technology, first, the position (coordinates) of the virtual camera and the angle at which the building is viewed Therefore, it is necessary to calculate which part of the scenery around the building is reflected on the building surface and to display the reflected image on the building surface. The CPU is heavily loaded because it is necessary. In addition, since the virtual camera is moving, it is necessary to repeat the above calculation for each frame along with the movement, and the CPU is subjected to a huge load. Adopting a method is not practical. In this regard, according to the method according to claim 1, the enormous calculation as described above is unnecessary, and it is possible to easily realize the change of the image reflected on the building surface or the like while keeping the load applied to the CPU low. it can.

  In the image processing program according to claim 2, in the image processing program according to claim 1, when a camera movement command for moving the virtual camera outside the object polygon is issued from the control unit, Coordinate data indicating the position of the virtual camera is recognized by the control unit. Thereby, the virtual camera is arranged in the virtual space. In addition, processing for extracting at least a part of the texture data for the reflected image is executed by the control unit in accordance with the position of the virtual camera after movement and the position of the gazing point of the virtual camera. Thereby, the texture of the image reflected on the object surface is determined. The former function is realized in the camera placement function, and the latter function is realized in the texture determination function.

  In this case, the virtual camera is moved outside the object polygon. Then, at least a part of the texture data for the reflected image is extracted according to the position of the virtual camera after the movement. In this way, in the invention according to claim 2, even if the virtual camera moves, by taking an image from the position of the virtual camera after the movement, different images (images reflected on the object surface) depending on the position of the virtual camera. Can be displayed on the image display unit. Also, different parallax depending on the position of the virtual camera can be expressed in the image displayed on the image display unit. As described above, in the invention according to claim 2, an image reflected on the object surface can be displayed on the image display unit with a realistic expression.

An image processing program according to claim 3 is a program for further realizing the following functions in the image processing program according to claim 1 or 2.
(11) A reflection degree setting function for setting a reflection degree of an image reflected on the object surface by causing the control unit to recognize the transparency of the texture data of the object.

  In this image processing program, the transparency of the texture data of the object is recognized by the control unit in the reflection degree setting function. Thereby, the reflection degree of the image shown on the object surface is set.

  In this case, the polygon model for the reflected image inside the polygon model for the object is photographed by the virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object. By causing the control unit to recognize the transparency of the texture data of the transparent part of the polygon model, it is possible to set the degree of reflection of the image shown on the object surface. As a result, it is possible to change the degree of reflection of the external scenery caused by, for example, dirt, dullness, cloudiness, or the like in a building window in the game space. In other words, when the window is dirty, it is possible to produce an effect that the external scenery is not reflected beautifully. If the building has multiple windows, for example, only one of them will be soiled, that is, a state where a plurality of transparent parts of the polygon model for the object are provided, and only the transparency of that one sheet is lowered. By performing such processing, it is possible to produce a more realistic effect by destroying the visual perfection of the building in the game space and adding the imperfection of the real world. Thus, in the invention according to claim 3, the image reflected on the object surface can be displayed on the image display unit with a more realistic expression.

An image processing program according to claim 4 is a program for further realizing the following functions in the image processing program according to any one of claims 1 to 3.
(12) A light source arrangement function for arranging the light source in the virtual space by causing the control unit to recognize coordinate data for defining the arrangement position of the light source outside the polygon for the object.
(13) An image reflected on the object surface by causing the control unit to execute processing for setting the reflectance of the texture data of the object according to the position of the virtual camera, the position of the gazing point of the virtual camera, and the position of the light source Reflective effect adding function to add reflective effect to

  In this image processing program, in the light source arrangement function, coordinate data for defining the arrangement position of the light source outside the polygon for the object is recognized by the control unit. Thereby, a light source is arrange | positioned in virtual space. In the reflection effect addition function, a process of setting the reflectance of the texture data of the object according to the position of the virtual camera, the position of the gazing point of the virtual camera, and the position of the light source is executed by the control unit. Thereby, a reflection effect is added to the image reflected on the object surface.

  In this case, the polygon model for the reflected image inside the polygon model for the object is photographed by the virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object. By causing the control unit to set the reflectance of the texture data of the object according to the position, the position of the gazing point of the virtual camera, and the position of the light source, it is possible to add a reflection effect to the image reflected on the object surface. Thus, in the invention according to claim 4, an image reflected on the object surface can be displayed on the image display unit with a more realistic expression.

  The image processing program according to claim 5 is the image processing program according to any one of claims 1 to 4, wherein the virtual camera is based on the coordinate data indicating the position of the virtual camera and the coordinate data indicating the gazing point of the virtual camera. A process of calculating the line-of-sight angle is executed by the control unit. Then, coordinate data corresponding to the line-of-sight angle in the image indicated by the texture data for the reflected image is recognized by the control unit. As a result, the texture of the image reflected on the object surface is extracted from the image that can virtually appear on the object surface with reference to the position indicated by the coordinate data corresponding to the line-of-sight angle. This function is realized in the texture determination function.

  In this case, the line-of-sight angle of the virtual camera is calculated based on the coordinate data indicating the position of the virtual camera and the coordinate data indicating the gazing point of the virtual camera. Then, a position corresponding to the line-of-sight angle in the image indicated by the texture data for the reflected image is determined. Then, an image reflected on the object surface with this position as a reference is extracted from an image that can virtually appear on the object surface.

  As described above, according to the fifth aspect of the present invention, an image reflected on the object surface can be extracted from an image that can be virtually reflected on the object surface in accordance with the viewing angle of the virtual camera. For this reason, when the polygon model for the reflected image arranged inside the polygon model for the object is photographed by the virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object, the virtual camera Different images (images reflected on the object surface) can be displayed on the image display unit depending on the position where the object is photographed. That is, according to the fifth aspect of the present invention, an image reflected on the object surface can be displayed on the image display unit with a realistic expression.

  In the image processing program according to claim 6, in the image processing program according to claim 5, the process of calculating the distance between the position of the virtual camera and the object based on the coordinate data indicating the position of the virtual camera includes: Is further executed. Then, the range of the image reflected on the object surface corresponding to this distance is recognized by the control unit. As a result, the texture in the range of the image shown on the object surface in the image that can virtually appear on the object surface is extracted with reference to the position indicated by the coordinate data corresponding to the line-of-sight angle.

  In this case, the distance between the position of the virtual camera and the object is calculated based on the coordinate data indicating the position of the virtual camera. Then, a range corresponding to the calculated distance is determined in the image that can virtually appear on the object surface with reference to the position corresponding to the line-of-sight angle in the image that can virtually appear on the object surface. In other words, the extraction position of an image that can virtually appear on the object surface is determined according to the viewing angle of the virtual camera, and the range of the image reflected on the object surface is determined according to the distance between the virtual camera position and the object. Is done.

  Thereby, in the invention which concerns on Claim 6, the texture of the image reflected on the object surface can be extracted from the texture of the image which can be reflected virtually on the object surface. For this reason, when the polygon model for the reflected image arranged inside the polygon model for the object is photographed by the virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object, the virtual camera Can display images of different sizes (images reflected on the object surface) on the image display unit depending on the position where the object is photographed. That is, in the invention according to claim 6, an image reflected on the object surface can be displayed on the image display unit with a more realistic expression.

  An image processing apparatus according to a seventh aspect is an image processing apparatus capable of processing data for displaying an object on an image display unit.

This image processing device
First texture storage means for storing texture data for the object in the storage unit;
Second texture storage means for storing texture data for a reflected image corresponding to an image that can be virtually reflected on the object surface in a storage unit;
First polygon arrangement means for arranging the polygon for the object in the virtual space by causing the control unit to recognize the coordinate data for defining the arrangement position of the polygon for the object;
Secondly, the image data polygon is arranged inside the object polygon by causing the control unit to recognize coordinate data for defining the arrangement position of the image image polygon inside the object polygon. Polygon placement means;
Camera placement means for placing the virtual camera in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the virtual camera outside the polygon for the object;
Gaze point arrangement means for arranging the gaze point of the virtual camera in the virtual space by causing the control unit to recognize coordinate data corresponding to the gaze point of the virtual camera;
Based on the position of the virtual camera and the position of the gazing point of the virtual camera, the texture of the image reflected on the object surface is determined by causing the control unit to execute processing to extract at least part of the texture data for the reflected image. Texture determining means to perform,
First polygon generating means for generating a polygon model for an object that is at least partially transparent by causing the control unit to execute a process of projecting texture data for the object onto the polygon for the object;
Second polygon generating means for generating a polygon model for a reflected image by causing the control unit to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image;
By causing the control unit to execute a process of photographing the polygon model for the reflected image inside the polygon model for the object from the outside of the polygon model for the object through the transparent part of the polygon model for the object. Image display means for displaying the object and the image reflected on the object surface on the image display unit;
It has.

  An image control method according to an eighth aspect is an image control method in which data for displaying an object on an image display unit is controlled by a computer.

This image control method
A first texture storing step of storing texture data for the object in the storage unit;
A second texture storage step of storing texture data for a reflected image corresponding to an image that can be virtually reflected on the object surface in a storage unit;
A first polygon placement step for placing the object polygon in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the object polygon;
Secondly, the image data polygon is arranged inside the object polygon by causing the control unit to recognize coordinate data for defining the arrangement position of the image image polygon inside the object polygon. Polygon placement step;
A camera placement step for placing the virtual camera in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the virtual camera outside the polygon for the object;
A gazing point arrangement step of arranging the gazing point of the virtual camera in the virtual space by causing the control unit to recognize coordinate data corresponding to the gazing point of the virtual camera;
Based on the position of the virtual camera and the position of the gazing point of the virtual camera, the texture of the image reflected on the object surface is determined by causing the control unit to execute processing to extract at least part of the texture data for the reflected image. A texture determining step,
A first polygon generation step of generating a polygon model for an object that is at least partially transparent by causing the control unit to execute a process of projecting the texture data for the object onto the polygon for the object;
A second polygon generation step of generating a polygon model for the reflected image by causing the control unit to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image;
By causing the control unit to execute a process of photographing the polygon model for the reflected image inside the polygon model for the object from the outside of the polygon model for the object through the transparent part of the polygon model for the object. An image display step for displaying an object and an image reflected on the object surface on the image display unit;
It has.

  In the present invention, the polygon model for the reflected image arranged inside the polygon model for the object is photographed by a virtual camera from the outside of the polygon model for the object through the transparent portion of the polygon model for the object. Different images (images reflected on the surface of the object) can be displayed on the image display unit depending on the position where the virtual camera captures the object. That is, in the present invention, an image reflected on the object surface can be displayed on the image display unit with a realistic expression.

[Configuration and operation of game device]
FIG. 1 shows a basic configuration of a game device according to an embodiment of the present invention. Here, a home video game device will be described as an example of the video game device. The home video game apparatus includes a home game machine body and a home television. The home game machine body can be loaded with a recording medium 10, and game data is read from the recording medium 10 as appropriate to execute the game. The contents of the game executed in this way are displayed on the home television.

  The game system of the home video game apparatus includes a control unit 1, a storage unit 2, an image display unit 3, an audio output unit 4, and an operation input unit 5, which are connected via a bus 6. Is done. The bus 6 includes an address bus, a data bus, a control bus, and the like. Here, the control unit 1, the storage unit 2, the audio output unit 4, and the operation input unit 5 are included in the home game machine body of the home video game apparatus, and the image display unit 3 is included in the home television. It is.

  The control unit 1 is provided mainly for controlling the progress of the entire game based on the game program. The control unit 1 includes, for example, a CPU (Central Processing Unit) 7, a signal processor 8, and an image processor 9. The CPU 7, the signal processor 8, and the image processor 9 are connected to each other via the bus 6. The CPU 7 interprets instructions from the game program and performs various data processing and control. For example, the CPU 7 instructs the signal processor 8 to supply image data to the image processor. The signal processor 8 mainly performs calculation in the three-dimensional space, position conversion calculation from the three-dimensional space to the pseudo three-dimensional space, light source calculation processing, and image and audio data generation processing. ing. The image processor 9 mainly performs a process of writing image data to be drawn into the RAM 12 based on the calculation result and the processing result of the signal processor 8.

  The storage unit 2 is provided mainly for storing program data and various data used in the program data. The storage unit 2 includes, for example, a recording medium 10, an interface circuit 11, and a RAM (Random Access Memory) 12. An interface circuit 11 is connected to the recording medium 10. The interface circuit 11 and the RAM 12 are connected via the bus 6. The recording medium 10 is for recording operation system program data, image data, audio data, game data including various program data, and the like. The recording medium 10 is, for example, a ROM (Read Only Memory) cassette, an optical disk, a flexible disk, or the like, and stores operating system program data, game data, and the like. The recording medium 10 also includes a card type memory, and this card type memory is mainly used for storing various game parameters at the time of interruption when the game is interrupted. The RAM 12 is used for temporarily storing various data read from the recording medium 10 and temporarily recording the processing results from the control unit 1. The RAM 12 stores various data and address data indicating the storage position of the various data, and can be read / written by designating an arbitrary address.

  The image display unit 3 is provided mainly for outputting image data written in the RAM 12 by the image processor 9 or image data read from the recording medium 10 as an image. The image display unit 3 includes, for example, a television monitor 20, an interface circuit 21, and a D / A converter (Digital-To-Analog converter) 22. A D / A converter 22 is connected to the television monitor 20, and an interface circuit 21 is connected to the D / A converter 22. The bus 6 is connected to the interface circuit 21. Here, the image data is supplied to the D / A converter 22 via the interface circuit 21, where it is converted into an analog image signal. The analog image signal is output as an image to the television monitor 20.

  Here, the image data includes, for example, polygon data and texture data. Polygon data is the coordinate data of vertices constituting a polygon. The texture data is for setting a texture on the polygon, and is composed of texture instruction data and texture color data. The texture instruction data is data for associating polygons and textures, and the texture color data is data for designating the texture color. Here, the polygon data and the texture data are associated with the polygon address data indicating the storage position of each data and the texture address data. In such image data, the signal processor 8 coordinates the polygon data in the three-dimensional space indicated by the polygon address data (three-dimensional polygon data) based on the movement amount data and the rotation amount data of the screen itself (viewpoint). Conversion and perspective projection conversion are performed, and the data is replaced with polygon data (two-dimensional polygon data) in a two-dimensional space. Then, a polygon outline is constituted by a plurality of two-dimensional polygon data, and texture data indicated by the texture address data is written in an internal area of the polygon. In this way, an object in which a texture is pasted on each polygon, that is, various characters can be expressed.

  The audio output unit 4 is provided mainly for outputting audio data read from the recording medium 10 as audio. The audio output unit 4 includes, for example, a speaker 13, an amplifier circuit 14, a D / A converter 15, and an interface circuit 16. An amplifier circuit 14 is connected to the speaker 13, a D / A converter 15 is connected to the amplifier circuit 14, and an interface circuit 16 is connected to the D / A converter 15. The bus 6 is connected to the interface circuit 16. Here, the audio data is supplied to the D / A converter 15 via the interface circuit 16, where it is converted into an analog audio signal. The analog audio signal is amplified by the amplifier circuit 14 and output from the speaker 13 as audio. The audio data includes, for example, ADPCM (Adaptive Differential Pulse Code Modulation) data and PCM (Pulse Code Modulation) data. In the case of ADPCM data, sound can be output from the speaker 13 by the same processing method as described above. In the case of PCM data, by converting the PCM data into ADPCM data in the RAM 12, the sound can be output from the speaker 13 by the same processing method as described above.

  The operation input unit 5 mainly includes a controller 17, an operation information interface circuit 18, and an interface circuit 19. An operation information interface circuit 18 is connected to the controller 17, and an interface circuit 19 is connected to the operation information interface circuit 18. The bus 6 is connected to the interface circuit 19.

  The controller 17 is an operation device used by the player to input various operation commands, and sends an operation signal according to the operation of the player to the CPU 7. The controller 17 includes a first button 17a, a second button 17b, a third button 17c, a fourth button 17d, an up key 17U, a down key 17D, a left key 17L, a right key 17R, and an L1 button 17L1, L2. A button 17L2, an R1 button 17R1, an R2 button 17R2, a start button 17e, a select button 17f, a left stick 17SL and a right stick 17SR are provided.

  The up direction key 17U, the down direction key 17D, the left direction key 17L, and the right direction key 17R are used, for example, to give the CPU 7 a command for moving a character or cursor up, down, left, or right on the screen of the television monitor 20. .

  The start button 17e is used when instructing the CPU 7 to load a game program from the recording medium 10.

  The select button 17f is used when instructing the CPU 7 to make various selections for the game program loaded from the recording medium 10.

  The left stick 17SL and the right stick 17SR are stick type controllers having substantially the same configuration as a so-called joystick. This stick type controller has an upright stick. The stick is configured to be tiltable from an upright position around the fulcrum in a 360 ° direction including front, rear, left and right. The left stick 17SL and the right stick 17SR pass through the operation information interface circuit 18 and the interface circuit 19 with the values of the x-coordinate and the y-coordinate having the upright position as the origin as operation signals according to the tilt direction and tilt angle of the stick. To the CPU 7.

  The first button 17a, the second button 17b, the third button 17c, the fourth button 17d, the L1 button 17L1, the L2 button 17L2, the R1 button 17R1, and the R2 button 17R2 correspond to the game program loaded from the recording medium 10. Various functions are allocated.

  Each button and each key of the controller 17 except for the left stick 17SL and the right stick 17SR are turned on when pressed from the neutral position by an external pressing force, and return to the neutral position when the pressing force is released. It is an on / off switch that turns off.

  The schematic operation of the home video game apparatus having the above configuration will be described below. When a power switch (not shown) is turned on and the game system 1 is turned on, the CPU 7 reads image data, audio data, and a program from the recording medium 10 based on the operating system stored in the recording medium 10. Read data. Some or all of the read image data, audio data, and program data are stored in the RAM 12. Then, the CPU 7 issues a command to the image data and sound data stored in the RAM 12 based on the program data stored in the RAM 12.

  In the case of image data, based on a command from the CPU 7, first, the signal processor 8 performs character position calculation and light source calculation in a three-dimensional space. Next, the image processor 9 performs a process of writing image data to be drawn into the RAM 12 based on the calculation result of the signal processor 8. Then, the image data written in the RAM 12 is supplied to the D / A converter 17 via the interface circuit 13. Here, the image data is converted into an analog video signal by the D / A converter 17. The image data is supplied to the television monitor 20 and displayed as an image.

  In the case of audio data, first, the signal processor 8 generates and processes audio data based on a command from the CPU 7. Here, processing such as pitch conversion, noise addition, envelope setting, level setting, and reverb addition is performed on the audio data, for example. Next, the audio data is output from the signal processor 8 and supplied to the D / A converter 15 via the interface circuit 16. Here, the audio data is converted into an analog audio signal. The audio data is output as audio from the speaker 13 via the amplifier circuit 14.

[Description of various processes in game device]
The game executed in this game machine is, for example, a baseball game. In a baseball game executed on this game machine, an object such as a building can be displayed on the television monitor 20. FIG. 2 is a functional block diagram for explaining functions that play a major role in the present invention.

  The first texture storage means 50 has a function of storing building texture data in the RAM 12. With this means, building texture data is stored in the RAM 12. The building texture data used here is data for expressing the texture of the building surface. This texture data is loaded and stored from the recording medium 10 to the RAM 12 together with the baseball game program when the baseball game program is loaded from the recording medium 10 to the RAM 12.

  The second texture storage means 51 has a function of storing, in the RAM 12, texture data for a reflected image corresponding to an image that can virtually appear on the building surface. In this means, the texture data for the reflected image corresponding to the image that can virtually appear on the building surface is stored in the RAM 12. The texture data for the reflected image used here is data generated by photographing a building or an object located in front of the building from the building side. That is, the texture data is data generated by photographing a landscape (including buildings and objects) that can be reflected on the building surface. The texture data is loaded and stored from the recording medium 10 to the RAM 12 together with the baseball game program when the baseball game program is loaded from the recording medium 10 to the RAM 12.

  The first polygon placement means 52 has a function of placing the building polygon in the virtual space by causing the CPU 7 to recognize coordinate data for defining the placement position of the building polygon. With this means, the building polygon is arranged in the virtual space by causing the CPU 7 to recognize coordinate data for defining the arrangement position of the building polygon.

  Here, the layout position of the building polygon is defined in advance in the game program. When the baseball game program is loaded from the recording medium 10 to the RAM 12, the coordinate data for defining the layout position of the polygon for the building is loaded from the recording medium 10 to the RAM 12 and stored together with the baseball game program.

  The second polygon arrangement means 53 causes the CPU 7 to recognize coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the building, thereby converting the polygon for the reflected image into the polygon for the building. It has the function to arrange inside. This means makes the CPU 7 recognize the coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the building, so that the polygon for the reflected image is arranged inside the polygon for the building. Is done.

  Here, the arrangement position of the polygon for the reflected image is defined in advance in the game program. Specifically, a predetermined position inside the building polygon is defined in advance in the game program as the arrangement position of the polygon for the reflected image. The coordinate data for defining the arrangement position of the polygon for the reflected image is loaded and stored from the recording medium 10 to the RAM 12 together with the baseball game program when the baseball game program is loaded from the recording medium 10 to the RAM 12. The

  The light source arrangement means 54 has a function of arranging the light source in the virtual space by causing the CPU 7 to recognize coordinate data for defining the arrangement position of the light source outside the building polygon. In this means, the CPU 7 recognizes coordinate data for defining the arrangement position of the light source outside the building polygon, thereby arranging the light source in the virtual space.

  Here, the arrangement position of the light source is defined in advance in the game program. Specifically, a predetermined position outside the building polygon is defined in advance in the game program as the light source arrangement position. When the baseball game program is loaded from the recording medium 10 into the RAM 12, the coordinate data for defining the light source arrangement position is loaded from the recording medium 10 into the RAM 12 and stored together with the baseball game program.

  Here, an example in which the light source does not move is shown, but the light source may be moved. For example, when the light source is moved over time, the arrangement position of the light source corresponding to each time is defined in advance in the game program. Specifically, the arrangement position of the light source corresponding to each time can be determined based on an equation that defines the arrangement position of the light source using the time as a parameter. In this case, when the light source moves, the coordinate data for defining the arrangement position of the light source after the movement is recognized by the CPU 7 for each time. The equations used here are loaded and stored from the recording medium 10 to the RAM 12 together with the baseball game program when the baseball game program is loaded from the recording medium 10 to the RAM 12.

  The camera placement unit 55 has a function of placing the virtual camera in the virtual space by causing the CPU 7 to recognize coordinate data for defining the placement position of the virtual camera outside the building polygon.

  With this means, the virtual camera is arranged in the virtual space by causing the CPU 7 to recognize the coordinate data for defining the arrangement position of the virtual camera outside the building polygon.

  Specifically, in this means, when the CPU 7 issues a camera movement command for moving the virtual camera outside the building polygon, the coordinate data indicating the position of the virtual camera after the movement is recognized by the CPU 7. Is done. Thereby, the virtual camera is arranged in the virtual space.

  Here, first, it is determined whether or not a camera movement command for moving the virtual camera is issued from the CPU 7 outside the building polygon. When a camera movement command for moving the virtual camera outside the building polygon is issued from the CPU 7, the coordinate data indicating the position of the virtual camera after the movement is recognized by the CPU 7. On the other hand, when the CPU 7 has not issued a camera movement command for moving the virtual camera outside the building polygon, the CPU 7 recognizes the coordinate data indicating the current virtual camera position. In this way, the virtual camera is defined and arranged in the virtual space.

  The gaze point arrangement means 56 has a function of arranging the gaze point of the virtual camera in the virtual space by causing the CPU 7 to recognize coordinate data corresponding to the gaze point of the virtual camera. In this means, the CPU 7 recognizes coordinate data corresponding to the gazing point of the virtual camera, so that the gazing point of the virtual camera is arranged in the virtual space.

  Here, the gazing point of the virtual camera is arranged inside the building polygon. For example, the gazing point of the virtual camera is arranged on the polygon for the reflected image. The position of the gazing point of the virtual camera arranged on the polygon for the reflected image is defined in advance in the game program. The coordinate data for defining the position of the gazing point is loaded and stored from the recording medium 10 to the RAM 12 together with the baseball game program when the baseball game program is loaded from the recording medium 10 to the RAM 12.

  Here, an example in which the gazing point does not move is shown, but the gazing point may be moved. That is, the line-of-sight direction of the virtual camera may be changed by moving the gazing point. For example, the gazing point may be moved based on at least one of recognition of an input signal from the controller 17 and issuance of a gazing point movement command.

  The reflection degree setting means 57 has a function of setting the reflection degree of an image reflected on the building surface by causing the CPU 7 to recognize the transparency of the texture data of the building. In this means, the CPU 7 recognizes the transparency of the texture data of the building to set the reflection degree of the image reflected on the building surface.

  Here, the transparency of the texture data of the building is recognized by the CPU 7. For example, the CPU 7 recognizes the transparency of the texture data of the windows provided on the wall surface of the building and the transparency of the texture data of the wall surfaces of the building excluding the windows. Thereby, the reflection degree of the image reflected on the building surface is set.

  Note that the correspondence between texture data and transparency is defined in advance in the game program. For example, when the baseball game program is loaded from the recording medium 10 to the RAM 12, the table indicating the correspondence relationship between the texture data and the transparency is loaded from the recording medium 10 to the RAM 12 and stored together with the baseball game program.

  The reflection effect adding means 58 causes the CPU 7 to execute processing for setting the reflectance of the texture data of the building in accordance with the position of the virtual camera, the position of the gazing point of the virtual camera, and the position of the light source, so that the building surface It has a function to add a reflection effect to the image shown on the screen. In this means, the image reflected on the building surface is obtained by causing the CPU 7 to execute processing for setting the reflectance of the texture data of the building in accordance with the position of the virtual camera, the position of the gazing point of the virtual camera, and the position of the light source. A reflection effect is added to the.

  Here, an angle (reflection) formed by a straight line (first straight line) connecting the position of the virtual camera and the gazing point of the virtual camera and a straight line (second straight line) connecting the intersection where the first straight line intersects the building surface and the light source. The CPU 7 executes a process for calculating the angle. And according to this reflection angle, the reflectance of the texture data of a building is set. Note that the correspondence relationship between the position of the virtual camera and the reflectance is defined in advance in the game program.

  The texture determination means 59 is reflected on the building surface by causing the CPU 7 to execute a process of extracting at least a part of the texture data for the reflected image based on the position of the virtual camera and the position of the gazing point of the virtual camera. It has a function to determine the texture of the image. In this means, by causing the CPU 7 to execute processing for extracting at least a part of the texture data for the reflected image based on the position of the virtual camera and the position of the gazing point of the virtual camera, the image of the image reflected on the surface of the building is displayed. The texture is determined. In this means, when the virtual camera moves, the CPU 7 performs a process of extracting at least a part of the texture data for the reflected image according to the position of the virtual camera after the movement and the position of the gazing point of the virtual camera. As a result, the texture of the image reflected on the building surface is determined.

  Specifically, in this means, the CPU 7 executes a process of calculating the viewing angle of the virtual camera based on the coordinate data indicating the position of the virtual camera and the coordinate data indicating the gazing point of the virtual camera. Then, the CPU 7 recognizes coordinate data corresponding to the line-of-sight angle in the image indicated by the texture data for the reflected image. Thus, the texture of the image shown on the building surface is extracted with reference to the position indicated by the coordinate data corresponding to the line-of-sight angle. In this means, the CPU 7 further executes a process of calculating the distance between the position of the virtual camera and the building based on the coordinate data indicating the position of the virtual camera. And the range of the image reflected on the building surface corresponding to this distance is recognized by the CPU 7. Thereby, the texture of the range of the image reflected on the building surface is extracted with reference to the position indicated by the coordinate data corresponding to the line-of-sight angle.

  Here, the straight line connecting the position of the virtual camera and the gazing point of the virtual camera (the first straight line described above), the reference point used to define the angle of the sight line direction of the virtual camera, and the gazing point of the virtual camera are The angle formed by the connecting straight line (third straight line) (the viewing angle of the virtual camera) is calculated by the CPU 7. Further, the CPU 7 calculates the distance between the virtual camera and the building surface (the distance between the camera buildings). Then, the coordinate data of the position corresponding to the line-of-sight angle, that is, the coordinate data of the position corresponding to the line-of-sight angle on the image reflected on the building surface (the line-of-sight corresponding position on the image reflected on the building surface) is detected by the CPU 7. Is recognized. Then, on the basis of the position indicated by the coordinate data corresponding to the viewing angle of the virtual camera recognized by the CPU 7 here, an image in a range corresponding to the distance between the camera buildings, that is, a partial image in the image reflected on the building surface is obtained. , Set and recognized by the CPU 7. Thereby, the texture of the partial image reflected on the building surface is extracted.

  Note that the reference point used for defining the angle of the visual line direction of the virtual camera is arranged at a predetermined position in a direction perpendicular to the building surface, for example. This position is defined in advance in the game program.

  Further, the process of detecting the line-of-sight corresponding position on the image reflected on the building surface is executed by the CPU 7 based on the texture data for the reflected image. For example, this processing is executed by the CPU 7 by preliminarily defining a correspondence relationship between the line-of-sight angle and the position inside the image reflected on the building surface in the game program.

  Furthermore, the process of setting the range for defining the partial image is realized by setting the boundary corresponding to the distance between the camera buildings in the image reflected on the building surface inside the image reflected on the building surface. The For example, the correspondence between the camera building distance and the data for defining the boundary is defined in advance in the game program.

  The first polygon generating means 60 has a function of generating a building polygon model that is at least partially transparent by causing the CPU 7 to execute processing for projecting building texture data onto building polygons. . In this means, the processing of projecting the building texture data onto the building polygon is executed by the CPU 7 to generate a building polygon model that is at least partially transparent.

  Here, the process of projecting the building texture data onto the building polygon is executed by the CPU 7. As a result, a polygon model for a building that is at least partially transparent is generated. For example, the CPU 7 executes a process (mapping) for associating the three-dimensional coordinates of a building polygon with a two-dimensional coordinate system. Then, the CPU 7 executes a process of associating the coordinates of the building texture data with the two-dimensional coordinate system in which the building polygons are mapped. Thereby, the polygon model for buildings is generated. Here, a polygon model for a building that is at least partially transparent is generated according to the transparency value.

  The second polygon generation unit 61 has a function of generating a polygon model for a reflected image by causing the CPU 7 to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image. I have. In this means, the CPU 7 executes a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image, thereby generating a polygon model for the reflected image.

  Here, the CPU 7 executes processing for projecting the extracted texture data for the reflected image onto the polygon for the reflected image. Thereby, a polygon model for a reflected image is generated. For example, the CPU 7 executes processing (mapping) for associating the three-dimensional coordinates of the polygon for the reflected image with the two-dimensional coordinate system. Then, the CPU 7 executes processing for associating the coordinates of the extracted texture data for the reflected image with the two-dimensional coordinates obtained by mapping the polygon for the reflected image. Thereby, a polygon model for a reflected image is generated.

  The image display means 62 performs processing for photographing the polygon model for the reflected image inside the building polygon model with a virtual camera from the outside of the building polygon model through the transparent portion of the building polygon model. By executing the function, the television monitor 20 has a function of displaying the building and the image reflected on the building surface. In this means, the CPU 7 executes a process for photographing the polygon model for the reflected image inside the building polygon model through the transparent part of the building polygon model from the outside of the building polygon model with the virtual camera. By doing so, the building and the image reflected on the building surface are displayed on the television monitor 20.

  Here, by causing the CPU 7 to issue a shooting command for the virtual camera, an image captured by the virtual camera is displayed on the television monitor 20. For example, when the gazing point of the virtual camera is arranged inside a building polygon, when a shooting command is issued from the CPU 7, the polygon model for the reflected image inside the building polygon model is changed to the building-use polygon model. The image is taken by a virtual camera from the outside of the building polygon model through the transparent part of the polygon model. Then, an image of the building and an image reflected on the building surface (an image reflected on the building surface) are displayed on the television monitor 20.

[Description of video display system in baseball game]
Next, specific contents of the video display system in the baseball game will be described. The flow shown in FIGS. 8 and 9 will also be described at the same time. FIG. 8 is a flow for explaining the overall outline of the baseball game, and FIG. 9 is a flow for explaining the system.

  In the following, the overall outline of the baseball game will be described first, and then the contents of the system will be described.

  First, when the game machine is turned on and the game machine is activated, the baseball game program is loaded from the recording medium 10 into the RAM 12 and stored. At this time, various basic game data necessary for executing the baseball game are simultaneously loaded from the recording medium 10 into the RAM 12 and stored (S1).

  For example, the basic game data includes data related to various images for a three-dimensional game space. The CPU 7 recognizes data related to various images for the three-dimensional game space, such as stadium image data, player character image data, and various object image data. Further, the basic game data includes position coordinate data for arranging data related to various images for the three-dimensional game space in the three-dimensional game space. The basic game data also includes data used in the above system.

  Subsequently, the baseball game program stored in the RAM 12 is executed by the CPU 7 based on the basic game data (S2). Then, the start screen of the baseball game is displayed on the television monitor 20. Then, various setting screens for executing the baseball game are displayed on the television monitor 20. Here, for example, a mode selection screen for selecting a play mode of the baseball game is displayed on the television monitor 20 (not shown). In the mode selection screen, the player operates the controller 17 to determine the play mode (S3). The play mode includes, for example, a battle mode in which a favorite team is selected from 12 teams to enjoy a match, a pennant mode in which a favorite team is selected from the 12 teams and a pennant race is played, and the player supervises A training mode for training the player characters of the team from the standpoint of the player, a growth experience mode for experiencing the baseball game from the standpoint of one player character with the Oyori player, and the like are prepared.

  Subsequently, various events are executed by the CPU 7 in the play mode selected on the mode selection screen (S4). The various events executed here are, for example, events automatically controlled by the CPU 7 based on an AI program (Artificial Intelligence Program), and events manually controlled by the player based on an input signal from the controller 17. There is a special event. The player character is controlled by automatic control for automatically instructing the player character based on the AI program, manual control for directly instructing the player character based on an input signal from the controller 17, or the like. There is. Thus, in this baseball game, an event is controlled or an instruction is instructed to the player character in accordance with an instruction from the controller 17 or an instruction from the AI program.

  Subsequently, the CPU 7 determines whether or not the selected play mode is finished (S5). Specifically, the CPU 7 determines whether or not a command indicating that the play mode has ended is issued. If the CPU 7 determines that an instruction indicating that the play mode has ended has been issued (Yes in S5), the CPU 7 executes a process of storing the game continuation data in the RAM 12. When the game continuation data is stored in the RAM 12, a selection screen for selecting whether or not to end the baseball game is displayed on the television monitor 20 (S6). When an item indicating the end of the baseball game is selected by operating the controller 17 on the selection screen (Yes in S6), the CPU 7 executes a process for ending the baseball game ( S7). On the other hand, when an item indicating continuation of the baseball game is selected by operating the controller 17 on the selection screen (No in S6), the mode selection screen in Step 3 (S3) is displayed on the television monitor. 20 is displayed again.

  Unless the CPU 7 determines that an instruction for ending the play mode has been issued (No in S5), various events are executed by the CPU 7 in the play mode selected on the mode selection screen (S4).

  Next, details of the video display system will be described.

  In the present embodiment, an example in which the video display system functions when the battle mode is selected is shown. For example, when a home run is released by a batter character while a match event is being executed in the battle mode, the stand, the ball jumping into the stand, the off-site building, the scenery reflected on the surface of the off-site building, etc. Is displayed on the television monitor 20. Here, a video display system is used when an off-site building and a scenery or a building reflected on the surface of the off-site building are displayed on the television monitor 20.

  In the following, an example in which one building is focused on, and this building and the scenery or building reflected on the surface of the building are displayed on the television monitor 20 using the video display system is shown.

  In the video display system, for example, when a baseball game program is loaded from the recording medium 10 to the RAM 12, texture data corresponding to the texture of the building surface, that is, texture data for the building is stored in the RAM 12 (S101). ). FIG. 3 shows a view when one side of the building is seen. Texture data corresponding to the texture of the building surface (outer wall and rooftop) is stored in the RAM 12. At this time, the texture data for the reflected image corresponding to the texture that can be reflected on the surface of the building or the texture of the building is stored in the RAM 12 (S102).

  The texture data for the reflected image is data corresponding to the scenery or the texture of the building that can be reflected on the surface of the building. Here, as shown in FIG. 3, when a scenery or a building outside the wall of the building is viewed from the center of gravity position PG0 (a virtual camera gazing point PG0 described later) of a polygon P2 for a reflected image described later. The image data is used as the texture data TG for the reflected image corresponding to the texture for the reflected image. Specifically, the texture data TG for the reflected image is located outside the outer surface of the building using the angle of view GA that can capture at least the outer surface of the building with a gazing point PG0 of a virtual camera described later as the shooting position. This is data generated by photographing a scene or a building to be photographed.

  Subsequently, the building polygon P1 is arranged in the three-dimensional game space (S103). Here, the position coordinate data of the building polygon P1 stored in the RAM 12 is recognized by the CPU 7. Then, the CPU 7 issues a command for placing the building polygon P1 at the position indicated by the position coordinate data. Then, the building polygon P1 is arranged in the three-dimensional game space.

  The term “polygon for building” is used to mean a polygon (each element) such as a triangle or a quadrangle, and a polygon (each element) such as a triangle or a quadrangle to form a building (hexahedron). Sometimes used to mean polygon aggregate.

  Subsequently, the polygon P2 for the reflected image is arranged in the three-dimensional game space (S104). Here, the position coordinate data of the polygon P2 for the reflected image stored in the RAM 12 is recognized by the CPU 7. The position indicated by the position coordinate data of the polygon P2 for the reflected image is a predetermined position inside the building polygon P1. Then, the CPU 7 issues a command for placing the reflected image polygon P2 at the position indicated by the position coordinate data. Then, the reflection image polygon P2 is arranged in the three-dimensional game space inside the building polygon P1.

  Note that the term “polygon for a reflected image” is used to mean a polygon (each element) such as a triangle or a quadrangle, and a polygon that forms a plane by combining a polygon (each element) such as a triangle or a quadrangle. Sometimes used to mean aggregate.

  Subsequently, the light source L is set in the three-dimensional game space as shown in FIG. 4 (S105). Here, the position coordinate data of the light source L stored in the RAM 12 is recognized by the CPU 7. Then, a command for placing the light source L at the position indicated by the position coordinate data is issued from the CPU 7. Then, the light source L is arranged in the three-dimensional game space.

  Subsequently, the virtual camera C is arranged in the three-dimensional game space as shown in FIGS. 3 and 4 (S106). Here, the position coordinate data indicating the initial position of the virtual camera C stored in the RAM 12 is recognized by the CPU 7. Then, the CPU 7 issues a command to place the virtual camera C at the position indicated by the position coordinate data. Then, the virtual camera C is arranged at the initial position in the three-dimensional game space.

  Subsequently, the gazing point PG0 of the virtual camera C is arranged in the three-dimensional game space as shown in FIGS. 3 and 4 (S107). Here, the gazing point PG0 of the virtual camera C is arranged on the polygon P2 for the reflected image. Specifically, the gazing point PG0 of the virtual camera C is arranged at the gravity center position PG0 of the polygon P2 for the reflected image. The position coordinate data indicating the gravity center position PG0 of the polygon P2 for the reflected image is stored in the RAM 12. When the position coordinate data is recognized by the CPU 7, the CPU 7 issues a command for placing the gazing point PG0 at the position indicated by the position coordinate data. Then, the gazing point PG0 is arranged in the three-dimensional game space.

  Subsequently, it is determined whether or not a camera movement command for moving the virtual camera C is issued from the CPU 7 outside the building polygon P1 (S108). When a camera movement command for moving the virtual camera C outside the building polygon P1 is issued from the CPU 7 (Yes in S108), coordinate data indicating the position of the virtual camera C after the movement is sent to the CPU 7. Recognized (S109). On the other hand, when the camera movement command for moving the virtual camera C is not issued from the CPU 7 outside the building polygon P1 (No in S108), the coordinate data indicating the current position of the virtual camera C is the CPU 7. (S110). In this way, the virtual camera C is defined and arranged in the virtual space.

  Subsequently, the transparency of the texture data of the building corresponding to the transparency W of the building surface is recognized by the CPU 7 (S111). Here, the CPU 7 recognizes the transparency W1 of the texture data of the window provided on the wall surface of the building and the transparency W2 of the texture data of the wall surface of the building excluding the window stored in the RAM 12. Thereby, the reflection degree of the image reflected on the building surface is set.

  Specifically, it is defined here that the transparency is 0% when the transparency W is 0%, and the transparency is when the transparency W is 100%. And the transparency W1 of the texture data of the window provided on the wall surface of the building stored in the RAM 12 is, for example, 100%, and the transparency W2 of the texture data of the wall surface of the building excluding the window is, for example, 0%. In this case, only the scenery or the building reflected on the window on the wall of the building can be displayed on the television monitor 20.

  Further, the transparency W1 of the texture data of the window provided on the wall surface of the building stored in the RAM 12 is, for example, 100%, and the transparency W2 of the texture data of the wall surface of the building excluding the window is, for example, 100%. In this case, an image reflected on the entire wall surface of the building can be displayed on the television monitor 20.

  As described above, according to the value of the transparency W of the texture data stored in the RAM 12, an image reflected on the building surface can be displayed on the television monitor 20 with various degrees of reflection. In the following, as an example, the transparency W1 of the texture data of the window provided on the wall surface of the building is 100%, and the transparency W2 of the texture data of the wall surface of the building excluding the window is 50%. I do.

  Subsequently, by causing the CPU 7 to execute a process of setting the reflectance H of the texture data of the building according to the position of the virtual camera C, the position of the gazing point PG0 of the virtual camera C, and the position of the light source L, the reflection is performed. The effect is set (S112). Here, as shown in FIG. 4, a straight line LS1 (first straight line) connecting the position of the virtual camera C and the gazing point PG0 of the virtual camera C, and an intersection K and a light source L where the first straight line intersects the building surface are obtained. The CPU 7 executes processing for calculating an angle α (reflection angle) formed by the connecting straight line LS2 (second straight line). And according to this reflection angle (alpha), the reflectance H of the texture data of a building is set.

  Specifically, first, the CPU 7 calculates an intersection point K at which a straight line LS1 connecting the position of the virtual camera C and the gazing point PG0 of the virtual camera C intersects the building surface. Then, a vector A <A> from the intersection K toward the light source L is calculated by the CPU 7. Also, the CPU 7 calculates a vector B <B> from the intersection K toward the position of the virtual camera C. Next, based on the expression (cosα = (<A> · <B>) / (| <A> || <B> |)) for calculating the inner product of the vector A <A> and the vector B <B>, The angle formed by the vector A <A> and the vector B <B>, that is, the reflection angle α is calculated by the CPU 7. In this way, the angle formed by the first straight line LS1 and the second straight line LS2 (reflection angle α) is calculated by the CPU 7.

  Note that the vector A <A> and the vector B <B> shown in FIG. 4 are displayed as unit vectors in order to make the drawing easier to see.

  In accordance with the reflection angle α, the reflectance H of the texture data of the building is set. Here, it is defined that complete reflection is obtained when the reflectance H is 100% and non-reflection when the reflectance H is 0%. For example, as shown in FIG. 5, when the reflection angle α is not less than 80 degrees and not more than 100, the reflectance H is set to 100%, for example. Then, the reflectance H is set so as to decrease as the reflection angle α increases from 90 degrees to 180 degrees, or from 90 degrees to 0 degrees. Thereby, according to the position of the virtual camera C, the glare of the light reflected on the building wall surface can be changed.

  The correspondence relationship between the reflection angle α and the reflectance H is defined in advance in the game program. For example, a table indicating the correspondence relationship between the reflection angle α and the reflectance H is loaded and stored from the recording medium 10 to the RAM 12 together with the baseball game program when the baseball game program is loaded from the recording medium 10 to the RAM 12. .

  Subsequently, based on the position of the virtual camera C and the position of the gazing point PG0 of the virtual camera C, the CPU 7 executes a process for extracting at least a part of the texture data TG for the reflected image, so that The texture of the image shown is determined (S113).

  Here, as shown in FIG. 6, in order to define the angle of the line of sight direction of the virtual camera C and the straight line LS1 (the first straight line) connecting the position of the virtual camera C and the gazing point PG0 of the virtual camera C. The CPU 7 calculates an angle β (line-of-sight angle β of the virtual camera C) formed by a straight line LS3 (third line) connecting the reference point B used and the gazing point PG0 of the virtual camera C.

  The reference point B used to define the angle of the visual line direction of the virtual camera C is, for example, in the direction perpendicular to the planar reflected image polygon P2 with reference to the gazing point PG0 of the virtual camera C. It is arranged at a predetermined position. This position is defined in advance in the game program.

  Specifically, an inner product of a vector C <C> from the gazing point PG0 of the virtual camera C toward the position of the virtual camera C and a vector D <D> from the gazing point PG0 of the virtual camera C toward the reference point B is obtained. Based on the equation (cosβ = (<C> · <D>) / (| <C> || <D> |)), the angle formed by the vector C <C> and the vector D <D>, that is, the line-of-sight angle β Is calculated by the CPU 7. In this way, the angle (line-of-sight angle β) formed by the first straight line LS1 and the third straight line LS3 is calculated by the CPU 7.

  Further, as shown in FIGS. 3 and 6, the distance BC (distance between camera buildings) between the virtual camera C and the building surface is calculated by the CPU 7. Specifically, the camera building distance BC is set by causing the CPU 7 to execute a process of calculating the length of the perpendicular line drawn from the virtual camera C to the building surface or the extended surface of the building surface.

  Then, the coordinate data of the position TS corresponding to the line-of-sight angle β on the image reflected on the building surface (the line-of-sight corresponding position on the image reflected on the building surface) is detected and recognized by the CPU 7. Here, the coordinate data of the line-of-sight corresponding position TS on the image reflected on the building surface is detected by the CPU 7 as follows.

  For example, as shown in FIG. 3, the positions of the four corners T1, T2, T3, and T4 and the position of the center of gravity T0 in the image corresponding to the texture data TG for the reflected image (image reflected on the building surface) are stored in the CPU 7. Be recognized. Specifically, the position coordinate data T1 (0, 0), T2 (0, 1), T3 (1, 1), T4 (1, 0) of each of the four corners of the image reflected on the building surface, and the position of the center of gravity The coordinate data T0 (0.5, 0.5) is recognized by the CPU 7.

  When the line-of-sight angle β is 0 degree, the coordinate data of the line-of-sight corresponding position TS on the image that the position coordinate data T0 (0.5, 0.5) of the center of gravity corresponds to the line-of-sight angle β is reflected on the building surface. As recognized by the CPU 7. When the line-of-sight angle β is 0 degree, the line-of-sight corresponding position TS (= T0) on the image reflected on the building surface is a reference.

  Here, as shown in FIG. 6, the center of gravity PG0 of the polygon P2 for the reflected image is the origin, the horizontal direction is the x coordinate, the vertical direction is the y coordinate, and the gazing point PG0 of the virtual camera C is set to the reference point B. The direction of the going vector D <D> is defined as the z direction. In this coordinate system, the x coordinate of the line-of-sight corresponding position TS on the image reflected on the building surface is set according to the angle βxz (see FIG. 3) obtained by projecting the line-of-sight angle β onto the xz plane. Further, the y coordinate of the line-of-sight corresponding position TS on the image reflected on the building surface is set according to the angle βyz (not shown) obtained by projecting the line-of-sight angle β onto the yz plane.

  Specifically, an angle βxz_max (see FIG. 3) when the straight line LS1 connecting the position of the virtual camera C and the gazing point PG0 of the virtual camera C intersects the boundary in the width direction of the building surface on the virtual camera C side. The calculation process is executed by the CPU 7. Also, a process of calculating an angle βyz_max (not shown) when the straight line LS1 connecting the position of the virtual camera C and the gazing point PG0 of the virtual camera C intersects the boundary in the height direction of the building surface on the virtual camera C side. , Executed by the CPU 7. Then, the CPU 7 executes a process (βxz / βxz_max) for dividing the angle βxz obtained by projecting the line-of-sight angle β on the xz plane by the angle βxz_max. Further, the CPU 7 executes a process (βyz / βyz_max) for dividing the angle βyz obtained by projecting the line-of-sight angle β on the yz plane by the angle βyz_max.

  Then, the position “(βxz / βxz_max, βyz / βyz_max)”, which is the division result with reference to the line-of-sight position TS (= T0) on the image reflected on the building surface, is the position TS corresponding to the line-of-sight angle β. It is recognized by the CPU 7 as coordinate data of (the line-of-sight corresponding position on the image reflected on the building surface).

  In this way, when the position TS corresponding to the line-of-sight angle β (the line-of-sight corresponding position on the image reflected on the building surface) is recognized by the CPU 7, the image corresponding to the camera building distance BC with the position TS as a reference. The CPU 7 sets and recognizes the extraction range, i.e., the range of the partial image in the image reflected on the building surface. In this way, at least a part of the texture data TG for the reflected image is extracted by the CPU 7.

  Here, for example, when the camera building distance BC is equal to the length of the building in the width direction, the camera building distance BC and the range (boundary) where the image is extracted so that the image reflected on the building surface is the same size. Is associated with the data for defining. Then, as the camera building distance BC approaches the building surface on the virtual camera C side, the camera building distance BC and the image are extracted so that the range of the image extracted from the image reflected on the building surface becomes smaller. Data for defining a range (boundary) is associated. On the other hand, the camera building distance BC and the image are extracted so that the range of the image extracted from the image reflected on the building surface increases as the camera building distance BC moves away from the building surface on the virtual camera C side. Is associated with data for defining a range (boundary) to be performed.

  Here, the data for defining the range (boundary) for extracting the image, that is, the data for defining the range of the partial image in the image reflected on the building surface is the coordinate data of the four corners. That is, when the camera building distance BC is calculated, four predetermined values corresponding to the camera building distance BC are added to each of the x coordinate data and the y coordinate data indicating the position TS corresponding to the line-of-sight angle β. Is executed by the CPU 7. Thereby, the coordinate data TS1, TS2, TS3, TS4 (see FIG. 3) at the four corners with respect to the position TS corresponding to the line-of-sight angle β is obtained. An image reflected on the building surface by causing the CPU 7 to recognize the coordinate data TS1, TS2, TS3, TS4 (see FIG. 3) of these four corners for defining the range of the partial image in the image reflected on the building surface. The range of the partial image can be defined, and the partial image in the image reflected on the building surface can be extracted.

  Subsequently, a process of projecting the building texture data onto the building polygon P1 is executed by the CPU 7 (S114). For example, the CPU 7 executes processing (mapping) for associating the three-dimensional coordinates of the building polygon P1 with the two-dimensional coordinate system. The CPU 7 executes a process of associating the coordinates of the building texture data with the two-dimensional coordinate system in which the building polygon P1 is mapped. Thereby, the polygon model PM1 for buildings is generated. The building polygon model PM1 generated here is at least partially transparent depending on the value of the transparency W. For example, in this building polygon model PM1, the window on the wall surface has transparency corresponding to 100% transparency W1, and the wall surface of the building excluding the window has transparency corresponding to 50% transparency W2. Have.

  Subsequently, the CPU 7 executes a process of projecting the extracted reflected image texture data onto the reflected image polygon P2 (S115). For example, the CPU 7 executes processing (mapping) for associating the three-dimensional coordinates of the polygon P2 for the reflected image with the two-dimensional coordinate system. Then, the CPU 7 executes a process of associating the coordinates of the extracted texture data for the reflected image with the two-dimensional coordinates obtained by mapping the polygon P2 for the reflected image. Thereby, the polygon model PM2 for the reflected image is generated.

  Subsequently, a process of photographing the polygon model PM2 for a reflected image inside the building polygon model PM1 through the entire wall surface of the building polygon model PM1 by the virtual camera C from the outside of the building polygon model PM1. By causing the CPU 7 to execute it, as shown in FIG. 7, the building and the video image shown on the building surface are displayed on the television monitor 20 (S116).

  In addition, in FIG. 7, the image | video reflected on the building surface is shown with the broken line. Further, a polygon model PM2 for displaying an image reflected on the building surface on the television monitor 20 is formed at the position of the polygon P2 shown in FIG.

  Specifically, by causing the CPU 7 to issue a shooting command for the virtual camera C, an image captured by the virtual camera C is displayed on the television monitor 20. For example, when the gazing point PG0 of the virtual camera C is arranged inside the building polygon P1, when a shooting command is issued from the CPU 7, the polygon model for the reflected image inside the building polygon model PM1 is displayed. PM2 is photographed by the virtual camera C from the outside of the building polygon model PM1 through the entire wall surface of the building polygon model PM1. Then, an image of the building and an image reflected on the building surface (an image reflected on the building surface) are displayed on the television monitor 20.

  In the above description of the video display system, the process of step 101 (S101) and the process of step 102 (S102) are executed in step 1 (S1). The processing from step 103 (S103) to step 116 (S116) is executed in step 4 (S4). That is, when a building is displayed on the television monitor 20 until a command indicating that the play mode has ended is issued from the CPU 7 (until Yes in S5), this step 103 (S103). ) To step 116 (S116).

  As described above, in the present embodiment, the polygon model PM2 for the reflected image arranged inside the building polygon model PM1 is photographed by the virtual camera C from the outside of the building polygon model PM1, Different images can be drawn on the building surface according to the position where the virtual camera C captures the building. Also, different parallaxes can be expressed in the video displayed on the television monitor 20 depending on the position where the virtual camera C captures the building. In this way, an image reflected on the building surface can be displayed on the television monitor 20 with a realistic expression.

[Other Embodiments]
(A) In the above embodiment, the polygon model for the reflected image arranged inside the polygon model for the object is passed through the transparent portion of the polygon model for the object by the virtual camera from the outside of the polygon model for the object. By photographing, a different image (image reflected on the object surface) is displayed on the image display unit depending on the position where the virtual camera captures the object. Here, a plurality of reflected image polygon models may be arranged apart from each other in the depth direction from the transparent portion of the object polygon model. For example, a car polygon model is arranged inside a transparent part, a house polygon model is arranged behind the car, and a background polygon model including a forest is arranged further inside. In this case, depending on the position and movement of the virtual camera, a part of the house can be seen blocked by a car located in front of it or the whole image can be seen without being blocked at all. At the same time, the area where the background forest is blocked by the car or house in front of it changes. In other words, by constructing an external reflection scene with a plurality of polygon models that are spaced apart from each other, a more three-dimensional reality with a sense of depth is achieved than when an external reflection scene is configured with a single polygon model. Close image representation can be performed.

  (B) In the above embodiment, an example in which a home video game apparatus as an example of a computer to which a game program can be applied has been used has been described. However, the game apparatus is not limited to the above embodiment, and a monitor is separately provided. The present invention can be similarly applied to a game device configured in a body, a game device in which a monitor is integrated, a personal computer functioning as a game device by executing a game program, a workstation, and the like.

  (C) The present invention includes a program for executing the above-described game and a computer-readable recording medium on which the program is recorded. Examples of the recording medium include a computer-readable flexible disk, a semiconductor memory, a CD-ROM, a DVD, an MO, a ROM cassette, and the like in addition to the cartridge.

1 is a basic configuration diagram of a video game apparatus according to an embodiment of the present invention. The functional block diagram as an example of the said video game device. The figure for demonstrating the arrangement position of the polygon for buildings, the polygon for a reflected image, a virtual camera, etc. in a three-dimensional game space. The figure which shows the position of a virtual camera, the position of a gazing point, and the position of a light source in a three-dimensional game space. The figure which shows the correspondence of a reflection angle and a reflectance. The figure for demonstrating the calculation method of a gaze angle. The figure which shows the building displayed on a monitor, and the image | video reflected on the building surface (the figure which shows the polygon model of the part displayed on a monitor). Flow showing the overall outline of the baseball game. The flowchart for demonstrating a video display system.

Explanation of symbols

1 control unit 3 image display unit 7 CPU
12 RAM
17 controller 20 television monitor 50 first texture storage means 51 second texture storage means 52 first polygon placement means 53 second polygon placement means 54 light source placement means 55 camera placement means 56 gazing point placement means 57 reflection level setting means 58 Reflection effect adding means 59 Texture determining means 60 First polygon generating means 61 Second polygon generating means 62 Image display means C Virtual camera BC Camera inter-building distance PG0 Gaze point P1 Building polygon PM1 Building polygon model P2 Reflected image Polygon for PM2 Polygon model for reflection image TG Texture data for reflection image L Light source α Reflection angle β Gaze angle H Reflectance

Claims (8)

To a computer that can process data for displaying objects on the image display,
A first texture storage function for storing texture data for an object in a storage unit;
A second texture storage function for storing the texture data for the reflected image corresponding to the image that can virtually appear on the object surface in the storage unit;
A first polygon placement function for placing the object polygon in a virtual space by causing the control unit to recognize coordinate data for defining the placement position of the object polygon;
The polygon for the reflected image is placed inside the polygon for the object by causing the control unit to recognize coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the object. A second polygon placement function,
A camera placement function for placing the virtual camera in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the virtual camera outside the polygon for the object;
A gaze point arrangement function for arranging the gaze point of the virtual camera in the virtual space by causing the control unit to recognize coordinate data corresponding to the gaze point of the virtual camera;
Based on the position of the virtual camera and the position of the gazing point of the virtual camera, the control unit executes a process of extracting at least a part of the texture data for the reflected image, whereby the texture of the image reflected on the object surface Texture decision function to decide,
A first polygon generation function for generating a polygon model for an object that is at least partially transparent by causing the control unit to execute a process of projecting the texture data for the object onto the polygon for the object;
A second polygon generation function for generating a polygon model for a reflected image by causing the control unit to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image;
The control unit performs processing for photographing the polygon model for the reflected image inside the polygon model for the object from the outside of the polygon model for the object through a transparent portion of the polygon model for the object. An image display function for displaying the object and an image reflected on the surface of the object on an image display unit,
An image processing program for realizing In the camera arrangement function, when a camera movement command for moving the virtual camera outside the polygon for the object is issued from the control unit, the control unit recognizes coordinate data indicating the position of the virtual camera after the movement. By placing the virtual camera in the virtual space,
In the texture determination function, by causing the control unit to execute a process of extracting at least part of the texture data for the reflected image according to the position of the virtual camera after movement and the position of the gazing point of the virtual camera. A texture of an image reflected on the object surface is determined;
The image processing program according to claim 1. In the computer,
A reflection degree setting function for setting a reflection degree of an image reflected on the object surface by causing the control unit to recognize the transparency of the texture data of the object;
The image processing program according to claim 1 or 2 for further realizing the above. In the computer,
A light source arrangement function for arranging the light source in a virtual space by causing the control unit to recognize coordinate data for defining the arrangement position of the light source outside the polygon for the object;
By causing the control unit to execute processing for setting the reflectance of the texture data of the object according to the position of the virtual camera, the position of the gazing point of the virtual camera, and the position of the light source, the image reflected on the object surface is displayed. A reflection effect adding function for adding a reflection effect;
The image processing program according to claim 1, for further realizing the above. In the texture determination function, based on the coordinate data indicating the position of the virtual camera and the coordinate data indicating the gazing point of the virtual camera, the control unit executes a process of calculating the gaze angle of the virtual camera, and for the reflected image By causing the control unit to recognize the coordinate data corresponding to the line-of-sight angle in the image indicated by the texture data, the texture of the image reflected on the object surface is extracted based on the position indicated by the coordinate data corresponding to the line-of-sight angle. To be
The image processing program according to claim 1. In the texture determination function, based on the coordinate data indicating the position of the virtual camera, a process for calculating the distance between the position of the virtual camera and the object is further executed by the control unit, and the object surface corresponding to the distance is calculated. By causing the control unit to recognize the range of the image shown, the texture of the range of the image shown on the object surface is extracted with reference to the position indicated by the coordinate data corresponding to the line-of-sight angle.
The image processing program according to claim 5. An image processing apparatus capable of processing data for displaying an object on an image display unit,
First texture storage means for storing texture data for the object in the storage unit;
Second texture storage means for storing texture data for a reflected image corresponding to an image that can be virtually reflected on the object surface in a storage unit;
First polygon placement means for placing the object polygon in a virtual space by causing the control unit to recognize coordinate data for defining the placement position of the object polygon;
The polygon for the reflected image is placed inside the polygon for the object by causing the control unit to recognize coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the object. Second polygon placement means for
Camera placement means for placing the virtual camera in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the virtual camera outside the polygon for the object;
Gaze point arrangement means for arranging the gaze point of the virtual camera in the virtual space by causing the control unit to recognize coordinate data corresponding to the gaze point of the virtual camera;
Based on the position of the virtual camera and the position of the gazing point of the virtual camera, the control unit executes a process of extracting at least a part of the texture data for the reflected image, whereby the texture of the image reflected on the object surface Texture determining means for determining
First polygon generating means for generating a polygon model for an object that is at least partially transparent by causing the control unit to execute a process of projecting the texture data for the object onto the polygon for the object;
Second polygon generating means for generating a polygon model for a reflected image by causing the control unit to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image;
The control unit performs processing for photographing the polygon model for the reflected image inside the polygon model for the object from the outside of the polygon model for the object through a transparent portion of the polygon model for the object. Image display means for displaying the object and an image reflected on the surface of the object on an image display unit,
An image processing apparatus comprising: An image control method for controlling data for displaying an object on an image display unit by a computer,
A first texture storing step of storing texture data for the object in the storage unit;
A second texture storage step of storing texture data for a reflected image corresponding to an image that can be virtually reflected on the object surface in a storage unit;
A first polygon placement step of placing the object polygon in a virtual space by causing the control unit to recognize coordinate data for defining the placement position of the object polygon;
The polygon for the reflected image is placed inside the polygon for the object by causing the control unit to recognize coordinate data for defining the arrangement position of the polygon for the reflected image inside the polygon for the object. A second polygon placement step,
A camera placement step for placing the virtual camera in the virtual space by causing the control unit to recognize coordinate data for defining the placement position of the virtual camera outside the polygon for the object;
A gazing point arrangement step of arranging the gazing point of the virtual camera in the virtual space by causing the control unit to recognize coordinate data corresponding to the gazing point of the virtual camera;
Based on the position of the virtual camera and the position of the gazing point of the virtual camera, the control unit executes a process of extracting at least a part of the texture data for the reflected image, whereby the texture of the image reflected on the object surface Determining a texture; and
A first polygon generation step of generating a polygon model for an object that is at least partially transparent by causing the control unit to execute a process of projecting the texture data for the object onto the polygon for the object;
A second polygon generation step of generating a polygon model for the reflected image by causing the control unit to execute a process of projecting the extracted texture data for the reflected image onto the polygon for the reflected image;
The control unit performs processing for photographing the polygon model for the reflected image inside the polygon model for the object from the outside of the polygon model for the object through a transparent portion of the polygon model for the object. An image display step for displaying the object and an image reflected on the surface of the object on an image display unit,
An image control method comprising:

Images