JP2003051032A - Game information, information storage medium and game device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a replay function with a high performance effect without requiring any high-grade processing. SOLUTION: The display area of an object to be displayed on a replay screen is set by a display control part 224. The image of the object is extracted from a display image by an image extracting part 222. First of all, an object area is determined on the basis of the position or size of the object on the display image. Next, the image of the object is extracted by determining an extraction area corresponding to the aspect ratio of the display area. Further, the image extracted on the basis of the size of the display area is expanded/reduced and stored in an extracted image storage part 540 after the size is changed. The replay screen is produced by controlling the display of the extracted image stored in this extracted image storage part 540 by the display control part 224.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to game information, an information storage medium storing the game information, and a game device.

[0002]

2. Description of the Related Art Currently, various kinds of games are provided, and in particular, it is known that a game screen has a replay function for reproducing a game screen, such as a sports game, a fighting game, or a racing game. . This replay function saves game data during game progress and reproduces a score scene such as a goal scene or a highlight scene such as a KO scene by referring to the game data related to the scene. Furthermore, as a replay function, there is also known a game device having a function of generating an image from a viewpoint different from the viewpoint at the time of progress of the game.

[0003]

By the way, the replay function is not only used as a reference for making the best use of the next play, but also in terms of looking back on the play, a dramatic effect is preferred. Further, since advanced processing can be realized due to the progress of hardware of computers and game devices, there has been a tendency to further enhance the effect of presentation by providing more realistic images.
It is an object of the present invention to provide a replay function having a high effect of presentation without using another method, that is, a high-level processing.

[0004]

In order to solve the above-mentioned problems, the present invention according to claim 1 provides a virtual space based on a given viewpoint to a device having the processor by calculation / control by the processor. Game information for causing a generation unit that generates an image (for example, the image generation unit 240 shown in FIG. 4) to function, and an image generated by the generation unit is a frame image (for example, a display in the embodiment of the invention. A first storage unit (for example, the frame buffer 520 shown in FIG. 4) that stores the image as an image, and an extraction unit that determines an extraction region from the frame image and extracts the image of the extraction region (for example, FIG. 4). Image extraction unit 22 shown in
2), a second storage unit that stores the extracted image extracted by the extraction unit (for example, the extracted image storage unit 540 shown in FIG. 4), and the extracted image stored in the second storage unit. , Reproduction information generating a reproduction image of the game (for example, the display control unit 224 shown in FIG. 4), and information for causing the device to function.

According to a twelfth aspect of the present invention, there is provided a game device including a generation unit (for example, an image generation unit 240 shown in FIG. 4) which generates an image of a virtual space based on a given viewpoint, and the generation is performed. A first storage unit (for example, the frame buffer 520 shown in FIG. 4) that stores the image generated by the unit as a frame image, an extraction region is determined from the frame image, and the image of the extraction region is extracted. Extraction means (for example, the image extraction unit 222 shown in FIG. 4)
And a second storage unit (for example, the extracted image storage unit 5 shown in FIG. 4) that stores the extracted image extracted by the extraction unit.
40) and the extraction image stored in the second storage unit, and reproduction means for generating a reproduction image of the game (for example,
The display control part 224) shown in FIG. 4 is provided.

According to the invention of claim 1 or 12, the image of an arbitrary region of the frame image stored in the first storage means is extracted, and the extracted image thus extracted is stored in the second storage means. The image of the extraction area in the frame image is reproduced by setting the above. That is, by saving the image of the required area from the frame image stored in the first storage means to the second storage means, the image of the extraction area in the frame image can be reproduced. For example,
Replay of an arbitrary scene in a game can be realized using an image extracted from a frame image.

Further, the game information according to claim 2 is the setting means according to claim 1 for setting a subject (for example, a self character in the embodiment of the invention) (for example, FIG. 4).
Calculation for calculating the position of the object in the frame image corresponding to the position of the object in the virtual space and the information for causing the game operation unit 220) shown in FIG. Means (eg, FIG. 4)
The information for causing the device to function as the image extracting unit 222) and the information for the extraction unit to determine the extraction region based on the calculation result by the calculation unit are included.

According to the second aspect of the present invention, for example, an object placed in the virtual space can be designated as the subject to be stored, and the image of the subject can be stored in the second storage means. Further, when extracting the image of the subject, the position of the subject in the frame image is determined by coordinate conversion based on the position of the viewpoint set in the virtual space. According to this, even when the object is not actually drawn in the frame image due to the reason that another object existing in the virtual space becomes an obstacle, etc., the area which becomes the position of the object based on the viewpoint in the frame image is determined. Can be extracted.

Further, in this case, as in the game information according to claim 3, in claim 2, the extracting means determines the extraction region according to the size of the subject in the frame image. Information may be included.

According to the third aspect of the invention, the ratio of the subject in the extracted image can be made constant regardless of the size of the subject in the frame image. According to this
It is possible to extract a region in which the subject is just fit from the frame image.

The game information according to a fourth aspect is the size setting means for setting the size of the extracted image stored in the second storage means according to the second or third aspect (for example, the image extracting section 222 shown in FIG. 4). For causing the device to function, and the extraction means includes information for determining the aspect ratio of the extraction region based on the aspect ratio of the size of the extracted image set by the size setting means. Is characterized by.

According to the invention of claim 4, the size of the extracted image stored in the second storage means is set in advance,
Since the aspect ratio of the extraction area is set based on the aspect ratio of the size of the extracted image, the size of the extraction image and the aspect ratio of the extraction area in the frame image can be made constant.

Further, in this case, as in the game information according to claim 5, in the claim 4, the size setting means sets the vertical size of the extracted image to an integer fraction of the vertical size of the frame image. And / or information for setting the lateral size of the extracted image to be an integral fraction of the lateral size of the frame image may be included.

According to the fifth aspect of the invention, when determining the size of the extracted image, the size of the extracted image can be determined according to the size of the frame image, that is, the size of the display screen. That is, it is possible to determine the size of the extracted image based on the aspect ratio of the screen displaying the image.

The game information according to claim 6 is the game information according to claim 1.
5, information for causing the device to function as a scaling unit (for example, the image extracting unit 222 shown in FIG. 4) that scales the extracted image extracted by the extracting unit to a given size; The second storage means includes information for causing the extracted image scaled by the scaling means to function to be stored.

According to the sixth aspect of the invention, the size of the extracted image extracted is enlarged or reduced according to a given size set by the size setting means. Therefore, by setting the size of the extracted image according to the size required when reproducing the extracted image, no special process is required when generating the reproduced image using the extracted image.

The game information according to claim 7 is, in any one of claims 1 to 6, extraction time setting means for setting the extraction time (for example, the game calculation section 22 shown in FIG. 4).
0) to cause the device to function, and the extraction means includes information for extracting the extracted image from the frame image corresponding to the time set by the extraction time setting means. To do.

According to the seventh aspect of the invention, it becomes possible to set the conditions for extracting the image from the frame image, and it is possible to extract only the subject satisfying the condition. As the extraction condition, for example, the timing of extracting an image, a preset parameter, or the like is determined. This parameter includes information such as the characteristics and state of the subject, which is set for the subject. Specifically, for example, it is possible to specify a human object as a subject, set a parameter of emotions and feelings for the human object, and set this parameter as an extraction condition. According to this, the extraction process can be performed according to the facial expression of the subject displayed in the display image.

Further, the game information according to claim 8 is the game information according to any one of claims 1 to 7, wherein:
Information for cumulatively storing the extracted images extracted by the extracting means, and information for generating the reproduced image in which the reproducing means arranges the plurality of extracted images stored in the second storing means, It is characterized by including.

According to the eighth aspect of the present invention, since the image of the subject is accumulated, if, for example, a character or the like moving in the virtual space is designated as the subject, the motion of the subject can be recorded. it can. This makes it possible to reproduce the motion of the subject, if necessary. Further, at this time, since it is only necessary to read out the extracted image stored in the second storage means, it is possible to reproduce the motion of the subject without requiring special processing. According to this, by controlling the arrangement order or the like when arranging the plurality of extracted images stored in the second storage unit, replay of the motion of the subject, reverse rotation, etc. are realized in the generated reproduced image. I can do things. Furthermore, when generating a reproduction image, a plurality of stored extracted images are sequentially displayed in frame advance based on a preset time difference, or the display screen is divided to display a plurality of extracted images on one screen. It is possible to produce a reproduced image.

Further, in this case, as in the game information according to claim 9, in claim 8, the reproduction means includes the reproduction image from the plurality of extracted images stored in the second storage means. Information for selecting the extracted image may be included.

According to the ninth aspect of the invention, it is possible to select an appropriate image for generating the reproduced image from the plurality of extracted images stored in the second storage means.

The game information according to a tenth aspect of the present invention is the game information according to any one of the first to ninth aspects, wherein when the second storage means stores the extracted image, the extracted image is subjected to a given filter. It is characterized in that it includes information to be stored.

Here, the filter is to apply some processing to the extracted image stored in the second storage means, and specifically, for example, blurring of the extracted image, addition of noise, This includes processing such as changing the brightness and setting the α value, and processing for deforming the extracted image due to rotation and distortion.

According to the tenth aspect of the present invention, the extracted image that has passed through the given filter is stored in the second storage means. Further, when the extracted images are cumulatively stored in the second storage unit, the filter parameters set for the respective filters can be changed and stored according to the extracted images. Therefore, by arranging the extracted image based on the parameter, for example, a reproduced image can be rendered by fade-in or fade-out. The filter parameters are
For example, it is a value set when applying a filter such as an α value or a coefficient by which the RGB value of each pixel is multiplied, or a value for specifying an option of the filter.

Furthermore, the game information according to any one of claims 1 to 10 may be stored as in the information storage medium according to claim 11.

According to the eleventh aspect of the present invention, it is possible to realize an information storage medium having the same effects as those of the invention according to any one of the first to tenth aspects.

[0028]

DETAILED DESCRIPTION OF THE INVENTION A game machine to which the present invention is applied will be described in detail below with reference to the drawings. In the following, a case where the present invention is applied to a tennis game will be described as an example, but the present invention is not limited to this. Further, in the tennis game, a battle is realized by operating, by computer control, an opponent character, which is an opponent of a character controlled by the player (hereinafter, referred to as own character).

FIG. 1 shows an example of a play screen of a tennis game. In FIG. 1, the player controls the player character 2 playing on the front side of the court and plays a tennis game by playing against the opponent character 4 playing on the back side of the court.

FIG. 2 shows an example of a replay screen displayed for reproducing the scored scene after scoring. In FIG. 2, the replay screen is a real-time display area P1.
, And the replay display areas RP1, RP2, ..., RP1
2 and. Here, in the real-time display area P1, for example, an arbitrary moving image such as a play screen or a comment screen is displayed. Also, the replay display areas RP1 and R
On P2, ..., RP12, the motion of the player character 2 in the scoring scene is displayed as 12 still images clockwise from the upper left. In addition, this replay display area RP1,
Own character 2 displayed on RP2, ..., RP12
When the image is displayed, the replay display area RP at the upper left is displayed.
The frames are sequentially displayed from 1 at a predetermined time interval.

According to the present invention, for example, an object arranged in the virtual three-dimensional space, an arbitrary area of the virtual three-dimensional space, or the like is used as a subject, and the object is designated from the image data stored in the frame buffer for each inter. The image of the subject is extracted and separately recorded, and the recorded image of the subject is displayed at an arbitrary display timing. In the present embodiment, the subject is the own character 2 and the display regions for displaying the subject during replay are recorded as replay display regions RP1, RP2, ..., RP12 shown in FIG. 2 on the scored display screen. Replay display areas RP1, RP2, ...
, And the score scene of the player character 2 is reproduced by displaying on the RP 12.

FIG. 3 shows an example of a replay screen when the player character 2 plays behind the court. As shown in FIG. 3, on the play screen displayed in the real-time display area P1, an image of the player character 2 playing on the back side of the court is displayed. Then, in the replay display areas RP1, RP2, ..., RP12, the images of the player character 2 in the scoring scene are displayed.

As shown in FIGS. 2 and 3, the images of the player character 2 in the scoring scene are different regardless of the place where the player character 2 plays, that is, the position and size of the player character 2 on the play screen. Replay display area RP
1, RP2, ..., RP12 are displayed. Further, even if the play position of the player character 2 is moved, each replay display area RP1, RP2, ...
, The image of the player character 2 is displayed in the center of the RP 12.

FIG. 4 shows a game device 1 according to this embodiment.
It is a figure which shows an example of the functional block of. In the figure,
The functional blocks include an operation unit 100, a processing unit 200, a display unit 300, a storage unit 400, a temporary storage unit 500,
Composed of.

The operation section 100 is for the player to input operation data, and outputs an operation signal according to the operation by the player to the processing section 200. This operation unit 10
The function of 0 can be realized by hardware such as a lever, a button, and a housing.

The processing section 200 controls the entire game apparatus 1, gives instructions to each functional section in the game apparatus 1, performs various processing such as game progress processing, image processing, and sound processing, and in particular, virtual processing. Three-dimensional space setting processing, virtual camera position and line-of-sight direction setting processing in the virtual three-dimensional space, processing for generating an image of the virtual three-dimensional space viewed from the virtual camera (hereinafter referred to as display image), and the like. , According to the game program 420 stored in the storage unit 400.
The function of this processing unit 200 is that various processors (CPU,
This can be realized by hardware such as DSP) or ASIC (gate array etc.) or a given program.

The processing section 200 also includes a game calculation section 220 and an image generation section 240 as main functional sections. Here, the operation of the processing unit 200 relating to the generation of the game image will be described with reference to FIG.

FIG. 5 is a diagram for explaining the display image generation processing. As shown in FIG. 5, in a virtual three-dimensional space,
An object 600 and a viewpoint (virtual camera) 610 are set. Further, the object 600 has the shape, color, texture, etc. defined as object data. The game calculation section 220 follows the object data relating to the object 600, based on the position information and the direction information of each polygon forming the object 600,
The coordinate value of the object 600 in the world coordinate system (Xw, Yw, Zw) is set. Subsequently, the position of the viewpoint 610 and the direction of the line of sight are set in the world coordinate system (Xw, Yw, Zw), and the view volume 620 is determined by clipping processing. Then, each polygon included in this view volume 620 is converted into a coordinate value of a viewpoint coordinate system (Xv, Yv, Zv) with respect to the viewpoint 610, and then, the determined viewpoint coordinate system (Xv, Yv, Zv).
2D screen coordinate system (Xs,
Ys) coordinate values are converted.

The image generation unit 240 uses the game calculation unit 2
A display image is generated based on the processing result of 20. Specifically, for the object 600 projected on the screen 630, color interpolation processing based on information related to the color, texture, etc. defined in the object 600,
Rendering processing such as hidden surface removal processing is performed. As a result, the object 600 is projected on the screen 630 placed on the extension of the viewpoint 610, and the display image is drawn on the screen 630. Then, the frame buffer 520
This display image data is written to generate display image data for one frame for one inter time (for example, 1/60 second).

Further, in order to realize the present invention, the game calculation section 220 includes, in particular, the image extraction section 222 and the display control section 2.
24 and 24.

The image extraction unit 222 executes processing according to the image extraction program 422, and the frame buffer 520
An image of a previously designated subject is extracted from the image data stored in the image data storage unit 5 and the subject image is extracted.
The process of storing in 40 is performed. At this time, the image of the subject is extracted and scaled up or down according to the size of the display area for displaying the subject image.

The display control unit 224 executes processing according to the display control program 424, and the image extraction unit 22 described later.
Before the extraction process by 2 is performed, the size of the display area of the subject image (for example, the replay display areas RP1, RP2, ... RP12 shown in FIG. 2 or 3) is set.
At this time, the size of the display area of the subject image is set based on the aspect ratio of the display screen. The size of this display area is arbitrary, but as described above,
The image extraction unit 222 extracts the image of the subject according to the size of the display area, and the extracted image storage unit 540.
To store.

Further, the display control unit 224, when displaying the image stored in the extracted image storage unit 540 on the display screen,
A process for controlling the display of the image is performed.

Next, the processing unit 20 for realizing the present invention.
The operation of 0 will be described with reference to FIG. Figure 6
It is a flow chart which shows an example of a flow of processing in this embodiment. As shown in the figure, first, the game calculation unit 2
20 arranges the objects forming the virtual three-dimensional space to set the virtual three-dimensional space (step S10). Furthermore, the game calculation unit 220 determines the world coordinate system (Xw, Yw, Zw) in step S10.
Place a virtual camera in the virtual three-dimensional space set by
The viewpoint of this virtual camera and the direction of the line of sight from the viewpoint are controlled.

Next, the game calculation section 220 performs clipping processing to determine the view volume, and sets the polygons located in the view volume to the viewpoint coordinate system (Xv, Yv, Zv) centered on the viewpoint of the virtual camera. ), The viewpoint coordinate system (Xv,
Based on the coordinate values of Yv, Zv), processing for converting into coordinate values in the two-dimensional screen coordinate system (Xs, Ys) is performed (step S20).

Then, based on the processing results of the game calculation unit 220 in steps S10 and S20, the image generation unit 240 causes the screen coordinate system (X
(s, Ys), such as the coordinate value of the object in (s, Ys) and various rendering processes based on the object data of each object, thereby performing the drawing process on the object projected on the screen and generating the display image. (Step S30). At this time, the pixel information of the generated display image is written in the frame buffer 520. Further, this pixel information is processed by the processing unit 20.
0, it is converted into an image signal in accordance with the display timing of the display image corresponding to the pixel information, and the display unit 300
Is output to.

Next, the image extracting section 222 executes an image extracting process (step S40). The image extraction unit 222
A process of extracting an image of a subject designated in advance from the display image is performed. Here, the function of the image extracting unit 222 will be described with reference to FIGS. 7 to 9.

FIG. 7A shows an example of a perspective view of a virtual three-dimensional space. As shown in FIG. 7A, in the virtual three-dimensional space, a rectangular parallelepiped object 72 and a desk object 74 are included.
Are placed, and the rectangular parallelepiped object 72 is placed on the desk object 74. Further, a virtual camera 76 is installed so as to photograph the rectangular parallelepiped object 72 and the desk object 74. In addition, FIG.
A rectangular parallelepiped object 7 placed in a virtual three-dimensional space
2 is shown. Here, hereinafter, the image extraction unit 22 will be described as an example in which the rectangular parallelepiped object 72 is designated as a subject and the image of the rectangular parallelepiped object 72 is extracted from the display image.
The process in 2 will be described.

The image extraction unit 222 targets only the rectangular parallelepiped object 72, which is the subject arranged in the virtual three-dimensional space shown in FIG. 7A, on the screen coordinate system (Xs, Y).
s) is converted into coordinates. Then, the rectangular parallelepiped object 7 converted into the screen coordinate system (Xs, Ys)
The position of the rectangular parallelepiped object 72 on the screen, that is, the position of the rectangular parallelepiped object 72 in the display image is acquired by referring to the coordinate value of each vertex of 2.

FIG. 8 is a diagram for explaining the extraction region determination processing when extracting the image of the rectangular parallelepiped object 72. FIG. 8A shows a case where the rectangular parallelepiped object 72 is converted into the coordinate values of the screen coordinate system (Xs, Ys).
It is a figure which shows the rectangular parallelepiped object 72 in the screen 80. The image extracting unit 222 firstly converts the rectangular parallelepiped object 72 into the screen coordinate system (Xs, Ys).
A region (hereinafter, referred to as a subject region) 82 of the rectangular parallelepiped object 72 on the screen 80 is determined based on the coordinate values of the vertices of. Specifically, among the coordinate values of the vertices of the rectangular parallelepiped object 72 in the screen coordinate system (Xs, Ys), the coordinate values at the upper end, the lower end, the left end, and the right end, for example, the coordinate values of the vertices 86 and 88 are acquired. . Then, based on these coordinate values, the rectangular parallelepiped object 72
The subject area 82 is determined so as to include.

According to the determination of the subject area 82 as described above, the image of the subject is displayed on the display image because, for example, another object is present in front of the rectangular parallelepiped object 72 which is the subject for the virtual camera 76. Even if is not drawn, or is only partially drawn, the area at the position where the rectangular parallelepiped object 72 is projected can be designated as the subject area 82. Further, since the subject area 82 is determined based on the size of the rectangular parallelepiped object 72, the area in which the rectangular parallelepiped object 72 can be exactly set can be the extraction area.

Next, the image extracting section 222 extracts a region actually extracted from the display image (hereinafter referred to as an extraction region) 84.
Is determined based on the size of the replay display area RP for displaying the subject. FIG. 8B shows an example of the replay display area RP for displaying a subject. As described above, the replay display area RP that displays the image of the subject to be extracted
Is set in the display control unit 224 before the extraction processing is performed.

Here, as an example, as shown in FIG. 8B, the case where the replay display area RP is represented by a × 2a, that is, the ratio of the length and the width is represented by the ratio of 1: 2 is taken as an example. The case of determining the extraction area 84 will be described. First, the subject area 82
Compare the vertical and horizontal lengths in. Then, the extraction area 84 is determined according to the aspect ratio of the replay display area PR with the longer one as a reference. Here, the subject area 82
Is vertical, the horizontal length is twice the vertical length of the subject area 82 with reference to this vertical length b, and the size of the extraction area 84 is determined to be b × 2b. Then, the determined coordinate values of the extraction area 84 are stored in the temporary storage unit 500.

The image extraction unit 222 extracts the area corresponding to the extraction area 84 in the display image stored in the frame buffer 520 according to the extraction area 84 determined as described above. FIG. 9 is a diagram for explaining the process of extracting the image of the extraction region 84. FIG. 9A shows an example of the display image stored in the frame buffer 520. In the display image shown in FIG. 9A, an image (hereinafter referred to as an extracted image) 90 of an area corresponding to the extracted area 84 determined according to the coordinate values of the screen coordinate system (Xs, Ys) as described above is extracted. .

Then, the image extracting section 222 resizes the extracted image 90 to match the size of the replay display area RP to be displayed and stores it in the extracted image storage section 540. FIG. 9B shows an example of the extracted image 90 stored in the extracted image storage unit 540. The size of the extracted image 90 shown in FIG. 9B is equal to the size of the replay display area RP shown in FIG. 8B. That is, when the extracted image 90 is stored in the extracted image storage unit 540, the size of the extracted image 90 is enlarged or reduced according to the size of the replay display area RP.

The extracted image 90 is displayed in the replay display area RP.
When the size is changed according to the above, the reduced image or the enlarged image may be generated by the image smoothing process using the interpolation function of the pixel data of the bilinear filtering. In an image generation device such as a game device,
Interpolation pixel data arithmetic processing such as the nearest neighbor interpolation method, the bilinear interpolation method (so-called bilinear filtering), and the cubic convolution interpolation method (so-called trilinear filtering) may be realized as a hardware function. In such a case, the image smoothing process can be realized at a higher speed.

Here, bilinear filtering will be described. FIG. 10 shows existing pixels (T1, T2, T
3 and T4) and a pixel (P) interpolated by bilinear filtering. Figure 10
As shown in (a), the color CP of the pixel (sampling point) P to be interpolated is a color obtained by interpolating the colors of the pixels T1 to T4 around P.

Specifically, based on the coordinates of T1 to T4 and the coordinates of P, the coordinate ratio β: 1-β (0≤β≤
1) and the y-axis coordinate ratio γ: 1-γ (0 ≦ γ ≦ 1)
And ask. The color CP of P (output color in bilinear filtering) can be expressed by the following equation. CP = (1-β) × (1-γ) × CT1 + β × (1-γ) × CT2 + (1-β) × γ × CT3 + β × γ × CT4 (1)

Further, as shown in FIG. 10B, β = γ
= 1/2, the color CP of the pixel P to be interpolated
Is as follows: CP = (CT1 + CT2 + CT3 + CT4) / 4 (2)

The image extracting section 222 uses the replay display area R.
Extracted image 9 enlarged or reduced according to the size of P
0 is stored in the extracted image storage unit 540. FIG. 11 is a diagram for explaining an example of a storage method when storing the extracted image 90 in the extracted image storage unit 540. FIG. 11 (a)
Is generated every 1/60 second and the frame buffer 520
The display images sequentially stored in the frame buffer 520 are shown in FIG.
It is overwritten by the display image generated every 60 seconds. The extracted image 90 in the generated display image is shown in FIG.
The extracted image storage unit 540 shown in FIG.

As will be described later, in the present embodiment, a subject image is extracted every three frames, for example, of the images generated every 1/60 seconds. As shown in FIG. 11B, the extracted image storage unit 540
In, the extracted images 90 extracted every three frames are stored in order from the storage area 1. That is, the extracted image 90 in the first frame F1 is stored in the area 1, the extracted image 90 in the fourth frame F4 is stored in the area 2, and so on. Further, in the example in FIG. 11, the storage area of the extracted image storage unit 540 is an area for storing 32 extracted images 90. When the extracted image 90 is stored in all of these 32 storage areas, the area 1 is overwritten in order. The extracted image storage unit 54
The method of storing the extracted images in 0 is not limited to this. For example, when 12 display areas are set as the replay display areas as shown in FIG. 2 or FIG. Minute data may be secured and only displayable images may be stored.

The image extraction unit 22 having the functions described above
2 executes processing according to the image extraction program 422, and the operation of the image extraction unit 222 is as shown in FIG.
Follow the flowchart shown in. That is, first, it is determined whether or not a subject (for example, a rectangular parallelepiped object 72 shown in FIG. 7B) exists in the view volume (step S41). If it is determined in step S41 that the subject does not exist in the view volume, the main image extraction ends.

When it is determined in step S41 that the subject is present in the view volume, it is determined whether or not the image of the subject is extracted from the display image according to preset extraction conditions (step S42). In the present embodiment, for example, the extraction condition is set to extract the subject image from the display image every three frames. The extraction condition is not limited to this, and extraction may be performed by setting an extraction timing and determining this timing. Also,
It is of course possible to extract each frame without performing this determination processing. When it is determined in step S42 that the extraction process is not performed, the main image extraction is ended.

When it is determined in step S42 that the extraction process is to be performed, the image extraction unit 222 performs the process of converting the coordinate value of the subject into the coordinate value of the screen coordinate system (Xs, Ys) (step S43).

Next, the image extraction section 222 determines the subject area by referring to the coordinate values of the upper end, lower end, left end and right end of the screen of the subject converted into the screen coordinate system (Xs, Ys). The extraction area is determined according to the aspect ratio of the display area for displaying the subject (step S44).

Next, the image extraction unit 222 extracts the area corresponding to the extraction area determined in step S44 from the display image data stored in the frame buffer 520 (step S45). Then, the size of the extracted extracted image is changed according to the display area (step S46). That is, when the size of the extracted image is smaller than the size of the display area, the extracted image is enlarged, and when the size of the extracted image is larger than the size of the display area, the extracted image is reduced to extract the extracted image. Change the size of.

Next, the extracted image whose size has been changed according to the size of the display area is stored in the extracted image storage unit 540 (step S47), and the main image extraction processing is terminated.

When the image extraction processing in the image extraction unit 222 is completed, it is determined whether or not to display the replay (FIG. 6; step S50). In this step S50,
When it is determined that the replay screen is not displayed, the process returns to step S10 and the above processes are repeated.

When it is determined in step S10 that the replay screen is to be displayed, the display control section 224 executes a replay display process (step S60).

The replay display processing in the display control unit 224 is to display the extracted image stored in the extracted image storage unit 540 when it is determined to display the replay screen. The display control unit 224 controls the display of the plurality of extracted images stored in the extracted image storage unit 540. For example, control is performed so that a plurality of stored extracted images are arranged and arranged, and a predetermined time difference is provided and displayed when the plurality of extracted images are arranged.

A case will be described in which the extracted images are displayed in the twelve replay display areas RP1, RP2, ..., RP12 shown in FIG. 2 or FIG. First, from the extracted image storage unit 540, the replay display areas RP1, RP2,
..., determines 12 images to be displayed on the RP12. For example, if the latest extracted image stored in the storage area of the extracted image storage unit 540 shown in FIG. 11 is the extracted image stored in the area 32, 12 extracted images traced back from this area 32, that is, The extracted images stored in the areas 21 to 32 are displayed. Specifically, the replay display area RP
1 to the extracted image stored in the area 21, the replay display area RP2 to the extracted image stored in the area 22, and
The display control is performed so that the extracted image stored in the area 32 is displayed in the replay display area RP12 according to a predetermined time difference. The method of determining the 12 extracted image images to be displayed is not limited to this, and an arbitrary image may be selected from the extracted images stored in the extracted image storage unit 540 and displayed.

Then, when the replay display processing by the display control section 224 is completed, this processing is completed.

The display section 300 displays game images such as a play screen and a replay screen. The processing unit 200 outputs the display image data stored in the frame buffer 520 in the temporary storage unit 500 to the display unit 300.

In the storage unit 400, in addition to various processing programs and data, the game program 42 relating to the progress of the game is stored.
0 or various game information (not shown) necessary for the progress of the game
Etc. are stored. The game program 420 particularly includes an image extraction program 422 and a display control program 424 in order to implement the present invention. The processing unit 200 performs various processes based on the program and data read from the storage unit 400.

The temporary storage unit 500 stores, in particular, a calculation result executed by the game calculation unit 220 according to the game program 420, information input from the operation unit 100, display image data generated by the image generation unit 240, and the like. Stored temporarily. In addition, in the temporary storage unit 500,
Coordinate values of the objects included in the virtual three-dimensional space in the world coordinate system, the viewpoint coordinate system, and the screen coordinate system are also temporarily stored. The function of this temporary storage unit 500 is
For example, it can be realized by RAM or VRAM.

Further, the temporary storage unit 500 is, in particular, a frame buffer 520 in which the image data generated by the image generation unit 240 is stored, and an extracted image storage unit in which the extracted image generated by the image extraction unit 222 is stored. 540 and.

In the present embodiment, the player character operated by the player is set as the subject, but the present invention is not limited to this, and it is possible to designate any area in the virtual three-dimensional space. is there.

Next, an example of the hardware configuration that can realize the game device 1 according to this embodiment will be described with reference to FIG.
Will be explained. In the device shown in FIG. 13, the CPU 10
00, ROM 1002, RAM 1004, VRAM 10
05, information storage medium 1006, image generation IC 1008,
Sound generation IC 1010, I / O ports 1012, 1014
Are connected to each other via a system bus 1016 so that data can be input and output. The image generation IC 1008 includes a display device 1
018 is a speaker 1020 in the sound generation IC 1010.
However, the I / O port 1012 has a control device 102
2, the communication device 1024 is connected to the I / O port 1014,
Each is connected.

The CPU 1000 uses the information storage medium 1006.
According to a program stored in the ROM 1002, a system program stored in the ROM 1002 (initialization information of the apparatus main body, etc.), a signal input by the control device 1022, etc., control of the entire apparatus and various data processing are performed.

The RAM 1004 is a storage means used as a work area of the CPU 1000, and has a given content in the information storage medium 1006 and the ROM 1002, the CPU 10 and the like.
The calculation result of 00 is stored.

The VRAM 1005 corresponds to the temporary storage unit 500 shown in FIG. 4, and is a storage device for temporarily storing the display data displayed on the display device 1018. The VRAM 1005 includes a frame buffer (corresponding to the frame buffer 520 shown in FIG. 4) for storing one frame of image data generated by the image generation IC 1008. The frame buffer has a capacity corresponding to the resolution and the number of colors of the display device 1018 and stores color information for each pixel. Furthermore, this VRAM1005
Includes a storage area (for example, the extracted image storage unit 540 shown in FIG. 4) that stores the extracted image extracted from the display image data stored in the frame buffer.

The information storage medium 1006 mainly stores programs, image data, sound data, play data, and the like. A memory such as a ROM as an information storage medium, a hard disk, a game cassette, an IC card,
Magnetic disks, optical disks, etc. are used. The function of this information storage medium 1006 corresponds to the storage unit 400 shown in FIG.

For example, when the game device is applied to a home game device, a CD-ROM as an information storage medium 1006 for storing the game program 420 shown in FIG.
A game cassette, a DVD, or the like is used, and a memory card or the like is used as the information storage medium 1006 that stores play data. When applied to an arcade game machine, a memory such as a ROM or a hard disk is used as the information storage medium 1006.

Further, the image generation IC 1008 and the sound generation IC 1010 provided in this apparatus can perform suitable output of sounds and images.

First, the image generation IC 1008
ROM 1002, RAM 100
4. An integrated circuit that generates pixel information based on information sent from the information storage medium 1006 or the like, and the generated display signal is output to the display device 1018. Display device 101
8 is CRT, LCD, TV, plasma display,
Alternatively, it is realized by a projector or the like and corresponds to the display unit 300 shown in FIG.

The sound generation IC 1010 is the CPU 10
00, the information storage medium 1006 and the ROM 1
This is an integrated circuit that generates a sound signal according to the information stored in 002 and the sound data stored in the RAM 1004, and the generated sound signal is output by the speaker 1020.

The control device 1022 corresponds to the operation unit 100 shown in FIG. 4, and is a device for the player to input an operation related to the game.

The communication device 1024 exchanges information used inside the game device 1 with the outside, and is connected to another device through a communication line to transmit and receive given information according to the program. Used for.

The above-described processing such as the game progress processing is performed by the information storage medium 1006 storing the game program 420 shown in FIG. 4, the CPU 1000 operating according to these programs, the image generation IC 1008, and the sound generation I.
It is realized by C1010 and the like. The CPU 1000 and the image generation IC 1008 correspond to the processing unit 200 shown in FIG. 4. The CPU 1000 mainly corresponds to the game calculation unit 220 shown in FIG. 4, and the image generation IC 1008 corresponds to the image generation unit 240 shown in FIG. .

The image generation IC 1008 and the sound generation IC 1
The processing performed by 010 or the like may be performed by software by the CPU 1000 or a general-purpose DSP. In this case, the CPU 1000 causes the processing unit 200 shown in FIG.
Will be applicable.

Next, FIG. 14 shows an example in which the present game device 1 is applied to a home game device. In other words, the game controller 1202, 1
204 and a display 1206 are connected,
The player sees the game image displayed on the display 1206 and listens to the game sound output from a speaker (not shown) while watching the game controller 1202,
At 1204, a character or the like is operated to enjoy the game. Further, a CD (DVD) 1208 or a memory card 1210 that is detachable from the game device main body 1200.
A game program 42 stored in the storage unit 400 shown in FIG.
0 and information such as game data (not shown) are stored, and the game apparatus body 1200 performs various processes (for example, the process shown in FIG. 6 or FIG. 12) in accordance with these information. The operation unit 100 shown in FIG.
2, 1204, the display unit 300 has a display 1206.
Respectively correspond to.

FIG. 15 shows an example in which the game device 1 is applied to the arcade game device 1100. In this arcade game device 1100, the player uses the speaker 11
Operation lever 1 while listening to the game sound output from 02
This is a device for enjoying a tennis game by operating a character or the like displayed on the display 1108 by operating 104 or operation buttons 1106.
The operation unit 100 shown in FIG. 4 corresponds to the operation lever 1104 or the operation buttons 1106 ... And the display unit 300 corresponds to the display 1108.

A system board 1110 built in the arcade game machine 1100 is equipped with a CPU, an image generation IC, a sound generation IC and the like. The game program 420 shown in FIG. 4, game data not shown, and the like are stored in the memory 111, which is an information storage medium on the system board 1110.
Stored in 2.

Further, as shown in FIG. 16, the present game apparatus 1 is a host apparatus 1300 and a host apparatus 130.
0 and a terminal 1304 connected via a communication line 1302
It is good also as applying to the game device containing -1 to 1304-n. This terminal 1304-1 to 1304-n
Is a device capable of at least displaying a game image, outputting a game sound, and inputting a game operation. A player enjoys a tennis game on any of the terminals 1304-1 to 1304-n.

In this case, the game program 4 shown in FIG.
Information such as 20 and game data (not shown) is stored in an information storage medium 1306 such as a magnetic disk device, a magnetic tape device, or a memory that can be controlled by the host device 1300. The terminals 1304-1 to 1304-n are CPUs,
In the case where a game image or a game sound can be generated standalone by having an image generation IC and a sound generation IC, a program or data stored in the information storage medium 1306 from the host device 1300 is transmitted via the communication line 1302. Terminal 1
304-1 to 1304-n, and each terminal 1304
In -1 to 1304-n, a game image and a game sound are generated. On the other hand, when the game image or the game sound cannot be generated standalone, the host device 1300 generates the game image or the game sound, and the terminal device 1304-1.
1304-n. Then, the terminals 1304-1 to 1304-1
At 1304-n, the generated or distributed game image or game sound is output.

Although an example of the game device to which the present invention is applied has been described above, the present invention is not limited to the above-described embodiment, and can be appropriately modified without departing from the spirit of the present invention.

For example, when a given parameter is set in advance for an object to be a subject and it is determined whether or not the process of extracting the extracted image from the display image is to be performed, whether the parameter is extracted by determining the parameter is determined. It may be determined whether or not. For example, if a human object is specified as a subject and a parameter of emotions and emotions is set for this human object, by determining this parameter, the facial expression of the subject displayed in the display image is, for example, a case of a smiling face. It is also possible to perform extraction processing.

Further, in this embodiment, as shown in FIG. 2 or 3, twelve replay display areas RP1, PR2, ... RP12 are set as display areas for the extracted image, and the replay display areas RP1, PR2, ... RP
Although the replay screen is rendered by displaying the extracted images according to a predetermined time difference on the display screen 12, the replay display area RP20 is sequentially updated with the extracted images at every time t as in the replay screen shown in FIG. It may be possible to produce a replay screen. That is, the display control unit 224 first sets the replay display area RP20 for displaying the extracted images, and determines the extracted images to be displayed and the order thereof at the replay display timing. Then, the first extracted image is displayed in the replay display area RP20, and when the time t has elapsed, the replay display area R is displayed.
The display of the extracted image is controlled such that the second extracted image is displayed on P20.

Also, a replay screen may be rendered as shown in FIG. In this case, the display control unit 22
4 sets each replay display area RP30 so that a plurality of extracted images displayed on the replay screen slide, and displays the extracted images so that the extracted images are sequentially displayed based on a predetermined time difference at the replay display timing. May be controlled.

Further, as shown in FIG. 19, the sizes of the replay display areas RP40 to RP45 set on the replay screen may be all different. That is, the size of the area for displaying the extracted image set by the display control unit 224 is arbitrary, and the size of the extracted image to be extracted and saved is determined in accordance with the size of each replay display area so that the replay display area is displayed. It is possible to produce a replay screen in which the sizes of a plurality of extracted images to be generated are different from each other.

Further, in the present embodiment, the image extracted from the display image is stored in the extracted image storage section 540. However, for the extracted image, for example, the degree of blurring, noise, lightness, etc., or the α value. The image may be stored in the extracted image storage unit 540 after being processed by various filters such as the changing process of the above, the deformation process such as the rotation and the distortion, and the like. Furthermore, at this time, the filter parameter set in the filter may be changed and stored for each extracted image. According to this, for example, a replay screen as if the extracted image is faded in or faded out can be produced. Further, the display order of the extracted images and the like may be determined according to this filter parameter.

In the above embodiment, the case where the present invention is applied to the tennis game has been described as an example, but the present invention is applicable to various sports games such as baseball games and golf games, fighting games, or simulations. It is also applicable to various other games such as games.

[0103]

According to the present invention, the size of the extracted image extracted from the display image is determined according to the aspect ratio of the display area in which the extracted image is displayed on the replay screen, and the extracted image extracted is displayed in the size of the display area. Save it by scaling it to fit. According to this, when displaying the extracted image, it is only necessary to read out the saved extracted image,
No special treatment required. For example, by designating a character or the like to be replayed as a subject, it is possible to reproduce the motion of the character only by displaying the stored extracted image or controlling the display.

At this time, by storing a plurality of images of the subject area of the image once displayed on the display screen as the game image, various images such as replay and reverse display can be used by using the plurality of images. Can be produced. Further, when displaying, it is possible to perform an effect such that the image data is sequentially displayed frame by frame based on a preset time difference, or the display screen is divided to display a plurality of image data on one screen.

[Brief description of drawings]

FIG. 1 is a diagram showing an example of a play screen in the present embodiment.

FIG. 2 is a diagram showing an example of a replay screen according to the present embodiment.

FIG. 3 is a diagram showing an example of a replay screen according to the present embodiment.

FIG. 4 is a diagram showing an example of functional blocks of a game device according to the present embodiment.

FIG. 5 is a diagram illustrating a process of generating a display image.

FIG. 6 is a flowchart showing an example of an operation of a processing unit in this embodiment.

7A is a diagram showing an example of a virtual three-dimensional space, and FIG. 7B is a diagram showing an example of a rectangular parallelepiped object set as a subject.

FIG. 8A is a diagram showing an example of a subject converted into a screen coordinate system, and FIG. 8B is a diagram showing an example of a display area of an extracted image.

9A is a diagram showing an example of a display image stored in a frame buffer, and FIG. 9B is a diagram showing an example of an extracted image stored in an extracted image storage unit.

FIG. 10 is a diagram for explaining bilinear filtering.

FIG. 11 is a diagram illustrating a process of storing an extracted image in an extracted image storage unit.

FIG. 12 is a flowchart showing an example of image extraction processing in the present embodiment.

FIG. 13 is a diagram showing an example of a hardware configuration according to the present embodiment.

FIG. 14 is a diagram showing a case where the present game device is applied to an arcade game machine.

FIG. 15 is a diagram showing a case where the present game device is applied to a home-use game machine.

FIG. 16 is a diagram showing a case where the present game device is applied to a terminal connected to a host device via a communication line.

FIG. 17 is a diagram for explaining an example of an effect method for a replay screen.

FIG. 18 is a diagram for explaining an example of an effect method for a replay screen.

FIG. 19 is a diagram for explaining an example of a rendering method of a replay screen.

[Explanation of symbols]

1 game device 100 operation part 200 Processing unit 220 Game operation unit 222 Image extraction unit 224 Display control unit 240 Image generator 300 display 400 storage 420 game programs 422 image extraction program 424 Display control program 500 temporary storage 520 frame buffer 540 Extracted image storage unit

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G06T 3/40 G06T 3/40 AF term (reference) 2C001 AA03 AA04 AA05 CB00 CB04 CB05 CB06 CC08 5B050 AA10 BA08 BA09 BA10 BA18 CA07 EA05 EA06 EA12 EA27 FA02 GA08 5B057 AA20 CA13 CB13 CC01 CD05 CD20 CH01 CH09 CH11 DA16

Claims (12)

[Claims] 1. Game information for causing a device having a processor to function as a generator for generating an image of a virtual space based on a given viewpoint by arithmetic operation / control by the processor, said generating means. A first storage unit that stores the image generated by the above as a frame image; an extraction unit that determines an extraction region from the frame image and extracts the image of the extraction region; and an extraction that is extracted by the extraction unit. Second to store images
And game information including information for causing the device to function: a reproducing unit that generates a reproduced image of the game including the extracted image stored in the second storing unit. 2. The information according to claim 1, wherein the setting means for setting a subject is caused to function in the apparatus, and the position of the subject in the frame image, which corresponds to the position of the subject in the virtual space, Game information including information for causing the device to function as a calculation unit that calculates by coordinate conversion based on a viewpoint, and information for causing the extraction unit to determine an extraction region based on a calculation result by the calculation unit. 3. The game information according to claim 2, wherein the extraction means includes information for determining an extraction area according to the size of the subject in the frame image. 4. The information according to claim 2, wherein the size setting means for setting the size of the extracted image stored in the second storage means causes the apparatus to function, and the extraction means sets the size setting. Game information including information for determining the aspect ratio of the extraction region based on the aspect ratio of the size of the extracted image set by the means. 5. The size setting means according to claim 4, wherein the vertical size of the extracted image is set to be an integer fraction of the vertical size of the frame image, and / or the horizontal size of the extracted image is set to the frame. Game information including information for setting the horizontal size of the image to be an integer fraction. 6. The information according to any one of claims 1 to 5, for causing the apparatus to function as a scaling unit that scales the extracted image extracted by the extracting unit to a given size, and the second information. Game information including: information for causing the storage unit to function to store the extracted image scaled by the scaling unit. 7. The information according to claim 1, wherein the extraction timing setting means for setting the extraction timing makes the apparatus function, and the extraction means is set by the extraction timing setting means. Game information including information for extracting the extracted image from the frame image corresponding to the time. 8. The information according to claim 1, wherein the second storage unit cumulatively stores the extracted images extracted by the extraction unit, and the reproduction unit includes the second information. Game information including: information for generating a reproduced image in which a plurality of extracted images stored in the storage unit are arranged. 9. The game information according to claim 8, wherein the reproduction unit includes information for selecting an extracted image to be included in the reproduced image from the plurality of extracted images stored in the second storage unit. 10. The information storage device according to claim 1, wherein when the second storage unit stores the extracted image, the second storage unit includes information for storing the extracted image by applying a given filter. Game information featuring. 11. An information storage medium for storing the game information according to claim 1. 12. A game device comprising a generation means for generating an image of a virtual space based on a given viewpoint, the first storage means for storing the image generated by the generation means as a frame image, Extraction means for determining an extraction area from the frame image and extracting the image of the extraction area; and second storing the extracted image extracted by the extraction means
And a reproduction unit that generates a reproduction image of the game including the extracted image stored in the second storage unit.