JP2001148035A - Image processing - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the plotting processing, to make the representation of an image multicolored and also to smoothly represent the movement of a character. SOLUTION: An image processing means 2 composites background image data 3d composed of a movie image and character data 4d composed of a stereoscopic image by polygon data and gives the composited data to a display 6. An image 60 obtained by compositing a background image 3 and a character 4 is shown on the display 6. A simple model 5d composed of three-dimensional data for judging a priority in hidden surface elimination with the data 4d is set in a part of the data 3d. The means 2 judges a part where the character 4 is hidden by the background 3 on the basis of the simple model and performs image elimination. According to the elimination, it is possible to represent an image in a three-dimensional manner. It is further possible to generate a display an image obtained by combining music reproduction and object movement with a smaller amount of operation without depending on complicated control.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, an image processing method, and a recording medium suitable for an amusement center or a game machine that can be used at home.

[0002]

2. Description of the Related Art With the recent advance in computer technology,
Video game devices using computer graphics technology have been widely used. This video game device has been widely accepted by users, and a large number of various game devices have been devised, and various game software have been supplied.

A game device having such an image processing function generally includes a game device main body having an operation device, a sound generating means such as a speaker, and a display for providing an image. In this game device, the background screen displayed on the display is changed with the development of the game, and the character can be moved within the background screen in accordance with a player's instruction. The player operates the operation device such as the joypad while watching the change in the background screen accompanying the game progress displayed on the display, and can enjoy the game by moving the character in the background screen.

There are various methods for generating a game screen of such a game device. As one of them, if all screens displayed on the display are created with polygon data,
Three-dimensional, that is, three-dimensional expression becomes possible. At this time, since the image data in the game space is three-dimensional data, an image viewed from any angle can be obtained by changing the angle of the virtual camera (camera viewpoint) in the game space, and the representation of the screen is represented. The degree of freedom is very high.

As a method for generating a game screen, a method using a movie screen based on computer graphics is also known. Here, a movie screen based on computer graphics is image data composed of a series of two-dimensional pictures determined to move from a certain position to another position, and a camera angle for viewing the screen is determined. Image data. When this movie screen is used, there is an advantage that a fine and fine screen can be provided, and the burden of image processing on the game device is small.

[0006] Under such circumstances, game apparatuses equipped with still another image processing function have already been used.
It is an object (character) displayed on the screen
This is a music game device that lets you dance to music. In the case of this game device, it is strongly desired that the tempo of the music matches the motion of the object. Conventionally, a computer system controls music reproduction and motion control on a real-time basis in order to make a character move in accordance with the music.

[0007]

As described above, in the conventional game device, when all the images including the background and the character are represented by polygon data, the screen is coarsely represented unless a large amount of polygon data is provided. , And the connected portion between the polygon data is expressed, resulting in a screen that is square overall. Further, when an image of a background, a character, or the like is configured with a large amount of polygon data, the screen becomes fine and various expressions can be performed to some extent, but a great load is imposed on image processing.

In the case of a game screen generation method using a movie screen based on computer graphics, since the display screen is two-dimensional data, it has a two-dimensional representation and cannot be three-dimensionally represented. Further, since the camera angle is fixed in the movie screen, the degree of freedom in screen expression is extremely low.

On the other hand, in the case of the image processing for playing the music game described above, since the reproduction of the music and the movement of the object are controlled on the basis of real time, the amount of calculation increases and the control is complicated.

[0010] The present invention provides an image processing apparatus, an image processing method, and a recording medium having an image processing function for solving the problems of the conventional game apparatus.

More specifically, the present invention realizes image processing capable of diversifying the expression of a game screen, more smoothly expressing the operation of a display body moving on the game screen, and remarkably reducing the amount of drawing processing. The first purpose is to do so.

Also, the present invention displays an image in which music playback and object movement are combined (linked) with a small amount of calculation, without depending on complicated control, and with flexibility. A second object is to realize image processing that can be performed.

[0013]

In order to achieve the first object, the image processing apparatus according to the present invention comprises, as one mode, a first display body composed of a movie image and a three-dimensional object composed of polygon data. An image processing apparatus configured to display a second display body including an image on a display unit, wherein a priority of a part of the first display body in erasing a hidden surface with the second display body is determined. Image processing means for setting a simple model composed of three-dimensional data for performing image processing.

Preferably, the first display forms a background of a game screen, and the second display forms a character displayed on the background. In addition, only the portion of the first display body for which the priority of the polygon data needs to be determined may be configured from the simple model.

For example, the simple model is preferably three-dimensional data composed of roughly set polygon data.

In another aspect of the image processing apparatus according to the present invention, a first display body composed of an image and a second display body composed of a three-dimensional image based on polygon data are displayed on display means. An image processing apparatus, wherein a virtual camera for the second display is set, and when the second display moves on the first display, the camera angle is set to a camera angle with respect to the first display. The movement of the virtual camera is controlled so that the positions of the virtual cameras substantially coincide with each other, and when the second display moves in the opposite direction to the first display, the first display is changed to the reverse motion. It is characterized by having image processing means for reproducing and making the position of the virtual camera substantially coincide with the camera angle with respect to the first display body in reverse motion.

[0017] Preferably, the image processing means is configured to divide an area of the first display body to be moved by the second display body into a plurality of sections from one section to another section. Means for making the position of the virtual camera substantially coincide with the angle of the camera for each section when the second display body moves.

On the other hand, in order to achieve the first object, according to one aspect of the image processing method according to the present invention, a first display body composed of a movie image and a second display body composed of a three-dimensional image composed of polygon data are provided. An image processing method for displaying a display body of the first display body on a display means, wherein a simple model including three-dimensional data is set in a part of the first display body, and the second display body is displayed using the simple model. It is characterized in that the priority in hidden surface removal is determined.

According to another aspect of the image processing method according to the present invention, an image for displaying on a display means a first display composed of an image and a second display composed of a three-dimensional image based on polygon data. A processing method, wherein a virtual camera for the second display is set, and when the second display moves on the first display, the virtual camera is set at a camera angle with respect to the first display. The movement of the virtual camera is controlled so that the positions of the cameras substantially coincide with each other.
When the display body moves in the reverse direction of the first display body, the first display body is reproduced in the reverse motion, and the position of the virtual camera is set to the camera angle with respect to the first display body in the reverse motion. It is characterized in that they almost match.

[0020] Further, a recording medium in which a program for functioning as the image processing means or the image processing method according to any one of the above-described configurations is provided.

As described above, by using the movie screen as a part of the screen such as the background displayed on the display means.
It is possible to increase the degree of freedom of expression by diversifying the expression method of the screen, and at the same time, significantly reduce the drawing process and smoothly express the moving state of the display body consisting of characters and the like on this movie screen. it can.

Furthermore, in order to achieve the above-mentioned second object, the image processing apparatus according to the present invention displays an image of a motion of an object existing in a virtual space on a screen of a display unit in accordance with sound data. It is characterized by doing so. Preferably, there is provided display control means for displaying the motion of the object linked to the beat of the sound data.

[0023] Further, while a reproducing means for reproducing a sound based on the sound data is provided, the display control means includes a first obtaining means for obtaining reproduction information of the sound data by the reproducing means, A calculating means for calculating a play position of the game by referring to the obtained reproduction information of the sound data; and a second means for obtaining the data of the virtual camera and the motion of the object based on the calculation result of the calculating means and the motion progress data. And generating means for generating image data for displaying the motion of the object on a monitor screen based on the result obtained by the second obtaining means.

[0024] Preferably, the first obtaining means includes a sound data reproduction sample number (n) by the reproduction means.
count) and a sampling frequency (freq), and the calculating means calculates the reproduction sample number (ncount) and the sampling frequency (fr).
eq) to calculate the current number of frames (frame) and the number of beats (beat).

At this time, for example, the calculating means calculates the current number of frames (frame) and the number of beats (beat) as follows: frame = ncount * FPS / freq beat = frame / fpb (where FPS is the number of frames per second) , Fpb is the number of frames per beat).

Further, the motion progress data may be data for allocating a motion in a time series according to the number of beats of the sound data.

Preferably, the data of the virtual camera is viewpoint information of the virtual camera in the virtual space, and the generating means converts a movie image having viewpoint information matching the viewpoint information of the virtual camera into a background image. Means for generating image data of the object.

Further, the generation means may be one of a first generation mode for automatically setting the motion of the object and a second generation mode for reflecting operation information from a player on the motion of the object. The image data may be generated based on a mode.

Further, the display control means includes means for forming a background image corresponding to the object separately from the image of the object, and a camera viewpoint and a light source for the object image and the background image. Means may be provided for synthesizing the image of the object and the background image in a state where at least one of the arrangement conditions is set to be substantially the same. For example, the background image is a movie image.

Further, it is preferable that the sound data is provided as ADX compressed ADX data.

Further, there is provided a storage medium in which a program for causing a computer to execute each of the above means of the image processing apparatus which achieves the second object is recorded.

Thus, it is possible to provide a so-called music game in which the motion of the object on the screen is excited in accordance with the music. This game requires less computation, does not rely on complicated controls,
Easy to process with good flexibility.

The above-mentioned recording medium includes, for example, a floppy disk, a hard disk, a magnetic tape, and a CD.
-ROM, CD-R, DVD, ROM cartridge, RAM memory cartridge with battery backup,
A flash memory, a nonvolatile RAM card, and the like can be given. The recording medium also includes a communication medium such as a priority communication medium such as a telephone line and a wireless communication medium such as a microwave line. The Internet is also included in the communication medium mentioned here. In short, if the program is downloaded to the computer by any means and has a predetermined function, the program is included in the recording medium according to the present invention.

[0034]

Embodiments of the present invention will be described below with reference to the accompanying drawings.

(First Embodiment) A first embodiment will be described with reference to FIGS.

[Outline] FIG. 1 is an explanatory diagram for explaining the outline of the first embodiment.

In FIG. 1, reference numeral 1 denotes a game device such as a TV game device that implements the image processing device of the present invention. The game device 1 can execute game software. When the TV game device 1 executes the game software, the image processing means 2 is realized in the TV game device 1.

As shown in FIG. 1, the image processing means 2 includes data 3d of a background image (first display body) composed of a movie image based on computer graphics.
And data 4d of a game character (second display body) composed of a three-dimensional image based on polygon data, image processing is performed, and a part of the background or the like to be displayed is erased with the character data 4d. Simple models 5ad and 5bd composed of three-dimensional data for determining the priority are set. As shown in FIG. 1, the simplified model 5ad is indicated by a dotted line along the contour of the desk data 3ad. Similarly, the simplified model 5bd is indicated by a dotted line along the contour of the wall surface 3bd, as shown in FIG. The dotted lines indicating the simplified models 5ad and 5bd are displayed inside the outline without stopping for the convenience of drawing creation, but the solid line and the dotted line are actually at the same position.

This image processing means 2 determines the priority of the character data 4d and the simple model 5ad,
The priority between the character data 4d and the simple model 5bd is determined. In this case, since the character data 4d is behind the simple model 5ad, the image processing means executes a process of erasing hidden portions of the character data 4d hidden by the simple model 5ad by giving priority to the simple model 5ad. I do. Further, since the character data 4d is located in front of the simple model 5bd, the image processing means 2 outputs the character data 4d.
The process of deleting the hidden surface of the portion corresponding to the rear side of the character data 4d is executed with priority given to the character data 4d.

The image processing means 2 executes the above-described image processing, and executes the character data 4d and the background screen data 3d.
Are combined, and the combined data is converted into a video signal and provided to the display 6. Thereby, the display 6
As shown in FIG. 1, an image 60 in a state where the character 4 stands up behind the desk 3a and in front of the wall surface 3b is displayed. Hereinafter, a specific description of this game device will be given.

[Configuration of Game Apparatus] FIG. 2 is a block diagram showing an outline of the game apparatus. This game device 1
Is composed of a CPU block 10 for controlling the entire apparatus, a video block 11 for controlling display of a game screen, a sound block 12 for generating sound effects and the like, a subsystem 13 for reading out the CD-ROM 9, and the like.

The CPU block 10 has an SCU (System C
ontrol Unit) 100, main CPU 101, RAM1
02, ROM 103, sub CPU 104, CPU bus 1
05 and the like.

The main CPU 101 controls the entire apparatus. The main CPU 101 has a D
It has the same calculation function as an SP (Digital Signal Processor) and can execute application software at high speed. The RAM 102 is used as a work area of the main CPU 101. In the ROM 103, an initial program for initialization processing and the like are written. The SCU 100 controls the buses 105, 106, and 107 so that the main CPU 101, the VDP 12
0, 130, the DSP 140, the CPU 141, and the like. Also, SCU
A VRAM 100 in the video block 11 includes a DMA controller therein and stores sprite data during a game.
Can be forwarded to This makes it possible to execute application software such as a game at high speed.

The sub CPU 104 is an SMPC (System M
This is called an anager & peripheral control, and has a function of collecting peripheral data from a PAD 7b as an operation device (peripheral) via a cable 7c and a connector 7a in response to a request from the main CPU 101. The main CPU 101 is the sub CPU 10
Based on the peripheral data received from 4, processing such as moving a character in the game screen is performed. It should be noted that an arbitrary peripheral such as a PAD, a joystick, and a keyboard can be connected to the connector 7a. The sub CPU 104 includes the connector 7a
It has a function of automatically recognizing the type of peripheral connected to the (main body side terminal) and collecting peripheral data and the like according to a communication method according to the type of peripheral.

The video block 11 is a VDP for drawing a character or the like composed of polygon data of a video game.
(Video Display Processor) 120, and a VDP 130 that performs drawing of a background screen, synthesis of polygon image data and a background image, clipping processing, and the like.

The VDP 120 is connected to the VRAM 121 and the frame buffers 122 and 123. The rendering data of the polygon representing the character of the video game machine is transmitted from the main CPU 101 to the VDP 12 via the SCU 100.
0 and written to the VRAM 121. VRAM
The drawing data written in 121 is drawn in the drawing frame buffer 122 or 123 in the format of 16 or 8 bits / pixel, for example. The drawn data of the frame buffer 122 or 123 is sent to the VDP 130. Information for controlling the drawing includes the main CPU 101.
Through the SCU 100 to the VDP 120.
Then, the VDP 120 executes the drawing process according to the instruction.

The VDP 130 is connected to the VRAM 131, and the image data output from the VDP 130 is stored in the memory 1
It is configured to be output to the encoder 160 via the P. 32. The encoder 160 generates a video signal by adding a synchronization signal or the like to the image data, and outputs the video signal to the TV receiver 6. Thereby, a game screen is displayed on the TV receiver 6.

The sound block 12 includes a DSP 140 that performs voice synthesis according to the PCM system or the FM system, and a CPU 141 that controls the DSP 140 and the like. The audio data generated by the DSP 140 is converted to a two-channel signal by the D / A converter 170 and then output to the speakers 6a and 6b.

The subsystem 13 includes a CD-ROM 8
It has a function of reading application software supplied in the form described above, playing a moving image, and the like.

[Operation of Game Apparatus] Next, the operation of the above-described game apparatus will be described with reference to FIG. 1 and with reference to FIGS. First, the operation flow of the entire apparatus will be described with reference to FIG.

In this game apparatus 1, a main CPU
101 enters the entire flowchart of FIG. 3 at regular intervals, and when the data processing cycle is not reached (S11; N
O), exit this process. In the data processing cycle (S11; YES), the processing shifts to the following processing.

First, the main CPU 101 executes a game process (S12). That is, in step 12, the main CPU 101 determines, for example, the game software, the data stored in association with the development of the game, and the PAD 7b
The game is developed based on peripheral data etc.

Next, the main CPU 101 implements the image processing means 2. The image processing means 2 captures background screen data composed of a movie screen by computer graphics based on the data associated with the game development obtained in the previous step, and captures character data to be arranged in the background. Are subjected to image processing (S13).

In the first embodiment, a simple model (mask model) composed of polygons along the contours of various parts and the like in the background screen is preset in the background screen data composed of the movie screen. ing. The image processing means 2 determines the priority of the simple model constituted by the polygon and the character data similarly constituted by the polygon. When it is determined that the priority of the simple model is higher than that of the character data, the image processing unit 2 places the model on the character data for a portion where the simple model overlaps the character data, and Process so that background screen data is displayed in the model part.

On the other hand, if the image processing means 2 determines that the priority of the character data is higher than that of the simple model, the image processing means 2 performs processing such that the character data is prioritized in a portion where the simple model overlaps the character.

Then, in accordance with such a condition, the video signal created in the video block 11 constituting a part of the image processing means 2 is supplied to the display 6 (S14). As a result, the display 6 displays an image in which characters composed of polygons are arranged in a fine and beautiful background screen based on the movie screen. This is displayed as if the character is moving in a three-dimensionally represented background screen. [Example of Image and Image Data] First, an example of a screen displayed on the display (see FIG. 5) will be described.

Thereafter, the structure of the image data will be described in the following order. That is, an example in which all image data is composed of polygon data (see FIG. 6) will be described first. Next, for example, background image data of the image data will be formed by movie screen data by computer graphics, and Example of setting a simple model with polygon data at a position where hidden surface should be removed in a part of FIG.
Reference) will be described. Further, an example of image data (see FIG. 8) in which the priority between the simple model and a character constituted by polygon data can be determined will be described.

A. Example of Image Displayed on Display FIG. 5 is an explanatory diagram of a screen displayed on the display.
As shown in FIG. 5, it is assumed that the display 6 displays, for example, the content shown on the screen 60a. On this screen 60a, the first enemy 3
0a is arranged, and a desk 30b, a character 40, and a grid-like partition 30c are sequentially arranged on the back side. Behind this partition 30c, a second enemy 30d,
30d, chairs 30e, 30e,... In addition, the counter 30 behind the chairs 30e, 30e, ...
f, the third enemy 30g inside this counter 30f
Are arranged in that order. Note that a chandelier 30h is arranged on the desk 30b.

B. Example in which all of image data is composed of polygon data FIG. 6 is an explanatory diagram in the case where the screen 60a shown in FIG. 5 is entirely composed of polygons. In FIG. 6, when the entire screen 60a described above is created by polygon data, it is necessary to create image data 60d1 as follows. That is, in the screen data 60d1, the first enemy data 30ad composed of polygon data
To be placed. Next, desk data 30bd and chandelier data 30hd composed of polygon data are arranged at positions behind the first enemy data 30ad.

The character data 40d composed of polygon data is arranged behind the desk data 30bd. Hereinafter, behind the character data 40d, grid-like partition data 30cd, second enemy data 30dd, 30dd, and chair data 30ed, 3
0ed, ... and chair data 30ed, 30
After the ed,..., the counter data 30fd, and the third enemy data 30 inside the counter data 30fd.
gd, 30gd,... must be arranged in this order. In this case, in order to express the displayed image 60 finely, it is necessary to increase the number of polygon data. In this case, the processing load on the main CPU 101 and the video block 11 of the game device 1 increases, and there is a possibility that other processing cannot be performed.

C. Example in which part of image data (background) is composed of simple polygon data. FIG. 7 shows that the part composed of polygon data is limited to only a part of the background, and the other background part is composed of a movie screen by computer graphics. It is an explanatory view of a case.

As can be seen from FIG. 7, in the first embodiment, a part of the background screen data 30 composed of a movie screen is determined by a small polygon data in a portion for determining the priority with respect to the character data 40d. The simple models 50bd, 50cd, and 50fd constituted by are arranged. The movie screen includes (a): a call address corresponding to a code address, (b): frame image data, (c): object (simple model) data in a frame, and (d): course data of a movie (movement of a camera). Information).

Here, the simple model 50bd is arranged at, for example, an outline of a desk portion of a background screen composed of a movie screen. Further, the simple model 50cd is arranged, for example, at an outline of a lattice portion of a background constituted by a movie screen. Further, the simple model 50fd is arranged, for example, at the outline of the counter portion of the background constituted by the movie screen. As can be understood from this figure, each simple model 50bd, 50cd, 50fd is provided as data 60d2 composed of a small number of polygon data.

D. Example of image data in which a part of image data (background) is composed of simple polygon data, and characters and the like are arranged in this part. FIG. It is explanatory drawing which shows a relationship. In the first embodiment, as shown in FIG. 8, the character data 40d is composed of a large number of polygon data. In addition, the first to third enemy data 30ad,
30bd and 30cd are also composed of a large number of polygon data.

The first enemy data 30ad includes the character 4 before the simplified model 50bd placed on the desk.
0d is behind the simple model 50bd placed on the desk,
In addition, before the simplified model 50ed placed on the grid, the second enemy 30bd is the simplified model 5d placed on the grid.
After 0ed, before the simplified model 50fd arranged on the counter, the third enemy 30gd is arranged after the simplified model 50fd arranged on the counter, respectively.

E. Data Configuration Example FIG. 9 is an explanatory diagram showing a data configuration example of the movie screen according to the first embodiment.

The movie image by computer graphics has movie data D1, D2,..., Dn. The movie data D1, D2,..., Dn
Are frame image data FD1a, FD1b,.
D1m. Also, the movie data D1, D
2,..., Dn, camera movement data CD1, C
D2,..., CDn and simple model data 6 in the frame
, 6dn,..., 6dn.

In the image processing, the frame image data FD1a, FD1b,..., FD1m is used as a reference frame, for example, between the frame image data FD1a and the frame image data FD1b and between the frame image data FD1b and the frame image data FD1c. , Between the frame image data FD1c and the frame image data FD1d,.
You can also create a continuous video.

[Specific Operation of Image Processing] Next, the image processing performed in step S13 of FIG. 3 will be described. FIG. 4 is a flowchart for explaining a specific operation of the image processing.

In FIG. 4, the image processing means 2 reads scene data obtained by executing the game software (S131). Next, the image processing means 2 reads, for example, frame data FD1a of the scene corresponding to the movie data D1 shown in FIG. 9 based on the scene data obtained in the previous step (S132). The movie screen includes (a): a call address corresponding to a code address, (b): frame image data, (c): object (simple model) data in a frame, and (d): course data of a movie (camera data). Movement information).

Then, the image processing means 2 outputs simple model data of the scene (for example, a mask model as shown in FIG. 7).
Is read (S133). The simple model (mask model) in this case is a colorless object.

Next, the image processing means 2 places the simple model in a virtual space as shown in FIG. 8, for example (S1).
34). Then, based on the image data as shown in FIG. 8, the image processing means 2 makes a collision determination between the game character data and the simple model by using the Z sort method or the Z buffer method (S135).

Based on the result of such determination, the image processing means 2 corrects and displays the game character (S1).
36). Thereafter, the image processing means 2 performs a viewpoint conversion process based on the data regarding the movie screen (S137), and outputs the processing result data to the frame buffers 122 and 123 (S138).

As a result of such image processing, a screen 60 a as shown in FIG. 5 is displayed on the display 6.

According to such an embodiment, the use of a movie screen by computer graphics enables display of a fine-grained and beautiful screen, and also has the advantage of reducing the burden of image processing on the game device. .

Further, according to this embodiment, a simple model composed of a small amount of polygon data is arranged to mask a part of the background, and a collision between the background and the game character is determined. Three-dimensional display can be performed. That is, according to the first embodiment, by using a movie screen as a part of the screen, the expression of the screen is diversified, the drawing process is remarkably reduced, and the moving image is displayed on the movie screen. Body movement can be expressed more smoothly.

(Second Embodiment) A second embodiment of the present invention will be described with reference to FIGS.

FIG. 10 is a diagram for explaining an outline of image processing according to the second embodiment of the present invention.

In FIG. 10, the image processing means 2 is realized in the game device 1 such as the TV game device as described above.

As shown in FIG. 10, the image processing means 2 is a game composed of background image (first display body) data 3d composed of a movie image by computer graphics and a stereoscopic image composed of polygon data. Image processing is performed on the character (second display body) data 4 d and the result is given to the display 6. The display 6 displays an image 60 in a state where the character 4 is standing after the desk 3a and in front of the wall surface 3b, as shown in FIG.

The image processing means 2 converts the background image data 3
The virtual camera 15 is set so that the position of the virtual camera 15 substantially matches the angle of the camera 16 with respect to the background image data 3d when the game character data 4d moves on the background image data 3d.
When the game character data 4d moves the background image data 3d in the reverse direction, the background image data 3d is reproduced in the reverse motion, and the camera 16 for the reverse motion background image data 3d is controlled. Is controlled so that the position of the virtual camera 15 substantially matches the angle.

At this time, the image processing means 2 divides the area of the background screen data 3d where the game character data 4d should move into a plurality of sections, and when the character data 4d moves from one section to another section. Virtual camera 1
5 is controlled so as to virtually match the angle of the camera 16 with respect to the initial position of another section while virtually capturing an image accompanying the movement.

Also in the second embodiment, a game device having the same hardware configuration as the game device 1 used in the first embodiment is used. Therefore, the same or similar components are denoted by the same reference numerals, and description thereof will be omitted or simplified.

In the game device 1 of the present embodiment, C
Various image processes are executed with the PU block 10 as the center as described below. This image processing is performed as shown in FIGS.
This will be described with reference to the drawings.

FIG. 11 is a diagram for explaining an operation example of the second embodiment. FIG. 12 is a flowchart for explaining the operation. FIG. 13 is a subroutine of FIG. FIG. 14 is a diagram showing a display example of the operation.

In FIG. 11, regions sp.A and sp.
B, sp.C, sp.D, sp.E,...
AB, sp.BC, sp.BD, sp.DE, ...
The range in which the character can move. A circled,
.., B, C, D, E,... Are camera positions.

The moving image data cam.AB is the camera position A.
4 shows a camera work and a movie when moving from a camera position to a camera position B. The moving image data cam.BA is the camera position B.
2 shows a camera work and a movie when moving from the camera position to the camera position A. In this embodiment, the image data of the camerawork moving from the camera position A to the camera position B and the image data of the camerawork moving from the camera position B to the camera position A are made independent. Hereinafter, the same applies.

Similarly, moving image data cam.BC shows a turtle work and a movie when moving from camera position B to camera position C. The moving image data cam.CB indicates a turtle work and a movie when moving from the camera position C to the camera position B.

Similarly, moving image data cam.BD indicates a turtle work and a movie when moving from camera position B to camera position D. The moving image data cam.DB indicates a turtle work and a movie when moving from the camera position D to the camera position B.

Similarly, the moving image data cam.DE indicates a turtle work and a movie when moving from the camera position D to the camera position E. The moving image data cam.ED indicates a turtle work and a movie when moving from the camera position E to the camera position D.

Assuming that the character 4 starts moving from the area sp.A, the image processing means 2 determines that the character 4 is within the area sp.A and the overlapping area sp. In A, processing is performed to display a frame (background image (image data cam.A)) captured by the camera 15A.

When the character 4 moves from the overlapping area sp. AB to the area sp. B, the camera work and the movie (moving image data cam. AB) are reproduced and stopped at the last frame.

From the area sp.B, as can be seen from FIG. 11, it can be moved in three directions. Of course, the number of branches is not limited to this, and any number of branches may be used.

When the character 4 moves from the overlapping area sp.AB to the area SP.A and remains in the overlapping area sp.AB, the last frame of the moving image data cam.AB is left as it is. When the character 4 moves to the area sp.A, the moving image data cam.BA starts to be reproduced, the camera 15 is moved to the camera position A, and the screen cam.A (the final moving image data cam.BA) ends. Frame) is displayed.

When the operation proceeds from the area sp.B to the area sp.C, the reproduction is started when the area sp.BC is shifted to the area sp.C, and the reproduction is started at the area sp.C and the overlapping area sp.B. -C
The last frame is displayed while the character 4 is present.

Further, when proceeding from the area sp.B to the area sp.D, reproduction is started at the time when the area sp.BD is shifted to the area sp.D, and the area sp.D and the overlapping area sp.D are reproduced. −
As long as the character 4 is in E, the last frame is displayed.

Note that the width of the neutral zone such as the overlapping area sp. AB can be set arbitrarily, and of course, the width may be zero.

In FIG. 14, it is assumed that the image processing means 2 generates a certain background image data 3d by connecting a path 30j of a predetermined length formed by computer graphics and a staircase 30k continuously. It is assumed that the image data 3d is created as background image data viewed from the directions of the arrows X and Y, respectively. The background image data 3d is created when viewed from the arrow X and arrow Y directions. That is, the camera 16 that captured the data of the background screen
And the angle of the virtual camera 15 for photographing the character 4 are substantially matched.

Here, "to make the angles of the cameras 15 and 16 substantially coincide with each other" means that there is no unnatural appearance in the screen. Camera 16 for this movie
And the range of the angle of the virtual camera 15 are appropriately determined.

The state in which the character data 4d moves under such background image data 3d is indicated by the virtual camera 15
It is assumed that you are shooting with. First, it is assumed that the virtual camera 15A captures the background image data 3d and the character data 4d from point A surrounded by a circle. With the movement of the character data 4d, an image 60 is displayed on the display 6.
Images moving in b, 60c and 60d are displayed.

Then, the overlapping area sp.
When moving to p.B, camera 15A at camera position A
To the camera 15B at the camera position B. The camera work and the movie of the camera 15 when moving from the camera position A to the camera position B can be output.
The processing when the character moves in this manner is described in FIG.
This will be described below with reference to FIGS. .

When the character is moving in the area sp. A in FIG. 11, the operations of steps S21 to S24 in FIG. 12 are repeated by the image processing means. The processing in steps S21 to S24 is processing corresponding to the operation described in the first embodiment.

In this moving state, the image processing means 2
The camera position A shown in FIG.
Image data 3j (cam.
A).

The outline of the operation realized by the processing of steps S21 to S24 is the same as in the first embodiment.
It looks like this:

First, the frame data FD of the corresponding scene
1a is read, the simple model data 5d of the scene is read, and the simple model data 5d is arranged in the virtual space. Then, the game character data 4
The collision determination between d and the simple model 5d is performed, and it is determined whether or not it is necessary to hide the character in the movie image, and a process is performed on the determination result (S21: FIG. 13).

That is, as shown in the subroutine of FIG. 13, the frame data FD1a and the simple model data 5d of the corresponding scene are read and the simple model data 5d
Is placed in the virtual space (step S201), collision determination is performed between the game character data 4d and the simple model data 5d, and it is determined whether it is necessary to hide a character in the movie image (S202). .

First, when there is no need to hide (S20)
2; NO), this process is passed without doing anything. Also,
When it is necessary to hide (S202; YES), the simple model data 5d is arranged according to the camera angle of the camera 15A (S203). A movie screen is displayed in a portion where the simple model data 5d and the character data 4d overlap.

Next, the image processing means 2 determines that the player
The character data is moved in the movie screen data based on the peripheral data obtained by operating 7b (S22).

When this step S21 is completed, again
The aforementioned subroutine (steps S201 to S2 in FIG. 13)
03) is executed (S22).

Then, the image processing means 2 determines whether it is necessary to change the position of the camera 15 in the background screen data composed of the movie screen data (S24). When the character data 4d is inside the area sp.A and the overlapping area sp.AB, it is determined that the position of the camera 15 does not need to be changed (S24; NO), and the process is repeated again from step S22. Move.

When the character moves from the overlapping area sp. AB to the area sp. B (see FIG. 11), the image processing means 2 determines that the position of the camera 15 needs to be changed (S24). ; YES), as shown in FIGS. 11 and 14, the camera 15A that matches the camera position A is moved to the camera position B to be a camera 15B (S25). The moving image data cam.AB is reproduced in accordance with the movement of the camera (S25). Also at this time, the character data 4d
Image processing between the image and the background image data 3d (FIG. 1)
Steps S201 and S202 of the third subroutine are processed (S26). Then, the image processing means 2 displays the frame from the camera position A to the camera position B captured by the camera 15A and the movie in synchronization with the frame,
The last frame is displayed and the process ends (S27).

Thus, a video signal in which the character data 4d is arranged on the background image data 3d of the stairs 3k composed of the movie screen is given to the display 6, and is given to the display 6 in FIG. It is displayed as such an image.

According to the second embodiment, a link to the movement of a character composed of polygons is provided.
Since the background represented by the movie moves, not only can the screen be displayed in an extremely beautiful state, but also an image can be expressed with a high degree of freedom.

It is preferable to provide a medium on which a program for causing a computer to execute the operations in the above embodiments is recorded. This medium includes, for example, floppy disk, hard disk, magnetic tape, CD-RO
M, CD-R, DVD, ROM cartridge, RAM memory cartridge with battery backup, flash memory, nonvolatile RAM card, and the like.

The medium includes a communication medium such as a priority communication medium such as a telephone line and a wireless communication medium such as a microwave line. The Internet is also included in this communication medium. In short, as long as it has a predetermined function by downloading the program to the computer by some means,
Included in this medium.

(Third Embodiment) A third embodiment of the present invention will be described with reference to FIGS.

The game device according to the third embodiment is
In a so-called music game, a character as an object displayed on the screen performs a game of dancing to music. In this dance, the device automatically moves the character (hereinafter referred to as "auto motion"), and the player operates the operation unit in response to a command corresponding to a line played during music. (Hereinafter referred to as “manual motion”).

For example, while dance music is played as BGM, the character performs predetermined basic movements such as walking, bouncing, and waving his knees in an automatic motion. In parallel with this, if a command such as “up, up, right” is issued in the music, the player operates the direction keys of the operation unit to match the command, and responds to the command. Attempt to play the manual motion that was performed. At this time, the player can give an appropriate movement to the character by pressing, for example, the up key of the direction key twice and the right key of the operation unit once in a short period. If the manner of this operation is inappropriate, the movement of the character will not be appropriate. Also, during the dance, an instruction such as attacking an enemy character with a gun and defeating it, for example, a "shoot" is also included in the music. In this case, the player needs to perform a predetermined button operation. These operations constitute a game element, and the accuracy and speed of the operation are determined as a game result.

In both the automatic motion data and the manual motion data, the start timing of the motion and the time for reproducing the motion are programmed in advance according to the sequence of the audio data. As described later, the sequence corresponds to the characteristic of the beat of the audio data and includes the number of beats reproduced in one minute. The outline of this control is how to reproduce a specific motion corresponding to specific motion data from a beat to a beat.

The above-mentioned command also exists at a specific beat of the music data, and when the command is started, the initial motion is started for the character. For example, when there is an appropriate key operation during several frames, an appropriate motion is played based on the corresponding motion data, but when there is no appropriate key operation, based on the motion data corresponding to the key operation, Improper motion is played. These manual motions are controlled by the sequence of audio data as described above. Specific contents of the sequence control will be described later.

Hereinafter, control of automatic motion in the music game will be described. By adjusting the automatic motion to the music (synchronizing or linking), it is possible to easily cope with various types of motion having a short and long time in a simple manner, with a small amount of calculation. The same is true for manual motion. Such a game device is configured as follows. FIG. 15 shows an overview of a game device according to the present invention, and FIG. 16 shows an electrical hardware block diagram thereof. In addition to the synchronization between the reproduction of the sound and the movement of the character, the reproduction of the movie video as the background video can be caused to operate with the movement of the character. Thereby, the reproduction of the movie video is synchronized with the reproduction of the movement of the character and the sound.

As shown in FIG. 15, the present game device is constituted by mutually connecting a game device main body 201, a controller 202 and a backup memory 203 as a subunit.

The game apparatus main body 201 is a control apparatus main body for controlling the progress of a game. The game apparatus main body 201 is configured such that a plurality of controllers 202 can be connected via a connector C. The game apparatus main body 201 includes a CD-ROM drive 211 so that a recording medium such as a CD-ROM can be detachably mounted.

The controller 202 has a structure as an operation section operated by each player, and is provided with an operation button group 22.
1 and a cross key 222 and the like, and can be connected to the game apparatus main body 201 by a connection cord 204 having a connector P. The controller 202 includes the backup memory 2
03 is provided detachably.

The game device main body 201 has a configuration similar to a computer device, and as shown in FIG. 16, a CPU block 230, a video block 231 and a sound block 2 as shown in FIG.
32 and a communication device 233.

The CPU block 230 includes a bus arbiter 3
00, CPU 301, main memory 302, ROM 30
3 and a CD-ROM drive 211. The bus arbiter 300 is configured to control transmission and reception of data by allocating a bus occupation time to devices connected to each other via a bus. The CPU 301
The backup memory 203 can be accessed via the main memory 302, the ROM 303, the CD-ROM drive 211, the video block 231 and the sound block 232, and the controller 202.

The CPU 301 performs various processes and controls necessary for performing the game, and can transfer image data to the graphic memory 311 and voice data to the sound memory 321. ROM303
Is a storage area of the initial program loader. R
The OM 303 is an element constituting the recording medium of the present invention, and a program necessary for the processing of the CPU 301 is recorded in advance. The recording medium is a CD-R.
OM or the like may be used.

Although the CD-ROM drive 211 uses a CD-ROM as a recording medium for data supplied from the outside, the CD-ROM drive 211 is not limited to this and may be configured to be able to read various other recording media. Alternatively, the program may be transferred to the memory via the communication device 233. With this setting, data can be transferred from a fixed disk of a remote server.

The video block 231 is composed of VDP (Vid
eo Display Processor) 310,
Graphic memory 311 and video encoder 31
2 is provided.

With these configurations, the video block 31
Is configured to be able to generate 3D image data and a movie image. The video encoder 312 includes the VDP 310
Converts the image data generated by the main monitor into a predetermined television signal of the NTSC system or the like, and connects the main monitor 23 to the outside.
5 (such as a cathode ray tube of a television receiver).

The sound block 232 includes a sound processor 320, a sound memory 321 and a D / A converter 322. With these configurations, the sound block 232 is configured to perform voice synthesis based on the waveform data and output an acoustic signal. The D / A converter 322 is configured to convert audio data generated by the sound processor 320 into an analog signal and output the analog signal to a speaker 234 (a speaker of a television receiver or a speaker of an audio device) connected to the outside. .

The communication device 233 is, for example, a modem or a terminal adapter, is configured to be connectable to the game device 201, and can function as an adapter for connecting the game device main body 201 to an external line. The communication device 233 can receive data transmitted from a game supply server such as an Internet server connected to a public line network, and supply the data to the CPU block 230 bus. The public line network may be a subscriber line, a dedicated line, or a wired / wireless network.

Next, a data group handled by the game device will be described. This data group includes ADX data, game progress data, camera data, motion data group, motion progress data, movie data, character data calculated according to operation information, and the like.

Among them, the ADX data is given here as ADX-compressed audio data. As audio data (sound data), MIDI (Musical Instrume)
nt Digital Interface) data, PCM, CDDA,
ADPCM (Adaptive Differential Pulse Code Modu)
lation). The ADX data is used as master data for time management, but the time management master is not limited to the ADX data as described above. When the ADX data is not used, the movie data may be the master data,
It may be an I sequence.

The ADX library used here is a library for reproducing the above-described ADX-compressed audio data. ADX-compressed audio can be easily reproduced by using the functions of this library. The number of currently reproduced samples can be obtained by the reproduction position function. The current frame number can be obtained from this sample number. The data of the current frame is acquired from the camera data on the main memory, and a virtual camera is set. Similarly, game data of the current frame is acquired, and data processing is executed to perform game processing.

The game progress data includes the number of beats of one music (n
beat) and the number of frames / beats (fpb). Therefore, fpb × nbeat = total number of frames. One beat is set to a length of 15 frames as standard, but is an amount that changes according to the BPM (beats / minute) of the music. The processing timing of each motion data is set corresponding to one or more of the number of beats. For this reason, if the BPM value is high, a fast-tempo movement can be expressed even with the same motion, and conversely, if the BPM value is low, the same motion can be expressed late. As camera data, viewpoint data (position, direction, and rotation angle) of virtual cameras for the total number of frames are prepared in advance.

The motion data group includes a plurality of motion data relating to the motion of the character. The plurality of motions are divided into conditions such as motion 1, motion 2, motion 3,..., Motion (m-1), and each motion is assigned to each motion such as, for example, moving right foot one step, left foot one step, and jumping up. . Each motion is actually represented by a plurality of image frames composed of the number of frames corresponding to one beat or n beats (n is an integer).

Further, as shown in FIG. 17, the motion progress data is a sequence of beats (time series) indicating sequence information indicating which motion should be reproduced at which beats.

As for the above-described camera data and movie data, data corresponding to one-to-one is created between the same frames. Movie data and ADX data are CD
-Stored in ROM, camera data, motion data group, motion progress data, etc. are called from ROM and placed on main memory.

Next, the processing of FIG. 18 executed by the CPU 301 will be described.

The CPU 301 determines in step S101 whether or not a predetermined data processing cycle has been reached, and when the determination is YES, the processing enters the processing in step S102 and subsequent steps.

That is, the CPU 301 reads the player's operation information output from the controller 2 as the operation section (step S102).

Next, the CPU 301 instructs reproduction of the audio data which is ADX data (step S103).
This command calls the ADX playback library,
ADX data is transferred from the D-ROM to the main memory 302, where it is decoded into audio data. The decoded audio data is transferred to the sound memory 321.
The sound is processed by the sound processor 320 and reproduced from the speaker 234 as sound.

Next, the CPU 301 obtains the ADX data reproduction information (step S104). The information to be obtained is the number of playback samples of the ADX data (ncount).
And the sampling frequency (freq), which are obtained from the ADX playback library.

Next, “number of frames / beat” (= fpb) is read from the game progress data, and the current number of frames (frame) and the number of beats (be) are set as the game playback position.
at) is calculated (step S105). The current number of frames (that is, the frame position) is calculated based on the equation of frame = ncount × FPS / freq, and the current number of beats is calculated based on the equation of beat = frame / fpb. However, FPS is a fixed value (frame / sec) in the application.

Next, the position, direction and rotation angle of the virtual camera (virtual viewpoint) in the three-dimensional virtual space corresponding to the number of frames calculated in this manner are read out from the camera data stored in advance (step S106). ).

Further, the CPU 301 executes step S
The data of the motion corresponding to the number of beats calculated in 104 is determined with reference to the motion progress data stored in advance, and the data of the determined motion is read from the motion data group (step S107).
It should be noted that the motion data is set in consideration of the motion when the player instructs the manual motion.

Next, a game process is performed (step S1).
08). The game process includes a projection conversion process of projecting a character composed of polygon data from a camera (virtual viewpoint) in a three-dimensional virtual space onto a two-dimensional display image, and a movie image matching the position, direction, and rotation angle of the virtual camera. (2
(A two-dimensional background image) selection processing, and the player's operation status, that is, determination of a game score according to the operation status in response to a manual motion command included in the voice, and the like. Note that the projection conversion processing is performed in accordance with the position and direction of the light source at the time of projection conversion according to those at the time of movie image creation. The image data of the character and the movie image created in this way are sent to the video block 31, and the image of the character is superimposed on the movie image and displayed, for example, as shown in FIGS. 19 and 20 (step S109).

As described in the above embodiment, the movie image is a two-dimensional image by computer graphics, and changes depending on the position, angle, and rotation angle of a camera (viewpoint) for observing the image. Since it is natural to see, it is created in advance according to various values of the position, angle, and rotation angle.

As described above, by selecting a movie image that matches the position of the virtual camera and has an angle at which the background does not look unnatural, a natural and realistic image can be displayed.

That is, when the above-described automatic motion is reproduced on the game screen, the positions of the virtual camera and the virtual light source with respect to the character composed of 3D data are adjusted according to the positions of the camera and the light source when the movie is created. It is programmed to be set. At the time of this automatic motion reproduction, the operation of the player on the operation unit is ignored, so that the positions of the camera viewpoint and the light source when the movie is created and the positions of the virtual camera viewpoint and the virtual light source with respect to the character need only be matched. It is.

In the case of manual motion, since the position of the virtual camera with respect to the 3D character needs to be diversified,
A large number of movie images are prepared in advance from cameras (viewpoints) corresponding to each position of the virtual camera that can be arranged in the three-dimensional virtual space. Then, a movie image corresponding to the position of the virtual camera designated (operated) for the 3D character is selected, and this is drawn as a background image.

For example, suppose that the player switches from a state in which the player has previously commanded a viewpoint for viewing the character from the front to a camera viewpoint for viewing the profile of the character. That is, if the virtual camera is switched from a state in which the virtual camera is in front of the character to a state in which the virtual camera is on the side, the movie image (background image) displayed on the monitor 235 is changed simultaneously with the image of the character. That is,
As described above, the movie image can be changed according to the camera position (camera viewpoint), and the image has a realistic feeling. At the time of reproduction by manual motion, since the position of the virtual camera needs to be changed according to the key operation method, movie images from different viewpoints corresponding to different virtual camera positions are prepared in advance.

Further, in the above-described projection conversion process at the time of reproducing the manual motion, the position and the direction of the light source used in the three-dimensional virtual space are made to match or substantially match those used when the movie image was created in advance. That is. As a result, the shadow of the projected image looks natural on the monitor screen.

By using a movie image as a background, compared with a case where the entire screen is displayed by polygons,
The amount of calculation can be greatly reduced while maintaining the image quality.

FIG. 19 shows one scene of an image in which the character CH dances on the floor on music (BGM) decoded from ADX data. The character CH is composed of polygon data, and a movie image BK serving as a background
Is displayed with the back. The character CH performs an automatic motion, such as walking or bouncing, necessary for the dance in accordance with the music. On the way, since the music includes instructions such as “up” and “down”, the player may operate the controller 202 in accordance with the instructions. When the controller 202 can be operated on the rhythm in a timely manner, the character CH can perform a balanced dance.

During the game, the enemy character AM is displayed as shown in FIG.
M also dances for a predetermined time. Then, when a predetermined command, for example, the word “shoot” is heard from the music, the player may press a predetermined button of the controller 202. Thereby, the character CH attacks the enemy character AM with the gun.

[0158] Such a controller operation state of the player, that is, the timing and accuracy are reflected in the game result, and the user can enjoy the music game.

At this time, the motions of the characters CH and AM are displayed linked to the music. Since this display is performed using the game progress data and the motion progress data in advance, the processing is simpler and the amount of calculation is smaller than in the case where the link of the motion to the music is controlled in real time. In particular, since the motion is assigned to the length of music, that is, the number of beats covering the entire game time, according to the motion progress data, there is an advantage that the time management master has a high degree of freedom in time progress. That is, there is an advantage that the game speed can be variously changed and flexibility is improved. Even when the frame speed (frame / second) is different (for example, PAL) such as slow motion or fast turning, there is an advantage that the program can be easily dealt with with little change in the program.

Further, in the present embodiment, even when the camera viewpoint is changed, the display is performed in a state where the direction of the viewpoint and the direction of the background almost coincide with each other. However, it is possible to provide a natural image with no sense of incongruity in directionality. In addition, since the light source position of the character represented by the polygon at the time of projection conversion almost coincides with the light source position of the movie image, it is possible to provide a natural image with no discomfort regarding the shadow.

In FIG. 20, "Gu-turn" at the lower left of the drawing is a symbol of the character, and the display of this symbol means that the character side, that is, the player side, is urged to perform an operation. I have. By switching this symbol from the above-mentioned symbol of the enemy character AM to the symbol of this character CH, the player recognizes that it is the order that requires his / her own input. In the case of an enemy character, image processing such as attacking the player from the enemy character is executed by computer processing.

The present invention is not limited to the configuration described in the above embodiment, and those skilled in the art can implement the present invention in a more appropriate manner without departing from the scope of the claims.

[0163]

As described above, according to one aspect of the present invention, a first display body composed of a movie image by computer graphics and a second display body composed of a three-dimensional image by polygon data are provided. And a simple model consisting of three-dimensional data for determining the priority in erasing the hidden surface with the second display body is set in a part of the first display body. Drawing processing can be remarkably reduced, and the movement of the display moving on the movie screen can be more smoothly expressed.

According to another aspect of the present invention, the background represented by a movie moves in a form linked to the movement of a character composed of polygons, so that a very beautiful screen can be represented. In addition, image expression with a high degree of freedom becomes possible.

Further, according to another aspect of the present invention, by providing game progress data and motion progress data in a part of the data group necessary for the game, complicated control is performed with a smaller amount of calculation. It is possible to display an image in which the reproduction of music and the movement of an object are combined (linked) without any change, and the game speed can be changed to various values without changing the program. High image processing can be provided.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram for describing an outline of a first embodiment according to the present invention.

FIG. 2 is a block diagram illustrating an outline of a game device to which the image processing device according to the first embodiment is applied.

FIG. 3 is a flowchart for explaining the overall operation of the first embodiment.

FIG. 4 is a flowchart illustrating a specific operation of image processing according to the first embodiment.

FIG. 5 is an explanatory diagram of a screen displayed on a display according to the first embodiment.

FIG. 6 is an explanatory diagram in the case where all screens are created by polygons.

FIG. 7 is an explanatory diagram of a case where only a part of the background is configured by polygon data and a background is configured by a movie screen by computer graphics according to the first embodiment;

FIG. 8 is an explanatory diagram showing the relationship between a simple model in which only a part of the background of the first embodiment is composed of a small amount of polygon data, a character, and the like.

FIG. 9 is an explanatory diagram illustrating an example of data of a movie screen according to the first embodiment.

FIG. 10 is a diagram for explaining an outline of a second embodiment according to the present invention.

FIG. 11 is a diagram for describing an operation example of the second embodiment.

FIG. 12 is a flowchart for explaining the operation of the second embodiment.

FIG. 13 is a diagram of a subroutine adopted in FIG.

FIG. 14 is a diagram illustrating a display example of an operation according to the second embodiment.

FIG. 15 is an outline view of a game device according to a third embodiment of the present invention.

FIG. 16 is a block diagram illustrating an electrical configuration of the game device.

FIG. 17 is a diagram illustrating motion progress data.

FIG. 18 is a flowchart illustrating an outline of a process related to a game executed by a CPU in a third embodiment.

FIG. 19 is a diagram illustrating an example of an image to be displayed.

FIG. 20 is a diagram illustrating another example of a displayed image.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 TV game apparatus 2 Image processing means 3d Background image data 4d Character data 5d Simple model data 6 TV receiver 7a Connector 7b Game operation pad 7c Cable 7a, 7b cable 10 CPU block 11 Video block 12 Sound block 13 Subsystem 100 SCU (System Control Unit) 101 Main CPU 102 RAM 103 ROM 104 Sub CPU 105 CPU bus 106, 107 Bus 120, 130 VDP 121 VRAM 122, 123 Frame buffer 131 VRAM 132 Memory 140 DSP 141 CPU 160 Encoder 1 Game device main unit 201 Controller 211 CD-ROM driver 230 CPU block 231 Video block 232 Sound block 234 Speaker 235 Monitor 301 CPU 302 Main memory 303 ROM (recording medium) 310 VDM 311 Graphic memory 320 Sound processor 321 Sound memory 312 Video encoder 322 D / A converter

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Takashi Yuda, Inventor 1-2-1-12, Haneda, Ota-ku, Tokyo (72) Inventor Jin Nakanishi Jin 1-2-12, Haneda, Ota-ku, Tokyo No. F-term in SEGA Enterprises (reference) 2C001 AA17 BA00 BA01 BA05 BA07 BC00 BC10 CB01 CB06 CC02 CC08 5B050 AA10 BA08 BA09 EA19 EA24 EA27 EA28 EA29 FA02 5B080 AA13 FA08 GA01

Claims (21)

[Claims] 1. An image processing apparatus comprising: a first display body including a movie image; and a second display body including a three-dimensional image based on polygon data. And an image processing means for performing image processing by setting a simple model consisting of three-dimensional data for determining a priority in erasing a hidden surface with the second display body. 2. The image processing device according to claim 1, wherein the first display forms a background of a game screen, and the second display forms a character displayed on the background. 3. The image processing apparatus according to claim 1, wherein only a portion of the first display body for which the priority of the polygon data needs to be determined is configured from the simplified model. 4. The image processing apparatus according to claim 1, wherein the simple model is three-dimensional data composed of roughly set polygon data. 5. An image processing apparatus for displaying, on a display means, a first display body composed of an image and a second display body composed of a three-dimensional image based on polygon data, the image processing apparatus comprising: A virtual camera is set, and when the second display body moves on the first display body, the position of the virtual camera is substantially matched with the camera angle with respect to the first display body. Controlling the movement, and if the second display moves in the opposite direction to the first display, the first display
Play back the display object of the reverse motion, the first of the reverse motion
An image processing apparatus having image processing means for making the position of the virtual camera substantially coincide with the camera angle with respect to the display body. 6. The image processing means according to claim 1, wherein the area to which the second display body of the first display body is to be moved is divided into a plurality of sections, and from one section to another section. The second
6. The image processing apparatus according to claim 5, wherein the position of the virtual camera substantially coincides with the angle of the camera for each section when the display body moves. 7. A first display body comprising a movie image,
An image processing method for displaying, on a display means, a second display body composed of a stereoscopic image based on polygon data, wherein a simple model composed of three-dimensional data is set in a part of the first display body. An image processing method for determining a priority in erasing a hidden surface of the second display body using the image processing method. 8. An image processing method for displaying, on a display means, a first display body composed of an image and a second display body composed of a three-dimensional image based on polygon data, wherein a virtual camera for the second display body is provided. Is set, and the second display is
When moving on the display body, the movement of the virtual camera is controlled so that the position and angle of the virtual camera substantially match the camera position and angle with respect to the first display body. If the body moves the first display in reverse, the first display is played in reverse motion, and the position of the virtual camera substantially matches the camera angle of the reverse motion with respect to the first display. An image processing method comprising: 9. A recording medium in which a program for causing a computer to function as the image processing means or the image processing method according to claim 1 is described. 10. An image processing apparatus, wherein an image of a motion of an object existing in a virtual space is displayed on a screen of a display unit in accordance with sound data. 11. An image processing apparatus according to claim 10, further comprising display control means for displaying a motion of said object linked to a beat of said sound data. 12. A display device, comprising: a reproducing unit that reproduces a sound based on the sound data, wherein the display control unit acquires a reproduction information of the sound data by the reproducing unit; A calculating means for calculating a play position of the game by referring to the obtained reproduction information of the sound data; and a second means for obtaining the data of the virtual camera and the motion of the object based on the calculation result of the calculating means and the motion progress data. The image processing apparatus according to claim 11, further comprising: an obtaining unit configured to generate image data for displaying a motion of the object on a monitor screen based on a result obtained by the second obtaining unit. 13. The sound data reproduction sample number (ncount) of the sound data by the reproduction means.
And a sampling frequency (freq), and the calculating means calculates the number of reproduced samples (nc)
out) and the sampling frequency (freq) with reference to the current frame number (frame) and beat number (bea).
13. The image processing apparatus according to claim 12, which is means for calculating t). 14. The arithmetic means calculates the current number of frames (frame) and the number of beats (beat) as follows: frame = ncount * FPS / freq beat = frame / fpb (where FPS is the number of frames per second, fpb is 14. The image processing apparatus according to claim 13, wherein the calculation is performed by using a number of frames per beat. 15. The image processing apparatus according to claim 12, wherein the motion progress data is data for assigning a motion in a time series according to the number of beats of the sound data. 16. The data of the virtual camera is viewpoint information of the virtual camera in the virtual space, and the generating unit is configured to generate the object using a movie image having viewpoint information matching the viewpoint information of the virtual camera as a background image. 13. The image processing apparatus according to claim 12, further comprising means for generating image data. 17. The method according to claim 1, wherein the generating unit is configured to set one of a first generation mode for automatically setting a motion of the object and a second generation mode for reflecting operation information from a player on the motion of the object. 13. The image processing apparatus according to claim 12, wherein the image data is generated based on a mode. 18. The image processing apparatus according to claim 18, wherein the display control unit is configured to form a background image applied to the object separately from the image of the object, and a camera viewpoint and a light source for the object image and the background image. 12. The image processing apparatus according to claim 11, further comprising: means for combining an image of the object and a background image with at least one of the arrangement conditions set to be substantially the same. 19. The image processing apparatus according to claim 18, wherein the background image is a movie image. 20. The image processing apparatus according to claim 10, wherein the sound data is an A / D signal.
An image processing device provided as X-compressed ADX data. 21. A storage medium in which a program for causing a computer to execute each unit of the image processing apparatus according to claim 10 is recorded.