JPH0772875A - Image and sound processor - Google Patents

Abstract

PURPOSE:To sound the sound effect of a stereo where a sound source position is corresponding to a character display position on a picture and to increase the linkage between the character and the sound. CONSTITUTION:By an image processing part M1, an image where the character is moved for a background is displayed. By a sound processing part M2, the sound effect being the sound according to the movement of the character is outputted. By a position recognition means M3, the display position on the picture of the character becoming the object of the sound effect is recognized. By a correction means M4, corresponding to the display position obtained by the position recognition means M3, the volume of the sound effect of a right side or left side close to the display position is corrected larger than the volume of the sound effect of a distant side. The sound corrected by the correction means 4 are outputted from the right side and the left side of the stereo respectively.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image and sound processing apparatus, and more particularly to an image and sound processing apparatus for outputting an image and a sound suitable for the image.

[0002]

2. Description of the Related Art Conventionally, in an image and sound processing apparatus used as a game machine, a background image for displaying a background and a foreground image for displaying a character moving against the background are superposed and combined to form a composite image. And background music (BGM) that matches the game
Is pronounced in stereo.

[0003]

In the conventional device, BGM is used.
Is played back in stereo, but the sound
The effects are not pronounced in stereo.

Therefore, there is a problem in that the sound effect is pronounced equally on the left and right regardless of where the character is displayed on the screen, the sound effect is not linked to the movement of the character, and the effect is small. It was

The present invention has been made in view of the above points,
It is an object of the present invention to provide an image and sound processing device capable of producing a stereo sound effect in which a sound source position corresponds to a character display position on a screen, and in which the linkage between the character and the sound is increased.

[0006]

FIG. 1 shows the principle of the present invention.

In the figure, the image processing unit M1 displays an image in which the character moves against the background. The voice processing unit M2
A sound effect that is a voice corresponding to the movement of the character is output.

The position recognizing means M3 recognizes the display position on the screen of the character which is the object of the sound effect.

The correcting means M4 sets the volume of the sound effect on the right side or the left side close to the display position to be higher than the volume of the sound effect on the far side, corresponding to the display position obtained by the position recognizing means M3. to correct. The sound corrected by the correction means 4 is output from each of the right and left sides of the stereo.

[0010]

In the present invention, since the sound volume of the sound effect on the right side and the left side is corrected corresponding to the display position of the character, the sound source position of the sound effect can be made to substantially coincide with the character display position.

[0011]

FIG. 2 shows a block diagram of an embodiment of the device of the present invention. In the drawing, a bus 11 executes a game program and controls the entire apparatus by a CPU 11, a ROM 12 storing a game program, image data, and audio data, and R.
An AM 14, a joystick 15 as an input device, a sound generator 16 for generating an audio signal, a bus controller 17, a sprite engine 20 for performing foreground image processing, and a scroll engine 21 for performing background image processing are connected. In addition, the sprite engine 20
A RAM 22 for storing foreground patterns and window patterns of characters and a frame buffer 23 for developing foreground patterns are connected to the scroll engine 2
1 is a video RAM (VRA) for storing background patterns.
M) 24 and color RAM 25 are connected.

The CPU 11 executes the game program,
A sound generation request based on voice data as a sound generation request is supplied to the sound generator 16 for sound generation, and RA
Image data is written in M22 and VRAM24, and a command is issued to the sprite engine 20 and the scroll engine 21 to draw a composite image. The bus controller 17 controls the right to use the bus 10 by the CPU 11, the sprite engine 20, and the scroll engine 21.

The sprite engine 20 selects and reads image data of a foreground pattern such as a character from the RAM 22, performs processing such as rotation, enlargement, reduction, and color calculation, and then writes it to a predetermined address of the frame buffer 23 to write it in the foreground. Expand the pattern.

The image data processed by the sprite engine 20 represents one pixel in 16 bits, for example. The lower 11 bits D0 to D10 are a color code. Of these, for example, the lower 8 bits D0 to D7 are used for the color RAM 2
5 represents the address. In this case, upper bit D8
~ D10 is unused. Next 4 bits D11 to D14
Is a priority code, and pixels with high priority are displayed with priority over pixels with low priority. Most significant bit D
No. 15 is unused.

The sprite engine 20 resets all the pixel data of the entire surface of the frame buffer 23 to 0, and then R
The character read from the AM 22 is expanded in the frame buffer 23.

The foreground image FG of the frame buffer 23 described above.
The image data for one frame is sequentially read by the sprite engine 20 in synchronism with the horizontal and vertical sync signals of the scroll engine, and is directly supplied to the scroll engine 21 without the bus 14.

The VRAM 24 stores a plurality of pattern data which are image data of cells of 8 × 8 pixels in the vertical and horizontal directions, and when the above cells are spread by 28 × 40 cells in the vertical and horizontal directions to form a background image for one frame, The pattern name data (address of the pattern data) for instructing which cell to use in correspondence with the pawl position of is stored for, for example, 2 frames.

The scroll engine 21 is the VRAM.
The pattern name data for each of the two frames is read out from 24, the pattern data is read out from the VRAM 24 by the pattern name data for each of the two frames, and the pixels of the pattern data are output to output the background images BG0, BG1 for the two frames. Get the image data of. By the way, the image data of each of the background images BG0 and BG1 has the same configuration as the image data of the foreground image.

Further, the scroll engine 21 determines whether the color code in the image data of each of the foreground image FG and the background images BG0 and BG1 is 00H, and the color code is 0H.
The priority codes of image data other than 0H are compared, and the image data having the maximum priority code value is selected. When the color code is 00H, it is regarded as transparent. After that, the color RAM 25 is accessed with the color code of the selected image data, RGB data representing the levels of each of the three primary colors RGB are obtained in the color RAM 25 using the color code as an address, and this RGB data is output from the terminal 56. The RGB data is analogized by the D / A converter 31, output from the terminal 32 as an RGB video signal, and displayed on a monitor (not shown).

By the way, the sound data as the sound generation request supplied from the CPU 11 to the sound generator 16 has pitch, length, strength, sounding position, tone color, channel, priority and attribute of 32 bits in total. It represents. The sounding position is represented by 2 bits. When the first bit is 1, the right sounding of the stereo sound is expressed, and when the second bit is 1, the left sounding of the stereo sound is expressed. When both 2 bits are 1, the left and right are sounded simultaneously. The timbre represents, for example, a piano sound or a violin sound. The channel indicates which of the six channels, for example. The priority is used to determine which sounding request to select when sounding requests for the same channel are made at the same time. The attribute is BG
Indicate M or sound effect.

It should be noted that the sound generator 16 produces sounds of 6 channels at the same time, and normally the 1st to 6th channels are used for BGM in the game program.
The effect uses channels 4 and 5 of these.

FIG. 3 shows a flowchart of the tone generation request process executed by the CPU 11. This process is an interrupt process at every predetermined time. In the figure, in step S10, the voice data having the highest priority is selected from the voice data requested to be sounded. Next, it is determined whether the attribute of the audio data selected in step S12 is BGM or sound effect,
If it is a sound effect, it is determined in step S14 whether or not a plurality of characters are displayed on the screen. When there are a plurality of characters, the character selected by inputting the joystick 15 is used as the sound source in step S16. When the character is single, that is, the character is used as the sound source. In step S18, the display position coordinates of the character of the sound source on the screen are obtained from the sprite engine 20, and the sound generation requests of the fourth and fifth channels corresponding to this display position are generated.

For example, as shown in FIG. 4, when the display position of the character is the left end region when the screen is divided into five equal parts in the horizontal direction, the sounding position of the fourth channel is the left side and the sounding position of the fifth channel is the left side. A tone generation request is generated, and if it is an area, a tone generation request is generated in which the tone generation position of channel 4 is on the left side and the tone generation position of channel 5 is left and right simultaneously.

If the display position of the character is the central region, the sound generation positions of the fourth channel are set to the left and right simultaneously and the fifth position.
A sound generation request is generated in which the sound generation positions of the channels are simultaneously set to the left and right.
A sound generation request is generated in which the sound generation positions of the fifth channel are simultaneously generated on the left and right, and if the display position of the character is the right end region, a sound generation request in which the sound generation position of the fourth channel is right and the sound generation position of the fifth channel is right is performed. To generate.

As a result, the volume on the left side becomes the ratio shown by the alternate long and short dash line in FIG. 4 according to the display position of the character,
The volume on the right is the ratio shown by the chain double-dashed line.

If the attribute is BGM in step S12, the process proceeds to step S20, and the first to
Generate a pronunciation request for the sixth channel. After that, the sound generator 1 sends the pronunciation request generated in step S22.
6 and the process is completed. The pronunciation request is a format in which a channel is designated instead of the priority and attribute of the voice data. In response to this sounding request, the sound generator 16 generates stereo right and left audio signals in which the sounds of the first to sixth channels are mixed, and the terminal 18
It is supplied to the right speaker and the left speaker from a and 18b.

As a result, as shown in FIG. 5 (A), three characters 50a, 50b, 50c are displayed as enemies on the screen, and the joystick 15 is used to display the character 5 on the right side.
When attacking by selecting 0c, the attack sound is loudly emitted from the right speaker to the left speaker, the sound source position and the character display position match, and an effective sound
The effect is obtained. In addition, as shown in FIG.
When the character 51 closes the door of the left house, the door sound is loudly emitted from the left speaker, and the sound source position and the character display position coincide with each other, and an effective sound effect is obtained.

Further, as shown in FIG. 5C, when the moving object character 52 moves from the left side to the right side of the screen,
The moving sound moves from the left side to the right side in accordance with the movement of the character 52, and a sound effect associated with the movement of the character 52 can be obtained.

It should be noted that the sound effect is fixed to the right-hand pronunciation on the fourth channel and left-hand pronunciation on the fifth channel,
According to the display position of the character, the same effect can be obtained even if the sound of the fourth channel is attenuated at the attenuation rates shown by the alternate long and two short dashes line in FIG. In this case, the respective attenuation rates can be changed from stepwise to linear, and the invention is not limited to the above embodiment.

Further, the speakers provided on the upper and lower sides of the display screen corresponding to the vertical display position of the character screen are used to correct the volume in the same manner as the left and right stereo speakers, or the pitch is increased on the upper side. It is possible to increase the audio signal frequency (increase the audio signal frequency), decrease the sound pitch on the lower side (decrease the frequency), and increase the linkage between the image and the audio as in the horizontal direction.

[0031]

As described above, according to the image and sound processing apparatus of the present invention, it is possible to generate a stereo sound effect in which the sound source position corresponds to the character display position on the screen, and the character and the voice are greatly linked. It is extremely useful in practice.

[Brief description of drawings]

FIG. 1 is a principle diagram of the present invention.

FIG. 2 is a block diagram of the device of the present invention.

FIG. 3 is a flowchart of pronunciation request processing.

FIG. 4 is a diagram for explaining the present invention.

FIG. 5 is a diagram for explaining the present invention.

[Explanation of symbols]

 M1 image processing unit M2 voice processing unit M3 position recognition means M4 correction means 11 CPU 16 sound generator 20 sprite engine 21 scroll engine

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Office reference number FI Technical display location G06T 13/00 H04S 7/00 F 8421-5H

Claims (1)

[Claims] 1. An image and sound processing apparatus for displaying an image in which a character moves against a background and outputting a sound effect which is a sound corresponding to the movement of the character, in a sound effect target character. The position recognition means for recognizing the display position on the screen and the sound effect on the far side for the volume of the sound effect on the right side or the left side close to the display position corresponding to the display position obtained by the position recognition means. An image and audio processing device, characterized in that the correction means corrects the volume to be higher than that of the stereo, and the sound corrected by the correction means is output from each of the right side and the left side of the stereo.