JP7277777B2 - Sound reproduction program, sound reproduction device and sound generation method - Google Patents

Description

The present invention relates to an audio reproduction program, an audio reproduction apparatus, and an audio generation method.

In some conventional game devices, a controller operated by a user vibrates according to the amount of damage inflicted on an enemy character (see Patent Document 1, for example).

JP 2019-63547 A

By the way, in the game, sound is played back along with the video. In game development, generally, the setting of the timing for reproducing audio is manually performed by a game developer while viewing an image. Therefore, the number of man-hours required for game development is increased.

SUMMARY OF THE INVENTION An object of the present invention is to provide a speech generation method capable of reducing the man-hours of software development, and a speech reproduction program and speech reproduction device generated by the method.

A first invention causes a computer to function as reproduction means for reproducing sound and vibration control means for controlling a vibration mechanism that generates vibration, and the vibration control means determines a mode of vibration for the vibration mechanism. Vibration information is output, the reproduction means reproduces a sound whose reproduction timing is set based on the vibration information , the computer further functions as determination means for determining the mode of the vibration, and the reproduction means reproduces the sound based on the mode of vibration determined by the determining means, wherein a plurality of the sounds are set for each mode of vibration, and the reproducing means determines by the determining means A sound reproducing program for reproducing any one of a plurality of sounds set to the vibration mode based on the vibration mode that has been set.

In the first invention, the determination means may determine the mode of vibration based on the start time and end time of vibration indicated in the vibration information.

Further, in the above invention, the determination means may determine the mode of vibration based on the amplitude of vibration indicated by the vibration information.

According to a second aspect of the invention, there is provided an audio reproducing apparatus comprising: a storage section storing the audio reproducing program according to any one of the above-described inventions; and a control section for executing the audio reproducing program.

A third aspect of the invention is a method for generating sound using a computer, comprising a sound generation step for generating sound, and vibration information generation for generating vibration information used to control a vibration mechanism that generates vibration. In the vibration information generation step, vibration information is generated in which the timing for generating vibration in the vibration mechanism is set in accordance with the reproduction of the moving image, and in the sound generation step, sound is reproduced based on the vibration information. setting the timing of the vibration, and determining the mode of the vibration, wherein the sound generating step reproduces the sound based on the mode of the vibration determined in the determining step, and reproduces the mode of the vibration. A plurality of the sounds are set for each of the vibrations, and in the sound generation step, based on the vibration mode determined in the determination step, any one of the plurality of sounds set to the vibration mode A method of generating speech characterized by reproducing one .

According to the present invention, it is possible to provide an audio generation method capable of reducing the man-hours of software development, an audio reproduction program generated by the method, and an audio reproduction apparatus.

1 is a block diagram showing the configuration of a game device according to this embodiment; FIG. FIG. 4 is a waveform diagram showing an example of vibration information output from the vibration control means during cutscene reproduction; The figure which shows an example of the correspondence of vibration data and audio|voice material data. 4 is a flowchart showing the operation of the development computer;

A sound reproduction program, a sound reproduction device, and a sound generation method according to embodiments of the present invention will be described below with reference to the drawings. A sound reproduction program and a sound generation method of the present invention are implemented as one function of a game program. A sound reproducing device is implemented as a game device.

The game program described in this embodiment is executed on a game device such as a personal computer, PlayStation (registered trademark), XBox (registered trademark), PlayStation Vita (registered trademark), or the like.

In a game based on this game program, in response to user operations, a player character is made to act in a three-dimensional virtual game space (hereinafter simply referred to as virtual space), and various actions are performed by the player character's companions. do.

In this game, a sound is played when a predetermined trigger condition is met in the course of movement or action of the player character or the like. Predetermined trigger conditions are, for example, the movement of the player character to a predetermined location, the appearance of an enemy character, the discovery of an item after defeating the enemy character, and the like.

Further, in this game, the controller operated by the user vibrates according to the situation of the player character in the virtual space. For example, when the player character receives damage from an enemy character or an earthquake occurs in the virtual space, the controller vibrates.

Also, in this game, when the user satisfies a predetermined condition during game play, a moving image (hereinafter also referred to as a cut scene) is reproduced. For example, when the player character encounters an enemy character or when the player character reaches a predetermined point, a predetermined cutscene is reproduced.

In particular, the game vibrates the controller during cutscenes. For example, when a small earthquake occurs in a cutscene, the controller vibrates slowly, and when a large earthquake occurs, the controller vibrates violently.

<Outline of game system>
This game system includes a server device 2 and a plurality of game devices 5 .

The server device 2 stores game programs and game data, and manages game data (for each account information described below) of the game device 5 .

Game device 5 executes a game based on a user's operation. When executing a game in an online state, game device 5 receives (more specifically, downloads and installs) a game program and game data from server device 2 via communication network 6 .

Specifically, the game device 5 can first log in to the server device 2 before proceeding with the game in the online state. Account information including identification information (user ID) and password for each user is assigned to each user in association with the game device 5 . This account information is transmitted from the game device 5 to the server device 2 at the time of login, and is used for user authentication in the server device 2 .

Mutual communication between server device 2 and game device 5 becomes possible after user authentication. After logging in, when the game device 5 receives data necessary for the progress of the game (data relating to the progress of the game) from the server device 2, while outputting game images and sounds to the display 61 and the speaker 62 based on the user's operation, let the game progress.

On the other hand, in the offline state, the game device 5 outputs game images and sounds to the display 61 and the speaker 62 based on the data regarding the progress of the game already stored in the storage unit 55 and the user's operation. while progressing the game.

The server device 2 also stores vibration information and cut scene data.

The game device 5 receives (more specifically, downloads) vibration information and cutscene data from the server device 2 when executing the game.

The game device 5 vibrates the controller 63 operated by the user according to the received (downloaded) vibration information. The vibration information defines a plurality of vibration patterns (modes of vibration) used to vibrate the controller 63 . The game device 5 vibrates the controller 63 in accordance with the vibration pattern defined in the vibration information in accordance with the progress of the game.

Also, the game device 5 reproduces a cutscene based on the cutscene data when the user satisfies a predetermined condition during game play. At this time, the game device 5 causes the controller 63 to vibrate in time with the reproduction of the cutscene.

<Hardware configuration>
Each hardware configuration of the server device 2 and the game device 5 will be described below.

<Configuration of Server Apparatus 2>
As shown in FIG. 1 , the server device 2 has a network interface 21 , a storage section 22 and a control section 23 . Network interface 21 and storage unit 22 are electrically connected to control unit 23 via bus 29 .

Network interface 21 is communicatively connected to a plurality of game devices 5 via communication network 6 such as the Internet and LAN.

The storage unit 22 is composed of an HDD, SSD, RAM, ROM, and the like. The storage unit 22 stores account information of each user who plays the game, login history, game data, and various programs including part of the game program according to the present embodiment. The storage unit 22 also stores vibration information, cut scene data, and audio material data.

The vibration information is data used to vibrate the controller 63 of the game device 5 . Specifically, the vibration information defines a plurality of vibration patterns (modes of vibration). The vibration patterns include, for example, vibration patterns such as large (strong) short vibrations and small (weak) long vibrations. The vibration information includes vibration time and vibration amplitude for each vibration pattern.

In the vibration information, a vibration start condition is set for each vibration pattern. For example, the vibration information is set so that the controller 63 vibrates greatly (strongly) when the player character receives a large amount of damage from an enemy character.

The cutscene data is data used for reproducing cutscenes, and includes scene video data, scene audio data, and the like. The scene video data and scene audio data are video data and audio data used when playing cut scenes.

The scene vibration data includes information for linking the vibration of the controller 63 with the reproduction of the scene video data. Specifically, the scene vibration data includes vibration data in which a vibration pattern used for vibration of the controller 63 is associated with a vibration start time and a vibration end time.

For example, in the case of performing an effect in which a small earthquake occurs in a cut scene, a small (weak) vibration is set as the vibration pattern in the vibration data. In the vibration data, the occurrence time of the earthquake is set as the start time of the vibration, and the end time of the earthquake is set as the end time of the vibration.

Audio material data is audio data such as sound effects, environmental sounds, and BGM used in cutscenes.

The control unit 23 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the device itself 2 .

<Functional Configuration of Control Unit 23 in Server Device 2>
By executing various programs, the control unit 23 functions as an information processing unit 231, a collation unit 232, and a distribution unit 233, as shown in FIG.

The information processing means 231 transmits and receives various data to and from each game device 5 . The data received by the information processing means 231 include download requests for game programs and game data, account information, and the like. Examples of the data transmitted by the information processing means 231 include information for confirming that the game device 5 has received the game program.

The verification unit 232 uses the account information received from the game device 5 to perform user authentication processing.

After the information processing means 231 receives the game program download request information and the user's account information, the distribution means 233 distributes (transmits) the game program and game data corresponding to the received account information to the game device 5 . Also, the distribution means 233 distributes (transmits) the cut scene data and the vibration information to the game device 5 .

<Configuration of game device 5>
A plurality of game devices 5 all have the same configuration.

A display 61 , a speaker 62 and a controller 63 are externally connected or built into the game device 5 .

The game device 5 also has a network interface 51 , a graphics processing unit 52 , an audio processing unit 53 , an operation unit 54 , a storage unit 55 and a control unit 56 . Network interface 51 , graphics processing unit 52 , audio processing unit 53 , operation unit 54 and storage unit 55 are electrically connected to control unit 56 via bus 59 .

Network interface 51 is communicably connected to communication network 6 in order to transmit and receive various data between game device 5 and server device 2 and between game devices 5 .

The graphics processing unit 52 draws a game image including various objects related to the virtual space in a moving image format according to the game image information output from the control unit 56 . The graphics processing unit 52 is connected to, for example, a liquid crystal display 61, and a game image rendered in a moving image format is displayed on the display 61 as a game screen.

The audio processing unit 53 is connected to the speaker 62 , reproduces and synthesizes the game sound according to the instruction of the control unit 56 , and outputs it from the speaker 62 .

The operation unit 54 is connected to the controller 63 and transmits/receives data regarding operation input to/from the controller 63 . The user inputs operation signals to the game device 5 by pressing various buttons of the controller 63 .

Further, the operation unit 54 causes the controller 63 to vibrate using a vibration mechanism (not shown) provided in the controller 63 . The vibration mechanism of the controller 63 includes, for example, an actuator. The operation unit 54 inputs the vibration signal output from the control unit 56 to the vibration mechanism of the controller 63 . The vibration mechanism of the controller 63 drives the actuator and vibrates the controller 63 according to the input vibration signal.

The storage unit 55 is configured with an HDD, SSD, RAM, ROM, and the like. The storage unit 55 stores game data downloaded from the server device 2, cut scene data, vibration information, various programs including part of the game program, account information of the device 5, and the like.

The control unit 56 is composed of a microcomputer including a CPU and a semiconductor memory, and controls the operation of the device 5 itself.

<Functional Configuration of Control Unit 56 in Game Device 5>
The control unit 56 functions as communication means 561, game progression means 562, cut scene reproduction means 563, and vibration control means 564 by executing various programs.

The communication means 561 has a function of communicating with the server device 2 and the game device 5 via the network interface 51 .

The communication unit 561 transmits account information, a request for downloading a game program or new game data, etc. to the server device 2 in response to various operation signals received by the operation unit 54 from the controller 63 . Also, the communication means 561 receives from the server device 2 the game data, the cutscene data, the vibration information, and the like sent from the server device 2 in response to the download request.

The game progress means 562 reads out data such as objects and textures included in the game data, executes the game program, and generates two-dimensional or three-dimensional game image information according to the user's operation. As the game image information is processed by the graphics processing unit 52 , the processed game image is displayed on the display 61 .

The cutscene reproducing means 563 reproduces a cutscene when the user satisfies a predetermined condition during game play. For example, when the player character encounters an enemy character, the cutscene reproducing means 563 reproduces a cutscene showing that the player character and the enemy character have encountered each other.

Specifically, the cutscene reproducing means 563 reads the cutscene data from the storage unit 55 when the user satisfies a predetermined condition. The cut scene reproducing means 563 outputs a signal indicating the scene video data included in the cut scene data to the graphic processing section 52 and causes the display 61 to display the scene video data. Also, the cut scene reproducing means 563 outputs a signal indicating the scene audio data included in the data to the audio processing section 53, and causes the speaker 62 to reproduce the scene audio data. The reproduction timing of the audio material data is set in the scene audio data based on the vibration information. Therefore, the cut scene reproducing means 563 reproduces the audio material data (sound) based on the vibration information.

The vibration control means 564 vibrates the controller 63 based on the vibration information. Specifically, the vibration control means 564 generates a vibration signal to vibrate the controller 63 when the vibration start condition is satisfied, and outputs the vibration signal to the operation unit 54 . For example, when the player character receives damage from an enemy character, the vibration control means 564 outputs a vibration signal to the operation unit 54 so as to vibrate the controller 63 at the timing when the player character receives the damage.

Further, when a cutscene is being reproduced by the cutscene reproducing means 563, the vibration control means 564 causes the controller 63 to vibrate in accordance with the cutscene being reproduced. Specifically, the vibration control means 564 generates a vibration signal based on the scene vibration data and vibration information included in the cutscene data. The vibration control means 564 outputs the generated vibration signal to the operation section 54 to vibrate the controller 63 .

More specifically, the vibration control means 564 detects vibration data from the scene vibration data. The vibration control means 564 reads the vibration pattern set in the vibration data from the vibration information in the storage section 55 . Then, the vibration control means 564 vibrates the controller 63 according to the read vibration pattern from the vibration start time set in the vibration data to the vibration end time.

<Generation of scene audio data at the game development stage>
In game development, after settings such as video and vibration timing of the controller 63 are set for a cut scene, playback timings for sound effects, environmental sounds, BGM, and the like are set while watching the video. That is, after the scene video data (video), scene vibration data, etc. are generated (set), the playback timing of the audio material data (sound effects, environmental sounds, BGM, etc.) is set, and the scene audio data ( voice) is generated.

In this embodiment, scene audio data is generated based on scene vibration data. For example, scene audio data is generated by a game development computer (hereinafter referred to as a development computer) or the like. The scene audio data generated by the development computer is stored in the storage unit 22 of the server device 2 and distributed (transmitted) to each game device 5 .

Specifically, the development computer detects vibration data included in the scene vibration data. The development computer determines the vibration pattern set in the vibration data. The development computer selects one of the plurality of voice material data set for the determined vibration pattern. The development computer sets the reproduction timing of the audio material data in accordance with the timing at which the controller 63 vibrates due to the vibration data. The development computer generates scene audio data so that the audio material data is reproduced at the set reproduction timing.

FIG. 2 is a waveform diagram showing an example of vibration information output from the vibration control means during reproduction of a cut scene. As shown in FIG. 2, the scene vibration data includes vibration data AC. The development computer detects the vibration data A to C included in the scene vibration data and determines each vibration pattern.

Specifically, the development computer determines the vibration pattern based on the vibration length and vibration amplitude in the vibration data.

The length of vibration in the vibration data is determined based on the time from the start time to the end time. For example, if the length of vibration in the vibration data is longer than a predetermined time, the computer for development determines that the length of vibration is "long", and if the length of vibration in the vibration data is shorter than the predetermined time , the length of the vibration is determined to be "short".

The development computer determines that the strength of the vibration is "strong" if the amplitude of vibration in the vibration data is greater than the threshold, and if the amplitude of vibration in the vibration data is less than the threshold , the strength of the vibration is determined to be "weak".

In FIG. 2, the vibration data A has a vibration length shorter than the predetermined time and a vibration amplitude greater than the threshold, so it is determined to be a "short/strong" vibration pattern. Vibration data B has a length of vibration longer than the predetermined time and an amplitude of vibration smaller than the threshold, so it is determined to be a "long/weak" vibration pattern. Vibration data C is determined to have a “short/weak” vibration pattern because the vibration length is shorter than the predetermined time and the vibration amplitude is smaller than the threshold value.

FIG. 3 is a diagram showing an example of correspondence between vibration patterns and audio material data. As shown in Fig. 3, vibration patterns are classified into four types according to the combination of vibration length ("long" or "short") and vibration strength ("strong" or "weak"). . A plurality of audio material data are set for each type of vibration data.

After determining the vibration pattern, the development computer selects one of the plurality of audio material data set to the determined type. For example, the computer for development selects one voice material data from among "a_short_srong_0.wav", "a_short_srong_1.wav", . For example, the development computer may randomly select one sound material data from a plurality of sound material data set for the vibration pattern.

The development computer sets the reproduction timing of the audio material data in accordance with the timing at which the controller 63 vibrates due to the vibration data. For example, when "a_short_srong_0.wav" is selected as the audio material data of vibration data A, the development computer sets the playback timing of "a_short_srong_0.wav" from the start time (Start) of vibration data A to the end of vibration. Set until the time (End).

The development computer generates scene audio data so that the audio material data is reproduced at the set reproduction timing.

<Operation of development computer>
1 to 4, a series of flow of generation of scene audio data in the development computer will be described. FIG. 4 is a flow chart showing the operation of the development computer.

Before step S1, scene video data, scene audio data, scene vibration data, and audio material data are stored in the storage unit of the development computer. Further, it is assumed that the reproduction timing of the audio material data (audio data such as sound effects, environmental sounds, and BGM reproduced in the cutscene) is not set for the scene audio data.

The development computer acquires scene vibration data from its own storage unit (step S1). The development computer detects vibration data included in the scene vibration data (step S2). For example, the development computer detects one vibration data included in the scene vibration data.

The development computer determines the vibration pattern set in the detected vibration data (step S3). Specifically, the development computer determines the vibration pattern of the vibration data based on the length of the vibration ("long" or "short") and the strength of the vibration ("strong" or "weak") in the vibration data. do. For example, in vibration data A, since the length of vibration (the time from the start time of vibration to the end time of vibration) is shorter than a predetermined time and the amplitude of vibration is greater than the threshold value, "short/strong" vibration determined to be a pattern.

The development computer selects one voice material data from among the plurality of voice material data set for the determined vibration pattern (step S4). For example, the development computer determined that the vibration pattern of vibration data A was a “short/strong” vibration pattern, so it randomly selected one audio material data from “a_short_srong_0.wav”, “a_short_srong_1.wav”, etc. select.

The development computer sets the reproduction timing of the selected voice material data (step S5). Specifically, the development computer sets the reproduction timing so that the selected sound material data is reproduced from the vibration start time to the vibration end time in the vibration data. The development computer generates scene audio data so that the audio material data is reproduced at the set reproduction timing.

If the next vibration data exists (Yes in step S6), the development computer executes steps S2 to S5 for the next vibration data.

If the next vibration data does not exist (No in step S6), the development computer stores the scene audio data in which the reproduction timing of the audio material data is set in the storage unit 22 of the server device 2 (step S7).

After step S<b>7 , the scene audio data (cut scene data) stored in the storage unit 22 is transmitted (distributed) to each game device 5 . In the game device 5, scene audio data is reproduced by the audio processing unit 53 (speaker 62) when the user satisfies a predetermined condition during game play. The game device 5 reproduces the audio material data according to the reproduction timing set in the scene audio data.

In summary, the game program of the present embodiment controls the control unit 56 (computer) of the game device 5 with cut scene reproducing means 563 (reproducing means) for reproducing scene audio data including audio material data (audio), It functions as vibration control means 564 for controlling the vibration mechanism that generates vibration, and the vibration control means 564 provides vibration information (vibration signal) that determines the vibration pattern (mode of vibration) for the vibrator (vibration mechanism) of the controller 63. , and the cut scene reproducing means 563 reproduces the scene audio data including the audio material data whose reproduction timing is set based on the vibration information.

<Effect of invention>
As described above, in the present embodiment, audio material data is reproduced based on vibration information used to vibrate the controller 63 .

In a cutscene, the player character may be impacted by, for example, an earthquake or an attack from an enemy character. In this case, vibration information is output to the vibrator so that the controller 63 vibrates at the timing when the player character receives the impact. In the cut scene, sound effects, environmental sounds, BGM, etc. are set to be reproduced at the timing when the player character receives an impact. That is, in game development, in cutscenes, settings are made such that sound effects, environmental sounds, BGM, and the like are reproduced in accordance with the timing at which the controller 63 vibrates.

In this embodiment, the reproduction timing of the audio material data is set for the scene audio data based on the vibration information. That is, the cut scene reproducing means 563 reproduces the audio material data based on the vibration information. This saves the game developer the trouble of setting the timing for reproducing the audio material data while viewing the video. That is, the man-hours for game (software) development can be reduced.

The development computer also determines the vibration pattern in the vibration data (vibration information). The development computer sets the reproduction timing of the voice material data based on the determined vibration pattern. The cutscene reproducing means 563 reproduces the voice material data at the reproduction timing set by the development computer. That is, the man-hours for game (software) development can be reduced.

Further, the development computer determines the vibration pattern of the vibration data based on the length of vibration in the vibration data (the time from the start time of vibration to the end time of vibration). This makes it possible to easily divide vibration data into patterns.

The development computer also determines the vibration pattern of the vibration data based on the amplitude (strength) of vibration in the vibration data. This makes it possible to easily divide vibration data into patterns.

Also, a plurality of audio material data are set for each vibration pattern. The development computer selects any one of the plurality of voice material data set for the vibration pattern. The cutscene reproducing means 563 reproduces the audio material data selected by the development computer. For example, the computer for development randomly selects any one of a plurality of audio material data, thereby widening the variety of acoustic effects.

(Other embodiments)
Note that the audio material data may be audio in a low range (a range below a predetermined frequency). In other words, the cutscene reproducing means 563 may reproduce low-pitched sounds based on the scene vibration data. If the speaker 62 includes a woofer or subwoofer, the cutscene reproducing means 563 may reproduce low-range or super-low-range sound from the woofer or subwoofer.

In step S5, if the length of vibration in the vibration data (the time from the start time of vibration to the end time of vibration) is longer than the reproduction time of the selected voice material data, the development computer may be set to be played in a loop.

The development computer may also determine the vibration pattern by means other than the length of vibration and the strength of vibration in the vibration data. For example, a specific vibration pattern such as rumbling, explosion, attack, etc. is set in advance in the development computer, and the development computer determines which vibration pattern the vibration contained in the vibration data matches. judge. In this case, by setting audio material data for each set vibration pattern, it is possible to further save the trouble of setting sound effects, environmental sounds, BGM, and the like.

In addition, the development computer divides vibration data into patterns using two criteria, the length of vibration and the amplitude (strength) of vibration. A division may be made. For example, the development computer uses criteria for vibration length and vibration amplitude, as well as the amount of change in vibration amplitude (e.g., the difference between the largest and smallest amplitudes in the vibration data). Vibration data may be divided into patterns. As a result, it is possible to further save the trouble of setting sound effects, environmental sounds, BGM, and the like.

The game device 5 may also have a function of reproducing audio material data (sound effects, environmental sounds, BGM, etc.) in synchronization with the timing at which vibration signals (vibration information) are output from the vibration control means 564 . For example, audio material data is set for each vibration pattern of vibration information (vibration data). The game device 5 determines the vibration pattern of the vibration information (vibration data). Then, the game device 5 reproduces the audio material data set to the determined vibration pattern in synchronization with the timing at which the vibration control means 564 outputs the vibration signal (vibration information). That is, the present invention can also be applied to settings other than playback of cutscenes (for example, setting playback timing of sound effects, environmental sounds, and BGM during game play).

In the above embodiment, the game device 5 is a device such as a personal computer and a PlayStation, but the type of the game device 5 is not limited to this. For example, the game device 5 may be a smart phone, a tablet, or an arcade game housing provided at a game center.

Also, the game device 5 may vibrate components other than the controller 63 according to the vibration information. For example, when the game device 5 is a smartphone, a vibration mechanism built into the smartphone may be vibrated according to the vibration information. That is, game device 5 may vibrate a device having a vibrating mechanism connected internally or externally according to the vibration information. Further, the object to be vibrated may be changed according to the vibration information according to the type of game device 5 .

2 Server device 22 Storage unit 23 Control unit 5 Game device 53 Audio processing unit 54 Operation unit 55 Storage unit 56 Control unit 563 Cut scene reproduction means 564 Vibration control means 63 Controller

Claims (5)

the computer,
a reproduction means for reproducing audio;
Functioning as a vibration control means for controlling a vibration mechanism that generates vibration,
The vibration control means outputs vibration information defining a mode of vibration to the vibration mechanism,
The reproduction means reproduces sound whose reproduction timing is set based on the vibration information,
said computer,
Further functioning as determination means for determining the mode of vibration,
The reproduction means reproduces the sound based on the mode of the vibration determined by the determination means,
A plurality of said sounds are set for each mode of said vibration,
The reproduction means reproduces any one of a plurality of sounds set to the vibration mode based on the vibration mode determined by the determination means.
A voice playback program characterized by: In claim 1 ,
The sound reproduction program, wherein the determination means determines the mode of the vibration based on a start time and an end time of the vibration indicated in the vibration information. In claim 1 or claim 2 ,
The sound reproducing program, wherein the determining means determines the mode of the vibration based on the amplitude of the vibration indicated by the vibration information. 4. An audio reproducing apparatus comprising: a storage unit storing the audio reproducing program according to claim 1 ; and a control unit executing the audio reproducing program. A method of generating sound using a computer, comprising:
a speech generation step for generating speech;
a vibration information generating step of generating vibration information used to control the vibration mechanism that generates the vibration;
In the vibration information generation step, the vibration information is generated in which timing for generating vibration in the vibration mechanism is set in accordance with reproduction of a moving image,
In the sound generating step, the timing for reproducing the sound is set based on the vibration information ,
Further comprising a determination step of determining the mode of vibration,
In the sound generation step, the sound is reproduced based on the mode of the vibration determined in the determination step,
A plurality of said sounds are set for each mode of said vibration,
In the sound generation step, based on the vibration mode determined in the determination step, any one of a plurality of sounds set to the vibration mode is reproduced.
A speech generation method characterized by:

Images