JP2004267433A - Information processor, server, program, recording medium for providing voice chat function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make a user feel as if he/she is talking as a character in a virtual space in the case of performing voice chat arranging the character in the virtual space. <P>SOLUTION: Voice transforming processing (S103, S105, S107) or voice synthesizing process (S109) which makes the relationship between the virtual space and voice intimate is performed prior to outputting the chat voice (S110). For example, the voice gets differently heard depending on the presence of objects other than the characters arranged in the virtual space, or character's voice made while he/she is moving the virtual space gets heard changing with the movement in real time. Further, the chat voice gets affected by voices other than the chat voice made in the virtual space or affected by the body condition the user really uttering the voice. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information processing apparatus, a server, and a computer program that controls the information processing apparatus suitable for application to a voice chat system in which conversation is performed via characters arranged in a virtual space.
[0002]
[Prior art]
The chat service provided on the Internet allows users who are physically separated to enjoy text-based conversations by transferring text data input from users to other users in real time via the network. Service. Originally proposed as a means for direct communication between users, it has recently been used as a function for allowing characters displayed on a computer screen to have a conversation. For example, Patent Document 1 discloses a system in which a user's surrogate character called an avatar is placed in a three-dimensional virtual reality space, and a character input by each user is transmitted to another user as an utterance of the surrogate character.
[0003]
In recent years, a voice chat service has started to be provided that enables voice conversation similar to a telephone by converting voice inputted by a microphone into digital data and exchanging it.
[0004]
[Patent Document 1]
JP 2001-31744 A
[0005]
[Problems to be solved by the invention]
As described above, there are two types of chat: a mode in which the user has a conversation as himself and a mode in which the user has a conversation as a substitute character. The roles expected of the chat system are slightly different between the former and the latter. In the former case, it is sufficient that each user's speech is accurately transmitted in real time. However, in the latter case, particularly in network role-playing games, etc., it is important not only to accurately transmit information, but also to create an atmosphere in which each user can fully transfer emotions to the characters.
[0006]
The invention described in Patent Document 1 tries to express a sense of distance between avatars by changing attributes of a chat character string, but there is a limit to creating an atmosphere using such characters. Accordingly, an object of the present invention is to provide a voice chat system that can enhance the atmosphere of a virtual space and enjoy a conversation full of realism. Furthermore, some problems that may arise due to the importance of presence are also solved.
[0007]
[Means for Solving the Problems]
The present invention provides an information processing apparatus including character control means, chat data transmission means, and chat voice output means as described below as means for enhancing the sense of presence when performing voice chat. A program for causing a computer to function as such an information processing apparatus is also provided. The program can be provided by being recorded on a computer-readable recording medium such as a DVD, a CD-ROM, or a memory card.
[0008]
The character control means communicates with a server that manages a virtual space that can be shared by a plurality of users and a character for each user placed in the virtual space, so that a character placed by the user of the information processing device in the virtual space. It is a means for controlling the behavior.
[0009]
The chat data transmission means is means for acquiring first voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the first voice data, and transmitting the chat data.
[0010]
The chat voice output means acquires chat data generated by the information processing apparatus in communication with the server, and uses the first voice data included in the chat data to use the user of the information processing apparatus that generated the chat data. Is means for outputting the voice of the arranged character.
[0011]
In the first information processing apparatus or program proposed by the present invention, the chat voice output means converts the first voice data included in the acquired chat data based on the attribute relating to the voice of the object arranged in the virtual space. By doing so, the second voice data is generated, and the voice represented by the second voice data is output as the voice of the character. However, the first audio data and the second audio data may be equal as a result of the conversion. The attributes relating to the sound of the object are, for example, sound absorption, sound reflection, and pitch change, and are defined together with other attributes of the object when configuring the virtual space.
[0012]
In other words, the way the sound is heard changes depending on the presence of an object other than the character in the virtual space, so that the user can recognize the structure of the virtual space not only visually but also by hearing. Thereby, a sense of reality can be enhanced.
[0013]
In the second information processing apparatus or program proposed by the present invention, the chat voice output means arranges the first voice data included in the acquired chat data by the user of the information processing apparatus in which the chat data is generated. The second voice data is generated by converting the character and the positional relationship between the character placed by the user of the information processing apparatus based on the displacement amount per unit time, that is, the displacement speed, and the voice represented by the second voice data is converted into the second voice data. Output as the voice of the character.
[0014]
By changing the sound produced by the moving character in real time, the user can recognize that the character is moving by hearing, so that the user's sense of reality can be enhanced.
[0015]
Further, in the third information processing apparatus or program proposed by the present invention, the chat data transmission means acquires the user's physical information by a predetermined sensor attached to the user and generates chat data including the physical information. Then make a call. The chat voice output means generates second voice data by converting the first voice data included in the acquired chat data based on the physical information included in the chat data, and the voice represented by the second voice data. Is output as the voice of the character.
[0016]
The user's physical information is information representing a change in the physical state of the user who operates the character, and includes, for example, a pulse, a sweating state, and a body temperature. By changing the voice of the character in accordance with the physical state of the user who operates the character, the effect is to make the user and the character feel assimilated.
[0017]
In the fourth information processing apparatus or program proposed by the present invention, the chat sound output means acquires sound effect data representing sound effects for producing a virtual space, and uses the first sound data and sound effect data. The second voice data is generated by the synthesis, and the voice represented by the second voice data is output as the voice of the character.
[0018]
If the output timing of the sound effect and chat voice overlap, the user's voice is affected by other sounds generated in the virtual space, so that the user is speaking in the virtual space. Can feel like.
[0019]
Further, the chat voice output means of each information processing device generates second voice data for each voice output device based on the positional relationship between the voice output device (speaker) that outputs voice and the user of the information processing device. Is desirable. By outputting the chat voice by utilizing the arrangement of the speakers, the sense of reality can be further enhanced.
[0020]
Next, the present invention proposes a chat voice playback function as a new function of voice chat. As means for realizing such a function, the following information processing apparatus and server as well as a computer are used. Provided is a program that functions as an information processing apparatus or server.
[0021]
A fifth information processing apparatus and program provided by the present invention includes the character control means, chat data transmission means, and chat voice output means as described above, as in the first to fourth information processing apparatuses. In the fifth information processing apparatus and program, the chat voice output means is a server generated by each information processing apparatus in addition to the function of acquiring the chat data immediately after being generated by each information processing apparatus and outputting the voice of the character. The function of acquiring the chat data stored and stored in and reproducing the voice of the character is provided. It is desirable that the chat voice output means can reproduce the voice of the character at a speed different from the speed at which the voice data is acquired. This is to enable fast-forwarding of audio during playback.
[0022]
Furthermore, in order to provide a chat voice reproduction function, a server and a server program including the following character control means, chat data distribution means, and chat data search means are provided.
[0023]
The character control means is a means for providing a virtual space that can be shared by a plurality of users and controlling the actions of the characters arranged by each user in the virtual space by communicating with the information processing apparatus of each user.
[0024]
The chat data distribution means receives chat data including voice data representing voice uttered by each user from the information processing apparatus of each user, stores the chat data in a predetermined storage medium, and communicates with the plurality of chat data. It is means for delivering to the information processing apparatus. The voice data included in the chat data may be stored in a storage medium after being converted into character data.
[0025]
The chat data search means is means for searching for chat data requested by the user from the chat data stored in the storage medium and transmitting it to the information processing apparatus of the user. Thereby, the information processing apparatus that accesses the server can reproduce the chat voice.
[0026]
Furthermore, the present invention includes, as the sixth information processing apparatus or program, the character control means, the chat data transmission means, and the chat voice output means as described above, similar to the first to fourth information processing apparatuses. The chat voice output means outputs the voice of the character based on the attributes and items of the character arranged by the user using the information processing apparatus and the character arranged by the user of the information processing apparatus from which the output voice data is acquired. Devices and programs are provided. According to this apparatus or program, the user can change the way the sound is heard by his / her selection by acquiring predetermined attributes and items. This is to prevent the user from feeling stressed about how to listen to the chat voice by allowing the user to select a preferred listening method.
[0027]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described by taking a network role playing game as an example. First, an overview of a network role playing game and its voice chat function will be described with reference to FIG.
[0028]
In general, the network game service is provided by a server computer managed by a game company or the like. The network role playing game service of the present embodiment is also provided by one or a plurality of computers (hereinafter referred to as server 2) connected to the network 1 such as the Internet. A user of a game service (hereinafter referred to as a user) operates an information processing apparatus having a communication function, for example, a home game machine, a personal computer, a portable game machine, a mobile phone, a portable information terminal, etc. The server 2 is accessed through the game. Note that the communication function is not limited to wired, but may be a wireless communication function. The figure shows a state in which two users 4A and 4B are accessing the server 2 using the information processing apparatuses 3A and 3B, respectively.
[0029]
The server 2 defines a virtual space 5 constituted by land, buildings, and other various objects, and provides the virtual space 5 in a state that can be shared by users who have accessed the server 2. The user can enjoy a feeling as if he / she is in the virtual space by placing a character corresponding to his / herself in the virtual space 5 provided by the server 2 and moving the character. The user can move his / her character by operating a control device (controller) connected to the information processing apparatus and sending a predetermined instruction signal to the server 2. In the figure, as a result of the user 4A operating the controller 11A to move the character 6A and the user 4B operating the controller 11B to move the character 6B, the character 6A and the character 6B encounter each other in the virtual space. .
[0030]
The information processing apparatuses 3A and 3B used by each user have a built-in or connected microphone for inputting sound and a speaker for outputting sound. Further, in the present embodiment, each user wears a pulse sensor for measuring a pulse at any part of the body. The form of the microphone, the speaker, and the pulse sensor may be any form. For example, in the figure, the users 4A and 4B are equipped with microphone-equipped headphones equipped with voice input microphones 7A and 7B and voice output earphones 8A and 8B, and pulse sensors 12A and 12B so as to hit the temples of the head. The state which mounted | wore is illustrated.
[0031]
Voice chat is realized by generating chat data including voice data representing voice input from the microphones 7 </ b> A and 7 </ b> B and exchanging chat data via the network 1 and the server 2. For example, when the utterance sound 9 of the user 4B is input to the information processing apparatus 3B through the microphone 7B, chat data including voice data representing the utterance sound 9 is transferred from the information processing apparatus 3B to the server 2. The chat data is distributed by the server 2 to the information processing apparatuses 3A and 3B, and the sound 10 is output from the earphone 8A of the user 4A and the earphone 8B of the user 4B.
[0032]
In the network role-playing game, a user who performs voice chat usually utters a voice with the intention of becoming a substitute character. In other words, not a direct conversation between users but an indirect conversation via a character. For this reason, in the following description, when a user utters as a character, it expresses as "a character utters" etc. as needed.
[0033]
The voice chat function of the network role-playing game according to the present embodiment has several features as described below.
[0034]
First, the voice uttered by a character is heard depending on the shape, position, orientation, characteristics, etc. of objects around the character. In other words, the attribute of an object other than the character arranged in the virtual space affects the way in which the voice uttered by the character is heard. The attribute of each object is defined at the time of configuring the virtual space.
[0035]
For example, in the virtual space 5 illustrated in FIG. 1, sound echo characteristics are defined as one of the attributes of the object 13 (tunnel). In this case, when the character 6C in the vicinity of the object 13 makes a sound while facing the object 13, the sound is reverberated and heard. When the character 6C makes a sound in the opposite direction to the object 13, the sound does not reverberate. The object 14 (plant) has sound absorption characteristics. In this case, the character 6D and the character 6E trying to communicate with each other with the object 14 sandwiched between them are absorbed by the object 14 and thus cannot hear each other's voice and cannot talk. On the other hand, the characters 6A and 6B located at a predetermined distance or more from the object 13 and the object 14 can talk normally without being influenced by the object.
[0036]
As object attributes related to sound, in addition to the above-mentioned echo and absorption, various attributes such as a characteristic that the emitted sound can be heard in a stepwise manner and a characteristic that it can be heard in an octave higher can be freely defined. it can. The attribute relating to the sound may be defined so as to be an environment close to the real world as in the example of the object 13, or may be an attribute causing an unrealistic phenomenon as in the example of the object 14.
[0037]
The way in which the voice uttered by the character changes depending on the location of the character is nothing other than that the voice is closely related to the structure of the virtual space. Thus, each user can feel that a certain character has moved from one place in the virtual space to another place from a change in how the voice uttered by the character is heard. In other words, since an event that has been captured only by vision can be captured by hearing, a sense of reality is increased as compared with the past.
[0038]
Voice chat is originally a function for communication, but in the present embodiment, it is also possible to enjoy the change in how the voice is heard by speaking to the character while moving the character. Furthermore, when encountering a partner who does not want to have a conversation, the game can be advanced while utilizing the way the sound is heard, such as moving the character to a place where it is difficult to hear the sound.
[0039]
Next, the second feature will be described. In the game of the present embodiment, when the positional relationship between characters having a conversation changes with the passage of time, the sound also changes in real time with the passage of time. For example, a voice uttered by a character trying to run away while riding a car is gradually reduced as the distance from the character that hears the voice increases. That is, not only a relative positional relationship between characters but also a change in the positional relationship is detected, and the detected change is reflected in the output voice. The relationship between the change in the positional relationship and the change in the sound may be a relationship similar to the real world as in the above example, but an unrealistic relationship unique to the virtual space may be defined. For example, when the character being uttered moves (warps) in the virtual space instantaneously, it is possible to define a relationship such that no sound can be heard or suddenly the sound can be heard at the warped timing.
[0040]
The fact that the way in which the voice uttered by the character changes in accordance with the movement of the character is nothing but the close relationship between the voice uttered by the user and the virtual space. Similar to the first feature, the user can feel that a certain character is moving from one place in the virtual space to another place from a change in how the voice uttered by the character is heard. Conventionally, an event that has been captured only by vision can be captured by auditory sense.
[0041]
Next, the third feature will be described. In role-playing games, sound effects for production are usually output in accordance with the action taken by the scene or character. For example, wind sound or collision sound. These sound effects, like the virtual space, are defined by the side that creates and provides the game. In the role playing game of the present embodiment, when the timing at which the character utters the voice overlaps with the output timing of such a sound effect, the way the character's voice is heard changes. In other words, the sound data output by the game control program and the sound data acquired by the microphone input are output after being synthesized according to a predetermined rule.
[0042]
For example, in a strong wind scene, the sound of the wind and the voice of the character will be heard, but in this case, the weight of the sound of the wind is increased so that the sound of the character is drowned out by the sound of the wind and becomes difficult to hear. . The rule for synthesizing speech may be a rule that makes it sound like the real world, or a rule that makes an unreal sound that is unique to the virtual world. In any case, it goes without saying that various rules can be considered.
[0043]
The fact that the sound heard by the character changes depending on the sound generated in the virtual space is nothing but the close relationship between the sound emitted by the user and the virtual space. As a result, the user who emits the sound can feel the presence as if he / she is speaking in the virtual space, and the user who listens to the sound can actually hear the character in the virtual space. You can enjoy the feeling as if
[0044]
Next, the fourth feature will be described. In the role playing game according to the present embodiment, each user wears the pulse sensors 12A and 12B as described above, and the sound produced by the user changes according to the user's pulse.
[0045]
For example, when it is detected that the pulse is extremely high, even if the user himself / herself utters a normal voice, the voice of the user who listens to the voice may be trembling or high. hear. Furthermore, the user's character with a high pulse changes the screen display, for example, the face color becomes red (or blue). Instead of the pulse sensor, a sweat sensor or a temperature sensor may be attached. Since the sensor is worn for the purpose of detecting a change in the user's physical condition, any sensor that meets this purpose may be used.
[0046]
As described above, when the user's body information is reflected in the utterance sound of the user's character, the uttering user can enjoy the game assimilating with the character. In addition, the user who listens to the voice can catch a glimpse of the state or character of the user who operates the character from the voice of the character.
[0047]
Next, means for providing the above-described voice chat function will be described. FIG. 2 is a diagram for explaining functions of the information processing apparatus 3 used by the user. As illustrated, the information processing apparatus 3 includes a character control function 16, a chat data transmission function 17, and a chat voice output function 18. Specifically, these functions are realized by a control program incorporated in the information processing apparatus 3.
[0048]
The character control function 16 receives information on the virtual space and the arrangement position of the characters from a server (not shown) via the network 1 and displays a partial area of the virtual space on the display 15 based on the received information. 11 is a function of receiving an operation input from 11 and transmitting information specifying the character's action to the server.
[0049]
The chat data transmission function 17 is a function that receives voice input from the microphone 7 and pulse information from the sensor 12, generates chat data including such information, and transmits the chat data to the server via the network 1. . As shown in FIG. 3, the chat data needs to be in a format including at least three types of information, that is, the uttered sound 21 input by the microphone and digitized, the utterance time 19 of the uttered sound 21, and the information of the uttered character 20. is there. Alternatively, information specifying the user may be added in place of the utterance character 20. In the present embodiment, the chat data also includes user physical information 22 such as a pulse acquired by a sensor.
[0050]
The chat voice output function 18 is a function that receives voice data transferred from the server 2 via the network 1 and outputs the voice data to the speaker 8. The voice data transferred from the server 2 includes production sound data representing sound effects for production, in addition to chat data transmitted by the chat data transmission function 17 of each information processing apparatus. As shown in FIG. 4, the effect sound data includes at least information on the sound effect 24 and the output timing 23 of the sound effect 24. The effect sound data may be transferred from the server 2 but may be held in advance by the information processing device 3.
[0051]
FIG. 5 is a diagram illustrating a hardware configuration of the information processing apparatus 3. The information processing apparatus 3 includes at least a CPU 25, a RAM 26, a communication control unit 27, an input / output control unit 28, an operation input control unit 29, a display output control unit 30, a voice input / output control unit 31, a sensor input control unit 32, and a connection between them. The system bus 33 is provided.
[0052]
The communication control unit 27 is connected to the network 1 and controls exchange of programs and data with the server 2. Further, the input / output control unit 28 controls reading of data from a recording medium such as a CD-ROM, DVD 33, memory card 34, and hard disk 35 and writing of data to the recording medium. The operation input control unit 29 controls user input from an input device such as the controller 11 externally connected to the information processing apparatus 3. The accepted input is transmitted to the CPU 25 via the system bus 33. The display output control unit 30 controls display on the display 15 of an image output by the control program. The voice input / output control unit 31 controls voice input from the microphone 7 and voice output to the speaker 8. Further, the sensor input control unit 32 controls sensor input from the pulse sensor 12.
[0053]
A control program that provides each function of FIG. 2 is provided by a CD-ROM or DVD 33 or downloaded from the server 2. In either case, the control program is loaded into the RAM 26 and executed by the CPU 25. The CPU 25 implements the character control function 16 by exchanging instruction signals and the like among the operation input control unit 29, the display output control unit 30, and the communication control unit 27 based on the control program. Similarly, the chat data transmission function 17 is realized by the CPU 25 exchanging signals and the like with the voice input / output control unit 31, the sensor input control unit 32, and the communication control unit 27 based on the control program. Is realized by exchanging signals with the communication control unit 27 and the voice input / output control unit 31.
[0054]
FIG. 6 is a flowchart showing an outline of the processing of the control program corresponding to the chat voice output function 18 of FIG. As shown in the figure, when the control program receives chat data in step S101, first, in step S102, there is an object having an attribute that affects voice output around the character corresponding to the user who sent the chat data. It is determined whether or not to do. Since the information about the configuration of the virtual space and the arrangement position of the character has been acquired by the character control function as described above, the determination can be performed using the information. For example, it is determined whether or not an object having a sound attribute exists in a circular area with a predetermined radius centered on the character that made the sound or a fan-shaped area with a predetermined angle in front of the character.
[0055]
If there is an object having an attribute related to voice, in step S103, the utterance sound included in the chat data is converted based on the object attribute. For example, if the attribute of the object is a sound echo characteristic, after the echo processing is performed on the uttered sound, the processed sound data is stored in the memory. If there is no object having the attribute related to the voice around the character, the process of step S103 is not executed.
[0056]
Next, in step S104, the relative positional relationship between the character that produced the sound and the character of the user who is using the device that executes the sound output process is calculated based on the virtual space and character placement information. To do. Further, when one or both of the two characters are moving, a change in positional relationship (displacement speed) per unit time is obtained, and whether or not the displacement speed is a speed that affects the voice is determined in advance. Judgment is made by comparison with a threshold value.
[0057]
If the displacement speed is greater than or equal to the threshold value, a voice conversion process based on the displacement speed is performed in step S105. If conversion processing has been performed in step S103, the conversion processing is further performed on the processed audio data stored in the memory. If the displacement speed does not affect the sound, the process of step S105 is not executed.
[0058]
Next, in step S106, it is determined whether or not user physical information such as a pulse is included in the chat data. If user physical information that affects voice (for example, information that the pulse is very high) is included, a conversion process based on the user physical information is executed in step S107. For example, as described above, the utterance sound is converted so that the voice can be heard trembling. If conversion processing has been performed in step S103 or S105, conversion processing is further performed on the converted audio data stored in the memory. The converted data is stored again in the memory. On the other hand, if the user physical information that affects the voice is not included, the process of step S107 is not executed.
[0059]
Next, in step S108, it is determined based on the output timing information included in the effect sound data whether there is a sound effect that is being output or is about to be output. If there is a sound effect, in step S109, the uttered sound and the sound effect are synthesized by performing predetermined weighting as described above. The synthesis method is preferably defined in advance for each type of sound effect. If the conversion process has been performed in step S103, S105, or S107, the processed sound stored in the memory is synthesized with the sound effect. If there is no sound effect, the process of step S109 is not performed.
[0060]
Next, the voice converted or synthesized in step S110 is output. With the above processing, a voice chat function having the above-described four features can be realized. However, the flowchart shown in FIG. 6 shows a process for providing all the above four features, but each of the above features has an effect of increasing the sense of reality alone, and all the features are not necessarily included. There is no need to combine them.
[0061]
As described above, how the sound is heard can be changed by processing the sound data itself by sound conversion or synthesis with another sound. On the other hand, it is empirically known that how to hear the sound changes depending on the user who listens to the sound and the position of the speaker from which the sound is output.
[0062]
Therefore, in the present embodiment, when performing the above voice conversion and synthesis, output data that differs depending on the speaker placement position, such as the speaker placed on the right side of the user and the speaker placed on the left side. Is generated. For example, when a certain character emits sound and moves at high speed in the right direction as viewed from the character of the user who uses the information processing apparatus, the volume of the uttered sound output from the left speaker is gradually reduced. The volume of the uttered sound output from the right speaker is increased stepwise. Thereby, it can be felt by hearing that the utterance character has moved in the right direction at high speed, and the sense of reality increases. Needless to say, more output data may be generated assuming that three or more speakers are arranged.
[0063]
Next, problems that may occur due to increased realism and means for solving the problems will be described. As is clear from the above description, increasing the sense of presence by changing the way the sound is heard does not necessarily make it easier to hear the sound. For this reason, while there are users who enjoy a sense of realism, there is a possibility that some users feel stressed that it is difficult to hear sound. Therefore, the network role-playing game according to the present embodiment has some new functions so that all users can enjoy the above-mentioned presence without feeling stress.
[0064]
FIG. 7 is a diagram for explaining a first function for alleviating stress that is difficult to hear. In the virtual space, an object 36 that emits loud sound noise is arranged between the character 6A of the user 4A and the characters 6B and 6C operated by other users. The sound 10 is output from the speaker 8A of the headphone of the user 4A, but the sound quality is deteriorated due to the influence of the object 36. Therefore, the user 4A determines which character the voice 10 is. Can not do it.
[0065]
The first function is a function for making it possible to easily distinguish the voice character in such a case. Specifically, as shown in FIG. 7, a mark 37 indicating that the voice is being spoken is displayed around the character 6B being voiced. Alternatively, characters such as “speaking” may be displayed around the speaking character 6B. Furthermore, the color of the voice character body may be changed, or the mouth of the character may be moved. Accordingly, the user 4A can easily recognize that the sound 10 is generated from the character 6B. Thereby, for example, by moving the character 6 </ b> A to the vicinity of the character 6 </ b> B and exchanging the conversation again, it is possible to confirm the content of the speech that has been missed. The first function can be realized by linking the chat voice output function 18 and the character control function 16 in the configuration of the control program shown in FIG.
[0066]
Here, in the first function, the character 6A makes an inquiry to the character 6B, and the character 6B makes the same statement again, so that the content of the missed statement becomes clear. In other words, if the character 6B refuses to repeat a statement, the content of the statement that has been missed cannot be known. Therefore, in this case, in this embodiment, an audio playback function is provided as the second function so that the content of the speech that has been missed can be known.
[0067]
The voice reproduction function provided as the second function is a function for reproducing a past utterance sound of a character when a predetermined instruction is input from the user. Various user interfaces for inputting instructions can be considered. For example, as shown in FIG. 8, a method of displaying a menu 38 for instructing voice reproduction on a screen is conceivable. The example of FIG. 8 is an example in which the operation menu 38 is displayed by moving the cursor 39 to the character 6B and performing a predetermined button operation. Furthermore, if a desired instruction is selected from the menu items by operating the cursor 39, a part or all of past utterances can be reproduced. In the case of only the first function, the user who operates the character 6B must repeat the same remarks many times when many characters ask for repetitive remarks. The user who operates the character 6B is not required to restate. Also, the user 4A who operates the character 6A can confirm the content he wants to know without hesitation of the user who operates the character 6B.
[0068]
Furthermore, as shown in FIG. 9, the present embodiment also provides a function of collectively playing back conversations conducted in a predetermined place (such as a room) in the virtual space without specifying a character. According to this function, the operation menu 40 appears on the screen when the user performs a predetermined button operation. The user can select any of the menu items by operating the cursor 39, and can reproduce a part or all of a conversation that has been performed in the past at a predetermined location in the virtual space. In this embodiment, a fast-forward playback function is also provided so that many conversations can be played back in a short time.
[0069]
Note that the audio playback function is useful not only for re-listening when the voice is missed, but also for users who have joined the game from the middle. For example, FIG. 9 shows an example in which a user operating the character 6A participates in the game halfway and encounters characters 6B to 6D in conversation. In such a case, the user who operates the character 6A can grasp the content of the conversation between the three characters by playing back the conversation that has been performed in the past at this place. In this case, the character 6A does not bother other users by asking many questions for grasping the situation.
[0070]
In order to provide the second function, it is necessary to store all audio data related to past utterances. When providing a playback function for the purpose of only re-listening, data for playback may be stored on the information processing device side, but as described above, not only for the purpose of re-listening, In order to enable playback, it is preferable to store playback data on the server side.
[0071]
FIG. 10 is a diagram showing functions on the server side necessary for performing audio reproduction. As shown in the figure, the server 2 provides virtual space and manages a character space / character control function 41 for managing the arrangement of characters, and receives chat data from each information processing device and distributes it to other information processing devices. A chat data distribution function 42 and a chat data search function 43 for acquiring and transmitting the requested chat data by searching the database 44 in response to a request from each information processing apparatus are provided.
[0072]
Chat data is stored and stored in the database 44 by the chat data distribution function 42. At this time, in addition to the utterance time and utterance character information included in the chat data, other information necessary for the search, such as the utterance location, is added. In addition to the method of saving chat data as it is received, chat data can be saved by converting voice data contained in chat data into character data and saving it as data containing the voice time, voice character, and voice data. A way to do this is also possible. When the utterance content is stored as character data, it is also possible to display the characters together with the voice when the reproduction of the voice is requested. In addition, since many techniques for retrieving character information are known, using these techniques makes it possible to retrieve not only the utterance character and utterance time but also the utterance content. Furthermore, in recent years, a technique has also been proposed in which voice data is converted into a standard voice code and a voice search is performed by matching or mismatching of the voice codes. Therefore, the voice data may be converted into a standard voice code and stored, and a search based on the voice code may be performed.
[0073]
For example, many standard audio compression techniques such as MP3 also set standards for fast-forward playback of audio. Therefore, if the utterance information included in the chat data is stored in a standard data format, the aforementioned fast-forward function can be provided. Note that the search data and the data for batch playback or fast-forward playback may be stored separately in different data formats and used separately according to the purpose.
[0074]
FIG. 11 is a flowchart showing a reproduction process executed by the information processing apparatus 3 and a search process executed by the server 2. As shown in the figure, in step S201, when the information processing apparatus 3 receives an input of a voice reproduction instruction from the operation menu as shown in FIG. 8 or FIG. 9, in step S202, the character, the utterance time, and the place where the conversation was made. The reproduction request including the search keyword information is transmitted to the server 2. When the server 2 receives the reproduction request in step S301, in step S302, the server 2 determines whether or not partial reproduction is requested or reproduction of all past audio is requested by confirming the presence or absence of the search keyword. . If a search keyword is included, the database 44 is searched using the keyword in step S303. In step S304, the chat data acquired by the search is transmitted to the information processing apparatus that transmitted the reproduction request. When reproduction of all past audio is requested, the chat data stored in the database 44 is arranged in time series and transmitted to the information processing apparatus.
[0075]
In step S203, the information processing apparatus receives the chat data transmitted by the server 2, and reproduces and outputs the voice included in the chat data in step S204.
[0076]
Next, a third function for alleviating stress that is difficult to hear will be described. The third function is a voice conversion process or voice for giving a sense of reality when the character satisfies a predetermined condition, such as when the character possesses a predetermined item or when the character has a predetermined attribute. This is a function for outputting a sound without synthesizing processing.
[0077]
FIG. 12 is a flowchart illustrating a process for providing the third function. As shown in the figure, the flowchart shown in FIG. 12 shows whether or not the character of the user who received the chat data (the user who listened to the voice) possesses the designated item after step S101 of the flowchart shown in FIG. Step S111 for determining whether or not is added. The specified item may be fixed, but may be defined for each chat data. That is, information on the designated item may be included in the chat data.
[0078]
If it is determined in step S111 that the listener's character does not possess the specified item, the processing from step S102 onward in FIG. 6 is executed. On the other hand, when the listener's character possesses the designated item, the processes from steps S102 to S109 in FIG. 6 are not executed. In this case, since voice conversion and synthesis processing are not performed, in step S110, the voice included in the chat data is output as it is.
[0079]
According to the third function, for example, when the designated item is a transceiver, as shown in FIG. 13, the character 6A carrying the transceiver 45A and the character 6B carrying the transceiver 45B are affected by surrounding objects and sound effects. You can always talk with a voice that is easy to hear.
[0080]
Similarly, in step S111 in FIG. 12, the attribute of the character may be referred to and the necessity of speech conversion or synthesis may be determined based on the attribute. In this case, for example, when a human attribute character has a conversation with a robot attribute character, it may be difficult to hear the voice, but when a human attribute character has a conversation with each other, it is possible to always talk with a clear voice. can do. In the case of a game of a type in which a battle is divided into groups, by defining the grouping as an attribute, it is possible to realize a specification that allows chatting with only the ally group.
[0081]
According to the third function, when the user satisfies a predetermined condition, the user can have a conversation with the voice that is uttered as in the conventional case. Any user who prioritizes can enjoy the game together without feeling stressed.
[0082]
As described above, in the role-playing game according to the present embodiment, when voice chat is performed, voice closely related to the virtual space is output. Can feel. In addition, as a result of emphasizing the sense of presence, even if it may be difficult to hear the sound temporarily, the user feels stressed because the device has been devised to rehearse the sound or listen to a clear sound. There is no.
[0083]
Although the network role playing game has been described as an example, it is needless to say that the present invention is a technique applicable to any system that performs voice chat via a character.
[0084]
【The invention's effect】
According to each information processing apparatus or program of the present invention, the chat voice is output after the processing for making the relation between the virtual space and the voice dense, so that the user who listens to the voice is as if in the virtual space. You can feel a sense of realism like having a conversation.
[0085]
Further, according to each other information processing apparatus or program of the present invention, even when chat voice is difficult to hear, the user is not stressed.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining an outline of a network role-playing game and its voice chat function.
FIG. 2 is a diagram illustrating functions of an information processing apparatus according to the present invention.
FIG. 3 is a diagram illustrating an example of a format of chat data.
FIG. 4 is a diagram illustrating an example of a format of effect sound data.
FIG. 5 is a diagram illustrating a hardware configuration of an information processing apparatus.
FIG. 6 is a flowchart showing an outline of processing in an embodiment of the program of the present invention.
FIG. 7 is a diagram for explaining a function for discriminating a voice character;
FIG. 8 is a diagram for explaining a playback function for each character of chat voice;
FIG. 9 is a diagram for explaining a chat sound batch reproduction function;
FIG. 10 is a diagram illustrating server functions necessary for playing chat voice.
FIG. 11 is a flowchart showing an outline of processing for reproducing chat voice.
FIG. 12 is a flowchart showing audio output processing based on possessed items.
FIG. 13 is a diagram for explaining audio output processing based on possessed items.
[Explanation of symbols]
2 server, 3, 3A, 3B information processing device, 4A, 4B user, 5 virtual space, 6A-6E character, 7, 7A, 7B microphone, 8, 8A, 8B speaker (earphone), 9 vocal sound, 10 output 11, 11A, 11B controller, 12, 12A, 12B sensor, 13, 14, 36 object, 33 system bus, 34 memory card, 35 hard disk, 37 mark, 38, 40 operation menu, 39 cursor, 45A, 45B Transceiver.

Claims (21)

An information processing apparatus that provides a voice chat function,
By controlling a virtual space that can be shared by multiple users and a server that manages the characters for each user placed in the virtual space, the user of the information processing apparatus controls the behavior of the characters placed in the virtual space Character control means for
Chat data transmission means for acquiring first voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the first voice data, and transmitting the chat data;
The character arranged by the user of the information processing apparatus that has acquired chat data generated by the information processing apparatus in communication with the server and uses the first voice data included in the chat data and generated the chat data Chat voice output means for outputting the voice of
The chat voice output means generates second voice data by converting the first voice data included in the acquired chat data based on an attribute relating to voice of an object arranged in the virtual space, and the second voice data is generated. 2. An information processing apparatus that outputs a voice represented by two voice data as the voice of the character. An information processing apparatus that provides a voice chat function,
By controlling a virtual space that can be shared by multiple users and a server that manages the characters for each user placed in the virtual space, the user of the information processing apparatus controls the behavior of the characters placed in the virtual space Character control means for
Chat data transmission means for acquiring first voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the first voice data, and transmitting the chat data;
The character arranged by the user of the information processing apparatus that has acquired chat data generated by the information processing apparatus in communication with the server and uses the first voice data included in the chat data and generated the chat data Chat voice output means for outputting the voice of
The chat voice output means includes a first voice data included in the acquired chat data, and a positional relationship between a character arranged by a user of the information processing apparatus in which the chat data is generated and a character arranged by the user of the information processing apparatus An information processing apparatus that generates second voice data by performing conversion based on a displacement amount per unit time and outputs the voice represented by the second voice data as the voice of the character. An information processing apparatus that provides a voice chat function,
By controlling a virtual space that can be shared by multiple users and a server that manages the characters for each user placed in the virtual space, the user of the information processing apparatus controls the behavior of the characters placed in the virtual space Character control means for
Chat data transmission means for acquiring first voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the first voice data, and transmitting the chat data;
The character arranged by the user of the information processing apparatus that has acquired chat data generated by the information processing apparatus in communication with the server and uses the first voice data included in the chat data and generated the chat data Chat voice output means for outputting the voice of
The chat data transmitting means acquires the user's physical information by a predetermined sensor attached to the user, generates and transmits chat data including the physical information,
The chat voice output unit generates second voice data by converting the first voice data included in the acquired chat data based on the physical information included in the chat data, and the second voice data represents the second voice data. An information processing apparatus that outputs voice as the voice of the character. An information processing apparatus that provides a voice chat function,
By controlling a virtual space that can be shared by multiple users and a server that manages the characters for each user placed in the virtual space, the user of the information processing apparatus controls the behavior of the characters placed in the virtual space Character control means for
Chat data transmission means for acquiring first voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the first voice data, and transmitting the chat data;
The character arranged by the user of the information processing apparatus that has acquired chat data generated by the information processing apparatus in communication with the server and uses the first voice data included in the chat data and generated the chat data Chat voice output means for outputting the voice of
The chat sound output means acquires sound effect data representing sound effects for producing the virtual space, generates second sound data by synthesizing the first sound data and the sound effect data, An information processing apparatus that outputs the voice represented by the second voice data as the voice of the character. In the information processing apparatus according to any one of claims 1 to 4,
The chat voice output unit generates the second voice data for each voice output device based on a positional relationship between a voice output device that outputs the voice and a user of the information processing device. . An information processing apparatus that provides a voice chat function,
By controlling a virtual space that can be shared by multiple users and a server that manages the characters for each user placed in the virtual space, the user of the information processing apparatus controls the behavior of the characters placed in the virtual space Character control means for
Chat data transmission means for acquiring voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the voice data, and transmitting the chat data;
The chat data generated by the information processing apparatus in communication with the server is acquired, and the voice of the character arranged by the user of the information processing apparatus in which the chat data is generated using the voice data included in the chat data Chat voice output means for outputting,
The chat voice output means obtains chat data immediately after generated by each information processing apparatus and outputs the voice of the character, and chat data generated by each information processing apparatus and stored and stored in the server. An information processing apparatus that provides a function of acquiring and reproducing the voice of the character. The information processing apparatus according to claim 6, wherein the chat voice output unit can reproduce the voice of the character at a speed different from a speed at which the voice data is acquired. A server that provides a voice chat function,
A character control means for providing a virtual space that can be shared by a plurality of users, and controlling the behavior of the character placed by each user in the virtual space by communicating with the information processing device of each user;
Chat data including voice data representing the voice uttered by each user is received from the information processing apparatus of each user, the chat data is stored in a predetermined storage medium, and the plurality of information processing apparatuses in communication Chat data delivery means for delivery to
Chat data search means for searching for chat data requested by the user from chat data stored in the storage medium and transmitting the chat data to the information processing apparatus of the user. A server characterized by enabling playback. 9. The server according to claim 8, wherein the chat data distribution unit converts the voice data included in the chat data into character data, and stores the character data in the predetermined storage medium. An information processing apparatus that provides a voice chat function,
By controlling a virtual space that can be shared by multiple users and a server that manages the characters for each user placed in the virtual space, the user of the information processing apparatus controls the behavior of the characters placed in the virtual space Character control means for
Chat data transmission means for acquiring voice data representing voice uttered by a user of the information processing apparatus, generating chat data including the voice data, and transmitting the chat data;
The chat data generated by the information processing apparatus in communication with the server is acquired, and the voice of the character arranged by the user of the information processing apparatus in which the chat data is generated using the voice data included in the chat data Chat voice output means for outputting,
The chat voice output means is based on attributes and / or items of a character arranged by a user using the information processing apparatus and / or a character arranged by a user of the information processing apparatus from which output voice data is acquired. An information processing apparatus that outputs voice of the character. A program that provides a voice chat function.
A character that controls the action of a character placed in the virtual space by a user of the computer by communicating with a virtual space that can be shared by a plurality of users and a server that manages the character for each user placed in the virtual space Control means,
The first voice data representing the voice uttered by the user of the computer is acquired, the chat data transmitting means for generating and transmitting the chat data including the first voice data, and the computer generated by the computer in communication with the server The chat data is acquired, and the first voice data included in the chat data is used to function as a chat voice output means for outputting the voice of the character arranged by the computer user who generated the chat data,
The chat voice output means generates second voice data by converting the first voice data included in the acquired chat data based on an attribute relating to voice of an object arranged in the virtual space, and the second voice data is generated. 2. A program that outputs the voice represented by the voice data as the voice of the character. A program that provides a voice chat function.
A character that controls the action of a character placed in the virtual space by a user of the computer by communicating with a virtual space that can be shared by a plurality of users and a server that manages the character for each user placed in the virtual space Control means,
The first voice data representing the voice uttered by the user of the computer is acquired, the chat data transmitting means for generating and transmitting the chat data including the first voice data, and the computer generated by the computer in communication with the server The chat data is acquired, and the first voice data included in the chat data is used to function as a chat voice output means for outputting the voice of the character arranged by the computer user who generated the chat data,
The chat voice output means includes a first voice data included in the acquired chat data, and a positional relationship between a character arranged by a computer user who generates the chat data and a character arranged by a computer user who operates the program A program for generating second voice data by converting based on a displacement amount per unit time and outputting the voice represented by the second voice data as the voice of the character. A program that provides a voice chat function.
A character that controls the action of a character placed in the virtual space by a user of the computer by communicating with a virtual space that can be shared by a plurality of users and a server that manages the character for each user placed in the virtual space Control means,
The first voice data representing the voice uttered by the user of the computer is acquired, the chat data transmitting means for generating and transmitting the chat data including the first voice data, and the computer generated by the computer in communication with the server The chat data is acquired, and the first voice data included in the chat data is used to function as a chat voice output means for outputting the voice of the character arranged by the computer user who generated the chat data,
The chat data transmitting means acquires the user's physical information by a predetermined sensor attached to the user, generates and transmits chat data including the physical information,
The chat voice output unit generates second voice data by converting the first voice data included in the acquired chat data based on the physical information included in the chat data, and the second voice data represents the second voice data. A program for outputting a voice as the voice of the character. A program that provides a voice chat function.
A character that controls the action of a character placed in the virtual space by a user of the computer by communicating with a virtual space that can be shared by a plurality of users and a server that manages the character for each user placed in the virtual space Control means,
The first voice data representing the voice uttered by the user of the computer is acquired, the chat data transmitting means for generating and transmitting the chat data including the first voice data, and the computer generated by the computer in communication with the server The chat data is acquired, and the first voice data included in the chat data is used to function as a chat voice output means for outputting the voice of the character arranged by the computer user who generated the chat data,
The chat sound output means acquires sound effect data representing sound effects for producing the virtual space, generates second sound data by synthesizing the first sound data and the sound effect data, A program that outputs the voice represented by the second voice data as the voice of the character. A program according to any one of claims 11 to 14,
The chat voice output unit generates the second voice data for each voice output device based on a positional relationship between a voice output device that outputs the voice and a computer user who operates the program. . A program that provides a voice chat function.
A character that controls the action of a character placed in the virtual space by a user of the computer by communicating with a virtual space that can be shared by a plurality of users and a server that manages the character for each user placed in the virtual space Control means,
The first voice data representing the voice uttered by the user of the computer is acquired, the chat data transmitting means for generating and transmitting the chat data including the first voice data, and the computer generated by the computer in communication with the server The chat data is acquired, and the first voice data included in the chat data is used to function as a chat voice output means for outputting the voice of the character arranged by the computer user who generated the chat data,
The chat voice output means acquires chat data immediately after being generated by each computer and outputs the voice of the character, and acquires chat data generated by each computer and stored in the server. And a function of reproducing the voice of the character. The program according to claim 16, wherein the chat voice output unit can play back the voice of the character at a speed different from the speed at which the voice data is acquired. A program for a server that provides a voice chat function.
A character control means for providing a virtual space that can be shared by a plurality of users, and controlling the behavior of the character placed by each user in the virtual space by communicating with the information processing device of each user,
Chat data including voice data representing the voice uttered by each user is received from the information processing apparatus of each user, the chat data is stored in a predetermined storage medium, and the information processing apparatuses in communication By functioning as chat data distribution means for distributing to the user and chat data requested by the user from chat data stored in the storage medium and functioning as chat data search means for transmitting to the information processing apparatus of the user A server program characterized in that chat information can be reproduced by the information processing apparatus. 19. The program according to claim 18, wherein the chat data distribution unit converts the voice data included in the chat data into character data, and stores the character data in the predetermined storage medium. A program that provides a voice chat function.
A character that controls the action of a character placed in the virtual space by a user of the computer by communicating with a virtual space that can be shared by a plurality of users and a server that manages the character for each user placed in the virtual space Control means,
Acquires voice data representing voice uttered by a user of the computer, generates chat data including the voice data and transmits the chat data, and acquires chat data generated by the computer in communication with the server The voice data included in the chat data is used to function as chat voice output means for outputting the voice of the character arranged by the computer user who generated the chat data.
The chat voice output means is based on an attribute and / or an item of a character arranged by a user using a computer that operates the program and / or a character arranged by a user of a computer from which audio data to be output is acquired. A program for outputting the voice of the character. A computer-readable recording medium on which the program according to any one of claims 11 to 20 is recorded.

Images