JP3780536B2 - Simulation system, virtual space providing apparatus and method, user terminal apparatus, and virtual space image generation method - Google Patents

Description

[0001]
[Industrial application fields]
The present invention is a simulation system suitable for use in, for example, designing a predetermined city space and testing problems in the city space., Virtual space providing device and method, user terminal device, and virtual space image generation methodAbout.
[0002]
[Prior art]
Recently, devices using virtual reality (virtual reality space) have been developed.
[0003]
For example, when designing a house, if a predetermined floor plan or specification is determined, an image of the corresponding house is generated with virtual reality, and the image is sent to the orderer who ordered the house, such as a head-mounted display. There is known an apparatus for performing display using. From the virtual reality displayed on the head-mounted display, the orderer can experience and test the house as if he / she actually lived in the house. Thereby, inconvenient points of the house can be easily found as compared with the case where the house is simply viewed from the design drawing.
[0004]
Similarly, an apparatus that provides an urban space as a virtual reality instead of a house is also known.
[0005]
[Problems to be solved by the invention]
However, such a conventional device cannot allow a plurality of users to experience (test) virtual reality at the same time, and therefore, find problems caused by a plurality of people using a predetermined space at the same time. There was a problem that could not be done.
[0006]
The present invention has been made in view of such a situation, and enables a plurality of users to test problems and the like when a predetermined space is used simultaneously.
[0007]
[Means for Solving the Problems]
  In the simulation system of the present invention, the receiving means has a corresponding character in the virtual space, inputs the character position, and transmits the character position to the supplying means. The supplying means is an image from the viewpoint of the character at the character position. Alternatively, the drawing information corresponding to the image from the overhead view of the virtual space including the character is read from the storage means and supplied to the receiving means, and the character position data supplied from the receiving means is supplied to the other receiving means. The receiving means receives the drawing information corresponding to the position of the character from the supplying means and the position of the character of the receiving means other than itself, and generates a virtual space image from the viewpoint of the character at the position of the own character. Or drawing information, character position data other than your own, and your character position data By using the data, generating a virtual space image from bird's-eye-view including an image of his characterThe supply means further includes a setting means for setting a range for synthesizing the audio signal corresponding to the character in accordance with a user operation by designating an area in the virtual space, and the supply means is set by the setting means Synthesized speech signals corresponding to a plurality of characters located within the specified range and supplied to the receiving meansIt is characterized by that.
[0008]
At least one of the receiving means and the supplying means does not display its own character, but switches between a character mode in which a character other than itself is displayed and an overhead mode in which both a character other than itself and its own character are displayed.Switching meansCan be provided.
[0009]
At least one of the receiving means and the supplying means has an overhead view for inputting the overhead view in the overhead view mode.Input meansCan be further provided.
[0010]
  SaidThe supply means can comprise selection means for selecting a synthesis mode for synthesizing audio signals corresponding to a plurality of characters and an independent mode for transferring audio signals corresponding to a specific character.
  SaidThe receiving means displays the character corresponding to the user terminal other than the self without displaying the character corresponding to the self using the image data provided from the supplying means and the data of the position of the character of the other user terminal. A virtual space image can be generated.
  The virtual space providing apparatus of the present invention includes a storage unit that stores data forming a virtual space, and a reception unit that receives data corresponding to the position of a character in a virtual space corresponding to the user terminal from a plurality of user terminals. The drawing information corresponding to the image from the viewpoint of the character at the position of the character corresponding to the received user terminal or the image from the overhead view of the virtual space including the character is read from the storage means and transmitted to the user terminal. Transmitting means for transmitting the character position data received from the other user terminal;Synthesizing means for synthesizing audio signals corresponding to characters received from a plurality of user terminals; and setting means for setting a range for synthesizing audio signals corresponding to characters by specifying a region in the virtual space;WithThe synthesizing unit synthesizes audio signals of a plurality of user terminals located within the range set by the setting unit, and the transmission unit further transmits the synthesized audio signals to the user terminal.It is characterized by that.
  SaidThe synthesizing means synthesizes the voice signal received from the user terminal corresponding to the character located far from the character centering on the character corresponding to each user terminal so that the voice signal is attenuated as the distance increases. Can do.
  Selection means for selecting a mode for synthesizing and transmitting audio signals received from a plurality of user terminals and a mode for transmitting audio signals received from specific user terminals can be further provided.
  The virtual space providing method of the present invention includes a reception step of receiving data corresponding to a position of a character in a virtual space corresponding to the user terminal from a plurality of user terminals, and a character at the position of the character corresponding to the received user terminal. A step of transmitting drawing information corresponding to an image from the viewpoint of the image or an image from the overhead view of the virtual space including the character to the user terminal, and transmitting data of the position of the character received from the user terminal to the other user terminal Steps,A step of setting a range for synthesizing a voice signal corresponding to the character by designating an area in the virtual space; and a step of synthesizing voice signals received from a plurality of user terminals located within the set range; And further transmitting the synthesized audio signal to the user terminalIt is characterized by that.
  SaidIn the synthesis step, the voice signal received from the user terminal corresponding to the character located at a position far from the character centered on the character corresponding to each user terminal is synthesized such that the farther the distance, the greater the attenuation. Can do.
  The user terminal device of the present invention transmits to the simulation device input means for inputting the character position in the virtual space corresponding to the user and data corresponding to the input character position in the virtual space corresponding to the self. A transmission means, a reception means for receiving drawing information corresponding to the data corresponding to the position of the character corresponding to the transmitted self from the simulation apparatus, and receiving data of the position of the character of another user terminal apparatus; and a virtual space Select either the character mode that displays the image from the viewpoint of the character that corresponds to self or the bird's-eye view mode that displays an image from the overhead view of the virtual space that includes the character that corresponds to self. Mode selection means to be used and the character mode is selected by the mode selection means Using the drawing information and the character position data of other user terminal devices, a virtual space image is generated from the viewpoint of the character at the character position in the virtual space corresponding to itself, and the overhead mode is selected by the mode selection means If it is, a virtual space image from an overhead view including the image of the own character is generated using the drawing information, the character position data of the other user terminal device, and the own character position data. Generating means forReceiving means, by specifying the area in the virtual space, A range for synthesizing the audio signal corresponding to the character is set, audio signals corresponding to a plurality of characters located within the set range are synthesized, and the synthesized audio signal is received from the simulation device.It is characterized by that.
  The generating means uses the drawing information and character position data of another user terminal device to display a character corresponding to a user terminal device other than the self, without displaying a character corresponding to the self. Can be generated.
  The generation unit can generate a virtual space image including a character corresponding to the self viewed from the overhead viewpoint, using the drawing information and the character position data of another user terminal device.
  An overhead mode switching means for switching between the character mode and the overhead mode can be further provided.
[0011]
[Action]
In the simulation system having the above configuration,The receiving means receives the image data corresponding to the position of the character and the position of the character of the receiving means other than itself, and generates a virtual space image.Therefore,MultipleIt is possible to grasp various problems in the case where the character simultaneously uses a predetermined virtual reality space.
[0012]
【Example】
FIG. 1 shows a configuration example of a simulation system of the present invention. In this embodiment, a plurality (N) of user terminals 3-1 to 3-N are connected to the simulation apparatus 1 via, for example, a broadband communication network using optical fibers. The simulation apparatus 1 has a database 2 in which image data forming a virtual reality space is stored.
[0013]
When the user terminals 3-1 to 3-N have a corresponding character in the virtual reality space and supply data corresponding to the position and viewpoint of the character to the simulation device 1, the simulation device 1 Image data corresponding to the position and viewpoint is read from the database 2 and supplied to the user terminals 3-1 to 3-N.
[0014]
FIG. 2 shows a configuration example of the simulation apparatus 1. As shown in the figure, the simulation apparatus 1 includes a CPU 21, and the CPU 21 executes various processes according to programs stored in the ROM 22. The RAM 23 appropriately stores data, programs, and the like necessary for the CPU 21 to execute various processes. The communication device 24 is configured to send and receive predetermined data to the user terminal 3 (3-1 to 3-N).
[0015]
The display device 25 includes a CRT, an LCD, and the like, and is connected to the interface 28 so that an image of the virtual reality space provided by the simulation device 1 can be monitored. The interface 28 is also connected to a microphone 26 and a speaker 27 so that a predetermined audio signal can be supplied to the user terminal 3 and an audio signal from the user terminal 3 can be monitored.
[0016]
Further, the simulation apparatus 1 includes an input device 29 so that various inputs can be performed via the interface 28. The input device 29 includes a keyboard 29a, a mouse 29b, a viewpoint input device 29c, a movement input device 29d, an overhead view mode switching button 29e, an overhead view viewpoint input device 29f, a composition mode switching button 29g, and an area designation device 29h.
[0017]
The keyboard 29a is operated when inputting predetermined characters or symbols. The mouse 29b is operated when a predetermined position is designated. The viewpoint input device 29 c is operated when inputting the viewpoint of the corresponding character of the simulation device 1. As a result, the viewpoint of the character can be moved in the vertical and horizontal directions, or a predetermined image can be zoomed. In addition, the movement input device 29d can perform an input for moving the character in the forward / backward / left / right directions at a predetermined speed.
[0018]
The overhead mode switching button 29e is operated when switching the mode for displaying the image of the virtual reality space on the display device 25 to the character mode or the overhead mode. In the character mode, an image from the viewpoint of the corresponding character is displayed, and in the overhead view mode, an image of the virtual reality space including the corresponding character is viewed from the overhead viewpoint. The overhead view input device 29f is operated when inputting an overhead view of an image displayed on the display device 25 in the overhead view mode.
[0019]
The composite mode switching button 29g is operated when switching between the composite mode and the single mode. In the single mode, only audio signals between the predetermined user terminal 3 or the simulation apparatus 1 and another user terminal 3 designated by them are exchanged. On the other hand, in the synthesis mode, all the audio signals input from the user terminals 3 corresponding to the characters located in the predetermined virtual reality space are synthesized and transmitted to the user terminals 3. The
[0020]
FIG. 3 shows a configuration example of the user terminal 3 (3-1 to 3-N). The user terminal 3 includes a CPU 41, and the CPU 41 is configured to execute various processes according to programs stored in the ROM 42. The RAM 43 appropriately stores data, programs, and the like necessary for the CPU 41 to execute various processes. The communication device 44 is configured to exchange data with the simulation device 1.
[0021]
The display device 45 includes a CRT, an LCD, and the like, and can display a CG (computer graphic) three-dimensional image or a three-dimensional image taken by a normal video camera. The microphone 46 is used when outputting an audio signal to the simulation apparatus 1 or another user terminal. The speaker 47 outputs an audio signal transmitted from the simulation apparatus 1 or another user terminal. The input device 49 is operated when performing various inputs.
[0022]
The keyboard 49a through the overhead view input device 49f in the input device 49 of the user terminal 3 correspond to the keyboard 29a through the overhead view input device 29f in the input device 29 of the simulation apparatus 1 shown in FIG.
[0023]
The interface 48 constitutes a data interface to the display device 45, the microphone 46, the speaker 47, and the input device 49.
[0024]
FIG. 4 schematically shows a virtual reality space provided by the simulation apparatus 1 shown in FIG. As shown in the figure, this virtual reality space constitutes a town, and a character C (for example, a character of the user terminal 3-1) and a character D (for example, a character of the user terminal 3-2) are displayed in this town. (Virtual reality space) can be moved.
[0025]
The character C sees an image as shown in FIG. 5, for example, from the position and viewpoint in the virtual reality space. That is, in the character mode, an image as shown in FIG. 5 is provided from the simulation device 1 and displayed on the display device 25 of the user terminal 3-1. When the viewpoint and position of the character C are changed by operating the viewpoint input device 49c and the movement input device 49d, a three-dimensional image forming the virtual reality space supplied from the simulation device 1 is correspondingly changed. Changed.
[0026]
Similarly, an image as shown in FIG. 6 is provided and displayed on the display device of the user terminal 3-2 to which the character D corresponds from the simulation device 1 in the character mode. The display image is also changed by moving the viewpoint and position of the character D.
[0027]
In the state shown in FIG. 4, the character C looks at the direction of the character D. Therefore, as shown in FIG. 5, the character D is displayed in the image (virtual reality space) displayed on the display device 25 of the user terminal 3-1.
[0028]
Similarly, in FIG. 4, the character D looks at the direction of the character C. For this reason, as shown in FIG. 6, the character C is displayed on the image (virtual reality space) displayed on the display device 25 of the user terminal 3-2.
[0029]
On the other hand, for example, when the bird's-eye view mode is designated in the user terminal 3-2, as shown in FIG. 4, an overhead image including the user's character C is displayed.
[0030]
Next, operations of the user terminal 3 and the simulation apparatus 1 will be described with reference to the flowcharts of FIGS.
[0031]
FIG. 7 illustrates a processing example of the user terminal 3. First, in step S1, the overhead mode switching button 49e of the user terminal 3 is operated to set either the overhead mode or the character mode. Next, in step S2, it is determined whether to change the position or the viewpoint. In the character mode, the position of the character in the virtual reality space is input by operating the movement input device 49d. In addition, the viewpoint of the character is input by operating the viewpoint input device 49c. In the overhead view mode, the position is input by operating the mobile input device 49d, and the overhead view point is input by operating the overhead view point input device 49f.
[0032]
When the position or the viewpoint is changed, the process proceeds to step S3, and a process for outputting data corresponding to the position or the viewpoint to the simulation apparatus 1 is executed. That is, the CPU 41 outputs data corresponding to operations of the viewpoint input device 49c, the movement input device 49d, the overhead view viewpoint input device 49f, and the like to the simulation device 1 via the communication device 44.
[0033]
As will be described later with reference to FIG. 8, when receiving the position and viewpoint data, the simulation apparatus 1 reads the image data corresponding to the position and viewpoint from the database 2 in step S <b> 22, and the user terminal 3. Output to.
[0034]
Therefore, in step S4, the user terminal 3 receives the drawing information output from the simulation apparatus 1, and generates, for example, a city planning image that forms a virtual reality space correspondingly.
[0035]
That is, when the CPU 41 receives drawing information from the simulation apparatus 1 via the communication device 44, the CPU 41 temporarily stores the drawing information in the RAM 43. Then, an image forming a three-dimensional virtual reality space corresponding to the drawing information is generated and displayed on the display device 45 via the interface 48. Thereby, for example, a three-dimensional image of the planned city is displayed on the display device 45.
[0036]
Steps S3 and S4 are executed only when the position or the viewpoint is changed. When there is no need to change the position or the viewpoint, there is no need to change the image already displayed on the display device 45. Accordingly, in this case, the processes in steps S3 and S4 are skipped.
[0037]
Next, it progresses to step S5 and it is determined whether the present mode is an overhead view mode. In the bird's-eye view mode, the process proceeds to step S6, and an image of one's own character is generated corresponding to the input viewpoint and position by operating the viewpoint input device 49c and the movement input device 49d. Then, an image of his / her character is output to the display device 45 and displayed.
[0038]
When the current mode is not the bird's-eye view mode, that is, in the character mode, an image corresponding to the position and viewpoint of his / her character is displayed on the display device 45. It is not necessary to display on 45. Therefore, in this case, the process of step S6 is skipped.
[0039]
In step S7, the character position and viewpoint data of the other user terminal 3 or the simulation apparatus 1 are received. In step S8, it is determined from the position and viewpoint data received in step S7 whether or not the position or viewpoint of the character has been changed. If changed, the process proceeds to step S9, where the new position or viewpoint is changed. An image of the character at the viewpoint is generated and output to the display device 45 for display.
[0040]
On the other hand, if it is determined in step S8 that the position or viewpoint of another character has not been changed, the process of step S9 is skipped. That is, the image of the character is not changed.
[0041]
Next, it progresses to step S10, it is determined whether a mode (overlook mode or character mode) is changed, and when not changing, it returns to step S2 and the subsequent process is repeatedly performed.
[0042]
On the other hand, when the mode is changed, the process returns to step S1, a new mode is set, the process proceeds to step S2, and the subsequent processing is repeated.
[0043]
As described above, for example, when the character mode is designated in the user terminal 3-2, for example, an image as shown in FIG. 6 is displayed on the display device 45 in correspondence with the position and viewpoint of his / her character.
[0044]
On the other hand, when the overhead view mode is set, an image as shown in FIG. 4 is displayed on the display device 45 corresponding to the position and the overhead view viewpoint.
[0045]
FIG. 8 shows a processing example of the simulation apparatus 1 when the user terminal 3 executes the processing shown in the flowchart of FIG. First, in step S21, the process waits until data for changing the position or viewpoint of the corresponding character is received from the user terminal 3. When received, the process proceeds to step S22, and drawing information corresponding to the received position or viewpoint data is obtained. The data is read from the database 2 and output to the user terminal 3 that has output the position or viewpoint data. The data output in step S22 is received and processed in the user terminal 3 in step S4 of FIG.
[0046]
In step S23, the position or viewpoint data received in step S21 is output to other related user terminals. The data output in step S23 is received by the user terminal 3 in step S7 in FIG.
[0047]
Here, whether or not another user terminal is related is determined from the position and viewpoint of the user terminal. That is, for example, when the position or viewpoint of the character C of the user terminal 3-1 is changed, the user terminal that displays the character C on the display device, and the user terminal other than the user terminal 3-1 is here. Other related user terminals in
[0048]
After the process of step S23, the process returns to step S21 and the same process is repeatedly executed.
[0049]
In FIG. 8, the processing of the simulation apparatus 1 corresponding to the operation of the user terminal 3 has been described. However, the simulation apparatus 1 similarly has the functions of the user terminal 3, and refer to FIG. The processing of the user terminal 3 described can be performed similarly in the simulation apparatus 1.
[0050]
As described above, the image of the city in the virtual reality space is displayed on the display device 45 of each user terminal 3 and the display device 25 of the simulation device 1 together with a predetermined number of character images.
[0051]
Next, with reference to the flowchart of FIG. 9, the conversation process by the audio signal with the other user terminal 3 or the simulation apparatus 1 in the user terminal 3 is demonstrated.
[0052]
First, in step S31, it is determined whether or not the current mode is the synthesis mode. If the current mode is not the synthesis mode (in the case of the independent mode), the process proceeds to step S32, and processing for designating the partner image is executed. That is, for example, the user terminal 3 operates the mouse 49b to place a corresponding cursor (not shown) on a character to be designated as a conversation partner and clicks to designate the character.
[0053]
Next, the process proceeds to step S33, and a process of outputting data for specifying the designated partner to the simulation apparatus 1 is executed. That is, the CPU 41 of the user terminal 3 outputs data corresponding to the designated character to the simulation apparatus 1.
[0054]
As will be described later with reference to the flowchart of FIG. 10, when the simulation apparatus 1 receives data designating the other party from the user terminal 3, the simulation apparatus 1 outputs the data to the designated user terminal in step S <b> 54. When the other user terminal that has received the designated data responds, it outputs an OK signal in step S43 of FIG. When receiving the OK signal, the simulation apparatus 1 executes a process of connecting the designated user terminal and the designated user terminal communication network in step S57 of FIG.
[0055]
Therefore, after confirming the reception of the OK signal in step S34 in FIG. 9, the user terminal 3 executes a two-way conversation using the voice signal with the designated partner in step S35.
[0056]
At this time, the audio signal input from the microphone 46 of the predetermined user terminal 3 is output to the simulation apparatus 1 via the interface 48 and the communication device 44. As described above, since the simulation apparatus 1 is connected to the communication network by voice signals, the voice signals are output to the user terminal 3 to which the designated character corresponds. And it outputs from the speaker 47 of the user terminal 3.
[0057]
Similarly, an audio signal input from the microphone 46 of the specified user terminal 3 is output to the speaker 47 of the user terminal specifying the character. As a result, a conversation using a bidirectional audio signal is performed.
[0058]
This conversation is repeatedly executed until it is instructed to end in step S36 by operating a predetermined key of the keyboard 49a of the user terminal 3 or until it is determined in step S37 that the mode has been changed to the synthesis mode. The
[0059]
If it is determined in step S36 that the end of the conversation has been commanded, the process proceeds to step S38, and processing for outputting an end signal is executed.
[0060]
When receiving the end signal, the simulation apparatus 1 detects this in step S58 in FIG. 10 and executes a process for releasing the connection of the communication network.
[0061]
On the other hand, if it is determined in step S31 that the mode is the composite mode, the process proceeds to step S39, where a user terminal corresponding to an unspecified character located in a space (region) in a predetermined virtual reality space or A conversation with the simulation device is executed.
[0062]
That is, as will be described later with reference to FIG. 10, in the synthesis mode, in step S62, a plurality of characters located in a predetermined area can be talked with each other. Accordingly, the user terminal 3 can have a conversation with the user terminal or the simulation apparatus corresponding to the unspecified character in the predetermined area until it is determined in step S40 that the synthesis mode has been completed. .
[0063]
During the conversation in the single mode, if it is determined in step S37 that the mode has been changed to the synthesis mode, the process proceeds from step S37 to step S39, and the subsequent processing is similarly executed.
[0064]
FIG. 10 shows an example of conversation processing in the simulation apparatus 1. First, in step S51, a setting process for the synthesis mode or the independent mode is performed. This setting is performed by operating the synthesis mode switching button 29g of the simulation apparatus 1. Next, in step S52, it is determined whether or not the set mode is the combination mode. If it is determined that the set mode is not the combination mode (independent mode), the process proceeds to step S53, and the user terminal 3 determines the predetermined mode. It is determined whether or not the designation data designating the character is received. When it is determined that the designated data has been received, the process proceeds to step S54, and the designated data is output to the user terminal 3 to which the designated character corresponds.
[0065]
In step S55, it is determined whether an OK signal is received from the user terminal that supplied the designated data. If the OK signal has not been received, the process proceeds to step S56 to determine whether or not to change the mode from the independent mode to the synthesis mode. If not changed, the process returns to step S53 and the subsequent processing is repeated.
[0066]
If it is determined in step S55 that an OK signal has been received, the process proceeds from step S55 to step S57, and communication is performed so that a user terminal that has designated a character and a user terminal that has output the OK signal can have a conversation using an audio signal. Execute processing to connect the network.
[0067]
Next, the process proceeds to step S58, where it is determined whether or not a conversation end signal has been received. If not, the process proceeds to step S59, where it is determined whether or not the independent mode has been changed. If not, the process returns to step S57. Thereby, the conversation by a bidirectional | two-way audio | voice signal is continued between the user terminal or simulation apparatus which designated the character, and the user terminal or simulation apparatus of the designated character.
[0068]
When the user terminal 3 outputs an end signal in step S38 in FIG. 9 and the simulation apparatus 1 receives this signal in step S58 in FIG. 10, the process returns to step S53, and the subsequent processing is repeated. In step S59, it is determined whether or not the mode is changed from the independent mode to the synthesis mode. When the mode is changed, the process returns to step S51, and the process for setting the predetermined mode is executed by operating the synthesis mode switching button 29g. .
[0069]
In step S51, when the composition mode is set by operating the composition mode switching button 29g, the process proceeds from step S52 to step S60, and it is determined whether or not the region for setting the composition mode is designated. When designating an area for which the synthesis mode is set, the process proceeds to step S61, and an area designation process is executed.
[0070]
That is, when setting the area to which the synthesis mode is applied, the area designating device 29h of the input device 29 is operated to designate a predetermined area as the area to which the synthesis mode is applied.
[0071]
For example, in a city space that forms a virtual reality space, assuming that a power outage has occurred in a building or residence in a given block, if you want to know the movement of each character in that case, you can use the composite mode in that block. Can be set. Alternatively, when a road is formed at a predetermined position in the virtual reality space and the influence of noise caused by vehicles traveling on the road is examined, an area within a predetermined range from the road is designated. Can do.
[0072]
If it is determined in step S60 that it is not particularly necessary to designate a region, the region designation process in step S61 is skipped. In this case, the synthesis mode is set in all regions (all spaces forming the virtual reality space).
[0073]
Next, the process proceeds to step S62, where a communication network based on the audio signal of the user terminal 3 corresponding to the character located in the designated area or all the spaces is connected to each other. In step S63, a conversation based on the audio signal is performed. Make it. This process is repeatedly executed until it is determined in step S64 that the mode is changed from the synthesis mode to the independent mode.
[0074]
In the synthesis mode, in the area where the synthesis mode is set, all the audio signals generated by the user terminals corresponding to the characters located in the area are synthesized and supplied to other user terminals. On the other hand, in the independent mode, a conversation is performed only between the user terminal that designates the character and the user terminal that corresponds to the designated character.
[0075]
However, such a conversation is impossible in a real space. That is, in an actual space, audio signals from surrounding characters are always input. In other words, a state in which an audio signal from such an unintended surrounding character is input is a more natural state. Therefore, in order to realize a more natural state, this synthesis mode is set.
[0076]
However, if all voice signals generated by characters located in a predetermined area are synthesized at the same level and supplied to each user terminal, it is difficult to substantially hear the voice signal at each user terminal. Become. Therefore, for each user terminal, a voice signal output by a character located far from the character centering on the corresponding character is synthesized such that it is attenuated as the distance increases. By doing so, it is possible to generate a sense of reality that is closer to the real space.
[0077]
The image provided in the virtual reality space is basically a highly accurate image generated by computer graphics. Therefore, by viewing this from all angles, it is possible to cause each user terminal to experience almost the same experience as in an actual space.
[0078]
In this virtual reality space, a large number of buildings, houses, rivers, and the like are appropriately arranged. And the problem in the city space can be grasped | ascertained by performing the process which moves the character corresponding to a some user terminal.
[0079]
【The invention's effect】
As described above, according to the simulation system of the present invention, the position of one's own character.When, Other characterspositionIn response toGenerate virtual space imageAs a result, the virtual reality space can be experienced in a state closer to the real space.. Also,It is possible to actually test and judge problems in the virtual reality space.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration example of a simulation system of the present invention.
FIG. 2 is a block diagram illustrating a configuration example of the simulation apparatus 1 of FIG.
FIG. 3 is a block diagram illustrating a configuration example of a user terminal 3 in FIG. 1;
4 is a diagram for explaining a virtual reality space formed by the simulation system of FIG. 1; FIG.
FIG. 5 is a diagram for explaining a field of view from a character C in FIG. 4;
6 is a diagram for explaining a field of view from a character D in FIG. 4;
FIG. 7 is a flowchart for explaining processing of the user terminal 3 of FIG. 1;
FIG. 8 is a flowchart for explaining processing of the simulation apparatus 1 of FIG. 1;
FIG. 9 is a flowchart illustrating conversation processing of the user terminal 3 of FIG.
10 is a flowchart for explaining conversation processing of the simulation apparatus 1 in FIG. 1;
[Explanation of symbols]
1 Simulation device
2 Database
3,3-1 to 3-N user terminal
21 CPU
22 ROM
23 RAM
24 Communication equipment
25 Display device
26 microphone
27 Speaker
28 interface
29 Input device
29a keyboard
29b mouse
29c Viewpoint input device
29d mobile input device
29e Overhead mode switch button
29f Overhead viewpoint input device
29g Composite mode switch button
29h area designation device
41 CPU
42 ROM
43 RAM
44 Communication equipment
45 Display device
46 microphone
47 Speaker
48 interface
49 Input device
49a keyboard
49b mouse
49c Viewpoint input device
49d mobile input device
49e Overhead mode switching button
49f Overhead viewpoint input device

Claims (14)

Storage means for storing image data forming a three-dimensional virtual space;
Supply means for supplying image data of the virtual space stored in the storage means;
A simulation system comprising: a plurality of receiving means connected to the supplying means for receiving the image data of the virtual space from the supplying means and generating a virtual space image;
The receiving means has a corresponding character in the virtual space, inputs the position of the character, transmits to the supply means,
The supply means reads out drawing information corresponding to an image from the viewpoint of the character at the position of the character or an image from an overhead viewpoint of the virtual space including the character from the storage means, and supplies the drawing information to the reception means And supplying the position data of the character supplied from the receiving means to the other receiving means,
The receiving means receives from the supply means the drawing information corresponding to the position of the character and the positions of the characters of the receiving means other than itself, and receives a virtual view from the viewpoint of the character at the position of the own character. A space image is generated, or a virtual space image from an overhead view including an image of one's character is generated using the drawing information, character position data other than oneself, and one's character position data. generated,
The supply means further comprises a setting means for setting a range for synthesizing a voice signal corresponding to the character in response to a user operation by designating an area in the virtual space,
The simulation system characterized in that the supply means synthesizes voice signals corresponding to the plurality of characters located within the range set by the setting means and supplies the synthesized voice signals to the reception means . At least one of the receiving means and the supplying means does not display its own character, but switches between a character mode in which a character other than itself is displayed and an overhead mode in which both the character other than itself and the own character are displayed. The simulation system according to claim 1, further comprising a switching unit. The simulation system according to claim 2, wherein at least one of the reception unit and the supply unit includes an overhead viewpoint input unit that inputs an overhead viewpoint in the overhead mode. Said supply means according to claim 1, characterized in that it comprises a combination mode for synthesizing a speech signal corresponding to a plurality of said characters, a selection means for selecting the independent mode for exchanging speech signals corresponding to a particular character The simulation system described in 1. The receiving means uses the image data provided from the supplying means and the position data of the character of another user terminal, and does not display a character corresponding to the user, but corresponds to a user terminal other than the self. The simulation system according to claim 1, wherein a virtual space image for displaying a character is generated. In a virtual space providing device that provides data forming a virtual space to a user terminal,
Storage means for storing data forming a virtual space;
Receiving means for receiving data corresponding to the position of the character in the virtual space corresponding to the user terminal from a plurality of the user terminals;
The drawing information corresponding to the received image from the viewpoint of the character at the position of the character corresponding to the user terminal or the image from the overhead view of the virtual space including the character is read from the storage means and transmitted to the user terminal. And transmitting means for transmitting the character position data received from the user terminal to another user terminal,
Synthesizing means for synthesizing audio signals corresponding to the characters received from a plurality of the user terminals;
Setting means for setting a range for synthesizing a voice signal corresponding to the character by designating a region in the virtual space ;
The synthesizing unit synthesizes audio signals of a plurality of the user terminals located within a range set by the setting unit,
The virtual space providing apparatus , wherein the transmission unit further transmits the synthesized audio signal to the user terminal . The synthesizing unit synthesizes a voice signal received from a user terminal corresponding to a character located at a position far from the character centered on a character corresponding to each user terminal so that the voice signal is attenuated as the distance increases. The virtual space providing device according to claim 6 . 7. The method according to claim 6 , further comprising selection means for selecting a mode for synthesizing and transmitting audio signals received from a plurality of user terminals and a mode for transmitting audio signals received from a specific user terminal. Virtual space providing device. In a virtual space providing method of a virtual space providing apparatus that provides data forming a virtual space to a user terminal,
A receiving step of receiving data corresponding to the position of the character in the virtual space corresponding to the user terminal from the plurality of user terminals;
A transmitting step of transmitting drawing information corresponding to an image from the viewpoint of the character at the position of the character corresponding to the received user terminal or an image from an overhead viewpoint of the virtual space including the character to the user terminal;
Transmitting the character position data received from the user terminal to another user terminal;
Setting a range for synthesizing an audio signal corresponding to the character by designating an area in the virtual space;
Synthesizing the audio signals received from a plurality of the user terminals located within the set range,
A method for providing a virtual space , further comprising transmitting the synthesized voice signal to the user terminal . The synthesizing step synthesizes the voice signal received from the user terminal corresponding to the character located at a position far from the character centered on the character corresponding to each user terminal so that the voice signal is attenuated as the distance increases. The virtual space providing method according to claim 9 . In a user terminal device that receives provision of data forming a virtual space from a simulation device,
Input means for inputting the position of the character in the virtual space corresponding to the self;
Transmitting means for transmitting data corresponding to the position of the character in the virtual space corresponding to the input self to the simulation device;
Receiving means for receiving the drawing information corresponding to the data corresponding to the position of the character corresponding to the transmitted self from the simulation device, and receiving the data of the character position of the other user terminal device;
Regarding the display mode of the image in the virtual space, either the character mode for displaying an image from the viewpoint of the character corresponding to the self or the overhead view mode for displaying an image from the overhead view of the virtual space including the character corresponding to the self Mode selection means for selecting
When the character mode is selected by the mode selection means, the character information at the character position in the virtual space corresponding to the self is used by using the drawing information and the character position data of another user terminal device. When a virtual space image from a viewpoint is generated and the overhead mode is selected by the mode selection means, the drawing information, the character position data of another user terminal device, and the own character position data And generating means for generating a virtual space image from a bird's eye view including an image of the own character,
The receiving means sets a range for synthesizing a voice signal corresponding to the character by designating an area in the virtual space, and a voice signal corresponding to a plurality of characters located within the set range Is synthesized, and the synthesized voice signal is received from the simulation device. The generation means uses the drawing information and the position data of the character of another user terminal device to display a character corresponding to a user terminal device other than the self without displaying the character corresponding to the self. The user terminal device according to claim 11 , wherein a spatial image is generated. The generation unit generates a virtual space image including a character corresponding to the self viewed from an overhead viewpoint using the drawing information and data of the position of the character of another user terminal device. The user terminal device according to 21. The user terminal apparatus according to claim 21, further comprising overhead mode switching means for switching between the character mode and the overhead mode.

Images