JP6714625B2 - Computer system - Google Patents

Description

The present invention relates to a computer system that enables multiple users to simultaneously experience the same event in a virtual space via a communication network such as the Internet.

In recent years, various systems have been developed that allow a plurality of users to simultaneously experience the same event in a virtual space via a communication network such as the Internet. For example, Patent Document 1 discloses a computer system in which a plurality of users can share the experience of playing a video game in a virtual space. In this system, characters (avatars) used by a plurality of users are arranged in a virtual space, the output of the video game machine is displayed on a television receiver in the virtual space, and each character plays the video game.

JP, 2016-202686, A

As an experience shared by multiple users in the same virtual space, in addition to collaborating with other users or competing with each other, it is also possible to view events such as sports performed in the virtual space with other users. To be When building a system that enables such an experience, in order to enhance the sense of realism when viewing an event, for example, cheering or applauding the athletes of the sport to be viewed, and responding to that user with sounds that correspond to their operations It is desirable to be able to put out the character to do. However, when the number of users who share the experience in the virtual space is large, there is a problem that the processing load of the computer increases if the sound is output one by one according to the operation of each user.

Therefore, it is an object of the present invention to provide a computer system capable of suppressing an increase in processing load on a computer while enhancing the realism of viewing an event performed in a virtual space.

In order to solve the above problems, a computer system according to the present invention includes a plurality of computers each having a display device for displaying a virtual space photographed by a virtual camera as a two-dimensional image and a sound output device for outputting a sound, and a server. And a communication unit for communicating between each of the plurality of computers and the server device, and a plurality of users corresponding to the plurality of computers viewing the respective display devices. Virtual space generation means for generating a virtual space in which an event is performed, and when the computer receives a predetermined operation input from the user, transmits an operation signal corresponding to the operation input from the computer to the server device. And a total number of the operation signals received by the server device from the plurality of computers within a fixed time, or a ratio of the total number of the operation signals to the number of the plurality of computers has reached a threshold value. And a first sound output unit that outputs a first sound corresponding to the operation signal from the sound output device when the total number or the ratio reaches a threshold value.

According to the computer system described above, the predetermined operation input to the computer by the user is reflected as the first sound corresponding to the operation input, so that it is possible to enhance the realism of viewing the event. Further, since the output of the first sound is limited when the total number of operation signals or the ratio of the operation signals to the event viewer reaches a threshold value, it is possible to suppress an increase in processing load on the computer.

In the above computer system, the sound output means may determine the volume of the first sound to be output according to the total number or the ratio when the total number or the ratio reaches a threshold value. .. According to this computer system, the volume of the first sound is determined according to the total number of operation signals or the ratio of the operation signals to the viewer. Therefore, for example, as the total number or ratio increases, the volume of the output sound gradually changes. Or it can be increased continuously to increase the reality of the experience in the virtual space.

In the above computer system, the plurality of computers include a first computer and a second computer, and the computer system includes a first character corresponding to a user who operates the first computer, and the second computer. Position management means for managing the position in the virtual space of the second character corresponding to the user who operates the second character, and the second character positioned within a predetermined range with the first character as a reference, and the second computer When the operation signal corresponding to the operation input accepted by the operation signal is transmitted from the second computer to the server device by the operation signal transmitting means, the operation signal corresponding to the operation signal is obtained regardless of the determination result by the determining means. Second sound output means for outputting a second sound from the sound output device of the first computer. According to this computer system, it is possible to express the phenomenon that the first character hears the sound from the second character located near the first character, and it is possible to further enhance the reality of the experience in the virtual space.

In the above computer system, the plurality of computers include a first computer and a second computer, and the computer system includes a first character corresponding to a user who operates the first computer, and the second computer. Position management means for managing the position in the virtual space of the second character corresponding to the user who operates the second character, and the second character positioned within a predetermined range with the first character as a reference, and the second computer When the operation signal corresponding to the operation input accepted by the operation signal is transmitted from the second computer to the server device by the operation signal transmitting means, the second character is controlled to perform an operation corresponding to the operation signal. And an operation control unit. According to this computer system, the second character located near the first character moves in response to the operation of the second user, so that the first user visually sees the reaction of the second user viewing the event. I can know. Therefore, it is possible to further enhance the realism of the event viewing.

Further, the virtual space generation means may arrange a display object in the virtual space in which a game to be performed as the event is displayed. According to this computer system, since a game can be watched through a display object such as a screen in the virtual space, it is possible for the user to experience watching a sports TV or watching an E-sports venue through the virtual space.

In addition, the virtual camera includes a left virtual camera and a right virtual camera arranged side by side in the left-right direction of the character, and the display device includes the left virtual camera and the left virtual camera so that a user can stereoscopically view the virtual space. It may be a head-mounted display that displays the virtual space captured by each of the right virtual cameras as a pair of virtual two-dimensional images having parallax with each other.

According to the present invention, it is possible to provide a computer system capable of suppressing an increase in the processing load of a computer while enhancing the realism of viewing an event performed in a virtual space.

It is a schematic diagram for explaining an outline of a computer system according to an embodiment of the present invention. It is a figure which shows an example of the screen displayed on a display device of a user side. It is a block diagram which shows the hardware constitutions of the computer system which concerns on one Embodiment. It is a block diagram which shows the functional structure of a computer apparatus and a server apparatus. 6 is a graph showing an example of the relationship between the ratio of the total number of operation signals received by the server device within a fixed time and the volume of output sound. FIG. 3 is a schematic plan view of a virtual space for explaining a near area. It is a figure showing an example of a character action based on neighborhood information. 6 is a flowchart showing the operation of the computer system from participation in viewing an event to the end of the event.

(Embodiment)
Hereinafter, a computer system according to an embodiment of the present invention will be described with reference to the drawings.

[System overview]
FIG. 1 is a schematic diagram for explaining the outline of a computer system 1 according to an embodiment of the present invention. The lower side of FIG. 1 shows a schematic configuration of a computer system 1 according to the present embodiment. As shown in FIG. 1, the computer system 1 includes a plurality of computer devices 2 that a plurality of users operate and inputs, and a server device 3 connected to the plurality of computer devices 2 via a communication network NW. There is. The computer system 1 enables a plurality of users to simultaneously view the same event performed in the virtual space S shared by them.

In this embodiment, as an event to be viewed in the virtual space S, a tournament in which a computer game is held as a competition, that is, a so-called E-sports tournament is described as an example. In the virtual space S, an E-Sports venue is created. A plan view of the inside of the venue in the virtual space S is schematically shown on the upper side of FIG. As shown in FIG. 1, at least one huge screen B1, a stage B2, and a spectator seat B3 are prepared in the venue in the virtual space S, and on the stage B2, players who participate in the competition. A character Q imitating is placed.

FIG. 2 shows an example of a screen displayed on the display unit 41 (see FIG. 3) of the computer device 2 on the user side. The screen shown in FIG. 2 is displayed from the viewpoint of the character P placed in the spectator seat B3. As shown in FIG. 2, a game screen played by the players who participated in the tournament is displayed on the screen B1. When each user accesses the server device 3 from the computer device 2, the character P corresponding to each user is placed in the auditorium B3 in the virtual space S. As shown in FIG. 2, the display unit 41 also displays a character P corresponding to another user placed in the auditorium B3.

As described above, in the computer system 1 according to the present embodiment, the user can watch the gameplay of the player through the screen B1 in the virtual space S together with other users from the viewpoint of the corresponding character P. .. In addition, in the present embodiment, a predetermined sound is output from the headphones 47 (see FIG. 3) included in the computer device 2 in response to an operation input to the computer device 2 by each user. Details of this will be described later.

[Hardware configuration]
FIG. 3 is a block diagram showing the hardware configuration of the computer system 1. The computer system 1 includes a computer device 2 and a server device 3, which are computers. The computer device 2 can communicate with another computer device 2 and the server device 3 via the communication network NW such as the Internet or LAN. The computer device 2 has a computer device main body 2a, an HMD 40 (corresponding to the "display device" of the present invention), a photodetecting device 46, headphones 47 (corresponding to the "sound output device" of the present invention), and a controller 48. The computer main body 2a includes a CPU 10, to which a disk drive 12, a memory card slot 13, a HDD 14 and a ROM 15 that form a storage unit (program storage unit), and a RAM 16 are connected to the CPU 10 via a bus 11.

A disk type recording medium 30 such as a DVD-ROM can be loaded in the disk drive 12. A program 30a and data 30b are recorded on the disc-type recording medium 30. The data 30b includes various data such as data necessary for forming a virtual space and sound data to be reproduced. A card type recording medium 31 can be loaded in the memory card slot 13.

The HDD 14 is a large-capacity recording medium built in the computer main body 2a, and records the program 30a and data 30b read from the disc-type recording medium 30. The ROM 15 is a semiconductor memory such as a mask ROM or PROM, and stores a boot program for booting the computer device 2, a program for controlling the operation when the disc-type recording medium 30 is loaded, and the like. The RAM 16 is composed of DRAM, SRAM, or the like, and reads the program 30a to be executed by the CPU 10 and the data 30b required at the time of execution from the disk-type recording medium 30 or the HDD 14 and temporarily records it.

Further, the CPU 10 is further provided with an HMD interface 17, a photodetector interface 18, a graphic processor 19, an audio synthesizer 20, an audio interface 21, a wireless communication controller 22, and a network interface 23 via the bus 11. It is connected. The HMD 40, the photodetecting device 46, and the headphones 47 are connected to the HMD interface 17, the photodetecting device interface 18, and the audio interface 21, respectively.

The HMD 40 can be mounted on the user's head. The HMD 40 includes a pair of display units 41 (41a, 41b), an acceleration sensor 42, a gyro sensor 43, a light emitting unit 44, and a control unit 45. By mounting the HMD 40 on the user's head, a left-eye display unit 41a and a right-eye display unit 41b are arranged in front of the user's left and right eyes, respectively.

The acceleration sensor 42 and the gyro sensor 43 form a motion detection system that detects motion of the user's head. The acceleration sensor 42 detects, for example, the direction of the HMD 40 with respect to the direction of gravity, that is, the inclination of the user's head. The gyro sensor 43 detects, for example, the angular velocity of the HMD 40, that is, the speed at which the user tilts or rotates the head. The motion information obtained from the acceleration sensor 42 and the gyro sensor 43 is sent to the graphic processing unit 19 and the audio synthesis unit 20 via the HMD interface 17.

The light emitting unit 44 of the HMD 40, together with the light detection device 46, constitutes a position detection system that detects the position of the user's head. In the present embodiment, the light emitting unit 44 is, for example, a plurality of LED lights provided on the HMD 40 so as to be separated from each other. The light detection device 46 is fixedly arranged in front of the user, for example, and detects the position of the light emitted from the light emission unit 44 of the HMD 40. The photodetector device 46 acquires the position information of the user's head with respect to the photodetector device 46 by detecting the position of the light emitted from the light emitting portion 44. This position information is used, for example, to correct the motion information described above. The position information obtained from the photodetector 46 is sent to the graphic processor 19 and the audio synthesizer 20 via the photodetector interface 18.

The position detection system that detects the position of the user's head is not limited to this. For example, an optical sensor may be provided on the HMD 40 side, and the light emitted from a light emitting device arranged around the user may be detected by this optical sensor to detect the position of the user's head.

The control unit 45 controls various devices included in the HMD 40, such as data transmission from the acceleration sensor 42 and the gyro sensor 43 to the computer apparatus body 2a and signal transmission to the light emitting unit 44.

The graphic processing unit 19 draws an image including a three-dimensional virtual space according to an instruction from the CPU 10. For example, the graphic processing unit 19 generates a pair of virtual two-dimensional images having parallax with each other so that the user can stereoscopically view the three-dimensional virtual space. That is, the graphic processing unit 19 generates virtual two-dimensional images for the left eye and the right eye that have parallax with each other and are captured by each of a pair of virtual cameras arranged in the virtual three-dimensional space. Then, the pair of virtual two-dimensional images are converted into a moving image format, sent to the HMD 40 via the HMD interface 17, and displayed on the pair of display units 41a and 41b. Further, the graphic processing unit 19 changes the orientation of the virtual camera and the like in accordance with the above-described motion information and position information so as to give the user a sense of realism as if he or she entered the virtual space.

The audio synthesizer 20 reproduces and synthesizes digital-format sound data included in the data 30b according to an instruction from the CPU 10. The sound data reproduced and synthesized by the audio synthesizing unit 20 is decoded into an analog format, and then sent to the headphones 47 via the audio interface 21 and output. As a result, the user can hear the reproduced sound. The headphones 47 may be configured integrally with the HMD 40. Further, the audio synthesis unit 20 outputs the sound from the headphones 47 in real time in accordance with the motion information and the position information sent from the HMD 40 and the photodetection device 46 so as to give the user a sense of presence as if he/she entered the virtual space. You may change the sound.

The wireless communication control unit 22 has a 2.4 GHz band wireless communication module, is wirelessly connected to the controller 48, and is capable of transmitting and receiving data. The user can input a signal to the computer device 2 by operating an operation unit such as a button provided on the controller 48.

The network interface 23 connects the computer device 2 to a communication network NW such as the Internet or LAN, and can communicate with another computer device 2 or the server device 3.

On the other hand, the server device 3 includes a high-performance CPU 50 that controls the operation of the server device 3, and the CPU 50 is connected to a HDD 52, a ROM 53, a RAM 54, and a network interface 55 via a high-speed bus 51.

The HDD 52 is a large-capacity recording medium built in the server device 3 and records programs 52a and data 52b different from those included in the computer device 2 described above. The ROM 53 is a semiconductor memory such as a mask ROM or a PROM, and has a basic program for realizing a basic operation of the server device 3 such as a program for controlling communication between the server device 3 and another computer device 2. It is recorded. The RAM 54 is composed of DRAM or SRAM, and reads the program 52a to be executed by the CPU 50 and the data 52b necessary for the execution from the HDD 52 or the like and temporarily stores it.

The network interface 55 connects the server device 3 to a communication network NW such as the Internet or a LAN, and can communicate with the computer device 2 in a client-server system.

[Functional configuration of computer device and server device]
FIG. 4 is a block diagram showing the functional configurations of the computer device 2 and the server device 3 included in the computer system 1.

First, the functional configuration of the server device 3 will be described. The server device 3 functions as the communication unit 61, the position management unit 62, the event information transmission unit 63, the counting unit 64, the determination unit 65, and the proximity information transmission unit 66 by executing the predetermined program 52a. It should be noted that each of these functions is configured by a CPU 50, an HDD 52, a ROM 53, a RAM 54, and the like shown in FIG.

The communication means 61 communicates with each of the plurality of computer devices 2 via the communication network NW.

The position management means 62 manages the position of the character P corresponding to each of the plurality of users who participate in the event as spectators. In the present embodiment, when the user accesses the server device 3 from the computer device 2 and participates as a spectator of an event performed in the virtual space S, the user uses the vacant seat of the spectator seat B3 on the computer device 2. From the inside, it is possible to select a seat in which the character P corresponding to the user is arranged. When the seat is selected by the user, the position management unit 62 stores the user information and the seat information of the character P corresponding to the user in association with each other. As a result, the selected seat is assigned to the user who has selected the seat.

The event information transmitting means 63 transmits various kinds of information (hereinafter, also referred to as “event information”) regarding an event executed in the virtual space S to the computer device 2 in a timely manner. The event information sent to the computer device 2 includes, for example, seat information of the character P corresponding to another user who inputs an operation to the other computer device 2, information necessary for the progress of the event, and objects arranged in the virtual space S. And information on non-player characters such as the above-mentioned character Q, information on event production and decoration in the virtual space, and the like.

In addition, in the present embodiment, the event information transmission means 63 causes the computer device 2 of each user to display, as event information, a video for viewing (that is, a player who participates in E-sports) on the screen B1 in the virtual space S. Send the information of the video of the game play screen to play). It should be noted that the information of the viewing video may include, for example, moving image data such as a game play screen, or a player who has participated in E-sports to generate a game play screen on the computer device 2 side. Operation information may be included. There may be a plurality of viewing videos sent to the computer device 2. In this case, the viewing video may include, in addition to the video of the game screen played by the player, a video showing the player's face, a video showing the player's eyes, a video showing the player's operation on the controller 48, and the like. ..

The counting means 64 counts the total number of operation signals, which will be described later, received by the server device 3 from the plurality of computer devices 2 within a fixed time (for example, one second). As will be described later, in the present embodiment, the operation signal includes the first operation signal and the second operation signal of different types, and the counting means 64 counts the total number by distinguishing according to the type of the operation signal.

The determination means 65 determines whether or not the ratio X of the total number of operation signals counted by the counting means 64 to the number of spectators at the event has reached the threshold value. Since the counting means 64 obtains the total number of received operation signals at a constant time interval, the determining means 65 determines at a constant time interval whether or not the ratio X has reached the threshold value. The number of spectators at the event is the number of computer devices 2 that communicate with the server device 3 to view the event, in other words, the number of users corresponding to the character P whose position is managed by the position management means 62. The determination result by the determination means 65 is used by the first sound output means 75, which will be described later, on the computer device 2 side.

The proximity information transmitting means 66 indicates to each computer device 2 that information indicating that an operation signal has been received from another user corresponding to the character P located in the vicinity of the character P corresponding to the computer device 2 (hereinafter, "nearby"). (Also referred to as "information"). The proximity information transmission means 66 will be described together with the second sound output means 76 and the operation control means 77 described later.

Next, the functional configuration of the computer device 2 will be described. The computer device 2 executes the predetermined program 30a to thereby perform communication means 71, virtual space generation means 72, image generation unit 73, operation signal transmission means 74, first sound output means 75, second sound output means 76, And functions as the operation control unit 77. It should be noted that each of these functions is composed of a CPU 10, an HDD 14, a ROM 15, a RAM 16, a graphic processing unit 19, an audio synthesizing unit 20, a wireless communication control unit 22 and the like shown in FIG. 3 in terms of hardware.

The communication means 71 communicates with the server device 3 via the communication network NW.

The virtual space generation means 72 generates a three-dimensional virtual space S in which an event to be viewed is performed. In the present embodiment, as described above, the event to be viewed is an E-sports competition, and the generated virtual space S includes the huge screen B1, the stage B2, and the spectator seat B3. On the screen B1 in the virtual space S, the viewing video (that is, the video of the game screen played by the player who participated in the E-sports) sent from the event information sending means 63 is displayed.

A character Q imitating a player is arranged on the stage B2. Further, in the spectator seat B3, a character P corresponding to the user is arranged and also a character P corresponding to another user is arranged. The character P corresponding to the computer device 2 operated and inputted by the user is a player character that operates in response to the operation input by the user. Other characters in the virtual space S (the character P corresponding to another user and the player character Q on the stage) are non-player characters whose movements are controlled by the CPU 10. The character P corresponding to the other user is arranged based on the seat information of the character P corresponding to the other user, which is sent by the event information transmitting means 63 described above.

The image generator 73 generates a two-dimensional image to be displayed on the HMD 40. Specifically, at the position (seat) where the character P corresponding to the user is arranged, a pair of virtual cameras are arranged side by side in the left-right direction of the character P. The image generation unit 73 generates images captured by the pair of virtual cameras as virtual two-dimensional images to be displayed on the pair of display units 41a and 41b. The positions and orientations of the pair of virtual cameras are changed based on the motion information obtained from the acceleration sensor 42 and the gyro sensor 43 and the position information obtained from the photodetector 46.

When the controller 48 receives a predetermined operation from the user viewing the event via the HMD 40, the operation signal transmitting unit 74 transmits an operation signal corresponding to the operation to the server device 3. Specifically, in the present embodiment, as the operation of the controller 48 performed by the user, two kinds of operations (first operation and second operation) for expressing the emotion held by viewing the event are prepared. There is.

For example, when the user has a positive emotion such as joy or joy by watching the event, for example, when a great match is played in the viewing match, the player who is cheering wins, etc. On the other hand, the first operation is performed (for example, the first button provided on the controller 48 is pressed). In addition, when the user feels negative emotions such as dissatisfaction or sadness by viewing the event, such as when the supporting player loses, the user performs the second operation on the controller 48 (for example, the controller). Press the second button on the 48).

As described above, the operation signal transmitting unit 74 transmits the first operation signal corresponding to the first operation to the server device 3 when the first operation is performed on the controller 48, and the controller 48 transmits the first operation signal to the controller 48. When the second operation is performed, the second operation signal corresponding to the second operation is transmitted to the server device 3. As described above, the counting means 64 distinguishably counts the first operation signal and the second operation signal transmitted from each computer device 2 to the server device 3.

The first sound output means 75 is for outputting a sound indicating that a certain percentage or more of users viewing an event have the same emotion. The first sound output means 75 outputs the first sound corresponding to the operation signal from the headphones 47 when the determination means 65 determines that the ratio X has reached the threshold value.

The sound data for outputting the first sound is included in the data 30b of the disc-type recording medium 30, for example. The first sound corresponding to the first operation signal corresponds to the first operation when the user has a positive emotion, and is, for example, a cheering sound by a large number of people called “Waah” or a large number of applause sounds that echo in the hall. is there. The first sound corresponding to the second operation signal corresponds to the second operation when the user has a negative emotion, for example, a voice or a large number of people who say "Aa" by expressing a disappointment. "Boo" performed by and boos emitted. The first sound corresponding to each operation signal is output, for example, as a sound coming from all directions of the character P corresponding to the user so as to be heard from the entire hall.

Further, when the ratio X reaches the threshold value, the first sound output means 75 outputs the sound volume according to the ratio X such that the volume of the first sound gradually increases as the ratio X increases. To decide. FIG. 5 shows an example of the relationship between the ratio X of the total number of operation signals received by the server device 3 within a fixed time and the volume V of the sound output from the headphones 47. In the example shown in FIG. 5, the threshold value used for the determination by the determination means 65 is set to 20%, and when the ratio X is lower than 20%, the volume V is zero. As shown in FIG. 5, when the ratio X is 20% or more, which is the threshold value, the volume increases stepwise as the ratio X increases. The first sound output means 75 does not have to increase the volume stepwise, and may increase the volume continuously and gradually, for example.

The second sound output means 76 is for outputting a sound produced by a character of another user in the vicinity of the character corresponding to the computer device 2. The second sound output means 76 outputs the second sound corresponding to the proximity information from the headphones 47 of the computer device 2 when the proximity information is received from the proximity information transmission means 66 of the server device 3 described above.

The sound data for outputting the second sound is included in the data 30b of the disc-type recording medium 30, for example. The second sound corresponding to the first operation signal corresponds to the first operation when the user has a positive emotion, and the character P of another user, for example, a joyous voice or a clapping sound such as "wa". And so on. The second sound corresponding to the second operation signal corresponds to the second operation when the user has a negative emotion, for example, a voice expressing "disappointment" and uttering "Aa" or a boo boo. is there. The second sound corresponding to each operation signal is output as a sound coming from the character P corresponding to another user who has sent the operation signal.

A case in which the second sound is output to the headphones 47 of the computer device (first computer device) 2 of a certain user (first user) will be described with reference to FIG. FIG. 6 is a schematic plan view of the virtual space S, and shows a character P (first character P1) corresponding to the first user and a predetermined neighborhood area D based on the first character P1. In the present embodiment, the neighborhood area D is preset for each seat of the spectator seat B3 in which the first character P1 is arranged. For example, in the illustrated example, a range within the number of rows (for example, two rows) set in advance in both the front-rear direction and the left-right direction from the seat in which the first character P1 is arranged is set as the neighboring area D.

The proximity information transmitting means 66 of the server device 3 includes a character P (second character P2) located in the vicinity region D of the seat where the first character P1 corresponding to the first user is disposed, and a computer device (the second character P2) for operating the character P (second character P2). The second computer device) 2 is specified. Then, when the server device 3 receives the operation signal from the second computer device 2, the proximity information transmitting means 66 transmits the proximity information indicating this to the first computer device 2.

The proximity information includes the type information of the operation signal sent from the second computer device 2 of the second user and the information on the position (for example, seat) of the second character P2. The second sound output means 76 outputs the second sound corresponding to the proximity information from the headphones 47 of the computer device 2 when the proximity information is received from the proximity information transmission means 66. The second sound is output as a sound coming from the second character P2 to the first character P1.

In addition, when the motion control means 77 receives the proximity information from the proximity information transmission means 66, it controls the second character P2 to perform a motion corresponding to the proximity information. More specifically, when the motion control means 77 receives the proximity information from the proximity information transmission means 66, the motion control means 77 controls the second character P2 to perform a motion corresponding to the type information of the operation signal included in the proximity information.

FIG. 7A shows the movement of the second character P2 corresponding to the first operation signal. The motion of the second character P2 corresponding to the first operation signal shows how the second character P2 rejoices. FIG. 7B shows the motion of the second character P2 corresponding to the second operation signal. The motion of the second character P2 corresponding to the second operation signal shows how the second character P2 is discouraged. In this way, the motion control means 77 reflects the operation signal from the other user in the motion of the character of the other user (that is, the above-mentioned second character P2) that easily enters the field of view.

[Processing flow of computer system]
Next, a flow of each operation executed in the computer system 1 described above will be described. FIG. 8 is a flowchart schematically showing the operation of the computer system from the time when the computer apparatus 2 accesses the server apparatus 3 to participate in the viewing of the event until the event ends.

As shown in FIG. 8, when the user accesses the server device 3 from the computer device 2 and selects a seat for viewing the event, seat selection information is transmitted from the computer device 2 to the server device 3 (step S101).

When the server device 3 receives the seat selection information, the position management unit 62 stores the user information and the seat information in association with each other (step S201), and the event information transmission unit 63 stores the event including the seat information of other users. The information is transmitted to the computer device 2 (step S202).

When the computer device 2 receives the event information, the virtual space generation means 72 arranges the character in the audience seat based on the seat information (including the seat information of another user) included in the event information, and the image generation unit 73 , Generate an image of the virtual space S (step S102). Thus, the image showing the virtual space S viewed from the selected seat is displayed on the display unit 41 of the computer device 2.

When it is the start time and the event is started (step S203), the event information transmission means 63 sends the information of the viewing video to be displayed on the screen B1 in the virtual space S to the computer device 2 of each user. Even before the event starts, the event information transmitting unit 63 may transmit, to the computer device 2 of each user, a video for exciting the event (for example, a video introducing a player) as a video to be displayed on the screen B1. Good.

Further, when the event starts, when the user performs a predetermined operation on the controller 48 in order to express the emotion held by viewing the event, an operation signal corresponding to the operation is transmitted to the server device 3. (Step S103). Note that the position of step S103 in the flow shown in FIG. 8 is an example, and during the event, the operation of the controller 48 for sending the operation signal is appropriately performed by the user.

During the event, the first sound output processing (steps S204, S205, S206, S104) is performed by the counting means 64, the judging means 65, and the first sound outputting means 75. In the first sound output process, the counting unit 64 counts the total number of operation signals received from the plurality of computer devices 2 at regular time intervals (step S204). Then, the determination means 65 determines whether or not the ratio X of the total number of counts to the number of spectators of the event has reached a threshold value at regular time intervals (step S205).

If the ratio X has not reached the threshold value (step S205: NO), the first sound output instruction is not sent from the server device 3 to each computer device 2, and the ratio X has reached the threshold value (step S205: YES). A first sound output instruction is sent from the server device 3 to each computer device 2 (step S206). When the computer device 2 receives the first sound output instruction, the first sound output means 75 outputs the first sound corresponding to the operation signal from the headphones 47 (step S104).

Further, during the event, the second sound output process (steps S207, S208, S105) is performed by the proximity information transmitting means 66 and the second sound output means 76. In the second sound output process, the proximity information transmitting means 66 determines whether or not an operation signal has been received from the computer device 2 of another user who operates the character located in the proximity area D (step S207), and the operation signal While not receiving (step S207: NO), no particular operation is performed. The proximity information transmitting means 66 sends the proximity information to each computer device 2 when receiving an operation signal from the computer device 2 of another user who operates the character located in the proximity area D (step S207: YES). Step S208).

When the computer device 2 receives the proximity information, the second sound output means 76 outputs the second sound corresponding to the proximity information from the headphones 47 of the computer device 2 (step S105). Further, based on the proximity information received by the computer device 2, the motion control means 77 controls the second character to perform a motion corresponding to the proximity information (step S106).

The first sound output processing and the second sound output processing are repeated until the event ends (step S209: NO), and the first sound output processing and the second sound output due to the end of the event (step S209: YES). The process also ends.

As described above, according to the computer system 1 according to the present embodiment, since the user's operation on the controller 48 is reflected as the first sound corresponding to the operation, it is possible to enhance the realism of viewing the event. You can Further, since the output of the first sound is limited when the ratio X of the total number of operation signals to the number of spectators of the event reaches the threshold value, it is possible to suppress an increase in the processing load of the computer device 2.

Further, according to the computer system 1 of the present embodiment, when the ratio X reaches the threshold value, the volume of the first sound gradually increases as the ratio X increases, so that the reality of the experience in the virtual space is increased. It can be increased.

Further, according to the computer system 1 of the present embodiment, when the second sound output means 76 receives the proximity information from the proximity information transmission means 66, the second sound corresponding to the proximity information is output to the headphones 47 of the computer device 2. Since it is output from, it is possible to express the phenomenon that the sound from the character of another user located nearby is heard. As a result, the reality of the experience in the virtual space can be further enhanced.

Further, according to the computer system 1 of the present embodiment, the motion control means 77 moves the character of another user located near the character according to the operation of the other user, so that the user views the event. It is possible to visually know the reaction of other users who do. Therefore, it is possible to further enhance the realism of the event viewing.

To summarize the above, the present invention includes a plurality of computer devices 2 each having an HMD 40 (display device) for displaying a virtual space photographed by a virtual camera as a two-dimensional image and a headphone 47 (sound output device) for outputting a sound, A computer system (1) comprising a server device (3), the communication means (71) for communicating between each of the plurality of computer devices (2) and the server device (3), and the plurality of computer devices (2) via each of the HMDs (40). A virtual space generating means 72 for generating a virtual space S in which an event to be viewed by a plurality of users is performed; and when the computer device 2 receives a predetermined operation input by the user, the operation input is supported. An operation signal transmitting means 74 for transmitting an operation signal from the computer device 2 to the server device 3, and the plurality of operation signals transmitted by the server device 3 from the plurality of computer devices 2 within a predetermined time. When the ratio X to the number of computer devices 2 has reached a threshold value, a determination means 65 is provided, and when the ratio X reaches the threshold value, the headphone 47 outputs a first sound corresponding to the operation signal. And a first sound output means 75 for outputting.

(Other embodiments)
The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

For example, in the above-described embodiment, the HMD 40 and the headphones 47 are shown as the display device that displays the virtual space S as a two-dimensional image and the sound output device that outputs the sound, respectively. The output device is not limited to this. For example, the sound output device may be a speaker. Further, for example, the display device may be a display such as a television monitor having one display unit. Further, for example, the operation device for inputting operation to the computer device 2 may not be the controller 48, but may be a mouse or a keyboard.

The respective functions of the server device 3 and the computer device 2 are not limited to the examples described in the above embodiment. For example, the computer device 2 receives information about the number of spectators at the event and the total number of operation signals received by the server device 3 within a certain time from the server device 3 at any time, so that the computer device 2 functions as the determination unit 65. You may.

Further, instead of the computer device 2, the server device 3 may function as the virtual space generating means 72 and the image generating unit 73. In this case, each computer device 2 transmits the motion information obtained from the acceleration sensor 42 and the gyro sensor 43 and the position information obtained from the light detection device 46 to the server device 3. The server device 3 changes the position and orientation of the virtual camera corresponding to each computer device 2 on the basis of the received information, and the images taken by the virtual camera, which are the images obtained by synthesizing the viewing image on the screen B1, are displayed. It may be sent to the computer device 2.

Further, in the above embodiment, the determination means 65 determines whether or not the ratio X has reached the threshold value, but the mode of the determination means 65 is not limited to this. For example, the determining unit 65 determines whether or not the total number of operation signals counted by the counting unit 64 (that is, the total number of operation signals received by the server device 3 within a certain period of time) has reached the threshold value instead of the ratio X. You may judge whether.

Further, in the above embodiment, the neighborhood area D is set for the spectator seat B3, but the present invention is not limited to this. The proximity area D may be set in a predetermined range based on the character P operated by the user, and for example, a range within a predetermined distance from the character P operated by the user may be set as the proximity area D. Further, the character P corresponding to the user may be movable in the virtual space S.

Further, the range of the neighboring area D is not limited to the example shown in FIG. 6 and can be changed as appropriate. Further, in the above-described embodiment, the second sound output means 76 and the motion control means 77 respectively output the second sound and the other sounds based on the operation signal from another user related to the character located in the same neighborhood area D. However, the present invention is not limited to this. In other words, the second sound output means 76 and the operation control means 77 may be different in other target users. For example, the motion control means 77 is a computer device corresponding to a character of another user (for example, a character of another user who is in the field of view of the operated character) located in a predetermined range extending in front of the character P corresponding to the user. When an operation signal is transmitted from 2 to the server device 3, another user's character may be controlled to perform an action corresponding to the operation signal. This makes it possible to reflect the operation signal from the other user in the character's motion for the character of the other user who is more likely to come into the field of view.

Further, in the above-described embodiment, the event of the E-sports is illustrated as the event performed in the virtual space S, but the event to be viewed is not limited to this. For example, the event may be watching sports performed in the real world, and in this case, an image of sports being performed in the real world may be displayed on the screen B1 in the virtual space S. For example, the event is not limited to watching sports, and may be viewing such as a concert. In this case, the viewing video projected on the screen B1 may not be necessary. For example, a character that imitates a performer or an idol operating on the stage B2 in the virtual space S may be viewed.

Further, the first sound and the second sound corresponding to each operation signal may be the same sound or may be different sounds.

Although two types of operation signals are shown in the above embodiment, the number of types of operation signals may be one, or may be three or more. Also, a plurality of first sounds may be prepared for each type of operation signal. In this case, the first sound output means 75 may randomly select one first sound from a plurality of first sounds corresponding to a certain operation signal (for example, the first operation signal). In addition, similarly, a plurality of second sounds and motions of the character corresponding to each operation signal may be prepared. In this case, the second sound output means 76 may randomly select one second sound from a plurality of second sounds corresponding to a certain operation signal, and the motion control means 77 may cause a certain operation signal to be selected. One motion may be randomly selected from the plurality of character motions corresponding to.

Even when these other embodiments are adopted, the effects of the present invention are exhibited. It is also possible to appropriately combine this embodiment with other embodiments, and other embodiments.

1: Computer system
2: Computer equipment (computer)
3: Server device
40: HMD (display device)
48: Controller (operating device)
61: Communication means
62: Position management means
65: Judgment means
71: Communication method
72: means for generating virtual space
74: Operation signal transmission means
75: First sound output means
76: Second sound output means
77: Motion control means
NW: Communication network
P: Character
S: Virtual space
B1: Screen (display object)

Claims (3)

A computer system comprising a plurality of computers each having a display device for displaying a virtual space photographed by a virtual camera as a two-dimensional image and a sound output device for outputting a sound, and a server device,
Communication means for communicating between each of the plurality of computers and the server device;
Virtual space generation means for generating a virtual space in which an event viewed by a plurality of users corresponding to the plurality of computers is performed via each of the display devices;
When the computer receives a predetermined operation input by the user, an operation signal transmitting unit that transmits an operation signal corresponding to the operation input from the computer to the server device,
Determination of whether or not the total number of the operation signals received by the server device from the plurality of computers within a certain period of time, or the ratio of the total number of the operation signals to the number of the plurality of computers has reached a threshold value Means and
First sound output means for outputting a first sound corresponding to the operation signal from the sound output device when the total number or the ratio reaches a threshold value,
In the virtual space, a display object in which a game performed as the event is displayed as a viewing video and a character corresponding to each user are arranged.
The plurality of computers includes a first computer and a second computer,
Position managing means for managing the positions in the virtual space of the first character corresponding to the user operating the first computer and the second character corresponding to the user operating the second computer,
The second character is located within a predetermined range based on the first character, and an operation signal corresponding to the operation input received by the second computer is transmitted from the second computer to the server by the operation signal transmitting means. Second sound output means for outputting a second sound corresponding to the operation signal from the sound output device of the first computer when the sound is transmitted to the device, regardless of the determination result by the determination means. ,
The first sound is output as a sound coming from all directions of the first character,
It said second sound is output as sound coming from the second character, computer system. The plurality of computers includes a first computer and a second computer,
Position managing means for managing the positions in the virtual space of the first character corresponding to the user operating the first computer and the second character corresponding to the user operating the second computer,
The second character is located within a predetermined range based on the first character, and an operation signal corresponding to the operation input received by the second computer is transmitted from the second computer to the server by the operation signal transmitting means. The computer system according to claim 1, further comprising a motion control unit that controls the second character to perform a motion corresponding to the operation signal when the motion signal is transmitted to the device. The virtual camera includes a left virtual camera and a right virtual camera arranged side by side in the left-right direction of the character,
The display device is a head mount that displays the virtual space captured by each of the left virtual camera and the right virtual camera as a pair of virtual two-dimensional images having a parallax with each other so that a user can stereoscopically view the virtual space. a display, according to claim 1 or 2 computer system.

Images