JP2024027196A - System, computer program and remote supporting system - Google Patents

Abstract

To provide a system and a computer program which allow an avatar of a user to participate in an event site of an event such as a sport or concert and give a user who is not in the site with feeling as if the user went to the site.SOLUTION: There is provided a system which executes the following steps. In the setting step, a user is associated with at least one of a plurality of supporting devices which is installed in an event site where an event in the actual world is held. In the output step, an output unit connected to the supporting device outputs a supporting image and/or supporting sound.SELECTED DRAWING: Figure 4

Description

The present invention relates to a system, a computer program, and a remote support system.

In recent years, for events held in the real world (such as baseball games), services have been provided that display videos of support solicited from users (spectators, spectators, etc.) who are unable to visit the event venue at the event venue. (For example, see Non-Patent Document 1).

In addition, there are services that display images of users cheering at the event venue based on the photos of users who are unable to visit the event venue (for example, (See Patent Document 2).

“First opening without spectators, various ideas”, [online], June 18, 2020, Kyodo News, [searched on June 8, 2021], Internet <https://nordot .app/646271106881995873?c=39546741839462401> ““Virtual Back Net Back Sheet” Recruiting Photos to Support”, [online], June 9, 2020, Yomiuri Giants Official Website, [Searched on June 8, 2021], Internet <https: //www.giants.jp/G/gnews/news_3914957.html>

However, with the above-mentioned service that displays cheering videos and the like at the venue, it is difficult to give users the experience of actually visiting the event venue and participating in (cheering for) the event.

An object of the present invention is to provide a system and a computer program that allow a user's alter ego to participate in an event venue for an event such as a sports event or a concert, thereby giving a user who is not present at the venue the feeling of being there. .

The first invention is
A system that executes each of the following steps,
In the setting step, the user is associated with at least one of the plurality of support devices,
The support device is installed at an event venue where a real-world event is held,
In the output step, outputting a cheering image and/or a cheering voice to an output unit connected to the cheering device;
It is a system.

Also,
Attributes are set in the support device,
The consideration required for associating the user with the support device varies depending on the attribute;
be able to.

Also,
The support device is installed in a seat at the event venue.
be able to.

Also,
The event venue is a venue for sports,
The support device is installed in at least one of a vehicle used for transportation by the players participating in the event, a bench where the players are seated, a locker room used by the players, and a field where the players play.
be able to.

Also,
The event venue is a venue where a performance is held,
The support device is installed on a stage where the performance is performed and/or in a waiting room of performers participating in the performance.
be able to.

Also,
Furthermore, a system that executes each of the following steps,
in the image input step, setting an image and/or text based on user operations;
In the output step, displaying an image and/or text set by the user on a display unit included in the support device;
be able to.

Also,
There are multiple types of the image and/or the text,
By the user consuming consideration, the user can set the type of the image and/or the text;
be able to.

Also,
Furthermore, a system that executes each of the following steps,
in the voice input step, setting or inputting voice based on the user's operation;
in the output step, causing a speaker included in the support device to output the audio set or input by the user;
be able to.

Also,
There are a plurality of types of audio, and the user can set the type of audio by consuming a fee.
be able to.

Also,
Furthermore, a system that performs the following steps,
In the photographing step, transmitting an image photographed by a camera included in the support device to the user's terminal device;
be able to.

Also,
Furthermore, a system that performs the following steps,
In the matching step,
matching the users associated with the support device having attributes included in a predetermined condition, and
carrying out a chat or conversation between the matched users;
be able to.

Also,
In the matching step,
matching a plurality of users to one user, and changing the audio of the conversation between the matched users based on the attributes of the device;
be able to.

The second invention is
A system that executes each of the following steps,
In the setting step, the user is associated with at least one of the plurality of support devices,
The support device is a device managed by the user, and is installed at an event venue where a real-world event is held by transportation,
In the output step, outputting a cheering image and/or a cheering voice to an output unit connected to the cheering device;
It is a system.

The third invention is
A computer program that causes a computer to perform each of the following steps,
In the setting step, the user is associated with at least one of the plurality of support devices,
The support device is installed at an event venue where a real-world event is held,
In the output step, outputting a cheering image and/or a cheering voice to an output unit connected to the cheering device;
It is a computer program.

The fourth invention is a computer program that causes a computer to execute each of the following steps,
In the setting step, the user is associated with at least one of the plurality of support devices,
The support device is a device managed by the user, and is installed at an event venue where a real-world event is held by transportation,
In the output step, outputting a cheering image and/or a cheering voice to an output unit connected to the cheering device;
It is a computer program.

The fifth invention is
A remote support system that executes each of the following steps,
In the setting step, the user is associated with at least one of the plurality of support devices,
The support device is installed at an event venue where a real-world event is held,
In the output step, outputting a cheering image and/or a cheering voice to an output unit connected to the cheering device;
It is a remote support system.

According to the present invention, it is possible to provide a system and a computer program that allow a user's alter ego to participate in an event venue for an event such as a sports event or a concert, thereby giving a user who is not present at the venue the feeling of being there. .

FIG. 1 is a diagram showing the configuration of a system in a first embodiment. FIG. 2 is a diagram showing the configuration of a user terminal device included in the system in the first embodiment. It is a diagram showing the configuration of an operation terminal device included in the system in the first embodiment. FIG. 2 is an external view showing a schematic configuration of an avatar device included in the system in the first embodiment. It is a diagram showing the configuration of an avatar device included in the system in the first embodiment. FIG. 2 is a diagram illustrating an example of a display of a user terminal device of an application executed in the system in the first embodiment. FIG. 2 is a diagram illustrating an example of a display of a user terminal device of an application executed in the system in the first embodiment. FIG. 2 is a diagram illustrating an example of a display of a user terminal device of an application executed in the system in the first embodiment. FIG. 2 is a diagram illustrating an example of a display of a user terminal device of an application executed in the system in the first embodiment. FIG. 2 is a diagram illustrating an example of a display of a user terminal device of an application executed in the system in the first embodiment. It is a figure showing an example of a schedule table in a 1st embodiment. It is a figure showing an example of user data in a 1st embodiment. It is a flowchart which shows support execution processing in a 1st embodiment. FIG. 2 is a diagram showing the configuration of a system in a second embodiment. FIG. 7 is a diagram showing the configuration of a support device (display device) included in the system in a third embodiment.

[First embodiment]
A system 1 according to an embodiment of the present invention will be described with reference to FIGS. 1 to 13. Note that the system 1 and the processing procedure described below are merely examples, and the embodiments of the present invention are not limited thereto. The design of the system 1 and the processing procedure can be changed as appropriate without changing the gist of the present invention.

<System description>
The system 1 of this embodiment includes an application server device 2, a user terminal device 3, a management server device 4, an operation terminal device 5, and a support device 6 shown in FIGS. 1 to 4.

By the cooperation of these devices (transmission and reception of data by each device), the user can have his/her alter ego participate in the event venue where the event is being held. Note that in this specification, "participation" means having the user or the support device 6 present at the event venue for the purpose of viewing (spectating) the event, cheering, etc. Further, the support device 6 is a device that is set as a user's alter ego.

Note that the support device 6 includes, for example, an avatar device (robot-type device) configured to be movable, which will be mainly explained below, and a stationary device configured to be immovable (for example, fixed to a pole, etc.). There are two types of devices: a device with a camera attached to the camera, and a device with a camera embedded in a home base, etc. In the following, the avatar device and the stationary device are referred to as the support device 6 without distinction, but expressions such as avatar device may be used as necessary.

Events include various events, entertainments, performances, etc., such as sports tournaments and matches. In this embodiment, a professional baseball game between team A (name: A-OSAKA) and team B (name: B-TOKYO) will be described as an example of an event. A baseball game is held in a stadium (event venue) in real space.

A cheering device 6 shown in FIGS. 4 and 5 is installed in the seats (spectator seats) of the stadium. The user can have the installed support device 6 participate in the event as his/her alter ego. Specifically, the user can virtually watch (cheer) a professional baseball game held at a stadium via the support device 6 associated with the user terminal device 3 shown in FIG.

The user uses the user terminal device 3 to view live video and audio of the match (stadium), view video and audio captured by the cheering device 6 (viewing video and viewing audio), and send cheering video and cheers to the cheering device 6. It can be output.

The designated image 70 (see FIGS. 6 to 8), the viewed image 80 (see FIGS. 9 and 10), etc. are displayed on the display 320 of the user terminal device 3 by executing the application (application program). . Note that a touch pad 340 is arranged on the top surface of the display 320 to receive touch input from the user.

By pressing a predetermined button (by operating the touchpad), the user can attach himself or herself to the cheering equipment 6 of any stadium (match) (the cheering equipment 6 placed in any area, such as behind the back net). (can be reserved). In this embodiment, the user selects registration in the stadium support device 6 for the match between team A and team B.

The designated image 70 in FIG. 6 is displayed on the display 320 after a match (stadium) is selected. The designation image 70 is an image for allowing the user to perform various designation operations (selection operations). In this embodiment, in the specification image 70, the user performs an operation to specify stadium seats (the cheering device 6) and various options.

In this embodiment, one support device 6 is installed for each seat in the stadium, and the support device 6 is designated by seat designation. Unique information is set for the stadium seats or the cheering device 6. Further, the object specified by the user may be the support device 6, or the support device 6 may be indirectly specified by the user specifying a seat.

The designated image 70 is composed of a message display area 71, a designated area 72, etc., as shown in FIG.

The message display area 71 displays a message prompting the user to perform a specifying operation. In the specification area 72, items to be specified (selected) by the user are displayed.

In seat selection, as shown in FIG. 6, a message for specifying a seat (support device 6) is displayed in the message display area 71, and a list of seat types and prices (seat list) is displayed in the specification area 72. Further, in the designated area 72, a seat map showing the position of each seat on a plan view of the stadium is also displayed.

In the designation image 70 in FIG. 6, the user taps the area (touch pad 340) where the price of the seat (support device 6) in the designation area 72 is displayed, and then designates an empty seat in that area. By doing so, one of the seats of the corresponding type is designated as the user's seat (support device 6). Thereby, the support device 6 installed at the designated seat is associated with the user terminal device 3 (and user ID). This associated support device 6 becomes the user's alter ego.

After the seat designation (designation of the support device 6) is completed, a message prompting the user to designate the output option (option 1) is displayed in the message display area 71, as shown in FIG. In addition, a list of option names and amounts (option list) is displayed in the designation area 72. The options are services that can be provided to users with whom the support device 6 is associated.

Options are mainly classified into two types: output options and tour options.

The output option (option 1) is a service that causes the display 620 and speaker 630 of the user's own support device 6 to output support (support images, support voices, etc.).

As shown in FIG. 4, the support device 6 as an avatar device described below is a robot that includes a head 660, a torso 661, a right arm 670, a left arm 680, and the like. A display 620 is placed on the body 661, and a speaker 630 is placed on the head 660.

For example, when "uniform (home)" in FIG. 7 is specified, an image of team A's uniform (upper body) is displayed on the display 620, as shown in FIG.

Further, for example, when the “support message (standard form)” shown in FIG. 7 is specified, a text image of the standard support message is displayed on the display 620.

Note that if both "Uniform (Home)" and "Support Message (Standard)" are specified, a text image is displayed superimposed on the uniform on display 620.

Further, for example, if "playback of applause sound" is specified, the user can tap the touch pad 340 at the position corresponding to the cheering icon button 91 (see FIG. 9) to hear the applause sound from the speaker 630. Output.

Furthermore, the tour option (option 2) is a service that allows the support device 6 to participate in an event held at the stadium.

For example, when "riding in a relief car (home)" is specified, the support device 6 can ride in the relief car of team A when the pitcher is replaced (obtains the right to ride in the same). Note that FIG. 10 shows an image projected by the support device 6 (for example, a stationary device) riding in the relief car. That is, this support device 6 can be moved with a relief pitcher to the pitcher's mound in a relief car.

Furthermore, in the “ride in relief car (home)” mode, the user can have a conversation with the relief pitcher via the support device 6. For example, the user's conversation voice acquired from the microphone 331 of the user terminal device 3 is output from the speaker 630 of the support device 6. Then, the relief pitcher's conversation voice acquired from the microphone 631 of the support device 6 is outputted from the speaker 330 of the user terminal device 3.

In this embodiment, only when riding together in a relief car, the association between the user and the support device 6 installed in the seat is changed to another support device 6 installed in the relief car. Note that the present invention is not limited to this, and the support device 6 associated with the user may be moved to the relief car by the staff at the event venue or the like.

In the designation image 70 of FIGS. 7 and 8, when the user taps the part (touch pad 340) in the designation area 72 where the price of the option is displayed, the designated item is designated as the user's option. Note that the user may not be required to specify an option, or may be able to specify multiple options.

In addition, to purchase seats and some paid options, use a general credit card payment service, an electronic payment service, or points awarded by an application (e.g., points earned based on the number of times used or the amount used). be able to.

Next, the viewing image 80 is displayed on the display 320 after the stadium seats (supporting device 6) and options have been specified in the specified image 70. The viewing image 80 is an image for the user to view the video of the match through the support device 6. As shown in FIG. 9, the viewing image 80 is composed of a video area 81, a support area 82, an operation area 83, and the like.

In the video area 81, a video of the stadium is displayed. In this embodiment, two types of images are displayed.

The first is the live video (distributed video) of the match taken by cameras installed in the stadium (including fixed cameras, drones, cameras of broadcast crews, etc.).

The second is a viewing video taken by the support device 6 (camera 640), as shown in FIG.

Furthermore, the speaker 330 of the user terminal device 3 outputs audio corresponding to the video area 81. When the viewing video is displayed in the video area 81, the audio acquired from the support device 6 (microphone 631) is output from the speaker 330.

The display of the relay video and viewing video is switched each time the switching button 500 (touch pad 340) is tapped. For example, in FIG. 9, the viewing video of the support device 6 in the seat behind the backnet (A) is displayed, but when the user taps the switching button 500, the display can be switched to the relay video.

The viewing video (camera 640) can be adjusted by the user tapping the operation buttons 101 to 106 (touch pad 340) in the operation area 83, as shown in FIG.

In the operation area 83, operation buttons 101 to 106 are displayed while the viewing video is displayed in the video area 81.

The operation buttons 101 to 104 are buttons for adjusting the direction of line of sight of the camera 640 of the support device 6. By operating these buttons, the user can adjust the orientation (up, down, left, and right) of the head 660 (camera 640) of the support device 6.

For example, while the user is touching the operation button 101, the head 660 of the support device 6 can be rotated to the left around the neck. As a result, the direction of the camera 640 placed on the head 660 of the support device 6 is changed.

By operating the operation buttons 105 and 106, the user can adjust the enlargement and reduction (optical zoom) of the object to be photographed by the camera. The operation button 105 causes the camera 640 to exhibit a zoom-in function, and the operation button 106 causes the camera 640 to exhibit a zoom-out function.

For example, when the operation button 105 (touch pad 340) is tapped while the viewing video is displayed as shown in FIG. 9, the viewing video is displayed so that the center part of the screen is enlarged. .

Furthermore, by operating the operation buttons 101 to 106, the user can view not only the match but also the surroundings of the cheering device 6 (the stadium). That is, the user can view any viewing video according to the movable range of the head 660 (camera 640) of the support device 6.

In addition, in the video area 81, if it is determined that predetermined conditions are met, such as while a specified tour option (riding in a relief car, commemorative photo shoot at a match, etc.) is being performed, a relay video is displayed. And the viewing video is forcibly switched to the optional video.

The option video is a video shot by the support device 6 (camera 640) under the designated tour option.

For example, if the tour option "Ride in a relief car (home)" is specified, as shown in FIG. 81 is displayed.

Note that while the optional video is displayed in the video area 81, the operation buttons 101 to 106 are also displayed in the operation area 83. This allows the user to adjust the optional video in the same way as when displaying the viewing video.

Further, while the optional video is displayed in the video area 81, it is also possible to have a conversation with the pitcher riding in the relief car via the microphone 331 of the user terminal device 3 and the support device 6. The voice uttered by the pitcher is acquired by the microphone 631 of the support device 6 and output from the speaker 330 of the user terminal device 3.

Next, images of support icon buttons 91 and 92 related to some of the specified output options are displayed in the support area 82. The support icon button corresponds to an output option that is executed only when tapped. In this embodiment, the output option for audio output corresponds to the support icon button.

For example, if the user specifies "playback of applause sound" and "booing" as output options, cheering icon buttons 91 and 92 are displayed as shown in FIGS. 9 and 10. The cheering icon button 91 corresponds to "play back the sound of applause." The support icon button 92 corresponds to "booing".

When the user taps these support icon buttons 91 and 92 (touch pad 340), the corresponding sound is output from the speaker 630 of the support device 6. Note that the audio (data) to be output is registered in advance.

Furthermore, an image of a chat button 95 is displayed in the support area 82. Chat button 95 accepts requests for voice chat. In the voice chat, the user can have a conversation with other users who meet matching conditions (predetermined conditions) among other users whose support devices 6 are participating in the stadium.

The other users who meet the matching condition are, for example, other users associated with the support device 6 having the same attributes as the support device 6 of the user who requested the chat.

The attributes include, for example, the installation location (seat type) of the support device 6, the team to support, a friend user who is in a friend relationship with the user, or a group of users. In the example of FIG. 9, the user is associated with the support device 6 on the seat behind the backnet (A). This support device 6 is set with an attribute of backnet back (A). In this case, other users of the support device 6 to which the backnet back (A) attribute is set become matching targets.

Conversation audio from other users is combined with the audio related to the video displayed in the video area 81 and output from the speaker 330 of the user terminal device 3 . Further, the user's conversation voice is acquired by the microphone 331 of the user terminal device 3 and transmitted to the user terminal device 3 of another user.

Note that in this embodiment, the support device 6 is managed by the stadium operator (management server device 4). The operator (operation terminal device 5) can instruct all the support devices 6 under management to output images and the like via the management server device 4.

In this embodiment, the management terminal device 5 can issue a forced output instruction to all the support devices 6, regardless of whether the support devices 6 are associated with users.

For example, it is possible to instruct the support device 6 to forcibly output stadium sponsor information (advertisement images, etc.), uniform presentation throughout the venue (stadium) (e.g. national anthem, mourning images), etc. can.

<System hardware configuration>
As shown in FIG. 1, the system 1 includes an application server device (computer) 2, a plurality of user terminal devices (computers) 3, a management server device (computer) 4, an operation terminal device (computer) 5, and an avatar device ( computer) 6.

The application server device 2, the plurality of user terminal devices 3, the management server device 4, the management terminal device, and the support device 6 are connected so that they can communicate with each other via a communication network 7 such as the Internet or LAN. There is.

Note that the user terminal device 3 is assigned a user account in association with the user terminal device 3. This user account is managed as a user ID (user identification information).

When the user terminal device 3 communicates with the application server device 2 via the communication network 6, the user ID is transmitted from the user terminal device 3. The transmitted user ID is subjected to a predetermined authentication at the server device 2. This enables communication between the application server device 2 and the user terminal device 3.

<Hardware configuration of application server device>
The application server device 2 includes various functions for providing the user terminal device 3 with information regarding the progress of the application.

The application server device 2 provides each user terminal device 3 with, for example, various image information for generating the designated image 70 and viewing image 80 of the application described above.

Further, the application server device 2 receives operation information such as a user's designated operation from the user terminal device 3. Then, the application server device 2 requests the management server device 4 to output to the support device 6, etc., based on the operation information.

Further, the application server device 2 controls the progress of the voice chat. Specifically, the user assigns (matches) other users to chat with, and transmits audio data between the matching users (user terminal devices 3).

The application server device 2 includes a control section 20, a network interface 21, and a storage section 22. Network interface 21 and storage section 22 are electrically connected to control section 20 via bus 29 .

The network interface 21 is connected so as to be able to communicate with each user terminal device 3 and the management server device 4 via a communication network 7 such as the Internet and a LAN.

The storage unit 22 stores various information and data. The storage unit 22 includes an HDD (Hard Disk Drive), an SSD (Solid State Drive), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

The storage unit 22 stores a control program (computer program) and various control data for controlling the progress of an application on the user terminal device 3.

Furthermore, the storage unit 22 stores a distribution program and data for distributing an application program for the user terminal device 3.

Furthermore, as shown in FIG. 11, the storage unit 22 stores a schedule table that is information regarding the schedule of the match.

In the schedule table, a match ID, a match card, a server ID, seat data, option data, etc. are stored as one record.

The held match ID is identification information of the held match.

The match card is detailed information (text data) of the match displayed on the user terminal device 3. For example, the detailed information includes the name of the competing team, the event schedule, the stadium name, etc.

The server ID is identification information of the management server device 4 that manages the stadium where the match is held. In this embodiment, there are multiple stadiums where baseball games are held, and each stadium is managed by a separate management server device 4.

The seat data includes information regarding the seats in the stadium where the match will be played. For example, as shown in FIG. 6, there is information such as the seat type for which the user is required to specify a seat, and its fare. The seat data may be received from each management server device 4.

The option data includes information regarding options 1 and 2 provided in the match. The option data includes information such as an option list that allows the user to specify options, as shown in FIG. 7, for example. Option data can be received from each management server device 4.

The application server device 2 causes the user terminal device 3 to display an image based on a schedule table and the like, and allows the user to select a match, specify an option, and the like.

Further, the storage unit 22 stores a user DB 221.

The user DB 221 is a database that stores information regarding users who use the system 1. For example, as shown in FIG. 12, the user DB 221 stores user data that is information regarding each user.

In the user data, a user ID, participation information, etc. are written as one record.

The user ID is the user's account information (identification information).

Participation information is information regarding a match (stadium) in which the user's alter ego is participating. That is, it is information about the stadium where the user is watching (cheering) through the user terminal device 3.

The match ID is identification information of the match in which the player is participating.

The seat ID is identification information of the seat (designated seat) specified by the user. That is, it is the identification information of the seat specified in the above-mentioned specified image.

The avatar ID is identification information of the support device 6 installed in the reserved seat. The avatar ID includes attribute information. In this embodiment, the avatar ID includes information (attribute information) regarding the installation location (seat type) of the support device 6 and the seat number. For example, the avatar ID: A-3339R in FIG. 12 includes attribute information of "A" indicating the attribute of the back net (A).

The output option ID is identification information of the output option specified by the user. The tour option ID is identification information of the tour option specified by the user.

The control unit 20 controls the operation of the application server device 2. The control unit 20 transmits and receives various information and data, and processes various information and data. The control unit 20 includes a CPU (Central Processing Unit), a semiconductor memory, and the like (not shown).

<Description of the functions of the control unit of the application server device>
The control unit 20 of the application server device 2 functions as the following means and executes the following steps by executing the above-mentioned computer program.

<Explanation of setting steps>
The control unit 20 executes the setting step by functioning as a setting means. Below, the processing executed by the control unit 20 as a setting means will be explained.

The control unit 20 associates a user with at least one of the plurality of support devices. This support device is the support device 6 described above, and is installed at an event venue (stadium) where a real-world event (game) is held. Based on the participation information received from the user terminal device 3, the control unit 20 instructs the management server device 4 to associate the user with the support device 6 of the seat designated by the user.

The control unit 20 causes the storage unit 22 to store the avatar ID of the support device 6 associated with the user as part of this user's participation information.

<Explanation of image input steps>
The control unit 20 executes an image input step by functioning as an image input means. Below, the processing executed by the control unit 20 as an image input means will be explained.

The control unit 20 sets an image (or text) based on a user's operation. The image is a support image displayed on the display 620 of the support device 6. The text is a message as a support image displayed on the display 620 of the support device 6. The support image corresponds to an output option that causes the display 620 to display the image. The control unit 20 causes the storage unit 22 to store the option ID of the output option specified by the user as part of the user's participation information.

<Explanation of voice input steps>
The control unit 20 executes the voice input step by functioning as a voice input means. Below, the processing executed by the control unit 20 as a voice input means will be explained.

The control unit 20 sets the audio based on the user's operation. The audio is a cheering voice that is output from the speaker 630 of the cheering device 6. The cheering audio corresponds to an output option that causes the speaker 630 to output audio. The control unit 20 causes the storage unit 22 to store the option ID of the output option specified by the user as part of the user's participation information.

<Explanation of tour option input steps>
The control unit 20 executes the tour option input step by functioning as a tour option input means. Below, the processing executed by the control unit 20 as a tour option input means will be explained.

The control unit 20 sets tour options based on user operations. The control unit 20 causes the storage unit 22 to store the option ID of the tour option specified by the user as part of the user's participation information.

<Explanation of output steps>
The control unit 20 executes the output step by functioning as an output means. Below, the processing executed by the control unit 20 as an output means will be explained.

The control unit 20 causes a display 620 and a speaker 630 (an example of an output unit) connected to the support device (support device 6) to output a support image or a support voice.

Specifically, the control unit 20 controls the output to the output unit of the support device 6 associated with the user based on participation information received from the user terminal device 3, operation information of the support icon buttons 91, 92, etc. Instruct the management server device 4.

<Explanation of execution steps>
The control unit 20 executes the execution steps by functioning as an execution unit. Below, the processing executed by the control unit 20 as an execution means will be explained.

The control unit 20 instructs the management server device 4 to execute the tour option of the support device 6 associated with the user based on the participation information received from the user terminal device 3 and the like.

<Explanation of video and audio output steps>
The control unit 20 executes the video and audio output step by functioning as a video and audio output means. Below, the processing executed by the control unit 20 as a video/audio output means will be explained.

The control unit 20 causes the display 320 and speaker 330 of the user terminal device 3 to output output information according to the progress of the event.

The control unit 20 transmits various information to be outputted to the display 320 and the speaker 330 to the user terminal device 3 based on the various output information described above, depending on the progress of the event (the progress of the match). As a result, the designated image 70 and viewing image 80 as shown in FIGS. 6 to 9 are displayed on the display 320.

<Explanation of matching step>
The control unit 20 executes the matching step by functioning as a matching unit. Below, the processing executed by the control unit 20 as a matching means will be explained.

The control unit 20 matches users associated with support devices (support devices 6) that have attributes included in predetermined conditions (matching conditions), and allows the matched users to chat (text conversation or voice conversation).

The control unit 20 refers to each user's participation information (avatar ID) and matches the users as described above. The control unit 20 causes the storage unit 22 to store the user ID of each matched user as matching information.

The control unit 20 transmits audio data of the conversational voice of the other party to the user terminal device 3 of each matched user. Note that the chat may be in the form of displaying text.

<Explanation of change steps>
The control unit 20 executes the changing step by functioning as a changing means. Below, the process executed by the control unit 20 as a changing means will be explained.

The control unit 20 changes the direction of the camera 640 of the support device 6. Specifically, the control unit 20 instructs the management server device 4 to change the direction of the camera, etc., based on the operation information of the operation buttons 101 to 106 received from the user terminal device 3.

<Hardware configuration of user terminal device>
The user terminal device 3 is a terminal device capable of executing applications and video games, such as a smart device such as a smartphone, a personal computer, a PlayStation (registered trademark), an XBox (registered trademark), or a Nintendo Switch (registered trademark). It is a device composed of

In this embodiment, a smartphone will be described as a user terminal device 3. The user terminal device 3 includes a display 320, a speaker 330, a microphone 331, and a touch pad 340. The user terminal device 3 executes the application to display the above-described specified image 70 and viewing image 80, and transmits operation information (operation signal) input by the user to the application server device 2.

As shown in FIG. 2, the user terminal device 3 includes a control section 30, a network interface 31, a graphics processing section 32, an audio processing section 33, an operation section 34, and a storage section 35.

The network interface 31 , the graphic processing section 32 , the audio processing section 33 , the operation section 34 , and the storage section 35 are electrically connected to the control section 30 via a bus 39 .

The control unit 30 controls the operation of the user terminal device 3. The control unit 30 transmits and receives various kinds of information and data, and processes various kinds of information and data. The control unit 30 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 30 will be described later.

The network interface 31 is communicably connected to the communication network 7 in order to transmit and receive various data between the user terminal device 3 and the application server device 2 or the management server device 4.

The graphic processing unit 32 draws various images in a moving image format according to various image information output from the control unit 30. The image drawn by the graphic processing unit 32 is output (displayed) on the display 320. For example, the graphic processing unit 32 causes the display 320 to display the specified image 70, the viewing image 80, etc. as various images in a moving image format.

The audio processing unit 33 causes the speaker 330 to output (reproduce) various sounds according to various audio information output from the control unit 30 . For example, the audio processing unit 33 causes the speaker 330 to output the audio of the image displayed in the video area 81 as various sounds.

Further, the audio processing unit 33 generates an analog audio signal and digital audio data (sound data) detected (collected) by the microphone 331. For example, the audio processing unit 33 generates audio data during a user's conversation (utterance) in a voice chat.

The operation unit 34 receives an operation signal from the user. An operation signal from a user is input to the operation unit 34 via a touch pad 340 that is an input position detection device. Touch pad 340 is placed on the top surface of display 320.

The user inputs operation information (operation signal) to the user terminal device 3 (operation unit 34) by operating (tapping) a location where the support icon buttons 91, 92, etc. are displayed on the display 320.

The storage unit 35 is composed of an HDD, SSD, RAM, ROM, and the like. The storage unit 35 stores various data downloaded from the application server device 2, various programs such as application programs, and the like. Further, the storage unit 35 stores a user ID used in the application server device 2.

<Description of the functions of the control unit of the user terminal device>
The control unit 30 functions as the following means and executes the following steps by executing the application program downloaded from the application server device 2.
<Explanation of application execution steps>
The control unit 30 executes the application execution step by functioning as an application execution unit. Below, processing executed by the control unit 30 as an application execution unit will be described.

The control unit 30 allows the user to specify a match and a seat (supporting device 6) in the stadium where the match will be held, based on the user's operation of the touch pad 340.

Furthermore, the control unit 30 specifies options (output options and tour options) based on the user's operation of the touch pad 340.

Further, the control unit 30 receives a user's operation on a support icon button (touch pad 340) displayed on the display 320.

Further, the control unit 30 receives user operations on operation buttons (touch pad 340) displayed on the display 320.

Further, the control unit 30 receives a user's operation on a chat button (touch pad 340) displayed on the display 320.

Further, the control unit 30 generates audio data of the user's conversation while the audio chat is being performed.

Further, the control unit 30 causes the display 320 to display the specified image 70, the viewing image 80, etc. based on information transmitted from the application server device 2 and the like.

<Explanation of communication steps>
The control unit 30 executes the communication step by functioning as a communication means. Below, processing executed by the control unit 30 as a communication means will be explained.

The control unit 30 receives information such as an application program, image information to be displayed on the application screen, and audio information from the application server device 2, for example.

Further, the control unit 30 transmits user identification information (user ID), participation information, support icon button operation information, operation button operation information, chat button, audio data, etc. to the application server based on the user's operation, for example. Send to device 2.

<Hardware configuration of management server device>
The management server device 4 includes various functions for providing the application server device 2 with information regarding baseball games at the stadium.

Furthermore, the management server device 4 includes various functions for managing the support devices 6 installed in the stadium.

As shown in FIG. 1, the management server device 4 includes a control section 40, a network interface 41, and a storage section 42.

Network interface 41 and storage section 42 are electrically connected to control section 40 via bus 49.

The control unit 40 controls the operation of the management server device 4. The control unit 40 transmits and receives various kinds of information and data, and processes various kinds of information and data. The control unit 40 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 40 will be described later.

The network interface 41 is communicatively connected to the application server device 2, the management terminal device 5, and the plurality of support devices 6 via a communication network 7 such as the Internet and a LAN.

The storage unit 42 stores various information and data. The storage unit 42 includes an HDD, SSD, RAM, ROM, and the like.

The storage unit 42 stores computer programs and data for controlling each support device 6.

The storage unit 42 also stores computer programs and data for transmitting various data to the application server device 2.

Further, the storage unit 42 stores a support DB 421.

The support DB 421 accumulates multiple types of support image information and multiple types of support voice information that are output targets of the support device 6 as data for executing output instructions to the display 620, speaker 630, etc. of the support device 6. This is the database that was created.

In this embodiment, the support DB 421 stores output information (support image information and support voice information) corresponding to output options. The support image information is, for example, an image of a team's uniform displayed on the display 620. The cheering audio information is, for example, audio data such as applause. In addition to outputting the output information, operation information for operating the arms of the support device 6 is also stored in association with the output information.

The storage unit 42 also stores a local user DB 422.

The local user DB 422 is a database that stores information regarding users associated with stadium seats (support devices 6) corresponding to the management server device 4.

For example, the local user DB 422 accumulates information about users who are set for matches (match IDs) to be held at stadiums managed by the management server device 4, among the users registered in the user data in FIG. ing. For example, the local user DB 422 of the management server device 4 (server ID: AS-01) stores information about users with match ID: AB-01 (user ID: UA-00001, etc.).

For example, the local user DB 422 stores user data in a format similar to that shown in FIG. 12 regarding the aforementioned users. Information in the user management table of the local user DB 422 is synchronized with the user management table in FIG. 12.

<Description of the functions of the control unit of the management server device>
The control unit 40 of the management server device 4 functions as the following means and executes the following steps by executing the above-mentioned program.

<Explanation of setting steps>
The control unit 40 executes the setting step by functioning as a setting means. Below, the processing executed by the control unit 40 as a setting means will be explained.

The control unit 40 associates the user with the seat (support device 6) specified by the user. Specifically, the control unit 40 registers the user ID and participation information received from the application server device 2 in the local user DB 422.

Note that if the seat is already associated with another user, the user's request for association will be rejected.

<Explanation of avatar control steps>
The control unit 40 executes the avatar control step by functioning as an avatar control means. Below, processing executed by the control unit 40 as avatar control means will be described.

When the control unit 40 receives an output instruction from the application server device 2, the control unit 40 outputs a support image or a support voice to a display 620 and a speaker 630 (an example of an output unit) connected to the support device (support device 6). etc. will be output.

Specifically, the control unit 40 instructs the output unit of the support device 6 associated with the user based on participation information received from the application server device 2, operation information of the support icon buttons 91, 92, etc.

Further, when receiving a change instruction from the application server device 2, the control unit 40 changes the orientation of the camera 620 connected to the support device (support device 6). Specifically, the control unit 40 instructs the support device 6 to make changes based on the operation information of the operation buttons 101 to 106 received from the application server device 2.

Further, when the control unit 40 receives a forced output instruction from the management terminal device 5, the control unit 40 outputs a display 620 and a speaker 630 (an example of an output unit) connected to the target support device (support device 6). , forcibly output audio, etc. For example, sponsor information for the stadium, a unified effect throughout the venue (stadium) (for example, singing of the national anthem, images of mourning), etc. are output.

<Explanation of video acquisition steps>
The control unit 40 executes a video acquisition step by functioning as a video acquisition unit. Below, processing executed by the control unit 40 as a moving image acquisition means will be described.

The control unit 40 acquires relay video information (including audio information) of a baseball game at the stadium. The relay video information is acquired from a video server device (not shown) via the communication network 7, for example.

The control unit 40 also acquires viewing video information captured by a camera 620 connected to the support device 6 and viewing audio information acquired from a microphone 630. Further, the control unit 40 transmits the acquired video information and the like to the application server device 2 together with the identification information of the support device 6.

<Tour execution steps>
The control unit 40 executes the tour execution step by functioning as a tour execution unit. Below, the processing executed by the control unit 40 as a tour execution means will be explained.

When the control unit 40 receives the execution instruction from the application server device 2, the control unit 40 executes the tour option of the support device 6 associated with the user according to the progress of the baseball game (for example, pitcher change, home run). do.

For example, when the aforementioned pitcher change occurs, the control unit 40 connects the support device 6 installed in the relief car to the support device 6 that is associated with the user who has specified the option of “riding in a relief car (home).” change. Furthermore, when the player hits a home run, the control unit 40 changes the cheering device 6 associated with the user who has specified the option of "sit on the player's bench" to the cheering device 6 installed on the player's bench.

Then, the control unit 40 transmits information on the execution of the tour option to the application server device 2 during the pitcher change.

Further, the control unit 40 causes the speaker 630 of the support device 6 installed in the relief car to output the user's conversation voice acquired from the microphone 331 of the user terminal device 3.

Further, at the time of a pitcher change, image information captured by a camera 640 connected to a support device 6 installed in a relief car and audio information captured from a microphone 631 are acquired in a video acquisition step.

Note that the information on the progress status of the baseball game is set by, for example, the administrator of the operation management device 5.

<Hardware configuration of operation terminal device>
The management terminal device 5 is a terminal device for a stadium operator, and the management terminal device 5 is a device configured by a terminal device capable of executing an application, such as a smart device such as a smartphone, or a personal computer. It is.

In this embodiment, a personal computer will be explained as the management terminal device 5. A display 520, a speaker 530, and a keyboard 340 are connected to the management terminal device 5. The management terminal device 5 executes the application and transmits the operation information (operation signal) input by the operator to the management server device 4.

As shown in FIG. 3, the management terminal device 5 includes a control section 50, a network interface 51, a graphic processing section 52, an audio processing section 53, an operation section 54, and a storage section 55.

The network interface 51 , the graphic processing section 52 , the audio processing section 53 , the operation section 54 , and the storage section 55 are electrically connected to the control section 50 via a bus 59 .

The control unit 50 controls the operation of the management terminal device 6. The control unit 50 transmits and receives various kinds of information and data, and processes various kinds of information and data. The control unit 50 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 50 will be described later.

The network interface 51 is communicably connected to the communication network 7 in order to transmit and receive various data between the management terminal device 5 and the management server device 4.

The graphic processing unit 52 draws various images in a moving image format according to various image information output from the control unit 50. The image drawn by the graphic processing unit 52 is output (displayed) on the display 520. For example, the graphic processing unit 52 causes the display 520 to display an operation screen for receiving an output instruction from the support device 6 described above.

The audio processing unit 53 causes the speaker 530 to output (reproduce) various sounds according to various audio information output from the control unit 50 .

An operation signal from an operator is input to the operation unit 54 . An operation signal from the user is input to the operation unit 54 via the keyboard 540.

The storage unit 55 includes an HDD, SSD, RAM, ROM, and the like. The storage unit 55 stores various programs such as application programs for operators, control data, and the like. Furthermore, the storage unit 55 stores a user ID (operator ID) used in the management server device 4.

<Description of the functions of the control unit of the operation terminal device>
The control unit 50 functions as the following means and executes the following steps by executing the above-mentioned application program for the operator.
<Explanation of output steps>
The control unit 50 executes the output step by functioning as an output means. Below, the processing executed by the control unit 50 as an output means will be explained.

The control unit 50 causes a display 620 and a speaker 630 (an example of an output unit) connected to all target support devices (support device 6) to output images and the like. As mentioned above, sponsor information for the stadium, a uniform performance throughout the venue (stadium) (for example, the singing of the national anthem or an image of mourning), etc. are forced to be output.

Specifically, the control unit 50 instructs the management server device 4 to output to the output units of all target support devices 6 based on operator operation information and the like.

<Explanation of communication steps>
The control unit 50 executes the communication step by functioning as a communication means. Below, processing executed by the control unit 50 as a communication means will be explained.

The control unit 50 receives information such as image information and audio information to be displayed on an application screen from the management server device 4, for example.

Further, the control unit 50 transmits the operator's identification information (user ID), output instructions, etc. to the management server device 4, for example, based on the operator's operation information.

<Hardware configuration of avatar device>
The cheering device 6 is installed at an event venue (stadium) where a real-world event (baseball game) is held, and has various functions for the associated users to cheer via the cheering device 6. Note that the support device 6 is driven by a built-in battery (not shown).

As shown in FIG. 4, the support device 6 includes a display 620, a speaker 630, a microphone 631, a camera 640, a head 660, a torso 661, a left arm 607, and a right arm 608. ing.

Head 660, right arm 670, and left arm 680 are connected to body 661.

A camera 640 and a microphone 631 are arranged on the front side of the head 660.

A display 620 and a speaker 631 are arranged on the front of the body 661.

Further, as shown in FIG. 5, the support device 6 includes a control section 60, a network interface 61, a graphic processing section 62, an audio processing section 63, a storage section 64, a right arm drive section 67, and a left arm drive section 68. , and a head drive section 66.

The network interface 61 , the graphic processing section 62 , the audio processing section 63 , the storage section 64 , the right arm drive section 67 , the left arm drive section 68 , the head drive section 66 , and the camera 604 are connected via a bus 69 . It is electrically connected to the control section 60.

The control unit 60 controls the operation of the support device 6. The control unit 60 transmits and receives various kinds of information and data, and processes various kinds of information and data. The control unit 60 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 60 will be described later.

The network interface 61 is communicably connected to the communication network 7 in order to transmit and receive various data between the support device 6 and the management server device 4.

The graphic processing unit 62 draws various images in a moving image format according to various image information output from the control unit 60. The image drawn by the graphic processing unit 62 is output (displayed) on the display 620. For example, the graphic processing unit 62 causes the display 620 to display a cheering image.

The audio processing unit 63 causes the speaker 630 to output (reproduce) various sounds according to various audio information output from the control unit 60 . For example, the audio processing unit 63 causes the speaker 630 to output cheering audio.

Further, the audio processing unit 63 generates an analog audio signal and digital audio data (sound data) detected (collected) by the microphone 631. For example, the audio processing unit 63 generates audio data of audio generated within the stadium.

The storage unit 64 includes an HDD, SSD, RAM, ROM, and the like. The storage unit 64 stores various programs, control data, etc. for controlling the operation of the avatar device. Furthermore, the storage unit 64 stores an avatar ID.

Further, the imaging unit 65 causes the camera 650 to perform imaging according to information output from the control unit 60. The camera (imaging unit) 650 includes an optical lens, a CCD image sensor (CCD), an imaging signal processing unit, and the like, and generates image data of the stadium. Camera 640 transmits the generated image data to control unit 60.

The head drive unit 66 includes a motor and the like, and rotates the head 660 in the vertical direction and the horizontal direction. The imaging direction of the camera 603 is adjusted by the rotation of the head. Note that a general configuration can be adopted as the configuration for rotating each of the drive units 65 to 67.

The right arm drive section 67 includes a motor and the like, and rotates the right arm section 670 in the vertical direction. The left arm drive section 68 includes a motor and the like, and rotates the left arm section 680 in the vertical direction.

<Description of the functions of the control unit of the avatar device>
The control unit 60 of the support device 6 functions as the following means and executes the following steps by executing the above-mentioned program.
<Explanation of output steps>
The control unit 60 executes the output step by functioning as an output means. Below, the processing executed by the control unit 60 as an output means will be explained.

The control unit 60 extracts the output target (output information) from the output instruction received from the management server device 4 and outputs it to the graphic processing unit 62 and the audio processing unit 63. As a result, the graphic processing section 62 outputs (displays) the cheering image on the display 620, and the audio processing section 63 outputs (reproduces) the cheering sound from the speaker 630.

<Description of driving steps>
The control section 60 executes the output step by functioning as a driving means. Below, processing executed by the control unit 60 as a driving means will be explained.

The control unit 60 drives each of the drive units 65 to 67 based on the change instruction received from the management server device 6. This causes the head 660, right arm 670, and left arm 680 to rotate.

Further, the control section 60 drives each of the driving sections 65 to 67 in accordance with the output of cheering voices and the like.

<Explanation of imaging steps>
The control unit 40 executes the imaging step by functioning as an imaging means. Below, processing executed by the control unit 40 as an imaging means will be described.

The control unit 40 acquires viewing video information captured by the camera 640 and viewing audio information acquired from the microphone 631. Further, the control unit 40 transmits the acquired video information and the like to the management server device 4 together with the identification information of the support device 6.

<Explanation of support execution process>
The support execution process of the present invention performed in the system 1 will be described below with reference to FIG. Although one user terminal device 3 and one management server device 4 are used in FIG. 13, a plurality of user terminal devices 3 and a plurality of management server devices 4 may be used to execute the support execution process.

First, the control unit 50 of the management terminal device 5 executes a status update step and transmits information on the progress of the match to the management server device 4 (step S500).

The progress of the game includes information such as player bus movement, players waiting at their lockers, 30 minutes before the start of the game, national anthem, during the game (inning information), pitching changes, when home runs are scored, the end of the game, interviews, etc. be. For example, the operator inputs the progress status into the management terminal device 5, and the information is transmitted from the management terminal device 5 to the management server device 4. This step is executed every time there is input from the operations manager.

Next, when the control unit 40 of the management server device 4 receives the progress status of the match, it executes an updating step (step S300).

In this step, the progress status of the match stored in the storage unit 42 is updated. This step is executed every time the management server device 4 receives the progress status of the match.

Further, the control unit 30 of the user terminal device 3 executes the selection step and receives a selection operation (designation operation) of the game (stadium) to participate in, the seat (the cheering device 6), the output option, and the tour option (step S105). .

Furthermore, in the selection step, the control unit 30 transmits participation information to the application server device 2. For example, after the application is started, the user terminal device 3 receives match information, seat information, etc. from the application server device 2, displays the specified image 70, etc., and prompts the user to perform the above operations via the touch pad 340. Let it run.

Next, the control unit 20 of the application server device 2 executes a setting step and executes settings regarding the received participation information (step S205). For example, the control unit 20 transmits a setting instruction to the management server device 4 along with participation information. Further, the control unit 20 registers the participation information in the user DB 221 as user data in association with the user ID of this user.

Next, the control unit 40 of the management server device 4 executes a setting step based on the setting instruction from the application server device 2 (step S305). For example, the control unit 40 executes a setting that associates a match seat (support device 6) specified by the user with the user.

Furthermore, in this step, the control unit 40 also registers information such as output options and tour options included in the participation information. Specifically, the control unit 40 registers the received user ID and participation information in the local user DB 422.

Next, the control unit 20 of the application server device 2 executes an information acquisition/output step, acquires various information from the management server device 4, and transmits output information to the display 320 and speaker 330 of the user terminal device 3. Execute (step S210).

For example, the control unit 20 requests the management server device 4 to start transmitting various information such as relay video and viewing video, and to output the information to the support device 6 (transmission start request).

Further, the control unit 20 transmits an output start instruction including relay video, viewing video, etc. to the user terminal device 3 in order to display the above-described viewing image 80. Note that the information acquisition/output step is repeatedly performed up to step S255, which will be described later. Further, the relay video and the viewing video are displayed, for example, from 30 minutes before the start of the game until the interview of the players of the winning team after the game ends.

Moreover, the viewing video may be distributed outside the distribution time of the relay video. For example, the viewing video may be displayed after the relay video has been distributed. Thereby, the user can, for example, participate in an optional tour after the game ends, and can also enjoy the afterglow after the game through the support device 6.

Next, the control unit 40 of the management server device 4 executes an information acquisition/transmission step based on the transmission start request from the application server device 2 (step S310).

In this step, various information such as information on the progress of the match, relay video, viewing video, etc. is acquired and transmitted.

For example, the control unit 40 requests the support device 6 to start transmitting the viewing video (including viewing audio) captured by the camera 640 and the microphone 631. Further, the control unit 40 starts a relay video acquisition process and the like. Note that the information acquisition/transmission step is repeatedly performed up to step S355, which will be described later.

Next, the control unit 60 of the support device 6 executes a photographing step based on the transmission start request from the management server device 4 (step S410). In this step, the control unit 60 transmits the viewing video (including viewing audio) captured by the camera 640 and the microphone 631 to the management server device 4 . Note that the photographing step is repeatedly performed up to step S455, which will be described later.

Further, the control unit 30 of the user terminal device 3 starts the output step based on the output start instruction from the application server device 2 (step S110). Thereby, based on the various information received from the application server device 2, the viewing image 80 is displayed on the display 320 and the audio is output. Note that the output step is repeatedly performed up to step S155, which will be described later.

Furthermore, the control unit 40 of the management server device 4 executes the support output I step based on the participation information (step S315).

In this step, among the output options to be output to the support device 6, output options that do not require the user to operate a button (operation of a support icon button) are output to the support device 6. This output option includes, for example, an output option for outputting the uniform image to the display 620 of the support device 6.

The control unit 40 determines a cheering video (for example, a uniform image) to be outputted to the cheering device 6 based on the user's participation information, and issues an output start instruction I to the display 620 of the cheering device 6. For example, the control unit 40 transmits an output start instruction I to the support device 6 along with output information (image information, etc.) such as a support video.

Next, the control unit 60 of the support device 6 executes the support output I step based on the output start instruction I from the management server device 4 (step S415). In this step, the control unit 60 causes the display 620 to display a support image based on the received output information. Note that the support output I step is continuously output until step S455, which will be described later.

Further, the control unit 30 of the user terminal device 3 executes a video change step when the user operates the switching button, and switches the display content of the video area 81 to either the relay video or the viewing video (step 120). As described above, the user can change the image by tapping the switching button (touch pad 340 corresponding to the position where the switching button is displayed).

Furthermore, when the user operates the support icon button, the control unit 30 of the user terminal device 3 executes a support request step and transmits the operation information (option ID) to the application server device 2 (step S125). As described above, the user can issue a support request by tapping the support icon button (touch pad 340 corresponding to the position where the support icon button is displayed).

Next, when the control unit 20 of the application server device 2 receives the operation information of the support icon button (for example, boo 92) from the user terminal device 3, it executes the support output II step (step S225). Specifically, the control unit 20 transmits the support output instruction II including the operation information (option ID) to the management server device 4.

Next, the control unit 40 of the management server device 4 executes the support output II step based on the support output instruction II from the application server device 2 (step S325). In this step, based on the operation information (option ID), the support voice to be outputted by the support device 6 is determined, and an output start instruction II is transmitted to the support device 6.

The control unit 40 transmits an output start instruction II to the support device 6, for example, along with output information (audio data, arm posture information, etc.) corresponding to the support voice. The arm posture information is, for example, the rotation angle of the arm.

Next, the control unit 60 of the support device 6 executes the support output II step based on the output start instruction II from the management server device 4 (step S425). In this step, the control unit 60 outputs a cheering voice to the speaker 630 based on the received output information, and rotates the arms 607 and 608. Note that the support output II step ends after output of the specified support voice is completed.

Further, the control unit 30 of the user terminal device 3 executes a camera operation request step when the user operates the operation button, and transmits operation information (operation ID) to the application server device 2 (step S130). As described above, the user can execute a camera operation request by tapping the operation button (touch pad 340 corresponding to the position where the operation button is displayed).

Next, when the control unit 20 of the application control server device 2 receives the operation information of the operation button from the user terminal device 3, it executes a camera change step (step S230). Specifically, the control unit 20 transmits a change instruction including operation information (operation ID) to the management server device 4.

Next, the control unit 40 of the management server device 4 executes a camera change step based on the change instruction from the application server device 2 (step S330).

In this step, the posture and zoom (reduction rate) of the head 660 of the support device 6 are determined based on the operation information (operation ID), and a change instruction is sent to the support device 6.

For example, the control unit 40 transmits a change instruction to the support device 6 along with control information such as the attitude of the head 660 of the support device 6 and zoom (reduction rate).

Next, the control unit 60 of the support device 6 executes a camera change step based on the change instruction from the management server device 4 (step S430). In this step, the control unit 60 sets (changes) the rotation of the head 660 and the zoom ratio based on the received setting information.

Note that the rotation of the head 660 and the zoom magnification/reduction ratio changed in the change step are maintained until a change instruction is received again or until the photographing step is completed.

Furthermore, when the user operates the chat button, the control unit 30 of the user terminal device 3 executes a chat start request step and transmits the chat start request to the application server device 2 (step S140). As described above, the user can execute a chat start request by tapping the chat button (touch pad 340 corresponding to the position where the chat button is displayed).

Next, when the control unit 20 of the application control server device 2 receives a chat start request from the user terminal device 3, it executes a matching step (step S240).

Specifically, the control unit 20 assigns another user who meets the matching conditions for the user as the user's voice chat partner. The number of other users may be one or more. The control unit 20 also registers the user ID of the chat partner in the user data of each matched user.

Further, when a match is made, the control unit 20 transmits a chat start instruction to the user terminal device 3 of each user with whom the match is made.

Next, the control unit 20 of the application server device 2 executes a chat communication step (step S245).

In this step, the control unit 20 receives the audio data of the user's utterance during matching from each user terminal device 3, and transmits it to the user terminal device 3 of the other user. Note that this step is continuously executed until the chat is ended, for example, when the user performs an operation to end the chat.

Furthermore, when the control unit 30 of the user terminal device 3 receives a chat start instruction from the application server device 6, it executes a chat execution step (step S145).

In this step, the control unit 30 transmits audio data of the user's uttered voice acquired through the microphone 331 to the application server device 2 . Further, the control unit 30 receives audio data of other users' uttered voices from the application server device 2 and outputs it from the speaker 330.

Note that this step is continuously executed until the chat is ended, for example, when the user performs an operation to end the chat.

Further, the control unit 50 of the management terminal device 5 executes a forced output step when the output condition is satisfied (step S535).

In this step, for example, all the cheering devices 6 in the stadium are forced to output performance video (including audio). The output conditions include, for example, that the progress of the match is in a specific situation, that a forced output instruction has been input by the operator, and so on.

For example, when the progress of the game is to sing the national anthem (a specific situation), images of the national flag, such as the Japanese flag, are displayed on the displays 630 of all the cheering devices 6 in the stadium in conjunction with the singing of the national anthem. In this case, the control unit 50 transmits a forced output instruction to the management server device 4 along with output information such as image information of the national flag.

Further, for example, in the case of a specific situation specified by the sponsor (such as when changing offense and defense), the control unit 50 causes the display 630 of all the cheering devices 6 in the stadium to display the sponsor's advertising video. As a result, the advertisement video is reflected in the relay video. In addition, stadium visitors will directly see advertising images, which will have an appealing effect on the visitors.

Further, in this step, if the termination condition is satisfied, the control unit 60 transmits a forced output termination instruction to the management server device 4, and terminates this step. The end condition is, for example, that the singing of the national anthem (in a specific situation) has ended.

Next, when the control unit 40 of the management server device 4 receives the forced output instruction from the management terminal device 5, it executes the forced output step (step S335).

In this step, the control unit 40 forces the support device 6 that is the output target to perform the output. Specifically, the control unit 40 transmits a forced output instruction including output information to the target support device 6. For example, a forced output instruction including image information (output information) of the national flag is transmitted to all the cheering devices 6 in the stadium.

Furthermore, in this step, when the control unit 40 receives the forced output termination instruction from the management terminal device 5, it transmits the forced output termination instruction to the avatar terminal device 6, and ends this step.

Next, when the control unit 60 of the support device 6 receives the forced output instruction from the management server device 4, it executes the forced output step (step S435).

In this step, the control unit 60 interrupts the execution of the support output I step, etc., and causes the display 620 to display an image of the national flag.

Further, in this step, when the control unit 60 receives a forced output termination instruction from the management server device 4, the control unit 60 terminates this step and resumes execution of the suspended support output I step and the like.

Further, the control unit 40 of the management server device 4 executes the execution step when the timing for executing the tour option has arrived (step S350). After the process of step S310, the control unit 40 refers to the participation information of each user in the local user DB 422 and continuously determines when the execution timing of the specified tour option has arrived.

For example, when the progress of the game indicates a pitcher change, the control unit 40 determines that the timing to execute the tour option of "Ride in Relief Car (Home)" has arrived, and executes "Ride in Relief Car". Note that if there is no pitcher change for the home team, "relief car ride-along (home)" will not be performed.

In this step, the control unit 40 temporarily changes the support device 6 associated with the user from the seat support device 6 to the relief car support device 6. As a result, a support image and the like are also output to the display 620 of the relief car support device 6.

Further, in this step, the control unit 40 requests the relief car support device 6 to start transmitting the viewing video (including viewing audio) captured by the camera 640 and the microphone 631. Note that the control unit 60 of the relief car support device 6 executes the photographing/output step based on the transmission start request and audio output instruction from the management server device 4. The control unit 60 transmits the viewing video (including viewing audio) captured by the camera 640 and the microphone 631 to the management server device 4 . Further, the control unit 60 outputs the audio data received from the management server device 4 from the speaker 630.

Further, in this step, the control unit 40 transmits a tour option output instruction to the application server device 2 along with output information of the viewing video (including viewing audio) received from the relief car support device 6.

Further, in this step, the control unit 40 requests the relief car support device 6 to output an audio instruction including audio data of the user's uttered audio received from the user terminal device 3 (application server device 2).

Further, in this step, when the end timing of the tour option arrives, the control unit 40 returns the association of the support device 6 associated with the corresponding user to the support device 6 of the original seat. As a result, the cheering image and the like are outputted again to the display 620 of the cheering device 6 at the original seat, and the relay video is outputted to the display 320 of the user terminal device 3.

When the tour option end timing has arrived, the control unit 40 transmits a tour option end instruction to the application server device 2, and ends this step.

Next, the control unit 20 of the application server device 2 executes a tour option output step based on the tour option output start instruction from the management server device 4 (step S250).

In this step, the control unit 20 transmits a tour option output instruction to the user terminal device 3 along with output information of the viewing video (including viewing audio) captured by the relief car support device 6.

Further, in this step, the control unit 20 transmits the audio data received from the user terminal device 3 to the management server device 4.

Further, in this step, when the control unit 20 receives the tour option end instruction, it transmits the tour option end instruction to the user terminal device 3, and ends this step.

Next, the control unit 30 of the user terminal device 3 executes a tour option output step based on the tour option output start instruction from the application server device 2 (step S150). Thereby, the viewing video taken by the relief car support device 6 is displayed on the display 320 (video area 81). Furthermore, the audio of this viewing video is output from the speaker 330.

Furthermore, in this step, the control unit 30 transmits the audio data of the user's uttered voice acquired from the microphone 331 to the application server device 2 .

When the control unit 30 receives the tour option end instruction from the application server device 2, it ends this step.

The control unit 40 of the management server device 4 ends the information acquisition/transmission step when the video display is terminated, such as when the relay video of the baseball game cannot be acquired (step S355). The control unit 40 transmits a termination instruction to the application server device 2 and the support device 6.

Through the above procedure, the support execution process of the present invention is executed.

To summarize the above, the present invention:
A system that executes each of the following steps,
In the setting step, a user is associated with a plurality of support devices 6,
The support device 6 is installed at an event venue where a real-world event is held,
In the output step, a display 620 and a speaker 630 connected to the support device 6 output a support image and a support voice.
It is a system.

<Effects of the invention>
According to the present invention, it is possible to provide a system and a computer program that allow a user's alter ego to participate in an event venue for an event such as a sports event or a concert, thereby giving a user who is not present at the venue the feeling of being there. .

Specifically, by installing an avatar device associated with a user at an event venue, the user can, for example, view the event through a camera installed on the avatar device. Users can give their support at the event venue through the display and speakers installed in the device.

Furthermore, according to the present invention, for example, a user can send cheering images and cheers to an athlete through an avatar device, and on the other hand, an athlete can also provide fan services to a user through an avatar device.

[Second embodiment]
The system of the present invention is not limited to the first embodiment, and a support device managed by a user may be used.

The support device in this embodiment is, for example, a support device 610 managed by a user, as shown in FIG. 14.

The support device 610 is not installed at the stadium (event venue) from the beginning, but is transported from the user's hand to the stadium by the user using a transport company, for example.

In this embodiment, the user performs an operation to specify a match, seat, option, etc. before transporting the support device 610.

Next, the user registers his or her support device 600 with the management server device 400 of the stadium where the match will be held.

As a result, information for various devices to start communication with the support device 610, such as the IP address of the support device 610, is registered in the local user DB (user data) in association with the user.

Note that information for starting communication is transmitted from the user terminal device 300 to the management server device 400 via the application server device 200.

After the communication connection between the management server device 400 and the support device 610 is completed, the user may transport the support device 610 to the stadium.

After arriving at the stadium, the cheering device 610 is placed at a designated position (seat) by, for example, the stadium operator.

The arrangement position can be automatically displayed on the display of the support device 610 after the power is turned on, for example, based on information specified by the user.

By starting an application on the user terminal device 300 a predetermined time before the start of the event, the user can view viewing videos and the like.

After the game is over, the cheering device 610 is transported to the user again using a carrier or the like.

Furthermore, the present invention is not limited to the above, and the user himself/herself may be able to bring the support device to the venue and install it. Furthermore, the user may be able to transport the support device to the venue using a shuttle bus for the support device.

Furthermore, if the support device is a self-propelled device (such as a bipedal robot), the user can set a destination on the support device and move it to the venue.

Other configurations and effects are similar to those of the embodiment described above.

[Third embodiment]
In the first and second embodiments, a robot-type avatar device is used as the support device, but various devices may be used as long as they are configured to output a support image and/or a support voice. It can be done.

For example, as shown in FIG. 15, a liquid crystal display with a wireless communication function may be used as the support device. The liquid crystal display 600 is equipped with a camera, a microphone, a speaker, etc., like the avatar device described above.

In this case, as shown in FIG. 15, a photograph of the user's own face can be displayed on the liquid crystal display 600 together with an image of the uniform of the team that the user supports. In this case, the user's own face photo may be a real-time video or a still image taken in advance.

Furthermore, one user may be associated with a plurality of adjacent liquid crystal displays 600. In this case, one user can be displayed in a large size as a multi-monitor.

Other configurations and effects are similar to those of the embodiment described above.

[Other embodiments]
In the embodiment, the event was a baseball game, but it may also be a game of other sports such as soccer, golf, tennis, or martial arts, public gambling such as horse racing or boat racing, or e-sports. Further, the event may be a concert, an overseas tour, or the like.

For example, if the event is e-sports, the support device may not only be installed at the seat where the user sits, but also at a position where it can capture images of the players' operations on the controller.

In e-sports, golf, tennis, etc., the cheering device may be controlled so as not to reproduce (or to reduce the volume of) cheering from the cheering device depending on the reproduction status so as not to interrupt the concentration of the players. Moreover, between users who support a player via a cheering device, cheering, chatting, etc. may be played back via a user terminal device.

Furthermore, if the event venue is a movie theater, a theater, or the like, the cheering device may be able to output audio, for example, during a cheering screening (such as a screening where the audience can cheer while waving penlights or the like).

Further, the application server device or the management server device may be able to detect, via the support device, a violation of etiquette such as a user uttering or displaying a prohibited word. In this case, the application server device or the like can forcibly control (prohibit) the output from the support device associated with the user who violates etiquette.

In addition, if the application server device etc. can detect manner violations as described above, restrictions may be imposed on the user who has violated manners a certain number of times, such as when reserving a seat next time. Users may not be able to make reservations or may only be able to reserve seats that are far from the players.

In addition, as an example of a specific situation in the progress of a match, when the theme song of team A (or team B) is played, the team color is displayed on the display of the cheering device, or multiple cheering An emblem or a message of support may be displayed across the device.

Furthermore, in the event of an emergency such as an earthquake, an evacuation route may be displayed on the display of the support device to guide visitors.

Further, in the embodiment described above, an example is described in which the support device associated with the user is changed at the start timing of the tour option, but the present invention is not limited to this. For example, when the start timing of a tour option arrives, in addition to the support device associated with the corresponding user, other support devices (for example, a support device riding in a relief car) may be temporarily A mapping may be added to.

Furthermore, the present invention is not limited to the above embodiment, and a plurality of types of uniforms may be prepared, such as a home uniform, an away uniform, and a third uniform. By purchasing the images (skins), the user can display those images as optional images on the display of the support device.

Furthermore, the user can purchase images of various goods such as towels, megaphones, and hats, and display them on the support device. In this case, for example, an image of a towel is displayed superimposed on the uniform image.

Further, the image displayed on the support device may be not only an image of the user's face photo but also an avatar image displayed as a three-dimensional model. Further, the user may be able to customize the avatar image by variously changing the facial parts or hairstyle of the avatar image.

In addition, there are multiple types of facial parts for the avatar image displayed on the display of the support device, and there are parts that can be used for free and parts that can be used for a fee. may have been done.

Further, the support device may include a light emitting device, and may cause the light emitting device to emit light based on a user's operation.

Further, a support device may be placed in a radio booth where a celebrity performs as a DJ, and a user as a listener may be associated with the support device. In this case, the user associated with the support device is changed based on the processing (lottery, etc.) of the management terminal device, and the user associated at that time can talk with the celebrity.

The present invention is not limited to the embodiments described above, and the support device (support device) may be fixed to the seats of the stadium in advance. In this case, when reserving a seat, the user may be able to view the viewing video from the seat (supporting device) on a trial basis.

The user may be able to change the volume or sound output from the support device via the user terminal device. For example, by processing a fee payment, the user may be able to increase the volume of his/her own cheering, or the user may be able to change the voice output from the cheering device using a voice changer. Good too.

In addition, the support device is not limited to the support device installed in the seat, but may also be a device with a camera embedded in the backrest of the seat, the base such as first base, the mound, etc., and can be distributed at multiple locations in the event venue. It may also be a device equipped with a camera. That is, the support device may include any one of a camera, a microphone, a speaker, and a display.

Furthermore, the support device may be a device that can move on the pitch side, inside the stadium, or in the sky. Further, the support device may move on rails, run on its own, or fly like a drone.

The present invention is not limited to the embodiments described above, and the camera of the support device may be controlled by the support device itself. For example, image recognition processing and tracking processing may be performed based on camera footage from a support device, and the camera may be controlled to follow the ball during a game.

Further, the movement of the camera of the support device may be controlled in conjunction with the line of sight or direction of an HMD (head mounted display) worn by the user. In this case, for example, the user may wear the HMD, set a reference posture and a reference line of sight, and register the information in the application server device. Based on this information, the camera of the support device may be controlled based on the posture changed from the basic posture or the like.

The viewing video may be displayed not only on the user terminal device of the user associated with the support device, but also on the user terminal device of another user. Further, this viewing video may be displayed as a distributed video.

Further, the support device may be equipped with a 360-degree camera such as a spherical camera or a half-spherical camera.

The present invention is not limited to the embodiment described above, and the user may be able to specify a support device installed in a place other than the seats in the stadium. For example, the user may be able to select one of the images taken by a plurality of fixed point cameras installed within the stadium.

Furthermore, while allowing spectators to enter the stadium as in the past, the user may also be able to register his or her own user ID in a stationary device installed within the stadium. In this case, for example, the stadium can accommodate up to 30,000 people, and 100 users are registered for each support device (avatar device, stationary device) installed in the stadium. If possible, it would be possible to accommodate up to 40,000 spectators, which is more than before.

In addition, in a stadium that can accommodate up to 30,000 people, if the admission limit is 5,000 people, in addition to the 5,000 visitors (5,000 seats), the cheering equipment (25,000 seats) can be assigned.

In addition, if seats at the stadium are unsold (if there are vacant seats), the operator will install a cheering device in that seat (on the cheering device installed at that seat) and display images from that seat. Viewing rights may be sold. In this case, even users who cannot visit the stadium can associate themselves with the cheering device at their seat and watch the game before the event ends.

Another example is a system that executes the following steps:
In the output step, an output section connected to the support device outputs a support image and/or a support voice,
A predetermined medium (for example, an object imitating a mascot character, etc.) can be connected to the support device,
In the output step, the cheering image and/or the cheering voice are changed according to attributes of the medium (information on the team to be cheered on, etc.);
There is a system.

In this case, by connecting an object, such as a mascot character, to the cheering device, the user can change the cheering content according to the attributes of the object.

Furthermore, the present invention is not limited to the embodiments described above, and a plurality of users may be associated with one support device. In this case, the display of the support device may be divided when outputting the support video or the like, and the user's video may be switched at predetermined time intervals. In addition, for one option (for example, if you want to watch the video based on the viewpoint of the camera mounted on the catcher's mask or umpire mask, a fee of 500,000 yen is required), the option will be split 50/50 among multiple people. may be available for purchase.

The present invention is not limited to the embodiments described above, and the relay video and the viewing video provided by the support device may be displayed at the same time. Furthermore, the relay video and the viewing video may be switched based on a user's operation.

The present invention is not limited to the embodiments described above, and the user may be able to specify (or change) output options and the like during the match.

Further, the support device may be installed at a bench where players (substitute players) participating in a game are seated, a locker room used by the players, a field where the players play, and the like. Further, in the case of a performance such as a concert, the support device may be installed on a stage where the performance is performed or in a waiting room of performers participating in the performance.

Furthermore, by developing the present invention, new services can be provided to users at the event venue, as described below.

For example, even if the user is remote, such as when the user is sitting in his or her designated seat, it may be possible to associate the user with a support device that is installed in a location that the user cannot normally go to. Specifically, cameras are attached to pitcher's hats, catcher masks (or umpire masks), benches, bases, and other equipment, and users can register their user terminal devices on the application server. , it may be possible to view (experience) images that would not normally be seen through the alter ego, while being at the venue (while being remote).

For example, a user can view a video based on the catcher's line of sight (camera perspective of a support device attached to the catcher's mask) using his or her user terminal device while sitting in a stadium seat (outfield seat).

The tour options of the embodiments described above may also be able to be specified on the user terminal device of the venue user. Thereby, venue users can also view relay video, viewing video, etc. on their own user terminal devices. In this way, the system of the present invention can also be used to provide additional services to venue users.

The present invention is not limited to the above embodiments, and the volume of the conversation voice of the other matched user may be adjusted while the voice chat is being performed.

For example, the volume may be adjusted so that the voice of a conversation with another user corresponding to a support device located at a seat located farther from the seat of the user's support device is lower. This allows the user to feel as if they are having a conversation in a stadium, even during voice chat.

Note that the avatar ID of the user's support device includes the seat number. Therefore, distance between the seats may be determined by comparing the seat position of the user's support device with the seat position of the support device of another user with reference to the avatar ID.

Furthermore, the user may be able to associate himself or herself with any of the support devices not only before the event starts, but also after the event has started. That is, the application server device may be able to accept the user's designation of seats and options even after the event has started. In this case, unsold tickets after the start of the event can be reduced. Furthermore, the fee paid by the user may vary depending on the length of time that has passed since the start of the event (or the time until the scheduled end time of the event).

In addition, in order to protect users who leave their seats (leave the stadium) during the event (between the start and end of the event), rights such as seats and options purchased by that user may be transferred to other users. may be able to do so. In this case, for example, it is only necessary that users who exchange rights can exchange necessary information such as match IDs and avatar IDs, as well as exchange money using general electronic payment services. . Note that these operations may be performed via the application server device or may be performed between user terminal devices.

Furthermore, users who leave their seats (leave the stadium) during the event (between the start and end of the event) may be able to view the viewing video from the support device associated with that seat. good. As a result, even after leaving your seat for various reasons (for example, going to the restroom, shopping at a store, returning home, etc.), you can view the video from your seat from any location via your user terminal. This way, you won't have to miss any scoring scenes.

Further, in the embodiment, an example is described in which a plurality of devices such as an application server device, a management server device, and a management terminal device are used, but the present invention is not limited to this. For example, the functions of the application server device, the functions of the management server device, and the functions of the management terminal device may be executed by one device. In this case, the one device and application program (eg, A-OSAKA app) need only be prepared for each stadium.

Additionally, if a specific situation occurs (for example, a player hits a come-from-behind home run), the management server device may use the display of the cheering device for a mass game (or dye it in team colors, etc.). . Alternatively, the management server device may drive the arm drive section of the support device to cause the support device to execute the wave.

Note that in the above, it may be possible to take measures to prevent a malicious user from reselling the right to view an event.

For example, in the above system, if the users who are associated with a predetermined number or more of support devices are all the same user (user ID), that user may be pre-registered in the system (e.g., pre-screened by the operator). It may be determined whether the user is a registered user (for example, a cheering squad, a sponsor, etc. who is registered as a team supporter).

If the user is not pre-registered, it may be possible to temporarily invalidate the user ID, etc. associated with the support device. This makes it possible to eliminate users who install multiple cheering devices at the stadium and resell the rights to view the event.

In addition, in the above system, instead of a cheering device, a holography device (or Augmented Reality device) with a camera, microphone, and speaker connected to stadium seats, vehicles used for transportation by players, benches where players are seated, etc. , IC chip) may be installed. If a holography device is installed, a hologram of the support device can be displayed instead of a physical support device. Examples of the hologram include a hologram of the user himself and a hologram of an avatar registered by the user.

Moreover, the present invention is not limited to the above, and instead of installing one support device in each seat, a support device including a camera that follows the movement of a ball, for example, may be installed in each area. In this case, the right to associate a user with a support device may be sold as an area ticket without limiting the number of seats.

Furthermore, the present invention is not limited to the above, and the user may be able to install support devices at two or more stadiums (for example, a swimming stadium, a judo venue) at the same time. In this case, for example, even if games are being held at the same time, the user may be able to watch the game by pressing a button to switch stadiums or by splitting the screen.

In addition, in the event that a user's support device malfunctions, the user ID can be temporarily registered in the support device of another user in a nearby seat based on the user's operation (or the processing of the management server device). It may be possible. This makes it possible to avoid problems such as the user being unable to view videos until the support device becomes normal.

1 System 2 Application server device 3 User terminal device 4 Management server device 5 Management terminal device 6 Support device (avatar device, stationary device)
7 Communication network

Claims (10)

A system consisting of a computer and a support device that causes the computer to execute each of the following steps,
In the image input step, set the support image,
The support image is an image customized based on a user's operation on a user terminal device different from the support device,
In the output step, displaying the support image on the support device,
The support device is installed in advance at an event venue where a real-world event is held.
system. The support image is an avatar image, and the user can select facial parts of the avatar image.
The system of claim 1. The support image is a costume image, and the user can select the costume image to be applied to the avatar image.
The system according to claim 2. The support image is a goods image, and the user can select the goods image to be applied to the avatar image.
A system according to claim 2 or 3. The support image is a costume image,
The goods image is displayed superimposed on the costume image.
The system according to claim 4. In the output step, based on the user's operation, the direction of the camera included in the support device and the enlargement and reduction of the object to be photographed by the camera are adjusted;
System according to any one of claims 1 to 5. Furthermore, a system that causes a computer to execute each of the following steps,
The image input step sets the text based on the user's actions,
In the output step, the text set by the user is displayed on a display unit included in the support device.
System according to any one of claims 1 to 6. Furthermore, a system that causes a computer to execute each of the following steps,
The voice input step sets or inputs voice based on the user's operation,
In the output step, a speaker included in the support device outputs the audio set or input by the user.
System according to any one of claims 1 to 7. Furthermore, a system that causes a computer to execute each of the following steps,
In the photographing step, an image photographed by a camera included in the support device is transmitted to the user's terminal device.
System according to any one of claims 1 to 8. A computer program that causes a computer to perform each of the following steps,
In the image input step, set the support image,
The support image is an image customized based on a user's operation on a user terminal device different from the support device,
In the output step, displaying the support image on the support device,
The support device is installed in advance at an event venue where a real-world event is held.
computer program.

Images