TWI793633B - Image transfer system, recording medium storing computer program used therein, and control method - Google Patents

Abstract

It provides an image transmission system that can reflect the reaction of the audience of the photographic image of the audio-visual activity as a performance caused by the performance machine in the activity. The image transmission system (1) is connected to the user terminal device (4) and the speaker (SP) installed in the event facility (EF) through the network (NT), and is set in the user terminal device (4) The display (46) displays a video screen (50) including a photographed image as a photographed result of an event held in the photographed event facility (EF), and transmits the photographed image to the user terminal device (4). In addition, the video delivery system (1) converts the posting into The speaker (SP) shall perform the sound performance. The video delivery system (1) then controls the speakers (SP) in such a way that their sound performance is added to the event.

Description

Image transfer system, recording medium storing computer program used therein, and control method

The present invention relates to a user terminal device connected to each user through a network, and a performance machine installed in an event facility as an additional performance, and the display device installed on the aforementioned user terminal device displays information including As a means of photographing the video screen of the photographed video, which is the photographed result of the event held in the event facility, a video transmission system, etc. that transmit the photographed video to the user terminal device.

There are user terminal devices used by each user connected to the network through the network, and performance equipment installed in the event facility as an additional performance, and the display device installed in the aforementioned user terminal devices displays events including shooting events The photographic result of the event held in the facility is the image screen of the photographic image, and the photographic image is transmitted to the image transmission system of the user terminal device. For example, there is a server that delivers content such as live video as such a photographic image (for example, refer to Patent Document 1). In addition, Patent Document 2 and Non-Patent Document 1 exist as prior art documents related to the present invention. [Prior Art Literature] [Patent Document]

[Patent Document 1] Japanese Patent No. 6430059 [Patent Document 2] Japanese Patent No. 6382468 [Non-patent literature]

[Non-Patent Document 1] "Nippon Ham cheering song resounds through audience-free Sapporo D! Fan recording sound source, played when scoring opportunity", [online], Reiwa March 14, 2020, Sports Nippon Sponichi Annex, [Order and March 26, 2020], Internet, <URL: https://WWW.sponichi.co.jp/baseball/2020/03/14/kiji/20200314s00001173044000c.html>

[Problem to be Solved by the Invention]

In the server of Patent Document 1, viewers who have a live broadcast animation use to select props and pay a price, and the selected props will be superimposed and displayed on the status of the live broadcast animation. However, this server is not structured so that the selection of props will affect the content of the live animation. More specifically, for example, in the case where the photographed result of the event at the event facility is used as a live animation, the selection result of the prop does not affect the structure of the control of the performance equipment installed at the event facility. That is, the audience's reaction to the live broadcast animation will not be linked (linked) with the performance of the performance machine through the event. On the other hand, the selection of items accompanying the payment of consideration (the audience's reaction) tends to increase in response to the audience's emotional uplift (satisfaction). As a result, even if the viewers who live-broadcast the animation are satisfied with the event and are excited by the selection of the props, the emotional excitement is not reflected in the actual event.

Also, in the animation delivery system of Patent Document 2, the animation of the animation of the character object generated based on the movements of the actors is delivered. In this system, actors perform in a studio unit, which has no audience. On the other hand, in a studio unit, a screen for projecting a moving image transmitted to a client device may be placed in front of an actor, for example. At this time, the actor may check the reaction of the audience of the animation through the screen. At this time, the actor may reflect this reaction in his own performance. However, depending on the content of the performance or the cast, there may be no room for such confirmation. Originally, whether the viewer's reaction is reflected in the performance (the content of the animation) is the judgment of the entrusted actor, and it will not be reflected directly.

On the other hand, in sports events such as professional baseball and grand sumo wrestling, there are cases where games without spectators are played without spectators entering the stadium. In such a situation, for example, even if it is broadcasted on TV, there is a possibility that there is only a live sound such as a home run and the voices of the players, which may give an impression that it is not lively. Possibility to become at least atmosphere different from general (the situation with audience) is high. In order to make this kind of atmosphere close to normal, in Non-Patent Document 1, it is introduced that many loudspeakers are arranged in the uppermost stage of the outfield auditorium of the stadium, and then the measure of playing the chance theme song is played when the players in the scoring circle enter the batting booth. However, in this measure, the chance theme song is only played in a pre-set situation such as a dotted circle, which still does not reflect the reaction of viewers of the TV broadcast. As a result, there is a possibility of becoming a monotonous performance.

Therefore, an object of the present invention is to provide an image delivery system and the like capable of reflecting the viewer's reaction of a photographic image of an audio-visual event as a performance by a performance machine on the event. [Means to solve the problem]

The image delivery system of the present invention is connected to the user terminal devices used by each user through the network, and the performance equipment installed in the event facility in the form of additional performances, and is used to display the above-mentioned user terminal devices. A device for displaying an image screen including a photographed image that is a photographed result of an event held in the aforementioned event facility, and a video transmission system for transmitting the photographed image to the aforementioned user terminal device, equipped with: performance conversion means, which is connected to When each viewer, who is a user of viewing and listening to the aforementioned photographic image, executes a supporting action for imparting a supporting effect on the aforementioned video screen to support the aforementioned activity through the aforementioned user terminal device, the supporting action is converted into an action to be performed by the aforementioned performance device. The activity performance; and the machine control means control the aforementioned performance machine in such a way that the aforementioned activity performance is added to the aforementioned activity.

On the other hand, the computer program of the present invention is configured such that a computer connected to the aforementioned user terminal device and the aforementioned performance device through the aforementioned network has the functions of each means of the aforementioned video delivery system.

In addition, the control method of the present invention is to connect to the user terminal device used by each user through the network, and the performance machine installed in the event facility in the form of additional performance, and to set it on the aforementioned user terminal device A display device for displaying an image screen including a photographic image as a result of photographing an event held in the aforementioned event facility, and transmitting the aforementioned photographic image to a computer incorporated in the image delivery system of the aforementioned user terminal device, executing The following program: performance conversion program, when each viewer who is a user of viewing and listening to the aforementioned photographic image performs a supporting action for giving the aforementioned video screen a supporting effect that supports the aforementioned activity through the aforementioned user terminal device, the supporting action is performed. Behavior is transformed into an activity performance to be performed by the aforementioned performance machine; and a machine control program is to control the aforementioned performance machine in such a way that the aforementioned activity performance is added to the aforementioned activity as the aforementioned performance.

An example of a video delivery system according to an aspect of the present invention will be described below. First, with reference to FIG. 1 , the overall structure of a video delivery system according to an aspect of the present invention will be described. The video delivery system 1 is a system for delivering a video (image) showing the status of an event held at the event facility EF to the user of the user terminal device 4 . Specifically, the image delivery system 1 includes a central server 2 as a server device, and an performance machine EA that can be connected to the central server 2 through a predetermined network NT. The central server 2 is constituted as one logical server device by combining server units 2A, 2B... which are plural computer devices. However, it is also possible to configure the central server 2 by a single server unit. Alternatively, the central server 2 may be logically configured using cloud computing.

The network NT system may be configured appropriately as long as the performance apparatus EA can be connected to the central server 2 . As an example, the network NT is constituted by the Internet which is the WAN, and the LAN which connects the central server 2 and the performance apparatus EA to the Internet respectively. Furthermore, various computer devices may be appropriately present between the performance device EA and the LAN. At this time, the computer device and the performance machine EA are constructed as a regional system, and this regional system can also be connected to the central server 2 through the network NT.

The performance machine EA is a device for realizing various performances. The performance device EA may be configured appropriately as long as it can realize such a performance. As an example, it is configured as a network device (so-called IOT device) that can be connected to the network NT. The performance machine EA can also be used as an output device to realize various performances, and can also be used as an input device for such a performance, and various devices can be appropriately included. However, in the example of FIG. 1, the speaker SP is disclosed as an example of the performance machine EA. , and camera CA. The speaker SP is a well-known sound output device that performs auditory performance by reproducing (outputting) various sounds. The camera CA is a known device for capturing images. These performance apparatuses EA may be appropriately installed in various facilities, but in the example of FIG. 1 , they are installed in event facilities (venues) EF. Event Facility EF is a facility for holding various events.

In some cases, the video distribution system 1 is connected to the user terminal device 4 through the network NT. The user terminal device 4 is a computer device that can be connected to a network and is used for the user's personal use. The user terminal device 4 allows the user to enjoy various services provided by the central server 2 by installing various computer software. For example, the user terminal device 4 has the function of a display terminal capable of displaying various animations accompanying the execution of a predetermined application program (software). As the user terminal device 4, it is also possible to use an appropriate computer device, but in the example of FIG. A user terminal device such as a personal computer 4C (fixed type is also possible). These are suitably connected to the network NT through, for example, access points AP. In addition, various computer devices that can be connected to the network, such as fixed home game machines or portable game machines, and are used for the user's personal use may be appropriately used as the user terminal device 4 .

The central server 2 provides various equipment services for the performance equipment EA. The performance machine EA may be controlled by the event operator of the event facility EF, for example, through the zone system, or may be controlled indirectly or directly by the central server 2 through the zone system. In other words, the performance machine EA is connected to an area system (for example, a system including appropriate computer devices such as a speaker control device for controlling the speakers SP), and may be controlled by the area system. At this time, the central server 2 outputs the area system to control (make the performance machine EA realize a proper performance) the performance machine EA (both the area system and the performance machine EA can be prepared by the operator of the event facility EF, the The operator is different from the operator of the image delivery system 1) control signal (the area system can make the performance machine EA perform the appropriate signal, such as recording the type of performance realized by the performance machine EA in the area system And when implementing its specific control, it can also be used as a signal indicating any type of execution). Then, the control of the actual performance machine EA may be performed indirectly through the area system (resulting in the role of a relay device) that receives the control instruction. In this way, the performance device EA may be appropriately controlled. For example, when the central server 2 controls it indirectly or directly, the service for the device includes the service of controlling the performance device EA. Specifically, as a service for controlling such an performance device EA, the service for the device includes, for example, controlling the shooting conditions (shooting direction, shooting range, angle of view) of the camera CA when the shooting result of the camera CA is used in the video delivery system. , or shooting period, etc.) camera control service, and video recording service that obtains the shooting result and records it as video data. Similarly, the device service includes, for example, a performance service in which the speaker SP reproduces (outputs) various performance sounds. The details of the performance service will be described later.

Likewise, the central server 2 provides various Web services to the users of the user terminal devices 4 through the network NT. For example, Web services include image delivery services, image association services, and billing services. The image delivery service is a service for delivering images of event status to the user terminal device 4 . Such images may appropriately include various images, but as an example, images (videos) of imaging results (including appropriately edited images) captured by the camera CA are included. The image delivery service may be configured to appropriately deliver the animation data of the image showing the event status to the user terminal device 4, but, as an example, it is configured to be delivered at any time by packet communication. Also, the video of the event status may be recorded as a recorded video recording the past event status, but, for example, it is delivered as a live video that transmits the current game status live (almost in real time). That is, through the video delivery service, the status of the event of the event facility EF is delivered to the user terminal device 4 almost instantly with the streaming.

The image association service is an image association service for active states delivered through the image delivery service. The image-related service may be various image-related services that appropriately include an activity state, but, as an example, an activity support service is included. The event support service is a service for supporting the event by the user of the user terminal device 4 who watches and listens to the state of the event (live video) through the video delivery service (hereinafter referred to as the state of viewer). Such support may be appropriately realized, but as an example, it is realized by making the viewer of the live video (event status) express emotions (impressions) related to the event status. In addition, such expression may be realized appropriately, but as an example, it is realized by at least any one of tipping, purchase of items, or posting of comments. As a result, the event support service has a function as a service that realizes at least any one of tipping, purchase of items, and posting of speeches.

Contribution of remark is function that each viewer contributes remark of oneself. The posting of the speech may be realized appropriately, and in order to display the image showing the state of the event, it may be realized through another screen different from the screen displayed on the user terminal device 4 (hereinafter referred to as the state of the image screen), but as For example, it is realized through a video image. In addition, the posting of the speech has the effect of displaying the speech. This display (the utterance) may be appropriately shared with other viewers through a screen other than the video screen, but as an example, it is shared with other viewers through a video screen. In other words, the posting of comments has the function of displaying the comments (character information expressing various emotions) of each viewer on the video screen. Contributions to this statement may be paid (exchange with collection of consideration) or free of charge (collection without consideration).

On the other hand, tipping is a function of providing value from viewers to event performers (players, actors, etc.). As such a value, various virtual currency (appropriate currency within a limited range including in-game currency, regional currency, etc.) may be used, but money is used in many cases. The purchase of an item is a function of purchasing an item (provided as a consideration with a predetermined consideration) related to an event. As such items, various items may be used as appropriate, but in most cases, items related to performers of the event are used, and in such cases, the purchase of items has the same effect as tipping. Like the posting of speeches, both tipping and purchase of items can be realized through other screens different from the video screen, and can be realized as appropriate, but as an example, it can be realized through the video screen. In addition, various effects such as one of the tipping and the purchase of items, the total amount of tips (or purchases), or a display indicating the occurrence of tipping (or purchases) are appropriately produced. Such an effect may not be shared with other viewers, but may be appropriately produced, but as an example, it is shared through a video screen in the same way as a speech. That is to say, appropriate effects (hereinafter referred to as support effects) will be produced by tipping, purchase of items, or posting of comments. However, this support effect is added to the video screen and shared with other viewers. As a result, the support service also has a function of adding such support effects to the image screen. In this situation, tipping, purchasing an item, or posting a comment can function as a supporting action of the present invention.

The support effect is not related to the content of tipping, etc., and the same effect may be used, but as an example, it is different (varied) depending on the content of tipping, etc. Specifically, the support effect is based on the amount of tipping (one viewer is fine, the total amount including other viewers is fine. Also, the amount at one time is fine, and the cumulative amount for a predetermined period is fine.), becomes Modes vary in luxury or simplicity. Similarly, the support effect changes according to the purchase amount or type of the item. In addition, in posting speeches, the content of speeches including a predetermined keyword, the number of characters, or the number of speeches of other viewers including a predetermined period (in other words, the number of viewers who posted speeches), etc. Support effect changes.

The charging service is a service for collecting various fees (consideration) from each user of the user terminal device 4 through known settlement processing. Such fees include various considerations for the content of Web services such as video delivery services and video-related services, but include, as an example, considerations for tips accompanying event support services or purchases of items (included when posting a speech is paid) Consideration of contribution accompanying remark). That is, the consideration (fee) required in the event support service is collected through the charged service. Furthermore, the Web service includes, for example, a data delivery service of delivering various data or software (including update of data, etc.) to each user terminal device 4, an ID giving service of giving a user ID for identifying each user, or An authentication service or the like may be used to receive user identification information from the user terminal device 4 and to authenticate the user.

Next, the difference in the structure of the image delivery system 1 according to the event will be described. In the event facility EF, various events accompanied by performances performed by the performance apparatus EA may be appropriately held. However, depending on the type of event, the structure of the performance apparatus EA is different, and as a result, the structure of the image transmission system 1 is also different. the situation. Hereinafter, two events are taken as examples of the types of events held in the event facility EF, and the structure of the image delivery system 1 corresponding to each of the two forms of the events will be described for each form. In addition, about the structure common to the above-mentioned video delivery system 1, the same code|symbol is attached|subjected in the following drawing, and the description is abbreviate|omitted.

(1st form) The video delivery system 1A of the first form will be described with reference to FIGS. 2 to 8 . FIG. 2 is a diagram showing a schematic structure of the video delivery system 1A of the first embodiment. The image delivery system 1A of the first aspect corresponds to an example of the structure of the image delivery system 1 when an event related to sports is held in the event facility EF as a type of event. As this kind of activity, it is also possible to hold appropriate activities related to various sports. The example in FIG. 2 is an activity of baseball (a sport in which each player uses a real ball, etc.) held in the activity facility EF (hereinafter referred to as baseball activity) The structure of the image delivery system 1A when the situation). At this time, as shown in FIG. 2, a baseball field is used as the event facility EF, and the performance apparatus EA is installed in such a field. Also, the performance machine EA may include various devices for performing (enhancing) baseball in an appropriate number, but in the example of FIG. 2, a plurality of speakers SP and one camera CA are disclosed.

Next, main parts of the control system of the video delivery system 1A of the first embodiment will be described with reference to FIG. 3 . First, the central server 2 is provided with a control unit 21 and a storage unit 22 as storage means. The control unit 21 is a computer composed of a CPU, which is an example of a processor that executes various arithmetic processing and motion control according to a predetermined computer program, and internal memory and other peripheral devices required for its operation. Also, various performance machines EA can be connected to the control unit 21, and in the example shown in FIG. 3, a camera CA and a speaker SP are disclosed. Furthermore, an input device such as a keyboard, an output device such as a display, and the like may be connected to the control unit 21 as needed, for example. However, such illustrations are omitted.

The memory unit 22 is an external memory device realized by a memory unit including a non-volatile memory medium (computer-readable memory medium) such as a hard disk array. The memory unit 22 may be configured to hold all data in one memory unit, or may be configured to store data in a plurality of memory units. In the storage unit 22, a server program PG1 is recorded as an example of a computer program for causing the control unit 21 to execute various processes necessary for providing various services to users. Also, in the storage unit 22, server data 23 necessary for provision of various services is stored. The server data 23 includes various data necessary for provision of equipment services or Web services, and in the example of FIG. 3 , video data VD, equipment data DD, and performance data ED are disclosed as one of such various data.

The video data VD is known animation data for displaying the video of the event status on the user terminal device 4 . The image of the event status, such as the image containing the shooting results of an appropriate number of cameras CA, and the image of the game screen displayed by an appropriate number of game machines (including these appropriate combination, etc., appropriate processing, etc.). Therefore, the video data VD can be an animation data displaying these various images. In the example of FIG. The state of photographic images) animation data. Equipment data DD is data for managing performance equipment EA installed in event facility EF. Also, the performance data ED is data for realizing a performance by the performance device EA. The details of the device data DD and performance data ED will be described later. Furthermore, the server data 23 may also include various data for realizing various services, for example. For example, such data may include ID management data for managing various IDs such as user IDs. However, such illustrations are omitted.

The control unit 21 is provided with an appliance service management unit 26 and a Web service management unit 27 as logical devices realized by a combination of hardware resources of the control unit 21 and the server program PG1 as software resources. The equipment service management unit 26 executes various processes for realizing the above-mentioned equipment services with respect to the performance equipment EA. Specifically, the appliance service management unit 26 executes performance control processing and post-performance processing as one of the processes for realizing the performance service described above, for example. The details of the programs of the performance control processing and post-performance processing will be described later.

On the other hand, the Web service management unit 27 executes various processes for realizing Web services such as the above-mentioned image distribution service, image-related service, or billing service to the user terminal device 4 . For example, the Web service management unit 27 executes known processing for realizing streaming of game images as processing for realizing image distribution services. Also, the Web service management unit 27 executes known billing processing (including cooperation with other billing systems) as processing for realizing the billing service. Similarly, the Web service management unit 27 executes appropriate processing in accordance with the content of the provided service as processing for realizing image-related services, but this processing includes processing for realizing support services. Specifically, the Web service management unit 27 is a process for realizing such a support service, for example, a process for realizing tipping, purchase of items, or posting of speeches. Such processing may be known as processing, and may be implemented appropriately.

The user terminal device 4 is provided with a control unit 41 as a computer and a storage unit 42 as storage means. The control unit 41 is a computer that combines a CPU as an example of a processor that executes various processes in accordance with a predetermined computer program, an internal memory required for its operation, and other peripheral devices.

The memory unit 42 is an external memory device realized by a memory unit including a non-volatile memory medium (computer-readable memory medium) such as a hard disk and a semiconductor memory device. In the storage unit 42, a terminal program PG2 is recorded as an example of a computer program for causing the control unit 41 to execute various processes necessary for providing various services to users. Furthermore, in the storage unit 42, terminal data TD necessary for enjoying Web services such as display of photographed images is recorded. Various data are included in the terminal data TD, but in the example of FIG. 3, the video data VD is shown as one of them. These video data VDs are provided from the central server 2 so as to include a part necessary for the video delivery service (or data delivery service) or a part of the video-related service. In addition, ID management data etc. which are suitably provided from the center server 2 may be included in terminal data TD, for example. Similarly, the terminal data TD may include, for example, image data for displaying various images associated with delivery of photographic images, audio data for reproducing various sounds such as BGM, and the like. However, such illustrations are omitted.

In the control unit 41, various logic devices are formed by combining the hardware resources of the control unit 41 and the terminal program PG2 as software resources. Then, through these logic devices, various processes necessary for enjoying the Web service are executed. As these associated logic devices, the image control unit 43 and the data management unit 44 are disclosed in the example of FIG. 3 . The image control unit 43 is a logic device that performs various processing for displaying various images (including animation). Such processing includes processing for displaying photographic images (movies) (processing for enjoying image delivery services), processing for displaying various images related to photographic images for enjoying image-related services, and Enjoy the processing of such associated fee-based services. For example, the video control unit 43 operates in cooperation with the Web service management unit 27 of the central server 2 as a process for realizing support services included in the video-related service, or executes tipping, purchase of items, and posting of speeches independently. processing. On the other hand, the data management unit 44 is a logic device that performs various processes related to the management of the terminal data TD recorded in the storage unit 42 . Such processing includes a process of acquiring video data VD from the center server 2 . Also, processing of updating various data such as video data VD and processing of providing (transmitting) updated data to the center server 2 are included as needed.

Also, in the user terminal device 4, various output devices and input devices may be appropriately provided in response to the types of user terminal devices such as the mobile terminal device 4A, etc., but in the example of FIG. 3 , the display is disclosed as such an output device. 46 and a speaker 47, revealing a touch panel TP as an input device. The display 46 and the speaker 47 are a known display device for displaying various images such as game images, and a known sound reproduction device for reproducing sound, respectively. On the display 46, various screens (images) related to services provided by the user terminal device 4 including Web services, such as the above-mentioned video screen, are displayed. The touch panel TP is a known input device (detection device) that detects the position of a user's touch operation and outputs a signal corresponding to the position. Through such a touch operation on the touch panel TP, an appropriate touch operation (action for service) for utilizing the image delivery service, the image-related service, or the paid service is input. The touch panel TP is arranged so as to cover the display 46 on the display 46 in order to detect such a touch operation on the entire area of the display surface of the display 46 .

Next, the details of the performance service will be described with reference to FIG. 4 . The performance of the performance device EA may be provided independently of the support service, but as an example, it is provided in conjunction with the support service. The example in FIG. 4 is an example of the flow of the performance service that reveals this situation. Also, the example in FIG. 4 discloses a situation in which a service of posting a speech is provided as an example of such a support service. That is, the example in FIG. 4 shows an example of the flow of the performance service when the performance machine EA performs a performance in conjunction with the posting of the speech (support service). At this time, as shown in FIG. 4 , the support service system includes four programs F1 to F4, and the performance service system includes two programs F5 and F6. As a result, through these 6 programs of F1 to F6, a performance by the performance machine EA for performance service, that is, a baseball event at the stadium is realized.

Specifically, first, the imaging result of the camera CA is sent to the central server 2 (F1). When the shooting result is sent from the camera CA, the central server 2 transmits the shooting image based on the shooting result to the user terminal device 4 (F2). The user terminal device 4 may appropriately provide the photographed image to the user, for example, through the image screen 50 . Therefore, on the image screen 50 , various objects photographed by the camera CA are appropriately displayed as photographed images, but in the example of FIG. 4 , the stadium image EFI corresponding to the stadium (event facility) EF is displayed. Also, when posting a speech is provided as a support service, the video screen 50 includes a posting button 51 . The contribution button 51 has a function as a position (area) to be touch-operated when posting a speech. When a touch operation is performed on the contribution button 51, the image screen 50 will change into a speech input mode (not shown). The utterance input mode may be appropriately provided in accordance with the input method of the utterance, etc. An appropriate method such as selecting from a plurality of candidates prepared in advance as a speech input method may also be used, but for example, when a free input in which the user can input arbitrary characters is used, a known keyboard for inputting such characters is displayed. Image, the image screen 50 changes to a utterance input mode including such a keyboard image. In this example, the touch operation on the contribution button 51 or the touch operation on the keyboard image in the utterance input mode functions as the contribution operation of the present invention.

When a speech is input (posted) in the speech input mode, the user terminal device 4 sends the input result (speech) to the central server 2 (F3). Then, the central server 2 transmits the utterance (input result) received by it to all viewers (the user who posted the utterance and other users) who watched the same photographic image in such a manner that the utterance is displayed on the image screen 50 ) of the user terminal device 4 (F4). The display of the utterance may be realized appropriately, and may be realized on the side of each user terminal device 4, or may be realized on the side of the central server 2. That is, even if the central server 2 transmits the video screen 50 with the speech added, each user terminal device 4 receiving the speech information may also add the speech to the video screen 50 . In any case, with the posting of the speech, the posting is reflected on the video screen 50 . Also, the reflection target of the statement may be limited to only the video screen 50 of the viewer who posted the speech (hereinafter referred to as a contributor), or conversely, only the video screen 50 of other viewers other than the poster, etc. Appropriate part of the viewer video screens 50 of all viewers viewing the same photographic video may be used, but as an example, there is no such limitation, and the speech is reflected on the video screens 50 of all viewers. In other words, the contribution (support) of a speech by one viewer is reflected not only on the video screen 50 of the contributor but also on the video screen 50 of other viewers as a display of the speech (support effect).

As an example, although such a program is used to provide a support service, the posting of the speech is displayed in the form of a photographed image attached to the video screen 50, so the support service (posting of the speech) is provided synchronously with the video delivery service, F1 and F2 The system has a function as a program for image delivery service. In this case, even if the image delivery service has a function as a part of the support service, conversely, the support service may also have a function as a part of the image delivery service. Alternatively, the image delivery service and the support service may be controlled as mutually independent services.

On the other hand, when receiving a speech post from the user terminal device 4, the central server 2 converts the speech post into a performance through the performance device EA of the field EF (F5). In addition, this conversion may be realized by various methods, but as an example, it is realized by performance data ED. The details of the performance data ED will be described later, but as an example, the performance data ED is the performance that should be realized through the performance device EA through the support behavior and corresponding behavior such as the contribution of the speech (hereinafter referred to as the status of the event performance) ) to establish a relationship. This kind of activity performance can also be set in such a way that it changes according to the content of the supporting behavior (including the degree of quantity, etc.). Specifically, for example, when posting a speech as a supporting action, for example, the speech may be associated with the event performance in such a way that the event performance changes according to the speech (number of characters, predetermined keywords, etc.). Similarly, when adding up the number of speeches (in other words, viewers) posted during a predetermined period, the speeches may be associated with the event performance so that the event performance changes according to the number. In this way, the event performance may be appropriately set, but as an example, regardless of the content of the speech, it is set to the same performance (however, depending on the time and situation, multiple performances may be prepared). That is to say, regardless of the content of the speech, the contribution accompanying the speech will be converted into the scheduled event performance.

As an event performance, various performances may be prepared appropriately, and the same performance may be prepared regardless of the content of the event, but as an example, a performance corresponding to the content of the event is prepared. Specifically, as an event performance, if it is an event of football, it is a performance that is typed by the support of football (refueling), and if it is an event of sumo wrestling, it is each event such as a performance that is typed by the support of sumo The various supports implemented in are appropriately typed performances. Therefore, in the example shown in FIG. 4 , a support type performance that is often performed in baseball is prepared as an event performance. For example, cheers from the audience such as "Wow" and "Oh" are often generated as cheers at baseball events. Therefore, these cheering sounds may be appropriately prepared as an event performance, but in the example of FIG. 4 , a sound performance simulating the cheering sound of "Wow" is prepared as an event performance. As a result, the posting of 1 speech was converted into a voice performance simulating the cheers of "Wow".

Also, after the central server 2 converts the utterance into an event performance (sound performance), it controls the performance device EA in such a way that the event performance is actually realized by the performance device EA in the event facility EF (F6). The performance machine EA performing the event performance may not change (or be the same) regardless of the content of the speech (support) or the status of the baseball (game), but as an example, it may be changed according to the content of the speech (support behavior) . This kind of change is that the cheers of "Wow" become "Come on!", etc. It can also occur in the content of the event performance, but in the example of Figure 4, the performance machine EA that should perform the event performance, that is, the activity facility EF This is achieved by different speakers SP to be performed (controlled) such as all the speakers SP or some of the speakers SP. Specifically, not all the speakers SP of the event facility EF are controlled so that only the speaker SP installed on the third base side performs a sound performance simulating cheers of "Wow" in the example of FIG. 4 . That is, only a part of the speakers SP realizes the active performance according to the content of the speech and the like.

The speaker SP of the performance object can be determined appropriately, but as an example, the content of the speech is to support the visiting team (generally, the team on the third base side), or to post a speech when the visiting team is attacking (generally, the first strike). Time (the time of attack can be specified appropriately, for example, the operator of the event can properly input the information of the offensive side, and it can be specified based on this information), etc., and set it at the third base in the situation where the performance of the third base side should be strengthened The performance machine EA on the side is controlled as an object performing performance. When the home team (generally, the team on the first base side) commits a statement while on offense, it is the same in the situation where the performance on the first base side should be strengthened. On the other hand, for example, when posting a speech about a home run, all the speakers SP installed in the event facility EF are used to add an event performance in a situation where the entire event facility EF should be heated up. In this way, when a plurality of speakers SP are installed (generally installed in different positions) in the event facility EF, these speakers SP (performance equipment EA) are used in appropriate units such as all or a part of them to add to the event performance.

It is also possible to sum up and add the activities and performances corresponding to the contribution of the statement (supporting behavior) after the total of the predetermined period, but as an example, it is added every time the contribution of the statement is made. In addition, such performances may be added without limitation, but as an example, they are added with appropriate restrictions. Specifically, for example, as the moment when a home run or a hit occurs (predetermined time) and the like, the time when baseball activities are actually emotionally high (it can also be used as the time when baseball activities should be heated up. In addition, it is appropriately judged whether it meets the It is also possible to wait for the time, but as an example, the operator of the event provides information on whether the current time is suitable.) If it overlaps with the additional time of the performance, the additional time of the performance will be staggered. That is, during the time when baseball activities are actually hot (hereinafter referred to as the limited time situation), the addition of limited activity performances.

The time limit (not only the time when the baseball event is hot, but also an appropriate time as an addition to the performance that should be avoided) can be appropriately added after the time limit has elapsed. For example, after the time limit has elapsed, the same number of voice performances as the number of submissions corresponding to the time may be added, but as an example, the voice performances corresponding to such submissions are combined into one. Therefore, a total of the number of submissions for a limited time is added, and a different voice performance is added according to the total number. It is also possible to appropriately generate the difference (change) of the voice performance in response to the total count (the number of speeches submitted), but as an example, the voice performance (analog The sound of cheers) changes. Such performance may be performed by an appropriate part of the speakers SP, but as an example, it is performed by all the speakers SP of the event facility EF. As an example, through such a program, the performance (performance service) of the speaker SP (performance device EA) of the stadium EF is realized in conjunction with the posting of the speech (support service). In this example, the limited time functions as the predetermined time of the present invention.

Furthermore, when setting the time limit, the number may be appropriate, for example, a plurality of time limits may be set for one event. Also, when two or more time limits are set at relatively short intervals (for example, when multiple time limits are set at short intervals for one home run), the interval between two time limits (hereinafter referred to as interval time) and It is also acceptable to set the performance time of the additional sound performance in the interval appropriately. For example, the interval time may be the same as or different from the performance time. Also, when the interval time is different from the performance time, the performance time may be shorter or longer than the interval time. For example, when the performance time is longer than the interval time, the volume of the performance may be gradually lowered with the arrival of the next time limit. In this case, a more natural (feeling incongruous) performance can be realized compared to the situation where the voice performance ends (the interval time coincides with the performance time) when the next time limit comes. In addition, the aftertaste of the voice performance can also be expressed through the change of the volume. The performance time may be set to be longer than the end of the next time limit. In this case, it is possible to repeatedly add the sound performance corresponding to the previous limited time (the performance with the aftertaste of gradually decreasing volume) and the sound performance corresponding to the current limited time (the performance with the loudest volume), and it is possible to realize an event closer to reality. The performance of the cheers generated in it.

Furthermore, the interval time may be omitted. That is, the time limit may be set continuously without intervening the interval time. In this case, the audio performance corresponding to the total result of one limited time may be added to an appropriate period including the subsequent limited time. Specifically, the sound performance corresponding to the total result of one time limit may be added in the next time limit, for example. That is, the time limit is configured such that in addition to restricting voice performances that individually reflect each utterance (not a total voice performance corresponding to a predetermined time, but a normal voice performance such as a performance in which each utterance is individually and directly reflected as described above), The time allowed for the voice performance (an example of a special voice performance different from the normal voice performance) corresponding to the total result of the corresponding limited time may also be used. As a result, the limited time serves as a function to reflect only the total period of the voice performances corresponding to the plurality of utterances. Also, it is not limited to the case where two or more limit times are set at relatively short intervals, and the limit time and performance time may be set appropriately. Similarly, the volume change (including the case of no change) at the performance time may also be appropriately set.

Next, the detailed content of the device data DD and the performance data ED will be described. FIG. 5 is a diagram showing an example of the structure of the device data DD. The example in FIG. 5 reveals the device data DD when the performance device EA of the control object is changed according to the content of the speech. At this time, as shown in FIG. 5 , the device data DD includes a device record DDR for managing the location of each performance device EA. Also, in order to realize this kind of management, the device record DDR includes information such as "device ID", "type", and "location".

"Apparatus ID" is information indicating the unique apparatus ID of each performance apparatus EA in order to identify each performance apparatus EA. The machine ID is uniquely assigned to each physical machine. Therefore, for example, two different device IDs are assigned to the two speakers SP. "Type" is information indicating the type of the performance device EA. The performance apparatus EA is distinguished by the type of information, for example, in units of speakers SP and cameras CA. Therefore, for example, the type of information differs between the speaker SP and the camera CA, but the same type of information is given between the two speakers SP. "Position" is information indicating the position where each performance apparatus EA is placed in the event facility EF. The position of each performance machine EA is in response to the scope of the performance object, and it is also possible to set it appropriately. However, for example, the range indicating the first base side and the third base side (in the second form described later is used to identify each player) as each game machine. The unit can also be set in the form of). Record the DDR on the machine, and record the information in a way that correlates with each other. Furthermore, the device data DD is not limited to such information, and appropriate information may be managed in response to requests for control, for example. Alternatively, part of such information may be appropriately omitted.

FIG. 6 is a diagram showing an example of the structure of the performance data ED. As shown in FIG. 6 , the performance data ED includes performance records EDR corresponding to each event performance realized by the performance equipment EA and managing the conditions. Also, in order to realize such management, the show record EDR includes, for example, information of "show ID", "show", "condition", and "object".

"Show ID" is information indicating a show ID unique to each show in order to identify each show. The "performance" is information indicating the performance to be realized by the performance device EA. Specifically, for example, when the speaker SP is used as the performance machine EA, and a voice performance is added as an event performance, information indicating cheers (types) of "Wow" is described in "performance" as a voice performance to be reproduced by each speaker SP. For another example, there may be situations in which voice performances other than the same voice performance ("Wow") are prepared, such as voice performances corresponding to the number of utterances in the time-limited time, but in this case, information indicating voice performances corresponding to the number of utterances Also described as "performance". Specifically, for example, when a voice performance that reproduces the sound of "Papa" (foley for clapping) is prepared as a performance with three stages (types) of different volumes depending on the number of utterances, information indicating "Papa" and Information indicating its volume is described in "performance".

On the other hand, "conditions" are information indicating conditions for applying (realizing) each event performance. Each event performance can be realized appropriately according to various conditions, but for example, if the same event performance is realized with the posting accompanying the speech, the information indicating the posting with the speech is described in "condition". As another example, when realizing the performance of the number of utterances corresponding to the time limit, information indicating the number of utterances is described in "condition" as a condition. Specifically, for example, in the above-mentioned three-stage voice performance of "Papa" with different volumes, the conditions indicating the number of utterances in the situation where the number of utterances are 100 or less, 101 to 200, or 201 or more are respectively passed through " condition" information to establish an association. Also, when the performance is changed according to the content of the speech, such various contents (conditions) are described in "conditions".

The "object" is the information of the performance apparatus EA representing the object (control object) that should execute each performance. "Object" is used when the performance device EA controlling the object changes according to the performance (in other words, when the performance device EA controlled is all or part of it, it may be omitted if it does not change). In the "object", for example, appropriate information indicating the performance equipment EA which is the object such as the equipment ID may be described, but as an example, when all the performance equipment EA is the object, describe all the information, and when a part is the object, describe Indicates a portion of information. In addition, as part of the information displayed, appropriate information may be used in response to a request from the control unit, but as an example, the support range of the supporting team (the third base side when supporting the away team, etc.) corresponding to the statement is described, or the display is used. Information on the condition of the control object on the offensive side at the time of specifying the speech. In performance recording EDR, it is recorded in such a way that such information is associated with each other. Furthermore, performance data ED is not limited to such information, and appropriate information may be managed in response to requests for performances to be managed (including the status of using performance equipment EA other than speakers SP). Alternatively, part of such information may be appropriately omitted.

Next, the performance control processing and post-performance processing will be described with reference to FIGS. 7 and 8 . Both the performance control processing and the post-performance processing are used to control the processing of the performance machine EA in the manner of executing the active performance according to the support behavior of the photographic image. More specifically, the performance control process is used to control the processing of the performance machine EA according to the support behavior outside the time limit when the time limit is set. The example of FIG. 7 discloses an example of performance control processing for realizing the control of the speaker SP (performance machine EA) of the example of FIG. 2 in such a situation. At this time, the machine service management unit 26 starts the performance control process of FIG. 7 every time it posts a speech (execution support action) outside the limited time, and first obtains the input result (posted speech) input through the user terminal device 4 ( Step S101).

Next, the device service management unit 26 converts the input result (posted statement) acquired in step S101 into an event performance (step S102). This conversion is performed on the basis of performance data ED. Specifically, the equipment service management unit 26 refers to the information of "condition" and "performance" in the performance data ED, and determines the event performance corresponding to the condition of utterance. Then, the appliance service management unit 26 specifies the identified event performance as a conversion target. That is, the device service management unit 26 converts the posted speech into a specified event performance. Furthermore, when the performance is changed in response to the content of the speech, such various contents (conditions) are described in the "condition", so the equipment service management unit 26 refers to these conditions in step S102, and specifies the event performance that meets the conditions. Can.

Next, the appliance service management unit 26 specifies the speaker SP to be controlled, that is, the speaker SP to execute the event performance converted in step S102 (step S103). This specification is realized as follows based on the "object" information of the performance data ED and the device data DD. The device service management unit 26 first refers to the "object" information of the performance data ED, and determines the conditions for specifying the control object to execute the event performance converted in step S102. For example, when changing the control object according to the support team of the statement, information indicating the support range of the support team etc. is described in "object". Therefore, the device service management unit 26 determines the supporting team based on the content of the statement. Then, the device service management unit 26 further refers to the "position" information of the device data DD, and specifies each speaker SP located in the range (first base side, etc.) corresponding to the determined supporting team as a control object. Similarly, in the case of changing the control target when posting a statement, information such as the attack side at the time of the statement is described in "object" as a condition. At this time, the device service management unit 26 refers to the information of "position" in the device data DD while discriminating the posting of the speech, and specifies each speaker SP on the attacking side at the time of posting the speech as a control object.

Next, the device service management unit 26 controls the speaker SP specified in step S103 so as to realize the event performance converted in step S102 (step S104). That is, the machine service management unit 26 implements the event performance converted in step S102 through the speaker SP specified in step S103. Then, after such control, the device service management unit 26 ends the present performance control process. Thereby, the support action (posting of a speech) to a photographic image is converted into a performance by the speaker SP, and this performance is realized by the speaker SP actually installed in the event facility EF. Also, the performance is realized through the speakers SP associated with the supporting action in the event facility EF. That is, the support by viewers accompanying the photographic image is added to the event of the event facility EF through the speaker SP for the event performance of the content.

On the other hand, post-performance processing is used to control the processing of the performance machine EA according to the support actions executed within the time limit in the situation where the time limit is set. The example in FIG. 8 discloses an example of post-performance processing for realizing the control of the speaker SP (performance machine EA) in the example in FIG. 2 . Also, the performance of the support behavior (posting of a speech) based on the time limit may be added at an appropriate time after the time limit has elapsed. However, the example in FIG. At this time, the machine service management unit 26 starts the after-event performance processing of FIG. 8 every time a predetermined period after the limited time has elapsed, and first acquires the input result (posted input) inputted through the user terminal device 4 within the latest limited time. speaking) (step S201).

Next, the appliance service management unit 26 calculates (totals) the number of utterances input during the latest time limit based on the input result acquired in step S201 (step S202). This calculation may be implemented appropriately. For example, if the content of the supporting action and the type of event performance are different, it may be executed corresponding to each type. When the posting accompanying the speech is attached to the same event regardless of the content, it is as follows Execute simply by accumulating the number of speeches within a time limit.

Next, the device service management unit 26 converts the time-limited posting speech (supporting behavior) into an event performance based on the obtained result of step S201 and the calculation result of step S202 (step S203). This conversion is the same as the conversion in step S102 in the example of FIG. 7 , and is implemented based on the performance data ED. Specifically, the equipment service management unit 26 refers to the information of "condition" and "performance" of the performance data ED, and judges an event performance whose condition has the number of utterances calculated in step S201. Then, the appliance service management unit 26 specifies the identified event performance as a conversion target. That is, the device service management unit 26 converts all the speeches posted within a time limit into one specific event performance.

Next, the appliance service management unit 26 specifies the speaker SP to be controlled, that is, the speaker SP to execute the event performance converted in step S203 (step S204). This identification is similar to the identification of step S103 in the example of FIG. 7, based on the "object" information of the performance data ED and the device data DD, as described below. The device service management unit 26 first refers to the "object" information of the performance data ED, and determines the condition for specifying the control object to execute the event performance converted in step S203. This judgment is the same as step S103 in the example of FIG. 7 , but for example, when "object" records all the information, the equipment service management unit 26 refers to the equipment data DD to specify all the equipment installed in the event facility EF as the control object. Speaker SP.

Next, the appliance service management unit 26 controls the speaker SP specified in step S204 so as to realize the event performance converted in step S203 (step S205). That is, the machine service management unit 26 implements the event performance converted in step S203 through the speaker SP specified in step S204. Then, after such control, the device service management unit 26 ends the post-show processing of this time. Thereby, the number of postings (the number of supporting actions) of the time-limited talk is calculated, and the event performance according to the number of postings is realized by speakers SP (for example, all speakers SP) actually installed in the event facility EF.

As described above, according to the first aspect, the support behavior of the viewer who watches the photographic image of the event is converted into an event performance, and the performance device EA is controlled so that the converted event performance is added to the event. More specifically, the speaker SP is controlled so that the posting of the utterance by the viewer of the video screen 50 is converted into a sound performance simulating cheers of "Wow", and the sound performance is reproduced. That is, the image screen 50 including the photographic image of baseball action is displayed on the user terminal device 4, and the posting of the speech for giving the speech is accepted on the video screen 50, but the posting of the speech is converted into the speaker SP. The voice performance is so special that it is actually added to the baseball game. In this way, the viewer's response to the speech posted on the photographic video can be reflected in the baseball game as a sound performance by the speaker SP installed in the stadium EF. Specifically, for example, it is possible to reflect the emotion of the viewer by posting tense scenes or speeches when supporting players, etc., in actual baseball activities through sound performances. As a result, it is possible to realize a realistic baseball action for the baseball player (or for the viewer) compared to the case where such an audio performance is not added.

Also, when the performance of the activity is changed in response to the supporting behavior, a specific supporting behavior can be promoted through the change of the performance of the activity. For example, in the example of FIG. 4, the same voice performance is added as an event performance outside the time limit. However, during the time limit, the cumulative number of speeches corresponding to the time is added. The larger the cumulative number, the more lively it is. Event performance. At this time, the increase in the number of submissions of time-limited speeches can be promoted through changes in such event performances. As a result, for example, when the time limit is set to a home run, it is possible to further promote the posting of a statement about such a home run, so that the event performance for the next home run can be made more lively.

Also, at a baseball event, a voice performance simulating the cheers of "Wow" is used as an event performance corresponding to the posting of a speech, but this voice performance varies depending on the type of event. For example, the situation of football is a performance that simulates cheers of football as an event performance. In general, effective performances tend to vary depending on the type of activity. However, when performing performances with different sounds that follow the cheers of the activity, this tendency can be reflected and more effective performances can be achieved. activity performances.

In the first form, the equipment service management unit 26 of the central server 2 functions as the performance conversion means and the equipment control means of the present invention by executing the performance control processing in FIG. 7 or the subsequent performance processing in FIG. 8 . Specifically, the device service management unit 26 of the central server 2 functions as a performance conversion means by executing the process of step S102 in FIG. 7 or the process of step S203 in FIG. 8 . Furthermore, the service management unit 26 for equipment of the central server 2 functions as equipment control means by executing the process of step S104 in FIG. 7 or the process of step S205 in FIG. 8 .

(second form) The video delivery system 1B of the second aspect will be described with reference to FIGS. 9 to 12 . FIG. 9 is a diagram showing a schematic structure of the video delivery system 1B of the second embodiment. The video delivery system 1B of the second form corresponds to an example of the structure of the video delivery system 1 when an event using a game provided by the game machine 3 (hereinafter referred to as a game event) is held as a type of event. At this time, as shown in FIG. 9 , the game machine 3 installed in the event facility EF is connected to the central server 2 through the network NF.

The game machine 3 is a device that provides games. As the game machine 3, various computer devices (including user terminal devices) for personal use such as fixed or portable game machines (including tablet computers or smart phones), or fixed or notebook personal computers can be used. 4) It is also possible, however, to use an arcade machine in the example of FIG. 9 . Arcade machines are computer devices installed in various facilities such as shops with the main purpose of increasing revenue by repeatedly playing games for many users. Therefore, the game machine 3 is configured as a commercial (business use) game machine (a game machine that provides games for a fee) that allows users to play games within the range corresponding to the game fee in consideration of the payment of a predetermined game fee. . When the game machine 3 is installed in the event facility EF, it is also possible to provide the game at a predetermined play fee as in the case where it is installed in a store. However, in the example of FIG. 9 , the game is provided free of charge.

The game machine 3 may provide appropriate games such as action games, simulation games, role-playing games, timing games (music games), or sports games for game events. The game machine 3 may provide these games as one person (individually) plays, and may provide these games as plural games. In addition, in the case of multiple play, the game system is in an appropriate form such as 1-to-1, 1-to-many (team), or many-to-many (the number of people is appropriate, and they can be consistent or inconsistent), as a battle type, or It is also possible to provide a cooperative game (including the case where the player or the cooperative player is a computer). Therefore, an appropriate number of game machines 3 may be installed in the event venue EF in response to such various games, and in the example of FIG. 9 , two or more game machines 3 are installed in the event venue EF. Then, these 2 game machines 3 are respectively provided through these 2 game machines 3, and 2 users P (hereinafter referred to as the situation of players P) who play the game respectively play a game against each other in a 1-on-1 manner. game.

The game event may be constituted as a tournament in which results are competed in an appropriate form such as a tournament or a league, or may be constituted as a party in which only mutual announcements are made. Also, the game event may be an event without spectators or an event with spectators. In this way, the game event may be appropriately configured according to the type of game, etc., but in the example of FIG. audience activity.

In the event venue EF, various performances for performing (heating up) game events may be performed, and the performance machine EA may include various machines for realizing such various performances. However, in the example of FIG. 9 , the lighting unit is included. LU, speaker SP, smoke device SU, display MO, and camera CA. In other words, in the event venue EF, as the performance machine EA, the lighting unit LU, the speaker SP, the smoke device SU, the display MO, and the camera CA are set (in the example of FIG. However, none of these is limited to one, and an appropriate number may be provided).

The lighting unit LU is a well-known lighting device that executes various visual performances by lighting (light) such as lighting, blinking, and lighting, or appropriate color development. The smoke device SU is a well-known device that performs a visual performance by generating an appropriate amount of smoke (smoke). The display MO is a well-known display device that displays various images (including performances and various information). On the display MO, for example, as an image for performance, the shooting result of the camera CA or the game screen provided by each game machine 3 may be appropriately displayed.

Also, as described above, the service system for equipment may appropriately include various services, but in the case of the video delivery system 1B of the second aspect, information acquisition services are included. The information obtaining service is a service for obtaining information (including replay data and image data) of the game status of each player P from each game machine 3 . For example, when the service system for the machine is also included in the game performance information of each player P through various data such as play data and is managed in the central server 2 as part of the server data 23, such data reflects such play. A data update service for status information is also available.

FIG. 10 is a functional block diagram showing main parts of the control system of the video delivery system 1B of the second embodiment. In the video delivery system 1B of the second form, the game machine 3 is added to the device connected to the central server 2 compared to the video delivery system 1B of the first form (the example in FIG. 2 ). As shown in FIG. 10, such a game machine 3 is provided with a control unit 31 as a computer and a memory unit 32 as memory means. The control unit 31 is a computer composed of a CPU as an example of a processor that executes various arithmetic processing and motion control according to a predetermined computer program, internal memory and other peripheral devices required for its operation.

In the control unit 31, a game control unit 33 and a data management unit 34 are provided as logic devices realized by a combination of hardware resources of the control unit 31 and the game program PG3 as software resources. The game control unit 33 executes various processes required for providing the game (including various processes required for enjoying the service of the device). Similarly, the data management unit 34 executes various processes for managing the data stored in the storage unit 32 (including various processes necessary for enjoying the service for the device). Such processing includes, for example, processing for generating or transmitting image data for displaying a game screen.

The memory unit 32 is an external memory device realized by a memory unit including a non-volatile memory medium (computer-readable memory medium) such as a hard disk and a semiconductor memory device. In the memory part 32, various data are recorded together with the above-mentioned game program PG3, and in the example of FIG. 10, the game data GD is revealed. The game data GD is used to comply with the game program PG3, in order to allow the user to play the game as appropriate reference data. The game data GD may suitably include various data such as audio data for reproducing game sounds, image data for displaying game screens, the above-mentioned play data, or ID management data.

Various output devices and input devices required for the arcade are properly installed on the game machine 3, and can be connected to the control unit 31. However, in the example of FIG. IP. The display 36 and the speaker 37 are a well-known display device for displaying various images related to the game for providing a game screen and the like, and a well-known sound output (reproduction) device for reproducing sound, respectively. The input device IP is a device used by the player P to input various playing behaviors for playing the game. As the input device IP, various input devices such as push key switches and touch panels may be appropriately used depending on the type of game or the like. Moreover, as mentioned above, in the performance machine EA of the second form, including the lighting unit LU, the smoke device SU, or the display MO, etc., these are also connected to the central server 2, but this is omitted in the example of FIG. 10 . etc. reveal that as the performance machine EA, only the camera CA and the speaker SP are disclosed.

Next, details of the performance service of the second aspect will be described with reference to FIG. 11 . Fig. 11 shows an example of the flow of the performance service of the second aspect. Also, the example in FIG. 11 is the same as the first form, and shows that the performance of the performance device EA is linked to the support service, and as an example of the support service, a service of posting comments is provided. On the other hand, in the performance service of the second aspect, the status of the game machine 3 is reflected in the performance linked to the supporting action (posting of a speech). Therefore, as shown in FIG. 11 , the program of F5A is added to the performance service of the second form compared to the performance service of the first form (the example in FIG. 4 ). As a result, the performance service of the second form includes three programs of F5A, F5B, and F6.

Specifically, the support service system includes the programs of F1 to F4 similarly to the example in FIG. 4 . These procedures can also be realized in the same way as the example in FIG. 4 . On the other hand, in the performance service of the second aspect, information is transmitted from the game machine 3 as a program not included in the example of FIG. 4 (F5A). This transmission may be performed at an appropriate cycle or various actions (processing) such as posting (F3) of a statement, but in the example of FIG. Along with (or after) this delivery, delivery from the game machine 3 is performed in response to a request from the central server 2 . In the event performance corresponding to the posting of the speech, various situations of the game machine 3 may be appropriately reflected according to the situation of the performance, etc., but as an example, the game play situation is reflected. Therefore, when the utterance is transmitted, the game machine 3 transmits information on the game play status at the time of the utterance transmission to the central server 2 .

When the central server 2 obtains the information of the game status from the game machine 3, it converts the speech contribution into a performance through the performance machine EA of the event facility EF (not only the speaker SP, but also a light unit LU, a smoke device SU, or a display MO as appropriate. etc.) (F5B). This conversion is realized in the same manner as the procedure of F5 in the example of FIG. 4 . However, the game state may be appropriately reflected in this conversion. For example, when providing a baseball game corresponding to the baseball of the first form, the information of the game state may be used (reflected) for judging an offense. Furthermore, for example, if there is a "nice hit!" immediately after a hit, and "a nice home run!" immediately after a home run (or as a display on the monitor MO), it is reflected in the content of the event performance. also can. In other words, the event performance may be changed (different) according to the playing status of the game. At this time, in the "performance" of the performance data ED, there is a description of "nice hit!", or a corresponding "nice home run!" information. Also, in "Condition" of the performance data ED, information indicating a condition for a hit or information indicating a condition for a home run is described. In any case, the central server 2 converts speech submissions into event performances according to the game status when the game status is reflected in the conversion of the performance.

After the conversion of the event show, the central server 2 controls the show machine EA (F6) in the same way as the program of F6 in the example of FIG. However, the game state may be appropriately reflected on the control. Specifically, for example, according to the game status, the attacking side is determined, and the performance machine EA to be controlled is specified. That is, the performance device EA to be controlled is appropriately changed according to the play situation. As another example, when providing a baseball game corresponding to the baseball in the first form, information on the game status may be used (reflected) for time-limited judgment. Specifically, the central server 2 refers to the information on the game status, and judges whether or not there is a posting comment during the emotionally high time (limited time) when a hit or the like occurs. Furthermore, the central server 2 may sum up the number of time-limited utterances in the same manner as in the example of FIG. For example, when the operator of an event sets a time limit, the time limit may be a certain period before and after a hit, not just at a moment when emotions are high, such as after a hit. On the other hand, when judging the time limit according to the play situation, there is a high possibility that the time limit can be set more accurately than the setting by the operator of the event only after a hit. Therefore, in the second form, unlike the first form, the central server 2 does not collect the time-limited speeches as one and add them to the additional period, but individually adjusts the performance period corresponding to each speech contribution. .

Next, the performance adjustment processing will be described with reference to FIG. 12 . The performance adjustment processing is performed instead of the performance control processing of the example in FIG. 7 and the post-performance processing in the example of FIG. 8 when individually adjusting the timing of the event performance of each speech post corresponding to the time limit. More specifically, the performance adjustment process is a process for realizing the performance corresponding to each comment post outside the time limit at any time while individually adjusting the performance period of each comment post corresponding to the time limit when the time limit is set. Furthermore, for example, when the contribution of each statement with a time limit is added as one event performance in a predetermined period, in the second form, the performance control processing of the example of FIG. 7 and the post-performance processing of the example of FIG. 8 are also executed. Can. In this case, the information on the play status of the game may be appropriately referred to, for example, it may be referred to for determination of time limit. Alternatively, it may be referred to in the transition of step S102 or the control of step S103 in the example of FIG. 7 .

The machine service management unit 26 starts the performance adjustment process of FIG. 12 every time a speech is posted, and first acquires the input result (posted speech) input through the user terminal device 4 (step S301). Next, the machine service management unit 26 acquires the game play status from the game machine 3 (step S302). If the machine service management unit 26 obtains the game status, it converts the speech posted according to the information of the game status and the input result obtained in step S301 into an event performance (step S303). The transformation of step S102 of the example is implemented in the same way. However, in this conversion, the device service management unit 26 may appropriately refer to the information on the play status of the game. Specifically, for example, when different event performances are made depending on the playing status of the game, the machine service management unit 26 realizes the event performance according to the playing status while referring to the information of "performance" and "condition" in the performance data ED. convert.

Next, the appliance service management unit 26 judges whether or not the adjustment condition is satisfied (step S304). The adjustment condition may be appropriately satisfied, but when the adjustment is realized within the time limit, it is satisfied when the posting period of the speech meets the time limit. Therefore, the device service management unit 26 refers to the information on the game status acquired in step S302, and judges whether or not the posting period of the speech corresponds to the time limit (a time when the mood such as a hit occurs). When the comment posting time corresponds to the time limit (adjustment condition is satisfied), the device service management unit 26 adjusts the event performance time (performance time) corresponding to the comment posting (step S305). Specifically, the machine service management unit 26 sets the performance period as not the posting period of the speech (there may be a slight deviation due to various processes, or the communication environment of the network NT, etc., but the posting period of such deviations is taken into consideration. ), but adjusted towards a predetermined period (for example, shortly after) after the time limit has elapsed. Also, when posting multiple speeches within a time limit, the performance period of each speech is sequentially staggered from the predetermined time period in such a way that the performances corresponding to each speech are performed sequentially after the time limit has elapsed in response to the submission period.

On the other hand, the device service management unit 26 specifies the control object when the posting time of the speech does not correspond to the time limit (the adjustment condition is not satisfied), or after the performance time is adjusted in step S305 (step S306). This specification is, for example, implemented in the same manner as the specification of step S103 in the example of FIG. 7 . However, in this specification, the device service management unit 26 may appropriately refer to the game status. Specifically, for example, when the control target changes according to the posting time of the statement, the device service management unit 26 refers to the information on the game status and determines the condition of the "target" such as when attacking.

Next, the appliance service management unit 26 controls each speaker SP (step S307). This control is realized, for example, in the same manner as the control of step S104 in the example of FIG. 7 . Thereby, like the example of FIG. 7, the posting of each speech is converted into a performance, and this performance is realized by the speaker SP etc. which are actually installed in the event facility EF. Also, when posting speeches within a time limit, adjust the timing of the event performances corresponding to each speech, and after the time limit elapses, the event performances corresponding to each speech are gradually added to the events of the event facility EF through speakers SP and the like.

As explained above, according to the second aspect, as in the first aspect, the support behavior of the viewer of the photographic image of the audio-visual event is converted into an event performance, and the performance is controlled in such a manner that the converted event performance is added to the event Machine EA. Therefore, the same effects as those in the first form can be obtained, but in the second form, the information of the play status of the game is referred to for switching of the event performance or specifying the performance device EA to be controlled. As a result, the game play status of the game machine 3 can be reflected in the event performance. Thereby, more detailed and accurate event performance can be realized.

In the second aspect, the equipment service management unit 26 of the central server 2 functions as the performance conversion means and the equipment control means of the present invention by executing the performance adjustment processing shown in FIG. 12 . Specifically, the device service management unit 26 functions as a performance conversion means by executing the process of step S303 in FIG. 12 . Moreover, the service management unit 26 for equipment functions as the equipment control means of the present invention by executing the processing of step S305 and the processing of step S307 in FIG. 12 .

The present invention is not limited to the above-mentioned form, and may be implemented in a form in which appropriate deformation or change is added. For example, other systems (or devices) such as the regional system, the game machine 3 (the situation of the second form), or the user terminal device 4 appropriately execute all or all of the functions (various processing, etc.) Part of it is fine. That is, the image delivery system of the present invention may include various other systems as appropriate. On the other hand, only the central server 2 may have the function as the image delivery system of the present invention, and only other appropriate systems such as the regional system, the game machine 3 (the situation of the second form), or the user terminal device 4 have this function. The function of the image delivery system of the invention is also possible.

Various aspects of the present invention derived from the above-mentioned embodiments and modifications are described below. In addition, in the following description, in order to understand various aspects of this invention easily, the corresponding member shown in drawing is added in parentheses, However, this invention is not limited to the form of illustration.

The image transmission system of the present invention is connected to the user terminal device (4) used by each user through the network (NT), and the performance equipment (EA) installed in the event facility (EF) in the form of additional performance, In addition, the display device (46) installed in the aforementioned user terminal device displays an image screen (50) including a photographed image (50) which is a photographed result of an event held in the aforementioned event facility, and transmits the aforementioned photographed image to The image transmission system (1) of the aforementioned user terminal device is provided with: performance conversion means (26), which is executed by each viewer who is a user who views and listens to the aforementioned photographic image through the aforementioned user terminal device to convert the aforementioned video image When imparting a supporting action that supports the aforementioned action with a supporting effect, the supporting action is converted into an active performance that the aforementioned performance machine should perform; and the machine control means (26) is controlled in such a way that the aforementioned active action is added to the aforementioned action as the aforementioned action The aforementioned performance machine.

According to the present invention, the supporting behavior of the viewer of the photographic image of the audio-visual event is converted into an event performance, and the performance machine is controlled in such a way that the converted event performance is added to the event. That is, a video screen including a photographic image of an event is displayed on a user terminal device, and a supporting action for imparting a supporting effect is accepted on the video screen, but the supporting action is converted into an active performance by a performance machine, And the activity show is actually attached to the activity. In this way, the support behavior of the photographic image, that is, the audience's reaction, can be reflected in the event as a performance by the performance machine installed in the event facility. Specifically, for example, the emotions of the viewers can be heightened and reflected in actual activities through activity performances. As a result, activities with a sense of presence can be realized compared to a situation where such an activity performance is not added.

The content (conditions) such as the time period, quantity, and type of the support activities may be the same regardless of the content (conditions) of the event performance, and may be changed according to the content of the event. For example, in one aspect of the video delivery system of the present invention, the aforementioned performance conversion means may convert the aforementioned support behavior into the aforementioned activity performance in such a way that the aforementioned activity performance is changed in response to the aforementioned support behavior of each viewer. At this point, changes in the performance of the event can be used to promote supportive behavior for specific content. For example, in this aspect, the above-mentioned performance conversion means is to change the above-mentioned activity performance in response to the number of the above-mentioned supporting behaviors at the above-mentioned predetermined time when the plurality of viewers perform the above-mentioned supporting behaviors in the predetermined time. It is also acceptable to convert the supporting behavior into the performance of the above-mentioned activities. At this time, the increase in the number of supporting behaviors at a given time can be promoted through changes in the performance of the event.

As a supporting action, various actions for producing various effects on the image screen may be properly executed through the user terminal device. For example, as a supporting action, the action of purchasing items as appropriate, the action of providing (so-called tipping) various values (the value equivalent to the actual currency in circulation can also be used, and the virtual value used in the game, etc.) Acts of posting various speeches on the screen are also acceptable. Then, these various actions may be appropriately converted into live performances. Specifically, for example, in one aspect of the video delivery system of the present invention, the aforementioned performance conversion means is used as the aforementioned supporting action on the aforementioned video screen, and when inputting contributions as the speeches displayed by the aforementioned supporting effects, the aforementioned It is also possible to convert the contribution of the speech into the above-mentioned event performance.

As mentioned above, the performances of the activities can be the same or can be changed. In the same situation, they can be the same regardless of the activities, and they can be the same in each activity. That is, the event performance system may be changed or not changed corresponding to each event. For example, in one aspect of the video delivery system of the present invention, the aforementioned performance conversion means may convert the aforementioned supporting behavior into the aforementioned event performance in such a way that the aforementioned event performance is different in response to the aforementioned activity. In general, effective performance tends to vary depending on the type of event, but in this case, it is possible to reflect this tendency and realize a more effective event performance.

The performance machine may include various machines (devices) for performing a performance. For example, the performance machine may appropriately include a display device, lighting, smoke device, etc. for additional visual performance. In addition, the performance machine may include an audio output device for additional visual performance. Then, appropriate performances may be realized by these various performance machines. Specifically, for example, in one aspect of the image transmission system of the present invention, the aforementioned performance conversion means includes a sound output device (SP) that outputs sound to the aforementioned performance machine, and when the aforementioned performance includes a sound performance through the aforementioned sound, The voice supporting the aforementioned activity may be included in the aforementioned activity performance as the aforementioned voice performance that differs according to the aforementioned activity, or the aforementioned supporting act may be converted into the aforementioned activity performance.

In the event facility, various events are appropriately held. For example, various sports such as baseball, sumo wrestling, soccer, and rugby may be held in event facilities. Similarly, in the event facility, various live events such as concerts may be held. Alternatively, in the event facility, a game event using a game machine may be held. Also, when various machines are installed in the event facilities for game machines, etc., the information of these machines may or may not be reflected in the event performance. Specifically, for example, in one aspect of the image transmission system of the present invention, a game machine (3) providing games is provided in the aforementioned event facility; as the aforementioned event, a game event using the aforementioned game is held; the aforementioned machine control means is connected to When the aforementioned game machine is connected through a network (NT), it is also possible to control the aforementioned performance machine by adjusting the period of the aforementioned event performance in response to the situation of the aforementioned game. Also, for example, in one aspect of the image transmission system of the present invention, a game machine (3) providing games is provided in the aforementioned event facility; as the aforementioned event, a game event using the aforementioned game is held; When NT is connected to the aforementioned game machine, it is also possible to convert the aforementioned supporting behavior into the aforementioned event performance in a way that is inconsistent with the aforementioned game situation and the aforementioned event performance. In these situations, the game play status of the game machine can be reflected in the event performance.

When a plurality of performance machines are installed in an event facility, the event performance may be performed by all of them, or may be realized by an appropriate part. In addition, the performance machines of these objects (when the performance is performed by all the performance machines, it is all, and when a part is performed, it is a part of the performance machines that perform the activity performance) may be fixed or variable. Can. When the performance machine of the object is variable (changing), including the difference of the performance machine, it may be regarded as an active performance, and the difference of the performance machine may be regarded as other elements different from the active performance. For example, in one aspect of the image transmission system of the present invention, the aforementioned machine control means is to change the execution of the multiple playing machines in response to the situation of the aforementioned game when the aforementioned playing machines include multiple playing machines arranged in different positions of the aforementioned event facility. The performance machine of aforementioned activity performance also can.

On the other hand, the computer program of the present invention is constituted in such a way that the computer (21) connected to the aforementioned user terminal device and the aforementioned performance device through the aforementioned network has the functions of each means of the aforementioned image delivery system .

In addition, the control method of the present invention is to connect to the user terminal device (4) used by each user through the network (NT), and the performance equipment (EA) installed in the event facility (EF) in the form of additional performance. ), and the display device (46) installed in the aforementioned user terminal device displays the imaging screen (50) including the imaging results of the activities held in the aforementioned activity facilities, that is, the imaging image (50), displaying the aforementioned imaging image The computer (26) incorporated in the image delivery system (1) transmitted to the aforementioned user terminal device executes the following program: the performance conversion program is performed by each viewer as the user of the aforementioned photographic image through the aforementioned user terminal A device for converting the supporting action into an active performance to be performed by the aforementioned performing machine when performing a supporting action for imparting a supporting effect to the aforementioned video image to support the aforementioned action; and a machine control program that uses the aforementioned active action as an additional Control the aforementioned performing machines in the manner of the aforementioned activities. By executing these computer programs or control methods, the image delivery system of the present invention can be realized.

1: Image delivery system 1A: Image delivery system 1B: Image delivery system 2: Central server 2A, 2B: server unit 3: game console 4: User terminal device 4A: Mobile terminal device 4B: Portable tablet terminal device 4C: Personal Computer 21: Control unit (computer) 22: Memory Department 23: Server information 26: Machine service management department (performance conversion means, machine control means) 27:Web Service Management Department 31: Control unit 32: memory department 33: Game Control Department 34:Data Management Department 36: display 37:Speaker 41: Control unit 42: Memory Department 43: Image Control Department 44:Data Management Department 46: display 47:Speaker 50: image screen 51: Submission button EFI: Stadium Image VD: video data DD: machine data DDR: Machine Record ED: performance information EDR: Performance Record GD: Game data TD: terminal data TP: touch panel LU: light unit IP: input device CA: camera EA: Show Machine EF: Event Facility NT: Network SP: Speaker (sound output device) SU: smoke device MO: monitor PG1: Program for server (computer program) PG2: terminal program PG3: game program

[ Fig. 1] Fig. 1 is a diagram showing a schematic structure of an image delivery system according to an aspect of the present invention. [ Fig. 2 ] A diagram showing a schematic structure of the video transmission system of the first aspect. [ Fig. 3] Fig. 3 is a functional block diagram showing the main parts of the control system of the video delivery system of the first aspect. [FIG. 4] A diagram showing an example of the flow of the performance service of the first aspect. [FIG. 5] A diagram showing an example of the structure of the device data. [FIG. 6] A diagram showing an example of the structure of performance data. [ Fig. 7 ] A flowchart showing an example of a program of performance control processing. [ Fig. 8 ] A flowchart showing an example of a program of post-show processing. [ Fig. 9 ] A diagram showing a schematic structure of a video transmission system of a second aspect. [ Fig. 10] Fig. 10 is a functional block diagram showing main parts of the control system of the video delivery system of the second aspect. [ Fig. 11 ] A diagram showing an example of the flow of the performance service of the second aspect. [ Fig. 12 ] A flowchart showing an example of a program of performance adjustment processing.

2: Central server

4: User terminal device

50: image screen

51: Submission button

EFI: Stadium Image

CA: camera

EF: Event Facility

SP: speaker

Claims (11)

An image transmission system, which is connected to the user terminal devices used by each user through the network, and the performance machines installed in the event facilities in the form of additional performances, and used on the display devices installed in the aforementioned user terminal devices, A method of displaying an image screen including a photographed image as a photographed result of an event held in the aforementioned event facility, and transmitting the aforementioned photographed image to the aforementioned user terminal device, is characterized in that it has: a performance conversion means, When each viewer who is a user who views the aforementioned photographic image performs a supporting action for imparting a supporting effect to the aforementioned video screen to support the aforementioned event through the aforementioned user terminal device, the supporting action is converted into the reality of the aforementioned event facility The activity performance to be performed by the aforementioned performance machine in the space; and the machine control means control the aforementioned performance machine in such a way that the aforementioned activity performance is added to the aforementioned activity. The image delivery system as described in Claim 1, wherein the performance conversion means converts the aforementioned support behavior into the aforementioned activity performance by changing the aforementioned activity performance in response to the aforementioned support behavior of each viewer. The image transmission system as described in Claim 2, wherein the performance conversion means is to respond to the aforementioned support at the aforementioned predetermined time when the plurality of viewers respectively perform the aforementioned supporting actions at the predetermined time The amount of behavior, the way in which the aforementioned activity performance changes, the conversion of the aforementioned supporting behavior into the aforementioned activity performance. The image delivery system as described in Claim 1, wherein the performance conversion means is to convert the contribution of the speech when inputting and submitting a speech as the speech displayed by the support effect on the video screen as the support action into the performance of the aforementioned activities. In the image delivery system as described in Claim 1, wherein the performance conversion means converts the aforementioned supporting behavior into the aforementioned activity performance by making the aforementioned activity performance different in response to the aforementioned activity. The image transmission system as described in claim 5, wherein the performance conversion means includes a sound output device that outputs sound to the performance machine, and when the performance includes a sound performance through the sound, the sound that supports the activity is used as the The above-mentioned voice performance that differs according to the above-mentioned activity is included in the above-mentioned activity performance, and the above-mentioned supporting behavior is converted into the above-mentioned activity performance. The video transmission system as described in any one of Claims 1 to 6, wherein a game machine for providing games is installed in the aforementioned event facility; as the aforementioned event, a game event using the aforementioned game is held; the aforementioned machine control means is in When connecting the aforementioned game consoles via the network, adjust the timing of the aforementioned event performances in response to the aforementioned game conditions mode to control the aforementioned performing machines. The image delivery system as described in any one of Claims 1 to 6, wherein a game machine for providing games is installed in the aforementioned event facility; as the aforementioned event, a game event using the aforementioned game is held; the aforementioned performance conversion means is in When the aforementioned game machine is connected through the network, the aforementioned supporting behavior is converted into the aforementioned event performance in a manner that is inconsistent with the aforementioned event performance in response to the aforementioned game situation. In the image delivery system as described in Claim 7, wherein the aforementioned machine control means is to change which of the plurality of playing machines should be changed in response to the conditions of the aforementioned game when the aforementioned playing machines include multiple playing machines arranged in different positions of the aforementioned event facilities. A performance machine performing the performance of the preceding activity. A recording medium storing a computer program, characterized in that: the computer program is such that a computer connected to the aforementioned user terminal device and the aforementioned performance machine through the aforementioned network has an image of any one of claims 1 to 9 The way to construct the function of each means of delivery system. A control method, characterized in that it is connected to the user terminal device used by each user through the network, and the performance machine installed in the event facility in the form of additional performance, and the display installed on the aforementioned user terminal device A device for displaying an image screen including a photographic image as a result of photographing an event held in the aforementioned event facility, and transmitting the aforementioned photographic image to the image transmission device of the aforementioned user terminal device The computer integrated in the delivery system executes the following program: The performance conversion program is executed by each viewer who is a user of the aforementioned photographic image through the aforementioned user terminal device to provide support for the aforementioned event to the aforementioned image screen In the case of a supporting action of an effect, the supporting action is converted into an active performance to be performed by the aforementioned performance machine in the real space of the aforementioned activity facility; and the machine control program is to control the aforementioned performance in such a way that the aforementioned active performance is added to the aforementioned action machine.

Images