TW202205868A - Video distribution system, computer program used therein, and control method - Google Patents

Abstract

Provided is a video distribution system capable of reflecting, to an event, the reaction of a viewer who viewed a captured video of the event, as a production by production equipment. A video distribution system (1) is connected, via a network (NT), to a user terminal device (4) and speakers (SP) installed at an event facility (EF), and distributes a captured video to the user terminal device (4) such that a video screen (50) including the captured video, which is a result of the capture of an event held at the event facility (EF), is displayed to a monitor (46) disposed on the user terminal device (4). In addition, if any of the viewers viewing the captured video contributes a post for adding a comment cheering the event to the video screen (50) via the user terminal device (4), the video distribution system (1) converts the post to an audio production to be performed by the speakers (SP). The video distribution system (1) controls the speakers (SP) so as to add the audio production to the event.

Description

Image delivery system, recording medium for storing computer program used therefor, and control method

The present invention relates to a performance machine connected to a user terminal device used by each user through a network, and a performance machine installed in an event facility by means of an additional performance. As a method of photographing the image screen of the photographed image, which is the result of the photographing of the event held in the event facility, the photographed image is transmitted to the image delivery system of the user terminal device or the like.

There are performance machines connected to user terminal devices used by each user through a network, and performance machines installed in event facilities in the form of additional performances, and on the display devices installed in the user terminal devices, the display includes as a filming event. The photographing result of the event held in the facility is the image frame of the photographed image, and the photographed image is transmitted to the image delivery system of the user terminal device. For example, as such a photographic image, a server that transmits content such as a live video is used (for example, refer to Patent Document 1). Further, as prior art documents related to the present invention, there are Patent Document 2 and Non-Patent Document 1. [Prior Art Literature] [Patent Literature]

[Patent Document 1] Japanese Patent No. 6430059 [Patent Document 2] Japanese Patent No. 6382468 [Non-patent literature]

[Non-Patent Document 1] "Nihon ham cheering song resounds through no-audience Sapporo D! Fans record sound source and play at scoring opportunity", [online], Reiwa, March 14, 2020, Sports Japan Sponichi Annex, [required and March 26, 2], Internet, <URL: https://WWW.sponichi.co.jp/baseball/2020/03/14/kiji/20200314s00001173044000c.html>

[The problem to be solved by the invention]

In the server of Patent Document 1, a viewer who has a live-broadcast animation selects an item and pays a price, and the selected item is displayed overlaid on the live-broadcast animation. However, this server does not know that the selection of props will affect the construction of the content of the live animation. More specifically, for example, in the case where the result of photography of an event at an event facility is used as a live animation, it is not the result of the selection of props that affects the structure of the control of the performance machine installed at the event facility. That is, the reaction of the audience of the live broadcast animation is not linked (linked) to the performance through the moving performance machine. On the other hand, the selection of the item accompanying the payment of the consideration (the audience's reaction) tends to increase in accordance with the audience's heightened emotions (satisfaction). As a result, even if the audience of the live-broadcast animation is satisfied with the event, and the emotion is raised through the selection of the prop, the emotion is not reflected in the actual event.

Moreover, in the animation delivery system of patent document 2, the animation of the animation of the character object generated according to the action of an actor is delivered. In this system, actors perform in studio units that have no audience. On the other hand, in the studio unit, there are cases in which a screen on which the animation transmitted to the client device is projected is arranged in front of an actor, or the like. At this time, the actor may check the reaction of the viewer of the animation through the screen. At this point, the actor may reflect this reaction in his own performance. However, depending on the content of the performance or the actors, there is a possibility that such confirmation may not be possible. Originally, whether the reaction of the viewers is reflected in the performance (the content of the animation) is the judgment of the entrusted actors, and it is not directly reflected.

On the other hand, in sports events such as professional baseball and grand sumo, there are cases in which no-spectator games are held in which spectators are not allowed to enter the arena. In such a situation, for example, even if it is broadcast on television, there is a possibility of giving an impression of a lack of excitement because only the live voice of the home run or the like and the voices of the players. At least there is a high possibility that it will become a different atmosphere from the general one (a situation with an audience). In order to make this kind of atmosphere close to normal, Non-Patent Document 1 introduces a measure of disposing a large number of speakers in the uppermost part of the outfield auditorium of the stadium, and playing the chance theme song when a player enters the playing seat in the scoring circle. However, in this measure, the opportunity theme song is played only in a predetermined situation such as a point circle, and the reaction of the viewers of the television broadcast is not reflected after all. As a result, there is a possibility of a monotonous performance.

Therefore, an object of the present invention is to provide a video transmission system or the like that can reflect the reaction of the viewers of the photographic video of the viewing and listening activities as a performance by a performance machine. [means to solve the problem]

The video transmission system of the present invention is connected to the user terminal device used by each user through the network, and the performance machine installed in the event facility in the form of additional performance, and is used for the display installed in the user terminal device. A device for displaying an image screen including a photographic image as a photographing result of an event held at the event facility, and for transmitting the photographic image to the image delivery system for the user terminal device, comprising: performance conversion means, tied to When each viewer, who is a user of viewing the photographic image, executes a support action for imparting a support effect supporting the action to the video screen through the user terminal device, the support action is converted into the action to be executed by the performance machine. Activity performance; and machine control means controlling the aforementioned performance machine in such a way that the aforementioned event performance is added to the aforementioned activity as the aforementioned performance.

On the other hand, the computer program of this invention is comprised so that the computer connected to the said user terminal apparatus and the said performance apparatus via the said network may have the function of each means of the said image distribution system.

In addition, the control method of the present invention is to connect to the user terminal device used by each user through the network, and to install the performance equipment in the event facility by adding a performance, so as to be installed in the user terminal device. The display device of the present invention displays an image screen including a photographic image, which is a photographing result of an event held in the event facility, and transmits the photographic image to a computer incorporated in the image delivery system of the user terminal device, and executes the operation. The following program: a performance conversion program, when each viewer, who is a user of viewing and listening to the photographic image, executes the support action for giving the support effect supporting the activity to the image image through the user terminal device, the support The behavior is converted into the activity performance to be performed by the aforementioned performance machine; and the machine control program controls the aforementioned performance machine in such a way that the aforementioned activity performance is added to the aforementioned activity as the aforementioned performance.

Hereinafter, an example of a video delivery system according to an aspect of the present invention will be described. First, with reference to FIG. 1, the whole structure of the image distribution system of one form of this invention is demonstrated. The video delivery system 1 is a system for delivering a video (image) showing the state of the event held at the event facility EF to the user of the user terminal device 4 . Specifically, the video delivery system 1 includes a central server 2 as a server device, and a performance machine EA that can be connected to the central server 2 through a predetermined network NT. The central server 2 is constituted as one logical server device by combining server units 2A, 2B . . . as plural computer devices. However, the central server 2 may be constituted by a single server unit. Alternatively, the central server 2 may be logically constituted using cloud computing.

The network NT system may be appropriately configured as long as the performance equipment EA can be connected to the central server 2 . As an example, the network NT is constructed by the Internet serving as a WAN, and a LAN connecting the central server 2 and the performance equipment EA to the Internet, respectively. Furthermore, various computer devices may be appropriately present between the performance equipment EA and the LAN. At this time, such a computer device and the performance machine EA are constructed as one area system, and this area system may be connected to the central server 2 through the network NT.

The performance machine EA is a device for realizing various performances. The performance device EA may be configured appropriately as long as it can realize such performance, and as an example, it is configured as a network device (so-called IOT device) that can be connected to the network NT. The performance device EA may be used as an output device for realizing various performances, and may be used as an input device used for such performances, and various devices may be appropriately included, but in the example of FIG. 1, as an example of the performance device EA, a speaker SP is disclosed , and camera CA. The speaker SP is a well-known sound output device that reproduces (outputs) various sounds to perform auditory performances. The camera CA is a well-known device for capturing images. These performance machines EA may be appropriately installed in various facilities, etc. However, in the example of FIG. 1 , they are installed in event facilities (venues) EF. Event Facility EF is a facility where various events are held.

There is also a situation in which the user terminal device 4 is connected to the video delivery system 1 through the network NT. The user terminal device 4 is a computer device that can be connected to a network and is used for the user's personal use. The user terminal device 4 allows the user to enjoy various services provided by the central server 2 by installing various computer software. For example, the user terminal device 4 has a function of a display terminal capable of displaying various animations in association with the execution of a predetermined application (software). As the user terminal device 4, an appropriate computer device may be used. However, in the example of FIG. 1, a mobile terminal device 4A such as a mobile phone (including a smart phone), a portable tablet terminal device 4B, and a notebook type are disclosed. (Fixed type is also acceptable) user terminal devices such as personal computer 4C. These are suitably connected to the network NT through eg access points AP. In addition, various computer devices that can be connected to a network, such as a stationary home game machine or a portable game machine, and are used for the user's personal use can be appropriately used as the user terminal device 4 .

The central server 2 provides various machine services for the performance machine EA. The performance machine EA can be controlled by the event operator of the event facility EF through the regional system, for example, or indirectly or directly controlled by the central server 2 through the regional system. In other words, the performance machine EA is connected to a zone system (eg, a system including a suitable computer device such as a speaker control device that controls the speakers SP), and can be controlled by the zone system. At this time, the central server 2 outputs such an area system to control (make the performance machine EA perform an appropriate performance) the performance machine EA (both the area system and the performance machine EA can be prepared by the operator of the event facility EF. The control signal of the operator different from the operator of the video transmission system 1 may be) (the zone system may also allow the appropriate signal for the performance machine EA to perform the performance, for example, the zone system records the type of performance realized by the performance machine EA and when realizing its specific control, it may be used as a signal indicating any kind of execution). Then, the control of the actual performance machine EA may be performed indirectly through the area system (resulting in the role of a relay device) that receives its control instruction. In this way, the performance machine EA may be appropriately controlled. For example, when it is indirectly or directly controlled by the central server 2, the machine service includes a service for controlling the performance machine EA. Specifically, as a service for controlling such a performance machine EA, the machine service includes, for example, control of the shooting conditions (shooting direction, shooting range, angle of view) of the camera CA in the situation where the shooting result of the camera CA is used in the video delivery system. , or during the shooting period, etc.), and the video recording service to obtain the shooting results and record them as animation data. Similarly, the service for equipment includes, for example, a performance service for reproducing (outputting) various performance sounds from the speaker SP. Details of the performance service will be described later.

Similarly, the central server 2 provides various Web services to the user of the user terminal device 4 through the network NT. For example, the Web service includes an image delivery service, an image association service, and a charging service. The image delivery service is a service for delivering the image of the activity status to the user terminal device 4 . Various types of images may be appropriately included in such images, but as an example, images (movies) of image capturing results (including images appropriately edited) captured by the camera CA are included. The video delivery service may be configured to appropriately deliver the animation data of the video for displaying the activity status to the user terminal device 4, but, as an example, it may be configured to be delivered at any time by packet communication. In addition, the video of such an activity situation may be a recorded video that records the past activity situation, but, for example, it is transmitted as a live video that transmits the current play situation in a live (almost instant) manner. That is, through the image delivery service, the status of the activity of the activity facility EF is streamed to the user terminal device 4 almost instantaneously.

The Image Correlation Service is a service that correlates images of live states delivered by the Image Delivery Service. The image-related service may appropriately include various services related to the image of the active state, but, as an example, includes an active support service. The event support service is a service in which the user of the user terminal device 4 (hereinafter referred to as the viewer's status) who is viewing the status of the event (live video) supports the event through a video delivery service. Such support may be appropriately realized, but as an example, it is realized by causing the viewer of the live video (the state of the event) to express emotions (feelings) related to the state of the event. In addition, such an expression may be realized appropriately, but as an example, it may be realized by at least any one of a reward, the purchase of an item, or the posting of a speech. As a result, the event support service has a function as a service that realizes at least any one of the reward, the purchase of an item, or the posting of a speech.

Contribution of speech is a function for each viewer to post their speech. Contribution of speeches may be implemented as appropriate, and may be implemented through a screen different from the screen displayed on the user terminal device 4 (hereinafter referred to as the image screen) in order to display the image showing the status of the activity, but as a For example, it is realized through a video screen. In addition, the posting of the utterance has the effect of displaying the utterance. The display (the speech) may be shared with other viewers as appropriate through another screen different from the video screen, but as an example, shared with other viewers through the video screen. That is, the posting of the speech has a function of displaying the speech (text information expressing various emotions) of each viewer on the video screen. Contribution of the speech may be paid (in exchange for collection of consideration) or free (collection without consideration).

On the other hand, the reward is a function of providing value from the viewer to the performer (player, actor, etc.) of the event. As such a value, various virtual currency (including in-game currency, regional currency, etc., within a limited range of appropriate currency) may be used, but in many cases, money is used. The purchase of props is a function of purchasing props associated with the activity (provided in consideration of the specified consideration). As such props, various props may be appropriately used, but in many cases, props associated with the performers of the event are used. In such a situation, the purchase of props has the same effect as a reward. Both the reward and the purchase of props can be realized through another screen different from the video screen, just like the posting of the speech, or can be realized appropriately, but as an example, it can be realized through the video screen. In addition, various effects such as any of these rewards and purchase of items, the total amount of the reward (or purchase), and the display indicating the occurrence of the reward (or purchase) are appropriately generated. Such an effect may not be shared with other viewers, and may be appropriately generated, but as an example, it is shared through a video screen like a speech. That is, an appropriate effect (sometimes referred to as a support effect hereinafter) is produced along with a tip, purchase of an item, or posting of a speech, but the support effect is added to the video screen and shared with other viewers. As a result, the support service also has a function of adding such a support effect to the video screen. In this situation, an act of giving a reward, an act of purchasing an item, or an act of posting a speech has a function as a supporting act of the present invention.

The support effect is not related to the content of the reward, etc., and the same effect may be the same, but as an example, it differs (changes) according to the content of the reward and the like. Specifically, the support effect is based on the amount of the reward (one viewer may also include the total amount of other viewers. Also, the one-time amount may be used, or the accumulated amount for a predetermined period may be used.), it becomes The way of luxury or simplicity varies. Likewise, the support effect varies depending on the purchase amount or type of the item. In addition, in the posting of speeches, the content of speeches including predetermined keywords, the number of characters, or the number of speeches by other viewers during a predetermined period (in other words, the number of viewers who contributed speeches), etc. Support effect changes.

The fee-based service is a service for collecting various fees (considerations) from each user of the user terminal device 4 through a known settlement process. Such fees include various considerations for the content of web services such as video delivery services or video-related services, but include, for example, rewards associated with event support services, or purchases of items (included in the case of paid speech contributions). Consideration for the contribution accompanying the speech). That is, through the charging service, the consideration (fee) required in the event support service is collected. Further, the Web service system further includes, for example, a data delivery service for delivering various data or software (including updating of data, etc.) to each user terminal device 4, an ID providing service for providing a user ID for identifying each user, or The user's identification information may be received from the user terminal device 4, and an authentication service or the like may be used to authenticate the user.

Next, the difference in the structure of the video delivery system 1 according to the activity will be described. In the event facility EF, it is possible to appropriately hold various events that accompany the performance by the performance machine EA. However, depending on the type of event, the structure of the performance machine EA is different, and as a result, the structure of the video delivery system 1 is also different. the situation. Hereinafter, taking two events as an example of the types of events held in the event facility EF, the structure of the video delivery system 1 corresponding to the two forms of the respective events will be described for each form. In addition, about the structure common to the above-mentioned image delivery system 1, the same code|symbol is attached|subjected to the following drawings, and its description is abbreviate|omitted.

(1st form) 2 to 8, the video delivery system 1A of the first aspect will be described. FIG. 2 is a diagram showing a schematic structure of the video delivery system 1A of the first aspect. The video delivery system 1A of the first aspect corresponds to an example of the structure of the video delivery system 1 when a sports-related event is held in the event facility EF as a type of event. As such an event, an appropriate event related to various sports may be held. The example in FIG. 2 is an event in which baseball (a sport in which each player plays with a real ball, etc.) is held in the event facility EF (hereinafter referred to as a baseball event). The structure of the image delivery system 1A at the time of the situation). At this time, as shown in FIG. 2 , a baseball field is used as the event facility EF, and a performance machine EA is installed in such field. In addition, the performance machine EA may include a suitable number of various apparatuses for performing (heating) baseball activities, but in the example of FIG. 2 , a plurality of speakers SP and one camera CA are disclosed.

Next, with reference to FIG. 3, the main part of the control system of 1A of video delivery systems of the 1st aspect is demonstrated. First, the central server 2 is provided with a control unit 21 and a memory unit 22 as memory means. The control unit 21 is configured as a computer combining a CPU, which is an example of a processor that executes various arithmetic processing and operation control in accordance with a predetermined computer program, an internal memory and other peripheral devices necessary for its operation. In addition, various performance machines EA can be connected to the control unit 21 , and the camera CA and the speaker SP are disclosed in the example of FIG. 3 . Furthermore, in the control unit 21, for example, an input device such as a keyboard, an output device such as a display, and the like can be connected as required. However, these illustrations are omitted.

The memory unit 22 is an external memory device realized by a memory unit including a non-volatile memory medium (a computer-readable memory medium) such as a hard disk array. The memory unit 22 may be configured to hold all the data in one memory unit, or may be configured to distribute the memory data in a plurality of memory units. In the memory unit 22, a server program PG1 is recorded as an example of a computer program for causing the control unit 21 to execute various processes necessary to provide various services to the user. In addition, in the storage unit 22, server data 23 necessary for providing various services are stored. The server data 23 includes various data necessary for providing device services or Web services, but in the example of FIG. 3 , image data VD, device data DD, and performance data ED are disclosed as one of such various data.

The image data VD is a well-known animation data for displaying the image of the activity state on the user terminal device 4 . The image of the activity state includes, for example, the image of the photographing results of the appropriate number of cameras CA, and the image of the game screen displayed by the appropriate number of game machines (including the appropriate number of images of the game screen displayed by the game machine) during the game activity (activity using the game machine) described later. combination, etc., images of appropriate processing, etc.). Therefore, the image data VD can be used as animation data for displaying these various images. In the example of FIG. 3 , it is configured as an image (including an appropriately processed image) for displaying the moving image captured by the camera CA. The state of the photographic image) animation data. The machine data DD is data for managing the performance machine EA installed in the event facility EF. In addition, the performance data ED is data for realizing performance by the performance machine EA. The details of the machine data DD and the performance data ED will be described later. Furthermore, the server data 23 may further include various data for realizing various services, for example. For example, such data may be ID management data including various IDs for managing user IDs and the like. However, these illustrations are omitted.

The control unit 21 is provided with a device service management unit 26 and a Web service management unit 27 as logic devices realized by a combination of hardware resources of the control unit 21 and a server program PG1 as a software resource. The equipment service management unit 26 executes various processes for realizing the aforementioned equipment service with respect to the performance equipment EA. Specifically, the device service management unit 26 executes a show control process and a post-show process as one of the processes for realizing the above-mentioned show service, for example. The details of the procedures of the performance control processing and the post-event performance processing will be described later.

On the other hand, the web service management unit 27 executes various processes for realizing web services such as the above-described image delivery service, image-related service, or fee-based service for the user terminal device 4 . For example, the Web service management unit 27 executes a known process for realizing streaming of game images as a process for realizing a video distribution service. In addition, the Web service management unit 27 executes a known billing process (including cooperation with other billing systems) as a process for realizing a billing service. Similarly, the Web service management unit 27 performs appropriate processing according to the content of the provided service as processing for realizing the image-related service, but this processing includes processing for realizing the support service. Specifically, the Web service management unit 27 is a process for realizing such a support service, for example, a process for realizing a tip, purchase of an item, or posting of a speech, or the like. Such a process may be known as a well-known process, and may be implemented appropriately.

The user terminal device 4 is provided with a control unit 41 as a computer, and a storage unit 42 as a storage means. The control unit 41 is configured as a computer in which a CPU, which is an example of a processor that executes various processes in accordance with a predetermined computer program, is combined with an internal memory and other peripheral devices necessary for its operation.

The memory unit 42 is an external memory device realized by a memory unit including a non-volatile memory medium (a computer-readable memory medium) such as a hard disk, a semiconductor memory device, and the like. In the memory unit 42, a terminal program PG2 is recorded as an example of a computer program for causing the control unit 41 to execute various processes required to provide various services to the user. In addition, in the storage unit 42, terminal data TD necessary for enjoying Web services such as the display of photographic images is recorded. The terminal data TD includes various data, but in the example of FIG. 3, as one of them, the image data VD is disclosed. These image data VDs are provided from the central server 2 in a manner of including a part required by the image delivery service (or data delivery service), or a part of the image-related service. Furthermore, the terminal data TD may further include, for example, ID management data appropriately provided from the central server 2 and the like. Similarly, the terminal data TD may include, for example, image data for displaying various images related to the transmission of photographic images, or audio data for reproducing various sounds such as BGM. However, these illustrations are omitted.

In the control unit 41, various logic devices are constituted by the combination of the hardware resources of the control unit 41 and the terminal program PG2 which is a software resource. Then, through these logical devices, various processes required to enjoy the Web service are executed, and as the related logical devices, the image control unit 43 and the data management unit 44 are disclosed in the example of FIG. 3 . The image control unit 43 is a logic device that performs various processing for displaying various images (including animation). Such processing includes processing for displaying photographic images (movies) (processing for enjoying image delivery services), processing for displaying various images associated with photographic images in order to enjoy image-related services, and processing for displaying photographic images. Enjoy the processing of these associated fee-based services. For example, the image control unit 43 operates in cooperation with the Web service management unit 27 of the central server 2 as a process for realizing a support service included in the image-related service, or independently executes rewards, purchases of items, and posting of speeches processing. On the other hand, the data management unit 44 is a logical device that performs various processes related to the management of the terminal data TD recorded in the storage unit 42 . In this process, the process of acquiring the image data VD from the central server 2 is included. In addition, if necessary, the process of updating various data such as the video data VD, or the process of providing (transmitting) the updated data to the central server 2 is included.

In the user terminal device 4, various output devices and input devices may be appropriately provided according to the types of user terminal devices such as the mobile terminal device 4A, etc. However, in the example of FIG. 3, a display is disclosed as such an output device 46 and the speaker 47, the touch panel TP is disclosed as an input device. The display 46 and the speaker 47 are respectively a well-known display device for displaying various images such as game images, and a well-known sound reproduction device for reproducing sound. The display 46 displays various screens (images) related to the service provided by the user terminal device 4 including the Web service, such as the above-mentioned image screen. The touch panel TP is a known input device (detection device) that detects the position of the user's touch operation and outputs a signal corresponding to the position. Through such a touch operation on the touch panel TP, an appropriate touch operation (action for service) for utilizing the image transfer service, the image-related service, or the fee-based service is input. The touch panel TP is arranged so as to cover the display 46 on the display 46 in order to detect such a touch operation with respect to the entire area of the display surface of the display 46 .

Next, the details of the performance service will be described with reference to FIG. 4 . The performance of the performance machine EA may be provided independently of the support service, but as an example, it is provided in connection with the support service. The example of FIG. 4 is an example of the flow of the performance service in such a situation. In addition, the example of FIG. 4 shows the state which provides the service of posting a speech as an example of such a support service. That is, the example of FIG. 4 shows an example of the flow of the performance service when the performance machine EA performs the performance in conjunction with the posting of the speech (support service). In this case, as shown in FIG. 4 , the support service system includes four programs of F1 to F4, and the performance service system includes two programs of F5 and F6. As a result, through the six programs of F1 to F6, the performance by the performance machine EA for the performance service, that is, the baseball activity of the stadium, is realized.

Specifically, first, the imaging result of the camera CA is sent to the central server 2 (F1). When the imaging result is sent from the camera CA, the central server 2 transmits the imaging image based on the imaging result to the user terminal 4 (F2). The user terminal device 4 may appropriately provide the captured image to the user, and as an example, the image screen 50 is provided. Therefore, on the image screen 50, various objects photographed by the camera CA are appropriately displayed as photographic images, but in the example of FIG. 4, the stadium image EFI corresponding to the stadium (event facility) EF is displayed. In addition, when posting a speech as a support service, the image screen 50 includes a posting button 51 . The contribution button 51 has a function as a position (area) to be touched and operated when posting a speech. When a touch operation is performed on the contribution button 51, the image screen 50 is changed to a speech input mode (not shown). The speech input mode may be appropriately provided according to the input method of speech and the like. An appropriate method, such as a method selected from a plurality of candidates prepared in advance as an input method for utterance, may be used. However, for example, when a user can input arbitrary characters for free input, a well-known keyboard for inputting such characters is displayed. The image, the image screen 50 changes to a speech input mode including such a keyboard image. In this example, the touch operation on the contribution button 51 or the touch operation on the keyboard image or the like in the speech input mode functions as the contribution operation of the present invention.

When an utterance is input (posted) in the utterance input mode, the user terminal device 4 transmits the input result (utterance) to the central server 2 (F3). Then, the central server 2 transmits the received speech (input result) to all viewers (the user who posted the speech, and other users) who are viewing the same photographic image by displaying the speech on the image screen 50 . ) of the user terminal device 4 (F4). The display of the speech may be implemented appropriately, and may be implemented on the side of each user terminal device 4 or may be implemented on the side of the central server 2 . That is, even if the central server 2 transmits the video screen 50 to which the speech is added, each user terminal device 4 that receives the information of the speech may also add a speech to the video screen 50 . In any case, along with the posting of the speech, the posting is reflected on the video screen 50 . In addition, the reflection target of the speech may be limited to only the video screen 50 of the viewer who posted the speech (hereinafter referred to as the "poster"), or conversely, only the video screen 50 of other viewers other than the poster, or the like. The video screen 50 of all viewers viewing an appropriate part of the same photographic video may be the video screen 50 of the viewer, but as an example, there is no such limitation, and the speech is reflected on the video screen 50 of all the viewers. That is, the posting (support) of the speech of one viewer is reflected not only on the video screen 50 of the contributor, but also on the video screen 50 of other viewers as a display (support effect) of the speech.

As an example, although the support service is provided using such a program, the posting of the speech is displayed as a photographic image attached to the video screen 50, so the support service (posting of the speech) is provided in synchronization with the video delivery service, F1 and F2 The system functions as a program for image delivery services. In this case, even if the image delivery service has a function as a part of the support service, conversely, the support service may have a function as a part of the image delivery service. Alternatively, the image delivery service and the support service may be managed as independent services.

On the other hand, when receiving the posting of the speech from the user terminal device 4, the central server 2 converts the posting of the speech into the performance of the stadium EF through the performance machine EA (F5). In addition, this conversion may be realized by various methods, but as an example, it is realized by the performance data ED. The details of the performance data ED will be described later, but as an example, the performance data ED is the performance that should be realized by the performance machine EA by supporting actions such as posting of speeches and corresponding actions (hereinafter referred to as the situation of the event performance). ) is constituted by the manner in which the association is established. This kind of activity performance may be set in a way that changes according to the content of the supporting behavior (including the degree of quantity, etc.). Specifically, for example, when posting a speech as a support action, it is also possible to associate the speech with the event performance so as to change the event performance according to the speech (number of characters, predetermined keywords, etc.). Similarly, when the number of speeches (in other words, viewers) contributed during a predetermined period is totaled, the speech and the event performance may be associated so as to change the event performance according to the number. In this way, the event performance may be appropriately set, but as an example, the same performance is set regardless of the content of the speech (however, multiple performances may be prepared according to the time and situation). That is, regardless of the content of the speech, the speech will be converted into a predetermined event performance along with the posting of the speech.

As an event performance, various performances may be appropriately prepared, and the same performance may be prepared regardless of the content of the event, but as an example, a performance according to the content of the event is prepared. Specifically, as an event performance, if it is a football event, a performance that is typified by football support (refueling), and if it is a sumo event, each event such as a performance that is typified by sumo wrestling support is used. The various performances performed in support are appropriately typed. Therefore, in the example of FIG. 4 , a performance of the support type which is widely performed in baseball is prepared as an active performance. For example, in many baseball events, cheers such as "Wow" or "Oh" are generated as cheers. Therefore, these cheering sounds may be appropriately prepared as a live performance, but in the example of FIG. 4, a sound performance simulating a cheering sound of "Wow" is prepared as a live performance. As a result, the posting of 1 speech was converted into a voice performance simulating a cheering sound of "Wow".

Furthermore, the central server 2 converts the speech into an event performance (voice performance), and controls the performance device EA in such a way that the event performance is actually realized in the event facility EF through the performance device EA (F6). The performance machine EA that performs the event has nothing to do with the content of the speech (support) or the status of baseball (game), and it may not change (it may be the same), but as an example, it changes according to the content of the speech (support behavior). . This kind of change is that the cheers of "Wow" become "Come on!", etc., and it can be performed in the content of the event performance, but in the example of Fig. 4, the performance machine EA that should perform the event performance, that is, the event facility EF. It is realized by different speakers SP of the performance (control) objects, such as all speakers SP, or a part of the speakers SP. Specifically, not all the speakers SP of the event facility EF, but only the speakers SP provided on the third base side in the example of FIG. 4 are controlled so as to realize a sound performance simulating a cheering sound of "Wow". That is, depending on the content of the speech and the like, only a part of the speakers SP realize the event performance.

The speaker SP of the performance object may be appropriately determined, but as an example, the content of the speech is to support the visiting team (generally, the team on the third base side), or when the visiting team is on offense (generally, the first strike). (The attacking time may be appropriately specified, for example, the information on the attacking side may be appropriately input by the operator of the event, or it may be specified according to the information), etc., and it is installed at the third base in the situation where the performance of the third base side should be strengthened. The performance machine EA on the side is controlled as an object to perform performance. The same is true in situations where the performance of the first base side should be strengthened, such as when the home team (generally, the team on the first base side) is making a statement on offense. On the other hand, for example, when a speech about a home run is posted, all the speakers SP installed in the event facility EF are used for the addition of the event performance in a situation where the entire event facility EF should be heated up. In this way, when a plurality of speakers SP (generally installed in different positions) are installed in the event facility EF, these speakers SP (performance machines EA) are all or part of the appropriate units used for the addition of event performances.

The activity performance corresponding to the contribution (support behavior) of the speech may be added after the total of the predetermined period, but as an example, it is added every time the speech is posted. In addition, this kind of performance may be added without limitation, but as an example, it is added with appropriate restrictions. Specifically, for example, the moment when a home run or a hit occurs (predetermined time) and other times when the actual mood of baseball activities is high (it can also be used as a time when baseball activities should be heated up. Moreover, it is appropriate to determine whether it complies with the It is also possible to wait for the time, but as an example, the operator of the event will provide information on whether the current time corresponds to the time.) If it overlaps with the additional period of the performance, the additional period of the performance will be staggered. That is, in the time when the baseball activity is actually hot (hereinafter referred to as the limited time), the performance of the event is restricted.

The event performance corresponding to the posting of the speech may be appropriately added after the limited time has elapsed for the limited time (not only the time when the timing of the baseball activity is hot, but also the appropriate time to be added as the performance to be avoided). For example, after the limited time has elapsed, the same number of voice performances as the number of postings corresponding to the time may be added, but as an example, the voice performances corresponding to such postings are collected into one. Therefore, for the total number of submissions for the limited time, a different voice performance will be added according to the total number. Appropriate generation may be made according to the difference (change) of the voice performance in the total count (the number of contributions to the speech), but as an example, the more the number of contributions (total count) with a time limit, the more lively the voice performance (analog the sound of cheers) changes. Such a performance may be performed by an appropriate part of the speakers SP, but as an example, it is performed by all the speakers SP of the event facility EF. As an example, through such a program, the performance (performance service) of the speaker SP (performance machine EA) of the stadium EF is realized in conjunction with the contribution of the speech (support service). In this example, the limited time functions as the predetermined time of the present invention.

Furthermore, when setting the time limit, the number may be appropriate, for example, a plurality of time limits may be set for one event. In addition, when the time limit of 2 or more is set at relatively short intervals (for example, when multiple time limits are set at short intervals for one home run), the interval between the two time limits (hereinafter referred to as the interval time) is the same as the time limit. The performance time of the additional voice performance in the interval can be set appropriately. For example, the interval time and the performance time may be the same or different. In addition, when the interval time and the performance time are different, the performance time may be shorter or longer than the interval time. For example, when the performance time is longer than the interval time, the volume of the performance may be gradually reduced together with the arrival of the next limited time. In this case, a more natural (less sense of incongruity) performance can be realized compared to a situation where the voice performance ends (the interval time matches the performance time) when the next limited time arrives. In addition, the aftertaste of the voice performance can also be expressed through such a change in volume. The performance time may be set longer than the end of the next limited time. In this case, the sound performance corresponding to the previous limited time (the performance with the aftertaste of gradually decreasing the volume) and the sound performance corresponding to the current limited time (the performance with the largest volume) can be repeatedly added, and a more realistic event can be realized. The cheers generated in the performance.

Furthermore, the interval time may be omitted. That is, the interval time may not be inserted, and the limit time may be set continuously. In this case, the sound performance corresponding to the summation result of one limited time may be added to an appropriate period including the subsequent limited time. Specifically, the sound performance corresponding to the summation result of one limited time may be added to, for example, the next limited time. That is, the time limit is constituted so as to limit the voice performance that reflects each utterance individually (not the voice performance in accordance with the total of the predetermined time, the performance in which each utterance is directly reflected as described above, etc.) The time allowed for the voice performance (an example of a special voice performance other than the normal voice performance) corresponding to the total result of the corresponding limited time may be allowed. As a result, the limited time functions as a mere total period for reflecting the voice performance corresponding to the plural utterances. In addition, it is not limited to the situation in which the time limit of 2 or more is set at relatively short intervals, and the time limit and the performance time may be appropriately set. Similarly, the volume change during the performance time (including the situation where it does not change) may also be appropriately set.

Next, the details of the machine data DD and the performance data ED will be described. FIG. 5 is a diagram showing an example of the structure of the device data DD. The example of FIG. 5 shows the machine data DD when the performance machine EA of the control object is changed according to the content of the speech. In this case, as shown in FIG. 5 , the device data DD includes the device record DDR that manages the position of each performing device EA. In addition, in order to realize such management, the device record DDR system includes, for example, information of "device ID", "type", and "location".

"Apparatus ID" is the information which shows the apparatus ID unique to each performance apparatus EA in order to identify each performance apparatus EA. The machine ID is uniquely assigned to each physical machine. Therefore, for example, two different device IDs are assigned to the two speakers SP, respectively. "Type" is information indicating the type of the performance machine EA. The performance equipment EA is distinguished by the type of information in units such as speaker SP or camera CA. Therefore, for example, the type of information is different between the speaker SP and the camera CA, but the same type of information is given between the two speakers SP. "Position" is information indicating the position where each performance machine EA is arranged in the event facility EF. The position of each performance machine EA may be appropriately set according to the range of the performance object. However, for example, the range indicating the first base side and the third base side (in the second form described later, each player is identified as each game machine). The unit can also be set in the way). The DDR is recorded on the machine, and the information is recorded in a way that the information is correlated with each other. Furthermore, the machine data DD is not limited to such information, for example, appropriate information may be managed in response to a control request. Alternatively, a part of such information may be omitted as appropriate.

FIG. 6 is a diagram showing an example of the structure of the performance data ED. As shown in FIG. 6 , the performance data ED contains the performance records EDR that manages the conditions of each event performance realized by the performance machine EA. In order to realize such management, the performance record EDR includes, for example, information of "show ID", "show", "condition", and "object".

The "show ID" is information indicating a show ID unique to each show in order to identify each show. "Performance" refers to information about the performance to be realized by the performance machine EA. Specifically, for example, when the speaker SP is used as the performance device EA, and the voice performance is added as a live performance, the information of the cheering sound (type) representing "Wow" is described in "performance" as the voice performance to be reproduced by each speaker SP. In another example, there is a situation in which a voice performance other than the same voice performance (“Wow”) is prepared in accordance with the above-mentioned limited number of speeches, etc., but in such a situation, the information indicating the voice performance corresponding to the number of speeches Also described as "performance". Specifically, for example, when preparing a voice performance that reproduces the sound of "Puba" (foley for applause) according to the number of speeches, as a three-stage (type) performance with different volumes, the information indicating "Puba", and Information indicating its volume is described in "Performance".

On the other hand, "conditions" are information indicating the conditions for applying (achieving) the performance of each event. Each event performance can be appropriately realized according to various conditions, but for example, when the same event performance is realized with the contribution of the speech, the information indicating the contribution of the speech is described in the "condition". For another example, when realizing the performance of the number of speeches according to the time limit, information indicating the number of speeches is described in "condition" as a condition. Specifically, for example, in the voice performance of the above-mentioned three-stage "baby" with different volumes, the conditions for the number of speeches indicating the number of speeches are less than 100, the situation of 101 to 200, or the situation of more than 201 are respectively passed through " Conditions" to associate with information. In addition, when changing the performance according to the content of the speech, such various contents (conditions) are described in "conditions".

The "object" indicates the information of the performance machine EA which is the target (control target) to execute each performance. "Object" is used to change the performance equipment EA of the control object according to the performance (in other words, if the performance equipment EA of the control object is all or a part of the control object, it may be omitted if it does not change). For the "object", for example, it is possible to describe the appropriate information of the performance equipment EA indicating the object of the equipment ID, etc., but as an example, when all the performance equipment EA is the object, the description indicates all the information, and when a part is the object, the description is made. Indicates a part of the information. In addition, as part of the information displayed, appropriate information may be used in response to a request from the control unit, etc., but as an example, the range of support of the supporting team corresponding to the statement (the third base side when supporting the away team, etc.) is described, or the display is used. Information that specifies the conditions of the control target on the attacking side when speaking. In the performance record EDR, the information is recorded in such a way that the information is related to each other. Furthermore, the performance data ED is not limited to such information, and for example, appropriate information may be managed in response to a request of the managed performance (including the situation of using the performance equipment EA other than the speaker SP). Alternatively, a part of such information may be omitted as appropriate.

Next, with reference to FIGS. 7 and 8 , the performance control processing and the subsequent performance processing will be described. Both the performance control processing and the post-event performance processing are used to control the processing of the performance machine EA in a manner of performing a live performance based on the support action for the photographic image. More specifically, the performance control processing is used to control the processing of the performance machine EA according to the support behavior outside the limited time when the limited time is set. The example of FIG. 7 is an example of performance control processing for realizing the control of the speaker SP (performance machine EA) of the example of FIG. 2 in such a situation. At this time, the device service management unit 26 starts the performance control process shown in FIG. 7 every time a speech is posted outside the time limit (execution of a support action), and first obtains the input result (posted speech) input through the user terminal device 4 ( Step S101).

Next, the device service management unit 26 converts the input result (posted speech) acquired in step S101 into an event performance (step S102 ). The conversion is carried out based on the performance data ED. Specifically, the machine service management unit 26 refers to the "condition" and "performance" information of the performance data ED, and determines the event performance corresponding to the condition of the speech. Then, the equipment service management unit 26 specifies the judged event performance as the conversion target. That is, the machine service management unit 26 converts the posted speech into a specific event performance. Furthermore, when changing the performance according to the content of the speech, such various contents (conditions) are described in the "conditions", so the service management unit 26 for equipment refers to these conditions in step S102, and the event performances that meet the conditions are also specified. Can.

Next, the appliance service management unit 26 specifies the speaker SP to be controlled, that is, the speaker SP that should execute the event performance converted in step S102 (step S103). This identification is realized based on the information of the "object" of the performance data ED and the machine data DD as described below. The equipment service management unit 26 first refers to the "object" information of the performance data ED, and discriminates the conditions for specifying the control object to be executed the moving performance converted in step S102. For example, when the control object is changed in response to the speaking support team, information indicating the support range of the support team or the like is described in "object". Therefore, the machine service management unit 26 determines the supporting team based on the content of the speech. Then, the machine service management unit 26 further refers to the "position" information of the machine data DD, and specifies each speaker SP located in the range (first base side, etc.) corresponding to the support team to be determined as a control object. Similarly, in a situation where the control object is changed at the time of posting in response to a speech, information such as the attacking side at the time of speech is described in "object" as a condition. At this time, the device service management unit 26 refers to the "position" information of the device data DD while judging the posting of the speech, and specifies each speaker SP on the offense side at the time of posting the speech as a control object.

Next, the equipment service management unit 26 controls the speaker SP specified in step S103 so as to realize the moving performance converted in step S102 (step S104). That is, the equipment service management unit 26 realizes the event performance converted in step S102 through the speaker SP specified in step S103. Then, after such control, the equipment service management unit 26 ends the present performance control process. Thereby, the supporting action (posting of the speech) for the photographic image is converted into a performance by the speaker SP, and the performance is realized by the speaker SP actually installed in the event facility EF. Again, the performance is realized through the speaker SP associated with the supporting behavior in the event facility EF. That is, the support from the viewers accompanying the photographed video is added to the event of the event facility EF through the speaker SP for the event performance of the content.

On the other hand, the post-event performance processing is used to control the processing of the performance machine EA according to the support action performed by the limited time in the situation where the limited time is set. The example of FIG. 8 shows an example of post-performance processing for realizing the control of the speaker SP (performance machine EA) of the example of FIG. 2 . In addition, the performance of the support action (posting of speech) according to the limited time may be added at an appropriate period after the limited time has elapsed. However, the example of FIG. At this time, the device service management unit 26 starts the post-show processing shown in FIG. 8 every time a predetermined time period after the time limit has elapsed, and first obtains the input result (posted) input through the user terminal device 4 within the most recent time limit. speech) (step S201).

Next, the appliance service management unit 26 calculates (totals) the number of utterances input in the most recent time limit based on the input result acquired in step S201 (step S202). This calculation can be implemented appropriately. For example, according to the content of the supporting action, when the type of the activity performance is different, it can be executed according to the various types. When the contribution of the speech, regardless of the content, the same activity performance is added, as It is executed by simply accumulating the number of speeches for a limited time.

Next, the device service management unit 26 converts the speech (support action) of the time-limited posting into an event performance based on the acquisition result in step S201 and the calculation result in step S202 (step S203). This conversion is implemented based on the performance data ED, similarly to the conversion in step S102 in the example of FIG. 7 . Specifically, the machine service management unit 26 refers to the information of "condition" and "performance" of the performance data ED, and discriminates the event performance whose condition has the number of speeches calculated in step S201. Then, the equipment service management unit 26 specifies the judged event performance as the conversion target. That is, the machine service management unit 26 converts all the speeches posted within the time limit into one specific event performance.

Next, the appliance service management unit 26 specifies the speaker SP to be controlled, that is, the speaker SP that should execute the event performance converted in step S203 (step S204). This identification is carried out as described below based on the information of the "object" of the performance data ED and the machine data DD, similarly to the identification in step S103 of the example of FIG. 7 . The equipment service management unit 26 first refers to the "object" information of the performance data ED, and discriminates the conditions for specifying the control object to be executed the moving performance converted in step S203. This determination is the same as step S103 in the example of FIG. 7 , but for example, when the description of “object” indicates all the information, the equipment service management unit 26 refers to the equipment data DD, and specifies all of the event facilities EF as the control object. speaker SP.

Next, the equipment service management unit 26 controls the speaker SP specified in step S204 so as to realize the event performance converted in step S203 (step S205). That is, the equipment service management unit 26 realizes the event performance converted in step S203 through the speaker SP specified in step S204. Then, after such control, the equipment service management unit 26 ends the present post-show processing. Thereby, the number of contributions (the number of supporting actions) of the speech within the time limit is calculated, and the event performance according to the number of contributions is realized by the speakers SP (eg, all speakers SP) actually installed in the event facility EF.

As described above, according to the first aspect, the support behavior of the viewer who sees the photographic image of the activity is converted into an activity performance, and the performance machine EA is controlled so that the converted activity performance is added to the activity. More specifically, the speaker SP is controlled so that the posting of the speech by the viewer of the video screen 50 is converted into a voice performance simulating a cheering sound of "Wow", and the voice performance is reproduced. That is, the video screen 50 including the photographed video of the baseball action is displayed on the user terminal device 4, and the posting of the speech for giving the speech is accepted on the video screen 50. However, the posting of the speech is converted to the speaker SP. To the sound performance, and the voice performance is actually attached to the baseball activity. Thereby, the reaction of the viewer, which is the contribution of the speech of the photographic image, can be reflected in baseball activities as a sound performance by the speaker SP installed in the stadium EF. Specifically, for example, a tense scene or a posting of a speech in support of a player's active time can be reflected in the actual baseball activity through a voice performance that raises the emotions of viewers. As a result, compared to a situation in which such a sound performance is not added, it is possible to realize a baseball action that is realistic to a baseball player (or a viewer who sees it).

In addition, when the activity performance changes in response to the support behavior, specific support behaviors can be promoted through the change in the activity performance. For example, in the example of FIG. 4 , the same sound performance outside the limited time is added as an event performance. However, in the limited time, the cumulative number of speeches corresponding to the time is added. event performance. In this case, the number of submissions of time-limited speeches can be promoted through changes in the performance of such events. As a result, for example, when the time limit is set to a home run, the posting of the speech about the home run can be further promoted, so that the event performance for the subsequent home run can be more lively.

Also, in baseball events, a voice performance simulating a cheering sound of "Wow" is used as an event performance corresponding to the posting of a speech, but such a voice performance varies depending on the type of event. For example, the state of football is a performance using cheers simulating football as an event performance. In general, effective performances have a tendency to vary depending on the type of activity. However, when using different voice performances according to the cheering sound of the activity according to the type of activity, this tendency can be reflected and a more effective performance can be achieved. activity performances.

In the first aspect, the equipment service management unit 26 of the central server 2 functions as the show conversion means and the machine control means of the present invention by executing the show control process of FIG. 7 or the post show process of FIG. 8 . Specifically, the device service management unit 26 of the central server 2 functions as a performance conversion means by executing the process of step S102 in FIG. 7 or the process of step S203 in FIG. 8 . Moreover, the apparatus service management part 26 of the central server 2 has a function as apparatus control means by performing the process of step S104 of FIG. 7, or the process of step S205 of FIG. 8.

(2nd form) 9 to 12, the video delivery system 1B of the second aspect will be described. FIG. 9 is a diagram showing a schematic structure of the video delivery system 1B of the second aspect. The video delivery system 1B of the second form corresponds to an example of the structure of the video delivery system 1 when an event (hereinafter referred to as a game event) using a game provided by the game machine 3 is held as a type of event. At this time, as shown in FIG. 9, the game machine 3 installed in the event facility EF is connected to the center server 2 through the network NF.

The game machine 3 is a device that provides games. As the game machine 3, various computer devices (including user terminal devices) for personal use, such as stationary or portable game machines (including tablet computers and smart phones), or stationary or notebook-type personal computers, can be used. 4) It is also possible, but an arcade machine is used in the example of FIG. 9 . An arcade is a computer device installed in various facilities such as shops with the main purpose of increasing profits by repeatedly allowing many users to play the game repeatedly. Therefore, the game machine 3 is constituted as a game machine for commercial use (for business use) that allows the user to play the game within the range corresponding to the play fee in consideration of the payment of the predetermined play fee (a game machine that provides the game for a fee) . Even if the game machine 3 is installed in the event facility EF, the game may be provided at a predetermined play fee as in the case of the store, but in the example of FIG. 9 , the game is provided for free.

The game machine 3 may provide an appropriate game such as an action game, a simulation game, a role-playing game, a timing game (music game), or a sports game for game activities. The game console 3 is played as a single player (single), and these games may be provided, or these games may be provided as a plurality of games. Also, in the case of multiple play, the game is in a suitable format such as 1-on-1, 1-on-many (team), or many-to-many (the number of people may be appropriate, and they may be consistent or inconsistent with each other) as a battle type, or It can also be provided for games of cooperation type (including the situation where the opponent or the cooperator is a computer). Therefore, according to such various games, an appropriate number of game machines 3 may be installed in the event venue EF, and in the example of FIG. 9 , two or more game machines 3 are installed in the event venue EF. Then, the two game machines 3 are provided with a battle type in which two users P (hereinafter referred to as the player P) who play the game respectively through the two game machines 3 play against each other in a one-to-one manner. game.

The game event may be constituted as a meeting in which the results of the game are competed in an appropriate format such as a tournament format or a league format, or may be constituted as a party where only play is announced to each other. In addition, the game event may be an event without an audience or an event with an audience. In this way, the game event may be appropriately configured according to the type of the game, etc. However, in the example of FIG. 9 , it is configured such that there is an attached audience PA who observes the play of the two players P who are playing against each other through the two game machines 3 in the stage. Audience activity.

In the event venue EF, various performances for performing (heating) game events may be performed, and the performance machine EA may include various machines for realizing such various performances, but in the example of FIG. 9, a lighting unit is included LU, speaker SP, smoke device SU, display MO, and camera CA. In other words, in the event venue EF, as the performance machine EA, the lighting unit LU, the speaker SP, the smoke device SU, the display MO, and the camera CA are installed (in the example of FIG. 9, one of each device is disclosed, However, these are not limited to one, and an appropriate number may be provided).

The lighting unit LU is a known lighting device that performs various visual performances by lighting (light) such as lighting, blinking, lighting off, or appropriate color development. The smoke device SU is a known device for performing a visual performance by generating an appropriate amount of smoke (smoke). The display MO is a known display device that displays various images (including performance or various information). On the display MO, for example, as an image for performance, the photographing result of the camera CA or the game screen provided by each game machine 3 may be appropriately displayed.

In addition, as described above, the device service system may include various services as appropriate, but in the case of the image delivery system 1B of the second aspect, the information acquisition service is included. The information acquisition service is a service for acquiring information (including replay data and image data) of the play status of each player P from each game machine 3 . The machine service system, for example, also includes information on the actual game performance of each player P. When various data such as game data are managed in the central server 2 as a part of the server data 23, such a game is reflected in the data. A data update service for status information is also available.

FIG. 10 is a functional block diagram showing the main part of the control system of the video delivery system 1B of the second aspect. In the video delivery system 1B of the second aspect, the game machine 3 is added to the device connected to the central server 2 compared to the video delivery system 1B of the first aspect (the example of FIG. 2 ). As shown in FIG. 10, such a game machine 3 is provided with a control unit 31 as a computer and a memory unit 32 as a memory means. The control unit 31 is constituted as a computer combining a CPU, which is an example of a processor that executes various arithmetic processing and operation control according to a predetermined computer program, an internal memory and other peripheral devices necessary for its operation.

The control unit 31 is provided with a game control unit 33 and a data management unit 34 as a logic device realized by a combination of hardware resources of the control unit 31 and a game program PG3 as a software resource. The game control unit 33 executes various processing required for providing the game (including various processing required for enjoying the machine service). Similarly, the data management unit 34 executes various processes for managing the data stored in the storage unit 32 (including various processes necessary for enjoying the service for the device). Such processing includes, for example, processing for generating or transmitting image data for displaying a game screen.

The memory unit 32 is an external memory device realized by a memory unit including a non-volatile memory medium (a computer-readable memory medium) such as a hard disk and a semiconductor memory device. In the memory unit 32, various data are recorded together with the above-mentioned game program PG3, and in the example of FIG. 10, the game data GD is revealed. The game data GD is the data that is appropriately referred to in order to allow the user to play the game in accordance with the game program PG3. The game data GD may appropriately include various data such as audio data for reproducing the sound of the game, image data for displaying the game screen, the above-mentioned play data, or ID management data.

Various output devices and input devices required for the arcade are appropriately installed in the game machine 3, which can be connected to the control unit 31, but in the example of FIG. 10, a display 36 and a speaker 37 are provided as such output devices, and input devices are provided as input devices IP. The display 36 and the speaker 37 are a known display device for displaying various images related to a game such as a game screen for providing a game, and a known sound output (reproduction) device for reproducing sound, respectively. The input device IP is a device used by the player P to input various play behaviors performed in order to play the game. As the input device IP, various input devices such as push-button switches or touch panels may be appropriately used in accordance with the type of game and the like. Furthermore, as described above, the performance machine EA in the second form includes a lighting unit LU, a smoke device SU, or a display MO, etc., which are also connected to the central server 2, but are omitted in the example of FIG. 10 . etc., as the performance machine EA, only the camera CA and the speaker SP are disclosed.

Next, with reference to FIG. 11 , the details of the performance service of the second form will be described. FIG. 11 shows an example of the flow of the performance service in the second form. In addition, the example of FIG. 11 is the same as the 1st form, and shows the state where the performance of the performance apparatus EA is linked with the support service, and the service of providing a speech is provided as an example of a support service. On the other hand, in the show service of the second aspect, the state of the game machine 3 is reflected on the show linked to the support action (posting of the speech). Therefore, as shown in FIG. 11 , the program of F5A is added to the performance service of the second form compared to the performance service of the first form (the example of FIG. 4 ). As a result, the performance service of the second form includes three programs of F5A, F5B, and F6.

Specifically, the support service system includes programs F1 to F4 as in the example of FIG. 4 . These procedures can be implemented similarly to the example of FIG. 4 . On the other hand, in the show service of the second aspect, as a program not included in the example of FIG. 4, the transmission of information is executed from the game machine 3 (F5A). This transmission may be performed at an appropriate period or various actions (processing) such as the posting of the speech (F3) as a trigger, but in the example of FIG. Accompanying this transfer (or after this transfer), in response to a request from the central server 2, a transfer from the gaming machine 3 is performed. In the event performance corresponding to the posting of the speech, various conditions of the game machine 3 may be appropriately reflected in accordance with the situation of the performance, etc., but as an example, the game play status is reflected. Therefore, the game machine 3 transmits the information of the play status of the game at the time of the transmission of the speech to the central server 2 by taking the transmission of the speech as an opportunity.

When the central server 2 obtains the information of the game state from the game machine 3, it converts the posting of the speech into the performance through the performance machine EA of the event facility EF (not only the speaker SP, but also the lighting unit LU, the smoke device SU, or the display MO as appropriate). etc.) (F5B). This conversion is implemented in the same way as the routine of F5 in the example of FIG. 4 . However, this conversion may appropriately reflect the game state. For example, when a baseball game corresponding to the baseball of the first form is provided, the information of the game status may be used (reflected) for the judgment at the time of attack. Furthermore, for example, a sound performance such as "Beautiful Hit!" immediately after a hit, and "Beautiful Home Run!" immediately after a home run (or displayed on the display MO) can be reflected in the content of the event performance. You can also. That is, it is also possible to change (different) the performance of the event according to the play status of the game. In this case, "Performance" in the performance data ED is described as "Beautiful hit!" or a cheer corresponding to "Beautiful home run!" information. Further, in the "condition" of the performance data ED, information indicating a condition for a hit or information indicating a condition for a home run is described. In any case, when the game status is reflected in the conversion of the performance, the central server 2 converts the speech submission into an event performance according to the game status.

After the conversion of the event performance, the central server 2 controls the performance machine EA (F6) in the same way as the procedure of F6 in the example of FIG. However, the control may appropriately reflect the game state. Specifically, for example, according to the game state, the performance machine EA of the specific control object is determined to be the attacking side. That is, according to the game situation, the performance machine EA to be controlled is appropriately changed. For another example, when a baseball game corresponding to the first form of baseball is provided, the information on the game status (reflected) may be used for the determination of the time limit. Specifically, the central server 2 refers to the information of the game state, and determines whether or not there is a post speech during the emotional high time (limited time) when a hit or the like occurs. Furthermore, the central server 2 can add up the number of speeches with limited time as in the case of the example of FIG. 4 , and can be added to the additional time as one performance, but the time can be adjusted individually, and each speech with limited time may be added. For example, when the operator of the event sets a time limit, the time limit may not only be the moment when the mood is high, such as after a hit, but also a certain period before and after it. On the other hand, when the time limit is judged according to the game situation, there is a high possibility that the time limit can be set more accurately than the setting by the operator of the event only after a hit. Therefore, in the second form, unlike the first form, the central server 2 does not aggregate the time-limited speech submissions into one additional time period, but may adjust the performance times corresponding to each speech submission individually. .

Next, the performance adjustment processing will be described with reference to FIG. 12 . The performance adjustment processing is performed instead of the performance control processing of the example of FIG. 7 and the post-event performance processing of the example of FIG. 8 when individually adjusting the timing of the event performance of each speech contribution corresponding to the limited time. More specifically, when the time limit is set, the performance adjustment processing is a process for realizing the performance corresponding to each speech post outside the time limit at any time while individually adjusting the time of the performance of each speech post corresponding to the time limit. Furthermore, for example, when the posting of each speech with a limited time is added as one event performance in a predetermined period, in the second form, the performance control processing of the example of FIG. 7 and the post-event performance processing of the example of FIG. 8 are also executed. Can. In this case, the information of the play status of the game may be appropriately referred to, for example, to determine the time limit. Alternatively, it may be referred to in the transition of step S102 or the control of step S103 in the example of FIG. 7 .

The device service management unit 26 starts the performance adjustment process of FIG. 12 every time a speech is posted, and first acquires the input result (posted speech) input through the user terminal device 4 (step S301 ). Next, the device service management unit 26 acquires the play status of the game from the game machine 3 (step S302). When the device service management unit 26 acquires the game status, it converts the speech posted based on the information on the game status and the input result acquired in step S301 into an event performance (step S303). However, this conversion is, for example, as shown in FIG. The conversion of step S102 of the example is implemented in the same way. However, in this conversion, the device service management unit 26 may appropriately refer to the information on the play status of the game. Specifically, for example, when the event performance is different according to the game play status, the device service management unit 26 realizes the event performance according to the play status while referring to the information of "performance" and "condition" of the performance data ED. convert.

Next, the appliance service management unit 26 determines whether or not the adjustment conditions are satisfied (step S304). The adjustment conditions may be satisfied as appropriate, but when adjustment is achieved within the time limit, it is satisfied when the posting period of the speech meets the time limit. Therefore, the machine service management unit 26 refers to the information on the game status acquired in step S302, and determines whether or not the posting time of the speech corresponds to the limited time (emotional period when a hit or the like occurs). When the posting time of the speech corresponds to the limited time (the adjustment condition is satisfied), the device service management unit 26 adjusts the time (performance time) of the event performance corresponding to the posting of the speech (step S305 ). Specifically, the device service management unit 26 sets the performance time as not the posting time for the speech (there may be a slight deviation due to various processes, the communication environment of the network NT, etc., but the deviation of the posting time is considered. ), but is adjusted so that it is offset by a predetermined period (eg, shortly after) after the limited time has elapsed. In addition, when multiple speeches are posted within a time limit, the performance period of each speech is staggered from the predetermined time in order so that the performances corresponding to each speech are performed in sequence after the time limit has elapsed according to the time of submission.

On the other hand, the device service management unit 26 specifies the control object when the posting time of the speech does not correspond to the limited time (the adjustment condition is not satisfied), or after adjusting the performance time in step S305 (step S306). This specification is implemented in the same manner as the specification of step S103 in the example of FIG. 7 , for example. However, in this specification, the service management unit 26 for equipment may appropriately refer to the play status. Specifically, for example, when the object of control changes according to the posting time of the speech, the device service management unit 26 determines the condition of the "object" during an attack while referring to the information of the game state.

Next, the appliance service management unit 26 controls each speaker SP (step S307). This control is implemented similarly to the control of step S104 of the example of FIG. 7, for example. Thereby, like the example of FIG. 7, the posting of each speech is converted into a performance, and this performance is realized by the speaker SP etc. which are actually installed in the event facility EF. In addition, when posting speeches within the time limit, the timing of the event performances corresponding to the speeches is adjusted, and after the time limit elapses, the event performances corresponding to the speeches are gradually added to the events of the event facility EF through speakers SP or the like.

As described above, according to the second aspect, similarly to the first aspect, the support behavior of the viewer of the photographic image of the viewing and listening event is converted into an event performance, and the performance is controlled in such a way that the converted event performance is added to the event Machine EA. Therefore, the same effects and the like as in the first form can be obtained, but in the second form, the transition of the active performance, or the identification of the performance machine EA to be controlled, etc., are further referred to the information on the play status of the game. As a result, the game play status of the game machine 3 can be reflected in the event performance. Thereby, a more detailed and accurate event performance can be realized.

In the second aspect, the equipment service management unit 26 of the central server 2 functions as the performance conversion means and the equipment control means of the present invention by executing the performance adjustment process of FIG. 12 . Specifically, by executing the process of step S303 in FIG. 12 , the device service management unit 26 has a function as a performance conversion means. Moreover, the apparatus service management part 26 has a function as apparatus control means of this invention by performing the process of step S305 of FIG. 12, and the process of step S307.

The present invention is not limited to the above-described form, and may be implemented in a form to which appropriate modifications or changes are added. For example, the regional system, the game machine 3 (in the second aspect), or other systems (or devices) such as the user terminal device 4 appropriately perform all or all of the functions (various processes, etc.) of the central server 2 in the above-mentioned aspect. Part of it is also possible. That is, the image delivery system of the present invention may include various other systems as appropriate. On the other hand, only the central server 2 may have the function as the video distribution system of the present invention, and only the regional system, the game machine 3 (in the case of the second form), or other appropriate systems such as the user terminal device 4 have this function. The function of the inventive image delivery system is also possible.

Hereinafter, various aspects of the present invention derived from the above-described embodiment and modified examples will be described. In addition, in the following description, in order to understand each aspect of this invention easily, the corresponding member shown in the drawings is attached with parentheses, however, this invention is not limited to the aspect shown in figure.

The video transmission system of the present invention is connected to the user terminal device (4) used by each user through the network (NT), and the performance equipment (EA) installed in the event facility (EF) by means of additional performance, The above-mentioned photographic image is transmitted to the display device (46) of the above-mentioned user terminal device so as to display an image screen (50) including a photographic image which is a photographing result of the activity held in the above-mentioned event facility. The video delivery system (1) of the user terminal device includes: performance conversion means (26) for executing the video image through the user terminal device by each viewer who is a user viewing and listening to the photographic video. When giving a support action that supports the aforementioned activity, the support action is converted into an action performance to be performed by the aforementioned performance machine; and the machine control means (26) is controlled in such a way that the aforementioned action performance is added to the aforementioned activity as the aforementioned performance The aforementioned performance machine.

According to the present invention, the support behavior of the viewer of the photographic image of the audiovisual activity is converted into an activity performance, and the performance machine is controlled in such a way that the converted activity performance is attached to the activity. That is, the user terminal device displays an image screen including a photographic image of the event, and accepts a support action for giving a support effect on the image screen, but the support action is converted into a moving performance by a performance machine, And the activity performance is actually attached to the activity. In this way, the reaction of the viewers, which is the supporting behavior of the photographic image, can be reflected in the event as a performance by the performance machine installed in the event facility. Specifically, for example, the emotions of the viewers can be reflected in the actual event through the event performance. As a result, compared to a situation in which such an event performance is not added, an event with a sense of presence can be realized.

The content (condition) of the event performance is not related to the period, quantity, type, etc. of the supporting behavior, and it may be the same, or it may be changed according to the content. For example, in one aspect of the image delivery system of the present invention, the performance conversion means may convert the support behavior into the activity performance by changing the activity performance in response to the support behavior of each viewer. At this point, content-specific support behaviors can be promoted through changes in the performance of the event. For example, in this aspect, the aforementioned performance conversion means is a method of changing the aforementioned activity performance in accordance with the number of aforementioned support actions at a predetermined time when a plurality of viewers perform the aforementioned supporting actions respectively at a predetermined time. Supporting behaviors can also be converted into the aforementioned activity performances. At this time, the change in the performance of the activity can promote an increase in the number of supportive behaviors at the designated time.

As the supporting action, various actions for producing various effects on the image screen may be appropriately executed through the user terminal device. For example, as support behaviors, the behavior of purchasing items, the behavior of supplying (so-called rewards) various values (the value equivalent to the real currency in circulation, and the virtual value used in the game etc. may also be used), or the behavior of providing (so-called reward) various values You can also post various speech actions on the screen. Then, these various behaviors can be appropriately converted into activity performances. Specifically, for example, in an aspect of the video delivery system of the present invention, when the performance conversion means is connected to the video screen, and as the support action, when the input operation of posting the speech displayed as the support effect is input, the above-mentioned Contributions of speeches can also be converted into performances of the aforementioned activities.

As mentioned above, activities and performances can be the same, and they can be changed. In the same situation, they can be the same regardless of the activity, and they can be the same for each activity. That is, the event performance may be changed according to each event, or it may not be changed. For example, in one aspect of the image transmission system of the present invention, the performance conversion means may convert the support behavior into the activity performance in a manner that makes the activity performance different according to the activity. In general, effective performances tend to vary depending on the type of activity, but in this case, it is possible to reflect this tendency and realize more effective activity performances.

The performance machine may include various machines (devices) for realizing performance. For example, the performance machine may appropriately include a display device, lighting, smoke device, etc. for additional visual performance. In addition, the performance machine system may include a sound output device to which visual performance is added. Then, appropriate performance may be realized through these various performance machines. Specifically, for example, in one aspect of the video transmission system of the present invention, the performance conversion means includes a sound output device (SP) for outputting sound to the performance equipment, and when the performance includes a voice performance through the sound, The sound that supports the above-mentioned activities is used as the above-mentioned sound performances that are different according to the above-mentioned activities, and is included in the above-mentioned activity performances.

In the event facility, various events are appropriately held. For example, in the event facility, various sports events such as baseball, sumo, soccer, and rugby may be held. Similarly, various live events such as concerts can be held in event facilities. Alternatively, in the event facility, a game event using a game machine may be held. In addition, in the case of game machines for game events, when various machines are installed in the event facilities, the information of these machines may be reflected in the event performance, or it may not be reflected. Specifically, for example, in an aspect of the video delivery system of the present invention, a game machine (3) providing a game is installed in the event facility; as the event, a game event using the game is held; and the device control means is tied to When connecting the above-mentioned game machine through the network (NT), the above-mentioned performance machine may be controlled by adjusting the period of the above-mentioned activity performance according to the above-mentioned game conditions. Also, for example, in one aspect of the video delivery system of the present invention, a game machine (3) providing a game is installed in the event facility; as the event, a game event using the game is held; and the performance conversion means is connected through a network When the road (NT) is connected to the aforementioned game machine, the aforementioned support behavior may be converted into the aforementioned event performance in accordance with the aforementioned game conditions and in a manner contrary to the aforementioned event performance. In these situations, the game play status of the game machine can be reflected in the event performance.

When a plurality of performance machines are installed in the event facility, the event performance may be performed by all of them, or may be realized by an appropriate part. In addition, the performance machines of these objects (all the performance machines when the activity performance is performed by all performance machines, and the performance machines of the object performing the activity performance when a part of the performance is performed) may be fixed or variable. Can. When the performance machine of the object is variable (changed), the difference including the performance machine can be regarded as an active performance, and the difference of the performance machine can be regarded as other elements different from the active performance. For example, in one aspect of the video transmission system of the present invention, the device control means is that when the performance machine includes a plurality of performance machines arranged at different positions of the event facility, according to the situation of the game, the execution of the plurality of performance machines is changed according to the situation of the game. A performance machine for the aforementioned event performance may also be used.

On the other hand, the computer program of the present invention is configured such that the computer (21) connected to the user terminal device and the performance machine via the network has the functions of the respective means of the video distribution system described above. .

In addition, the control method of the present invention is to connect the user terminal device (4) used by each user through the network (NT), and the performance equipment (EA) installed in the event facility (EF) by adding performance. ), and the above-mentioned photographic image is displayed on the display device (46) provided in the above-mentioned user terminal device so as to display a video screen (50) including a photographic image which is the result of photographing the activity held in the above-mentioned event facility. The computer (26) incorporated in the image delivery system (1) transmitted to the user terminal device executes the following program: a performance conversion program, which is connected to each viewer who is a user of viewing and listening to the photographic image through the user terminal. A device for converting the supporting action into an action performance to be performed by the performing machine when performing a supporting action for imparting a supporting effect supporting the action to the image screen; and a machine control program for adding the action action as the action. Control the aforementioned performance machines in the manner of the aforementioned activities. By executing these computer programs or control methods, the image delivery system of the present invention can be realized.

1: Image Delivery System 1A: Image Delivery System 1B: Image Delivery System 2: Central server 2A, 2B: Server unit 3: Game console 4: User terminal device 4A: Mobile terminal device 4B: Portable tablet terminal device 4C: Personal Computer 21: Control unit (computer) 22: Memory Department 23: Server Information 26: Machine Service Management Department (performance conversion means, machine control means) 27: Web Services Management Department 31: Control unit 32: Memory Department 33: Game Control Department 34: Data Management Department 36: Display 37: Speakers 41: Control unit 42: Memory Department 43: Image Control Department 44: Data Management Department 46: Display 47: Speakers 50: Image screen 51: Submission button EFI: Stadium Images VD: image data DD: machine data DDR: Machine Record ED: Performance Information EDR: Performance Record GD:Game Information TD: Terminal data TP: Touch Panel LU: Lighting Unit IP: Input Device CA: camera EA: The Performance Machine EF: Event Facilities NT: network SP: Speaker (sound output device) SU: smoke device MO: Display PG1: Server program (computer program) PG2: Terminal program PG3: Game Program

[ Fig. 1] Fig. 1 is a diagram showing a schematic structure of a video delivery system according to an aspect of the present invention. [Fig. 2] Fig. 2 is a diagram showing a schematic structure of the video delivery system of the first aspect. [Fig. [ Fig. 3] Fig. 3 is a functional block diagram showing the essential parts of the control system of the video delivery system of the first aspect. [ Fig. 4 ] A diagram showing an example of the flow of the performance service in the first form. [ Fig. 5 ] A diagram showing an example of the structure of machine data. [ Fig. 6 ] A diagram showing an example of the structure of performance data. [ Fig. 7 ] A flowchart showing an example of the procedure of the performance control process. [ Fig. 8 ] A flowchart showing an example of the procedure of the post-show processing. [ Fig. 9] Fig. 9 is a diagram showing a schematic structure of the video delivery system of the second aspect. [ Fig. 10] Fig. 10 is a functional block diagram showing the main parts of the control system of the video delivery system of the second aspect. [ Fig. 11 ] A diagram showing an example of the flow of the performance service in the second form. [ Fig. 12 ] A flowchart showing an example of the procedure of the performance adjustment processing.

2: Central server

4: User terminal device

50: Image screen

51: Submission button

EFI: Stadium Images

CA: camera

EF: Event Facilities

SP: Speaker

Claims (11)

An image transmission system is connected to the user terminal device used by each user through the network, and the performance machine installed in the activity facility in the form of additional performance, and is installed in the display device of the user terminal device, An image delivery system for transmitting the photographed image to the user terminal device by displaying a video screen including a photographic image as a result of photographing the event held in the event facility, is characterized by comprising: The performance conversion means is configured to convert the support action into a support action for giving a support effect supporting the action to the video image through the user terminal device, each viewer who is a user of viewing and listening to the photographic image. the performance of the activity to be performed by the aforementioned performance machine; and The machine control means controls the aforementioned performance machine in such a way that the aforementioned activity performance is added to the aforementioned activity as the aforementioned performance. The image delivery system as recited in claim 1, wherein, The aforementioned performance conversion means is to convert the aforementioned support behavior into the aforementioned event performance by changing the aforementioned activity performance in response to the aforementioned support behavior of each viewer. The image delivery system as recited in claim 2, wherein, The aforementioned performance conversion means is to convert the aforementioned support behavior into the aforementioned activity performance by changing the aforementioned activity performance according to the number of the aforementioned support behaviors at the aforementioned predetermined time when the plurality of viewers perform the aforementioned support behaviors respectively. . The image delivery system as recited in claim 1, wherein, The performance conversion means is based on the image screen as the supporting action, when inputting a posting operation of posting a speech displayed by the supporting effect, converting the posting of the speech into the activity performance. The image delivery system as recited in claim 1, wherein, The aforementioned performance conversion method is to convert the aforementioned support behavior into the aforementioned event performance in a way that makes the aforementioned event performance different in response to the aforementioned event. The image delivery system as recited in claim 5, wherein, The performance conversion means includes a sound output device for outputting sound to the performance machine, and when the performance includes a sound performance through the sound, the sound supporting the activity is used as the sound performance that differs according to the activity, including in The way of the aforementioned activity performance is to convert the aforementioned support behavior into the aforementioned activity performance. The image delivery system as described in any one of claims 1 to 6, wherein, At the aforementioned event facilities, set up game machines that provide games; As the aforementioned event, hold a gaming event utilizing the aforementioned game; The above-mentioned machine control means controls the above-mentioned performance machine by adjusting the period of the above-mentioned activity performance according to the above-mentioned game conditions when the above-mentioned game machine is connected through a network. The image delivery system as described in any one of claims 1 to 6, wherein, At the aforementioned event facilities, set up game machines that provide games; As the aforementioned event, hold a gaming event utilizing the aforementioned game; The above-mentioned performance conversion means is to convert the above-mentioned support behavior into the above-mentioned activity performance in a manner that is inconsistent with the above-mentioned activity performance according to the situation of the above-mentioned game when the above-mentioned game machine is connected through the network. The image delivery system as recited in claim 7, wherein, The machine control means is that when the performance machine includes a plurality of performance machines arranged at different positions of the event facility, according to the situation of the game, the performance machine that should perform the activity performance is changed among the plurality of performance machines. A recording medium for storing a computer program, characterized in that: the computer program enables a computer connected to the user terminal device and the performance machine through the network to have the image of any one of claims 1 to 9 It is structured in a way to transmit the function of each means of the system. A control method, which is characterized by connecting to a user terminal device used by each user through a network, and a performance machine installed in an event facility by means of an additional performance, and using the display device installed in the user terminal device. A device that displays an image screen including a photographic image as a photographing result of an event held in the event facility, transmits the photographic image to a computer incorporated in the image delivery system of the user terminal device, and executes the following program : The performance conversion program converts the support action into a support action for giving a support effect supporting the action to the video image through the user terminal device, each viewer who is a user of viewing and listening to the photographic image. the performance of the activity to be performed by the aforementioned performance machine; and The machine control program controls the aforementioned performance machine in such a way that the aforementioned event performance is added to the aforementioned event as the aforementioned performance.

Images