JP2023120932A - Information processing system, information processing device, program, and information processing method - Google Patents

Abstract

To provide an information processing system.SOLUTION: A system 10 comprises an information processing device and a content distribution device. The information processing device comprises: a first information reception unit which receives input operation information showing input operations input to a communication terminal from each of a plurality of communication terminals possessed by each of live content audiences; a tallying unit which tallies input operations shown by the input operation information received from each of the plurality of communication terminals by the first information reception unit; and an information transmission unit which transmits tallying results of the tallied input operations to the content distribution device. The content distribution device comprises: a storage unit which stores first rendering association information for associating types of input operations to the communication terminals with rendering processing for live contents; a second information reception unit which receives the tallying results of the input operations from the information processing device; and a rendering processing determination unit which determines rendering processing of an execution object on the basis of the tallying results of the input operations received by the second information reception unit and the first rending association information stored in the storage unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing system, an information processing device, a program, and an information processing method.

Japanese Patent Laid-Open No. 2004-200002 describes a technique for controlling the performance on a stage by inputting a comment from a user terminal viewing the stage via a network.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2013-037670 A

According to one embodiment of the present invention, an information processing system is provided. The information processing system may include an information processing device. The information processing system may comprise a content delivery device. The information processing apparatus may include a first information receiving section that receives input operation information indicating an input operation input to a communication terminal from each of a plurality of communication terminals owned by spectators of the live content. The information processing apparatus may include an aggregation unit that aggregates the input operations indicated by the input operation information received by the first information reception unit from each of the plurality of communication terminals. The information processing device may include an information transmission unit configured to transmit a tally result of the input operations tallied by the tally unit to the content distribution device. The content distribution device may have a storage unit that stores first effect correspondence information that associates a type of input operation to the communication terminal with a effect process for the live content. The content distribution device may have a second information receiving unit that receives the tallied result of the input operation from the information processing device. The content distribution device determines an effect process to be executed based on the total result of the input operations received by the second information receiving unit and the first effect correspondence information stored in the storage unit. You may have the production|presentation process determination part which performs.

The counting unit may count the input operations indicated by the input operation information received from each of the plurality of communication terminals by the first information receiving unit during the performance of the live content. The effect processing determining unit may determine the effect processing based on the result of the input operation counted by the counting unit during the performance of the live content. The effect process determination unit may determine the effect process associated with the input operation with the largest total number of input operations during a predetermined period. The effect processing determining unit may determine the effect processing associated with an input operation in which the total number of input operations during a predetermined period is greater than a predetermined total number threshold.

The aggregating unit determines whether the input operation flag indicating whether the input operation is valid or invalid among the input operations indicated by the input operation information received from each of the plurality of communication terminals is valid. Operations may be aggregated. The counting unit may count the input operations for each communication terminal. The effect processing determination unit may determine the effect processing for the communication terminal to which the input operation satisfying a predetermined input operation condition is input. The aggregating unit weights the input operation indicated by the input operation information received from one of the communication terminals more than the input operation indicated by the input operation information received from the other communication terminal, and aggregates the input operation. good.

The first information receiving section may receive, from each of the plurality of communication terminals, remaining battery level information indicating remaining battery levels of the communication terminals. The totalizing unit may totalize the remaining battery power indicated by the remaining battery power information received by the first information receiving unit from each of the plurality of communication terminals. The information transmission unit may transmit a tally result of the battery remaining amount tallied by the tally unit to the content distribution device. The second information receiving unit may receive the counting result of the remaining battery power from the information processing device. The effect processing determining unit may execute an event for determining the effect processing when the counting result of the remaining battery power received by the second information receiving unit satisfies a predetermined remaining battery level condition. .

The first information receiving section may receive communication terminal-related information including communication terminal-related data from each of the plurality of communication terminals. The totalizing section may totalize the communication terminal-related data included in the communication terminal-related information received from each of the plurality of communication terminals by the first information receiving section. The information transmission unit may transmit a total result of the communication terminal-related data collected by the totalization unit to the content distribution device. The storage section may store second effect correspondence information that associates a type of communication terminal-related data related to the communication terminal with the effect process. The second information receiving section may receive the counting result of the communication terminal-related data from the information processing device. The effect processing determination unit performs the effect processing based on the result of aggregation of the communication terminal-related data received by the second information receiving unit and the second effect correspondence information stored in the storage unit. You can decide.

The effect processing determination unit may determine the effect processing for changing the content of the live content, which is XR (Cross Reality) content. The effect processing determination unit may determine the effect processing for changing the output of a device used for performing the live content. The first information receiving unit receives, from each of the plurality of communication terminals, the input operation information indicating the input operation detected by at least one of a gyro sensor and an acceleration sensor mounted on the communication terminal. good.

According to one embodiment of the present invention, an information processing device is provided. The information processing apparatus may include an information receiving unit that receives input operation information indicating an input operation input to a communication terminal from each of a plurality of communication terminals owned by spectators of the live content. The information processing apparatus may include an aggregation unit that aggregates the input operations indicated by the input operation information received by the information reception unit from each of the plurality of communication terminals. The information processing apparatus may include an information transmission unit configured to transmit information based on the result of counting the input operations counted by the counting unit.

The information processing device may further include a storage unit that stores first effect correspondence information that associates the type of input operation to the communication terminal with the effect processing for the live content. The information processing device determines an effect process to be executed based on the total result of the input operations totaled by the total part and the first effect correspondence information stored in the storage part. A part may be further provided. The information transmission unit may transmit effect processing information indicating the effect processing determined by the effect processing determination unit.

According to one aspect of the present invention, there is provided a program for causing a computer to function as the information processing apparatus.

According to one embodiment of the present invention, an information processing method is provided. The information processing method includes a first information receiving step in which the information processing device receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by spectators of the live content. good. The information processing method may include a tallying step of tallying the input operations indicated by the input operation information received from each of the plurality of communication terminals in the first information receiving step. The information processing method may include an information transmission step in which the information processing device transmits a tally result of the input operations tallied in the tally step to the content distribution device. The information processing method may include a second information receiving step in which the content distribution device receives the tallied result of the input operation from the information processing device. In the information processing method, the content distribution device stores the total result of the input operations received in the second information receiving step, the type of input operation to the communication terminal and the live information stored in the content distribution device. An effect processing determination step of determining the effect processing to be executed based on the first effect correspondence information that associates the effect processing with respect to the content may be provided.

According to one embodiment of the present invention, a computer-implemented information processing method is provided. The information processing method may include an information receiving step of receiving input operation information indicating an input operation input to a communication terminal from each of a plurality of communication terminals owned by spectators of the live content. The information processing method may include a tallying step of tallying the input operations indicated by the input operation information received from each of the plurality of communication terminals in the information receiving step. The information processing method may include an information transmitting step of transmitting information based on the result of counting the input operations counted in the counting step.

It should be noted that the above summary of the invention is not an exhaustive list of all the necessary features of the invention. Subcombinations of these feature groups can also be inventions.

An example system 10 is shown schematically. Another example of system 10 is shown schematically. An example of live content displayed on the display device 40 is shown schematically. Another example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. Another example of live content displayed on the display device 40 is schematically shown. An example of the functional configuration of the information processing apparatus 100 is shown schematically. An example of the functional configuration of the content delivery device 200 is shown schematically. An example of event correspondence information stored in the information processing apparatus 100 is shown schematically. 1 schematically shows an example of totalization results totaled by the information processing apparatus 100. FIG. 2 schematically shows another example of the aggregated results aggregated by the information processing apparatus 100. FIG. 1 schematically shows an example of effect correspondence information stored in the content distribution device 200. FIG. 1 schematically shows an example of communication terminal-related data correspondence information stored in information processing apparatus 100. FIG. 2 schematically shows another example of the aggregated results aggregated by the information processing apparatus 100. FIG. Another example of the effect correspondence information stored in the content distribution device 200 is schematically shown. 4 is an explanatory diagram for explaining an example of the flow of processing of the information processing apparatus 100; FIG. 1 schematically shows an example of a hardware configuration of a computer 1200 functioning as an information processing apparatus 100. FIG.

Currently, in live content such as live music performances online, the only way for viewers of live content to communicate their intentions in live content is to post on chat, answer questionnaires, or support with tipping. Therefore, viewers' intentions can only be reflected in the production of live content during performances to the extent that viewers' chat posts and questionnaire responses are reflected. Therefore, it is not possible to obtain, with a high degree of freedom, the presentation of the live content or the expression of intent by the audience associated with the scene during the performance of the live content and to reflect it in the presentation of the live content in real time. In addition, even if you want to make a special production for a specific viewer, you cannot do it. Also, currently, in live content such as live music performances, the only way for viewers of live content to communicate their intentions in live content is to wave a penlight or fan if they do not use a dedicated device. . Therefore, without the use of a dedicated device, it is not possible to acquire the intentions of viewers linked to live content production and scenes with a high degree of freedom during live content performances, and to reflect them in live content production in real time. . On the other hand, the method using a dedicated device is not versatile. In addition, even if you want to make a special production for a specific viewer, you cannot do it. Furthermore, in the current live content, the method of acquiring weather data such as temperature data and humidity data and people flow data is to install sensors in advance and search for and utilize APIs (Application Programming Interfaces) that are open to the public. There is only a degree. Therefore, it is not possible to acquire weather data, crowd flow data, etc. of an arbitrary point during a performance of live content and reflect it in real-time production of the live content. The system 10 according to the present embodiment includes, for example, software for smartphones that enables viewers of live content held online or offline to input their own intentions, and acquires viewer input operations from the software. an API for acquiring statistical data of input operations by viewers; and an API for transmitting operation signals for live content (when digital content is rendered by an MEC (Multi-access Edge Computing) server). provide. This allows viewers to express their intentions to a high degree. In addition, by passing the information to the live content side, it is possible to make use of it in directing the live content. Furthermore, since smartphones are used, it is possible to produce special effects for specific viewers by enabling production for specific smartphones.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention.

FIG. 1 schematically illustrates an example system 10 . The system 10 includes, for example, an information processing device 100 and a content delivery device 200 . The system 10 may comprise multiple communication terminals 300 . System 10 may comprise communication terminal 400 . System 10 may include display device 40 .

Information processing apparatus 100 communicates with a plurality of communication terminals 300 . The information processing device 100 communicates with a plurality of communication terminals 300 via the network 20, for example. The information processing apparatus 100 communicates with, for example, each of the plurality of communication terminals 300 owned by the spectators of the live content distributed by the content distribution apparatus 200 .

Network 20 may include a core network provided by a carrier. The core network may conform to, for example, a 5G (5th Generation) communication system. The core network may conform to mobile communication systems after the 6G (6th Generation) communication system. The core network may conform to a 3G (3rd Generation) communication system. The core network may comply with the LTE (Long Term Evolution) communication system. Network 20 may include the Internet.

For example, the information processing apparatus 100 receives input operation information indicating an input operation input to the communication terminal 300 from each of the plurality of communication terminals 300 owned by the spectators of the live content via the network 20 . An input operation input to communication terminal 300 is detected by at least one of a gyro sensor and an acceleration sensor mounted on communication terminal 300, for example. In this case, the input operation input to communication terminal 300 may be an operation of shaking communication terminal 300 . An input operation input to communication terminal 300 may be detected by a touch panel display mounted on communication terminal 300 . In this case, the input operation input to communication terminal 300 may be a tapping operation, a swiping operation, or the like. An input operation input to communication terminal 300 may be any operation detected by any other sensor.

The information processing apparatus 100 aggregates, for example, input operations indicated by input operation information received from each of the plurality of communication terminals 300 owned by the audience of the live content. The information processing apparatus 100 transmits, for example, information based on the tallied result of input operations via the network 20 . The information processing apparatus 100 transmits, for example, information based on the tally result of input operations to the content distribution apparatus 200 . The information processing apparatus 100 may transmit information based on the result of tallying the input operations to the communication terminal 400 owned by the creator of the live content. A live content creator is, for example, a live content director. A live content creator may be a live content producer.

The content distribution device 200 distributes live content. The content distribution device 200 distributes live content via the network 20, for example.

The content distribution device 200, for example, generates live content and distributes the generated live content. The content distribution device 200 may distribute pre-stored live content.

The content distribution device 200 distributes live content so that, for example, the live content is displayed on the display device 40 of a live venue or the like. The content distribution device 200 distributes live content such that, for example, the live content is displayed on each display device 40 of a plurality of different live venues. The content distribution device 200 may distribute the live content such that the live content is displayed on the display of the communication terminal 300 owned by the audience of the live content.

The information processing device 100 may have the functions of the content distribution device 200 . That is, the information processing device 100 and the content distribution device 200 may be integrated.

Live content is, for example, online live live content. The live content may be offline live live content.

Live content is, for example, live music content. Live content is, for example, live comedy live content. Live content may be any other live content.

Live content is, for example, live live content by a virtual character. In this case, the live content is, for example, XR content. XR content is, for example, VR (Virtual Reality) content. XR content is, for example, AR (Augmented Reality) content. XR content may be MR (Mixed Reality) content. The live content may be live live content by a real person.

Communication terminal 300 and communication terminal 400 communicate with information processing apparatus 100 using, for example, an application. Communication terminal 300 and communication terminal 400 communicate with information processing apparatus 100 using, for example, a web application. Communication terminal 300 and communication terminal 400 communicate with information processing apparatus 100 using native applications, for example. Communication terminal 300 and communication terminal 400 may communicate with information processing apparatus 100 using a hybrid application that combines a web application and a native application.

Communication terminal 300 and communication terminal 400 may be any terminals as long as they can communicate with information processing apparatus 100 . For example, the communication terminal 300 and the communication terminal 400 may be mobile phones such as smart phones, tablet terminals, wearable terminals, and the like. Communication terminal 300 and communication terminal 400 may be PCs (Personal Computers).

FIG. 1 mainly describes an example in which the content distribution device 200 determines the effect processing for live content, which is XR content of a live music performance. Here, the explanation is continued assuming that the XR content is distributed so as to be displayed on the display device 40 at the live venue.

In the content distribution device 200, effect correspondence information that associates the type of input operation to the communication terminal 300 with the effect processing for the live content is registered in advance. Here, "the operation of shaking the communication terminal 300 to the left" is associated with the effect processing of "the virtual character wears the costume A and plays the song 1", and the "operation of shaking the communication terminal 300 to the right" and the "virtual character "plays song 1 in costume B" is associated with the effect processing, and "the operation of shaking communication terminal 300 upward" is associated with the effect process of "virtual character wears costume C and plays song 1". Effect correspondence information in which ``the operation of shaking the communication terminal 300 downward'' is associated with the effect processing of ``the virtual character wears the costume D and plays the tune 1'' is registered in advance in the contents distribution device 200. - 特許庁Continue to explain.

The information processing apparatus 100 receives input operation information from each of the plurality of communication terminals 300 owned by the audience of the live content at the live venue via the network 20 . A live content audience performs an input operation to the communication terminal 300 in response to, for example, an event notification notifying of a "voting event". The event notification is displayed on the display device 40, for example.

The information processing apparatus 100 aggregates input operations indicated by input operation information received from each of the plurality of communication terminals 300 . The information processing apparatus 100 performs, for example, an “operation of shaking the communication terminal 300 to the left”, an “operation of shaking the communication terminal 300 to the right”, an “operation of shaking the communication terminal 300 upward”, and an “operation of shaking the communication terminal 300 downward”. , and totaled respectively. Here, the explanation will be continued assuming that the total number of times of "operation to shake communication terminal 300 to the left" is the largest.

The information processing apparatus 100 transmits, via the network 20, the result of tallying the input operations to the content distribution apparatus 200 as information based on the result of tallying the input operations. The content distribution device 200 determines the effect processing for the live content to be executed based on the result of counting the input operations and the effect correspondence information received from the information processing device 100 . Here, the content distribution device 200 executes the effect processing of "virtual character wears costume A and plays song 1" corresponding to "operation of shaking communication terminal 300 to the left" with the largest total number of input operations. The description will be continued assuming that it is determined as the target effect processing.

The content distribution device 200 generates live content in which the virtual character wears the costume A and plays the tune 1 based on the determined effect processing. The content distribution device 200 distributes the generated live content via the network 20 .

Currently, if the live content is live online live content, it is possible to know the intention of the audience of the live content only to the extent of confirming financial support such as chat posts, questionnaire responses, or tipping by the audience of the live content. . When knowing the intent of the live content audience from chat posts and questionnaire responses, it is difficult for the live content audience to post a chat or answer a questionnaire while watching the live content. The presence of the audience for the live content is reduced. When knowing the intention of the audience of the live content from financial support such as tipping, the intention of the audience of the live content can only be known in a very limited way. Also, if the live content is offline live live content, if the live content audience does not use a dedicated device to communicate their intentions, the penlight or fan brought by the live content audience will be checked. The intention of the audience of the live content can only be understood to the extent that it is done. When knowing the intention of the audience of the live content from a penlight or fan, it is possible to know the intention of the audience of the live content only in a very limited way. When using a dedicated device to know the intent of the audience of the live content, the number of dedicated devices is necessary for the number of audience of the live content, and how to use the dedicated device must be explained to the audience of the live content. Therefore, the dedicated device has a high introduction cost and is not versatile. Therefore, it is possible to know the intention of the audience of the live content with respect to the production and scenes of the live content with a high degree of freedom without reducing the presence of the audience of the live content to the live content. There is a demand for a general-purpose system that can be reflected in the performance of.

According to the system 10 according to the present embodiment, the information processing apparatus 100 receives the input operation information from each of the plurality of communication terminals 300, totals the input operations indicated by the received input operation information, and totals the input operations. Information based on the result is transmitted to the content distribution device 200 . The content distribution device 200 determines the effect processing for the live content to be executed based on the information based on the result of counting the input operations received from the information processing device 100 and the effect correspondence information. Since the content distribution device 200 can register the performance correspondence information for each event for determining the performance processing, the performance of the live content can be performed by knowing the intention of the audience of the live content with respect to the performance and scene of the live content with a high degree of freedom. can be reflected in In particular, when the information processing device 100 tallies input operations during a live content performance, the content distribution device 200 performs effect processing to be executed based on information based on the tally result of the input operations tallied during the live content performance. can be determined. Therefore, the content distribution device 200 can reflect the intention of the audience of the live content in real time. As a result, the sense of unity between the audience of the live content and the creator of the live content can be enhanced. In addition, the content distribution apparatus 200 selects an execution target based on information based on the totalized result of the input operation indicated by the input operation information received from the communication terminal 300, which is a general-purpose device such as a smartphone, by the information processing apparatus 100. can be determined. Furthermore, since the input operations counted by the information processing apparatus 100 are simple input operations such as shaking the communication terminal 300, the live content audience can perform input operations on the communication terminal 300 while watching the live content. is. Therefore, the system 10 according to the present embodiment can recognize the intention of the audience of the live content and reflect it in the performance of the live content without reducing the presence of the audience of the live content. As a result, the system 10 according to the present embodiment can acquire and acquire the intent of the audience of the live content with respect to the production and scenes of the live content with a high degree of freedom without reducing the presence of the audience of the live content with respect to the live content. It is possible to realize a general-purpose system capable of reflecting the intention of the audience of the live content to the performance of the live content.

FIG. 2 schematically shows another example of system 10 . FIG. 2 mainly describes an example in which the content distribution device 200 determines the effect processing for live content, which is XR content of a live music performance.

The processor 220 of the content distribution device 200 aggregates the input operations indicated by the input operation information received by the information processing device 100 from each of the communication terminals 300 via the API from the information processing device 100 via the API. Receives the aggregate result of input operations. The processor 220 stores the tally result of the input operations received from the information processing apparatus 100 in the tally result storage unit 230 .

Processor 220 receives presentation correspondence information from communication terminal 400 via API. The processor 220 stores the received effect correspondence information in the effect correspondence information storage unit 240 .

The processor 220 receives IoT sensor data from an IoT (Internet of Things) sensor 600 via an API. Processor 220 receives temperature data from, for example, IoT sensor 600 . Processor 220 may receive any other IoT sensor data from IoT sensor 600 . The processor 220 stores the received IoT sensor data in the IoT sensor data storage unit 260. FIG.

The IoT sensor 600 is installed, for example, at a live venue where XR content is distributed. The IoT sensor 600 may be placed anywhere else.

Processor 220 receives environmental data from environmental data management device 700 via the API. Processor 220 receives weather data, for example, from environmental data management device 700 . Processor 220 may receive any other environmental data from environmental data manager 700 . Processor 220 stores the received environmental data in environmental data storage unit 270 .

The environmental data management device 700 manages environmental data of, for example, live venues where XR content is distributed. The environmental data management device 700 may manage environmental data of any other location.

Processor 220 may receive any data via the API from any other external device. The external device is, for example, a city OS (Operating System) server. The external device is, for example, a fixed point camera. The external device is, for example, an SNS (Social Networking Service) server. The external device is, for example, a search engine server. The external device may be a payment data management server that manages payment data.

The processor 220 receives motion data from the motion capture device 500, which provides motion data based on detection results of motion of a live human being. Processor 220 receives motion data from motion capture device 500 using, for example, a VPN (Virtual Private Network) communication protocol. Processor 220 may receive motion data from motion capture device 500 using any other communication protocol.

The processor 220 determines an effect process for the XR content to be executed, based on the total result of the input operations stored in the total result storage unit 230 and the effect correspondence information stored in the effect correspondence information storage unit 240. do. The processor 220 may further determine the rendering process to be executed based on the IoT sensor data stored in the IoT sensor data storage unit 260 . The processor 220 may further determine the rendering process to be executed based on the environment data stored in the environment data storage section 270 .

Processor 220 generates XR content. The processor 220 generates XR content by, for example, rendering the XR content based on the action data received from the motion capture device 500 and the effect processing to be executed determined by the processor 220 .

The processor 220 distributes the XR content so that the generated XR content is displayed on the display device 40 such as a live venue. Processor 220 delivers XR content using, for example, an OSC (OpenSound Control) communication protocol. Processor 220 delivers XR content using, for example, the Art-Net communication protocol. Processor 220 may use any other communication protocol to deliver XR content.

FIG. 3 schematically shows an example of live content displayed on the display device 40. As shown in FIG. FIG. 3 mainly describes an example in which the display device 40 displays live content, which is XR content of live music.

The display device 40 displays the XR content superimposed with an event notification of a "voting event." The event notification in FIG. 3 includes the message "Which hat do you want to wear in the next song?", the image data of hat A, which is one of the options, the image data of the left arrow, and the message "Shake left to select". , the image data of the hat B which is another one of the options, the image data of the right arrow, and the message "shake right to select". When the audience of the live content who has confirmed the event notification displayed on the display device 40 wants the virtual character to wear the hat A for the next song, he or she shakes the communication terminal 300 to the left and causes the virtual character to wear the hat B for the next song. If you want to cover with , the communication terminal 300 is swung to the right. Information processing apparatus 100 selects an "operation of shaking communication terminal 300 to the left" and an "operation of shaking communication terminal 300 to the right" from the input operations indicated by the input operation information received from each of communication terminals 300. Aggregate each. The information processing apparatus 100 transmits the tallied result of input operations to the content distribution apparatus 200 .

FIG. 4 schematically shows another example of live content displayed on the display device 40. As shown in FIG. In FIG. 4 , in the “voting event” in the description of FIG. 3 , the total number of times of the “operation of shaking the communication terminal 300 to the left” is greater than the total number of times of “operation of shaking the communication terminal 300 to the right”. An example in which this is indicated will be mainly described.

Since the total number of input operations indicates that the total number of "operations of shaking the communication terminal 300 to the left" is greater than the total number of "operations of shaking the communication terminal 300 to the right", the content distribution apparatus 200 determines that "voting In the effect correspondence information of "event", the effect processing "virtual character wears hat A and plays song 1" corresponding to "operation of shaking communication terminal 300 to the left" is determined as the effect process for the XR content to be executed. . The content distribution device 200 renders and distributes the XR content in which the virtual character wears the hat A and plays the tune 1 based on the determined effect processing. The display device 40 displays XR content distributed by the content distribution device 200 .

FIG. 5 schematically shows another example of live content displayed on the display device 40. As shown in FIG. FIG. 5 mainly describes an example in which the display device 40 displays live content, which is XR content of live music.

The display device 40 displays XR content superimposed with an event notification that notifies a "tap event." The event notification in FIG. 5 includes the message "Let's all tap to open the treasure box before the next song!" and image data of the closed treasure box. A spectator of the live content who has confirmed the event notification displayed on the display device 40 taps the "open" button displayed on the communication terminal 300 when he/she wishes to open the treasure chest. The information processing apparatus 100 aggregates “operations of tapping the communication terminals 300 ” from the input operations indicated by the input operation information received from each of the plurality of communication terminals 300 . The information processing apparatus 100 transmits the tallied result of input operations to the content distribution apparatus 200 .

FIG. 6 schematically shows another example of live content displayed on the display device 40. As shown in FIG. FIG. 6 shows an example of a case in which the total number of input operations in the "tap event" in the description of FIG. Mainly explained.

The content distribution apparatus 200 indicates that the total number of times of the "operation of tapping the communication terminal 300" is greater than the total number of times threshold value in the total number of input operations, so the content distribution apparatus 200 adds "communication terminal 300 'tap operation' is determined as the effect process for the XR content to be executed. The contents distribution device 200 renders and distributes the XR contents including the message "Treasure box opened!", changing the closed treasure box to the open treasure box based on the determined effect processing. The display device 40 displays XR content distributed by the content distribution device 200 .

FIG. 7 schematically shows another example of live content displayed on the display device 40. As shown in FIG. FIG. 7 mainly describes an example in which the display device 40 displays live content, which is XR content of live music. In FIG. 7, parts different from those in FIG. 3 will be mainly described.

When a plurality of display devices are installed in a live venue or the like, a display device 45 different from the display device 40 displays an event notification for notifying a "voting event". The display device 40 displays the XR content on which the event notification for notifying the "voting event" is not superimposed.

FIG. 8 schematically shows an example of the functional configuration of the information processing device 100. As shown in FIG. The information processing device 100 has a storage unit 102 , an effect-related information registration unit 104 , an information receiving unit 106 , an aggregation unit 108 , an effect processing determining unit 110 , an information transmitting unit 112 , and a content generating unit 114 . Note that it is not essential that the information processing apparatus 100 have all of these configurations.

The storage unit 102 stores various information. The storage unit 102 stores, for example, user information of live content audience. User information includes, for example, user identification information that identifies an audience member of the live content. The user information includes, for example, terminal identification information that identifies the communication terminal 300 owned by the spectator of the live content. The user information includes e-mail address information of the live content audience, for example. User information includes password information for communication terminal 300 to log in to an application. The user information may include ticket type information indicating the type of ticket purchased by the spectator of the live content. A ticket is, for example, a regular ticket. The ticket may be a premium ticket that costs more than a regular ticket.

The storage unit 102 stores, for example, event correspondence information that associates the type of input operation to the communication terminal 300 with an event that determines the effect processing for the live content to be executed. The event correspondence information has, for example, an event tag attached to each event that determines the effect processing.

An event that determines the effect processing is, for example, a voting event. An event that determines the rendering process is, for example, a tap event. The event that determines the rendering process may be any other event.

The storage unit 102 stores, for example, communication terminal-related data correspondence information that associates the type of communication terminal-related data related to the communication terminal 300 with a reception condition for the information processing apparatus 100 to receive the communication terminal-related data from the communication terminal 300. do. In the communication terminal-related data correspondence information, for example, a communication terminal-related data tag is attached to each communication terminal-related data.

Communication terminal-related data includes, for example, position data indicating the position of communication terminal 300 . Communication terminal-related data includes, for example, temperature data indicating the temperature of communication terminal 300 . Communication terminal-related data includes, for example, moving speed data indicating the moving speed of communication terminal 300 . Communication terminal-related data includes, for example, atmospheric pressure data indicating the atmospheric pressure detected by communication terminal 300 . Communication terminal related data may include any other data related to communication terminal 300 .

The effect corresponding information registration unit 104 registers the effect corresponding information in the storage unit 102 . The effect corresponding information registration unit 104 registers the effect corresponding information received from the communication terminal 400 by the information receiving unit 106 in the storage unit 102, for example. The effect-related information registration unit 104 may register, in the storage unit 102 , the effect-related information input by the live content creator using the input device of the information processing apparatus 100 .

The effect correspondence information includes, for example, first effect correspondence information that associates the type of input operation to the communication terminal 300 with the effect processing for the live content. For example, an event tag is attached to the first effect correspondence information for each event that determines the effect process. The effect correspondence information may include second effect correspondence information that associates the type of communication terminal-related data related to the communication terminal 300 with the effect processing for the live content. In the second effect correspondence information, for example, a communication terminal-related data tag is attached to each communication terminal-related data.

For example, the effect correspondence information registration unit 104 further associates the event correspondence information with an input operation flag indicating whether the input operation to the communication terminal 300 corresponding to the event correspondence information is valid or invalid, and stores the flag in the storage unit 102. to register. For example, the effect correspondence information registration unit 104 further associates an event tag attached to the event correspondence information with an input operation flag corresponding to the event tag, and registers the event tag in the storage unit 102 .

The information receiving unit 106 receives various information from an external device. The information receiving unit 106 receives various types of information from, for example, an external device via the network 20 . The information receiving unit 106 stores the received various information in the storage unit 102 .

The information receiving unit 106 receives various types of information from each of the plurality of communication terminals 300, for example. The information receiving unit 106 receives various types of information, for example, from each of a plurality of communication terminals 300 owned by each audience member of the live content. The information receiving unit 106 receives various types of information from each of the plurality of communication terminals 300, for example, during a live content performance.

The information receiving unit 106 receives input operation information from each of the plurality of communication terminals 300, for example. The information receiving unit 106 receives remaining battery level information indicating the remaining battery level of the communication terminal 300 from each of the plurality of communication terminals 300, for example. The information receiving section 106 may receive communication terminal-related information including communication terminal-related data from each of the plurality of communication terminals 300 . The information receiving unit 106 periodically receives remaining battery level information and communication terminal-related information, for example.

The information receiving unit 106 receives various information from the content distribution device 200, for example. The information receiving unit 106 receives various types of information from the content distribution device 200, for example, during a live content performance.

The information receiving unit 106 receives presentation correspondence information from the content distribution device 200, for example. The information receiving unit 106 receives input operation flag change instruction information for instructing change of the input operation flag from the content distribution apparatus 200, for example. The input operation flag change instruction information is, for example, information instructing to change the input operation flag from the valid state to the invalid state. The input operation flag change instruction information is, for example, information instructing to change the input operation flag from the invalid state to the valid state. Note that the input operation flag may be changed by inputting input operation flag change instruction information by the live content creator using an input device included in the information processing apparatus 100 . The information receiving unit 106 may receive a reception condition for receiving communication terminal-related data from the content distribution device 200 .

The information receiving unit 106 receives various information from the communication terminal 400, for example. The information receiving unit 106 receives various types of information from the communication terminal 400, for example, during a live content performance.

The information receiving unit 106 receives, for example, the same information as the information received from the content distribution device 200 from the communication terminal 400 . Information transmitting section 112 may receive arbitrary information different from the information received from content distribution apparatus 200 from communication terminal 400 .

The information receiver 106 may receive IoT sensor data from the IoT sensor 600 . The information receiving section 106 may receive environmental data from the environmental data management device 700 . The information receiving section 106 may receive arbitrary data from any other external device.

Aggregation unit 108 aggregates various types of information. The tallying unit 108 tallies various kinds of information during a live content performance, for example.

Aggregation unit 108 , for example, aggregates input operations indicated by input operation information received by information reception unit 106 from each of communication terminals 300 . Aggregation unit 108 aggregates, for example, input operations with valid input operation flags among input operations indicated by input operation information received by information reception unit 106 from each of communication terminals 300 . Aggregation unit 108 may aggregate input operations for each communication terminal 300 .

The tallying unit 108 tallies the input operations, for example, in a tallying mode according to the type of the event that determines the effect processing for the live content to be executed. For example, when the event that determines the effect processing is a "voting event", the tallying unit 108 tallies the input operations in an "overwrite" mode in which only the latest input operations input to the communication terminal 300 are tallied. For example, when the event that determines the effect processing is a "tap event", the counting unit 108 counts the input operations in an "accumulation" mode that counts all the input operations input to the communication terminal 300.

The tallying unit 108 may tally the remaining battery power indicated by the remaining battery power information received by the information receiving unit 106 from each of the plurality of communication terminals 300 . Aggregating section 108 may aggregate communication terminal-related data included in the communication terminal-related information received by information receiving section 106 from each of a plurality of communication terminals 300 . Aggregating unit 108 aggregates the remaining battery amount and communication terminal-related data, for example, in response to information receiving unit 106 receiving remaining battery amount information and communication terminal-related information.

The effect processing determination unit 110 determines effect processing for the live content to be executed. The effect processing determination unit 110 determines, for example, the effect processing to be executed during the live content performance.

For example, the effect processing determination unit 110 executes an event for determining the effect processing for the live content to be executed, when the total result of various information collected by the total unit 108 satisfies a predetermined event execution condition. For example, the effect processing determination unit 110 determines to execute an event for determining the effect processing to be executed when the counting result of the remaining battery charge collected by the counting unit 108 satisfies a predetermined remaining battery level condition. Effect processing determination unit 110 determines to execute an event for determining the effect processing to be executed when the totalization result of the communication terminal-related data collected by totalization unit 108 satisfies a predetermined communication terminal-related data condition. good too.

The effect processing determination unit 110 determines the effect processing to be executed, for example, based on the result of aggregation by the total unit 108 and the effect correspondence information stored in the storage unit 102 . The effect processing determination unit 110 determines the effect processing to be executed, for example, based on the total result of the input operations collected by the total unit 108 and the first effect correspondence information stored in the storage unit 102 . For example, the effect processing determining unit 110 selects the effect to be executed based on the total result of the input operations totaled by the totalizing unit 108 during the performance of the live content and the first effect correspondence information stored in the storage unit 102. Decide what to do. The effect processing determination unit 110 determines the effect processing to be executed based on the aggregation result of the communication terminal-related data aggregated by the aggregation unit 108 and the second effect correspondence information stored in the storage unit 102. good.

The effect processing determination unit 110 may determine the effect processing to be executed further based on the IoT sensor data stored in the storage unit 102 . The effect processing determination unit 110 may determine the effect processing to be executed further based on the environment data stored in the storage unit 102 .

For example, the effect processing determination unit 110 determines, as the effect processing to be executed, effect processing that satisfies a predetermined effect processing determination condition in which an input operation is determined. For example, the effect process determination unit 110 determines, as the effect process to be executed, the effect process associated with the input operation with the largest total number of input operations during a predetermined period. Effect processing determination unit 110 determines, as effect processing to be executed, effect processing associated with an input operation in which the total number of input operations during a predetermined period is greater than a predetermined total number threshold. may The effect processing determination unit 110 may determine, as the effect processing to be executed, effect processing in which the communication terminal-related data satisfies the effect processing determination condition.

For example, when the live content is XR content, the effect processing determination unit 110 determines the effect processing for changing the content of the XR content as the effect processing to be executed. The effect processing determination unit 110 may determine, as the effect processing to be executed, the effect processing of changing the output of the device used for performing the live content. A device used for presenting live content is, for example, a sound output device such as a speaker. Equipment used for presenting live content is, for example, a lighting device. The equipment used to present live content may be any other device.

The information transmission unit 112 transmits various kinds of information to the external device. The information transmission unit 112 transmits various kinds of information to an external device via the network 20, for example.

The information transmission unit 112 transmits various information to the communication terminal 300, for example. The information transmission unit 112 transmits, for example, a transmission request requesting transmission of input operation information to the communication terminal 300 . The information transmitting unit 112 transmits, to the communication terminal 300, the transmission request including valid input manipulation information indicating valid input manipulations counted by the counting unit 108, for example. For example, the information transmitting unit 112 transmits the transmission request to the communication terminal 300 in response to a change in the valid input operations counted by the counting unit 108 . Upon receiving the transmission request from information processing apparatus 100, communication terminal 300 transmits input operation information to information processing apparatus 100 when a valid input operation indicated by valid input operation information included in the transmission request is input. you can

Information transmitting section 112 may transmit a transmission request requesting transmission of communication terminal-related data to communication terminal 300 . Upon receiving the transmission request from the information processing device 100 , the communication terminal 300 may transmit communication terminal related information including the communication terminal related data to the information processing device 100 .

The information transmitting unit 112 transmits a transmission stop instruction for instructing to stop transmitting the remaining battery amount information, for example, when the counting result of the remaining battery amount collected by the totalizing unit 108 does not satisfy a predetermined remaining battery amount condition. Send to terminal 300 . For example, when the aggregation result of the communication terminal-related data aggregated by the aggregation unit 108 does not satisfy a predetermined communication terminal-related data condition, the information transmission unit 112 issues a transmission stop instruction to instruct to stop transmission of the communication terminal-related information. to the communication terminal 300.

The information transmission unit 112 transmits various kinds of information to the content distribution device 200, for example. The information transmitting unit 112 transmits, for example, information based on the totalized result of the input operations totalized by the totalizing unit 108 to the content distribution device 200 . The information transmitting unit 112 transmits, to the content distribution apparatus 200, the input operation tally result tallied by the tally unit 108, for example, as information based on the input operation tally result. The information transmitting unit 112 transmits effect processing information indicating the effect processing determined by the effect processing determining unit 110 based on the total result of the input operations collected by the total unit 108 as information based on the total result of the input operation. may be sent to

The information transmission unit 112 transmits, for example, information based on the totalization result of the communication terminal-related data totalized by the totalization unit 108 to the content distribution device 200 . The information transmitting unit 112 transmits, for example, the aggregation result of the communication terminal-related data aggregated by the aggregation unit 108 to the content distribution apparatus 200 as information based on the aggregation result of the communication terminal-related data. The information transmission unit 112 transmits the effect processing information determined by the effect processing determination unit 110 based on the result of the aggregation of the communication terminal-related data aggregated by the aggregation unit 108 as information based on the aggregation result of the communication terminal-related data to the content distribution device 200. may be sent to The information transmission unit 112 may transmit the result of counting the remaining battery levels by the counting unit 108 to the content distribution device 200 .

The information transmission unit 112 transmits various information to the communication terminal 400, for example. The information transmission unit 112 transmits, for example, the same information as the information transmitted to the content distribution device 200 to the communication terminal 400 . Information transmitting section 112 may transmit arbitrary information different from the information transmitted to content distribution apparatus 200 to communication terminal 400 .

The content generation unit 114 generates XR content when the live content is XR content. The content generation unit 114 generates, for example, XR content during a live content performance.

The content generation unit 114 renders the XR content including the effect processing for the execution target XR content determined by the effect processing determination unit 110, for example, based on the motion data received by the information reception unit 106 from the motion capture device 500. generates XR content. The information transmission section 112 may transmit the XR content generated by the content generation section 114 .

The information processing device 100 may not have the effect correspondence information registration unit 104 and the effect processing determination unit 110 . In this case, an external device such as the content distribution device 200 may determine the rendering process for the live content to be executed.

The information processing device 100 does not have to have the content generation unit 114 . In this case, an external device such as the content distribution device 200 may generate the live content.

FIG. 9 schematically shows an example of the functional configuration of the content distribution device 200. As shown in FIG. The content distribution device 200 has a storage unit 202 , an effect correspondence information registration unit 204 , an information reception unit 206 , an effect processing determination unit 208 , an information transmission unit 210 and a content generation unit 212 . It should be noted that it is not essential that the content distribution device 200 have all of these configurations.

The storage unit 202 stores various information. The storage unit 202 stores, for example, effect correspondence information. The storage unit 202 stores, for example, first effect correspondence information. The storage unit 202 stores, for example, second effect correspondence information.

The effect correspondence information registration unit 204 registers the effect correspondence information in the storage unit 202 . The effect-related information registration unit 204 registers the effect-related information in the storage unit 202 in the same manner as the effect-related information registration unit 104, for example.

The information receiving unit 206 receives various information from an external device. The information receiving unit 206 receives various types of information from, for example, an external device via the network 20 . The information receiving unit 206 receives various types of information from an external device, for example, during a live content performance. The information receiving section 206 stores the received various information in the storage section 202 .

The information receiving unit 206 receives various information from the information processing apparatus 100, for example. The information receiving unit 206 receives, for example, from the information processing apparatus 100 information based on the totalized results of the information processing apparatus 100 . The information receiving unit 206 receives, for example, from the information processing apparatus 100 information based on the result of counting the input operations counted by the information processing apparatus 100 . The information receiving unit 206 receives, for example, from the information processing apparatus 100 information based on the totalization result of the communication terminal-related data collected by the information processing apparatus 100 . The information receiving unit 206 may receive, from the information processing device 100 , the result of counting the remaining battery levels counted by the information processing device 100 .

The information receiving unit 206 receives various information from the communication terminal 400, for example. The information receiving unit 106 receives presentation correspondence information from the communication terminal 400, for example. The effect-related information registration unit 204 may register the effect-related information received by the information receiving unit 206 from the communication terminal 400 in the storage unit 202 .

The information receiver 206 may receive IoT sensor data from the IoT sensor 600 . The information receiving section 206 may receive environmental data from the environmental data management device 700 . The information receiving section 206 may receive arbitrary data from any other external device.

The effect processing determination unit 208 determines effect processing for the live content to be executed. The effect processing determining unit 208 determines, for example, effect processing to be executed during a live content performance.

For example, the effect processing determination unit 208 is based on the information based on the result of totaling by the information processing device 100 received by the information receiving unit 206 from the information processing device 100 and the effect correspondence information stored in the storage unit 202. to determine the effect processing to be executed. The effect processing determination unit 208 determines the effect processing to be executed, for example, based on the total result of input operations collected by the information processing device 100 and the first effect correspondence information stored in the storage unit 202 . The effect processing determination unit 208 determines the effect processing to be executed based on the total result of the communication terminal-related data collected by the information processing device 100 and the second effect correspondence information stored in the storage unit 202. good too. The effect processing determination unit 208 determines the effect processing to be executed, for example, in the same manner as the effect processing determination unit 110 .

The information transmission unit 210 transmits various kinds of information to the external device. The information transmission unit 210 transmits various kinds of information to an external device via the network 20, for example.

The information transmission unit 210 distributes, for example, live content. The information transmission unit 210 distributes live content so that it can be displayed on the display device 40, for example.

The information transmission unit 210 transmits various kinds of information to the information processing device 100, for example. The information receiving unit 206 transmits, for example, the effect correspondence information to the information processing device 100 . The information transmitting section 210 may transmit input operation flag change instruction information to the information processing apparatus 100 .

Information transmitting section 210 may transmit various types of information to communication terminal 400 . The information transmitting unit 210 transmits to the communication terminal 400, for example, information based on the aggregated results of the information processing apparatus 100, which the information receiving unit 206 has received from the information processing apparatus 100. FIG.

The content generation unit 212 generates XR content when the live content is XR content. The content generation unit 212 generates XR content during a live content performance, for example. The content generation unit 212 generates XR content in the same manner as the content generation unit 114, for example.

FIG. 10 schematically shows an example of event correspondence information stored in the information processing apparatus 100. As shown in FIG. FIG. 10 mainly describes an example of the event correspondence information when the live content is XR content of live music.

The event correspondence information in FIG. 10 includes an event tag of an event that determines the effect processing for the XR content to be executed, a counting start time at which the counting unit 108 starts counting input operations, and a counting unit 108 counts the input operations. The aggregation period, aggregation mode, valid input operation, and input operation flag are associated with each other. In addition, in FIG. 10, the counting start time is represented by the elapsed time from the delivery start time of the XR content.

The counting start time of the event tag "voting event 1" is "00:30:00". The counting period of the event tag “voting event 1” is “5 minutes”. The counting mode of the event tag "voting event 1" is the "overwrite" mode. Valid input operations for the event tag "voting event 1" are "left swing", which is an operation of swinging the communication terminal 300 to the left, and "right swing", which is an operation of swinging the communication terminal 300 to the right. The input operation flag of the event tag "voting event 1" is "valid".

The counting start time of the event tag "voting event 2" is "01:30:00". The counting period of the event tag “voting event 2” is “8 minutes”. The tabulation mode of the event tag "voting event 2" is the "overwrite" mode. Valid input operations for the event tag "voting event 2" are "swing up", which is an operation of swinging the communication terminal 300 upward, and "swing down", which is an operation of swinging the communication terminal 300 downward. The input operation flag of the event tag "voting event 2" is "valid".

The counting start time of the event tag "tap event 1" is "01:00:00". The aggregation period of the event tag “tap event 1” is “10 minutes”. The aggregation mode of the event tag "tap event 1" is the "accumulation" mode. A valid input operation for the event tag “tap event 1” is “tap the “open” button”, which is an operation for tapping the “open” button displayed on the communication terminal 300 . The input operation flag of the event tag "tap event 1" is "valid".

The counting start time of the event tag “tap event 2” is “00:45:00”. The aggregation period of the event tag “tap event 2” is “20 minutes”. The aggregation mode of the event tag "tap event 2" is the "accumulation" mode. A valid input operation for the event tag “tap event 2” is “tap the “Like” button”, which is an operation of tapping the “Like” button displayed on the communication terminal 300 . The input operation flag of the event tag “tap event 2” is “invalid”.

FIG. 11 schematically shows an example of the tallied results tallied by the information processing apparatus 100 . FIG. 11 shows an example of the tally result of tallying the input operations of a plurality of communication terminals 300 in "voting event 1", "voting event 2", and "tap event 1" in which the input operation flag of FIG. 10 is valid. Mainly explained.

The number of communication terminals 300 participating in the event tag “voting event 1” is “200”. The total number of valid input operations for the event tag “voting event 1” is “150 times” for “left swing” and “50 times” for “right swing”.

The number of communication terminals 300 participating in the event tag “voting event 2” is “150”. The total number of valid input operations for the event tag “voting event 2” is “120 times” for “up swing” and “30 times” for “down swing”.

The number of communication terminals 300 participating in the event tag “tap event 1” is “300”. The total number of valid input operations for “tap event 1” is “2000 times” for the event tag “tap”.

FIG. 12 schematically shows another example of the tallied results tallied by the information processing apparatus 100 . FIG. 12 mainly describes an example of the tally result when input operations are tallied for each communication terminal 300 in the tally result of FIG. 11 .

The user identification information of "communication terminal A" is "user A". A ticket purchased by a live content spectator who owns “communication terminal A” is a “normal ticket”. The events in which "communication terminal A" participated are "voting event 1", "voting event 2", and "tap event 1". The event participation rate of "communication terminal A" is "100%". The input operation indicated by the input operation information transmitted from "communication terminal A" to information processing apparatus 100 in "voting event 1" is "left swing". The input operation indicated by the input operation information transmitted from "communication terminal A" to information processing apparatus 100 in "voting event 2" is "down swing". The input operation indicated by the input operation information transmitted from "communication terminal A" to information processing apparatus 100 in "tap event 1" is "double tap". In this case, the “communication terminal A”, for example, transmits the input operation information indicating the operation of tapping the “open” button to the information processing apparatus 100 twice during the counting period of the “tap event 1”. "Communication terminal A" counts that the operation of tapping the "open" button is input twice during the counting period of "tap event 1", and the input operation indicating the operation of tapping the "open" button twice Information may be transmitted to the information processing device 100 .

The user identification information of "communication terminal B" is "user B". A ticket purchased by a live content spectator who owns “communication terminal B” is a “premium ticket”. The event in which "communication terminal B" participated is "voting event 2". The event participation rate of “communication terminal B” is “33%”. Since "communication terminal B" has not participated in "voting event 1", "communication terminal B" has not transmitted input operation information to information processing apparatus 100 in "voting event 1". Therefore, the input operation indicated by the input operation information transmitted from "communication terminal B" to information processing apparatus 100 in "voting event 1" is "none". The input operation indicated by the input operation information transmitted from "communication terminal B" to information processing apparatus 100 in "voting event 2" is "down swing". Since "communication terminal B" does not participate in "tap event 1", "communication terminal B" does not transmit input operation information to information processing apparatus 100 in "tap event 1". Therefore, the input operation indicated by the input operation information transmitted from the "communication terminal B" to the information processing apparatus 100 at the "tap event 1" is "none".

The user identification information of "communication terminal C" is "user C". A ticket purchased by a live content spectator who owns “communication terminal C” is a “normal ticket”. The events in which “communication terminal C” participated are “voting event 1” and “tap event 1”. The event participation rate of “communication terminal C” is “67%”. The input operation indicated by the input operation information transmitted from "communication terminal C" to information processing apparatus 100 in "voting event 1" is "swing right". Since "communication terminal C" has not participated in "voting event 2", "communication terminal C" has not transmitted input operation information to information processing apparatus 100 in "voting event 2". Therefore, the input operation indicated by the input operation information transmitted from "communication terminal C" to information processing apparatus 100 in "voting event 2" is "none". The input operation indicated by the input operation information transmitted from the "communication terminal C" to the information processing apparatus 100 in the "tap event 1" is "tap 30 times". In this case, the “communication terminal C”, for example, transmits input operation information indicating an operation of tapping the “open” button to the information processing apparatus 100 30 times during the counting period of the “tap event 1”. "Communication terminal C" counts that the operation of tapping the "open" button is input 30 times during the counting period of "tap event 1", and the input operation indicating the operation of tapping the "open" button 30 times Information may be transmitted to the information processing device 100 .

Aggregation unit 108 , for example, weights input operations indicated by input operation information received from one communication terminal 300 more than input operations indicated by input operation information received from other communication terminals 300 , and totals them. Aggregation unit 108 converts an input operation indicated by input operation information received from one communication terminal 300 to an input operation indicated by input operation information received from another communication terminal 300, for example, based on the aggregated results obtained in the past. Aggregate by weighting more than operations. Aggregation unit 108, for example, collects input operations indicated by input operation information received from communication terminals 300 whose event participation rate is higher than a predetermined event participation rate threshold, to communication terminals 300 whose event participation rate is lower than event participation rate threshold. The input operations indicated by the input operation information received from are weighted and tabulated. In the example shown in FIG. 12 , when the event participation rate threshold is 75%, totaling unit 108 counts the input operation indicated by the input operation information received from communication terminal A as the input operation received from communication terminal B and communication terminal C. The input operations indicated by the operation information are weighted and tabulated.

Based on the user information stored in the storage unit 102, the counting unit 108 converts the input operation indicated by the input operation information received from one communication terminal 300 to the input operation information received from the other communication terminal 300. The input operation may be weighted and tabulated. For example, the tallying unit 108 converts the input operation indicated by the input operation information received from the communication terminal 300 owned by the live content spectator who purchased the premium ticket to the communication terminal 300 owned by the live content spectator who purchased the normal ticket. The input operations indicated by the input operation information received from are weighted and tabulated. In the example shown in FIG. 12, the counting unit 108 weights the input operation indicated by the input operation information received from communication terminal B more than the input operation indicated by the input operation information received from communication terminal A and communication terminal C. Tally.

FIG. 13 schematically shows an example of effect correspondence information stored in the content distribution device 200. As shown in FIG. FIG. 13 mainly describes an example of the first effect correspondence information corresponding to the event correspondence information shown in FIG.

The first effect correspondence information in FIG. 13 corresponds to the event tag of the event that determines the effect process for the XR content to be executed, the event execution condition, the valid input operation, the effect process to be performed, and the effect determination condition. attached.

The event execution condition of the event tag "voting event 1" is "none". Valid input operations for the event tag "voting event 1" are "left swing" and "right swing". The production process for the production target of the event tag "voting event 1" is the production process "virtual character wears hat A and plays song 1" if "swing left" is the production determination condition, and "swing right". satisfies the production decision condition, the production process is "the virtual character wears the hat B and plays the tune 1". The effect determination condition for the event tag "voting event 1" is "the total number of input operations is the largest" during the tallying period.

The event execution condition for the event tag "voting event 2" is "average remaining battery capacity>30%". The average remaining battery level is an average of the remaining battery levels indicated by the remaining battery level information received by the information receiving unit 106 from each of the plurality of communication terminals 300 . Valid input operations for the event tag "voting event 2" are "up swing" and "down swing". The production process for the production target of the event tag "voting event 2" is the production process "virtual character plays song 2" if "up swing" is the production determination condition, and "down swing" is the production determination condition. is satisfied, the effect processing is "the virtual character plays tune 3". The effect determination condition for the event tag "voting event 2" is "the total number of input operations is the largest" during the tallying period.

The event execution condition of the event tag "tap event 1" is "none". A valid input operation for the event tag "tap event 1" is "tap the 'open' button". The effect processing for the effect target of the event tag “tap event 1” is the effect processing “opening a treasure box”. The effect determination condition for the event tag "tap event 1" is "the total number of taps of the "open" button>1000 times" during the counting period. The total number of taps of the “open” button is the total number of operations of tapping the “open” button indicated by the input operation information from each of the plurality of communication terminals 300 by the information receiving unit 106 .

The event execution condition of the event tag “tap event 2” is “average temperature of temperature data<35° C.”. The average temperature of the temperature data is the average of the temperature data indicated by the communication terminal related information received by the information receiving section 106 from each of the plurality of communication terminals 300 . A valid input operation for the event tag “tap event 2” is “tap the “Like” button”. The effect processing for the effect object of the event tag “tap event 2” is the effect processing “increase the volume” output by the speaker. The effect determination condition for the event tag "tap event 1" is "the total number of taps on the 'Like' button>5000 times" during the aggregation period. The total number of taps of the “Like” button is the total number of operations of tapping the “Like” button indicated by the input operation information from each of the plurality of communication terminals 300 by the information receiving unit 106 .

In the following description of FIG. 13, an example in which the effect processing determination unit 208 determines the effect processing to be executed based on the counting result shown in FIG. 11 and the first effect correspondence information shown in FIG. 13 is mainly described. to explain.

In the event tag “voting event 1”, the effect processing determination unit 208 determines that the total number of times of “left swing” satisfies the effect determination condition “the total number of input operations is the largest”, so the effect processing determination unit 208 determines “ A virtual character puts on a hat A and plays song 1" effect processing is determined as the effect process for the XR content to be executed in the event tag "voting event 1". The content generation unit 212 generates XR content including rendering processing of "a virtual character wears a hat A and plays song 1".

In the event tag “voting event 2”, the effect processing determination unit 208 determines that the total number of times of “up swing” satisfies the effect determination condition “the total number of input operations is the largest”, so that “ The virtual character plays song 2" rendering process is determined as the rendering process for the XR content to be executed in the event tag "voting event 2". The content generation unit 212 generates XR content including rendering processing of "virtual character plays song 2".

In the event tag "tap event 1", the effect processing determination unit 208 satisfies the effect determination condition "total number of taps of the 'open' button > 1000 times". The rendering process of "opening a treasure box" is determined as the rendering process for the XR content to be executed in the event tag "tap event 1". The content generation unit 212 generates XR content including a “treasure chest opening” rendering process.

The effect processing determination unit 208 may determine the effect processing to be performed for a specific communication terminal 300 based on the result of counting the input operations for each communication terminal 300 . For example, the effect processing determination unit 208 determines the effect processing to be performed for the communication terminal 300 to which an input operation that satisfies a predetermined input operation condition is input. The input operation condition is, for example, input of an input operation that satisfies the effect determination condition in a voting event. The input operation condition is, for example, that the largest number of tapping operations among the plurality of communication terminals 300 are input in the tap event. The input operation condition may be that a tap operation is input more than a predetermined number of taps in the tap event.

In the example of the tallied result shown in FIG. 12, the effect processing determination unit 208 sends a message “you” to communication terminal A to which an input operation that satisfies the effect determination condition is input in the event tag “voting event 1”, for example. The hat selected by has been chosen! The rendering process of "notifying" is determined as the rendering process to be rendered. The content generation unit 212 generates XR content including the rendering process. The information transmission unit 210 transmits the XR content generated by the content generation unit 212 to the communication terminal A. FIG.

In the example of the tallied result shown in FIG. 12, the effect processing determination unit 208 selects, for example, the communication terminal C that has received the largest number of tapping operations among the plurality of communication terminals 300 in the event tag "tap event 1". On the other hand, "Message" You Win! The rendering process of "notifying" is determined as the rendering process to be rendered. The content generation unit 212 generates XR content including the rendering process. The information transmission unit 210 transmits the XR content generated by the content generation unit 212 to the communication terminal C. FIG.

FIG. 14 schematically shows an example of communication terminal-related data correspondence information stored in information processing apparatus 100. As shown in FIG. FIG. 14 mainly describes an example of the communication terminal-related data correspondence information when the live content is XR content of live music.

The communication terminal-related data correspondence information in FIG. 14 associates communication terminal-related data tags, communication terminal-related data, reception conditions, and aggregation modes.

The communication terminal-related data of the communication terminal-related data tag “communication terminal-related data 1” is “location data” of the communication terminal 300 . The reception condition for receiving the position data of the communication terminal-related data tag "communication terminal-related data 1" is "none". The aggregation mode of the communication terminal-related data tag "communication terminal-related data 1" is the "overwrite" mode.

The communication terminal-related data of the communication terminal-related data tag “communication terminal-related data 2” is “temperature data” of the communication terminal 300 . The reception condition for receiving the temperature data of the communication terminal-related data tag "communication terminal-related data 2" is "average remaining battery level>30%". The aggregation mode of the communication terminal-related data tag "communication terminal-related data 2" is the "overwrite" mode.

FIG. 15 schematically shows another example of the tallied results tallied by the information processing apparatus 100 . 15, position data of the communication terminal 300 corresponding to the communication terminal-related data tag "communication terminal-related data 1" and temperature data of the communication terminal 300 corresponding to the communication terminal-related data tag "communication terminal-related data 2" of FIG. An example of the aggregated result of aggregated will be mainly described.

The number of communication terminals 300 that have transmitted position data to information processing apparatus 100 is "300". Among them, the number of communication terminals 300 that have transmitted the position data of “position A” is “5”, the number of communication terminals 300 that have transmitted the position data of “position B” is “10”, and the number of communication terminals 300 that have transmitted the position data of “position B” is “10”. The number of communication terminals 300 that have transmitted the position data of "position C" is "150", the number of communication terminals 300 that have transmitted the position data of "position D" is "55", and the position of "position E" is The number of communication terminals 300 that have transmitted data is "80".

The number of communication terminals 300 that have transmitted temperature data to the information processing apparatus 100 is "300". Of these, the number of communication terminals 300 that have transmitted temperature data indicating a temperature of “25° C. or less” is “5,” and the number of communication terminals 300 that have transmitted temperature data indicating a temperature of “25 to 30° C.” is “120”, the number of communication terminals 300 that have transmitted temperature data indicating a temperature of “30 to 35° C.” is “165”, and the number of communication terminals that have transmitted temperature data indicating a temperature of “35° C. or higher” is “165”. The number of terminals of the terminal 300 is "10". The average temperature of the temperature data transmitted from each of the "300" communication terminals 300 to the information processing apparatus 100 is "32.5"°C.

FIG. 16 schematically shows another example of the effect correspondence information stored in the content distribution device 200. As shown in FIG. FIG. 16 mainly describes an example of the second effect correspondence information corresponding to the communication terminal-related data correspondence information shown in FIG.

The second effect correspondence information in FIG. 16 associates a communication terminal-related data tag, communication terminal-related data, effect processing for the XR content to be executed, and effect processing determination conditions.

The communication terminal-related data of the communication terminal-related data tag “communication terminal-related data 1” is “location data” of the communication terminal 300 . The effect processing for the effect object of the communication terminal related data tag "communication terminal related data 1" is the effect process "make the weather at the location indicated by the location data most frequently". The effect processing determination condition of the communication terminal-related data tag "communication terminal-related data 1" is "the position indicated by the most position data".

The communication terminal-related data of the communication terminal-related data tag “communication terminal-related data 2” is “temperature data” of the communication terminal 300 . The effect processing for the effect object of the communication terminal related data tag "communication terminal related data 2" is the effect process "the character plays while sweating". The effect processing determination condition of the communication terminal-related data tag "communication terminal-related data 2" is "average temperature of temperature data>30° C.".

In the following description of FIG. 16, an example in which the effect processing determination unit 208 determines the effect processing to be executed based on the aggregate result shown in FIG. 15 and the second effect correspondence information shown in FIG. 16 is mainly described. to explain.

In the communication terminal related data tag “communication terminal related data 1”, the effect processing determination unit 208 satisfies the effect determination condition “the position indicated by the most position data” is satisfied by the position data of “position C”. The effect processing for the XR content to be executed in the communication terminal related data tag "communication terminal related data 1" is determined as the effect processing for the XR content to be executed. The content generation unit 212 generates XR content including a rendering process of “change to the weather of the location C” based on the weather data of the location C that the information reception unit 206 received from the environmental data management device 700 .

Since the average temperature of the temperature data in the communication terminal-related data tag “communication terminal-related data 2” satisfies the effect determination condition “average temperature of temperature data>30° C.”, the effect processing determination unit 208 determines that “the character is sweating.” "Playing while playing" effect processing is determined as the effect processing for the XR content to be executed in the communication terminal related data tag "communication terminal related data 2". The content generation unit 212 generates XR content including rendering processing in which “a character performs while sweating”.

FIG. 17 is an explanatory diagram for explaining an example of the processing flow of the information processing apparatus 100. As shown in FIG. FIG. 17 mainly describes an example in which the information processing apparatus 100 transmits to the content distribution apparatus 200 the tally results of the input operations input to each of the plurality of communication terminals 300 owned by the spectators of the live content. In FIG. 17, the state after the counting start time has passed will be described as the start state.

In step (the step may be abbreviated as S) 102 , the information receiving unit 106 receives input operation information from each of the plurality of communication terminals 300 via the network 20 . For example, the content distribution device 200 distributes the XR content so that the XR content superimposed with the event notification is displayed on the display device 40 during the counting period.

In S104, if the counting period has passed, the process proceeds to S106. In S104, if the aggregation period has not elapsed, the process returns to S102.

In S106, totalizing unit 108 totalizes the input operations indicated by the input operation information received by information receiving unit 106 from each of the plurality of communication terminals 300 in S102. In S<b>108 , the information transmission unit 112 transmits the tally result of the input operations tallied by the tally unit 108 to the content distribution device 200 via the network 20 . The content distribution device 200 determines the effect processing of the live content to be executed based on the total result of the input operations received from the information processing device 100 and the first effect corresponding information stored in the content distribution device 200. do. The content distribution device 200 generates XR content including the determined effect processing to be executed, and distributes the XR content so that the generated XR content is displayed on the display device 40 . This completes the processing of the information processing apparatus 100 transmitting to the content distribution apparatus 200 the result of counting the input operations input to each of the plurality of communication terminals 300 owned by the spectators of the live content.

FIG. 18 schematically shows an example of a hardware configuration of a computer 1200 functioning as the information processing apparatus 100. As shown in FIG. Programs installed on the computer 1200 cause the computer 1200 to act as one or more "parts" of the apparatus of the above embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the above embodiments. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the processes or steps of the processes according to the above embodiments. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

Computer 1200 according to this embodiment includes CPU 1212 , RAM 1214 , and graphics controller 1216 , which are interconnected by host controller 1210 . Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , DVD drive 1226 , and IC card drive, which are connected to host controller 1210 via input/output controller 1220 . DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, and the like. Storage devices 1224 may be hard disk drives, solid state drives, and the like. Computer 1200 also includes legacy input/output units, such as ROM 1230 and keyboard 1242 , which are connected to input/output controller 1220 via input/output chip 1240 .

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .

Communication interface 1222 communicates with other electronic devices over a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 . DVD drive 1226 reads programs or data from DVD-ROM 1227 or the like and provides them to storage device 1224 . The IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.

ROM 1230 stores therein programs that are dependent on the hardware of computer 1200, such as a boot program that is executed by computer 1200 upon activation. Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.

The program is provided by a computer-readable storage medium such as DVD-ROM 1227 or IC card. The program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 . The information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as a RAM 1214, a storage device 1224, a DVD-ROM 1227, or an IC card, and transmits the read transmission data. Data is transmitted to the network, or received data received from the network is written in a receive buffer area or the like provided on the recording medium.

In addition, the CPU 1212 causes the RAM 1214 to read all or necessary portions of files or databases stored in external recording media such as the storage device 1224, DVD drive 1226 (DVD-ROM 1227), IC card, etc. Various types of processing may be performed on the data. CPU 1212 may then write back the processed data to an external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on recording media and subjected to information processing. CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 . Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. provide.

The blocks in the flowcharts and block diagrams in this embodiment may represent steps in the process in which the operations are performed or "parts" of the apparatus responsible for performing the operations. Certain steps and "sections" may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry. Programmable circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.

A computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.

The computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include

Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the description of the scope of claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The execution order of each process such as actions, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is etc., and it should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if the description is made using "first," "next," etc. for convenience, it means that it is essential to carry out in this order. not a thing

10 system, 20 network, 40 display device, 45 display device, 100 information processing device, 102 storage unit, 104 effect correspondence information registration unit, 106 information reception unit, 108 aggregation unit, 110 effect processing determination unit, 112 information transmission unit, 114 content generation unit 200 content distribution device 202 storage unit 204 effect correspondence information registration unit 206 information reception unit 208 effect processing determination unit 210 information transmission unit 212 content generation unit 220 processor 230 counting result storage unit , 240 performance corresponding information storage unit, 260 IoT sensor data storage unit, 270 environment data storage unit, 300 communication terminal, 400 communication terminal, 500 motion capture device, 600 IoT sensor, 700 environment data management device, 1200 computer, 1210 host controller , 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input/output controller, 1222 communication interface, 1224 storage device, 1226 DVD drive, 1227 DVD-ROM, 1230 ROM, 1240 input/output chip, 1242 keyboard

Claims (17)

an information processing device;
comprising a content distribution device and
The information processing device is
a first information receiving unit that receives input operation information indicating an input operation input to a communication terminal from each of a plurality of communication terminals owned by spectators of the live content;
an aggregating unit for aggregating the input operations indicated by the input operation information received by the first information receiving unit from each of the plurality of communication terminals;
an information transmission unit configured to transmit the result of the input operations aggregated by the aggregation unit to the content distribution device;
The content distribution device is
a storage unit that stores first effect correspondence information that associates the type of input operation to the communication terminal with the effect processing for the live content;
a second information receiving unit that receives the tallied result of the input operation from the information processing device;
an effect processing determining unit that determines effect processing to be executed based on the total result of the input operations received by the second information receiving unit and the first effect correspondence information stored in the storage unit; An information processing system. the counting unit counts the input operations indicated by the input operation information received from each of the plurality of communication terminals during the performance of the live content by the first information receiving unit;
The effect processing determining unit determines the effect processing based on the result of the input operation counted by the counting unit during the performance of the live content.
The information processing system according to claim 1. 3. The information processing system according to claim 1, wherein said effect processing determination unit determines said effect processing associated with an input operation having the largest total number of input operations during a predetermined period. 4. The effect process determination unit determines the effect process associated with an input operation in which the total number of input operations during a predetermined period is greater than a predetermined total number threshold. The information processing system according to any one of . The aggregating unit determines whether the input operation flag indicating whether the input operation is valid or invalid among the input operations indicated by the input operation information received from each of the plurality of communication terminals is valid. aggregate operations,
The information processing system according to any one of claims 1 to 4. The counting unit counts the input operations for each communication terminal,
6. The effect process determination unit according to any one of claims 1 to 5, wherein the effect process determination unit determines the effect process for the communication terminal to which the input operation that satisfies a predetermined input operation condition is input. Information processing system. The totalizing unit weights the input operations indicated by the input operation information received from one of the communication terminals more than the input operations indicated by the input operation information received from the other communication terminals, and totals the input operations. The information processing system according to any one of claims 1 to 6. The first information receiving unit receives, from each of the plurality of communication terminals, remaining battery level information indicating the remaining battery level of the communication terminal,
the totalizing unit totalizes the remaining battery power indicated by the remaining battery power information received by the first information receiving unit from each of the plurality of communication terminals;
The information transmission unit transmits a total result of the battery remaining amount collected by the totalization unit to the content distribution device,
The second information receiving unit receives the counting result of the remaining battery power from the information processing device,
The effect processing determining unit executes an event for determining the effect processing when the counting result of the remaining battery level received by the second information receiving unit satisfies a predetermined remaining battery level condition.
The information processing system according to any one of claims 1 to 7. The first information receiving unit receives communication terminal-related information including communication terminal-related data from each of the plurality of communication terminals,
the totalizing unit totalizes the communication terminal-related data included in the communication terminal-related information received by the first information receiving unit from each of the plurality of communication terminals;
The information transmission unit transmits a result of aggregation of the communication terminal-related data aggregated by the aggregation unit to the content distribution device,
The storage unit stores second effect correspondence information that associates a type of communication terminal-related data related to the communication terminal with the effect process,
The second information receiving unit receives the aggregation result of the communication terminal-related data from the information processing device,
The effect processing determination unit performs the effect processing based on the result of aggregation of the communication terminal-related data received by the second information receiving unit and the second effect correspondence information stored in the storage unit. decide,
The information processing system according to any one of claims 1 to 8. The information processing system according to any one of claims 1 to 9, wherein the effect processing determination unit determines the effect processing for changing the content of the live content that is XR (Cross Reality) content. 11. The information processing system according to any one of claims 1 to 10, wherein said effect processing determination unit determines said effect processing for changing an output of a device used for performing said live content. The first information receiving unit receives, from each of the plurality of communication terminals, the input operation information indicating the input operation detected by at least one of a gyro sensor and an acceleration sensor mounted on the communication terminal. The information processing system according to any one of claims 1 to 11. an information receiving unit that receives input operation information indicating an input operation input to a communication terminal from each of a plurality of communication terminals owned by spectators of the live content;
an aggregating unit for aggregating the input operations indicated by the input operation information received by the information receiving unit from each of the plurality of communication terminals;
An information processing apparatus, comprising: an information transmitting unit that transmits information based on the result of counting the input operations counted by the counting unit. a storage unit that stores first effect correspondence information that associates the type of input operation to the communication terminal with the effect processing for the live content;
an effect processing determination unit that determines effect processing to be executed based on the total result of the input operations collected by the total unit and the first effect correspondence information stored in the storage unit. ,
The information transmission unit transmits effect processing information indicating the effect processing determined by the effect processing determination unit.
The information processing apparatus according to claim 13. A program for causing a computer to function as the information processing apparatus according to claim 13 or 14. a first information receiving step in which the information processing device receives input operation information indicating an input operation input to the communication terminal from each of a plurality of communication terminals owned by spectators of the live content;
an aggregating step in which the information processing device aggregates the input operations indicated by the input operation information received from each of the plurality of communication terminals in the first information receiving step;
an information transmission step in which the information processing device transmits a tally result of the input operations tallied in the tally step to a content distribution device;
a second information receiving step in which the content distribution device receives the tallied result of the input operation from the information processing device;
The result of the counting of the input operations received by the content distribution device in the second information receiving stage, the type of input operation for the communication terminal and the effect processing for the live content stored in the content distribution device. and an effect processing determination step of determining effect processing to be executed based on the first effect correspondence information associated with . A computer-implemented information processing method comprising:
an information receiving step of receiving input operation information indicating an input operation input to a communication terminal from each of a plurality of communication terminals owned by spectators of the live content;
an aggregating step of aggregating the input operations indicated by the input operation information received from each of the plurality of communication terminals in the information receiving step;
and an information transmission step of transmitting information based on the tallied result of the input operations tallied in the tally step.

Images